2024-09-21T12:26:54.047 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T12:26:54.073 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T12:26:54.176 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946 branch: wip-guits-main-2024-09-21-0842 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7913946' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-21-0842 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 441784946648ff53dd310293f9dd752afeeea72a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 441784946648ff53dd310293f9dd752afeeea72a kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-21-0842 sha1: 441784946648ff53dd310293f9dd752afeeea72a owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 5896 sha1: 441784946648ff53dd310293f9dd752afeeea72a sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-21-0842 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 441784946648ff53dd310293f9dd752afeeea72a targets: smithi046.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP23xYWsvv9VcArcxpQgc9YpMw+VcuRTK4Yz3KtbqSVp3bMkpw4iI2Itp5hHHHzYZZTy+bdFDxldkkuOAtNzuew= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvgsVGl9WCXfPYCiK0cx054lz42KvIdwS7FET22fp5SE+S4VAMVk8aph/g97swbZYtVksWJyL9kkl86kyObd2U= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_11:23:40 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-21T12:26:54.176 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa; will attempt to use it 2024-09-21T12:26:54.177 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks 2024-09-21T12:26:54.177 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T12:26:54.178 INFO:teuthology.task.internal:Checking packages... 2024-09-21T12:26:54.200 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '441784946648ff53dd310293f9dd752afeeea72a' 2024-09-21T12:26:54.200 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:26:54.200 INFO:teuthology.packaging:ref: None 2024-09-21T12:26:54.200 INFO:teuthology.packaging:tag: None 2024-09-21T12:26:54.200 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-21-0842 2024-09-21T12:26:54.200 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:26:54.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-21-0842 2024-09-21T12:26:54.343 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5104.g44178494 2024-09-21T12:26:54.344 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T12:26:54.353 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T12:26:54.353 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T12:26:54.374 INFO:teuthology.task.internal:Saving configuration 2024-09-21T12:26:54.395 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T12:26:54.403 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T12:26:54.426 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi046.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 12:21:54.708113', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP23xYWsvv9VcArcxpQgc9YpMw+VcuRTK4Yz3KtbqSVp3bMkpw4iI2Itp5hHHHzYZZTy+bdFDxldkkuOAtNzuew='} 2024-09-21T12:26:54.446 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 12:21:54.706339', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvgsVGl9WCXfPYCiK0cx054lz42KvIdwS7FET22fp5SE+S4VAMVk8aph/g97swbZYtVksWJyL9kkl86kyObd2U='} 2024-09-21T12:26:54.446 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T12:26:54.453 INFO:teuthology.task.internal:roles: ubuntu@smithi046.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-21T12:26:54.453 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-21T12:26:54.453 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T12:26:54.514 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f18c8788280>, signals=[15]) 2024-09-21T12:26:54.515 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T12:26:54.521 INFO:teuthology.task.internal:Opening connections... 2024-09-21T12:26:54.521 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:26:54.522 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:26:54.597 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2024-09-21T12:26:54.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:26:54.672 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T12:26:54.678 DEBUG:teuthology.orchestra.run.smithi046:> uname -m 2024-09-21T12:26:54.696 INFO:teuthology.orchestra.run.smithi046.stdout:x86_64 2024-09-21T12:26:54.697 DEBUG:teuthology.orchestra.run.smithi046:> cat /etc/os-release 2024-09-21T12:26:54.754 INFO:teuthology.orchestra.run.smithi046.stdout:NAME="CentOS Stream" 2024-09-21T12:26:54.754 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION="9" 2024-09-21T12:26:54.754 INFO:teuthology.orchestra.run.smithi046.stdout:ID="centos" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:ID_LIKE="rhel fedora" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:VERSION_ID="9" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:PLATFORM_ID="platform:el9" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:ANSI_COLOR="0;31" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:LOGO="fedora-logo-icon" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:HOME_URL="https://centos.org/" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T12:26:54.755 INFO:teuthology.orchestra.run.smithi046.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T12:26:54.756 INFO:teuthology.lock.ops:Updating smithi046.front.sepia.ceph.com on lock server 2024-09-21T12:26:54.775 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2024-09-21T12:26:54.794 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2024-09-21T12:26:54.795 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2024-09-21T12:26:54.853 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="CentOS Stream" 2024-09-21T12:26:54.853 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="9" 2024-09-21T12:26:54.853 INFO:teuthology.orchestra.run.smithi176.stdout:ID="centos" 2024-09-21T12:26:54.853 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="rhel fedora" 2024-09-21T12:26:54.853 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="9" 2024-09-21T12:26:54.853 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el9" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:LOGO="fedora-logo-icon" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://centos.org/" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T12:26:54.854 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T12:26:54.854 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2024-09-21T12:26:54.875 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T12:26:54.884 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T12:26:54.889 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T12:26:54.890 DEBUG:teuthology.orchestra.run.smithi046:> test '!' -e /home/ubuntu/cephtest 2024-09-21T12:26:54.892 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2024-09-21T12:26:54.911 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T12:26:54.917 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T12:26:54.917 DEBUG:teuthology.orchestra.run.smithi046:> test -z $(ls -A /var/lib/ceph) 2024-09-21T12:26:54.950 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2024-09-21T12:26:55.065 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T12:26:55.113 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T12:26:55.127 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T12:26:55.127 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T12:26:55.128 DEBUG:teuthology.orchestra.run.smithi046:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T12:26:55.128 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T12:26:55.145 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:26:55.145 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-21T12:26:55.146 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:26:55.146 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-21T12:26:55.203 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-503.el9.x86_64 2024-09-21T12:26:55.203 INFO:teuthology.task.kernel:Running kernel on smithi046: 5.14.0-503.el9.x86_64 2024-09-21T12:26:55.203 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum install -y kernel 2024-09-21T12:26:55.204 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-503.el9.x86_64 2024-09-21T12:26:55.204 INFO:teuthology.task.kernel:Running kernel on smithi176: 5.14.0-503.el9.x86_64 2024-09-21T12:26:55.205 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2024-09-21T12:26:57.595 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-21T12:26:58.063 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 7.5 MB/s | 8.3 MB 00:01 2024-09-21T12:27:01.222 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:02 2024-09-21T12:27:02.521 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 5.3 MB/s | 20 MB 00:03 2024-09-21T12:27:05.781 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T12:27:07.988 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-21T12:27:08.156 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 19 kB 00:01 2024-09-21T12:27:09.244 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T12:27:09.455 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-21T12:27:10.326 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T12:27:14.941 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-21T12:27:15.740 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-09-21T12:27:16.973 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T12:27:16.973 INFO:teuthology.orchestra.run.smithi046.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T12:27:17.056 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:27:17.062 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:27:17.062 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-21T12:27:17.063 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:27:17.064 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 79 M 2024-09-21T12:27:17.064 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 126 M 2024-09-21T12:27:17.064 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:27:17.201 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 310 kB/s | 36 kB 00:00 2024-09-21T12:27:17.672 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T12:27:17.672 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T12:27:17.760 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T12:27:17.767 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:27:17.768 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:27:17.768 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:27:17.768 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2024-09-21T12:27:17.768 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:27:17.768 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 79 M 2024-09-21T12:27:17.768 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 126 M 2024-09-21T12:27:17.769 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:27:17.793 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 48 MB/s | 29 MB 00:00 2024-09-21T12:27:18.301 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-21T12:27:18.350 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 64 kB/s | 36 kB 00:00 2024-09-21T12:27:18.744 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 21 MB/s | 35 MB 00:01 2024-09-21T12:27:18.744 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:27:18.744 INFO:teuthology.orchestra.run.smithi046.stdout:Total 47 MB/s | 79 MB 00:01 2024-09-21T12:27:19.191 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T12:27:19.455 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:27:19.850 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T12:27:19.856 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:27:19.856 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:27:20.834 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-21T12:27:20.834 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:27:20.834 INFO:teuthology.orchestra.run.smithi176.stdout:Total 26 MB/s | 79 MB 00:03 2024-09-21T12:27:20.885 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:27:20.885 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:27:21.516 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:27:21.853 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:27:21.853 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:27:22.806 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:27:22.807 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:27:23.457 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:27:24.121 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:27:24.201 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:27:25.219 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:27:25.965 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:27:26.049 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:27:26.954 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:27:27.095 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:27:28.802 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:27:28.927 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:27:32.233 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:27:32.271 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:27:33.757 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:27:33.869 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:27:37.412 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:27:38.699 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:16.575 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:16.940 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:16.941 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:28:16.941 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:28:16.941 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:28:16.965 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:17.004 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:17.335 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:17.335 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:28:17.336 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:28:17.336 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T12:28:17.766 INFO:teuthology.orchestra.run.smithi046.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T12:28:17.767 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:28:17.767 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:28:18.102 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:28:18.159 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:28:18.159 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:28:18.159 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:28:18.159 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.160 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.160 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.160 INFO:teuthology.orchestra.run.smithi176.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.160 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:28:18.160 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:28:18.186 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.186 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.186 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.186 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T12:28:18.187 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T12:28:18.187 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-21T12:28:18.187 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi046.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T12:28:18.187 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:28:18.245 INFO:teuthology.orchestra.run.smithi046.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.245 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo rpm -qi grub2-tools 2024-09-21T12:28:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:Name : grub2-tools 2024-09-21T12:28:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:Epoch : 1 2024-09-21T12:28:18.283 INFO:teuthology.orchestra.run.smithi046.stdout:Version : 2.06 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Release : 82.el9 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Architecture: x86_64 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Group : Unspecified 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Size : 8274670 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:License : GPLv3+ 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Packager : builder@centos.org 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Vendor : CentOS 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T12:28:18.284 INFO:teuthology.orchestra.run.smithi046.stdout:Summary : Support tools for GRUB. 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:Description : 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:hardware devices. 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:28:18.285 INFO:teuthology.orchestra.run.smithi046.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T12:28:18.286 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T12:28:18.286 INFO:teuthology.task.kernel:Updating grub on smithi046 to boot 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.286 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T12:28:18.563 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:28:18.655 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.655 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.655 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.655 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T12:28:18.655 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T12:28:18.655 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-21T12:28:18.655 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi176.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T12:28:18.656 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:28:18.714 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:28:18.714 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.715 DEBUG:teuthology.orchestra.run.smithi176:> sudo rpm -qi grub2-tools 2024-09-21T12:28:18.746 INFO:teuthology.orchestra.run.smithi176.stdout:Name : grub2-tools 2024-09-21T12:28:18.746 INFO:teuthology.orchestra.run.smithi176.stdout:Epoch : 1 2024-09-21T12:28:18.746 INFO:teuthology.orchestra.run.smithi176.stdout:Version : 2.06 2024-09-21T12:28:18.746 INFO:teuthology.orchestra.run.smithi176.stdout:Release : 82.el9 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Architecture: x86_64 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Group : Unspecified 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Size : 8274670 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:License : GPLv3+ 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Packager : builder@centos.org 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Vendor : CentOS 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Summary : Support tools for GRUB. 2024-09-21T12:28:18.747 INFO:teuthology.orchestra.run.smithi176.stdout:Description : 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout:hardware devices. 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:28:18.748 INFO:teuthology.orchestra.run.smithi176.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T12:28:18.749 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T12:28:18.749 INFO:teuthology.task.kernel:Updating grub on smithi176 to boot 5.14.0-508.el9.x86_64 2024-09-21T12:28:18.749 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T12:28:18.844 INFO:teuthology.orchestra.run.smithi046.stderr:Generating grub configuration file ... 2024-09-21T12:28:19.384 INFO:teuthology.orchestra.run.smithi176.stderr:Generating grub configuration file ... 2024-09-21T12:28:20.273 INFO:teuthology.orchestra.run.smithi046.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T12:28:20.314 INFO:teuthology.orchestra.run.smithi046.stderr:done 2024-09-21T12:28:20.316 DEBUG:teuthology.orchestra.run.smithi046:> mktemp 2024-09-21T12:28:20.331 INFO:teuthology.orchestra.run.smithi046.stdout:/tmp/tmp.0ngbIeZejR 2024-09-21T12:28:20.331 DEBUG:teuthology.orchestra.run.smithi046:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0ngbIeZejR 2024-09-21T12:28:20.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0666 /tmp/tmp.0ngbIeZejR 2024-09-21T12:28:20.534 DEBUG:teuthology.orchestra.remote:smithi046:/tmp/tmp.0ngbIeZejR is 6KB 2024-09-21T12:28:20.583 DEBUG:teuthology.orchestra.run.smithi046:> rm -fr /tmp/tmp.0ngbIeZejR 2024-09-21T12:28:20.598 DEBUG:teuthology.orchestra.run.smithi046:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T12:28:20.616 INFO:teuthology.orchestra.run.smithi176.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T12:28:20.649 INFO:teuthology.orchestra.run.smithi176.stderr:done 2024-09-21T12:28:20.651 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2024-09-21T12:28:20.666 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.Sn7XZ7yorg 2024-09-21T12:28:20.666 DEBUG:teuthology.orchestra.run.smithi176:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Sn7XZ7yorg 2024-09-21T12:28:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T12:28:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T12:28:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T12:28:20.667 INFO:teuthology.orchestra.run.smithi046.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T12:28:20.669 DEBUG:teuthology.orchestra.run.smithi046:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T12:28:20.747 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.Sn7XZ7yorg 2024-09-21T12:28:20.822 DEBUG:teuthology.orchestra.run.smithi046:> sudo shutdown -r now 2024-09-21T12:28:20.889 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.Sn7XZ7yorg is 6KB 2024-09-21T12:28:20.910 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.Sn7XZ7yorg 2024-09-21T12:28:20.925 DEBUG:teuthology.orchestra.run.smithi176:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T12:28:20.988 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T12:28:20.988 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T12:28:20.988 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T12:28:20.988 INFO:teuthology.orchestra.run.smithi176.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T12:28:20.989 DEBUG:teuthology.orchestra.run.smithi176:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T12:28:21.152 DEBUG:teuthology.orchestra.run.smithi176:> sudo shutdown -r now 2024-09-21T12:28:50.854 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-21T12:28:50.854 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:28:50.855 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:28:51.154 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-21T12:28:51.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-21T12:28:51.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:29:09.231 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-21T12:29:09.487 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.176 2024-09-21T12:29:18.241 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:29:18.241 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:29:18.488 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-21T12:29:18.489 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:29:21.295 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.46 2024-09-21T12:29:33.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:29:33.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:30:18.535 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T12:30:30.546 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-21T12:30:30.547 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:30:30.954 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-21T12:30:31.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-21T12:30:31.319 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T12:30:31.320 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2024-09-21T12:30:31.336 INFO:teuthology.orchestra.run.smithi176.stdout:5.14.0-508.el9.x86_64 2024-09-21T12:30:31.336 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T12:30:31.336 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T12:30:31.336 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T12:30:32.338 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-21T12:30:32.338 DEBUG:teuthology.orchestra.run.smithi176:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T12:30:32.423 INFO:teuthology.orchestra.run.smithi176.stdout:ttyS1 2024-09-21T12:30:32.441 DEBUG:teuthology.parallel:result is None 2024-09-21T12:30:33.302 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T12:30:48.302 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:30:48.303 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:30:48.659 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-21T12:30:49.023 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:30:49.023 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T12:30:49.023 DEBUG:teuthology.orchestra.run.smithi046:> uname -r 2024-09-21T12:30:49.040 INFO:teuthology.orchestra.run.smithi046.stdout:5.14.0-508.el9.x86_64 2024-09-21T12:30:49.040 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T12:30:49.040 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T12:30:49.040 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T12:30:50.041 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-21T12:30:50.042 DEBUG:teuthology.orchestra.run.smithi046:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T12:30:50.118 INFO:teuthology.orchestra.run.smithi046.stdout:ttyS1 2024-09-21T12:30:50.141 DEBUG:teuthology.parallel:result is None 2024-09-21T12:30:50.141 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T12:30:50.148 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T12:30:50.148 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T12:30:50.151 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T12:30:50.170 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T12:30:50.176 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T12:30:50.189 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T12:30:50.189 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T12:30:50.210 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T12:30:50.270 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T12:30:50.277 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T12:30:50.277 DEBUG:teuthology.orchestra.run.smithi046:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T12:30:50.280 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T12:30:50.317 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:30:50.318 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:30:50.329 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:30:50.330 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:30:50.332 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T12:30:50.341 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T12:30:50.341 DEBUG:teuthology.orchestra.run.smithi046:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T12:30:50.374 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T12:30:50.402 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T12:30:50.411 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T12:30:50.411 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T12:30:50.444 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T12:30:50.461 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:30:50.543 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:30:50.595 DEBUG:teuthology.orchestra.run.smithi046:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:30:50.682 DEBUG:teuthology.orchestra.run.smithi046:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:30:50.724 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:30:50.725 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T12:30:50.792 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:30:50.836 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:30:50.897 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:30:50.934 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:30:50.983 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:30:50.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T12:30:51.050 DEBUG:teuthology.orchestra.run.smithi046:> sudo service rsyslog restart 2024-09-21T12:30:51.052 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2024-09-21T12:30:51.098 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:30:51.132 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:30:51.453 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T12:30:51.468 INFO:teuthology.task.internal:Starting timer... 2024-09-21T12:30:51.468 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T12:30:51.490 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T12:30:51.498 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T12:30:51.498 DEBUG:teuthology.orchestra.run.smithi046:> sudo service auditd rotate 2024-09-21T12:30:51.562 INFO:teuthology.orchestra.run.smithi046.stdout:Rotating logs: 2024-09-21T12:30:51.564 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2024-09-21T12:30:51.639 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2024-09-21T12:30:51.641 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T12:30:51.641 DEBUG:teuthology.orchestra.run.smithi046:> /usr/sbin/getenforce 2024-09-21T12:30:51.663 INFO:teuthology.orchestra.run.smithi046.stdout:Permissive 2024-09-21T12:30:51.663 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2024-09-21T12:30:51.727 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2024-09-21T12:30:51.727 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi046.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2024-09-21T12:30:51.727 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:30:51.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:30:51.756 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:30:51.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:30:51.783 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T12:30:51.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo /usr/sbin/setenforce permissive 2024-09-21T12:30:51.831 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2024-09-21T12:30:51.865 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T12:30:51.875 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T12:30:51.885 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T12:30:51.886 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi046.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T12:34:35.434 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi046.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2024-09-21T12:34:35.435 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:34:35.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi046.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:34:35.511 DEBUG:teuthology.orchestra.run.smithi046:> true 2024-09-21T12:34:35.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi046.front.sepia.ceph.com' 2024-09-21T12:34:35.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-21T12:34:35.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:34:35.668 DEBUG:teuthology.orchestra.run.smithi176:> true 2024-09-21T12:34:35.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2024-09-21T12:34:35.745 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T12:34:35.755 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T12:34:35.755 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T12:34:35.756 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:34:35.758 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T12:34:35.759 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:34:35.789 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T12:34:35.804 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T12:34:35.815 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T12:34:35.829 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T12:34:35.831 INFO:teuthology.orchestra.run.smithi046.stderr:sudo: ntpd: command not found 2024-09-21T12:34:35.843 INFO:teuthology.orchestra.run.smithi046.stdout:506 Cannot talk to daemon 2024-09-21T12:34:35.854 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2024-09-21T12:34:35.859 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T12:34:35.865 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2024-09-21T12:34:35.874 INFO:teuthology.orchestra.run.smithi046.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T12:34:35.880 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T12:34:35.893 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T12:34:35.931 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:34:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:34:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-21T12:34:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.935 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.948 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:34:35.952 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:34:35.952 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-21T12:34:35.952 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.952 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.952 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.952 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:34:35.952 INFO:teuthology.run_tasks:Running task install... 2024-09-21T12:34:35.960 DEBUG:teuthology.task.install:project ceph 2024-09-21T12:34:35.960 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '441784946648ff53dd310293f9dd752afeeea72a'}} 2024-09-21T12:34:35.960 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '441784946648ff53dd310293f9dd752afeeea72a'} 2024-09-21T12:34:35.960 INFO:teuthology.task.install:Using flavor: default 2024-09-21T12:34:35.965 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T12:34:35.965 INFO:teuthology.task.install:extra packages: [] 2024-09-21T12:34:35.966 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '441784946648ff53dd310293f9dd752afeeea72a', 'tag': None, 'wait_for_package': False} 2024-09-21T12:34:35.966 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:34:35.966 INFO:teuthology.packaging:ref: None 2024-09-21T12:34:35.966 INFO:teuthology.packaging:tag: None 2024-09-21T12:34:35.966 INFO:teuthology.packaging:branch: squid 2024-09-21T12:34:35.966 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:34:35.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:34:35.968 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '441784946648ff53dd310293f9dd752afeeea72a', 'tag': None, 'wait_for_package': False} 2024-09-21T12:34:35.968 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:34:35.968 INFO:teuthology.packaging:ref: None 2024-09-21T12:34:35.968 INFO:teuthology.packaging:tag: None 2024-09-21T12:34:35.968 INFO:teuthology.packaging:branch: squid 2024-09-21T12:34:35.968 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:34:35.969 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:34:36.198 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T12:34:36.199 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T12:34:36.223 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T12:34:36.223 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T12:34:36.316 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T12:34:36.316 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:34:36.316 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T12:34:36.333 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T12:34:36.334 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:34:36.334 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T12:34:36.343 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T12:34:36.344 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:34:36.344 INFO:teuthology.packaging:ref: None 2024-09-21T12:34:36.344 INFO:teuthology.packaging:tag: None 2024-09-21T12:34:36.344 INFO:teuthology.packaging:branch: squid 2024-09-21T12:34:36.344 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:34:36.344 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T12:34:36.362 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T12:34:36.362 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:34:36.362 INFO:teuthology.packaging:ref: None 2024-09-21T12:34:36.362 INFO:teuthology.packaging:tag: None 2024-09-21T12:34:36.363 INFO:teuthology.packaging:branch: squid 2024-09-21T12:34:36.363 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:34:36.363 DEBUG:teuthology.orchestra.run.smithi046:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T12:34:36.410 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T12:34:36.430 DEBUG:teuthology.orchestra.run.smithi046:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T12:34:36.485 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T12:34:36.508 DEBUG:teuthology.orchestra.run.smithi046:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T12:34:36.549 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2024-09-21T12:34:36.550 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2024-09-21T12:34:36.574 INFO:teuthology.orchestra.run.smithi046.stdout:check_obsoletes = 1 2024-09-21T12:34:36.575 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum clean all 2024-09-21T12:34:36.784 INFO:teuthology.orchestra.run.smithi176.stdout:45 files removed 2024-09-21T12:34:36.812 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw 2024-09-21T12:34:36.813 INFO:teuthology.orchestra.run.smithi046.stdout:45 files removed 2024-09-21T12:34:36.841 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-radosgw 2024-09-21T12:34:37.391 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 283 kB/s | 84 kB 00:00 2024-09-21T12:34:37.401 INFO:teuthology.orchestra.run.smithi046.stdout:ceph packages for x86_64 320 kB/s | 84 kB 00:00 2024-09-21T12:34:37.675 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-21T12:34:37.677 INFO:teuthology.orchestra.run.smithi046.stdout:ceph noarch packages 51 kB/s | 12 kB 00:00 2024-09-21T12:34:37.943 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-21T12:34:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T12:34:38.427 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T12:34:38.493 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-21T12:34:40.279 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-21T12:34:40.286 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T12:34:44.903 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - CRB 8.5 MB/s | 6.5 MB 00:00 2024-09-21T12:34:44.955 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - CRB 9.3 MB/s | 6.5 MB 00:00 2024-09-21T12:34:46.504 INFO:teuthology.orchestra.run.smithi176.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-21T12:34:46.805 INFO:teuthology.orchestra.run.smithi046.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-21T12:34:47.667 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T12:34:47.728 INFO:teuthology.orchestra.run.smithi046.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T12:34:53.122 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-21T12:34:53.401 INFO:teuthology.orchestra.run.smithi046.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-21T12:34:55.366 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:34:55.384 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T12:34:55.385 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T12:34:55.386 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout:Installing weak dependencies: 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout:Install 30 Packages 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 2 Packages 2024-09-21T12:34:55.387 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:34:55.388 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 60 M 2024-09-21T12:34:55.388 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:34:55.690 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrading: 2024-09-21T12:34:55.698 INFO:teuthology.orchestra.run.smithi046.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T12:34:55.699 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T12:34:55.699 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:34:55.699 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T12:34:55.699 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T12:34:55.699 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T12:34:55.699 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T12:34:55.700 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T12:34:55.701 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T12:34:55.702 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T12:34:55.702 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T12:34:55.702 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T12:34:55.702 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T12:34:55.702 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout:Installing weak dependencies: 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:34:55.703 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:34:55.704 INFO:teuthology.orchestra.run.smithi046.stdout:Install 30 Packages 2024-09-21T12:34:55.704 INFO:teuthology.orchestra.run.smithi046.stdout:Upgrade 2 Packages 2024-09-21T12:34:55.704 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:34:55.704 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 60 M 2024-09-21T12:34:55.705 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:34:56.249 INFO:teuthology.orchestra.run.smithi176.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 9.4 MB/s | 5.4 MB 00:00 2024-09-21T12:34:56.307 INFO:teuthology.orchestra.run.smithi176.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 433 kB/s | 25 kB 00:00 2024-09-21T12:34:56.416 INFO:teuthology.orchestra.run.smithi176.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 6.8 MB/s | 751 kB 00:00 2024-09-21T12:34:56.533 INFO:teuthology.orchestra.run.smithi176.stdout:(4/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 12 MB/s | 11 MB 00:00 2024-09-21T12:34:56.557 INFO:teuthology.orchestra.run.smithi176.stdout:(5/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 3.5 MB/s | 507 kB 00:00 2024-09-21T12:34:56.616 INFO:teuthology.orchestra.run.smithi176.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 772 kB/s | 45 kB 00:00 2024-09-21T12:34:56.692 INFO:teuthology.orchestra.run.smithi176.stdout:(7/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.8 MB/s | 136 kB 00:00 2024-09-21T12:34:56.775 INFO:teuthology.orchestra.run.smithi176.stdout:(8/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 1.9 MB/s | 162 kB 00:00 2024-09-21T12:34:56.992 INFO:teuthology.orchestra.run.smithi176.stdout:(9/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x8 16 MB/s | 21 MB 00:01 2024-09-21T12:34:57.017 INFO:teuthology.orchestra.run.smithi176.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 1.3 MB/s | 321 kB 00:00 2024-09-21T12:34:57.093 INFO:teuthology.orchestra.run.smithi176.stdout:(11/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_6 9.6 MB/s | 5.3 MB 00:00 2024-09-21T12:34:57.120 INFO:teuthology.orchestra.run.smithi176.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 973 kB/s | 99 kB 00:00 2024-09-21T12:34:57.154 INFO:teuthology.orchestra.run.smithi176.stdout:(13/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 1.8 MB/s | 300 kB 00:00 2024-09-21T12:34:57.254 INFO:teuthology.orchestra.run.smithi176.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 453 kB/s | 45 kB 00:00 2024-09-21T12:34:57.288 INFO:teuthology.orchestra.run.smithi176.stdout:(15/32): boost-program-options-1.75.0-8.el9.x86 549 kB/s | 107 kB 00:00 2024-09-21T12:34:57.313 INFO:teuthology.orchestra.run.smithi176.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 833 kB/s | 160 kB 00:00 2024-09-21T12:34:57.355 INFO:teuthology.orchestra.run.smithi176.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-21T12:34:57.414 INFO:teuthology.orchestra.run.smithi176.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-21T12:34:57.464 INFO:teuthology.orchestra.run.smithi176.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2024-09-21T12:34:57.489 INFO:teuthology.orchestra.run.smithi176.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 477 kB/s | 36 kB 00:00 2024-09-21T12:34:57.515 INFO:teuthology.orchestra.run.smithi176.stdout:(21/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 662 kB 00:00 2024-09-21T12:34:57.539 INFO:teuthology.orchestra.run.smithi176.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 628 kB/s | 47 kB 00:00 2024-09-21T12:34:57.598 INFO:teuthology.orchestra.run.smithi176.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T12:34:57.623 INFO:teuthology.orchestra.run.smithi176.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T12:34:57.657 INFO:teuthology.orchestra.run.smithi176.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 254 kB/s | 26 kB 00:00 2024-09-21T12:34:57.677 INFO:teuthology.orchestra.run.smithi046.stdout:(1/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x8 11 MB/s | 21 MB 00:01 2024-09-21T12:34:57.682 INFO:teuthology.orchestra.run.smithi176.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-21T12:34:57.716 INFO:teuthology.orchestra.run.smithi176.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-21T12:34:57.752 INFO:teuthology.orchestra.run.smithi046.stdout:(2/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 2.7 MB/s | 5.4 MB 00:01 2024-09-21T12:34:57.774 INFO:teuthology.orchestra.run.smithi176.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-21T12:34:57.777 INFO:teuthology.orchestra.run.smithi046.stdout:(3/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 251 kB/s | 25 kB 00:00 2024-09-21T12:34:57.816 INFO:teuthology.orchestra.run.smithi176.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T12:34:57.828 INFO:teuthology.orchestra.run.smithi046.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 9.9 MB/s | 507 kB 00:00 2024-09-21T12:34:57.892 INFO:teuthology.orchestra.run.smithi176.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T12:34:57.945 INFO:teuthology.orchestra.run.smithi046.stdout:(5/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 3.8 MB/s | 751 kB 00:00 2024-09-21T12:34:58.020 INFO:teuthology.orchestra.run.smithi046.stdout:(6/32): python3-ceph-argparse-19.1.1-373.g4e45e 603 kB/s | 45 kB 00:00 2024-09-21T12:34:58.067 INFO:teuthology.orchestra.run.smithi176.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 12 MB/s | 3.4 MB 00:00 2024-09-21T12:34:58.104 INFO:teuthology.orchestra.run.smithi046.stdout:(7/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 19 MB/s | 5.3 MB 00:00 2024-09-21T12:34:58.125 INFO:teuthology.orchestra.run.smithi176.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 10 MB/s | 3.2 MB 00:00 2024-09-21T12:34:58.129 INFO:teuthology.orchestra.run.smithi046.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 1.2 MB/s | 136 kB 00:00 2024-09-21T12:34:58.131 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:34:58.131 INFO:teuthology.orchestra.run.smithi176.stdout:Total 22 MB/s | 60 MB 00:02 2024-09-21T12:34:58.154 INFO:teuthology.orchestra.run.smithi046.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 3.2 MB/s | 162 kB 00:00 2024-09-21T12:34:58.205 INFO:teuthology.orchestra.run.smithi046.stdout:(10/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 5.9 MB/s | 300 kB 00:00 2024-09-21T12:34:58.230 INFO:teuthology.orchestra.run.smithi046.stdout:(11/32): python3-rados-19.1.1-373.g4e45e6b4.el9 3.1 MB/s | 321 kB 00:00 2024-09-21T12:34:58.233 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:34:58.255 INFO:teuthology.orchestra.run.smithi046.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T12:34:58.268 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:34:58.268 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:34:58.697 INFO:teuthology.orchestra.run.smithi046.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 229 kB/s | 107 kB 00:00 2024-09-21T12:34:58.805 INFO:teuthology.orchestra.run.smithi046.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 291 kB/s | 160 kB 00:00 2024-09-21T12:34:58.831 INFO:teuthology.orchestra.run.smithi046.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 339 kB/s | 45 kB 00:00 2024-09-21T12:34:58.960 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:34:58.960 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:34:59.198 INFO:teuthology.orchestra.run.smithi046.stdout:(16/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9. 3.1 MB/s | 11 MB 00:03 2024-09-21T12:34:59.223 INFO:teuthology.orchestra.run.smithi046.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 746 kB/s | 292 kB 00:00 2024-09-21T12:34:59.265 INFO:teuthology.orchestra.run.smithi046.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 1.4 MB/s | 662 kB 00:00 2024-09-21T12:34:59.340 INFO:teuthology.orchestra.run.smithi046.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.8 MB/s | 221 kB 00:00 2024-09-21T12:34:59.365 INFO:teuthology.orchestra.run.smithi046.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 358 kB/s | 36 kB 00:00 2024-09-21T12:34:59.416 INFO:teuthology.orchestra.run.smithi046.stdout:(21/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 6.0 MB/s | 308 kB 00:00 2024-09-21T12:34:59.441 INFO:teuthology.orchestra.run.smithi046.stdout:(22/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 470 kB/s | 47 kB 00:00 2024-09-21T12:34:59.483 INFO:teuthology.orchestra.run.smithi046.stdout:(23/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 623 kB/s | 26 kB 00:00 2024-09-21T12:34:59.500 INFO:teuthology.orchestra.run.smithi046.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2024-09-21T12:34:59.525 INFO:teuthology.orchestra.run.smithi046.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T12:34:59.567 INFO:teuthology.orchestra.run.smithi046.stdout:(26/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T12:34:59.592 INFO:teuthology.orchestra.run.smithi046.stdout:(27/32): python3-prettytable-0.7.2-27.el9.noarc 107 kB/s | 42 kB 00:00 2024-09-21T12:34:59.659 INFO:teuthology.orchestra.run.smithi046.stdout:(28/32): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-21T12:34:59.685 INFO:teuthology.orchestra.run.smithi046.stdout:(29/32): re2-20211101-20.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T12:34:59.735 INFO:teuthology.orchestra.run.smithi046.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T12:34:59.969 INFO:teuthology.orchestra.run.smithi046.stdout:(31/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-21T12:35:00.394 INFO:teuthology.orchestra.run.smithi046.stdout:(32/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 4.7 MB/s | 3.4 MB 00:00 2024-09-21T12:35:00.400 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:00.400 INFO:teuthology.orchestra.run.smithi046.stdout:Total 13 MB/s | 60 MB 00:04 2024-09-21T12:35:00.437 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:35:00.511 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:35:00.526 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T12:35:00.552 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:35:00.552 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:35:00.556 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T12:35:00.581 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T12:35:00.612 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:35:00.633 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:35:00.832 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:35:00.883 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:35:01.270 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:35:01.270 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:35:01.300 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T12:35:01.366 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:35:01.468 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:35:01.555 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T12:35:01.584 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:35:01.647 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:35:01.675 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T12:35:01.719 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T12:35:01.790 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:35:01.819 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:35:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:35:01.926 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T12:35:02.036 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T12:35:02.069 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T12:35:02.114 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T12:35:02.142 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T12:35:02.171 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T12:35:02.205 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T12:35:02.516 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T12:35:02.559 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:35:02.649 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:35:02.680 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T12:35:02.724 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T12:35:02.781 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:35:02.872 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T12:35:02.899 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T12:35:02.932 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T12:35:02.955 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:35:02.980 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:35:03.176 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:35:03.208 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T12:35:03.230 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:35:03.237 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:35:03.308 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:35:03.384 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T12:35:03.414 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T12:35:03.630 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T12:35:03.712 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:35:03.811 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:35:03.943 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T12:35:03.969 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:35:04.032 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:35:04.069 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T12:35:04.113 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T12:35:04.184 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:35:04.213 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:35:04.278 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:35:04.312 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T12:35:04.423 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T12:35:04.454 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T12:35:04.500 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T12:35:04.528 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T12:35:04.557 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T12:35:04.607 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T12:35:04.934 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T12:35:04.978 INFO:teuthology.orchestra.run.smithi046.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:35:05.069 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:35:05.099 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T12:35:05.135 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T12:35:05.653 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T12:35:05.680 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:35:05.737 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:35:05.744 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:35:05.769 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:35:05.824 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T12:35:05.857 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T12:35:06.353 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:35:06.397 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:35:06.488 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:35:06.489 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T12:35:06.489 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T12:35:06.489 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:06.523 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:35:08.299 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:35:08.337 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:35:08.943 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:35:08.982 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:35:09.075 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:35:09.075 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T12:35:09.075 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T12:35:09.075 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:09.109 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /root 2024-09-21T12:35:16.704 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2024-09-21T12:35:16.705 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:17.699 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:35:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:35:17.725 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:17.725 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T12:35:17.725 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:35:17.725 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:35:17.725 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:17.727 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:35:17.810 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:35:17.810 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T12:35:19.061 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T12:35:19.062 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T12:35:19.063 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T12:35:19.063 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T12:35:19.063 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T12:35:19.063 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T12:35:19.063 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T12:35:19.064 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T12:35:19.064 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T12:35:19.064 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:35:19.064 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T12:35:19.064 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /sys 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /proc 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /mnt 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /var/tmp 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /home 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /root 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:skipping the directory /tmp 2024-09-21T12:35:19.718 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.952 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.953 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T12:35:19.954 INFO:teuthology.orchestra.run.smithi176.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T12:35:19.955 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T12:35:19.955 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:19.955 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:20.365 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-test 2024-09-21T12:35:20.744 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:35:20.775 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:35:20.775 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:20.775 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T12:35:20.775 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:35:20.775 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:35:20.775 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:20.777 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:35:20.855 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:35:20.855 INFO:teuthology.orchestra.run.smithi046.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:35:20.950 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:27 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:21.082 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:21.083 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:21.084 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:35:21.084 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:21.084 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:35:21.084 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T12:35:21.084 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:35:21.085 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T12:35:21.085 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T12:35:21.085 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T12:35:21.085 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:21.085 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:35:21.085 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:21.086 INFO:teuthology.orchestra.run.smithi176.stdout:Install 4 Packages 2024-09-21T12:35:21.086 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:21.086 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 49 M 2024-09-21T12:35:21.086 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 209 M 2024-09-21T12:35:21.086 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:35:21.423 INFO:teuthology.orchestra.run.smithi176.stdout:(1/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 751 kB/s | 163 kB 00:00 2024-09-21T12:35:21.799 INFO:teuthology.orchestra.run.smithi176.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-09-21T12:35:21.849 INFO:teuthology.orchestra.run.smithi176.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 473 kB/s | 304 kB 00:00 2024-09-21T12:35:22.069 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:35:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T12:35:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T12:35:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T12:35:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T12:35:22.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T12:35:22.071 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T12:35:22.072 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T12:35:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T12:35:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T12:35:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:35:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T12:35:22.073 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T12:35:22.741 INFO:teuthology.orchestra.run.smithi176.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T12:35:22.743 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:22.743 INFO:teuthology.orchestra.run.smithi176.stdout:Total 30 MB/s | 49 MB 00:01 2024-09-21T12:35:22.771 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:35:22.791 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:35:22.791 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:35:23.165 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:35:23.166 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:35:23.273 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout:Upgraded: 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.274 INFO:teuthology.orchestra.run.smithi046.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T12:35:23.275 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:23.276 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:23.655 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-test 2024-09-21T12:35:23.705 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:35:23.784 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T12:35:23.831 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T12:35:23.859 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:35:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:31 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:24.402 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:24.403 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:24.403 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:35:24.403 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:24.403 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout:Install 4 Packages 2024-09-21T12:35:24.404 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:24.405 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 49 M 2024-09-21T12:35:24.405 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 209 M 2024-09-21T12:35:24.405 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:35:24.902 INFO:teuthology.orchestra.run.smithi046.stdout:(1/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 746 kB/s | 163 kB 00:00 2024-09-21T12:35:24.969 INFO:teuthology.orchestra.run.smithi046.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.0 MB/s | 304 kB 00:00 2024-09-21T12:35:25.127 INFO:teuthology.orchestra.run.smithi046.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 283 kB/s | 64 kB 00:00 2024-09-21T12:35:26.236 INFO:teuthology.orchestra.run.smithi046.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 31 MB/s | 49 MB 00:01 2024-09-21T12:35:26.238 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:26.238 INFO:teuthology.orchestra.run.smithi046.stdout:Total 27 MB/s | 49 MB 00:01 2024-09-21T12:35:26.266 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:35:26.289 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:35:26.289 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:35:26.679 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:35:26.679 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:35:27.225 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:35:27.305 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T12:35:27.344 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T12:35:27.371 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:35:28.501 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:35:28.582 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:35:30.947 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:35:30.947 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T12:35:30.947 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T12:35:30.948 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T12:35:31.278 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T12:35:31.279 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:31.279 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:31.566 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph 2024-09-21T12:35:32.177 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:32.267 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:35:32.321 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T12:35:32.324 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T12:35:32.325 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T12:35:32.326 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout:Install 37 Packages 2024-09-21T12:35:32.327 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:32.328 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 30 M 2024-09-21T12:35:32.328 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 108 M 2024-09-21T12:35:32.328 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:35:32.356 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:35:32.846 INFO:teuthology.orchestra.run.smithi176.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 48 kB/s | 6.6 kB 00:00 2024-09-21T12:35:33.013 INFO:teuthology.orchestra.run.smithi176.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 5.0 MB/s | 1.5 MB 00:00 2024-09-21T12:35:33.071 INFO:teuthology.orchestra.run.smithi176.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-21T12:35:33.155 INFO:teuthology.orchestra.run.smithi176.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.9 MB/s | 249 kB 00:00 2024-09-21T12:35:33.356 INFO:teuthology.orchestra.run.smithi176.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-21T12:35:33.564 INFO:teuthology.orchestra.run.smithi176.stdout:(6/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 31 MB/s | 17 MB 00:00 2024-09-21T12:35:33.631 INFO:teuthology.orchestra.run.smithi176.stdout:(7/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 6.0 MB/s | 4.7 MB 00:00 2024-09-21T12:35:33.664 INFO:teuthology.orchestra.run.smithi176.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 4.0 MB/s | 1.2 MB 00:00 2024-09-21T12:35:33.723 INFO:teuthology.orchestra.run.smithi176.stdout:(9/37): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-09-21T12:35:33.765 INFO:teuthology.orchestra.run.smithi176.stdout:(10/37): python3-ply-3.11-14.el9.noarch.rpm 531 kB/s | 106 kB 00:00 2024-09-21T12:35:33.790 INFO:teuthology.orchestra.run.smithi176.stdout:(11/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.1 MB/s | 215 kB 00:00 2024-09-21T12:35:33.824 INFO:teuthology.orchestra.run.smithi176.stdout:(12/37): python3-pycparser-2.20-6.el9.noarch.rp 701 kB/s | 135 kB 00:00 2024-09-21T12:35:34.116 INFO:teuthology.orchestra.run.smithi176.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-09-21T12:35:34.316 INFO:teuthology.orchestra.run.smithi176.stdout:(14/37): lua-5.4.4-4.el9.x86_64.rpm 342 kB/s | 188 kB 00:00 2024-09-21T12:35:34.400 INFO:teuthology.orchestra.run.smithi176.stdout:(15/37): python3-packaging-20.9-5.el9.noarch.rp 272 kB/s | 77 kB 00:00 2024-09-21T12:35:34.425 INFO:teuthology.orchestra.run.smithi176.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 470 kB/s | 51 kB 00:00 2024-09-21T12:35:34.450 INFO:teuthology.orchestra.run.smithi176.stdout:(17/37): python3-mako-1.1.4-6.el9.noarch.rpm 261 kB/s | 172 kB 00:00 2024-09-21T12:35:34.492 INFO:teuthology.orchestra.run.smithi176.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-21T12:35:34.517 INFO:teuthology.orchestra.run.smithi176.stdout:(19/37): python3-toml-0.10.2-6.el9.noarch.rpm 354 kB/s | 42 kB 00:00 2024-09-21T12:35:34.543 INFO:teuthology.orchestra.run.smithi176.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-21T12:35:34.576 INFO:teuthology.orchestra.run.smithi176.stdout:(21/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 518 kB/s | 43 kB 00:00 2024-09-21T12:35:34.601 INFO:teuthology.orchestra.run.smithi176.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 704 kB/s | 11 kB 00:00 2024-09-21T12:35:34.627 INFO:teuthology.orchestra.run.smithi176.stdout:(23/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-21T12:35:34.644 INFO:teuthology.orchestra.run.smithi176.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 437 kB/s | 18 kB 00:00 2024-09-21T12:35:34.661 INFO:teuthology.orchestra.run.smithi176.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 695 kB/s | 23 kB 00:00 2024-09-21T12:35:34.678 INFO:teuthology.orchestra.run.smithi176.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 579 kB/s | 19 kB 00:00 2024-09-21T12:35:34.703 INFO:teuthology.orchestra.run.smithi176.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 469 kB/s | 20 kB 00:00 2024-09-21T12:35:34.718 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:35:34.718 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T12:35:34.718 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T12:35:34.718 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T12:35:34.728 INFO:teuthology.orchestra.run.smithi176.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 926 kB/s | 46 kB 00:00 2024-09-21T12:35:34.754 INFO:teuthology.orchestra.run.smithi176.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T12:35:34.779 INFO:teuthology.orchestra.run.smithi176.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 661 kB/s | 16 kB 00:00 2024-09-21T12:35:34.804 INFO:teuthology.orchestra.run.smithi176.stdout:(31/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-09-21T12:35:34.829 INFO:teuthology.orchestra.run.smithi176.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-21T12:35:34.855 INFO:teuthology.orchestra.run.smithi176.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-21T12:35:34.888 INFO:teuthology.orchestra.run.smithi176.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-21T12:35:34.914 INFO:teuthology.orchestra.run.smithi176.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 802 kB/s | 20 kB 00:00 2024-09-21T12:35:34.939 INFO:teuthology.orchestra.run.smithi176.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T12:35:34.964 INFO:teuthology.orchestra.run.smithi176.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-21T12:35:34.968 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:34.969 INFO:teuthology.orchestra.run.smithi176.stdout:Total 11 MB/s | 30 MB 00:02 2024-09-21T12:35:35.024 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T12:35:35.024 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:35.024 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:35:35.024 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:35.024 INFO:teuthology.orchestra.run.smithi046.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:35.025 INFO:teuthology.orchestra.run.smithi046.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T12:35:35.025 INFO:teuthology.orchestra.run.smithi046.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T12:35:35.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:35.025 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:35.122 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:35:35.164 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:35:35.164 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:35:35.309 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph 2024-09-21T12:35:35.641 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:35:35.641 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:35:35.927 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:42 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:36.071 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:35:36.074 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T12:35:36.075 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T12:35:36.076 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout:Install 37 Packages 2024-09-21T12:35:36.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 30 M 2024-09-21T12:35:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 108 M 2024-09-21T12:35:36.078 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:35:36.847 INFO:teuthology.orchestra.run.smithi046.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 51 kB/s | 6.6 kB 00:00 2024-09-21T12:35:37.001 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:35:37.067 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T12:35:37.072 INFO:teuthology.orchestra.run.smithi046.stdout:(2/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.7 MB/s | 2.4 MB 00:00 2024-09-21T12:35:37.101 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T12:35:37.105 INFO:teuthology.orchestra.run.smithi046.stdout:(3/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 3.9 MB/s | 1.5 MB 00:00 2024-09-21T12:35:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T12:35:37.201 INFO:teuthology.orchestra.run.smithi046.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.6 MB/s | 249 kB 00:00 2024-09-21T12:35:37.215 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T12:35:37.268 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T12:35:37.301 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T12:35:37.384 INFO:teuthology.orchestra.run.smithi046.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 8.8 MB/s | 4.7 MB 00:00 2024-09-21T12:35:37.392 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T12:35:37.480 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T12:35:37.520 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T12:35:37.556 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T12:35:37.601 INFO:teuthology.orchestra.run.smithi046.stdout:(6/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 17 MB 00:00 2024-09-21T12:35:37.602 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T12:35:37.637 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T12:35:37.679 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T12:35:37.719 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T12:35:37.754 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T12:35:37.789 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T12:35:37.837 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T12:35:37.877 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T12:35:37.958 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T12:35:38.105 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T12:35:38.185 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T12:35:38.193 INFO:teuthology.orchestra.run.smithi046.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 255 kB/s | 253 kB 00:00 2024-09-21T12:35:38.238 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T12:35:38.277 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T12:35:38.326 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T12:35:38.327 INFO:teuthology.orchestra.run.smithi046.stdout:(8/37): python3-ply-3.11-14.el9.noarch.rpm 148 kB/s | 106 kB 00:00 2024-09-21T12:35:38.390 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T12:35:38.494 INFO:teuthology.orchestra.run.smithi046.stdout:(9/37): python3-cryptography-36.0.1-4.el9.x86_6 1.1 MB/s | 1.2 MB 00:01 2024-09-21T12:35:38.585 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T12:35:38.632 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T12:35:38.709 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T12:35:38.798 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T12:35:38.839 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T12:35:38.902 INFO:teuthology.orchestra.run.smithi046.stdout:(10/37): python3-pycparser-2.20-6.el9.noarch.rp 191 kB/s | 135 kB 00:00 2024-09-21T12:35:38.957 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T12:35:39.044 INFO:teuthology.orchestra.run.smithi046.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 174 kB/s | 125 kB 00:00 2024-09-21T12:35:39.103 INFO:teuthology.orchestra.run.smithi046.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 942 kB/s | 188 kB 00:00 2024-09-21T12:35:39.110 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T12:35:39.141 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:35:39.153 INFO:teuthology.orchestra.run.smithi046.stdout:(13/37): python3-markupsafe-1.1.1-12.el9.x86_64 698 kB/s | 35 kB 00:00 2024-09-21T12:35:39.167 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:35:39.167 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:39.167 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T12:35:39.167 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:35:39.168 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:35:39.168 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:39.203 INFO:teuthology.orchestra.run.smithi046.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-21T12:35:39.229 INFO:teuthology.orchestra.run.smithi046.stdout:(15/37): python3-urllib3-1.26.5-6.el9.noarch.rp 293 kB/s | 215 kB 00:00 2024-09-21T12:35:39.254 INFO:teuthology.orchestra.run.smithi046.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 823 kB/s | 172 kB 00:00 2024-09-21T12:35:39.279 INFO:teuthology.orchestra.run.smithi046.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-21T12:35:39.321 INFO:teuthology.orchestra.run.smithi046.stdout:(18/37): luarocks-3.9.2-5.el9.noarch.rpm 3.6 MB/s | 151 kB 00:00 2024-09-21T12:35:39.346 INFO:teuthology.orchestra.run.smithi046.stdout:(19/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-09-21T12:35:39.371 INFO:teuthology.orchestra.run.smithi046.stdout:(20/37): lua-devel-5.4.4-4.el9.x86_64.rpm 190 kB/s | 22 kB 00:00 2024-09-21T12:35:39.397 INFO:teuthology.orchestra.run.smithi046.stdout:(21/37): python3-toml-0.10.2-6.el9.noarch.rpm 248 kB/s | 42 kB 00:00 2024-09-21T12:35:39.439 INFO:teuthology.orchestra.run.smithi046.stdout:(22/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.8 MB/s | 172 kB 00:00 2024-09-21T12:35:39.464 INFO:teuthology.orchestra.run.smithi046.stdout:(23/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 181 kB/s | 11 kB 00:00 2024-09-21T12:35:39.489 INFO:teuthology.orchestra.run.smithi046.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 369 kB/s | 18 kB 00:00 2024-09-21T12:35:39.515 INFO:teuthology.orchestra.run.smithi046.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-09-21T12:35:39.540 INFO:teuthology.orchestra.run.smithi046.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-21T12:35:39.565 INFO:teuthology.orchestra.run.smithi046.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 393 kB/s | 20 kB 00:00 2024-09-21T12:35:39.591 INFO:teuthology.orchestra.run.smithi046.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 923 kB/s | 46 kB 00:00 2024-09-21T12:35:39.616 INFO:teuthology.orchestra.run.smithi046.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T12:35:39.641 INFO:teuthology.orchestra.run.smithi046.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T12:35:39.667 INFO:teuthology.orchestra.run.smithi046.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 327 kB/s | 16 kB 00:00 2024-09-21T12:35:39.700 INFO:teuthology.orchestra.run.smithi046.stdout:(32/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.1 MB/s | 36 kB 00:00 2024-09-21T12:35:39.725 INFO:teuthology.orchestra.run.smithi046.stdout:(33/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-09-21T12:35:39.751 INFO:teuthology.orchestra.run.smithi046.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-21T12:35:39.767 INFO:teuthology.orchestra.run.smithi046.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-21T12:35:39.793 INFO:teuthology.orchestra.run.smithi046.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-21T12:35:39.818 INFO:teuthology.orchestra.run.smithi046.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.5 MB/s | 427 kB 00:00 2024-09-21T12:35:39.823 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:39.823 INFO:teuthology.orchestra.run.smithi046.stdout:Total 8.1 MB/s | 30 MB 00:03 2024-09-21T12:35:39.982 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:35:40.027 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:35:40.027 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:35:40.509 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:35:40.509 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:35:40.609 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:35:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:35:40.636 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:40.636 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T12:35:40.636 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:35:40.636 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:35:40.636 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:41.067 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:35:41.091 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:35:41.091 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:41.091 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T12:35:41.091 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:35:41.092 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:35:41.092 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:41.326 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:35:41.350 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:35:41.350 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:41.350 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T12:35:41.351 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:35:41.351 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:35:41.351 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:41.415 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:35:42.039 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:35:42.113 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T12:35:42.147 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T12:35:42.174 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T12:35:42.249 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T12:35:42.298 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T12:35:42.331 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T12:35:42.427 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T12:35:42.621 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T12:35:42.676 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T12:35:42.711 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T12:35:42.740 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T12:35:42.775 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T12:35:42.808 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T12:35:42.849 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T12:35:42.894 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T12:35:42.928 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T12:35:42.977 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T12:35:43.017 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T12:35:43.094 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T12:35:43.246 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T12:35:43.269 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T12:35:43.270 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T12:35:43.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T12:35:43.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T12:35:43.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T12:35:43.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T12:35:43.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T12:35:43.271 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T12:35:43.272 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T12:35:43.344 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T12:35:43.405 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T12:35:43.442 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T12:35:43.501 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T12:35:43.564 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T12:35:43.761 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T12:35:43.813 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T12:35:43.894 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T12:35:43.992 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T12:35:44.028 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T12:35:44.151 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:44.230 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T12:35:44.231 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T12:35:44.232 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T12:35:44.233 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T12:35:44.234 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:44.234 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:44.315 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T12:35:44.338 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:35:44.366 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:35:44.366 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:44.366 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T12:35:44.366 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:35:44.367 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:35:44.367 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:44.617 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-base 2024-09-21T12:35:45.195 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:45.283 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:35:45.326 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:45.327 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:35:45.327 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:45.402 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install cephadm 2024-09-21T12:35:45.897 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:35:45.927 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:35:45.927 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:45.927 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T12:35:45.927 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:35:45.927 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:35:45.927 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:45.982 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:46.115 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:46.115 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:46.115 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 765 k 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 772 k 2024-09-21T12:35:46.116 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:35:46.390 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:35:46.392 INFO:teuthology.orchestra.run.smithi176.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-21T12:35:46.392 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:46.393 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.7 MB/s | 765 kB 00:00 2024-09-21T12:35:46.393 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:35:46.398 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:35:46.398 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:35:46.404 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:35:46.404 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:35:46.416 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:35:46.416 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:46.416 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T12:35:46.416 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:35:46.416 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:35:46.416 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:46.477 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:35:46.657 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:35:46.683 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:35:46.683 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:46.683 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T12:35:46.683 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:35:46.683 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:35:46.683 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:46.757 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:35:46.929 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:47.021 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:47.378 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:47.626 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:47.626 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:47.626 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:35:47.627 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:47.627 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:47.627 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:47.854 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T12:35:48.446 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:55 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:48.472 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:35:48.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T12:35:48.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T12:35:48.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T12:35:48.472 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T12:35:48.473 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T12:35:48.474 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T12:35:48.475 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T12:35:48.475 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T12:35:48.475 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T12:35:48.475 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T12:35:48.579 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:48.580 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:35:48.581 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:48.581 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:35:48.581 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:48.581 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 145 k 2024-09-21T12:35:48.581 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 435 k 2024-09-21T12:35:48.581 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:35:48.784 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 717 kB/s | 145 kB 00:00 2024-09-21T12:35:48.785 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:48.785 INFO:teuthology.orchestra.run.smithi176.stdout:Total 710 kB/s | 145 kB 00:00 2024-09-21T12:35:48.785 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:35:48.792 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:35:48.792 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:35:48.850 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:35:48.850 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:35:49.003 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:35:49.085 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:35:49.110 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:35:49.110 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:49.110 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T12:35:49.110 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:49.303 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T12:35:49.304 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T12:35:49.305 INFO:teuthology.orchestra.run.smithi046.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:49.306 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:49.657 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-base 2024-09-21T12:35:50.014 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:35:50.014 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:50.014 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:35:50.014 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:50.014 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:50.015 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:50.246 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr 2024-09-21T12:35:50.263 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:50.356 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:35:50.401 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:50.402 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:35:50.402 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:50.478 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install cephadm 2024-09-21T12:35:50.837 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:50.926 INFO:teuthology.orchestra.run.smithi176.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:35:50.968 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:50.969 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:35:50.969 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:51.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T12:35:51.079 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:51.216 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 765 k 2024-09-21T12:35:51.217 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 772 k 2024-09-21T12:35:51.218 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:35:51.490 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.7 MB/s | 765 kB 00:00 2024-09-21T12:35:51.491 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:51.491 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.7 MB/s | 765 kB 00:00 2024-09-21T12:35:51.491 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:35:51.496 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:35:51.496 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:35:51.502 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:35:51.503 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:35:51.578 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:35:51.619 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:51.752 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:51.753 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T12:35:51.754 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout:Install 12 Packages 2024-09-21T12:35:51.755 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:51.756 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 8.7 M 2024-09-21T12:35:51.756 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 105 M 2024-09-21T12:35:51.756 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:35:52.069 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:52.179 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:52.287 INFO:teuthology.orchestra.run.smithi176.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 212 kB/s | 32 kB 00:00 2024-09-21T12:35:52.313 INFO:teuthology.orchestra.run.smithi176.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 94 kB/s | 16 kB 00:00 2024-09-21T12:35:52.430 INFO:teuthology.orchestra.run.smithi176.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.3 MB/s | 269 kB 00:00 2024-09-21T12:35:52.480 INFO:teuthology.orchestra.run.smithi176.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-09-21T12:35:52.549 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:52.563 INFO:teuthology.orchestra.run.smithi176.stdout:(5/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 8.4 MB/s | 3.6 MB 00:00 2024-09-21T12:35:52.597 INFO:teuthology.orchestra.run.smithi176.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 4.6 MB/s | 548 kB 00:00 2024-09-21T12:35:52.614 INFO:teuthology.orchestra.run.smithi176.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 388 kB/s | 19 kB 00:00 2024-09-21T12:35:52.648 INFO:teuthology.orchestra.run.smithi176.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-21T12:35:52.681 INFO:teuthology.orchestra.run.smithi176.stdout:(9/12): protobuf-compiler-3.14.0-13.el9.x86_64. 3.4 MB/s | 863 kB 00:00 2024-09-21T12:35:52.707 INFO:teuthology.orchestra.run.smithi176.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 525 kB/s | 31 kB 00:00 2024-09-21T12:35:52.773 INFO:teuthology.orchestra.run.smithi176.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 12 MB/s | 2.0 MB 00:00 2024-09-21T12:35:52.798 INFO:teuthology.orchestra.run.smithi176.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T12:35:52.802 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:52.803 INFO:teuthology.orchestra.run.smithi176.stdout:Total 8.3 MB/s | 8.7 MB 00:01 2024-09-21T12:35:52.803 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:35:52.803 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:52.803 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:35:52.804 INFO:teuthology.orchestra.run.smithi046.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:52.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:52.804 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:52.854 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:35:52.870 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:35:52.870 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:35:53.003 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T12:35:53.084 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:35:53.085 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:35:53.616 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:35:53.616 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:53.699 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T12:35:53.734 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:35:53.758 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:53.759 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 145 k 2024-09-21T12:35:53.759 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 435 k 2024-09-21T12:35:53.759 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:35:53.780 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T12:35:53.820 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T12:35:53.927 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T12:35:53.962 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 711 kB/s | 145 kB 00:00 2024-09-21T12:35:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:Total 706 kB/s | 145 kB 00:00 2024-09-21T12:35:53.963 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:35:53.972 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:35:53.972 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:35:54.032 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:35:54.033 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:35:54.062 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T12:35:54.148 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T12:35:54.184 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:35:54.191 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T12:35:54.228 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:35:54.230 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:35:54.257 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:35:54.257 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:35:54.257 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T12:35:54.257 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:54.259 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T12:35:55.199 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:35:55.200 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:55.200 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:35:55.200 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:35:55.200 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:55.200 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:55.316 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T12:35:55.352 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:35:55.421 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr 2024-09-21T12:35:56.029 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:03 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:56.121 INFO:teuthology.orchestra.run.smithi046.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:35:56.166 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:56.167 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:35:56.167 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:35:56.238 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T12:35:56.695 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:35:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T12:35:56.696 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T12:35:56.844 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:03 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:56.981 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:35:56.982 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:35:56.983 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:35:56.984 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-09-21T12:35:56.984 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:35:56.984 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 8.7 M 2024-09-21T12:35:56.984 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 105 M 2024-09-21T12:35:56.984 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:35:57.004 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T12:35:57.004 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:57.004 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:35:57.004 INFO:teuthology.orchestra.run.smithi176.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T12:35:57.004 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:57.004 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:57.005 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:35:57.251 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T12:35:57.477 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 215 kB/s | 32 kB 00:00 2024-09-21T12:35:57.502 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 95 kB/s | 16 kB 00:00 2024-09-21T12:35:57.719 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.1 MB/s | 3.6 MB 00:00 2024-09-21T12:35:57.744 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.1 MB/s | 269 kB 00:00 2024-09-21T12:35:57.795 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T12:35:57.820 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T12:35:57.839 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:04 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:35:57.878 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 35 MB/s | 2.0 MB 00:00 2024-09-21T12:35:57.904 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 5.6 MB/s | 144 kB 00:00 2024-09-21T12:35:57.929 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-21T12:35:57.963 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.1 MB/s | 1.0 MB 00:00 2024-09-21T12:35:57.971 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:35:57.972 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-21T12:35:57.972 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:35:57.972 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-21T12:35:57.972 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T12:35:57.973 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:57.974 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:35:57.974 INFO:teuthology.orchestra.run.smithi176.stdout:====================================================================================== 2024-09-21T12:35:57.974 INFO:teuthology.orchestra.run.smithi176.stdout:Install 12 Packages 2024-09-21T12:35:57.974 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:35:57.974 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 38 M 2024-09-21T12:35:57.974 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 212 M 2024-09-21T12:35:57.975 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:35:57.988 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.1 MB/s | 188 kB 00:00 2024-09-21T12:35:58.080 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 2.3 MB/s | 863 kB 00:00 2024-09-21T12:35:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:58.083 INFO:teuthology.orchestra.run.smithi046.stdout:Total 7.9 MB/s | 8.7 MB 00:01 2024-09-21T12:35:58.135 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:35:58.154 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:35:58.155 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:35:58.370 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:35:58.370 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:35:58.673 INFO:teuthology.orchestra.run.smithi176.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-21T12:35:58.723 INFO:teuthology.orchestra.run.smithi176.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-21T12:35:58.748 INFO:teuthology.orchestra.run.smithi176.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-21T12:35:58.790 INFO:teuthology.orchestra.run.smithi176.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 441 kB/s | 18 kB 00:00 2024-09-21T12:35:58.858 INFO:teuthology.orchestra.run.smithi176.stdout:(5/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 22 MB/s | 3.0 MB 00:00 2024-09-21T12:35:58.882 INFO:teuthology.orchestra.run.smithi176.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 419 kB/s | 38 kB 00:00 2024-09-21T12:35:58.921 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:35:58.998 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T12:35:59.008 INFO:teuthology.orchestra.run.smithi176.stdout:(7/12): ceph-mgr-diskprediction-local-19.1.1-37 15 MB/s | 7.4 MB 00:00 2024-09-21T12:35:59.033 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T12:35:59.033 INFO:teuthology.orchestra.run.smithi176.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-21T12:35:59.081 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T12:35:59.117 INFO:teuthology.orchestra.run.smithi176.stdout:(9/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 19 MB/s | 4.9 MB 00:00 2024-09-21T12:35:59.118 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T12:35:59.150 INFO:teuthology.orchestra.run.smithi176.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 2.1 MB/s | 250 kB 00:00 2024-09-21T12:35:59.241 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T12:35:59.376 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T12:35:59.417 INFO:teuthology.orchestra.run.smithi176.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 54 MB/s | 16 MB 00:00 2024-09-21T12:35:59.475 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T12:35:59.524 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T12:35:59.551 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:35:59.583 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T12:35:59.876 INFO:teuthology.orchestra.run.smithi176.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.9 MB/s | 5.1 MB 00:00 2024-09-21T12:35:59.877 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:35:59.877 INFO:teuthology.orchestra.run.smithi176.stdout:Total 20 MB/s | 38 MB 00:01 2024-09-21T12:36:00.240 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:00.266 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:00.266 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:00.701 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:00.716 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T12:36:00.758 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:36:01.462 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:01.537 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T12:36:01.574 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:36:01.672 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:36:01.708 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T12:36:01.892 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T12:36:01.924 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T12:36:02.000 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T12:36:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:36:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T12:36:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T12:36:02.069 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T12:36:02.070 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T12:36:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T12:36:02.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T12:36:02.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T12:36:02.392 INFO:teuthology.orchestra.run.smithi046.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T12:36:02.392 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:02.392 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:02.613 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T12:36:02.645 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T12:36:02.769 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T12:36:03.220 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:10 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:03.360 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:03.361 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-21T12:36:03.361 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:36:03.361 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-21T12:36:03.361 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:03.361 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T12:36:03.362 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:36:03.362 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T12:36:03.362 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T12:36:03.362 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T12:36:03.362 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T12:36:03.362 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T12:36:03.363 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:03.364 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:03.364 INFO:teuthology.orchestra.run.smithi046.stdout:====================================================================================== 2024-09-21T12:36:03.364 INFO:teuthology.orchestra.run.smithi046.stdout:Install 12 Packages 2024-09-21T12:36:03.364 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:03.365 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 38 M 2024-09-21T12:36:03.365 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 212 M 2024-09-21T12:36:03.365 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:04.006 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:36:04.054 INFO:teuthology.orchestra.run.smithi046.stdout:(1/12): ceph-mgr-diskprediction-local-19.1.1-37 16 MB/s | 7.4 MB 00:00 2024-09-21T12:36:04.104 INFO:teuthology.orchestra.run.smithi046.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 658 kB/s | 33 kB 00:00 2024-09-21T12:36:04.163 INFO:teuthology.orchestra.run.smithi046.stdout:(3/12): libquadmath-11.5.0-2.el9.x86_64.rpm 336 kB/s | 191 kB 00:00 2024-09-21T12:36:04.222 INFO:teuthology.orchestra.run.smithi046.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 313 kB/s | 18 kB 00:00 2024-09-21T12:36:04.272 INFO:teuthology.orchestra.run.smithi046.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-21T12:36:04.414 INFO:teuthology.orchestra.run.smithi046.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.7 MB/s | 3.0 MB 00:00 2024-09-21T12:36:04.447 INFO:teuthology.orchestra.run.smithi046.stdout:(7/12): libgfortran-11.5.0-2.el9.x86_64.rpm 939 kB/s | 801 kB 00:00 2024-09-21T12:36:04.523 INFO:teuthology.orchestra.run.smithi046.stdout:(8/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.2 MB/s | 245 kB 00:00 2024-09-21T12:36:04.606 INFO:teuthology.orchestra.run.smithi046.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 3.0 MB/s | 250 kB 00:00 2024-09-21T12:36:04.765 INFO:teuthology.orchestra.run.smithi046.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 10 MB/s | 4.9 MB 00:00 2024-09-21T12:36:05.042 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T12:36:05.049 INFO:teuthology.orchestra.run.smithi046.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-09-21T12:36:05.073 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:36:05.473 INFO:teuthology.orchestra.run.smithi046.stdout:(12/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.0 MB/s | 5.1 MB 00:01 2024-09-21T12:36:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:05.475 INFO:teuthology.orchestra.run.smithi046.stdout:Total 18 MB/s | 38 MB 00:02 2024-09-21T12:36:05.848 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:05.876 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:05.876 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:06.336 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:06.336 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:07.124 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:07.203 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T12:36:07.247 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:36:07.353 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:36:07.399 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T12:36:07.590 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T12:36:07.638 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T12:36:07.639 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T12:36:07.639 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T12:36:07.639 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:36:07.639 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T12:36:07.648 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T12:36:07.743 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T12:36:08.055 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T12:36:08.055 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:08.055 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:08.056 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:08.436 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T12:36:08.443 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-rook 2024-09-21T12:36:08.565 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T12:36:09.038 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:16 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:09.174 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:09.175 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T12:36:09.176 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout:Install 13 Packages 2024-09-21T12:36:09.177 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:09.178 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 2.2 M 2024-09-21T12:36:09.178 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 26 M 2024-09-21T12:36:09.178 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:09.882 INFO:teuthology.orchestra.run.smithi176.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 250 kB/s | 19 kB 00:00 2024-09-21T12:36:09.886 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:36:09.907 INFO:teuthology.orchestra.run.smithi176.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 251 kB/s | 26 kB 00:00 2024-09-21T12:36:09.966 INFO:teuthology.orchestra.run.smithi176.stdout:(3/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 307 kB/s | 49 kB 00:00 2024-09-21T12:36:09.991 INFO:teuthology.orchestra.run.smithi176.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-21T12:36:10.022 INFO:teuthology.orchestra.run.smithi176.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-21T12:36:10.042 INFO:teuthology.orchestra.run.smithi176.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T12:36:10.084 INFO:teuthology.orchestra.run.smithi176.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-21T12:36:10.109 INFO:teuthology.orchestra.run.smithi176.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 211 kB/s | 14 kB 00:00 2024-09-21T12:36:10.143 INFO:teuthology.orchestra.run.smithi176.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-21T12:36:10.176 INFO:teuthology.orchestra.run.smithi176.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-21T12:36:10.201 INFO:teuthology.orchestra.run.smithi176.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.8 MB/s | 90 kB 00:00 2024-09-21T12:36:10.227 INFO:teuthology.orchestra.run.smithi176.stdout:(12/13): python3-rsa-4.9-2.el9.noarch.rpm 706 kB/s | 59 kB 00:00 2024-09-21T12:36:10.260 INFO:teuthology.orchestra.run.smithi176.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-21T12:36:10.263 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:10.263 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.0 MB/s | 2.2 MB 00:01 2024-09-21T12:36:10.329 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:10.344 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:10.344 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:10.434 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:10.436 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:10.941 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:10.960 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T12:36:10.988 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:36:11.109 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T12:36:11.179 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T12:36:11.242 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T12:36:11.279 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T12:36:11.329 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T12:36:11.431 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T12:36:11.541 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T12:36:11.589 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T12:36:12.310 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T12:36:12.370 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T12:36:12.412 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T12:36:12.477 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T12:36:12.498 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:36:13.256 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:36:13.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T12:36:13.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T12:36:13.256 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T12:36:13.257 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T12:36:13.486 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:36:13.487 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T12:36:13.573 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:13.574 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:13.842 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T12:36:13.916 INFO:teuthology.orchestra.run.smithi046.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:13.917 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:14.294 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-rook 2024-09-21T12:36:14.431 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:14.564 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:14.565 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:14.565 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:36:14.565 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:14.565 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:14.565 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout:Install 6 Packages 2024-09-21T12:36:14.566 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:14.567 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 7.0 M 2024-09-21T12:36:14.567 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 33 M 2024-09-21T12:36:14.567 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:14.898 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:14.954 INFO:teuthology.orchestra.run.smithi176.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.5 MB/s | 248 kB 00:00 2024-09-21T12:36:15.013 INFO:teuthology.orchestra.run.smithi176.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.2 MB/s | 548 kB 00:00 2024-09-21T12:36:15.036 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T12:36:15.038 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout:Install 13 Packages 2024-09-21T12:36:15.039 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:15.040 INFO:teuthology.orchestra.run.smithi176.stdout:(3/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 605 kB/s | 146 kB 00:00 2024-09-21T12:36:15.040 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 2.2 M 2024-09-21T12:36:15.040 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 26 M 2024-09-21T12:36:15.041 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:15.055 INFO:teuthology.orchestra.run.smithi176.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.3 MB/s | 58 kB 00:00 2024-09-21T12:36:15.097 INFO:teuthology.orchestra.run.smithi176.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.2 MB/s | 74 kB 00:00 2024-09-21T12:36:15.181 INFO:teuthology.orchestra.run.smithi176.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-21T12:36:15.183 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:15.184 INFO:teuthology.orchestra.run.smithi176.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-21T12:36:15.255 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:15.266 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:15.266 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:15.366 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:15.367 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:15.498 INFO:teuthology.orchestra.run.smithi046.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 277 kB/s | 19 kB 00:00 2024-09-21T12:36:15.523 INFO:teuthology.orchestra.run.smithi046.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 271 kB/s | 26 kB 00:00 2024-09-21T12:36:15.598 INFO:teuthology.orchestra.run.smithi046.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-21T12:36:15.624 INFO:teuthology.orchestra.run.smithi046.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-09-21T12:36:15.649 INFO:teuthology.orchestra.run.smithi046.stdout:(5/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 223 kB/s | 49 kB 00:00 2024-09-21T12:36:15.674 INFO:teuthology.orchestra.run.smithi046.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T12:36:15.682 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:15.699 INFO:teuthology.orchestra.run.smithi046.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-21T12:36:15.750 INFO:teuthology.orchestra.run.smithi046.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 321 kB/s | 32 kB 00:00 2024-09-21T12:36:15.775 INFO:teuthology.orchestra.run.smithi046.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 141 kB/s | 14 kB 00:00 2024-09-21T12:36:15.800 INFO:teuthology.orchestra.run.smithi046.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T12:36:15.826 INFO:teuthology.orchestra.run.smithi046.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 2.0 MB/s | 220 kB 00:00 2024-09-21T12:36:15.845 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T12:36:15.851 INFO:teuthology.orchestra.run.smithi046.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-21T12:36:15.884 INFO:teuthology.orchestra.run.smithi046.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-21T12:36:15.887 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:15.887 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.6 MB/s | 2.2 MB 00:00 2024-09-21T12:36:15.899 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T12:36:15.958 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:15.974 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:15.974 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:16.075 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:16.075 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:16.440 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T12:36:16.526 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T12:36:16.590 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T12:36:16.598 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:16.620 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:36:16.773 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T12:36:16.829 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T12:36:16.885 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T12:36:16.920 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T12:36:16.962 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T12:36:17.077 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T12:36:17.187 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T12:36:17.248 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T12:36:17.372 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:36:17.372 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T12:36:17.372 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T12:36:17.372 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T12:36:17.372 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T12:36:17.372 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:17.639 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:17.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-fuse 2024-09-21T12:36:18.011 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T12:36:18.061 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T12:36:18.095 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T12:36:18.144 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T12:36:18.172 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:36:18.467 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:18.599 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout:Install 2 Packages 2024-09-21T12:36:18.600 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:18.601 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 976 k 2024-09-21T12:36:18.601 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 2.9 M 2024-09-21T12:36:18.601 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:18.775 INFO:teuthology.orchestra.run.smithi176.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 631 kB/s | 80 kB 00:00 2024-09-21T12:36:18.941 INFO:teuthology.orchestra.run.smithi176.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.0 MB/s | 897 kB 00:00 2024-09-21T12:36:18.942 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:18.942 INFO:teuthology.orchestra.run.smithi176.stdout:Total 2.8 MB/s | 976 kB 00:00 2024-09-21T12:36:18.952 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:36:18.952 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T12:36:18.952 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T12:36:18.952 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T12:36:18.952 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T12:36:18.952 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T12:36:18.953 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T12:36:18.953 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T12:36:18.953 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T12:36:18.953 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T12:36:18.953 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T12:36:18.953 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T12:36:18.954 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T12:36:18.954 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:18.975 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:18.975 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:19.056 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:19.057 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:19.245 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:19.289 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T12:36:19.289 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:19.289 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T12:36:19.290 INFO:teuthology.orchestra.run.smithi046.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T12:36:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T12:36:19.291 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:19.291 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:19.385 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T12:36:19.466 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:36:19.538 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T12:36:20.151 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:36:20.151 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T12:36:20.153 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:27 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:20.293 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T12:36:20.294 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout:Install 6 Packages 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 7.0 M 2024-09-21T12:36:20.295 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 33 M 2024-09-21T12:36:20.296 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:20.422 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T12:36:20.422 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:20.422 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:20.422 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T12:36:20.422 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:20.422 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:20.696 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librados-devel 2024-09-21T12:36:20.762 INFO:teuthology.orchestra.run.smithi046.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.4 MB/s | 248 kB 00:00 2024-09-21T12:36:20.787 INFO:teuthology.orchestra.run.smithi046.stdout:(2/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 720 kB/s | 146 kB 00:00 2024-09-21T12:36:20.846 INFO:teuthology.orchestra.run.smithi046.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-21T12:36:20.871 INFO:teuthology.orchestra.run.smithi046.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 757 kB/s | 58 kB 00:00 2024-09-21T12:36:20.897 INFO:teuthology.orchestra.run.smithi046.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-21T12:36:20.997 INFO:teuthology.orchestra.run.smithi046.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-09-21T12:36:21.000 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:21.000 INFO:teuthology.orchestra.run.smithi046.stdout:Total 9.9 MB/s | 7.0 MB 00:00 2024-09-21T12:36:21.074 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:21.087 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:21.087 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:21.193 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:21.195 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:21.292 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:28 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:21.431 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:21.431 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:36:21.432 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:21.433 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 127 k 2024-09-21T12:36:21.433 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 456 k 2024-09-21T12:36:21.433 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:21.534 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:21.646 INFO:teuthology.orchestra.run.smithi176.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 593 kB/s | 127 kB 00:00 2024-09-21T12:36:21.647 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:21.648 INFO:teuthology.orchestra.run.smithi176.stdout:Total 588 kB/s | 127 kB 00:00 2024-09-21T12:36:21.648 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:21.653 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:21.653 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:21.703 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T12:36:21.717 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:21.717 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:21.758 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T12:36:21.867 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:21.962 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:22.311 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T12:36:22.391 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:22.404 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T12:36:22.476 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T12:36:22.503 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:36:22.673 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:22.673 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:22.673 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:22.673 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:22.674 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:22.674 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:22.899 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs2 2024-09-21T12:36:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:36:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T12:36:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T12:36:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T12:36:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T12:36:23.255 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T12:36:23.492 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T12:36:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:23.529 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:23.583 INFO:teuthology.orchestra.run.smithi176.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:23.627 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:23.628 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:23.628 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:23.712 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install libcephfs-devel 2024-09-21T12:36:23.779 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install ceph-fuse 2024-09-21T12:36:24.302 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:24.387 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:31 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:24.436 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:24.436 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:24.436 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 32 k 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 142 k 2024-09-21T12:36:24.437 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:24.525 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repository Size 2024-09-21T12:36:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:24.526 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:24.526 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout:Installing dependencies: 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout:Install 2 Packages 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:24.527 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 976 k 2024-09-21T12:36:24.528 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 2.9 M 2024-09-21T12:36:24.528 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:24.584 INFO:teuthology.orchestra.run.smithi176.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 216 kB/s | 32 kB 00:00 2024-09-21T12:36:24.585 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:24.585 INFO:teuthology.orchestra.run.smithi176.stdout:Total 214 kB/s | 32 kB 00:00 2024-09-21T12:36:24.585 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:24.588 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:24.589 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:24.608 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:24.608 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:24.706 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:24.733 INFO:teuthology.orchestra.run.smithi046.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 507 kB/s | 80 kB 00:00 2024-09-21T12:36:24.823 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:24.849 INFO:teuthology.orchestra.run.smithi046.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.2 MB/s | 897 kB 00:00 2024-09-21T12:36:24.850 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:24.850 INFO:teuthology.orchestra.run.smithi046.stdout:Total 2.9 MB/s | 976 kB 00:00 2024-09-21T12:36:24.862 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:24.885 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:24.972 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:24.972 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:25.168 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:25.179 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:25.314 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T12:36:25.393 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:36:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:25.415 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:25.415 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:25.416 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:25.416 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:25.601 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librados2 2024-09-21T12:36:26.061 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:36:26.061 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T12:36:26.181 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:26.271 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:26.314 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:26.315 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:26.315 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:26.345 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T12:36:26.345 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:26.346 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:26.346 INFO:teuthology.orchestra.run.smithi046.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T12:36:26.346 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:26.346 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:26.387 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install librbd1 2024-09-21T12:36:26.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados-devel 2024-09-21T12:36:26.965 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:27.055 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:27.098 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:27.098 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:27.099 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:27.168 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rados 2024-09-21T12:36:27.244 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:27.385 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:27.386 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:27.386 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:36:27.386 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:27.386 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 127 k 2024-09-21T12:36:27.386 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 456 k 2024-09-21T12:36:27.386 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:27.587 INFO:teuthology.orchestra.run.smithi046.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 629 kB/s | 127 kB 00:00 2024-09-21T12:36:27.588 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:27.588 INFO:teuthology.orchestra.run.smithi046.stdout:Total 625 kB/s | 127 kB 00:00 2024-09-21T12:36:27.588 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:27.594 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:27.595 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:27.661 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:27.662 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:27.750 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:27.815 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:27.839 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:27.883 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:27.884 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:27.884 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:27.921 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:27.961 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rgw 2024-09-21T12:36:28.349 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:28.544 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:28.604 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:28.604 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:28.605 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:28.605 INFO:teuthology.orchestra.run.smithi046.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:28.605 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:28.605 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:28.633 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:28.677 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:28.677 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:28.678 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:28.749 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-cephfs 2024-09-21T12:36:28.857 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs2 2024-09-21T12:36:29.336 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:29.427 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:29.463 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:29.472 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:29.473 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:29.473 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:29.544 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install python3-rbd 2024-09-21T12:36:29.556 INFO:teuthology.orchestra.run.smithi046.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:29.602 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:29.603 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:29.603 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:29.681 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install libcephfs-devel 2024-09-21T12:36:30.125 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:30.215 INFO:teuthology.orchestra.run.smithi176.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:30.258 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:30.259 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2024-09-21T12:36:30.259 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:30.293 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:30.328 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-fuse 2024-09-21T12:36:30.434 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:30.434 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 32 k 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 142 k 2024-09-21T12:36:30.435 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:30.591 INFO:teuthology.orchestra.run.smithi046.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 204 kB/s | 32 kB 00:00 2024-09-21T12:36:30.592 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:30.592 INFO:teuthology.orchestra.run.smithi046.stdout:Total 202 kB/s | 32 kB 00:00 2024-09-21T12:36:30.592 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:30.596 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:30.596 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:30.609 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:30.610 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:30.701 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:30.799 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:30.909 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:31.041 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:31.042 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:36:31.043 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:31.043 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 85 k 2024-09-21T12:36:31.043 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 231 k 2024-09-21T12:36:31.043 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:31.162 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:31.246 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 421 kB/s | 85 kB 00:00 2024-09-21T12:36:31.246 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:31.246 INFO:teuthology.orchestra.run.smithi176.stdout:Total 418 kB/s | 85 kB 00:00 2024-09-21T12:36:31.247 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:31.253 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:31.253 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:31.316 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:31.316 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:31.402 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:31.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:31.402 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:31.402 INFO:teuthology.orchestra.run.smithi046.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:31.402 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:31.402 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:31.469 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:31.569 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:31.572 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librados2 2024-09-21T12:36:31.960 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:32.175 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:32.207 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:32.207 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:32.207 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:32.207 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:32.207 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:32.208 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:32.268 INFO:teuthology.orchestra.run.smithi046.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:32.397 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install librbd1 2024-09-21T12:36:32.427 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-mirror 2024-09-21T12:36:33.001 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:33.022 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:33.093 INFO:teuthology.orchestra.run.smithi046.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:33.139 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:33.140 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:33.140 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repo Size 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:33.159 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:33.160 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:33.160 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:36:33.160 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:33.160 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 3.1 M 2024-09-21T12:36:33.160 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 13 M 2024-09-21T12:36:33.160 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:33.216 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rados 2024-09-21T12:36:33.483 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:36:33.483 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:33.484 INFO:teuthology.orchestra.run.smithi176.stdout:Total 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:36:33.484 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:33.493 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:33.493 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:33.574 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:33.574 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:33.820 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:33.914 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:33.960 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:33.961 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:33.961 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:34.000 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:34.047 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rgw 2024-09-21T12:36:34.059 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:34.084 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:34.084 INFO:teuthology.orchestra.run.smithi176.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:36:34.084 INFO:teuthology.orchestra.run.smithi176.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T12:36:34.084 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:36:34.084 INFO:teuthology.orchestra.run.smithi176.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:36:34.084 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:34.650 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:34.740 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:34.786 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:34.787 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:34.788 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:34.875 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-cephfs 2024-09-21T12:36:35.119 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:35.119 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:35.119 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:35.120 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:35.120 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:35.120 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:35.385 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install rbd-nbd 2024-09-21T12:36:35.486 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:35.579 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:35.626 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:35.627 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:35.627 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:35.707 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install python3-rbd 2024-09-21T12:36:35.984 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:36.124 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout: Package Architecture Version Repository Size 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout:================================================================================ 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout:Install 1 Package 2024-09-21T12:36:36.125 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:36.126 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 170 k 2024-09-21T12:36:36.126 INFO:teuthology.orchestra.run.smithi176.stdout:Installed size: 494 k 2024-09-21T12:36:36.126 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2024-09-21T12:36:36.314 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:36.328 INFO:teuthology.orchestra.run.smithi176.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 843 kB/s | 170 kB 00:00 2024-09-21T12:36:36.329 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:36.329 INFO:teuthology.orchestra.run.smithi176.stdout:Total 836 kB/s | 170 kB 00:00 2024-09-21T12:36:36.329 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2024-09-21T12:36:36.337 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2024-09-21T12:36:36.337 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2024-09-21T12:36:36.404 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2024-09-21T12:36:36.405 INFO:teuthology.orchestra.run.smithi046.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:36:36.405 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2024-09-21T12:36:36.450 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:36.451 INFO:teuthology.orchestra.run.smithi046.stdout:Nothing to do. 2024-09-21T12:36:36.451 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:36.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-fuse 2024-09-21T12:36:36.573 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2024-09-21T12:36:36.676 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:37.137 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:37.144 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:37.276 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:37.276 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:37.276 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-21T12:36:37.276 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:37.276 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 85 k 2024-09-21T12:36:37.277 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 231 k 2024-09-21T12:36:37.278 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:37.440 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:37.440 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:37.440 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2024-09-21T12:36:37.440 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:37.440 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:36:37.440 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2024-09-21T12:36:37.469 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 446 kB/s | 85 kB 00:00 2024-09-21T12:36:37.470 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:37.470 INFO:teuthology.orchestra.run.smithi046.stdout:Total 443 kB/s | 85 kB 00:00 2024-09-21T12:36:37.470 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:37.478 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:37.478 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:37.545 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:37.546 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:37.702 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:37.751 DEBUG:teuthology.parallel:result is None 2024-09-21T12:36:37.796 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:38.189 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:38.461 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:38.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:38.461 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:38.461 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:38.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:38.461 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:38.678 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-mirror 2024-09-21T12:36:39.285 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:46 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:39.423 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout: Package Arch Version Repo Size 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:36:39.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:39.425 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 3.1 M 2024-09-21T12:36:39.425 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 13 M 2024-09-21T12:36:39.425 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:39.748 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:36:39.748 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:Total 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:36:39.749 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:39.759 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:39.759 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:39.844 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:39.845 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:40.292 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:40.349 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:40.374 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:36:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T12:36:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:36:40.375 INFO:teuthology.orchestra.run.smithi046.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:36:40.375 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:41.440 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:41.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:41.440 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:41.440 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:41.440 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:41.441 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:41.659 DEBUG:teuthology.orchestra.run.smithi046:> sudo yum -y install rbd-nbd 2024-09-21T12:36:42.274 INFO:teuthology.orchestra.run.smithi046.stdout:Last metadata expiration check: 0:01:49 ago on Sat 21 Sep 2024 12:34:53 PM UTC. 2024-09-21T12:36:42.416 INFO:teuthology.orchestra.run.smithi046.stdout:Dependencies resolved. 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout: Package Architecture Version Repository Size 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:Installing: 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction Summary 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:================================================================================ 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:Install 1 Package 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:Total download size: 170 k 2024-09-21T12:36:42.417 INFO:teuthology.orchestra.run.smithi046.stdout:Installed size: 494 k 2024-09-21T12:36:42.418 INFO:teuthology.orchestra.run.smithi046.stdout:Downloading Packages: 2024-09-21T12:36:42.627 INFO:teuthology.orchestra.run.smithi046.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 813 kB/s | 170 kB 00:00 2024-09-21T12:36:42.628 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:36:42.628 INFO:teuthology.orchestra.run.smithi046.stdout:Total 806 kB/s | 170 kB 00:00 2024-09-21T12:36:42.629 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction check 2024-09-21T12:36:42.637 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction check succeeded. 2024-09-21T12:36:42.637 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction test 2024-09-21T12:36:42.706 INFO:teuthology.orchestra.run.smithi046.stdout:Transaction test succeeded. 2024-09-21T12:36:42.707 INFO:teuthology.orchestra.run.smithi046.stdout:Running transaction 2024-09-21T12:36:42.870 INFO:teuthology.orchestra.run.smithi046.stdout: Preparing : 1/1 2024-09-21T12:36:42.962 INFO:teuthology.orchestra.run.smithi046.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:43.414 INFO:teuthology.orchestra.run.smithi046.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:43.663 INFO:teuthology.orchestra.run.smithi046.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:36:43.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:Installed: 2024-09-21T12:36:43.663 INFO:teuthology.orchestra.run.smithi046.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:36:43.663 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:36:43.663 INFO:teuthology.orchestra.run.smithi046.stdout:Complete! 2024-09-21T12:36:43.935 DEBUG:teuthology.parallel:result is None 2024-09-21T12:36:43.935 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:36:43.935 INFO:teuthology.packaging:ref: None 2024-09-21T12:36:43.935 INFO:teuthology.packaging:tag: None 2024-09-21T12:36:43.935 INFO:teuthology.packaging:branch: squid 2024-09-21T12:36:43.936 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:36:43.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:36:44.179 DEBUG:teuthology.orchestra.run.smithi046:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T12:36:44.202 INFO:teuthology.orchestra.run.smithi046.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T12:36:44.202 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T12:36:44.202 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T12:36:44.204 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:36:44.204 INFO:teuthology.packaging:ref: None 2024-09-21T12:36:44.204 INFO:teuthology.packaging:tag: None 2024-09-21T12:36:44.204 INFO:teuthology.packaging:branch: squid 2024-09-21T12:36:44.204 INFO:teuthology.packaging:sha1: 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:36:44.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:36:44.428 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T12:36:44.454 INFO:teuthology.orchestra.run.smithi176.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T12:36:44.455 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T12:36:44.455 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T12:36:44.457 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T12:36:44.457 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:36:44.457 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T12:36:44.489 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:36:44.490 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T12:36:44.524 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T12:36:44.524 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:36:44.524 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T12:36:44.576 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T12:36:44.646 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:36:44.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T12:36:44.675 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T12:36:44.744 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T12:36:44.745 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:36:44.745 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T12:36:44.774 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T12:36:44.843 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:36:44.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T12:36:44.872 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T12:36:44.940 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T12:36:44.940 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:36:44.940 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T12:36:44.968 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T12:36:45.037 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:36:45.037 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T12:36:45.065 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T12:36:45.131 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:36:45.139 INFO:teuthology.task.print:**** done install task... 2024-09-21T12:36:45.139 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T12:36:45.251 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '441784946648ff53dd310293f9dd752afeeea72a'} 2024-09-21T12:36:45.251 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T12:36:45.252 INFO:tasks.cephadm:Cluster fsid is 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:36:45.252 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T12:36:45.252 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-21T12:36:45.252 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi046': '172.21.15.46', 'mon.smithi176': '172.21.15.176'} 2024-09-21T12:36:45.252 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T12:36:45.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo hostname $(hostname -s) 2024-09-21T12:36:45.282 DEBUG:teuthology.orchestra.run.smithi176:> sudo hostname $(hostname -s) 2024-09-21T12:36:45.309 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-21T12:36:45.310 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:36:45.447 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '441784946648ff53dd310293f9dd752afeeea72a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83203/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5104-g44178494', 'node_name': '172.21.5.36+adami06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5104.g44178494'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 10:26:40.656703', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-21-0842', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-21-0842/441784946648ff53dd310293f9dd752afeeea72a/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T12:36:45.648 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 4e45e6b490e6cbe082cdf155fea780438ec53fc7 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-21T12:36:45.649 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T12:36:45.650 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T12:36:45.650 DEBUG:teuthology.orchestra.run.smithi046:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T12:36:46.009 INFO:teuthology.orchestra.run.smithi046.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 12:36 /home/ubuntu/cephtest/cephadm 2024-09-21T12:36:46.010 DEBUG:teuthology.orchestra.run.smithi176:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T12:36:46.377 INFO:teuthology.orchestra.run.smithi176.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 12:36 /home/ubuntu/cephtest/cephadm 2024-09-21T12:36:46.377 DEBUG:teuthology.orchestra.run.smithi046:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T12:36:46.397 DEBUG:teuthology.orchestra.run.smithi176:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T12:36:46.426 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-21T12:36:46.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T12:36:46.439 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T12:36:48.064 INFO:teuthology.orchestra.run.smithi046.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:36:48.103 INFO:teuthology.orchestra.run.smithi176.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:37:19.867 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-21T12:37:19.867 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:37:19.867 INFO:teuthology.orchestra.run.smithi176.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T12:37:19.867 INFO:teuthology.orchestra.run.smithi176.stdout: "repo_digests": [ 2024-09-21T12:37:19.867 INFO:teuthology.orchestra.run.smithi176.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T12:37:19.868 INFO:teuthology.orchestra.run.smithi176.stdout: ] 2024-09-21T12:37:19.868 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-21T12:37:20.054 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:37:20.054 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:37:20.055 INFO:teuthology.orchestra.run.smithi046.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T12:37:20.055 INFO:teuthology.orchestra.run.smithi046.stdout: "repo_digests": [ 2024-09-21T12:37:20.055 INFO:teuthology.orchestra.run.smithi046.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T12:37:20.055 INFO:teuthology.orchestra.run.smithi046.stdout: ] 2024-09-21T12:37:20.055 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:37:20.087 DEBUG:teuthology.orchestra.run.smithi046:> sudo mkdir -p /etc/ceph 2024-09-21T12:37:20.119 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph 2024-09-21T12:37:20.147 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 777 /etc/ceph 2024-09-21T12:37:20.187 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /etc/ceph 2024-09-21T12:37:20.212 INFO:tasks.cephadm:Writing seed config... 2024-09-21T12:37:20.213 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-21T12:37:20.213 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-21T12:37:20.213 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T12:37:20.213 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T12:37:20.213 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T12:37:20.213 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-21T12:37:20.214 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-21T12:37:20.215 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T12:37:20.215 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T12:37:20.215 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T12:37:20.215 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T12:37:20.215 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T12:37:20.215 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T12:37:20.215 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:37:20.215 DEBUG:teuthology.orchestra.run.smithi046:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T12:37:20.246 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 297e1ece-7816-11ef-baf6-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T12:37:20.246 DEBUG:teuthology.orchestra.run.smithi046:mon.smithi046> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service 2024-09-21T12:37:20.288 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T12:37:20.288 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 297e1ece-7816-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.46 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:37:20.501 INFO:teuthology.orchestra.run.smithi046.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:37:20.501 INFO:teuthology.orchestra.run.smithi046.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.46', '--skip-admin-label'] 2024-09-21T12:37:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T12:37:20.502 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying podman|docker is present... 2024-09-21T12:37:20.525 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-21T12:37:20.525 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying lvm2 is present... 2024-09-21T12:37:20.525 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying time synchronization is in place... 2024-09-21T12:37:20.533 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T12:37:20.533 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T12:37:20.539 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T12:37:20.539 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T12:37:20.546 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-21T12:37:20.553 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-21T12:37:20.553 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-21T12:37:20.553 INFO:teuthology.orchestra.run.smithi046.stdout:Repeating the final host check... 2024-09-21T12:37:20.576 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 5.2.2 2024-09-21T12:37:20.576 INFO:teuthology.orchestra.run.smithi046.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T12:37:20.576 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl is present 2024-09-21T12:37:20.576 INFO:teuthology.orchestra.run.smithi046.stdout:lvcreate is present 2024-09-21T12:37:20.583 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T12:37:20.583 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T12:37:20.589 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T12:37:20.589 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T12:37:20.596 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout enabled 2024-09-21T12:37:20.602 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout active 2024-09-21T12:37:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:Unit chronyd.service is enabled and running 2024-09-21T12:37:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:Host looks OK 2024-09-21T12:37:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:Cluster fsid: 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:Acquiring lock 140204456478560 on /run/cephadm/297e1ece-7816-11ef-baf6-efdc52797490.lock 2024-09-21T12:37:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:Lock 140204456478560 acquired on /run/cephadm/297e1ece-7816-11ef-baf6-efdc52797490.lock 2024-09-21T12:37:20.603 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 3300 ... 2024-09-21T12:37:20.604 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying IP 172.21.15.46 port 6789 ... 2024-09-21T12:37:20.604 INFO:teuthology.orchestra.run.smithi046.stdout:Base mon IP(s) is [172.21.15.46:3300, 172.21.15.46:6789], mon addrv is [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-21T12:37:20.607 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.46 metric 100 2024-09-21T12:37:20.607 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.46 metric 100 2024-09-21T12:37:20.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T12:37:20.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T12:37:20.610 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-21T12:37:20.612 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T12:37:20.612 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T12:37:20.612 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T12:37:20.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T12:37:20.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-21T12:37:20.613 INFO:teuthology.orchestra.run.smithi046.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T12:37:20.613 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-21T12:37:20.613 INFO:teuthology.orchestra.run.smithi046.stdout:Mon IP `172.21.15.46` is in CIDR network `172.21.0.0/20` 2024-09-21T12:37:20.613 INFO:teuthology.orchestra.run.smithi046.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T12:37:20.614 INFO:teuthology.orchestra.run.smithi046.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T12:37:20.614 INFO:teuthology.orchestra.run.smithi046.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:37:21.156 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stdout 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T12:37:21.157 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:37:21.157 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T12:37:21.157 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:66069d7a5240ff24cb47e5b84cff1b0dd6013e59abb2a061101c2af76e3da9e1 2024-09-21T12:37:21.157 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T12:37:21.157 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Copying config sha256:164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T12:37:21.157 INFO:teuthology.orchestra.run.smithi046.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T12:37:22.103 INFO:teuthology.orchestra.run.smithi046.stdout:ceph: stdout ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T12:37:22.103 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph version: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T12:37:22.103 INFO:teuthology.orchestra.run.smithi046.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T12:37:22.992 INFO:teuthology.orchestra.run.smithi046.stdout:stat: stdout 167 167 2024-09-21T12:37:22.992 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial keys... 2024-09-21T12:37:23.930 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQADvu5mwRHkExAAXy+a7ffrDY6lxGyzQbBHpw== 2024-09-21T12:37:24.953 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAEvu5muItFDhAAIJ6nUct/DQWxnAr+8V5FhA== 2024-09-21T12:37:25.801 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph-authtool: stdout AQAFvu5mGs2cDxAAv3wVxlCQVL00grJKtJDKjA== 2024-09-21T12:37:25.801 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial monmap... 2024-09-21T12:37:26.723 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T12:37:26.723 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T12:37:26.723 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:26.723 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T12:37:26.723 INFO:teuthology.orchestra.run.smithi046.stdout:monmaptool for smithi046 [v2:172.21.15.46:3300,v1:172.21.15.46:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T12:37:26.724 INFO:teuthology.orchestra.run.smithi046.stdout:setting min_mon_release = quincy 2024-09-21T12:37:26.724 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: set fsid to 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:26.724 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T12:37:26.724 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:37:26.724 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mon... 2024-09-21T12:37:27.662 INFO:teuthology.orchestra.run.smithi046.stdout:create mon.smithi046 on 2024-09-21T12:37:27.876 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T12:37:28.024 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T12:37:28.227 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-297e1ece-7816-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-297e1ece-7816-11ef-baf6-efdc52797490.target. 2024-09-21T12:37:28.227 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-297e1ece-7816-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-297e1ece-7816-11ef-baf6-efdc52797490.target. 2024-09-21T12:37:28.461 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046 2024-09-21T12:37:28.462 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service: Unit ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service not loaded. 2024-09-21T12:37:28.631 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-297e1ece-7816-11ef-baf6-efdc52797490.target.wants/ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service → /etc/systemd/system/ceph-297e1ece-7816-11ef-baf6-efdc52797490@.service. 2024-09-21T12:37:28.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:28 smithi046 podman[27479]: 2024-09-21 12:37:28.860607838 +0000 UTC m=+0.116604124 container create 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, ceph=True, RELEASE=squid-4e45e6b, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T12:37:29.147 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:37:29.147 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T12:37:29.155 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:37:29.155 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T12:37:29.156 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T12:37:29.156 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T12:37:29.156 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon to start... 2024-09-21T12:37:29.156 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mon... 2024-09-21T12:37:29.273 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:29 smithi046 podman[27479]: 2024-09-21 12:37:29.062756434 +0000 UTC m=+0.318752729 container init 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T12:37:29.273 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:29 smithi046 podman[27479]: 2024-09-21 12:37:29.066384263 +0000 UTC m=+0.322380548 container start 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:37:29.273 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:29 smithi046 ceph-mon[27500]: mkfs 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:29.273 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:29 smithi046 ceph-mon[27500]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-09-21T12:37:29.274 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:29 smithi046 bash[27479]: 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 2024-09-21T12:37:29.274 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:29 smithi046 systemd[1]: Started Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: monmap epoch 1 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: last_changed 2024-09-21T12:37:26.140175+0000 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: min_mon_release 19 (squid) 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: election_strategy: 1 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: fsmap 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: mgrmap e1: no daemons active 2024-09-21T12:37:30.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:30 smithi046 ceph-mon[27500]: from='client.? 172.21.15.46:0/2273768211' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T12:37:30.208 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T12:37:30.208 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout id: 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:30.208 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T12:37:30.208 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:30.208 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout services: 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi046 (age 0.547616s) 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout data: 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:mon is available 2024-09-21T12:37:30.209 INFO:teuthology.orchestra.run.smithi046.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T12:37:31.230 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T12:37:31.231 INFO:teuthology.orchestra.run.smithi046.stdout:Generating new minimal ceph.conf... 2024-09-21T12:37:31.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:31 smithi046 ceph-mon[27500]: from='client.? 172.21.15.46:0/2386980220' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T12:37:31.335 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:31 smithi046 ceph-mon[27500]: from='client.? 172.21.15.46:0/2386980220' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T12:37:32.201 INFO:teuthology.orchestra.run.smithi046.stdout:Restarting the monitor... 2024-09-21T12:37:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:32 smithi046 ceph-mon[27500]: from='client.? 172.21.15.46:0/3292663399' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:37:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:32 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:37:32.910 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:32 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[27496]: 2024-09-21T12:37:32.492+0000 7f3b6ff16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:37:32.910 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:32 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[27496]: 2024-09-21T12:37:32.492+0000 7f3b6ff16640 -1 mon.smithi046@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T12:37:32.910 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:32 smithi046 podman[27745]: 2024-09-21 12:37:32.64626612 +0000 UTC m=+0.272711371 container died 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b) 2024-09-21T12:37:33.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 podman[27745]: 2024-09-21 12:37:33.016989586 +0000 UTC m=+0.643434823 container cleanup 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T12:37:33.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 bash[27745]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046 2024-09-21T12:37:33.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 podman[27756]: 2024-09-21 12:37:33.259658865 +0000 UTC m=+0.610569563 container remove 7dee24a05a56f1ff48625958f588693dc1634372b43cc3087776e30368c17277 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T12:37:33.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service: Deactivated successfully. 2024-09-21T12:37:33.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:37:33.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 systemd[1]: Starting Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 podman[27849]: 2024-09-21 12:37:33.610378577 +0000 UTC m=+0.105685316 container create b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 podman[27849]: 2024-09-21 12:37:33.520881845 +0000 UTC m=+0.016188533 image pull 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 podman[27849]: 2024-09-21 12:37:33.820767256 +0000 UTC m=+0.316073957 container init b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 podman[27849]: 2024-09-21 12:37:33.823921814 +0000 UTC m=+0.319228492 container start b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T12:37:33.880 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: pidfile_write: ignore empty --pid-file 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: load: jerasure load: lrc 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Git sha 0 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: DB SUMMARY 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: DB Session ID: P8VK9JEU9KH5Z5FVY9LE 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000009.log size: 95837 ; 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:37:33.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.env: 0x55abe60aa940 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.info_log: 0x55abe71bd8c0 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.statistics: (nil) 2024-09-21T12:37:33.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.use_fsync: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.db_log_dir: 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.wal_dir: 2024-09-21T12:37:33.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.write_buffer_manager: 0x55abe71ccdc0 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:37:33.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.unordered_write: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.row_cache: None 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.wal_filter: None 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.wal_compression: 0 2024-09-21T12:37:33.886 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:37:33.887 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_open_files: -1 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:37:33.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Compression algorithms supported: 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kZSTD supported: 0 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000010 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:37:33.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.merge_operator: 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_filter: None 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55abe71bd520) 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-09-21T12:37:33.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 4 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x55abe71b11f0 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-09-21T12:37:33.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: bloomfilter 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 5 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_auto_readahead_size: 262144 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: prepopulate_block_cache: 0 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:37:33.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression: NoCompression 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.num_levels: 7 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:37:33.893 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:37:33.894 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:37:33.895 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:37:33.896 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.ttl: 2592000 2024-09-21T12:37:33.897 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T12:37:33.898 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e3fc7edd-d8ee-459f-8772-5d7d739e1dc1 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726922253850227, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726922253851199, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91838, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89879, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83247, "raw_average_value_size": 337, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726922253, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e3fc7edd-d8ee-459f-8772-5d7d739e1dc1", "db_session_id": "P8VK9JEU9KH5Z5FVY9LE", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726922253851298, "job": 1, "event": "recovery_finished"} 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55abe71dee00 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: DB pointer 0x55abe72da000 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:37:33.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 2/0 91.58 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 91.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:37:33.900 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 142.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 27.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 27.52 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:37:33.901 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache BinnedLRUCache@0x55abe71b11f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???) e1 preinit fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).mds e1 new map 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).mds e1 print_map 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e1 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: btime 2024-09-21T12:37:29:103548+0000 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: -1 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:37:33.902 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: No filesystems configured 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 ceph-mon[27868]: mon.smithi046@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 bash[27849]: b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f 2024-09-21T12:37:33.903 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:33 smithi046 systemd[1]: Started Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:37:33.903 INFO:teuthology.orchestra.run.smithi046.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T12:37:34.906 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T12:37:34.927 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:37:34.927 INFO:teuthology.orchestra.run.smithi046.stdout:Creating mgr... 2024-09-21T12:37:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T12:37:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T12:37:34.928 INFO:teuthology.orchestra.run.smithi046.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-21T12:37:35.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: mon.smithi046 is new leader, mons smithi046 in quorum (ranks 0) 2024-09-21T12:37:35.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: monmap epoch 1 2024-09-21T12:37:35.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: last_changed 2024-09-21T12:37:26.140175+0000 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: min_mon_release 19 (squid) 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: election_strategy: 1 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: fsmap 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: mgrmap e1: no daemons active 2024-09-21T12:37:35.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:34 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/716194053' entity='client.admin' 2024-09-21T12:37:35.177 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-297e1ece-7816-11ef-baf6-efdc52797490@mgr.smithi046.vedsjs 2024-09-21T12:37:35.177 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Failed to reset failed state of unit ceph-297e1ece-7816-11ef-baf6-efdc52797490@mgr.smithi046.vedsjs.service: Unit ceph-297e1ece-7816-11ef-baf6-efdc52797490@mgr.smithi046.vedsjs.service not loaded. 2024-09-21T12:37:35.332 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-297e1ece-7816-11ef-baf6-efdc52797490.target.wants/ceph-297e1ece-7816-11ef-baf6-efdc52797490@mgr.smithi046.vedsjs.service → /etc/systemd/system/ceph-297e1ece-7816-11ef-baf6-efdc52797490@.service. 2024-09-21T12:37:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:37:35.874 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T12:37:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:37:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T12:37:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T12:37:35.883 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T12:37:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:37:35.894 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T12:37:35.902 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:37:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T12:37:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T12:37:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-21T12:37:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr to start... 2024-09-21T12:37:35.903 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr... 2024-09-21T12:37:36.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:36 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2458401382' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T12:37:37.035 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "297e1ece-7816-11ef-baf6-efdc52797490", 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-21T12:37:37.036 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T12:37:37.037 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T12:37:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T12:37:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T12:37:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T12:37:37.038 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T12:37:37.041 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T12:37:29:103548+0000", 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.042 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:37.043 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T12:37:29.104223+0000", 2024-09-21T12:37:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:37:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T12:37:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:37:37.044 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (1/15)... 2024-09-21T12:37:39.734 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:39 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3198700236' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "297e1ece-7816-11ef-baf6-efdc52797490", 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T12:37:40.063 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T12:37:40.064 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T12:37:40.065 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T12:37:29:103548+0000", 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T12:37:40.066 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T12:37:29.104223+0000", 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:37:40.067 INFO:teuthology.orchestra.run.smithi046.stdout:mgr not available, waiting (2/15)... 2024-09-21T12:37:41.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:37:41.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: mgrmap e2: smithi046.vedsjs(active, starting, since 0.0029196s) 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' 2024-09-21T12:37:41.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:40 smithi046 ceph-mon[27868]: from='mgr.14100 172.21.15.46:0/628459268' entity='mgr.smithi046.vedsjs' 2024-09-21T12:37:42.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:42 smithi046 ceph-mon[27868]: mgrmap e3: smithi046.vedsjs(active, since 1.00725s) 2024-09-21T12:37:42.975 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:42 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/927515444' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T12:37:43.255 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:43.255 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsid": "297e1ece-7816-11ef-baf6-efdc52797490", 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 0 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "smithi046" 2024-09-21T12:37:43.256 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T12:37:43.257 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T12:37:43.261 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T12:37:29:103548+0000", 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T12:37:43.262 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T12:37:29.104223+0000", 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:37:43.263 INFO:teuthology.orchestra.run.smithi046.stdout:mgr is available 2024-09-21T12:37:44.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:43 smithi046 ceph-mon[27868]: mgrmap e4: smithi046.vedsjs(active, since 2s) 2024-09-21T12:37:45.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:45 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3098416714' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout fsid = 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.46:3300,v1:172.21.15.46:6789] 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T12:37:51.323 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T12:37:51.324 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling cephadm module... 2024-09-21T12:37:55.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:54 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2778046857' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T12:37:56.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:55 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2778046857' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T12:37:56.098 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:55 smithi046 ceph-mon[27868]: mgrmap e5: smithi046.vedsjs(active, since 13s) 2024-09-21T12:37:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:57 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1657055051' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.vedsjs", 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-21T12:37:58.285 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 5... 2024-09-21T12:38:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: Active manager daemon smithi046.vedsjs restarted 2024-09-21T12:38:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:38:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T12:38:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: mgrmap e6: smithi046.vedsjs(active, starting, since 0.00297384s) 2024-09-21T12:38:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:38:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:38:00.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:37:59 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:38:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:00 smithi046 ceph-mon[27868]: Found migration_current of "None". Setting to last migration. 2024-09-21T12:38:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:00 smithi046 ceph-mon[27868]: mgrmap e7: smithi046.vedsjs(active, since 1.00545s) 2024-09-21T12:38:01.431 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:38:01.431 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T12:38:01.431 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T12:38:01.431 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:38:01.432 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 5 is available 2024-09-21T12:38:01.432 INFO:teuthology.orchestra.run.smithi046.stdout:Setting orchestrator backend to cephadm... 2024-09-21T12:38:02.033 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:01 smithi046 ceph-mon[27868]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T12:38:02.033 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:01 smithi046 ceph-mon[27868]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T12:38:02.033 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:01 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:02.033 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:01 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:02.993 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:02 smithi046 ceph-mon[27868]: mgrmap e8: smithi046.vedsjs(active, since 2s) 2024-09-21T12:38:02.993 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:02 smithi046 ceph-mon[27868]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:02.993 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:02 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:02.993 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:02 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:38:03.685 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T12:38:03.685 INFO:teuthology.orchestra.run.smithi046.stdout:Generating ssh key... 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:03] ENGINE Bus STARTING 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:03] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:03] ENGINE Error in HTTPServer.serve 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:38:03.941 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:03] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:03] ENGINE Bus STARTED 2024-09-21T12:38:03.942 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:03 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:38:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:05 smithi046 ceph-mon[27868]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:05 smithi046 ceph-mon[27868]: Generating ssh key... 2024-09-21T12:38:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:05 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:05 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:06.232 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2WiH8JpAzFF1bZpxVRw4oytVpHCGUFAfkjoFILAxGkbOALIVGcnwdedXqDmNWaw0GKxZNkG4IHa2y9lD32vz8m/YO8d7nVMrqLMSyi3BkiU95aI8a53cwftUqPPNujIm1Ey3cBc8/wtj9hc21K3nvnoPnFT5fZ9x9ODlwnqsFgOZT+oFxhc96S4QTLuCz0KyN9eZ++YdTvTvUI2VZyVaA0FfD79gY7cpcR/y3qbtkNda6smdrt9Q2qk2twNA//PWjF9Lk0npSAFidswkJg1ntzXIpO97eSm8BanqsChhME9RNaxdS2zeuF428xgXBHlCJMSEqU/6zedUW/+p7639uZDcLQgJMqGofz08RAcQKxUpr4KoxpVVUIM+rpretKpWyE2Zpjmk9pEMcI1rGfKcQNPXAiezGCuXFcdCzvqUDFtnqW97EtnSviLBdWPHIW+lKHjXL8TSLTNGRgCWqfySLjDK/5mm9VapTV7PiBJMhHNXWFIdKLewLfAp1HDeg+UU= ceph-297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:38:06.233 INFO:teuthology.orchestra.run.smithi046.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T12:38:06.233 INFO:teuthology.orchestra.run.smithi046.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T12:38:06.236 INFO:teuthology.orchestra.run.smithi046.stdout:Adding host smithi046... 2024-09-21T12:38:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:06 smithi046 ceph-mon[27868]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:07.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:07 smithi046 ceph-mon[27868]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi046", "addr": "172.21.15.46", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:09.084 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:08 smithi046 ceph-mon[27868]: Deploying cephadm binary to smithi046 2024-09-21T12:38:11.347 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Added host 'smithi046' with addr '172.21.15.46' 2024-09-21T12:38:11.348 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mon service with default placement... 2024-09-21T12:38:11.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:11 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:11.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:11 smithi046 ceph-mon[27868]: Added host smithi046 2024-09-21T12:38:11.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:11 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:38:12.631 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T12:38:12.632 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying mgr service with default placement... 2024-09-21T12:38:13.175 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:12 smithi046 ceph-mon[27868]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:13.175 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:12 smithi046 ceph-mon[27868]: Saving service mon spec with placement count:5 2024-09-21T12:38:13.175 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:12 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:14.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:14 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:14.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:14 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:14.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:14 smithi046 ceph-mon[27868]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:14.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:14 smithi046 ceph-mon[27868]: Saving service mgr spec with placement count:2 2024-09-21T12:38:14.891 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:14 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T12:38:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying crash service with default placement... 2024-09-21T12:38:16.535 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-21T12:38:16.535 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying ceph-exporter service with default placement... 2024-09-21T12:38:16.650 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:16 smithi046 ceph-mon[27868]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:16.650 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:16 smithi046 ceph-mon[27868]: Saving service crash spec with placement * 2024-09-21T12:38:16.650 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:16 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:17.724 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-21T12:38:17.725 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying prometheus service with default placement... 2024-09-21T12:38:18.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:18 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:18.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:18 smithi046 ceph-mon[27868]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:18.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:18 smithi046 ceph-mon[27868]: Saving service ceph-exporter spec with placement * 2024-09-21T12:38:18.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:18 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:18.292 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:18 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-21T12:38:18.949 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying grafana service with default placement... 2024-09-21T12:38:19.609 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:19 smithi046 ceph-mon[27868]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:19.609 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:19 smithi046 ceph-mon[27868]: Saving service prometheus spec with placement count:1 2024-09-21T12:38:19.609 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:19 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:20.701 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-21T12:38:20.701 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying node-exporter service with default placement... 2024-09-21T12:38:21.092 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:20 smithi046 ceph-mon[27868]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:21.092 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:20 smithi046 ceph-mon[27868]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:21.092 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:20 smithi046 ceph-mon[27868]: Saving service grafana spec with placement count:1 2024-09-21T12:38:21.092 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:20 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:22.082 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-21T12:38:22.082 INFO:teuthology.orchestra.run.smithi046.stdout:Deploying alertmanager service with default placement... 2024-09-21T12:38:22.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:22 smithi046 ceph-mon[27868]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:22.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:22 smithi046 ceph-mon[27868]: Saving service node-exporter spec with placement * 2024-09-21T12:38:22.330 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:22 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:23.271 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-21T12:38:23.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:23 smithi046 ceph-mon[27868]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:23.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:23 smithi046 ceph-mon[27868]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:23.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:23 smithi046 ceph-mon[27868]: Saving service alertmanager spec with placement count:1 2024-09-21T12:38:23.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:23 smithi046 ceph-mon[27868]: from='mgr.14118 172.21.15.46:0/3361319329' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:25.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:24 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2188939515' entity='client.admin' 2024-09-21T12:38:25.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:24 smithi046 ceph-mon[27868]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:25.565 INFO:teuthology.orchestra.run.smithi046.stdout:Enabling the dashboard module... 2024-09-21T12:38:26.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:26 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4179809015' entity='client.admin' 2024-09-21T12:38:27.368 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:27 smithi046 ceph-mon[27868]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:27.369 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:27 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2970515105' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T12:38:28.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:28 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2970515105' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T12:38:28.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:28 smithi046 ceph-mon[27868]: mgrmap e9: smithi046.vedsjs(active, since 27s) 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "active_name": "smithi046.vedsjs", 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for the mgr to restart... 2024-09-21T12:38:28.862 INFO:teuthology.orchestra.run.smithi046.stdout:Waiting for mgr epoch 9... 2024-09-21T12:38:29.111 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:29 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3489379139' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: Active manager daemon smithi046.vedsjs restarted 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: mgrmap e10: smithi046.vedsjs(active, starting, since 0.0029655s) 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:38:32.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:32 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:38:33.602 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:38:33.603 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T12:38:33.603 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T12:38:33.603 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:38:33.603 INFO:teuthology.orchestra.run.smithi046.stdout:mgr epoch 9 is available 2024-09-21T12:38:33.603 INFO:teuthology.orchestra.run.smithi046.stdout:Generating a dashboard self-signed certificate... 2024-09-21T12:38:34.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:34 smithi046 ceph-mon[27868]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T12:38:34.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:34 smithi046 ceph-mon[27868]: mgrmap e11: smithi046.vedsjs(active, since 1.00673s) 2024-09-21T12:38:34.296 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:34 smithi046 ceph-mon[27868]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T12:38:34.885 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T12:38:34.885 INFO:teuthology.orchestra.run.smithi046.stdout:Creating initial admin user... 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: mgrmap e12: smithi046.vedsjs(active, since 2s) 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:34] ENGINE Bus STARTING 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:34] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:34] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:34] ENGINE Bus STARTED 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: [21/Sep/2024:12:38:34] ENGINE Error in HTTPServer.serve 2024-09-21T12:38:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T12:38:35.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:38:35.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-21T12:38:35.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:38:35.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T12:38:35.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:38:35.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:35 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:36.291 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$eCKy7rdfCX6mNIc6s17EI.USkhK435PBGXMKJeXS.Sr2npK1csI6O", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726922315, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T12:38:36.292 INFO:teuthology.orchestra.run.smithi046.stdout:Fetching dashboard port number... 2024-09-21T12:38:36.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:36 smithi046 ceph-mon[27868]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:36.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:36 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:36.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:36 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:37 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2728958783' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T12:38:38.288 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T12:38:38.298 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:38:38.299 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout disabled 2024-09-21T12:38:38.307 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:38:38.307 INFO:teuthology.orchestra.run.smithi046.stdout:systemctl: stdout inactive 2024-09-21T12:38:38.307 INFO:teuthology.orchestra.run.smithi046.stdout:firewalld.service is not enabled 2024-09-21T12:38:38.307 INFO:teuthology.orchestra.run.smithi046.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T12:38:38.309 INFO:teuthology.orchestra.run.smithi046.stdout:Ceph Dashboard is now available at: 2024-09-21T12:38:38.309 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:38.309 INFO:teuthology.orchestra.run.smithi046.stdout: URL: https://smithi046.front.sepia.ceph.com:8443/ 2024-09-21T12:38:38.309 INFO:teuthology.orchestra.run.smithi046.stdout: User: admin 2024-09-21T12:38:38.309 INFO:teuthology.orchestra.run.smithi046.stdout: Password: 6jnoqr4hcs 2024-09-21T12:38:38.310 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:38.310 INFO:teuthology.orchestra.run.smithi046.stdout:Saving cluster configuration to /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config directory 2024-09-21T12:38:39.569 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T12:38:39.569 INFO:teuthology.orchestra.run.smithi046.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T12:38:39.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.570 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:38:39.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.570 INFO:teuthology.orchestra.run.smithi046.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T12:38:39.570 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.570 INFO:teuthology.orchestra.run.smithi046.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout: ceph telemetry on 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout:For more information see: 2024-09-21T12:38:39.571 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.572 INFO:teuthology.orchestra.run.smithi046.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T12:38:39.572 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:39.572 INFO:teuthology.orchestra.run.smithi046.stdout:Bootstrap complete. 2024-09-21T12:38:39.612 INFO:tasks.cephadm:Fetching config... 2024-09-21T12:38:39.612 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:38:39.612 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T12:38:39.629 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T12:38:39.630 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:38:39.630 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T12:38:39.686 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T12:38:39.686 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:38:39.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/keyring of=/dev/stdout 2024-09-21T12:38:39.752 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T12:38:39.752 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:38:39.752 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T12:38:39.808 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T12:38:39.808 DEBUG:teuthology.orchestra.run.smithi046:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2WiH8JpAzFF1bZpxVRw4oytVpHCGUFAfkjoFILAxGkbOALIVGcnwdedXqDmNWaw0GKxZNkG4IHa2y9lD32vz8m/YO8d7nVMrqLMSyi3BkiU95aI8a53cwftUqPPNujIm1Ey3cBc8/wtj9hc21K3nvnoPnFT5fZ9x9ODlwnqsFgOZT+oFxhc96S4QTLuCz0KyN9eZ++YdTvTvUI2VZyVaA0FfD79gY7cpcR/y3qbtkNda6smdrt9Q2qk2twNA//PWjF9Lk0npSAFidswkJg1ntzXIpO97eSm8BanqsChhME9RNaxdS2zeuF428xgXBHlCJMSEqU/6zedUW/+p7639uZDcLQgJMqGofz08RAcQKxUpr4KoxpVVUIM+rpretKpWyE2Zpjmk9pEMcI1rGfKcQNPXAiezGCuXFcdCzvqUDFtnqW97EtnSviLBdWPHIW+lKHjXL8TSLTNGRgCWqfySLjDK/5mm9VapTV7PiBJMhHNXWFIdKLewLfAp1HDeg+UU= ceph-297e1ece-7816-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T12:38:39.869 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:39 smithi046 ceph-mon[27868]: mgrmap e13: smithi046.vedsjs(active, since 6s) 2024-09-21T12:38:39.869 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:39 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1237415016' entity='client.admin' 2024-09-21T12:38:39.882 INFO:teuthology.orchestra.run.smithi046.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2WiH8JpAzFF1bZpxVRw4oytVpHCGUFAfkjoFILAxGkbOALIVGcnwdedXqDmNWaw0GKxZNkG4IHa2y9lD32vz8m/YO8d7nVMrqLMSyi3BkiU95aI8a53cwftUqPPNujIm1Ey3cBc8/wtj9hc21K3nvnoPnFT5fZ9x9ODlwnqsFgOZT+oFxhc96S4QTLuCz0KyN9eZ++YdTvTvUI2VZyVaA0FfD79gY7cpcR/y3qbtkNda6smdrt9Q2qk2twNA//PWjF9Lk0npSAFidswkJg1ntzXIpO97eSm8BanqsChhME9RNaxdS2zeuF428xgXBHlCJMSEqU/6zedUW/+p7639uZDcLQgJMqGofz08RAcQKxUpr4KoxpVVUIM+rpretKpWyE2Zpjmk9pEMcI1rGfKcQNPXAiezGCuXFcdCzvqUDFtnqW97EtnSviLBdWPHIW+lKHjXL8TSLTNGRgCWqfySLjDK/5mm9VapTV7PiBJMhHNXWFIdKLewLfAp1HDeg+UU= ceph-297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:38:39.894 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2WiH8JpAzFF1bZpxVRw4oytVpHCGUFAfkjoFILAxGkbOALIVGcnwdedXqDmNWaw0GKxZNkG4IHa2y9lD32vz8m/YO8d7nVMrqLMSyi3BkiU95aI8a53cwftUqPPNujIm1Ey3cBc8/wtj9hc21K3nvnoPnFT5fZ9x9ODlwnqsFgOZT+oFxhc96S4QTLuCz0KyN9eZ++YdTvTvUI2VZyVaA0FfD79gY7cpcR/y3qbtkNda6smdrt9Q2qk2twNA//PWjF9Lk0npSAFidswkJg1ntzXIpO97eSm8BanqsChhME9RNaxdS2zeuF428xgXBHlCJMSEqU/6zedUW/+p7639uZDcLQgJMqGofz08RAcQKxUpr4KoxpVVUIM+rpretKpWyE2Zpjmk9pEMcI1rGfKcQNPXAiezGCuXFcdCzvqUDFtnqW97EtnSviLBdWPHIW+lKHjXL8TSLTNGRgCWqfySLjDK/5mm9VapTV7PiBJMhHNXWFIdKLewLfAp1HDeg+UU= ceph-297e1ece-7816-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T12:38:39.958 INFO:teuthology.orchestra.run.smithi176.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC2WiH8JpAzFF1bZpxVRw4oytVpHCGUFAfkjoFILAxGkbOALIVGcnwdedXqDmNWaw0GKxZNkG4IHa2y9lD32vz8m/YO8d7nVMrqLMSyi3BkiU95aI8a53cwftUqPPNujIm1Ey3cBc8/wtj9hc21K3nvnoPnFT5fZ9x9ODlwnqsFgOZT+oFxhc96S4QTLuCz0KyN9eZ++YdTvTvUI2VZyVaA0FfD79gY7cpcR/y3qbtkNda6smdrt9Q2qk2twNA//PWjF9Lk0npSAFidswkJg1ntzXIpO97eSm8BanqsChhME9RNaxdS2zeuF428xgXBHlCJMSEqU/6zedUW/+p7639uZDcLQgJMqGofz08RAcQKxUpr4KoxpVVUIM+rpretKpWyE2Zpjmk9pEMcI1rGfKcQNPXAiezGCuXFcdCzvqUDFtnqW97EtnSviLBdWPHIW+lKHjXL8TSLTNGRgCWqfySLjDK/5mm9VapTV7PiBJMhHNXWFIdKLewLfAp1HDeg+UU= ceph-297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:38:39.972 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T12:38:40.224 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:38:41.902 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T12:38:41.902 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3802256344' entity='client.admin' 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T12:38:42.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:41 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:38:42.385 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:38:43.070 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:42 smithi046 ceph-mon[27868]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-09-21T12:38:43.644 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi176 2024-09-21T12:38:43.644 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:38:43.645 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/etc/ceph/ceph.conf 2024-09-21T12:38:43.663 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:38:43.663 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:38:43.722 INFO:tasks.cephadm:Adding host smithi176 to orchestrator... 2024-09-21T12:38:43.722 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch host add smithi176 2024-09-21T12:38:44.117 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:38:44.353 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:44 smithi046 ceph-mon[27868]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:44.354 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:44 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:46 smithi046 ceph-mon[27868]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:47.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:47.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:47.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:47.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:47.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:38:47.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T12:38:47.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:38:47.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: Deploying daemon crash.smithi046 on smithi046 2024-09-21T12:38:47.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: Deploying cephadm binary to smithi176 2024-09-21T12:38:47.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:47 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:49.566 INFO:teuthology.orchestra.run.smithi046.stdout:Added host 'smithi176' with addr '172.21.15.176' 2024-09-21T12:38:49.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:49 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:49.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:49 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:49.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:49 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:49.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:49 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:49.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:49 smithi046 ceph-mon[27868]: Deploying daemon node-exporter.smithi046 on smithi046 2024-09-21T12:38:49.870 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:49 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:50.169 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T12:38:50.425 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:38:50.907 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:50 smithi046 ceph-mon[27868]: Added host smithi176 2024-09-21T12:38:51.054 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:38:51.054 INFO:teuthology.orchestra.run.smithi046.stdout:[{"addr": "172.21.15.46", "hostname": "smithi046", "labels": [], "status": ""}, {"addr": "172.21.15.176", "hostname": "smithi176", "labels": [], "status": ""}] 2024-09-21T12:38:52.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:51 smithi046 ceph-mon[27868]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:38:52.292 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T12:38:52.293 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T12:38:53.181 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:38:53.297 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:53 smithi046 ceph-mon[27868]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:53.298 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:53 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:54.188 INFO:teuthology.orchestra.run.smithi046.stderr:adjusted tunables profile to default 2024-09-21T12:38:54.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:54 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:54.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:54 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:54.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:54 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:54.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:54 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:54.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:54 smithi046 ceph-mon[27868]: Deploying daemon alertmanager.smithi046 on smithi046 2024-09-21T12:38:54.465 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:54 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2877122619' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T12:38:55.010 INFO:tasks.cephadm:Adding mon.smithi046 on smithi046 2024-09-21T12:38:55.010 INFO:tasks.cephadm:Adding mon.smithi176 on smithi176 2024-09-21T12:38:55.011 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch apply mon '2;smithi046:172.21.15.46=smithi046;smithi176:172.21.15.176=smithi176' 2024-09-21T12:38:55.268 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:38:55.313 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:38:55.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:55 smithi046 ceph-mon[27868]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:55.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:55 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2877122619' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T12:38:55.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:55 smithi046 ceph-mon[27868]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T12:38:55.891 INFO:teuthology.orchestra.run.smithi176.stdout:Scheduled mon update... 2024-09-21T12:38:56.468 DEBUG:teuthology.orchestra.run.smithi176:mon.smithi176> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176.service 2024-09-21T12:38:56.471 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:38:56.471 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:38:56.741 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:38:56.787 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:38:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:56 smithi046 ceph-mon[27868]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi176:172.21.15.176=smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:38:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:56 smithi046 ceph-mon[27868]: Saving service mon spec with placement smithi046:172.21.15.46=smithi046;smithi176:172.21.15.176=smithi176;count:2 2024-09-21T12:38:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:56 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:57.424 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:38:57.425 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:38:57.425 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:38:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:57 smithi046 ceph-mon[27868]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:38:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:57 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:38:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:57 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/3275282021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:38:58.964 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:38:58.965 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:38:59.203 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:38:59.247 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:38:59.874 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:38:59.874 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:38:59.875 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:59 smithi046 ceph-mon[27868]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:38:59 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/1567551785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:01.471 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:01.471 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:01.714 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:01.759 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:39:02.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:01 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:02.396 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:02.396 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:02.396 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:02 smithi046 ceph-mon[27868]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T12:39:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:02 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:39:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:02 smithi046 ceph-mon[27868]: Deploying daemon grafana.smithi046 on smithi046 2024-09-21T12:39:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:02 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:02 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/3235509629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:04.009 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:04.009 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:04.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:03 smithi046 ceph-mon[27868]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:04.255 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:04.298 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:04.926 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:04.926 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:04.927 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:05 smithi046 ceph-mon[27868]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:05 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/4156535953' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:06.506 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:06.506 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:06.747 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:06.792 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:07.402 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:07.402 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:07.402 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:08.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:07 smithi046 ceph-mon[27868]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:08.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:07 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/1739955694' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:08.990 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:08.991 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:09.234 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:09.278 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:09.926 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:09.927 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:09.927 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:09 smithi046 ceph-mon[27868]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:11.136 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:10 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/3116574236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:11.485 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:11.485 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:11.740 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:11.786 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:11.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:11.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:11.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:11 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:12.490 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:12.490 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:12.490 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:13.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:12 smithi046 ceph-mon[27868]: Deploying daemon prometheus.smithi046 on smithi046 2024-09-21T12:39:13.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:12 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:13.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:12 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2752249740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:14.116 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:14.117 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:13 smithi046 ceph-mon[27868]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:14.362 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:14.416 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:15.047 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:15.047 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:15.047 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:16.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:15 smithi046 ceph-mon[27868]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:16.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:15 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/3599943415' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:16.597 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:16.597 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:16.835 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:16.880 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:17.541 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:17.541 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:17.541 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:18.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:17 smithi046 ceph-mon[27868]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:18.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:17 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/287154407' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:19.169 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:19.169 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:19.411 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:19.455 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:20.040 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:19 smithi046 ceph-mon[27868]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:20.126 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:20.126 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:20.126 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:21.114 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:20 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/1548834164' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:21.694 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:21.694 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:21.937 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:21.982 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:22.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:21 smithi046 ceph-mon[27868]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:22.635 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:22.636 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:22.636 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:23.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:23 smithi046 ceph-mon[27868]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:23.649 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:23 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:23.649 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:23 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:23.649 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:23 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:23.649 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:23 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T12:39:23.649 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:23 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/4111197008' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:24.318 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:24.318 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:24.552 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:24.597 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:24.601 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:24 smithi046 ceph-mon[27868]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T12:39:24.601 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:24 smithi046 ceph-mon[27868]: mgrmap e14: smithi046.vedsjs(active, since 51s) 2024-09-21T12:39:25.273 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:25.274 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:25.274 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:25.595 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:25 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2117678033' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:26.863 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:26.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:27.105 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:27.149 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:27.812 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:27.812 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:27.812 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:28.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:27 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/3837479984' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: Active manager daemon smithi046.vedsjs restarted 2024-09-21T12:39:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:39:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:39:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: mgrmap e15: smithi046.vedsjs(active, starting, since 0.00326988s) 2024-09-21T12:39:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:39:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:39:28.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:39:29.352 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:29.352 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:29.605 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:29.660 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:30.331 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:30.331 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:30.331 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:30 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:30 smithi046 ceph-mon[27868]: mgrmap e16: smithi046.vedsjs(active, since 1.00539s) 2024-09-21T12:39:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:30 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:31.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:31 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/1198909181' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:31.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:32.098 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:32.099 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:32 smithi046 ceph-mon[27868]: [21/Sep/2024:12:39:30] ENGINE Bus STARTING 2024-09-21T12:39:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:32 smithi046 ceph-mon[27868]: [21/Sep/2024:12:39:30] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T12:39:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:32 smithi046 ceph-mon[27868]: [21/Sep/2024:12:39:30] ENGINE Error in HTTPServer.serve 2024-09-21T12:39:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-21T12:39:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:39:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:39:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T12:39:32.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:39:32.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:32 smithi046 ceph-mon[27868]: [21/Sep/2024:12:39:30] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T12:39:32.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:32 smithi046 ceph-mon[27868]: [21/Sep/2024:12:39:30] ENGINE Bus STARTED 2024-09-21T12:39:32.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:32 smithi046 ceph-mon[27868]: mgrmap e17: smithi046.vedsjs(active, since 2s) 2024-09-21T12:39:32.588 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:32.639 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:39:33.350 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:33.351 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:33.351 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2383548980' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:34.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:39:34.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:34.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:35.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:35.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:35.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:35.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:39:35.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T12:39:35.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:35.499 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:35.500 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:35.913 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:36.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:35 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:39:36.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:35 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:39:36.182 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:35 smithi046 ceph-mon[27868]: Deploying daemon ceph-exporter.smithi176 on smithi176 2024-09-21T12:39:36.757 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:36.757 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:36.758 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:36 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/4134172700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:38.359 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:38.359 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:39.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:39:39.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T12:39:39.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:39.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: Deploying daemon crash.smithi176 on smithi176 2024-09-21T12:39:39.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:39.271 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:40.074 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:40.074 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:40.074 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:40.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:40 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2202083913' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:41 smithi046 ceph-mon[27868]: Deploying daemon node-exporter.smithi176 on smithi176 2024-09-21T12:39:41.994 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:41.994 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:42.245 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:43.385 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:43.385 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:43.385 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:44.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:44 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:44.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:44 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:39:44.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:44 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/242655661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:45.543 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:45.543 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:39:46.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:46.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:45 smithi046 ceph-mon[27868]: Deploying daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:39:46.435 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:47.197 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:47.197 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:47.198 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:47.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:47 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2834610276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:48.903 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:48.904 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:49.223 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: Deploying daemon mon.smithi176 on smithi176 2024-09-21T12:39:49.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:49.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:50.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:50 smithi046 ceph-mon[27868]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:51.413 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:51.413 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":1,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:37:26.140175Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:39:51.414 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 1 2024-09-21T12:39:51.414 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:51 smithi176 podman[35441]: 2024-09-21 12:39:51.381947476 +0000 UTC m=+0.166966517 container create 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:39:51.745 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:51 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2030337865' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 podman[35441]: 2024-09-21 12:39:52.391430496 +0000 UTC m=+1.176449533 container init 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 podman[35441]: 2024-09-21 12:39:52.39584972 +0000 UTC m=+1.180868754 container start 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pidfile_write: ignore empty --pid-file 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: load: jerasure load: lrc 2024-09-21T12:39:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Git sha 0 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: DB SUMMARY 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: DB Session ID: ALIIDPTMQL9LRX5X15NY 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi176/store.db dir, Total Num: 0, files: 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi176/store.db: 000004.log size: 511 ; 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:39:52.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.env: 0x557f26eae940 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.info_log: 0x557f2775b8c0 2024-09-21T12:39:52.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:39:52.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.statistics: (nil) 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.use_fsync: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.db_log_dir: 2024-09-21T12:39:52.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.wal_dir: 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.write_buffer_manager: 0x557f2776adc0 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:39:52.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.unordered_write: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.row_cache: None 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.wal_filter: None 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:39:52.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.wal_compression: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:39:52.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_open_files: -1 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:39:52.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Compression algorithms supported: 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kZSTD supported: 0 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi176/store.db/MANIFEST-000005 2024-09-21T12:39:52.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.merge_operator: 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_filter: None 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557f2775b520) 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: index_type: 0 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: data_block_index_type: 0 2024-09-21T12:39:52.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: index_shortening: 1 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: checksum: 4 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: no_block_cache: 0 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache: 0x557f2774f1f0 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache_options: 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: capacity : 536870912 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: num_shard_bits : 4 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: strict_capacity_limit : 0 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache_compressed: (nil) 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: persistent_cache: (nil) 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_size: 4096 2024-09-21T12:39:52.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_size_deviation: 10 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_restart_interval: 16 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: index_block_restart_interval: 1 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: metadata_block_size: 4096 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: partition_filters: 0 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: use_delta_encoding: 1 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: filter_policy: bloomfilter 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: whole_key_filtering: 1 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: verify_compression: 0 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: format_version: 5 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: enable_index_compression: 1 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_align: 0 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: max_auto_readahead_size: 262144 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: prepopulate_block_cache: 0 2024-09-21T12:39:52.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression: NoCompression 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.num_levels: 7 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:39:52.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:39:52.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:39:52.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:39:52.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:39:52.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.ttl: 2592000 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:39:52.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi176/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b0d5d66a-e520-4051-aa99-e13e73f45bde 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726922392423130, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726922392423683, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726922392, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b0d5d66a-e520-4051-aa99-e13e73f45bde", "db_session_id": "ALIIDPTMQL9LRX5X15NY", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726922392423808, "job": 1, "event": "recovery_finished"} 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi176/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557f2777ce00 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: DB pointer 0x557f27878000 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** DB Stats ** 2024-09-21T12:39:52.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** Compaction Stats [default] ** 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:39:52.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** Compaction Stats [default] ** 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:39:52.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Block cache BinnedLRUCache@0x557f2774f1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176 does not exist in monmap, will attempt to join an existing cluster 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: using public_addr v2:172.21.15.176:0/0 -> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: starting mon.smithi176 rank -1 at public addrs [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] at bind addrs [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi176 fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(???) e0 preinit fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).mds e1 new map 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).mds e1 print_map 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: e1 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: btime 2024-09-21T12:37:29:103548+0000 2024-09-21T12:39:52.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: legacy client fscid: -1 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: No filesystems configured 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:39:52.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon alertmanager.smithi046 on smithi046 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2877122619' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2877122619' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi046:172.21.15.46=smithi046;smithi176:172.21.15.176=smithi176", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:39:52.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Saving service mon spec with placement smithi046:172.21.15.46=smithi046;smithi176:172.21.15.176=smithi176;count:2 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/3275282021' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/1567551785' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.592 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.593 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:39:52.593 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.593 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon grafana.smithi046 on smithi046 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/3235509629' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/4156535953' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/1739955694' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/3116574236' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.594 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon prometheus.smithi046 on smithi046 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2752249740' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/3599943415' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.595 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/287154407' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/1548834164' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/4111197008' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14162 172.21.15.46:0/3933761824' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mgrmap e14: smithi046.vedsjs(active, since 51s) 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2117678033' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/3837479984' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Active manager daemon smithi046.vedsjs restarted 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mgrmap e15: smithi046.vedsjs(active, starting, since 0.00326988s) 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:39:52.597 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mgrmap e16: smithi046.vedsjs(active, since 1.00539s) 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/1198909181' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: [21/Sep/2024:12:39:30] ENGINE Bus STARTING 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: [21/Sep/2024:12:39:30] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: [21/Sep/2024:12:39:30] ENGINE Error in HTTPServer.serve 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Traceback (most recent call last): 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._run(expiration_interval) 2024-09-21T12:39:52.598 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: s = self.context.wrap_socket( 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: return self.sslsocket_class._create( 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self.do_handshake() 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._sslobj.do_handshake() 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: [21/Sep/2024:12:39:30] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T12:39:52.599 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: [21/Sep/2024:12:39:30] ENGINE Bus STARTED 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mgrmap e17: smithi046.vedsjs(active, since 2s) 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2383548980' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi046", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi176", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:52.600 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T12:39:52.601 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon ceph-exporter.smithi176 on smithi176 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/4134172700' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon crash.smithi176 on smithi176 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2202083913' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon node-exporter.smithi176 on smithi176 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/242655661' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T12:39:52.603 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2834610276' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: Deploying daemon mon.smithi176 on smithi176 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:52.604 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2030337865' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:52.605 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 ceph-mon[35476]: mon.smithi176@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-21T12:39:52.605 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 bash[35441]: 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f 2024-09-21T12:39:52.605 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:52 smithi176 systemd[1]: Started Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:39:53.278 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:39:53.279 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:39:53.523 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: mon.smithi046 calling monitor election 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: mon.smithi176 calling monitor election 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: mon.smithi046 is new leader, mons smithi046,smithi176 in quorum (ranks 0,1) 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: monmap epoch 2 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: last_changed 2024-09-21T12:39:52.456233+0000 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: min_mon_release 19 (squid) 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: election_strategy: 1 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.smithi176 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: fsmap 2024-09-21T12:39:57.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: mgrmap e17: smithi046.vedsjs(active, since 29s) 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: overall HEALTH_OK 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.825 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:39:57.825 INFO:teuthology.orchestra.run.smithi176.stdout:{"epoch":2,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","modified":"2024-09-21T12:39:52.456233Z","created":"2024-09-21T12:37:26.140175Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi046","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:3300","nonce":0},{"type":"v1","addr":"172.21.15.46:6789","nonce":0}]},"addr":"172.21.15.46:6789/0","public_addr":"172.21.15.46:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi176","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:3300","nonce":0},{"type":"v1","addr":"172.21.15.176:6789","nonce":0}]},"addr":"172.21.15.176:6789/0","public_addr":"172.21.15.176:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T12:39:57.825 INFO:teuthology.orchestra.run.smithi176.stderr:dumped monmap epoch 2 2024-09-21T12:39:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:39:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: mon.smithi046 calling monitor election 2024-09-21T12:39:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:39:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: mon.smithi176 calling monitor election 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: mon.smithi046 is new leader, mons smithi046,smithi176 in quorum (ranks 0,1) 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: monmap epoch 2 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: last_changed 2024-09-21T12:39:52.456233+0000 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: min_mon_release 19 (squid) 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: election_strategy: 1 2024-09-21T12:39:57.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.smithi176 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: fsmap 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: mgrmap e17: smithi046.vedsjs(active, since 29s) 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: overall HEALTH_OK 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1312123515' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:57.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:58.467 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T12:39:58.468 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T12:39:58.735 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:39:58.756 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: mgrmap e18: smithi046.vedsjs(active, since 29s), standbys: smithi176.rmyfjh 2024-09-21T12:39:58.756 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi176.rmyfjh", "id": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:39:58.756 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:39:58.756 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2054142594' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:58.756 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:58.756 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:39:58.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:58.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:58.856 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: mgrmap e18: smithi046.vedsjs(active, since 29s), standbys: smithi176.rmyfjh 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi176.rmyfjh", "id": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2054142594' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:39:58.857 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:39:59.379 INFO:teuthology.orchestra.run.smithi046.stdout:# minimal ceph.conf for 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:39:59.379 INFO:teuthology.orchestra.run.smithi046.stdout:[global] 2024-09-21T12:39:59.379 INFO:teuthology.orchestra.run.smithi046.stdout: fsid = 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:39:59.379 INFO:teuthology.orchestra.run.smithi046.stdout: mon_host = [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] 2024-09-21T12:39:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:39:59 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2092680561' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:39:59 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2092680561' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:39:59.985 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T12:39:59.985 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:39:59.985 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T12:40:00.014 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:40:00.014 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:40:00.083 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:40:00.083 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T12:40:00.109 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:40:00.109 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:40:00.176 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T12:40:00.176 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T12:40:00.178 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T12:40:00.178 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T12:40:00.221 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T12:40:00.221 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T12:40:00.265 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T12:40:00.265 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T12:40:00.308 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T12:40:00.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T12:40:00.351 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T12:40:00.351 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T12:40:00.394 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T12:40:00.395 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T12:40:00.437 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T12:40:00.437 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T12:40:00.481 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T12:40:00.481 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T12:40:00.525 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T12:40:00.525 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T12:40:00.533 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:00.544 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T12:40:00.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T12:40:00.588 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T12:40:00.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T12:40:00.645 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T12:40:00.645 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T12:40:00.688 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T12:40:00.689 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T12:40:00.734 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T12:40:00.734 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T12:40:00.783 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T12:40:00.783 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T12:40:00.835 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-21T12:40:00.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-21T12:40:00.885 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T12:40:00.885 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T12:40:00.928 DEBUG:tasks.cephadm:set 18 configs 2024-09-21T12:40:00.928 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi046') 2024-09-21T12:40:00.977 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:01.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: overall HEALTH_OK 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.022 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.023 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:40:01.023 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:40:01.023 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: overall HEALTH_OK 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:40:01.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:40:01.319 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:02.175 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi046') 2024-09-21T12:40:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:01 smithi176 ceph-mon[35476]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-09-21T12:40:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:01 smithi176 ceph-mon[35476]: Reconfiguring daemon mon.smithi046 on smithi046 2024-09-21T12:40:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:01 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4052957306' entity='client.admin' 2024-09-21T12:40:02.375 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:01 smithi046 ceph-mon[27868]: Reconfiguring mon.smithi046 (unknown last config time)... 2024-09-21T12:40:02.375 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:01 smithi046 ceph-mon[27868]: Reconfiguring daemon mon.smithi046 on smithi046 2024-09-21T12:40:02.375 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:01 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4052957306' entity='client.admin' 2024-09-21T12:40:02.552 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.643 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.646 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.647 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.647 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.656 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.659 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.662 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.665 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.666 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.671 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:02.684 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:03.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:02 smithi046 ceph-mon[27868]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:03.052 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:02 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4036237473' entity='client.admin' 2024-09-21T12:40:03.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:02 smithi176 ceph-mon[35476]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:03.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:02 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4036237473' entity='client.admin' 2024-09-21T12:40:03.144 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:04.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:04 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3627207285' entity='client.admin' 2024-09-21T12:40:04.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:04 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2213788170' entity='client.admin' 2024-09-21T12:40:04.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:04 smithi046 ceph-mon[27868]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:04.831 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:04 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2246532944' entity='client.admin' 2024-09-21T12:40:05.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:04 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3627207285' entity='client.admin' 2024-09-21T12:40:05.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:04 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2213788170' entity='client.admin' 2024-09-21T12:40:05.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:04 smithi176 ceph-mon[35476]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:05.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:04 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2246532944' entity='client.admin' 2024-09-21T12:40:05.611 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:05 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1128524927' entity='client.admin' 2024-09-21T12:40:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:05 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1128524927' entity='client.admin' 2024-09-21T12:40:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 -- 172.21.15.46:0/3000846356 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f927006e380 msgr2=0x7f9270070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:06.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 --2- 172.21.15.46:0/3000846356 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f927006e380 0x7f9270070840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9278000f80 tx=0x7f9278005c50 comp rx=0 tx=0).stop 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 -- 172.21.15.46:0/3000846356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288196f10 msgr2=0x7f928819bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 --2- 172.21.15.46:0/3000846356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288196f10 0x7f928819bf10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f927c00b490 tx=0x7f927c00b950 comp rx=0 tx=0).stop 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 -- 172.21.15.46:0/3000846356 shutdown_connections 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 --2- 172.21.15.46:0/3000846356 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f927006e380 0x7f9270070840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 --2- 172.21.15.46:0/3000846356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9288196f10 0x7f928819bf10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 --2- 172.21.15.46:0/3000846356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9288101600 0x7f92881969d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 -- 172.21.15.46:0/3000846356 >> 172.21.15.46:0/3000846356 conn(0x7f92880fcdb0 msgr2=0x7f92880fd7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 -- 172.21.15.46:0/3000846356 shutdown_connections 2024-09-21T12:40:06.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:06.823+0000 7f928dc40640 1 -- 172.21.15.46:0/3000846356 wait complete. 2024-09-21T12:40:07.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:06 smithi046 ceph-mon[27868]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:07.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:06 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3000846356' entity='client.admin' 2024-09-21T12:40:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:06 smithi176 ceph-mon[35476]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:06 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3000846356' entity='client.admin' 2024-09-21T12:40:08.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi046') 2024-09-21T12:40:08.068 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T12:40:08.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:08 smithi046 ceph-mon[27868]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:08.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:08 smithi176 ceph-mon[35476]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:09.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 -- 172.21.15.46:0/1918615055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 msgr2=0x7f6b641044f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/1918615055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641044f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6b58009880 tx=0x7f6b5802a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 -- 172.21.15.46:0/1918615055 shutdown_connections 2024-09-21T12:40:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/1918615055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641044f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 -- 172.21.15.46:0/1918615055 >> 172.21.15.46:0/1918615055 conn(0x7f6b640fbca0 msgr2=0x7f6b640fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 -- 172.21.15.46:0/1918615055 shutdown_connections 2024-09-21T12:40:09.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 -- 172.21.15.46:0/1918615055 wait complete. 2024-09-21T12:40:09.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.694+0000 7f6b6aedf640 1 Processor -- start 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b6aedf640 1 -- start start 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b6aedf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641019f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b6aedf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b641000b0 0x7f6b64100530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b6aedf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6b64107440 con 0x7f6b64102100 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b6aedf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6b641072c0 con 0x7f6b641000b0 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641019f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641019f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43110/0 (socket says 172.21.15.46:43110) 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 -- 172.21.15.46:0/672470944 learned_addr learned my addr 172.21.15.46:0/672470944 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b63fff640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b641000b0 0x7f6b64100530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:09.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 -- 172.21.15.46:0/672470944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b641000b0 msgr2=0x7f6b64100530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b641000b0 0x7f6b64100530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 -- 172.21.15.46:0/672470944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b64100a70 con 0x7f6b64102100 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.695+0000 7f6b68c7b640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641019f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6b58000c00 tx=0x7f6b580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.696+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b5803f070 con 0x7f6b64102100 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.696+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f6b58004ac0 con 0x7f6b64102100 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.696+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b64100d00 con 0x7f6b64102100 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.696+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b58035030 con 0x7f6b64102100 2024-09-21T12:40:09.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.696+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6419ec70 con 0x7f6b64102100 2024-09-21T12:40:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.697+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b64107be0 con 0x7f6b64102100 2024-09-21T12:40:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.698+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f6b58042070 con 0x7f6b64102100 2024-09-21T12:40:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.698+0000 7f6b61ffb640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6b5406e330 0x7f6b540707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:09.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.698+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f6b580add40 con 0x7f6b64102100 2024-09-21T12:40:09.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.698+0000 7f6b63fff640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6b5406e330 0x7f6b540707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:09.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.699+0000 7f6b63fff640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6b5406e330 0x7f6b540707f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b64101770 tx=0x7f6b50008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:09.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.703+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b5807c650 con 0x7f6b64102100 2024-09-21T12:40:09.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.882+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f6b6402d980 con 0x7f6b64102100 2024-09-21T12:40:09.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.885+0000 7f6b61ffb640 1 -- 172.21.15.46:0/672470944 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v19)=0 v19) ==== 115+0+0 (secure 0 0 0) 0x7f6b58080300 con 0x7f6b64102100 2024-09-21T12:40:09.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6b5406e330 msgr2=0x7f6b540707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:09.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6b5406e330 0x7f6b540707f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6b64101770 tx=0x7f6b50008040 comp rx=0 tx=0).stop 2024-09-21T12:40:09.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 msgr2=0x7f6b641019f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:09.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641019f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6b58000c00 tx=0x7f6b580046c0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 shutdown_connections 2024-09-21T12:40:09.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6b5406e330 0x7f6b540707f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6b641000b0 0x7f6b64100530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 --2- 172.21.15.46:0/672470944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6b64102100 0x7f6b641019f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:09.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 >> 172.21.15.46:0/672470944 conn(0x7f6b640fbca0 msgr2=0x7f6b640fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:09.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 shutdown_connections 2024-09-21T12:40:09.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.888+0000 7f6b6aedf640 1 -- 172.21.15.46:0/672470944 wait complete. 2024-09-21T12:40:10.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.578+0000 7fe939af1640 1 -- 172.21.15.46:0/1100771107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9341020d0 msgr2=0x7fe9341044c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:10.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.578+0000 7fe939af1640 1 --2- 172.21.15.46:0/1100771107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9341020d0 0x7fe9341044c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe924009880 tx=0x7fe92402a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:10.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.578+0000 7fe939af1640 1 -- 172.21.15.46:0/1100771107 shutdown_connections 2024-09-21T12:40:10.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.578+0000 7fe939af1640 1 --2- 172.21.15.46:0/1100771107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9341020d0 0x7fe9341044c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:10.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.579+0000 7fe939af1640 1 -- 172.21.15.46:0/1100771107 >> 172.21.15.46:0/1100771107 conn(0x7fe9340fbcd0 msgr2=0x7fe9340fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:10.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.579+0000 7fe939af1640 1 -- 172.21.15.46:0/1100771107 shutdown_connections 2024-09-21T12:40:10.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.579+0000 7fe939af1640 1 -- 172.21.15.46:0/1100771107 wait complete. 2024-09-21T12:40:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.579+0000 7fe939af1640 1 Processor -- start 2024-09-21T12:40:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.579+0000 7fe939af1640 1 -- start start 2024-09-21T12:40:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe939af1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9341020d0 0x7fe9341969f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe939af1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 0x7fe93419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe939af1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9341073a0 con 0x7fe934196f30 2024-09-21T12:40:10.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe939af1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe934107220 con 0x7fe9341020d0 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 0x7fe93419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 0x7fe93419bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43122/0 (socket says 172.21.15.46:43122) 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 -- 172.21.15.46:0/884044237 learned_addr learned my addr 172.21.15.46:0/884044237 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe9337fe640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9341020d0 0x7fe9341969f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 -- 172.21.15.46:0/884044237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9341020d0 msgr2=0x7fe9341969f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9341020d0 0x7fe9341969f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 -- 172.21.15.46:0/884044237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe934197460 con 0x7fe934196f30 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe932ffd640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 0x7fe93419bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe92800b4a0 tx=0x7fe92800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe928014070 con 0x7fe934196f30 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe93419c470 con 0x7fe934196f30 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.580+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7fe928010a90 con 0x7fe934196f30 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.581+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe928017bd0 con 0x7fe934196f30 2024-09-21T12:40:10.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.581+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe93419c9f0 con 0x7fe934196f30 2024-09-21T12:40:10.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.582+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe934107b40 con 0x7fe934196f30 2024-09-21T12:40:10.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.582+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe928017070 con 0x7fe934196f30 2024-09-21T12:40:10.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.582+0000 7fe930ff9640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe91c06e340 0x7fe91c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:10.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.583+0000 7fe9337fe640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe91c06e340 0x7fe91c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:10.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.583+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe92800d040 con 0x7fe934196f30 2024-09-21T12:40:10.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.583+0000 7fe9337fe640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe91c06e340 0x7fe91c070800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe924000c00 tx=0x7fe924004e10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:10.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.587+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe92801e030 con 0x7fe934196f30 2024-09-21T12:40:10.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.766+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fe93402dab0 con 0x7fe934196f30 2024-09-21T12:40:10.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.788+0000 7fe930ff9640 1 -- 172.21.15.46:0/884044237 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v20)=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fe92805b1c0 con 0x7fe934196f30 2024-09-21T12:40:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe91c06e340 msgr2=0x7fe91c070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe91c06e340 0x7fe91c070800 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe924000c00 tx=0x7fe924004e10 comp rx=0 tx=0).stop 2024-09-21T12:40:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 msgr2=0x7fe93419bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 0x7fe93419bf30 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe92800b4a0 tx=0x7fe92800b960 comp rx=0 tx=0).stop 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 shutdown_connections 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe91c06e340 0x7fe91c070800 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe934196f30 0x7fe93419bf30 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.790+0000 7fe939af1640 1 --2- 172.21.15.46:0/884044237 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9341020d0 0x7fe9341969f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.791+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 >> 172.21.15.46:0/884044237 conn(0x7fe9340fbcd0 msgr2=0x7fe9340fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.791+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 shutdown_connections 2024-09-21T12:40:10.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.791+0000 7fe939af1640 1 -- 172.21.15.46:0/884044237 wait complete. 2024-09-21T12:40:10.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:10 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3078984254' entity='client.admin' 2024-09-21T12:40:10.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:10 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/672470944' entity='client.admin' 2024-09-21T12:40:10.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:10 smithi046 ceph-mon[27868]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:11.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:10 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3078984254' entity='client.admin' 2024-09-21T12:40:11.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:10 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/672470944' entity='client.admin' 2024-09-21T12:40:11.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:10 smithi176 ceph-mon[35476]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.484+0000 7fb56f94c640 1 -- 172.21.15.46:0/2861082222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 msgr2=0x7fb568104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.484+0000 7fb56f94c640 1 --2- 172.21.15.46:0/2861082222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568104490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb564009880 tx=0x7fb56402a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 -- 172.21.15.46:0/2861082222 shutdown_connections 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 --2- 172.21.15.46:0/2861082222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568104490 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 -- 172.21.15.46:0/2861082222 >> 172.21.15.46:0/2861082222 conn(0x7fb5680fbc80 msgr2=0x7fb5680fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 -- 172.21.15.46:0/2861082222 shutdown_connections 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 -- 172.21.15.46:0/2861082222 wait complete. 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 Processor -- start 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.485+0000 7fb56f94c640 1 -- start start 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56f94c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56f94c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb568196f50 0x7fb56819bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56f94c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb5681073e0 con 0x7fb5681020a0 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56f94c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb568107260 con 0x7fb568196f50 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:11.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43174/0 (socket says 172.21.15.46:43174) 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 -- 172.21.15.46:0/4220383741 learned_addr learned my addr 172.21.15.46:0/4220383741 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56cee7640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb568196f50 0x7fb56819bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 -- 172.21.15.46:0/4220383741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb568196f50 msgr2=0x7fb56819bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb568196f50 0x7fb56819bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 -- 172.21.15.46:0/4220383741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb568197480 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56d6e8640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568196a10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb564000c00 tx=0x7fb5640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb56403f070 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7fb564004ac0 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56819c490 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.486+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb564035030 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.487+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56819ca10 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.487+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb568107b80 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.488+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fb564042070 con 0x7fb5681020a0 2024-09-21T12:40:11.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.488+0000 7fb55e7fc640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb55406e380 0x7fb554070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:11.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.488+0000 7fb56cee7640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb55406e380 0x7fb554070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:11.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.488+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fb5640adb60 con 0x7fb5681020a0 2024-09-21T12:40:11.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.489+0000 7fb56cee7640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb55406e380 0x7fb554070840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb568197ec0 tx=0x7fb558008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:11.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.493+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb56407c590 con 0x7fb5681020a0 2024-09-21T12:40:11.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.676+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fb56802d9d0 con 0x7fb5681020a0 2024-09-21T12:40:11.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.679+0000 7fb55e7fc640 1 -- 172.21.15.46:0/4220383741 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v22)=0 v22) ==== 120+0+0 (secure 0 0 0) 0x7fb564080240 con 0x7fb5681020a0 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.681+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb55406e380 msgr2=0x7fb554070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.681+0000 7fb56f94c640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb55406e380 0x7fb554070840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb568197ec0 tx=0x7fb558008040 comp rx=0 tx=0).stop 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.681+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 msgr2=0x7fb568196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.681+0000 7fb56f94c640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568196a10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb564000c00 tx=0x7fb5640046c0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 shutdown_connections 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb55406e380 0x7fb554070840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb568196f50 0x7fb56819bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 --2- 172.21.15.46:0/4220383741 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5681020a0 0x7fb568196a10 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 >> 172.21.15.46:0/4220383741 conn(0x7fb5680fbc80 msgr2=0x7fb5680fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:11.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 shutdown_connections 2024-09-21T12:40:11.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.682+0000 7fb56f94c640 1 -- 172.21.15.46:0/4220383741 wait complete. 2024-09-21T12:40:11.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 -- 172.21.15.46:0/644428240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7981020a0 msgr2=0x7fa798104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/644428240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7981020a0 0x7fa798104490 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa794009880 tx=0x7fa79402a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 -- 172.21.15.46:0/644428240 shutdown_connections 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/644428240 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7981020a0 0x7fa798104490 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 -- 172.21.15.46:0/644428240 >> 172.21.15.46:0/644428240 conn(0x7fa7980fbc80 msgr2=0x7fa7980fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 -- 172.21.15.46:0/644428240 shutdown_connections 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 -- 172.21.15.46:0/644428240 wait complete. 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 Processor -- start 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.965+0000 7fa79ffd3640 1 -- start start 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79ffd3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7981020a0 0x7fa798101990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79ffd3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 0x7fa7981004d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79ffd3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa7981073e0 con 0x7fa798100050 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79ffd3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa798107260 con 0x7fa7981020a0 2024-09-21T12:40:11.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 0x7fa7981004d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 0x7fa7981004d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43148/0 (socket says 172.21.15.46:43148) 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 -- 172.21.15.46:0/726501649 learned_addr learned my addr 172.21.15.46:0/726501649 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79dd6f640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7981020a0 0x7fa798101990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 -- 172.21.15.46:0/726501649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7981020a0 msgr2=0x7fa798101990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7981020a0 0x7fa798101990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 -- 172.21.15.46:0/726501649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa798100a10 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79d56e640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 0x7fa7981004d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa78800b4a0 tx=0x7fa78800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa788014070 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7fa788010a90 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa798100d00 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa788017bd0 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.966+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79819ec30 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.967+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa798107b80 con 0x7fa798100050 2024-09-21T12:40:11.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.968+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa798100050 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.968+0000 7fa78effd640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa78406e380 0x7fa784070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.969+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa78800d040 con 0x7fa798100050 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.969+0000 7fa79dd6f640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa78406e380 0x7fa784070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.969+0000 7fa79dd6f640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa78406e380 0x7fa784070840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7940096c0 tx=0x7fa794004e10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:10.973+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa78801e030 con 0x7fa798100050 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.151+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7fa798102500 con 0x7fa798100050 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.155+0000 7fa78effd640 1 -- 172.21.15.46:0/726501649 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v21)=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7fa78805b150 con 0x7fa798100050 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa78406e380 msgr2=0x7fa784070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa78406e380 0x7fa784070840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa7940096c0 tx=0x7fa794004e10 comp rx=0 tx=0).stop 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 msgr2=0x7fa7981004d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 0x7fa7981004d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa78800b4a0 tx=0x7fa78800b960 comp rx=0 tx=0).stop 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 shutdown_connections 2024-09-21T12:40:11.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa78406e380 0x7fa784070840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa798100050 0x7fa7981004d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 --2- 172.21.15.46:0/726501649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7981020a0 0x7fa798101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:11.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.157+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 >> 172.21.15.46:0/726501649 conn(0x7fa7980fbc80 msgr2=0x7fa7980fc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:11.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.158+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 shutdown_connections 2024-09-21T12:40:11.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:11.158+0000 7fa79ffd3640 1 -- 172.21.15.46:0/726501649 wait complete. 2024-09-21T12:40:11.956 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:11 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/884044237' entity='client.admin' 2024-09-21T12:40:11.956 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:11 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/726501649' entity='client.admin' 2024-09-21T12:40:11.956 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:11 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4220383741' entity='client.admin' 2024-09-21T12:40:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 -- 172.21.15.46:0/2720460623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0102170 msgr2=0x7f9bc0104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2720460623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0102170 0x7f9bc0104560 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009880 tx=0x7f9bb002a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 -- 172.21.15.46:0/2720460623 shutdown_connections 2024-09-21T12:40:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2720460623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0102170 0x7f9bc0104560 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 -- 172.21.15.46:0/2720460623 >> 172.21.15.46:0/2720460623 conn(0x7f9bc00fbcd0 msgr2=0x7f9bc00fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 -- 172.21.15.46:0/2720460623 shutdown_connections 2024-09-21T12:40:12.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.040+0000 7f9bc5122640 1 -- 172.21.15.46:0/2720460623 wait complete. 2024-09-21T12:40:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bc5122640 1 Processor -- start 2024-09-21T12:40:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bc5122640 1 -- start start 2024-09-21T12:40:12.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bc5122640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0102170 0x7f9bc0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bc5122640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 0x7f9bc019bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bc5122640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0107400 con 0x7f9bc0196f90 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bc5122640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc0107280 con 0x7f9bc0102170 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bbe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 0x7f9bc019bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bbe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 0x7f9bc019bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43190/0 (socket says 172.21.15.46:43190) 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bbe59c640 1 -- 172.21.15.46:0/2205860604 learned_addr learned my addr 172.21.15.46:0/2205860604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.041+0000 7f9bbed9d640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0102170 0x7f9bc0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9bbe59c640 1 -- 172.21.15.46:0/2205860604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0102170 msgr2=0x7f9bc0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9bbe59c640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0102170 0x7f9bc0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9bbe59c640 1 -- 172.21.15.46:0/2205860604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc01974c0 con 0x7f9bc0196f90 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9bbe59c640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 0x7f9bc019bf90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400b4a0 tx=0x7f9bb400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bb4014070 con 0x7f9bc0196f90 2024-09-21T12:40:12.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f9bb4010a90 con 0x7f9bc0196f90 2024-09-21T12:40:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc019c4d0 con 0x7f9bc0196f90 2024-09-21T12:40:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9bb4017bd0 con 0x7f9bc0196f90 2024-09-21T12:40:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.042+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc019ca50 con 0x7f9bc0196f90 2024-09-21T12:40:12.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.043+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc0107ba0 con 0x7f9bc0196f90 2024-09-21T12:40:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.044+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f9bb4017070 con 0x7f9bc0196f90 2024-09-21T12:40:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.044+0000 7f9ba7fff640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ba806e380 0x7f9ba8070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.044+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9bb400d040 con 0x7f9bc0196f90 2024-09-21T12:40:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.044+0000 7f9bbed9d640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ba806e380 0x7f9ba8070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:12.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.045+0000 7f9bbed9d640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ba806e380 0x7f9ba8070840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:12.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.049+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9bb401e030 con 0x7f9bc0196f90 2024-09-21T12:40:12.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:11 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/884044237' entity='client.admin' 2024-09-21T12:40:12.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:11 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/726501649' entity='client.admin' 2024-09-21T12:40:12.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:11 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4220383741' entity='client.admin' 2024-09-21T12:40:12.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.226+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f9bc002dab0 con 0x7f9bc0196f90 2024-09-21T12:40:12.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.229+0000 7f9ba7fff640 1 -- 172.21.15.46:0/2205860604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v23)=0 v23) ==== 106+0+0 (secure 0 0 0) 0x7f9bb405b0d0 con 0x7f9bc0196f90 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ba806e380 msgr2=0x7f9ba8070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ba806e380 0x7f9ba8070840 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb00058d0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 msgr2=0x7f9bc019bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 0x7f9bc019bf90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9bb400b4a0 tx=0x7f9bb400b960 comp rx=0 tx=0).stop 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 shutdown_connections 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ba806e380 0x7f9ba8070840 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9bc0196f90 0x7f9bc019bf90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 --2- 172.21.15.46:0/2205860604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9bc0102170 0x7f9bc0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 >> 172.21.15.46:0/2205860604 conn(0x7f9bc00fbcd0 msgr2=0x7f9bc00fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 shutdown_connections 2024-09-21T12:40:12.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.231+0000 7f9bc5122640 1 -- 172.21.15.46:0/2205860604 wait complete. 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 -- 172.21.15.46:0/677935890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae34100540 msgr2=0x7fae34100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 --2- 172.21.15.46:0/677935890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae34100540 0x7fae34100940 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fae24009880 tx=0x7fae2402a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 -- 172.21.15.46:0/677935890 shutdown_connections 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 --2- 172.21.15.46:0/677935890 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae34100540 0x7fae34100940 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 -- 172.21.15.46:0/677935890 >> 172.21.15.46:0/677935890 conn(0x7fae340fbcd0 msgr2=0x7fae340fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 -- 172.21.15.46:0/677935890 shutdown_connections 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.497+0000 7fae39711640 1 -- 172.21.15.46:0/677935890 wait complete. 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae39711640 1 Processor -- start 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae39711640 1 -- start start 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae39711640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae34100540 0x7fae3406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:12.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae39711640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 0x7fae3419dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae39711640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae34106320 con 0x7fae3419bbe0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae39711640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae341061a0 con 0x7fae34100540 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae327fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 0x7fae3419dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae327fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 0x7fae3419dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43086/0 (socket says 172.21.15.46:43086) 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.498+0000 7fae327fc640 1 -- 172.21.15.46:0/3078984254 learned_addr learned my addr 172.21.15.46:0/3078984254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae32ffd640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae34100540 0x7fae3406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae327fc640 1 -- 172.21.15.46:0/3078984254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae34100540 msgr2=0x7fae3406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae327fc640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae34100540 0x7fae3406a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae327fc640 1 -- 172.21.15.46:0/3078984254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae3419e510 con 0x7fae3419bbe0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae327fc640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 0x7fae3419dfd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b4a0 tx=0x7fae2800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae28014070 con 0x7fae3419bbe0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7fae28010a90 con 0x7fae3419bbe0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae28017bc0 con 0x7fae3419bbe0 2024-09-21T12:40:12.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae3419e6e0 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.499+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae3419ec90 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.500+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae34106ac0 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.501+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fae28017070 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.501+0000 7fae1bfff640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fae1c06e330 0x7fae1c0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.501+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fae2800d040 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.501+0000 7fae32ffd640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fae1c06e330 0x7fae1c0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.502+0000 7fae32ffd640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fae1c06e330 0x7fae1c0707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae24000c00 tx=0x7fae24004e10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.506+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae2801e030 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.682+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7fae341009c0 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.685+0000 7fae1bfff640 1 -- 172.21.15.46:0/3078984254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v18)=0 v18) ==== 121+0+0 (secure 0 0 0) 0x7fae2805b220 con 0x7fae3419bbe0 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fae1c06e330 msgr2=0x7fae1c0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fae1c06e330 0x7fae1c0707f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fae24000c00 tx=0x7fae24004e10 comp rx=0 tx=0).stop 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 msgr2=0x7fae3419dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:12.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 0x7fae3419dfd0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b4a0 tx=0x7fae2800b960 comp rx=0 tx=0).stop 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 shutdown_connections 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fae1c06e330 0x7fae1c0707f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae3419bbe0 0x7fae3419dfd0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 --2- 172.21.15.46:0/3078984254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae34100540 0x7fae3406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 >> 172.21.15.46:0/3078984254 conn(0x7fae340fbcd0 msgr2=0x7fae340fc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 shutdown_connections 2024-09-21T12:40:12.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:09.688+0000 7fae39711640 1 -- 172.21.15.46:0/3078984254 wait complete. 2024-09-21T12:40:13.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:13 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2205860604' entity='client.admin' 2024-09-21T12:40:13.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:13 smithi046 ceph-mon[27868]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:13.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:13 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3850688846' entity='client.admin' 2024-09-21T12:40:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:13 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2205860604' entity='client.admin' 2024-09-21T12:40:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:13 smithi176 ceph-mon[35476]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:13 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3850688846' entity='client.admin' 2024-09-21T12:40:14.495 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 -- 172.21.15.46:0/1326379588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74000ffcc0 msgr2=0x7f74001000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 --2- 172.21.15.46:0/1326379588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74000ffcc0 0x7f74001000c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009c20 tx=0x7f73f002aa90 comp rx=0 tx=0).stop 2024-09-21T12:40:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 -- 172.21.15.46:0/1326379588 shutdown_connections 2024-09-21T12:40:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 --2- 172.21.15.46:0/1326379588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74000ffcc0 0x7f74001000c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:14.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 -- 172.21.15.46:0/1326379588 >> 172.21.15.46:0/1326379588 conn(0x7f74000fb450 msgr2=0x7f74000fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 -- 172.21.15.46:0/1326379588 shutdown_connections 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.723+0000 7f7405f18640 1 -- 172.21.15.46:0/1326379588 wait complete. 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f7405f18640 1 Processor -- start 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f7405f18640 1 -- start start 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f7405f18640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74000ffcc0 0x7f740018cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f7405f18640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 0x7f740018b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f7405f18640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7400105aa0 con 0x7f740018b320 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f7405f18640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7400105920 con 0x7f74000ffcc0 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f73feffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 0x7f740018b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f73feffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 0x7f740018b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43198/0 (socket says 172.21.15.46:43198) 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.724+0000 7f73feffd640 1 -- 172.21.15.46:0/3850688846 learned_addr learned my addr 172.21.15.46:0/3850688846 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:14.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73ff7fe640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74000ffcc0 0x7f740018cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73feffd640 1 -- 172.21.15.46:0/3850688846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74000ffcc0 msgr2=0x7f740018cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73feffd640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74000ffcc0 0x7f740018cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73feffd640 1 -- 172.21.15.46:0/3850688846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740018bce0 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73feffd640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 0x7f740018b7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f73f400b4a0 tx=0x7f73f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73f4014070 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f73f4010a90 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740018bfd0 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73f4017bd0 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.725+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740019ec60 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.726+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7400106240 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.727+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f73f4017070 con 0x7f740018b320 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.727+0000 7f73fcff9640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f73e806e380 0x7f73e8070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:14.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.727+0000 7f73ff7fe640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f73e806e380 0x7f73e8070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.728+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f73f400d040 con 0x7f740018b320 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.728+0000 7f73ff7fe640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f73e806e380 0x7f73e8070840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73f0000f80 tx=0x7f73f003b040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.732+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73f401e030 con 0x7f740018b320 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.908+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f7400190a90 con 0x7f740018b320 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.911+0000 7f73fcff9640 1 -- 172.21.15.46:0/3850688846 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v24)=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7f73f405b0e0 con 0x7f740018b320 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f73e806e380 msgr2=0x7f73e8070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f73e806e380 0x7f73e8070840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f73f0000f80 tx=0x7f73f003b040 comp rx=0 tx=0).stop 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 msgr2=0x7f740018b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 0x7f740018b7a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f73f400b4a0 tx=0x7f73f400b960 comp rx=0 tx=0).stop 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 shutdown_connections 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f73e806e380 0x7f73e8070840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f740018b320 0x7f740018b7a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:14.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 --2- 172.21.15.46:0/3850688846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74000ffcc0 0x7f740018cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 >> 172.21.15.46:0/3850688846 conn(0x7f74000fb450 msgr2=0x7f74000fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 shutdown_connections 2024-09-21T12:40:14.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:12.913+0000 7f7405f18640 1 -- 172.21.15.46:0/3850688846 wait complete. 2024-09-21T12:40:15.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:15 smithi046 ceph-mon[27868]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:15 smithi176 ceph-mon[35476]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:16.519 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:16 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3469783382' entity='client.admin' 2024-09-21T12:40:16.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:16 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3469783382' entity='client.admin' 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.604+0000 7f24797e1640 1 -- 172.21.15.46:0/548969679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 msgr2=0x7f2474104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.604+0000 7f24797e1640 1 --2- 172.21.15.46:0/548969679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474104490 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2464009880 tx=0x7f246402a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.604+0000 7f24797e1640 1 -- 172.21.15.46:0/548969679 shutdown_connections 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.604+0000 7f24797e1640 1 --2- 172.21.15.46:0/548969679 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474104490 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.604+0000 7f24797e1640 1 -- 172.21.15.46:0/548969679 >> 172.21.15.46:0/548969679 conn(0x7f24740fbc80 msgr2=0x7f24740fe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 -- 172.21.15.46:0/548969679 shutdown_connections 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 -- 172.21.15.46:0/548969679 wait complete. 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 Processor -- start 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 -- start start 2024-09-21T12:40:16.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474197030 0x7f247419c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.605+0000 7f24797e1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2474107520 con 0x7f24741020a0 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f24797e1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24741073a0 con 0x7f2474197030 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43240/0 (socket says 172.21.15.46:43240) 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 -- 172.21.15.46:0/1814911463 learned_addr learned my addr 172.21.15.46:0/1814911463 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 -- 172.21.15.46:0/1814911463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474197030 msgr2=0x7f247419c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f246bfff640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474197030 0x7f247419c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474197030 0x7f247419c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 -- 172.21.15.46:0/1814911463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2474197560 con 0x7f24741020a0 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f246bfff640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474197030 0x7f247419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2472ffd640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474196af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2464005940 tx=0x7f24640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:16.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f246403f070 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f2464003a90 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247419c570 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2464035030 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.606+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247419caf0 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.607+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2474102500 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.608+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f2464042070 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.609+0000 7f2470ff9640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f246006e380 0x7f2460070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.609+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f24640adb80 con 0x7f24741020a0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.609+0000 7f246bfff640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f246006e380 0x7f2460070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.610+0000 7f246bfff640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f246006e380 0x7f2460070840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2474197fa0 tx=0x7f245c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:16.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.613+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f246407c5b0 con 0x7f24741020a0 2024-09-21T12:40:16.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 -- 172.21.15.46:0/4102137413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc0ff8f0 msgr2=0x7f67bc0ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 --2- 172.21.15.46:0/4102137413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc0ff8f0 0x7f67bc0ffcf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67b0009880 tx=0x7f67b002a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 -- 172.21.15.46:0/4102137413 shutdown_connections 2024-09-21T12:40:16.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 --2- 172.21.15.46:0/4102137413 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc0ff8f0 0x7f67bc0ffcf0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 -- 172.21.15.46:0/4102137413 >> 172.21.15.46:0/4102137413 conn(0x7f67bc0fb400 msgr2=0x7f67bc0fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 -- 172.21.15.46:0/4102137413 shutdown_connections 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.093+0000 7f67c3022640 1 -- 172.21.15.46:0/4102137413 wait complete. 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67c3022640 1 Processor -- start 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67c3022640 1 -- start start 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67c3022640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67bc0ff8f0 0x7f67bc102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67c3022640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 0x7f67bc100da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67c3022640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc1073f0 con 0x7f67bc100920 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67c3022640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc107270 con 0x7f67bc0ff8f0 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 0x7f67bc100da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67bbfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 0x7f67bc100da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43218/0 (socket says 172.21.15.46:43218) 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.094+0000 7f67bbfff640 1 -- 172.21.15.46:0/3469783382 learned_addr learned my addr 172.21.15.46:0/3469783382 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:16.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67c0dbe640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67bc0ff8f0 0x7f67bc102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67bbfff640 1 -- 172.21.15.46:0/3469783382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67bc0ff8f0 msgr2=0x7f67bc102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67bbfff640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67bc0ff8f0 0x7f67bc102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67bbfff640 1 -- 172.21.15.46:0/3469783382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc1012e0 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67bbfff640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 0x7f67bc100da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f67a800b4a0 tx=0x7f67a800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67a8014070 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc1015d0 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(25 keys) ==== 1047+0+0 (secure 0 0 0) 0x7f67a8010a90 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67a8017bd0 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.095+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc19ecb0 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.096+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc107b90 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.097+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f67a8017070 con 0x7f67bc100920 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.097+0000 7f67b9ffb640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f67ac06e330 0x7f67ac0707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:16.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.097+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f67a800d040 con 0x7f67bc100920 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.097+0000 7f67c0dbe640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f67ac06e330 0x7f67ac0707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.098+0000 7f67c0dbe640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f67ac06e330 0x7f67ac0707f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67b0000c00 tx=0x7f67b0004e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.102+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f67a801e030 con 0x7f67bc100920 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.283+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f67bc062df0 con 0x7f67bc100920 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.286+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) ==== 123+0+0 (secure 0 0 0) 0x7f67a805b290 con 0x7f67bc100920 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.287+0000 7f67b9ffb640 1 -- 172.21.15.46:0/3469783382 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f67a805ef40 con 0x7f67bc100920 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f67ac06e330 msgr2=0x7f67ac0707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f67ac06e330 0x7f67ac0707f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f67b0000c00 tx=0x7f67b0004e30 comp rx=0 tx=0).stop 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 msgr2=0x7f67bc100da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 0x7f67bc100da0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f67a800b4a0 tx=0x7f67a800b960 comp rx=0 tx=0).stop 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 shutdown_connections 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f67ac06e330 0x7f67ac0707f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67bc100920 0x7f67bc100da0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 --2- 172.21.15.46:0/3469783382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67bc0ff8f0 0x7f67bc102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 >> 172.21.15.46:0/3469783382 conn(0x7f67bc0fb400 msgr2=0x7f67bc0fbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:16.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 shutdown_connections 2024-09-21T12:40:16.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:15.288+0000 7f67c3022640 1 -- 172.21.15.46:0/3469783382 wait complete. 2024-09-21T12:40:16.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.792+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f2474190300 con 0x7f24741020a0 2024-09-21T12:40:16.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.795+0000 7f2470ff9640 1 -- 172.21.15.46:0/1814911463 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v26)=0 v26) ==== 122+0+0 (secure 0 0 0) 0x7f2474190300 con 0x7f24741020a0 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.797+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f246006e380 msgr2=0x7f2460070840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.797+0000 7f24797e1640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f246006e380 0x7f2460070840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2474197fa0 tx=0x7f245c008040 comp rx=0 tx=0).stop 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.797+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 msgr2=0x7f2474196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.797+0000 7f24797e1640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474196af0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2464005940 tx=0x7f24640048f0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 shutdown_connections 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f246006e380 0x7f2460070840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2474197030 0x7f247419c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.799 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 --2- 172.21.15.46:0/1814911463 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24741020a0 0x7f2474196af0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:16.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 >> 172.21.15.46:0/1814911463 conn(0x7f24740fbc80 msgr2=0x7f24740fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:16.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 shutdown_connections 2024-09-21T12:40:16.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:16.798+0000 7f24797e1640 1 -- 172.21.15.46:0/1814911463 wait complete. 2024-09-21T12:40:16.909 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:17.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 -- 172.21.15.46:0/3060121738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1194101600 msgr2=0x7f1194101a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3060121738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1194101600 0x7f1194101a00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1184009880 tx=0x7f118402a5d0 comp rx=0 tx=0).stop 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 -- 172.21.15.46:0/3060121738 shutdown_connections 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3060121738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1194101600 0x7f1194101a00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 -- 172.21.15.46:0/3060121738 >> 172.21.15.46:0/3060121738 conn(0x7f11940fcdb0 msgr2=0x7f11940ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 -- 172.21.15.46:0/3060121738 shutdown_connections 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 -- 172.21.15.46:0/3060121738 wait complete. 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 Processor -- start 2024-09-21T12:40:17.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.239+0000 7f119a8a3640 1 -- start start 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f119a8a3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1194101600 0x7f1194075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f119a8a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 0x7f1194074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f119a8a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1194107590 con 0x7f11940745e0 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f119a8a3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1194107410 con 0x7f1194101600 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 0x7f1194074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 0x7f1194074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43258/0 (socket says 172.21.15.46:43258) 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 -- 172.21.15.46:0/3287151275 learned_addr learned my addr 172.21.15.46:0/3287151275 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f1193fff640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1194101600 0x7f1194075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 -- 172.21.15.46:0/3287151275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1194101600 msgr2=0x7f1194075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1194101600 0x7f1194075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 -- 172.21.15.46:0/3287151275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1194074fa0 con 0x7f11940745e0 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11937fe640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 0x7f1194074a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f118800b4a0 tx=0x7f118800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:17.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1188014070 con 0x7f11940745e0 2024-09-21T12:40:17.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.240+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f1188010ab0 con 0x7f11940745e0 2024-09-21T12:40:17.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.241+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1194075290 con 0x7f11940745e0 2024-09-21T12:40:17.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.241+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1188017c80 con 0x7f11940745e0 2024-09-21T12:40:17.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.241+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f119419ed90 con 0x7f11940745e0 2024-09-21T12:40:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.242+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1194101a80 con 0x7f11940745e0 2024-09-21T12:40:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.242+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f1188017070 con 0x7f11940745e0 2024-09-21T12:40:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.243+0000 7f11917fa640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f117c06e340 0x7f117c070800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.243+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f118800d040 con 0x7f11940745e0 2024-09-21T12:40:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.243+0000 7f1193fff640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f117c06e340 0x7f117c070800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:17.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.243+0000 7f1193fff640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f117c06e340 0x7f117c070800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1184004ee0 tx=0x7f1184005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:17.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.247+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f118801e030 con 0x7f11940745e0 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.vedsjs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:17 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1814911463' entity='client.admin' 2024-09-21T12:40:17.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.426+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f1194062e60 con 0x7f11940745e0 2024-09-21T12:40:17.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.429+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 123+0+0 (secure 0 0 0) 0x7f118805b1a0 con 0x7f11940745e0 2024-09-21T12:40:17.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.429+0000 7f11917fa640 1 -- 172.21.15.46:0/3287151275 <== mon.0 v2:172.21.15.46:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1188017460 con 0x7f11940745e0 2024-09-21T12:40:17.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f117c06e340 msgr2=0x7f117c070800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:17.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f117c06e340 0x7f117c070800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1184004ee0 tx=0x7f1184005d50 comp rx=0 tx=0).stop 2024-09-21T12:40:17.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 msgr2=0x7f1194074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 0x7f1194074a60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f118800b4a0 tx=0x7f118800b960 comp rx=0 tx=0).stop 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 shutdown_connections 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f117c06e340 0x7f117c070800 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11940745e0 0x7f1194074a60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 --2- 172.21.15.46:0/3287151275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1194101600 0x7f1194075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 >> 172.21.15.46:0/3287151275 conn(0x7f11940fcdb0 msgr2=0x7f11940fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 shutdown_connections 2024-09-21T12:40:17.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:17.431+0000 7f119a8a3640 1 -- 172.21.15.46:0/3287151275 wait complete. 2024-09-21T12:40:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.vedsjs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:40:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:40:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:17 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1814911463' entity='client.admin' 2024-09-21T12:40:18.239 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T12:40:18.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:18 smithi046 ceph-mon[27868]: Reconfiguring mgr.smithi046.vedsjs (unknown last config time)... 2024-09-21T12:40:18.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:18 smithi046 ceph-mon[27868]: Reconfiguring daemon mgr.smithi046.vedsjs on smithi046 2024-09-21T12:40:18.462 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:18 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3287151275' entity='client.admin' 2024-09-21T12:40:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:18 smithi176 ceph-mon[35476]: Reconfiguring mgr.smithi046.vedsjs (unknown last config time)... 2024-09-21T12:40:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:18 smithi176 ceph-mon[35476]: Reconfiguring daemon mgr.smithi046.vedsjs on smithi046 2024-09-21T12:40:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:18 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3287151275' entity='client.admin' 2024-09-21T12:40:19.015 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi046') 2024-09-21T12:40:19.015 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi046') 2024-09-21T12:40:19.015 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi046') 2024-09-21T12:40:19.015 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi046') 2024-09-21T12:40:19.015 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi046') 2024-09-21T12:40:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:19 smithi176 ceph-mon[35476]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:19.575 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:19 smithi046 ceph-mon[27868]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:19.713 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-21T12:40:19.713 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi046') 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 -- 172.21.15.46:0/474229321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 msgr2=0x7fa318100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 --2- 172.21.15.46:0/474229321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa318100010 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009880 tx=0x7fa30c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 -- 172.21.15.46:0/474229321 shutdown_connections 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 --2- 172.21.15.46:0/474229321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa318102bf0 0x7fa318103070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 --2- 172.21.15.46:0/474229321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa318100010 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 -- 172.21.15.46:0/474229321 >> 172.21.15.46:0/474229321 conn(0x7fa3180fb760 msgr2=0x7fa3180fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 -- 172.21.15.46:0/474229321 shutdown_connections 2024-09-21T12:40:20.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.141+0000 7fa31f861640 1 -- 172.21.15.46:0/474229321 wait complete. 2024-09-21T12:40:20.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31f861640 1 Processor -- start 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31f861640 1 -- start start 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31f861640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa3181024e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31f861640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa318102bf0 0x7fa318100ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31f861640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa31810a7a0 con 0x7fa3180ffc10 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31f861640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa31810a620 con 0x7fa318102bf0 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31d5fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa3181024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31d5fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa3181024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47920/0 (socket says 172.21.15.46:47920) 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31d5fd640 1 -- 172.21.15.46:0/714003136 learned_addr learned my addr 172.21.15.46:0/714003136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.142+0000 7fa31cdfc640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa318102bf0 0x7fa318100ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa31d5fd640 1 -- 172.21.15.46:0/714003136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa318102bf0 msgr2=0x7fa318100ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa31d5fd640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa318102bf0 0x7fa318100ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa31d5fd640 1 -- 172.21.15.46:0/714003136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3181010e0 con 0x7fa3180ffc10 2024-09-21T12:40:20.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa31d5fd640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa3181024e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa30c006010 tx=0x7fa30c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa30c03f070 con 0x7fa3180ffc10 2024-09-21T12:40:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa30c0049d0 con 0x7fa3180ffc10 2024-09-21T12:40:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa318101370 con 0x7fa3180ffc10 2024-09-21T12:40:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa30c035030 con 0x7fa3180ffc10 2024-09-21T12:40:20.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.143+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3181018a0 con 0x7fa3180ffc10 2024-09-21T12:40:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.144+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa318100010 con 0x7fa3180ffc10 2024-09-21T12:40:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.145+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fa30c042070 con 0x7fa3180ffc10 2024-09-21T12:40:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.145+0000 7fa30a7fc640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa30406e280 0x7fa304070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.145+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fa30c0ada20 con 0x7fa3180ffc10 2024-09-21T12:40:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.145+0000 7fa31cdfc640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa30406e280 0x7fa304070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:20.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.146+0000 7fa31cdfc640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa30406e280 0x7fa304070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa318102260 tx=0x7fa314005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:20.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.150+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa30c080190 con 0x7fa3180ffc10 2024-09-21T12:40:20.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.327+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fa31819f650 con 0x7fa3180ffc10 2024-09-21T12:40:20.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.330+0000 7fa30a7fc640 1 -- 172.21.15.46:0/714003136 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7fa30c0849c0 con 0x7fa3180ffc10 2024-09-21T12:40:20.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.332+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa30406e280 msgr2=0x7fa304070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:20.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.332+0000 7fa31f861640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa30406e280 0x7fa304070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa318102260 tx=0x7fa314005f90 comp rx=0 tx=0).stop 2024-09-21T12:40:20.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.332+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 msgr2=0x7fa3181024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:20.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.332+0000 7fa31f861640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa3181024e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa30c006010 tx=0x7fa30c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 shutdown_connections 2024-09-21T12:40:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa30406e280 0x7fa304070740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa318102bf0 0x7fa318100ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 --2- 172.21.15.46:0/714003136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3180ffc10 0x7fa3181024e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 >> 172.21.15.46:0/714003136 conn(0x7fa3180fb760 msgr2=0x7fa3180fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 shutdown_connections 2024-09-21T12:40:20.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:20.333+0000 7fa31f861640 1 -- 172.21.15.46:0/714003136 wait complete. 2024-09-21T12:40:21.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:21 smithi046 ceph-mon[27868]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:21.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:21 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/714003136' entity='client.admin' 2024-09-21T12:40:21.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:21 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:21.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:21 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:21.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:21 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:40:21.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:21 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:21.797 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:21 smithi176 ceph-mon[35476]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:21.797 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:21 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/714003136' entity='client.admin' 2024-09-21T12:40:21.798 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:21 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:21.798 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:21 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:21.798 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:21 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:40:21.798 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:21 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:22.214 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-21T12:40:22.214 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T12:40:22.214 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi046') 2024-09-21T12:40:22.214 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi046') 2024-09-21T12:40:22.214 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi046') 2024-09-21T12:40:22.215 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '297e1ece-7816-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi046') 2024-09-21T12:40:22.215 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T12:40:22.215 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:40:22.215 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T12:40:22.233 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T12:40:22.233 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_1 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 12:39:21.652165683 +0000 2024-09-21T12:40:22.290 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 12:34:16.364814038 +0000 2024-09-21T12:40:22.291 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 12:34:16.364814038 +0000 2024-09-21T12:40:22.291 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 12:34:16.364814038 +0000 2024-09-21T12:40:22.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T12:40:22.362 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T12:40:22.362 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T12:40:22.362 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 9.6389e-05 s, 5.3 MB/s 2024-09-21T12:40:22.364 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T12:40:22.421 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_2 2024-09-21T12:40:22.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:22 smithi046 ceph-mon[27868]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-09-21T12:40:22.449 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:22 smithi046 ceph-mon[27868]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 12:39:21.652165683 +0000 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 12:34:16.676810749 +0000 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 12:34:16.676810749 +0000 2024-09-21T12:40:22.465 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 12:34:16.676810749 +0000 2024-09-21T12:40:22.465 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T12:40:22.530 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T12:40:22.530 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T12:40:22.530 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000107994 s, 4.7 MB/s 2024-09-21T12:40:22.531 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T12:40:22.589 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_3 2024-09-21T12:40:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T12:40:22.645 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 12:39:21.653165673 +0000 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 12:34:17.007807261 +0000 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 12:34:17.007807261 +0000 2024-09-21T12:40:22.646 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 12:34:17.007807261 +0000 2024-09-21T12:40:22.646 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T12:40:22.715 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T12:40:22.715 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T12:40:22.715 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000103801 s, 4.9 MB/s 2024-09-21T12:40:22.717 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T12:40:22.734 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:22 smithi176 ceph-mon[35476]: Reconfiguring ceph-exporter.smithi046 (monmap changed)... 2024-09-21T12:40:22.734 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:22 smithi176 ceph-mon[35476]: Reconfiguring daemon ceph-exporter.smithi046 on smithi046 2024-09-21T12:40:22.774 DEBUG:teuthology.orchestra.run.smithi046:> stat /dev/vg_nvme/lv_4 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 2024-09-21 12:39:21.653165673 +0000 2024-09-21T12:40:22.830 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 12:34:17.331803846 +0000 2024-09-21T12:40:22.831 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 12:34:17.331803846 +0000 2024-09-21T12:40:22.831 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: 2024-09-21 12:34:17.331803846 +0000 2024-09-21T12:40:22.831 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T12:40:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records in 2024-09-21T12:40:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:1+0 records out 2024-09-21T12:40:22.894 INFO:teuthology.orchestra.run.smithi046.stderr:512 bytes copied, 0.000112993 s, 4.5 MB/s 2024-09-21T12:40:22.896 DEBUG:teuthology.orchestra.run.smithi046:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T12:40:22.953 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:40:22.954 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T12:40:22.974 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T12:40:22.974 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2024-09-21T12:40:23.032 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-21 12:39:51.043083844 +0000 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-21 12:34:13.207955868 +0000 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-21 12:34:13.207955868 +0000 2024-09-21T12:40:23.033 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-21 12:34:13.207955868 +0000 2024-09-21T12:40:23.033 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T12:40:23.101 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-21T12:40:23.102 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-21T12:40:23.102 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000208486 s, 2.5 MB/s 2024-09-21T12:40:23.103 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T12:40:23.162 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-21 12:39:51.043083844 +0000 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-21 12:34:13.534952485 +0000 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-21 12:34:13.534952485 +0000 2024-09-21T12:40:23.219 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-21 12:34:13.534952485 +0000 2024-09-21T12:40:23.220 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T12:40:23.284 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-21T12:40:23.284 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-21T12:40:23.284 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000229288 s, 2.2 MB/s 2024-09-21T12:40:23.285 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T12:40:23.343 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-21 12:39:51.044083834 +0000 2024-09-21T12:40:23.400 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-21 12:34:13.855949165 +0000 2024-09-21T12:40:23.401 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-21 12:34:13.855949165 +0000 2024-09-21T12:40:23.401 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-21 12:34:13.855949165 +0000 2024-09-21T12:40:23.401 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T12:40:23.462 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:23 smithi176 ceph-mon[35476]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:23.462 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:23.462 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:23.462 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:40:23.462 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:23.464 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-21T12:40:23.464 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-21T12:40:23.464 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000200313 s, 2.6 MB/s 2024-09-21T12:40:23.465 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T12:40:23.523 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2024-09-21 12:39:51.044083834 +0000 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-21 12:34:14.174945865 +0000 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-21 12:34:14.174945865 +0000 2024-09-21T12:40:23.579 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: 2024-09-21 12:34:14.174945865 +0000 2024-09-21T12:40:23.580 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T12:40:23.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:23 smithi046 ceph-mon[27868]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:23.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:23.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:23.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:40:23.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:23.643 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2024-09-21T12:40:23.643 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2024-09-21T12:40:23.643 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000226054 s, 2.3 MB/s 2024-09-21T12:40:23.644 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T12:40:23.701 INFO:tasks.cephadm:Deploying osd.0 on smithi046 with /dev/vg_nvme/lv_4... 2024-09-21T12:40:23.701 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T12:40:24.095 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:24.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:24 smithi046 ceph-mon[27868]: Reconfiguring crash.smithi046 (monmap changed)... 2024-09-21T12:40:24.479 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:24 smithi046 ceph-mon[27868]: Reconfiguring daemon crash.smithi046 on smithi046 2024-09-21T12:40:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:24 smithi176 ceph-mon[35476]: Reconfiguring crash.smithi046 (monmap changed)... 2024-09-21T12:40:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:24 smithi176 ceph-mon[35476]: Reconfiguring daemon crash.smithi046 on smithi046 2024-09-21T12:40:25.599 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:25 smithi046 ceph-mon[27868]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:25.600 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:25.600 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:25 smithi176 ceph-mon[35476]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:26.389 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:26 smithi046 ceph-mon[27868]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-09-21T12:40:26.389 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:26 smithi046 ceph-mon[27868]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-09-21T12:40:26.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:26 smithi176 ceph-mon[35476]: Reconfiguring alertmanager.smithi046 (dependencies changed)... 2024-09-21T12:40:26.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:26 smithi176 ceph-mon[35476]: Reconfiguring daemon alertmanager.smithi046 on smithi046 2024-09-21T12:40:27.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:27 smithi046 ceph-mon[27868]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:27.735 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:27 smithi176 ceph-mon[35476]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:28.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:28 smithi046 ceph-mon[27868]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:28 smithi176 ceph-mon[35476]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:29.612 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:29 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:29 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:31 smithi046 ceph-mon[27868]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-09-21T12:40:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:31 smithi046 ceph-mon[27868]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-09-21T12:40:31.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:31 smithi046 ceph-mon[27868]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:31 smithi176 ceph-mon[35476]: Reconfiguring grafana.smithi046 (dependencies changed)... 2024-09-21T12:40:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:31 smithi176 ceph-mon[35476]: Reconfiguring daemon grafana.smithi046 on smithi046 2024-09-21T12:40:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:31 smithi176 ceph-mon[35476]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:31.399 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:40:31.426 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_4 2024-09-21T12:40:32.129 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:40:32.617 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:32 smithi046 ceph-mon[27868]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:32.735 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:32 smithi176 ceph-mon[35476]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 -- 172.21.15.46:0/1951498124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 msgr2=0x7f7988107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1951498124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988107110 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f797c0098b0 tx=0x7f797c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 -- 172.21.15.46:0/1951498124 shutdown_connections 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1951498124 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988107110 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1951498124 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 0x7f79881047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 -- 172.21.15.46:0/1951498124 >> 172.21.15.46:0/1951498124 conn(0x7f79880fc010 msgr2=0x7f79880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 -- 172.21.15.46:0/1951498124 shutdown_connections 2024-09-21T12:40:33.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.595+0000 7f798dcc9640 1 -- 172.21.15.46:0/1951498124 wait complete. 2024-09-21T12:40:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f798dcc9640 1 Processor -- start 2024-09-21T12:40:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f798dcc9640 1 -- start start 2024-09-21T12:40:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f798dcc9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 0x7f7988197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f798dcc9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f798dcc9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f798810a790 con 0x7f7988104d20 2024-09-21T12:40:33.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f798dcc9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f798810a610 con 0x7f79881023f0 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f7986ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f7986ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42082/0 (socket says 172.21.15.46:42082) 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.596+0000 7f7986ffd640 1 -- 172.21.15.46:0/1033384041 learned_addr learned my addr 172.21.15.46:0/1033384041 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f79877fe640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 0x7f7988197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7986ffd640 1 -- 172.21.15.46:0/1033384041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 msgr2=0x7f7988197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7986ffd640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 0x7f7988197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7986ffd640 1 -- 172.21.15.46:0/1033384041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7988198040 con 0x7f7988104d20 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f79877fe640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 0x7f7988197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7986ffd640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988197a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f797c009230 tx=0x7f797c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f797c03f070 con 0x7f7988104d20 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f797c0044d0 con 0x7f7988104d20 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798819ca50 con 0x7f7988104d20 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f797c035030 con 0x7f7988104d20 2024-09-21T12:40:33.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.597+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798819cf50 con 0x7f7988104d20 2024-09-21T12:40:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.598+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79881027d0 con 0x7f7988104d20 2024-09-21T12:40:33.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.599+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f797c042070 con 0x7f7988104d20 2024-09-21T12:40:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.599+0000 7f7984ff9640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f797006e2d0 0x7f7970070790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:40:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.600+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f797c0adca0 con 0x7f7988104d20 2024-09-21T12:40:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.600+0000 7f79877fe640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f797006e2d0 0x7f7970070790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:40:33.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.600+0000 7f79877fe640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f797006e2d0 0x7f7970070790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f797800abe0 tx=0x7f797800a5c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:40:33.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.604+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f797c07c6c0 con 0x7f7988104d20 2024-09-21T12:40:33.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:40:33.796+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7988105720 con 0x7f797006e2d0 2024-09-21T12:40:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:40:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:40:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:34.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:40:34.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:40:34.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:34 smithi046 ceph-mon[27868]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:40:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:34 smithi046 ceph-mon[27868]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:34 smithi176 ceph-mon[35476]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:40:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:34 smithi176 ceph-mon[35476]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:36.607 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:36 smithi046 ceph-mon[27868]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:36.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:36 smithi176 ceph-mon[35476]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:37 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:37 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:37 smithi046 ceph-mon[27868]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-21T12:40:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:37 smithi046 ceph-mon[27868]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-21T12:40:38.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:37 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:37 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:37 smithi176 ceph-mon[35476]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-21T12:40:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:37 smithi176 ceph-mon[35476]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-21T12:40:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:38 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3059057410' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e260bc-7dd4-4165-91b7-79c05b1bca54"}]: dispatch 2024-09-21T12:40:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:38 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3059057410' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72e260bc-7dd4-4165-91b7-79c05b1bca54"}]': finished 2024-09-21T12:40:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:38 smithi046 ceph-mon[27868]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T12:40:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:40:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:38 smithi046 ceph-mon[27868]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:38 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/160513498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:40:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:38 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3059057410' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72e260bc-7dd4-4165-91b7-79c05b1bca54"}]: dispatch 2024-09-21T12:40:39.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:38 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3059057410' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72e260bc-7dd4-4165-91b7-79c05b1bca54"}]': finished 2024-09-21T12:40:39.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:38 smithi176 ceph-mon[35476]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T12:40:39.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:40:39.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:38 smithi176 ceph-mon[35476]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:39.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:38 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/160513498' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:40:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:40 smithi046 ceph-mon[27868]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:40.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:40 smithi176 ceph-mon[35476]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:42.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:42 smithi046 ceph-mon[27868]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:42.735 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:42 smithi176 ceph-mon[35476]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:43.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:43 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:43 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:44.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:44 smithi046 ceph-mon[27868]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:44 smithi176 ceph-mon[35476]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:46.636 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:46 smithi046 ceph-mon[27868]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:46.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:46 smithi176 ceph-mon[35476]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:48.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:48 smithi046 ceph-mon[27868]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:48 smithi176 ceph-mon[35476]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:50.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:50 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:50.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:50 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:50.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:50 smithi046 ceph-mon[27868]: Reconfiguring ceph-exporter.smithi176 (monmap changed)... 2024-09-21T12:40:50.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:50 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:40:50.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:50 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:50.204 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:50 smithi046 ceph-mon[27868]: Reconfiguring daemon ceph-exporter.smithi176 on smithi176 2024-09-21T12:40:50.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:50 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:50.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:50 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:50.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:50 smithi176 ceph-mon[35476]: Reconfiguring ceph-exporter.smithi176 (monmap changed)... 2024-09-21T12:40:50.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:50 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:40:50.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:50 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:50.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:50 smithi176 ceph-mon[35476]: Reconfiguring daemon ceph-exporter.smithi176 on smithi176 2024-09-21T12:40:51.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T12:40:51.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:51.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: Deploying daemon osd.0 on smithi046 2024-09-21T12:40:51.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:51.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:51.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:51.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:40:51.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:51 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:51.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T12:40:51.283 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:51.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: Deploying daemon osd.0 on smithi046 2024-09-21T12:40:51.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:51.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:51.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:51.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:40:51.284 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:51 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:52.131 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: Reconfiguring crash.smithi176 (monmap changed)... 2024-09-21T12:40:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: Reconfiguring daemon crash.smithi176 on smithi176 2024-09-21T12:40:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:40:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:40:52.132 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:52.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: Reconfiguring crash.smithi176 (monmap changed)... 2024-09-21T12:40:52.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: Reconfiguring daemon crash.smithi176 on smithi176 2024-09-21T12:40:52.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:52.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:52.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:40:52.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:40:52.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: Reconfiguring mgr.smithi176.rmyfjh (monmap changed)... 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: Reconfiguring daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:40:53.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:53.318 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: Reconfiguring mgr.smithi176.rmyfjh (monmap changed)... 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: Reconfiguring daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:40:53.319 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:40:54.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:54 smithi046 ceph-mon[27868]: Reconfiguring mon.smithi176 (monmap changed)... 2024-09-21T12:40:54.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:54 smithi046 ceph-mon[27868]: Reconfiguring daemon mon.smithi176 on smithi176 2024-09-21T12:40:54.265 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:54 smithi176 ceph-mon[35476]: Reconfiguring mon.smithi176 (monmap changed)... 2024-09-21T12:40:54.265 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:54 smithi176 ceph-mon[35476]: Reconfiguring daemon mon.smithi176 on smithi176 2024-09-21T12:40:55.543 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:40:55.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.545 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:55 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi046.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:40:55.653 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:40:55.654 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi046.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:40:55.654 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.654 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:40:55.654 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:40:55.654 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:55.654 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:55 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:40:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:56 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:40:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:56 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:40:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:56 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:56 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:56.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:56 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:40:56.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:56 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi046.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:40:56.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:56 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:56.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:56 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:57 smithi046 ceph-mon[27868]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:57.737 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:57 smithi176 ceph-mon[35476]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:57.737 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:57.737 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:40:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:59 smithi046 ceph-mon[27868]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:40:59 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:40:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:59 smithi176 ceph-mon[35476]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:40:59.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:40:59 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:01 smithi046 ceph-mon[27868]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:01 smithi176 ceph-mon[35476]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:01.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:01.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:02.633 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:02 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:02 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:03.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.121+0000 7f7984ff9640 1 -- 172.21.15.46:0/1033384041 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7988105720 con 0x7f797006e2d0 2024-09-21T12:41:03.123 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 0 on host 'smithi046' 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f797006e2d0 msgr2=0x7f7970070790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f797006e2d0 0x7f7970070790 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f797800abe0 tx=0x7f797800a5c0 comp rx=0 tx=0).stop 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 msgr2=0x7f7988197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988197a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f797c009230 tx=0x7f797c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 shutdown_connections 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f797006e2d0 0x7f7970070790 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7988104d20 0x7f7988197a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 --2- 172.21.15.46:0/1033384041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881023f0 0x7f7988197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 >> 172.21.15.46:0/1033384041 conn(0x7f79880fc010 msgr2=0x7f79880fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:41:03.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 shutdown_connections 2024-09-21T12:41:03.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:03.123+0000 7f798dcc9640 1 -- 172.21.15.46:0/1033384041 wait complete. 2024-09-21T12:41:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:03 smithi046 ceph-mon[27868]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:03 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:03 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:03 smithi046 ceph-mon[27868]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T12:41:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:03 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:03 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.711 DEBUG:teuthology.orchestra.run.smithi046:osd.0> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T12:41:03.714 INFO:tasks.cephadm:Deploying osd.1 on smithi046 with /dev/vg_nvme/lv_3... 2024-09-21T12:41:03.714 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T12:41:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:03 smithi176 ceph-mon[35476]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:03.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:03 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:03 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:03 smithi176 ceph-mon[35476]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T12:41:03.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:03 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:03.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:03 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:04.559 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:41:05.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-mon[27868]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:41:05.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-mon[27868]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T12:41:05.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-mon[27868]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-21T12:41:05.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:05.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-mon[27868]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:05.413 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[48077]: 2024-09-21T12:41:05.128+0000 7f20d337f640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T12:41:05.413 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:41:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[48077]: 2024-09-21T12:41:05.131+0000 7f20cf9b9640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:41:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:05 smithi176 ceph-mon[35476]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:41:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:05 smithi176 ceph-mon[35476]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T12:41:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:05 smithi176 ceph-mon[35476]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-21T12:41:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:05 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:05 smithi176 ceph-mon[35476]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:06.391 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:06 smithi046 ceph-mon[27868]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T12:41:06.391 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:06 smithi046 ceph-mon[27868]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T12:41:06.391 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:06 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:06.391 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:06 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:06.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:06 smithi176 ceph-mon[35476]: from='osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T12:41:06.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:06 smithi176 ceph-mon[35476]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T12:41:06.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:06 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:06.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:06 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:07 smithi046 ceph-mon[27868]: purged_snaps scrub starts 2024-09-21T12:41:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:07 smithi046 ceph-mon[27868]: purged_snaps scrub ok 2024-09-21T12:41:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:07 smithi046 ceph-mon[27868]: osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] boot 2024-09-21T12:41:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:07 smithi046 ceph-mon[27868]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T12:41:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:07 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:07 smithi046 ceph-mon[27868]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:07 smithi176 ceph-mon[35476]: purged_snaps scrub starts 2024-09-21T12:41:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:07 smithi176 ceph-mon[35476]: purged_snaps scrub ok 2024-09-21T12:41:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:07 smithi176 ceph-mon[35476]: osd.0 [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] boot 2024-09-21T12:41:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:07 smithi176 ceph-mon[35476]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T12:41:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:07 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:41:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:07 smithi176 ceph-mon[35476]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:41:08.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:08 smithi046 ceph-mon[27868]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T12:41:08.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:08 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:08.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:08 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:08.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:08 smithi176 ceph-mon[35476]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T12:41:08.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:08 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:08.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:08 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:08.837 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:41:08.871 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_3 2024-09-21T12:41:09.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:09 smithi046 ceph-mon[27868]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:09 smithi176 ceph-mon[35476]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:09.598 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:41:10.568 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:10 smithi046 ceph-mon[27868]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:10.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.652+0000 7fe80eb49640 1 -- 172.21.15.46:0/529446931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808102b70 msgr2=0x7fe808102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.652+0000 7fe80eb49640 1 --2- 172.21.15.46:0/529446931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808102b70 0x7fe808102ff0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097e0 tx=0x7fe7f802a3f0 comp rx=0 tx=0).stop 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- 172.21.15.46:0/529446931 shutdown_connections 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 --2- 172.21.15.46:0/529446931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808102b70 0x7fe808102ff0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 --2- 172.21.15.46:0/529446931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808101970 0x7fe808101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- 172.21.15.46:0/529446931 >> 172.21.15.46:0/529446931 conn(0x7fe8080fd140 msgr2=0x7fe8080ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- 172.21.15.46:0/529446931 shutdown_connections 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- 172.21.15.46:0/529446931 wait complete. 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 Processor -- start 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- start start 2024-09-21T12:41:10.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 0x7fe808075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808102b70 0x7fe8080745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe80810a7b0 con 0x7fe808101970 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.653+0000 7fe80eb49640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe80810a630 con 0x7fe808102b70 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 0x7fe808075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 0x7fe808075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44218/0 (socket says 172.21.15.46:44218) 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 -- 172.21.15.46:0/3692999500 learned_addr learned my addr 172.21.15.46:0/3692999500 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe7fffff640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808102b70 0x7fe8080745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 -- 172.21.15.46:0/3692999500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808102b70 msgr2=0x7fe8080745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808102b70 0x7fe8080745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 -- 172.21.15.46:0/3692999500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe808074b20 con 0x7fe808101970 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80c8e5640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 0x7fe808075f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e970 tx=0x7fe80400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe80400cac0 con 0x7fe808101970 2024-09-21T12:41:10.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe80400cc60 con 0x7fe808101970 2024-09-21T12:41:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe808074e10 con 0x7fe808101970 2024-09-21T12:41:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe804003d40 con 0x7fe808101970 2024-09-21T12:41:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.654+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8080753a0 con 0x7fe808101970 2024-09-21T12:41:10.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.656+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe808101d70 con 0x7fe808101970 2024-09-21T12:41:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.656+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7fe804004000 con 0x7fe808101970 2024-09-21T12:41:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.656+0000 7fe7fdffb640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe7f006e230 0x7fe7f00706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:41:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.657+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fe80408d960 con 0x7fe808101970 2024-09-21T12:41:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.657+0000 7fe7fffff640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe7f006e230 0x7fe7f00706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:41:10.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.657+0000 7fe7fffff640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe7f006e230 0x7fe7f00706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80308f0 tx=0x7fe7f8005ab0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:41:10.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.661+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe80405c140 con 0x7fe808101970 2024-09-21T12:41:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:10 smithi176 ceph-mon[35476]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:10.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:10.848+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fe808062630 con 0x7fe7f006e230 2024-09-21T12:41:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:11 smithi046 ceph-mon[27868]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:41:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:11 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:41:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:11 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:41:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:11 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:11 smithi176 ceph-mon[35476]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:41:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:11 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:41:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:11 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:41:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:11 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:12.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:12 smithi046 ceph-mon[27868]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:12.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:12 smithi176 ceph-mon[35476]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: Detected new or changed devices on smithi046 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi046 to 11844M 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:14.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:14.387 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: Detected new or changed devices on smithi046 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi046 to 11844M 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:14.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1188598005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92ad225-134c-4b1a-9b18-906a96fab115"}]: dispatch 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1188598005' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92ad225-134c-4b1a-9b18-906a96fab115"}]': finished 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1271794703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:15.015 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1188598005' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d92ad225-134c-4b1a-9b18-906a96fab115"}]: dispatch 2024-09-21T12:41:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1188598005' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d92ad225-134c-4b1a-9b18-906a96fab115"}]': finished 2024-09-21T12:41:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T12:41:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1271794703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:41:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:16.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:16 smithi046 ceph-mon[27868]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:16 smithi176 ceph-mon[35476]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:18.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:18 smithi176 ceph-mon[35476]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:18 smithi046 ceph-mon[27868]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:20.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:20 smithi046 ceph-mon[27868]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:20 smithi176 ceph-mon[35476]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:22.632 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:22 smithi046 ceph-mon[27868]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:22.739 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:22 smithi176 ceph-mon[35476]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:23.520 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T12:41:23.520 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:23.520 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:23 smithi046 ceph-mon[27868]: Deploying daemon osd.1 on smithi046 2024-09-21T12:41:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T12:41:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:23.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:23 smithi176 ceph-mon[35476]: Deploying daemon osd.1 on smithi046 2024-09-21T12:41:24.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:24 smithi046 ceph-mon[27868]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:24 smithi176 ceph-mon[35476]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:26.520 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:26 smithi046 ceph-mon[27868]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:26.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:26 smithi176 ceph-mon[35476]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:28.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:28 smithi046 ceph-mon[27868]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:28.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:28.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:28 smithi176 ceph-mon[35476]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:28.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:29 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:29 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:29 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:29.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:29 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:29.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:29 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:29.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:29 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:30 smithi046 ceph-mon[27868]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:30 smithi176 ceph-mon[35476]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:32.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:32.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:32 smithi176 ceph-mon[35476]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:33.181 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:32 smithi046 ceph-mon[27868]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:33.222 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 1 on host 'smithi046' 2024-09-21T12:41:33.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.220+0000 7fe7fdffb640 1 -- 172.21.15.46:0/3692999500 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe808062630 con 0x7fe7f006e230 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.222+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe7f006e230 msgr2=0x7fe7f00706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.222+0000 7fe80eb49640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe7f006e230 0x7fe7f00706f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80308f0 tx=0x7fe7f8005ab0 comp rx=0 tx=0).stop 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.222+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 msgr2=0x7fe808075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.222+0000 7fe80eb49640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 0x7fe808075f20 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fe80400e970 tx=0x7fe80400ee30 comp rx=0 tx=0).stop 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 shutdown_connections 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe7f006e230 0x7fe7f00706f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe808102b70 0x7fe8080745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:33.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 --2- 172.21.15.46:0/3692999500 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe808101970 0x7fe808075f20 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 >> 172.21.15.46:0/3692999500 conn(0x7fe8080fd140 msgr2=0x7fe808106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:41:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 shutdown_connections 2024-09-21T12:41:33.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:33.223+0000 7fe80eb49640 1 -- 172.21.15.46:0/3692999500 wait complete. 2024-09-21T12:41:33.849 DEBUG:teuthology.orchestra.run.smithi046:osd.1> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T12:41:33.851 INFO:tasks.cephadm:Deploying osd.2 on smithi046 with /dev/vg_nvme/lv_2... 2024-09-21T12:41:33.851 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T12:41:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:34 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:34.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:34 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:34.570 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:41:35.327 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:35 smithi046 ceph-mon[27868]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:35 smithi176 ceph-mon[35476]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:35.662 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:41:35 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[55764]: 2024-09-21T12:41:35.460+0000 7f73f758d640 -1 osd.1 0 log_to_monitors true 2024-09-21T12:41:36.553 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:36 smithi046 ceph-mon[27868]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T12:41:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:36 smithi176 ceph-mon[35476]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T12:41:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-mon[27868]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:41:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-mon[27868]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T12:41:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-mon[27868]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-21T12:41:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-mon[27868]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:37.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[55764]: 2024-09-21T12:41:37.232+0000 7f73f2ced640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T12:41:37.413 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:41:37 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[55764]: 2024-09-21T12:41:37.236+0000 7f73ef327640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:41:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:37 smithi176 ceph-mon[35476]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:41:37.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:37 smithi176 ceph-mon[35476]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T12:41:37.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:37 smithi176 ceph-mon[35476]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-21T12:41:37.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:37 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:37.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:37 smithi176 ceph-mon[35476]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:38.097 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:41:38.122 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi046:vg_nvme/lv_2 2024-09-21T12:41:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:38 smithi046 ceph-mon[27868]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T12:41:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:38 smithi046 ceph-mon[27868]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T12:41:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:38 smithi176 ceph-mon[35476]: from='osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T12:41:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:38 smithi176 ceph-mon[35476]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T12:41:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:39 smithi046 ceph-mon[27868]: purged_snaps scrub starts 2024-09-21T12:41:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:39 smithi046 ceph-mon[27868]: purged_snaps scrub ok 2024-09-21T12:41:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:39 smithi046 ceph-mon[27868]: osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] boot 2024-09-21T12:41:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:39 smithi046 ceph-mon[27868]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T12:41:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:39 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:39.334 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:39 smithi046 ceph-mon[27868]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:39.383 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:41:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:39 smithi176 ceph-mon[35476]: purged_snaps scrub starts 2024-09-21T12:41:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:39 smithi176 ceph-mon[35476]: purged_snaps scrub ok 2024-09-21T12:41:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:39 smithi176 ceph-mon[35476]: osd.1 [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] boot 2024-09-21T12:41:39.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:39 smithi176 ceph-mon[35476]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T12:41:39.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:39 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:41:39.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:39 smithi176 ceph-mon[35476]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 -- 172.21.15.46:0/1188845151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 msgr2=0x7f55781047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 --2- 172.21.15.46:0/1188845151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f55781047e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f55740098b0 tx=0x7f557402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 -- 172.21.15.46:0/1188845151 shutdown_connections 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 --2- 172.21.15.46:0/1188845151 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 0x7f5578107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 --2- 172.21.15.46:0/1188845151 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f55781047e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 -- 172.21.15.46:0/1188845151 >> 172.21.15.46:0/1188845151 conn(0x7f55780fc010 msgr2=0x7f55780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 -- 172.21.15.46:0/1188845151 shutdown_connections 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.229+0000 7f557f811640 1 -- 172.21.15.46:0/1188845151 wait complete. 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557f811640 1 Processor -- start 2024-09-21T12:41:40.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557f811640 1 -- start start 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557f811640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f5578101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557f811640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 0x7f55781003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557f811640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f557810a7c0 con 0x7f55781023f0 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557f811640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f557810a640 con 0x7f5578104d20 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557d5ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f5578101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557d5ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f5578101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54398/0 (socket says 172.21.15.46:54398) 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.230+0000 7f557d5ad640 1 -- 172.21.15.46:0/1729378698 learned_addr learned my addr 172.21.15.46:0/1729378698 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557cdac640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 0x7f55781003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557d5ad640 1 -- 172.21.15.46:0/1729378698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 msgr2=0x7f55781003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557d5ad640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 0x7f55781003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557d5ad640 1 -- 172.21.15.46:0/1729378698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55781008e0 con 0x7f55781023f0 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557cdac640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 0x7f55781003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:41:40.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557d5ad640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f5578101ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55740099d0 tx=0x7f55740048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f557403f070 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5578100b70 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5574004c70 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55781010a0 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.231+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5574035030 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.232+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55781027d0 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.233+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f5574042070 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.233+0000 7f556e7fc640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f556406e230 0x7f55640706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.233+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7f55740ae1d0 con 0x7f55781023f0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.233+0000 7f557cdac640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f556406e230 0x7f55640706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.234+0000 7f557cdac640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f556406e230 0x7f55640706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5578101a60 tx=0x7f556800a5c0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:41:40.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.238+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f557407c760 con 0x7f55781023f0 2024-09-21T12:41:40.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:41:40.424+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f5578105700 con 0x7f556406e230 2024-09-21T12:41:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:40 smithi176 ceph-mon[35476]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T12:41:40.638 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:40 smithi046 ceph-mon[27868]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T12:41:41.535 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:41 smithi176 ceph-mon[35476]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:41.535 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:41 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:41:41.535 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:41 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:41:41.535 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:41 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:41.572 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:41 smithi046 ceph-mon[27868]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:41.572 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:41:41.572 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:41:41.572 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:41 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: Detected new or changed devices on smithi046 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi046 to 5922M 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:42.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:42.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:42 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:42.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi046:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: Detected new or changed devices on smithi046 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi046 to 5922M 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:42.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:42 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:43.295 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:43 smithi046 ceph-mon[27868]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:43 smithi176 ceph-mon[35476]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:44.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:44 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:44.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:44 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4083049415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99af3cc6-64df-4851-916e-2a097d183686"}]: dispatch 2024-09-21T12:41:44.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:44 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4083049415' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99af3cc6-64df-4851-916e-2a097d183686"}]': finished 2024-09-21T12:41:44.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:44 smithi046 ceph-mon[27868]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T12:41:44.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:44 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:41:44.322 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:44 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/10259189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:41:44.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:44 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:44 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4083049415' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99af3cc6-64df-4851-916e-2a097d183686"}]: dispatch 2024-09-21T12:41:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:44 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4083049415' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99af3cc6-64df-4851-916e-2a097d183686"}]': finished 2024-09-21T12:41:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:44 smithi176 ceph-mon[35476]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T12:41:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:44 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:41:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:44 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/10259189' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:41:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:45 smithi176 ceph-mon[35476]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:45.619 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:45 smithi046 ceph-mon[27868]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:46.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:46 smithi046 ceph-mon[27868]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:46.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:46 smithi176 ceph-mon[35476]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:48.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:47 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:48.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:47 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:48.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:47 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:48.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:47 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:48.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:47 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:48.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:47 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:48.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:47 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:48.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:47 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:48.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:47 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:41:48.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:47 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:49.036 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:48 smithi046 ceph-mon[27868]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:49.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:48 smithi176 ceph-mon[35476]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:50.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:50 smithi046 ceph-mon[27868]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:50.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:50 smithi176 ceph-mon[35476]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:52.271 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T12:41:52.271 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:52 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:52.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T12:41:52.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:52 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:41:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:53 smithi176 ceph-mon[35476]: Deploying daemon osd.2 on smithi046 2024-09-21T12:41:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:53 smithi176 ceph-mon[35476]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:53.401 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:53 smithi046 ceph-mon[27868]: Deploying daemon osd.2 on smithi046 2024-09-21T12:41:53.401 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:53 smithi046 ceph-mon[27868]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:54.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:54 smithi046 ceph-mon[27868]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:54.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:54 smithi176 ceph-mon[35476]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:56.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:56 smithi046 ceph-mon[27868]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:56.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:56 smithi176 ceph-mon[35476]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:58.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:58.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:58.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:58.621 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:41:58.622 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:58.622 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:41:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:59 smithi176 ceph-mon[35476]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:59.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:41:59 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:41:59.599 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:59 smithi046 ceph-mon[27868]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:41:59.599 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:41:59 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:00.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:00 smithi046 ceph-mon[27868]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:00 smithi176 ceph-mon[35476]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:01.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.329+0000 7f556e7fc640 1 -- 172.21.15.46:0/1729378698 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5578105700 con 0x7f556406e230 2024-09-21T12:42:01.331 INFO:teuthology.orchestra.run.smithi046.stdout:Created osd(s) 2 on host 'smithi046' 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f556406e230 msgr2=0x7f55640706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f556406e230 0x7f55640706f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f5578101a60 tx=0x7f556800a5c0 comp rx=0 tx=0).stop 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 msgr2=0x7f5578101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f5578101ce0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f55740099d0 tx=0x7f55740048f0 comp rx=0 tx=0).stop 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 shutdown_connections 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f556406e230 0x7f55640706f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5578104d20 0x7f55781003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 --2- 172.21.15.46:0/1729378698 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f55781023f0 0x7f5578101ce0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 >> 172.21.15.46:0/1729378698 conn(0x7f55780fc010 msgr2=0x7f55780fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 shutdown_connections 2024-09-21T12:42:01.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:42:01.331+0000 7f557f811640 1 -- 172.21.15.46:0/1729378698 wait complete. 2024-09-21T12:42:01.951 DEBUG:teuthology.orchestra.run.smithi046:osd.2> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T12:42:01.953 INFO:tasks.cephadm:Deploying osd.3 on smithi176 with /dev/vg_nvme/lv_4... 2024-09-21T12:42:01.953 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T12:42:02.209 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:42:02.644 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:02 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:02.645 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:02 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:02 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:02 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:03.536 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:03 smithi176 ceph-mon[35476]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:03 smithi046 ceph-mon[27868]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:04.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:04 smithi176 ceph-mon[35476]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:04.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:04 smithi046 ceph-mon[27868]: pgmap v82: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:04.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:04 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[63402]: 2024-09-21T12:42:04.474+0000 7f37d97e1640 -1 osd.2 0 log_to_monitors true 2024-09-21T12:42:04.683 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:42:04.711 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi176:vg_nvme/lv_4 2024-09-21T12:42:04.963 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 -- 172.21.15.176:0/505337562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130102b70 msgr2=0x7f6130102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 --2- 172.21.15.176:0/505337562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130102b70 0x7f6130102ff0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f6124009880 tx=0x7f612402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 -- 172.21.15.176:0/505337562 shutdown_connections 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 --2- 172.21.15.176:0/505337562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130102b70 0x7f6130102ff0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 --2- 172.21.15.176:0/505337562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6130101970 0x7f6130101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 -- 172.21.15.176:0/505337562 >> 172.21.15.176:0/505337562 conn(0x7f61300fd140 msgr2=0x7f61300ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:42:05.433 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 -- 172.21.15.176:0/505337562 shutdown_connections 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 -- 172.21.15.176:0/505337562 wait complete. 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.425+0000 7f61359da640 1 Processor -- start 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61359da640 1 -- start start 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61359da640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 0x7f61301974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61359da640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6130102b70 0x7f6130197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61359da640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f613010a7b0 con 0x7f6130102b70 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61359da640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f613010a630 con 0x7f6130101970 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 0x7f61301974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 0x7f61301974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:57354/0 (socket says 172.21.15.176:57354) 2024-09-21T12:42:05.434 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 -- 172.21.15.176:0/1806145278 learned_addr learned my addr 172.21.15.176:0/1806145278 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612e7fc640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6130102b70 0x7f6130197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 -- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6130102b70 msgr2=0x7f6130197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6130102b70 0x7f6130197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 -- 172.21.15.176:0/1806145278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61301980b0 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f612effd640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 0x7f61301974f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f612000eaf0 tx=0x7f612000c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f612000cd10 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6120003e30 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f613019caf0 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.426+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6120010660 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.427+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f613019d080 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.427+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6130101d70 con 0x7f6130101970 2024-09-21T12:42:05.435 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.428+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 18) ==== 92495+0+0 (secure 0 0 0) 0x7f6120003970 con 0x7f6130101970 2024-09-21T12:42:05.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.428+0000 7f61349d8640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f611806e240 0x7f6118070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:05.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.428+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 2550+0+0 (secure 0 0 0) 0x7f612008de20 con 0x7f6130101970 2024-09-21T12:42:05.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.428+0000 7f612e7fc640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f611806e240 0x7f6118070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:05.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.429+0000 7f612e7fc640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f611806e240 0x7f6118070700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61301989a0 tx=0x7f6124009620 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:42:05.436 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.433+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f612005c3c0 con 0x7f6130101970 2024-09-21T12:42:05.610 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:05.608+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6130062630 con 0x7f611806e240 2024-09-21T12:42:05.611 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:05 smithi176 ceph-mon[35476]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T12:42:05.611 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:05 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:05.611 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:05 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:05.810 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:05 smithi046 ceph-mon[27868]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T12:42:05.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:05 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:05.811 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:05 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:06.655 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:06.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:06 smithi176 ceph-mon[35476]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:06.769 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[63402]: 2024-09-21T12:42:06.425+0000 7f37d4f41640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T12:42:06.770 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[63402]: 2024-09-21T12:42:06.432+0000 7f37d157b640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]: dispatch 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='client.24159 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:42:06.770 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:06.771 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:06 smithi046 ceph-mon[27868]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:07 smithi176 ceph-mon[35476]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T12:42:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:07 smithi176 ceph-mon[35476]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T12:42:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:07 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:07.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:07 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:07.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:07 smithi046 ceph-mon[27868]: from='osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]}]': finished 2024-09-21T12:42:07.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:07 smithi046 ceph-mon[27868]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T12:42:07.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:07 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:07.829 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:07 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:09.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: purged_snaps scrub starts 2024-09-21T12:42:09.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: purged_snaps scrub ok 2024-09-21T12:42:09.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:09.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] boot 2024-09-21T12:42:09.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T12:42:09.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:09.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/2779610507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c05a03-79b8-46d8-8507-6c7d9c04629b"}]: dispatch 2024-09-21T12:42:09.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c05a03-79b8-46d8-8507-6c7d9c04629b"}]: dispatch 2024-09-21T12:42:09.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1c05a03-79b8-46d8-8507-6c7d9c04629b"}]': finished 2024-09-21T12:42:09.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T12:42:09.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:09.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:08 smithi046 ceph-mon[27868]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: purged_snaps scrub starts 2024-09-21T12:42:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: purged_snaps scrub ok 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: osd.2 [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] boot 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/2779610507' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c05a03-79b8-46d8-8507-6c7d9c04629b"}]: dispatch 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1c05a03-79b8-46d8-8507-6c7d9c04629b"}]: dispatch 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1c05a03-79b8-46d8-8507-6c7d9c04629b"}]': finished 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:09.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:08 smithi176 ceph-mon[35476]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:42:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:42:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/3030246924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:42:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: Detected new or changed devices on smithi046 2024-09-21T12:42:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi046 to 3948M 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:10.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:10.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/3030246924' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: Detected new or changed devices on smithi046 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi046 to 3948M 2024-09-21T12:42:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:10.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:10 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T12:42:11.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:10 smithi176 ceph-mon[35476]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T12:42:11.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:10 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:11.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:10 smithi176 ceph-mon[35476]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:11.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:10 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T12:42:11.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:10 smithi046 ceph-mon[27868]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T12:42:11.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:10 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:11.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:10 smithi046 ceph-mon[27868]: pgmap v91: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:11.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67763]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:42:11.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67763]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:11.413 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:11.413 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67763]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:11.912 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67766]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:42:11.912 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67766]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:11.912 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:11.912 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:42:11 smithi046 sudo[67766]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:12.229 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:11 smithi176 ceph-mon[35476]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T12:42:12.229 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:11 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:12.229 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:11 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:12.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:11 smithi046 ceph-mon[27868]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T12:42:12.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:11 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:12.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:11 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:12.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67769]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:42:12.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67769]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:12.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:12.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67769]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:12.911 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67772]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:42:12.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67772]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:12.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:12.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67772]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:12.979 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:12.977+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6120058330 con 0x7f6130101970 2024-09-21T12:42:13.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:12 smithi176 ceph-mon[35476]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:13.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:12 smithi046 ceph-mon[27868]: pgmap v93: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:13.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67775]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:42:13.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67775]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:13.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:13.163 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:12 smithi046 sudo[67775]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67778]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:42:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67778]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67778]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:42:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:13 smithi046 sudo[67781]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:14.523 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 ceph-mon[35476]: mgrmap e19: smithi046.vedsjs(active, since 2m), standbys: smithi176.rmyfjh 2024-09-21T12:42:14.523 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:14.523 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 ceph-mon[35476]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 sudo[67784]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 sudo[67784]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 sudo[67784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 sudo[67784]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 ceph-mon[27868]: mgrmap e19: smithi046.vedsjs(active, since 2m), standbys: smithi176.rmyfjh 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:14 smithi046 ceph-mon[27868]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:42:14.779 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40823]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:42:14.779 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40823]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:14.780 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:14.780 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40823]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40826]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:42:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40826]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:42:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:42:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:14 smithi176 sudo[40826]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:42:15.481 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:42:15.481 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:42:15.481 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:42:15.481 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:42:15.481 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:42:15.482 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:42:15.482 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:15.482 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:42:15.482 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:42:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:15.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:42:15.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:16 smithi176 ceph-mon[35476]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:16 smithi046 ceph-mon[27868]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T12:42:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:17 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:17 smithi176 ceph-mon[35476]: Deploying daemon osd.3 on smithi176 2024-09-21T12:42:17.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T12:42:17.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:17 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:17.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:17 smithi046 ceph-mon[27868]: Deploying daemon osd.3 on smithi176 2024-09-21T12:42:18.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:18 smithi176 ceph-mon[35476]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:18.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:18 smithi046 ceph-mon[27868]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:20.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:20 smithi176 ceph-mon[35476]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T12:42:20.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:20 smithi046 ceph-mon[27868]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T12:42:22.520 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:22 smithi176 ceph-mon[35476]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T12:42:22.713 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:22 smithi046 ceph-mon[27868]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T12:42:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:23.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:23.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:23.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:24.473 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:24 smithi176 ceph-mon[35476]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T12:42:24.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:24 smithi046 ceph-mon[27868]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T12:42:26.395 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.393+0000 7f61349d8640 1 -- 172.21.15.176:0/1806145278 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6130062630 con 0x7f611806e240 2024-09-21T12:42:26.395 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 3 on host 'smithi176' 2024-09-21T12:42:26.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f611806e240 msgr2=0x7f6118070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:26.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f611806e240 0x7f6118070700 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61301989a0 tx=0x7f6124009620 comp rx=0 tx=0).stop 2024-09-21T12:42:26.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 msgr2=0x7f61301974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:26.397 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 0x7f61301974f0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f612000eaf0 tx=0x7f612000c2d0 comp rx=0 tx=0).stop 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 shutdown_connections 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f611806e240 0x7f6118070700 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6130102b70 0x7f6130197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 --2- 172.21.15.176:0/1806145278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6130101970 0x7f61301974f0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 >> 172.21.15.176:0/1806145278 conn(0x7f61300fd140 msgr2=0x7f6130106080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 shutdown_connections 2024-09-21T12:42:26.398 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:26.395+0000 7f61359da640 1 -- 172.21.15.176:0/1806145278 wait complete. 2024-09-21T12:42:26.636 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:26 smithi176 ceph-mon[35476]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:42:26.636 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:26 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:26.636 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:26 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:26.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:26 smithi046 ceph-mon[27868]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:42:26.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:26 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:26.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:26 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:27.242 DEBUG:teuthology.orchestra.run.smithi176:osd.3> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T12:42:27.245 INFO:tasks.cephadm:Deploying osd.4 on smithi176 with /dev/vg_nvme/lv_3... 2024-09-21T12:42:27.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T12:42:27.534 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:42:28.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:28.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:28.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:28.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:29.213 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:42:28 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[41424]: 2024-09-21T12:42:28.957+0000 7f78c830d640 -1 osd.3 0 log_to_monitors true 2024-09-21T12:42:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:29 smithi176 ceph-mon[35476]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:42:29.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:29 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:29.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:29 smithi176 ceph-mon[35476]: from='osd.3 [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:42:29.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:29 smithi176 ceph-mon[35476]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:42:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:29 smithi046 ceph-mon[27868]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:42:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:29 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:29 smithi046 ceph-mon[27868]: from='osd.3 [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:42:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:29 smithi046 ceph-mon[27868]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:42:30.563 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[41424]: 2024-09-21T12:42:30.312+0000 7f78c3a6d640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T12:42:30.563 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[41424]: 2024-09-21T12:42:30.318+0000 7f78c00a7640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:42:30.564 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-mon[35476]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:42:30.564 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-mon[35476]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T12:42:30.564 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:30.564 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-mon[35476]: from='osd.3 [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:30.564 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:30 smithi176 ceph-mon[35476]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:30 smithi046 ceph-mon[27868]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:42:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:30 smithi046 ceph-mon[27868]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T12:42:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:30 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:30 smithi046 ceph-mon[27868]: from='osd.3 [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:30 smithi046 ceph-mon[27868]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:30.850 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:42:30.879 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi176:vg_nvme/lv_3 2024-09-21T12:42:31.467 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:42:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:31 smithi176 ceph-mon[35476]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-21T12:42:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:31 smithi176 ceph-mon[35476]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T12:42:31.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:31.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:31.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:31 smithi176 ceph-mon[35476]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:31 smithi046 ceph-mon[27868]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-21T12:42:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:31 smithi046 ceph-mon[27868]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T12:42:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:31 smithi046 ceph-mon[27868]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:42:31.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 -- 172.21.15.176:0/4080593435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c102b60 msgr2=0x7f342c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:31.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 --2- 172.21.15.176:0/4080593435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c102b60 0x7f342c102fe0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3420009880 tx=0x7f342002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:42:31.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 -- 172.21.15.176:0/4080593435 shutdown_connections 2024-09-21T12:42:31.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 --2- 172.21.15.176:0/4080593435 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c102b60 0x7f342c102fe0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:31.946 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 --2- 172.21.15.176:0/4080593435 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f342c101960 0x7f342c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 -- 172.21.15.176:0/4080593435 >> 172.21.15.176:0/4080593435 conn(0x7f342c0fd0f0 msgr2=0x7f342c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 -- 172.21.15.176:0/4080593435 shutdown_connections 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.930+0000 7f34324f6640 1 -- 172.21.15.176:0/4080593435 wait complete. 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f34324f6640 1 Processor -- start 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f34324f6640 1 -- start start 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f34324f6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 0x7f342c199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f34324f6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f342c102b60 0x7f342c199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f34324f6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f342c10a820 con 0x7f342c102b60 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f34324f6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f342c10a6a0 con 0x7f342c101960 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f342bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 0x7f342c199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f342bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 0x7f342c199760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:38188/0 (socket says 172.21.15.176:38188) 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.931+0000 7f342bfff640 1 -- 172.21.15.176:0/4151722436 learned_addr learned my addr 172.21.15.176:0/4151722436 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-21T12:42:31.947 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f342b7fe640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f342c102b60 0x7f342c199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f342bfff640 1 -- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f342c102b60 msgr2=0x7f342c199ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f342bfff640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f342c102b60 0x7f342c199ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f342bfff640 1 -- 172.21.15.176:0/4151722436 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f342c19a320 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f342bfff640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 0x7f342c199760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f341c00b3d0 tx=0x7f341c00b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f341c015020 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f341c011af0 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f341c010da0 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f342c19ed60 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.932+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f342c19f2e0 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.933+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342c101d60 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.934+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f341c018020 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.934+0000 7f34297fa640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f341406e2b0 0x7f3414070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.934+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 3807+0+0 (secure 0 0 0) 0x7f341c08d6a0 con 0x7f342c101960 2024-09-21T12:42:31.948 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.934+0000 7f342b7fe640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f341406e2b0 0x7f3414070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:31.949 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.935+0000 7f342b7fe640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f341406e2b0 0x7f3414070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f342c19ac10 tx=0x7f3420005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:42:31.949 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:31.939+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f341c01f020 con 0x7f342c101960 2024-09-21T12:42:32.120 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:32.118+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f342c0626f0 con 0x7f341406e2b0 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: purged_snaps scrub starts 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: purged_snaps scrub ok 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: osd.3 [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] boot 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:32.541 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:42:32.542 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:42:32.542 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: purged_snaps scrub starts 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: purged_snaps scrub ok 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: osd.3 [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] boot 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:42:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:33.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:33.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:33.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:33.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:33 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.602 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:42:33.602 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T12:42:33.602 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:33.603 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:33 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:34 smithi046 ceph-mon[27868]: Detected new or changed devices on smithi176 2024-09-21T12:42:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:34 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi176 to 14912M 2024-09-21T12:42:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:34 smithi046 ceph-mon[27868]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T12:42:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:34 smithi046 ceph-mon[27868]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T12:42:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:34 smithi176 ceph-mon[35476]: Detected new or changed devices on smithi176 2024-09-21T12:42:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:34 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi176 to 14912M 2024-09-21T12:42:34.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:34 smithi176 ceph-mon[35476]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T12:42:34.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:34 smithi176 ceph-mon[35476]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/4176735099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "891f2ba1-c4c6-4f70-8281-1d23c31de8d7"}]: dispatch 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "891f2ba1-c4c6-4f70-8281-1d23c31de8d7"}]: dispatch 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "891f2ba1-c4c6-4f70-8281-1d23c31de8d7"}]': finished 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:35.538 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:35 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/1993252051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/4176735099' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "891f2ba1-c4c6-4f70-8281-1d23c31de8d7"}]: dispatch 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "891f2ba1-c4c6-4f70-8281-1d23c31de8d7"}]: dispatch 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "891f2ba1-c4c6-4f70-8281-1d23c31de8d7"}]': finished 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: osdmap e30: 5 total, 4 up, 5 in 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:35 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/1993252051' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:42:36.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:36 smithi176 ceph-mon[35476]: pgmap v112: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-21T12:42:36.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:36 smithi046 ceph-mon[27868]: pgmap v112: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 143 KiB/s, 0 objects/s recovering 2024-09-21T12:42:38.671 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:38 smithi046 ceph-mon[27868]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T12:42:38.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:38 smithi176 ceph-mon[35476]: pgmap v113: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T12:42:40.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:40 smithi176 ceph-mon[35476]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T12:42:40.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:40 smithi046 ceph-mon[27868]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-21T12:42:42.523 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:42 smithi176 ceph-mon[35476]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:42.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:42 smithi046 ceph-mon[27868]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:43.687 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:43 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T12:42:43.687 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:43 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:43.687 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:43 smithi176 ceph-mon[35476]: Deploying daemon osd.4 on smithi176 2024-09-21T12:42:43.687 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:43 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:43.742 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:43 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T12:42:43.742 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:43 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:43.742 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:43 smithi046 ceph-mon[27868]: Deploying daemon osd.4 on smithi176 2024-09-21T12:42:43.743 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:43 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:44.690 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:44 smithi176 ceph-mon[35476]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:44.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:44 smithi046 ceph-mon[27868]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:46.508 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:46 smithi176 ceph-mon[35476]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:46.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:46 smithi046 ceph-mon[27868]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:48 smithi176 ceph-mon[35476]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:48.813 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:48 smithi046 ceph-mon[27868]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:49.688 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:49 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:49.688 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:49 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:49.688 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:49 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:42:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:49 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:50.495 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:50 smithi176 ceph-mon[35476]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:50 smithi046 ceph-mon[27868]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:52 smithi176 ceph-mon[35476]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:52.714 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:52 smithi046 ceph-mon[27868]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:52.896 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.895+0000 7f34297fa640 1 -- 172.21.15.176:0/4151722436 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f342c0626f0 con 0x7f341406e2b0 2024-09-21T12:42:52.897 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 4 on host 'smithi176' 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.897+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f341406e2b0 msgr2=0x7f3414070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.897+0000 7f34324f6640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f341406e2b0 0x7f3414070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f342c19ac10 tx=0x7f3420005a20 comp rx=0 tx=0).stop 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.897+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 msgr2=0x7f342c199760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.897+0000 7f34324f6640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 0x7f342c199760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f341c00b3d0 tx=0x7f341c00b890 comp rx=0 tx=0).stop 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 shutdown_connections 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f341406e2b0 0x7f3414070770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f342c102b60 0x7f342c199ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 --2- 172.21.15.176:0/4151722436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f342c101960 0x7f342c199760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 >> 172.21.15.176:0/4151722436 conn(0x7f342c0fd0f0 msgr2=0x7f342c104000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 shutdown_connections 2024-09-21T12:42:52.899 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:52.898+0000 7f34324f6640 1 -- 172.21.15.176:0/4151722436 wait complete. 2024-09-21T12:42:53.549 DEBUG:teuthology.orchestra.run.smithi176:osd.4> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T12:42:53.551 INFO:tasks.cephadm:Deploying osd.5 on smithi176 with /dev/vg_nvme/lv_2... 2024-09-21T12:42:53.551 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T12:42:53.860 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:42:54.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:53 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.181 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.181 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.181 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:54.181 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:53 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:55.134 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:54 smithi176 ceph-mon[35476]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:55.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:54 smithi046 ceph-mon[27868]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:55.746 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:42:55 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[47982]: 2024-09-21T12:42:55.471+0000 7fabcea9d640 -1 osd.4 0 log_to_monitors true 2024-09-21T12:42:56.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:55 smithi176 ceph-mon[35476]: from='osd.4 [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:42:56.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:55 smithi176 ceph-mon[35476]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:42:56.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:55 smithi046 ceph-mon[27868]: from='osd.4 [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:42:56.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:55 smithi046 ceph-mon[27868]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:42:57.000 INFO:teuthology.orchestra.run.smithi176.stdout: 2024-09-21T12:42:57.026 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi176:vg_nvme/lv_2 2024-09-21T12:42:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:56 smithi046 ceph-mon[27868]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:42:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:56 smithi046 ceph-mon[27868]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T12:42:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:56 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:56 smithi046 ceph-mon[27868]: from='osd.4 [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:56 smithi046 ceph-mon[27868]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:56 smithi046 ceph-mon[27868]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:57.204 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-mon[35476]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:42:57.204 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-mon[35476]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T12:42:57.205 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:57.205 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-mon[35476]: from='osd.4 [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:57.205 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-mon[35476]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:42:57.205 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-mon[35476]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:57.205 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[47982]: 2024-09-21T12:42:56.912+0000 7fabca1fd640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T12:42:57.205 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:42:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[47982]: 2024-09-21T12:42:56.917+0000 7fabc6837640 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:42:57.575 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:42:58.151 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:57 smithi176 ceph-mon[35476]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-21T12:42:58.151 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:57 smithi176 ceph-mon[35476]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T12:42:58.151 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:58.151 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:57 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:58.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:57 smithi046 ceph-mon[27868]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-21T12:42:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:57 smithi046 ceph-mon[27868]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T12:42:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:57 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:58.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.149+0000 7f902545a640 1 -- 172.21.15.176:0/928661560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020101990 msgr2=0x7f9020101d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:58.169 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 --2- 172.21.15.176:0/928661560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020101990 0x7f9020101d90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9010009880 tx=0x7f901002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- 172.21.15.176:0/928661560 shutdown_connections 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 --2- 172.21.15.176:0/928661560 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9020102b90 0x7f9020103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 --2- 172.21.15.176:0/928661560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020101990 0x7f9020101d90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- 172.21.15.176:0/928661560 >> 172.21.15.176:0/928661560 conn(0x7f90200fd140 msgr2=0x7f90200ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- 172.21.15.176:0/928661560 shutdown_connections 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- 172.21.15.176:0/928661560 wait complete. 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 Processor -- start 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- start start 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9020101990 0x7f9020075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 0x7f90200745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f902010a7b0 con 0x7f9020101990 2024-09-21T12:42:58.170 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.150+0000 7f902545a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f902010a630 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 0x7f90200745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 0x7f90200745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:43682/0 (socket says 172.21.15.176:43682) 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 -- 172.21.15.176:0/1450555786 learned_addr learned my addr 172.21.15.176:0/1450555786 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 -- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9020101990 msgr2=0x7f9020075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9020101990 0x7f9020075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 -- 172.21.15.176:0/1450555786 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9020074b20 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f9017fff640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 0x7f90200745e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f900800c8a0 tx=0x7f900800cd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90080079b0 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9008007b50 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9008018700 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9020074e10 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.151+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90200753a0 con 0x7f9020102b90 2024-09-21T12:42:58.171 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.152+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9020101d90 con 0x7f9020102b90 2024-09-21T12:42:58.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.153+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9008007d00 con 0x7f9020102b90 2024-09-21T12:42:58.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.153+0000 7f901cff9640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f900c06e2b0 0x7f900c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:42:58.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.153+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4206+0+0 (secure 0 0 0) 0x7f900808df60 con 0x7f9020102b90 2024-09-21T12:42:58.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.153+0000 7f901effd640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f900c06e2b0 0x7f900c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:42:58.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.154+0000 7f901effd640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f900c06e2b0 0x7f900c070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90100096c0 tx=0x7f9010000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:42:58.172 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.158+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9008014030 con 0x7f9020102b90 2024-09-21T12:42:58.336 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:42:58.335+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9020107140 con 0x7f900c06e2b0 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: purged_snaps scrub starts 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: purged_snaps scrub ok 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: osd.4 [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] boot 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:59.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:59.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: purged_snaps scrub starts 2024-09-21T12:42:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: purged_snaps scrub ok 2024-09-21T12:42:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: osd.4 [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] boot 2024-09-21T12:42:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: osdmap e33: 5 total, 5 up, 5 in 2024-09-21T12:42:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi176:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: pgmap v126: 1 pgs: 1 peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:42:59.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:42:59.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:00.114 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:59 smithi176 ceph-mon[35476]: Detected new or changed devices on smithi176 2024-09-21T12:43:00.114 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:59 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi176 to 7456M 2024-09-21T12:43:00.114 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:59 smithi176 ceph-mon[35476]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T12:43:00.114 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:42:59 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:43:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:59 smithi046 ceph-mon[27868]: Detected new or changed devices on smithi176 2024-09-21T12:43:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:59 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi176 to 7456M 2024-09-21T12:43:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:59 smithi046 ceph-mon[27868]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T12:43:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:42:59 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/94217708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0014df04-7f89-498a-9e46-ffafb6de20c6"}]: dispatch 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0014df04-7f89-498a-9e46-ffafb6de20c6"}]: dispatch 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0014df04-7f89-498a-9e46-ffafb6de20c6"}]': finished 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T12:43:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:00 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: pgmap v128: 1 pgs: 1 peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/94217708' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0014df04-7f89-498a-9e46-ffafb6de20c6"}]: dispatch 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0014df04-7f89-498a-9e46-ffafb6de20c6"}]: dispatch 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0014df04-7f89-498a-9e46-ffafb6de20c6"}]': finished 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: osdmap e35: 6 total, 5 up, 6 in 2024-09-21T12:43:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:00 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:02 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/414294640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:43:02.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:02 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/414294640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:43:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:03 smithi176 ceph-mon[35476]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:03 smithi046 ceph-mon[27868]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:04.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:04 smithi176 ceph-mon[35476]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:04.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:04 smithi046 ceph-mon[27868]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:06.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:06 smithi176 ceph-mon[35476]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:06 smithi046 ceph-mon[27868]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:08.504 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:08 smithi176 ceph-mon[35476]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:08 smithi046 ceph-mon[27868]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:09.754 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T12:43:09.754 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:09.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T12:43:09.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:10.743 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:10 smithi176 ceph-mon[35476]: Deploying daemon osd.5 on smithi176 2024-09-21T12:43:10.743 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:10 smithi176 ceph-mon[35476]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:10.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:10 smithi046 ceph-mon[27868]: Deploying daemon osd.5 on smithi176 2024-09-21T12:43:10.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:10 smithi046 ceph-mon[27868]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:12.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:12 smithi176 ceph-mon[35476]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:12.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:12 smithi046 ceph-mon[27868]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:13.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:14 smithi176 ceph-mon[35476]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:14.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:14 smithi046 ceph-mon[27868]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:15.715 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:43:15.715 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:15.715 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:15 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:43:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:15 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:16 smithi176 ceph-mon[35476]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:16 smithi046 ceph-mon[27868]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:18.698 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:18 smithi176 ceph-mon[35476]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:18.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:18 smithi046 ceph-mon[27868]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:19.204 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.202+0000 7f901cff9640 1 -- 172.21.15.176:0/1450555786 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9020107140 con 0x7f900c06e2b0 2024-09-21T12:43:19.204 INFO:teuthology.orchestra.run.smithi176.stdout:Created osd(s) 5 on host 'smithi176' 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f900c06e2b0 msgr2=0x7f900c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f900c06e2b0 0x7f900c070770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f90100096c0 tx=0x7f9010000bc0 comp rx=0 tx=0).stop 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 msgr2=0x7f90200745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 0x7f90200745e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f900800c8a0 tx=0x7f900800cd60 comp rx=0 tx=0).stop 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 shutdown_connections 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f900c06e2b0 0x7f900c070770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9020102b90 0x7f90200745e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 --2- 172.21.15.176:0/1450555786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9020101990 0x7f9020075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 >> 172.21.15.176:0/1450555786 conn(0x7f90200fd140 msgr2=0x7f90200ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:19.207 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 shutdown_connections 2024-09-21T12:43:19.208 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:19.205+0000 7f902545a640 1 -- 172.21.15.176:0/1450555786 wait complete. 2024-09-21T12:43:19.829 DEBUG:teuthology.orchestra.run.smithi176:osd.5> sudo journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T12:43:19.831 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-21T12:43:19.832 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T12:43:20.107 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:20.480 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:20 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.480 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:20 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.480 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:20 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.481 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:20 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:20 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:20 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:20 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:20 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 -- 172.21.15.46:0/647913005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18102490 msgr2=0x7f9b18104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 --2- 172.21.15.46:0/647913005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18102490 0x7f9b18104880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009880 tx=0x7f9b0802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 -- 172.21.15.46:0/647913005 shutdown_connections 2024-09-21T12:43:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 --2- 172.21.15.46:0/647913005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b18104dc0 0x7f9b181071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 --2- 172.21.15.46:0/647913005 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18102490 0x7f9b18104880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 -- 172.21.15.46:0/647913005 >> 172.21.15.46:0/647913005 conn(0x7f9b180fc010 msgr2=0x7f9b180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 -- 172.21.15.46:0/647913005 shutdown_connections 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.564+0000 7f9b1d699640 1 -- 172.21.15.46:0/647913005 wait complete. 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b1d699640 1 Processor -- start 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b1d699640 1 -- start start 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b1d699640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b18102490 0x7f9b18101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b1d699640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 0x7f9b18100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b1d699640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1810a820 con 0x7f9b18104dc0 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b1d699640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9b1810a6a0 con 0x7f9b18102490 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 0x7f9b18100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:20.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b0ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 0x7f9b18100440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58806/0 (socket says 172.21.15.46:58806) 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b0ffff640 1 -- 172.21.15.46:0/781136970 learned_addr learned my addr 172.21.15.46:0/781136970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b16ffd640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b18102490 0x7f9b18101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b0ffff640 1 -- 172.21.15.46:0/781136970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b18102490 msgr2=0x7f9b18101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b0ffff640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b18102490 0x7f9b18101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.565+0000 7f9b0ffff640 1 -- 172.21.15.46:0/781136970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b18100980 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.566+0000 7f9b0ffff640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 0x7f9b18100440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000b3d0 tx=0x7f9b0000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.566+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b00015020 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.566+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9b00011af0 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.566+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b18100c70 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.566+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9b00010d30 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.566+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b18101280 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.567+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b18102870 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.568+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9b00018020 con 0x7f9b18104dc0 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.568+0000 7f9b14ff9640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9b0406e300 0x7f9b040707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:20.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.568+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4321+0+0 (secure 0 0 0) 0x7f9b0008d6a0 con 0x7f9b18104dc0 2024-09-21T12:43:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.568+0000 7f9b16ffd640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9b0406e300 0x7f9b040707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.569+0000 7f9b16ffd640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9b0406e300 0x7f9b040707c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000c00 tx=0x7f9b08009620 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:20.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.573+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9b0001f020 con 0x7f9b18104dc0 2024-09-21T12:43:20.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.750+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9b1819fcf0 con 0x7f9b18104dc0 2024-09-21T12:43:20.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.751+0000 7f9b14ff9640 1 -- 172.21.15.46:0/781136970 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v35) ==== 74+0+130 (secure 0 0 0) 0x7f9b0005f1a0 con 0x7f9b18104dc0 2024-09-21T12:43:20.752 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:20.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9b0406e300 msgr2=0x7f9b040707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:20.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9b0406e300 0x7f9b040707c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b08000c00 tx=0x7f9b08009620 comp rx=0 tx=0).stop 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 msgr2=0x7f9b18100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 0x7f9b18100440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000b3d0 tx=0x7f9b0000b890 comp rx=0 tx=0).stop 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 shutdown_connections 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9b0406e300 0x7f9b040707c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9b18104dc0 0x7f9b18100440 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 --2- 172.21.15.46:0/781136970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b18102490 0x7f9b18101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 >> 172.21.15.46:0/781136970 conn(0x7f9b180fc010 msgr2=0x7f9b180fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 shutdown_connections 2024-09-21T12:43:20.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:20.753+0000 7f9b1d699640 1 -- 172.21.15.46:0/781136970 wait complete. 2024-09-21T12:43:21.492 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:43:21 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[54849]: 2024-09-21T12:43:21.433+0000 7f4df32d5640 -1 osd.5 0 log_to_monitors true 2024-09-21T12:43:21.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:21 smithi176 ceph-mon[35476]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:21.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:21 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/781136970' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:43:21.543 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:21 smithi046 ceph-mon[27868]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:21.543 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:21 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/781136970' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:43:21.576 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"num_osds":6,"num_up_osds":5,"osd_up_since":1726922577,"num_in_osds":6,"osd_in_since":1726922580,"num_remapped_pgs":0} 2024-09-21T12:43:22.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:22 smithi176 ceph-mon[35476]: from='osd.5 [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:43:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:22 smithi176 ceph-mon[35476]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:43:22.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T12:43:22.608 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:22 smithi046 ceph-mon[27868]: from='osd.5 [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:43:22.608 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:22 smithi046 ceph-mon[27868]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:43:22.855 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:23.280 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='osd.5 [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:23.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:43:23.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:43:23.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:23.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:43:23.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 -- 172.21.15.46:0/1922488894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c1023f0 msgr2=0x7fe16c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 --2- 172.21.15.46:0/1922488894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c1023f0 0x7fe16c1047e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe15c0098b0 tx=0x7fe15c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 -- 172.21.15.46:0/1922488894 shutdown_connections 2024-09-21T12:43:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 --2- 172.21.15.46:0/1922488894 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16c104d20 0x7fe16c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 --2- 172.21.15.46:0/1922488894 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c1023f0 0x7fe16c1047e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 -- 172.21.15.46:0/1922488894 >> 172.21.15.46:0/1922488894 conn(0x7fe16c0fc010 msgr2=0x7fe16c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 -- 172.21.15.46:0/1922488894 shutdown_connections 2024-09-21T12:43:23.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.361+0000 7fe171193640 1 -- 172.21.15.46:0/1922488894 wait complete. 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.362+0000 7fe171193640 1 Processor -- start 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.362+0000 7fe171193640 1 -- start start 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe171193640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16c1023f0 0x7fe16c1975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe171193640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 0x7fe16c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe171193640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c10a830 con 0x7fe16c104d20 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe171193640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c10a6b0 con 0x7fe16c1023f0 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 0x7fe16c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 0x7fe16c197b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58814/0 (socket says 172.21.15.46:58814) 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 -- 172.21.15.46:0/3508153228 learned_addr learned my addr 172.21.15.46:0/3508153228 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16ad9d640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16c1023f0 0x7fe16c1975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 -- 172.21.15.46:0/3508153228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16c1023f0 msgr2=0x7fe16c1975c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16c1023f0 0x7fe16c1975c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 -- 172.21.15.46:0/3508153228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c198180 con 0x7fe16c104d20 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe16a59c640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 0x7fe16c197b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b3d0 tx=0x7fe16000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.363+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe160015020 con 0x7fe16c104d20 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.364+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe160011af0 con 0x7fe16c104d20 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.364+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c19cbc0 con 0x7fe16c104d20 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.364+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe160010d30 con 0x7fe16c104d20 2024-09-21T12:43:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.364+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c19d1d0 con 0x7fe16c104d20 2024-09-21T12:43:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.364+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c1027d0 con 0x7fe16c104d20 2024-09-21T12:43:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.365+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe160018020 con 0x7fe16c104d20 2024-09-21T12:43:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.365+0000 7fe153fff640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe15406e300 0x7fe1540707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.366+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4358+0+0 (secure 0 0 0) 0x7fe16008d7d0 con 0x7fe16c104d20 2024-09-21T12:43:23.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.366+0000 7fe16ad9d640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe15406e300 0x7fe1540707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:23.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.366+0000 7fe16ad9d640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe15406e300 0x7fe1540707c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe15c000c00 tx=0x7fe15c009620 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:23.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.370+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe16001f020 con 0x7fe16c104d20 2024-09-21T12:43:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.545+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe16c19d620 con 0x7fe16c104d20 2024-09-21T12:43:23.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.546+0000 7fe153fff640 1 -- 172.21.15.46:0/3508153228 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) ==== 74+0+130 (secure 0 0 0) 0x7fe16005b560 con 0x7fe16c104d20 2024-09-21T12:43:23.547 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe15406e300 msgr2=0x7fe1540707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:23.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe15406e300 0x7fe1540707c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe15c000c00 tx=0x7fe15c009620 comp rx=0 tx=0).stop 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 msgr2=0x7fe16c197b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 0x7fe16c197b00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe16000b3d0 tx=0x7fe16000b890 comp rx=0 tx=0).stop 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 shutdown_connections 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe15406e300 0x7fe1540707c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe16c104d20 0x7fe16c197b00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 --2- 172.21.15.46:0/3508153228 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe16c1023f0 0x7fe16c1975c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 >> 172.21.15.46:0/3508153228 conn(0x7fe16c0fc010 msgr2=0x7fe16c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 shutdown_connections 2024-09-21T12:43:23.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:23.548+0000 7fe171193640 1 -- 172.21.15.46:0/3508153228 wait complete. 2024-09-21T12:43:23.566 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[54849]: 2024-09-21T12:43:23.216+0000 7f4deea35640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T12:43:23.566 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[54849]: 2024-09-21T12:43:23.223+0000 7f4deb06f640 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:43:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='osd.5 [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:43:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:23.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:43:23.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:43:23.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:43:23.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:43:24.290 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"num_osds":6,"num_up_osds":5,"osd_up_since":1726922577,"num_in_osds":6,"osd_in_since":1726922580,"num_remapped_pgs":0} 2024-09-21T12:43:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: Detected new or changed devices on smithi176 2024-09-21T12:43:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi176 to 4970M 2024-09-21T12:43:24.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-21T12:43:24.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T12:43:24.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:24.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:24.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:24 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3508153228' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: Detected new or changed devices on smithi176 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi176 to 4970M 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]}]': finished 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:24 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3508153228' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:43:25.291 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T12:43:25.560 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:25 smithi176 ceph-mon[35476]: purged_snaps scrub starts 2024-09-21T12:43:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:25 smithi176 ceph-mon[35476]: purged_snaps scrub ok 2024-09-21T12:43:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:25 smithi176 ceph-mon[35476]: osd.5 [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] boot 2024-09-21T12:43:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:25 smithi176 ceph-mon[35476]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T12:43:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:25 smithi176 ceph-mon[35476]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:25 smithi046 ceph-mon[27868]: purged_snaps scrub starts 2024-09-21T12:43:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:25 smithi046 ceph-mon[27868]: purged_snaps scrub ok 2024-09-21T12:43:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:25 smithi046 ceph-mon[27868]: osd.5 [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] boot 2024-09-21T12:43:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:25 smithi046 ceph-mon[27868]: osdmap e38: 6 total, 6 up, 6 in 2024-09-21T12:43:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:43:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:25 smithi046 ceph-mon[27868]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.004+0000 7fded83ac640 1 -- 172.21.15.46:0/3686562506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded0100b20 msgr2=0x7fded0100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.004+0000 7fded83ac640 1 --2- 172.21.15.46:0/3686562506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded0100b20 0x7fded0100f80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009880 tx=0x7fdec002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.004+0000 7fded83ac640 1 -- 172.21.15.46:0/3686562506 shutdown_connections 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 --2- 172.21.15.46:0/3686562506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded0100b20 0x7fded0100f80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 --2- 172.21.15.46:0/3686562506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fded01001e0 0x7fded01005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 -- 172.21.15.46:0/3686562506 >> 172.21.15.46:0/3686562506 conn(0x7fded00fc010 msgr2=0x7fded00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 -- 172.21.15.46:0/3686562506 shutdown_connections 2024-09-21T12:43:26.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 -- 172.21.15.46:0/3686562506 wait complete. 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 Processor -- start 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 -- start start 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 0x7fded0199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fded0100b20 0x7fded0199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fded010c970 con 0x7fded01001e0 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.005+0000 7fded83ac640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fded010c7f0 con 0x7fded0100b20 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 0x7fded0199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 0x7fded0199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58826/0 (socket says 172.21.15.46:58826) 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 -- 172.21.15.46:0/3494059989 learned_addr learned my addr 172.21.15.46:0/3494059989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded5947640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fded0100b20 0x7fded0199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 -- 172.21.15.46:0/3494059989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fded0100b20 msgr2=0x7fded0199bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fded0100b20 0x7fded0199bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 -- 172.21.15.46:0/3494059989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded019a230 con 0x7fded01001e0 2024-09-21T12:43:26.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded6148640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 0x7fded0199670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00d8d0 tx=0x7fdecc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:26.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdecc017030 con 0x7fded01001e0 2024-09-21T12:43:26.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdecc004020 con 0x7fded01001e0 2024-09-21T12:43:26.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdecc0047a0 con 0x7fded01001e0 2024-09-21T12:43:26.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded019ec70 con 0x7fded01001e0 2024-09-21T12:43:26.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.006+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded019f1b0 con 0x7fded01001e0 2024-09-21T12:43:26.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.007+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded01005e0 con 0x7fded01001e0 2024-09-21T12:43:26.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.008+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdecc0041d0 con 0x7fded01001e0 2024-09-21T12:43:26.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.008+0000 7fdec77fe640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdebc06e310 0x7fdebc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:26.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.008+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fdecc018070 con 0x7fded01001e0 2024-09-21T12:43:26.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.009+0000 7fded5947640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdebc06e310 0x7fdebc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:26.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.009+0000 7fded5947640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdebc06e310 0x7fdebc0707d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fded019ab20 tx=0x7fdec0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:26.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.013+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdecc05b940 con 0x7fded01001e0 2024-09-21T12:43:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.189+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fded0062df0 con 0x7fded01001e0 2024-09-21T12:43:26.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.189+0000 7fdec77fe640 1 -- 172.21.15.46:0/3494059989 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v39) ==== 74+0+130 (secure 0 0 0) 0x7fdecc05f5f0 con 0x7fded01001e0 2024-09-21T12:43:26.191 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdebc06e310 msgr2=0x7fdebc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdebc06e310 0x7fdebc0707d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fded019ab20 tx=0x7fdec0005a20 comp rx=0 tx=0).stop 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 msgr2=0x7fded0199670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 0x7fded0199670 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00d8d0 tx=0x7fdecc00dd90 comp rx=0 tx=0).stop 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 shutdown_connections 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdebc06e310 0x7fdebc0707d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fded0100b20 0x7fded0199bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 --2- 172.21.15.46:0/3494059989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fded01001e0 0x7fded0199670 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:26.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.191+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 >> 172.21.15.46:0/3494059989 conn(0x7fded00fc010 msgr2=0x7fded0108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.192+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 shutdown_connections 2024-09-21T12:43:26.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:26.192+0000 7fded83ac640 1 -- 172.21.15.46:0/3494059989 wait complete. 2024-09-21T12:43:26.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:26 smithi046 ceph-mon[27868]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T12:43:26.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:26 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3494059989' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:43:26.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:26 smithi176 ceph-mon[35476]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T12:43:26.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:26 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3494059989' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:43:26.961 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"num_osds":6,"num_up_osds":6,"osd_up_since":1726922604,"num_in_osds":6,"osd_in_since":1726922580,"num_remapped_pgs":0} 2024-09-21T12:43:26.962 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T12:43:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:27.490 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:27 smithi046 ceph-mon[27868]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:27 smithi176 ceph-mon[35476]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 -- 172.21.15.46:0/414237072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 msgr2=0x7f9400106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 --2- 172.21.15.46:0/414237072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f9400106bd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f93f4009880 tx=0x7f93f402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 -- 172.21.15.46:0/414237072 shutdown_connections 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 --2- 172.21.15.46:0/414237072 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94001007f0 0x7f9400100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 --2- 172.21.15.46:0/414237072 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f9400106bd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 -- 172.21.15.46:0/414237072 >> 172.21.15.46:0/414237072 conn(0x7f94000fc550 msgr2=0x7f94000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 -- 172.21.15.46:0/414237072 shutdown_connections 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 -- 172.21.15.46:0/414237072 wait complete. 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 Processor -- start 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.679+0000 7f9406aab640 1 -- start start 2024-09-21T12:43:27.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f9406aab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94001007f0 0x7f940019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f9406aab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f940019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f9406aab640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f940010dca0 con 0x7f94001067f0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f9406aab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f940010db20 con 0x7f94001007f0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f940019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f940019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39086/0 (socket says 172.21.15.46:39086) 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 -- 172.21.15.46:0/1498157517 learned_addr learned my addr 172.21.15.46:0/1498157517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f9404847640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94001007f0 0x7f940019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 -- 172.21.15.46:0/1498157517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94001007f0 msgr2=0x7f940019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94001007f0 0x7f940019d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 -- 172.21.15.46:0/1498157517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9400197870 con 0x7f94001067f0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fffff640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f940019dbf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00c8a0 tx=0x7f93ec00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93ec0079b0 con 0x7f94001067f0 2024-09-21T12:43:27.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f93ec007b50 con 0x7f94001067f0 2024-09-21T12:43:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9400197b00 con 0x7f94001067f0 2024-09-21T12:43:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.680+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f93ec018700 con 0x7f94001067f0 2024-09-21T12:43:27.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.681+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9400198090 con 0x7f94001067f0 2024-09-21T12:43:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.682+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940019e2f0 con 0x7f94001067f0 2024-09-21T12:43:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.682+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f93ec007d00 con 0x7f94001067f0 2024-09-21T12:43:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.683+0000 7f93fdffb640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f93f006e310 0x7f93f00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.683+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f93ec08e020 con 0x7f94001067f0 2024-09-21T12:43:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.683+0000 7f9404847640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f93f006e310 0x7f93f00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:27.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.683+0000 7f9404847640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f93f006e310 0x7f93f00707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f4004120 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:27.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.687+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f93ec014030 con 0x7f94001067f0 2024-09-21T12:43:27.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.865+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9400198da0 con 0x7f94001067f0 2024-09-21T12:43:27.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.866+0000 7f93fdffb640 1 -- 172.21.15.46:0/1498157517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11361 (secure 0 0 0) 0x7f93ec057070 con 0x7f94001067f0 2024-09-21T12:43:27.867 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:27.868 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","created":"2024-09-21T12:37:29.103706+0000","modified":"2024-09-21T12:43:25.220166+0000","last_up_change":"2024-09-21T12:43:24.214531+0000","last_in_change":"2024-09-21T12:43:00.824836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T12:42:08.829984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72e260bc-7dd4-4165-91b7-79c05b1bca54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6803","nonce":493901196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6805","nonce":493901196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6809","nonce":493901196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6807","nonce":493901196}]},"public_addr":"172.21.15.46:6803/493901196","cluster_addr":"172.21.15.46:6805/493901196","heartbeat_back_addr":"172.21.15.46:6809/493901196","heartbeat_front_addr":"172.21.15.46:6807/493901196","state":["exists","up"]},{"osd":1,"uuid":"d92ad225-134c-4b1a-9b18-906a96fab115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6811","nonce":3172280334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6813","nonce":3172280334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6817","nonce":3172280334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6815","nonce":3172280334}]},"public_addr":"172.21.15.46:6811/3172280334","cluster_addr":"172.21.15.46:6813/3172280334","heartbeat_back_addr":"172.21.15.46:6817/3172280334","heartbeat_front_addr":"172.21.15.46:6815/3172280334","state":["exists","up"]},{"osd":2,"uuid":"99af3cc6-64df-4851-916e-2a097d183686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6819","nonce":720202274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6821","nonce":720202274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6825","nonce":720202274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6823","nonce":720202274}]},"public_addr":"172.21.15.46:6819/720202274","cluster_addr":"172.21.15.46:6821/720202274","heartbeat_back_addr":"172.21.15.46:6825/720202274","heartbeat_front_addr":"172.21.15.46:6823/720202274","state":["exists","up"]},{"osd":3,"uuid":"f1c05a03-79b8-46d8-8507-6c7d9c04629b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6801","nonce":3674681341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6803","nonce":3674681341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6807","nonce":3674681341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6805","nonce":3674681341}]},"public_addr":"172.21.15.176:6801/3674681341","cluster_addr":"172.21.15.176:6803/3674681341","heartbeat_back_addr":"172.21.15.176:6807/3674681341","heartbeat_front_addr":"172.21.15.176:6805/3674681341","state":["exists","up"]},{"osd":4,"uuid":"891f2ba1-c4c6-4f70-8281-1d23c31de8d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6809","nonce":2392731042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6811","nonce":2392731042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6815","nonce":2392731042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6813","nonce":2392731042}]},"public_addr":"172.21.15.176:6809/2392731042","cluster_addr":"172.21.15.176:6811/2392731042","heartbeat_back_addr":"172.21.15.176:6815/2392731042","heartbeat_front_addr":"172.21.15.176:6813/2392731042","state":["exists","up"]},{"osd":5,"uuid":"0014df04-7f89-498a-9e46-ffafb6de20c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6817","nonce":58490774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6819","nonce":58490774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6823","nonce":58490774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6821","nonce":58490774}]},"public_addr":"172.21.15.176:6817/58490774","cluster_addr":"172.21.15.176:6819/58490774","heartbeat_back_addr":"172.21.15.176:6823/58490774","heartbeat_front_addr":"172.21.15.176:6821/58490774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:41:04.126215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:41:36.414842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:05.486585+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:29.988430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:56.430814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:43:22.479273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/4175095776":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6800/2799026186":"2024-09-22T12:37:59.843813+0000","172.21.15.46:6801/2799026186":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/1961061203":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/2569846456":"2024-09-22T12:37:59.843813+0000","172.21.15.46:6800/2190573753":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/2476197265":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/3333048124":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/2703068580":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/3638928701":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6800/3815949737":"2024-09-22T12:39:28.313737+0000","172.21.15.46:0/2844834476":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6801/2190573753":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/3184981437":"2024-09-22T12:38:32.104639+0000","172.21.15.46:6801/3815949737":"2024-09-22T12:39:28.313737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f93f006e310 msgr2=0x7f93f00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f93f006e310 0x7f93f00707d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f93f4000c00 tx=0x7f93f4004120 comp rx=0 tx=0).stop 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 msgr2=0x7f940019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f940019dbf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f93ec00c8a0 tx=0x7f93ec00cd60 comp rx=0 tx=0).stop 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 shutdown_connections 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f93f006e310 0x7f93f00707d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94001067f0 0x7f940019dbf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 --2- 172.21.15.46:0/1498157517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94001007f0 0x7f940019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.868+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 >> 172.21.15.46:0/1498157517 conn(0x7f94000fc550 msgr2=0x7f9400109f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.869+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 shutdown_connections 2024-09-21T12:43:27.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:27.869+0000 7f9406aab640 1 -- 172.21.15.46:0/1498157517 wait complete. 2024-09-21T12:43:28.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:28 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1498157517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:43:28.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:28 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1498157517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:43:28.612 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T12:42:08.829984+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T12:43:28.612 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T12:43:28.876 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:29.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:29 smithi046 ceph-mon[27868]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:29.249 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:29 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 -- 172.21.15.46:0/557650121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964101900 msgr2=0x7fb964101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 --2- 172.21.15.46:0/557650121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964101900 0x7fb964101d60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb958009880 tx=0x7fb95802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 -- 172.21.15.46:0/557650121 shutdown_connections 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 --2- 172.21.15.46:0/557650121 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964101900 0x7fb964101d60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 --2- 172.21.15.46:0/557650121 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb964107900 0x7fb964107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 -- 172.21.15.46:0/557650121 >> 172.21.15.46:0/557650121 conn(0x7fb9640fd600 msgr2=0x7fb9640ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 -- 172.21.15.46:0/557650121 shutdown_connections 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.333+0000 7fb969380640 1 -- 172.21.15.46:0/557650121 wait complete. 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb969380640 1 Processor -- start 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb969380640 1 -- start start 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb969380640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb964101900 0x7fb96419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb969380640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 0x7fb96419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb969380640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb96410edd0 con 0x7fb964107900 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb969380640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb96410ec50 con 0x7fb964101900 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb9627fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 0x7fb96419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb9627fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 0x7fb96419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39106/0 (socket says 172.21.15.46:39106) 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.334+0000 7fb9627fc640 1 -- 172.21.15.46:0/3249507537 learned_addr learned my addr 172.21.15.46:0/3249507537 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb962ffd640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb964101900 0x7fb96419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb9627fc640 1 -- 172.21.15.46:0/3249507537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb964101900 msgr2=0x7fb96419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb9627fc640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb964101900 0x7fb96419f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb9627fc640 1 -- 172.21.15.46:0/3249507537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb964199a50 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb9627fc640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 0x7fb96419fdd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb958031460 tx=0x7fb9580045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb95803f070 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb964199ce0 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb9580035f0 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb958035030 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.335+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb96419a210 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.336+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb964103040 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.337+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fb958042070 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.337+0000 7fb94bfff640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb94c06e2b0 0x7fb94c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.338+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fb9580ae7f0 con 0x7fb964107900 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.338+0000 7fb962ffd640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb94c06e2b0 0x7fb94c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.338+0000 7fb962ffd640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb94c06e2b0 0x7fb94c070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb954005fd0 tx=0x7fb954005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:29.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.342+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb95807c490 con 0x7fb964107900 2024-09-21T12:43:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.519+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb96419af80 con 0x7fb964107900 2024-09-21T12:43:29.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.520+0000 7fb94bfff640 1 -- 172.21.15.46:0/3249507537 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7fb958080140 con 0x7fb964107900 2024-09-21T12:43:29.521 INFO:teuthology.orchestra.run.smithi046.stdout:pg_num: 1 2024-09-21T12:43:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb94c06e2b0 msgr2=0x7fb94c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb94c06e2b0 0x7fb94c070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb954005fd0 tx=0x7fb954005850 comp rx=0 tx=0).stop 2024-09-21T12:43:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 msgr2=0x7fb96419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:29.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 0x7fb96419fdd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb958031460 tx=0x7fb9580045e0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 shutdown_connections 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fb94c06e2b0 0x7fb94c070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb964107900 0x7fb96419fdd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 --2- 172.21.15.46:0/3249507537 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb964101900 0x7fb96419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 >> 172.21.15.46:0/3249507537 conn(0x7fb9640fd600 msgr2=0x7fb964074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 shutdown_connections 2024-09-21T12:43:29.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:29.522+0000 7fb969380640 1 -- 172.21.15.46:0/3249507537 wait complete. 2024-09-21T12:43:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:29 smithi176 ceph-mon[35476]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:29 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:30.156 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T12:43:30.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T12:43:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:30 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3249507537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T12:43:30.422 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:30 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3249507537' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T12:43:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 -- 172.21.15.46:0/3221868618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 msgr2=0x7f68401071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 --2- 172.21.15.46:0/3221868618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401071d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6828009880 tx=0x7f682802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 -- 172.21.15.46:0/3221868618 shutdown_connections 2024-09-21T12:43:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 --2- 172.21.15.46:0/3221868618 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401071d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 --2- 172.21.15.46:0/3221868618 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68401024b0 0x7f68401048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:30.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 -- 172.21.15.46:0/3221868618 >> 172.21.15.46:0/3221868618 conn(0x7f68400fbff0 msgr2=0x7f68400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 -- 172.21.15.46:0/3221868618 shutdown_connections 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.845+0000 7f6844a53640 1 -- 172.21.15.46:0/3221868618 wait complete. 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6844a53640 1 Processor -- start 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6844a53640 1 -- start start 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6844a53640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68401024b0 0x7f6840197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6844a53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6844a53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f684010a780 con 0x7f6840104de0 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6844a53640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f684010a600 con 0x7f68401024b0 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6835d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6835d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39126/0 (socket says 172.21.15.46:39126) 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f6835d9b640 1 -- 172.21.15.46:0/3271941942 learned_addr learned my addr 172.21.15.46:0/3271941942 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:30.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.846+0000 7f683e59c640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68401024b0 0x7f6840197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6835d9b640 1 -- 172.21.15.46:0/3271941942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68401024b0 msgr2=0x7f6840197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6835d9b640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68401024b0 0x7f6840197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6835d9b640 1 -- 172.21.15.46:0/3271941942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6840197fb0 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6835d9b640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401979c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6828006010 tx=0x7f68280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f682803f070 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68280044d0 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684019c9c0 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6828035030 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.847+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684019cec0 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.848+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6840102890 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.849+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6828042070 con 0x7f6840104de0 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.849+0000 7f6837fff640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f682c06e310 0x7f682c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:30.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.849+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f68280ae970 con 0x7f6840104de0 2024-09-21T12:43:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.849+0000 7f683e59c640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f682c06e310 0x7f682c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.850+0000 7f683e59c640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f682c06e310 0x7f682c0707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f683000abe0 tx=0x7f683000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:30.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:30.853+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68280b0e20 con 0x7f6840104de0 2024-09-21T12:43:31.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.100+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f684019d470 con 0x7f6840104de0 2024-09-21T12:43:31.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.102+0000 7f6837fff640 1 -- 172.21.15.46:0/3271941942 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f682807c690 con 0x7f6840104de0 2024-09-21T12:43:31.103 INFO:teuthology.orchestra.run.smithi046.stdout:[client.0] 2024-09-21T12:43:31.103 INFO:teuthology.orchestra.run.smithi046.stdout: key = AQBzv+5mkq8IBhAAWoAsoaBBPFRXxTFPwtqLqA== 2024-09-21T12:43:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f682c06e310 msgr2=0x7f682c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f682c06e310 0x7f682c0707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f683000abe0 tx=0x7f683000a2d0 comp rx=0 tx=0).stop 2024-09-21T12:43:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 msgr2=0x7f68401979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401979c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6828006010 tx=0x7f68280048f0 comp rx=0 tx=0).stop 2024-09-21T12:43:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 shutdown_connections 2024-09-21T12:43:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f682c06e310 0x7f682c0707d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6840104de0 0x7f68401979c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 --2- 172.21.15.46:0/3271941942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68401024b0 0x7f6840197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 >> 172.21.15.46:0/3271941942 conn(0x7f68400fbff0 msgr2=0x7f68400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 shutdown_connections 2024-09-21T12:43:31.106 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:31.104+0000 7f6844a53640 1 -- 172.21.15.46:0/3271941942 wait complete. 2024-09-21T12:43:31.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:31 smithi046 ceph-mon[27868]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:31.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:31 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3271941942' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:43:31.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:31 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3271941942' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:43:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:31 smithi176 ceph-mon[35476]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:31 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3271941942' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:43:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:31 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3271941942' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:43:31.739 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:43:31.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T12:43:31.739 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T12:43:31.778 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T12:43:32.041 INFO:teuthology.orchestra.run.smithi176.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T12:43:32.500 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 -- 172.21.15.176:0/2291663972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 msgr2=0x7f8de4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:32.500 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 --2- 172.21.15.176:0/2291663972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de4100c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009880 tx=0x7f8dd402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.500 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 -- 172.21.15.176:0/2291663972 shutdown_connections 2024-09-21T12:43:32.500 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 --2- 172.21.15.176:0/2291663972 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de4101a60 0x7f8de4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 --2- 172.21.15.176:0/2291663972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de4100c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 -- 172.21.15.176:0/2291663972 >> 172.21.15.176:0/2291663972 conn(0x7f8de40fc010 msgr2=0x7f8de40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 -- 172.21.15.176:0/2291663972 shutdown_connections 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.496+0000 7f8de8b91640 1 -- 172.21.15.176:0/2291663972 wait complete. 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de8b91640 1 Processor -- start 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de8b91640 1 -- start start 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de8b91640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de8b91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de4101a60 0x7f8de419e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de8b91640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4109700 con 0x7f8de4101a60 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de8b91640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8de4109580 con 0x7f8de4100860 2024-09-21T12:43:32.501 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de259c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de406ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:33970/0 (socket says 172.21.15.176:33970) 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.497+0000 7f8de259c640 1 -- 172.21.15.176:0/1367028718 learned_addr learned my addr 172.21.15.176:0/1367028718 (peer_addr_for_me v2:172.21.15.176:0/0) 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8ddbfff640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de4101a60 0x7f8de419e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8de259c640 1 -- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de4101a60 msgr2=0x7f8de419e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8de259c640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de4101a60 0x7f8de419e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8de259c640 1 -- 172.21.15.176:0/1367028718 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8de4198120 con 0x7f8de4100860 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8de259c640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de406ac30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006010 tx=0x7f8dd40048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dd403f070 con 0x7f8de4100860 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8de419ed40 con 0x7f8de4100860 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8dd40044d0 con 0x7f8de4100860 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dd4035030 con 0x7f8de4100860 2024-09-21T12:43:32.502 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.498+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8de419f260 con 0x7f8de4100860 2024-09-21T12:43:32.503 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.499+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8de4100c60 con 0x7f8de4100860 2024-09-21T12:43:32.503 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.500+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8dd4042070 con 0x7f8de4100860 2024-09-21T12:43:32.503 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.500+0000 7f8ddb7fe640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8dd006e2b0 0x7f8dd0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:32.503 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.500+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8dd40aeac0 con 0x7f8de4100860 2024-09-21T12:43:32.503 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.500+0000 7f8ddbfff640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8dd006e2b0 0x7f8dd0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:32.504 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.501+0000 7f8ddbfff640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8dd006e2b0 0x7f8dd0070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8de406a9b0 tx=0x7f8dcc008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:32.506 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.505+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8dd407c760 con 0x7f8de4100860 2024-09-21T12:43:32.735 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.734+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f8de4190510 con 0x7f8de4100860 2024-09-21T12:43:32.736 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:32 smithi176 ceph-mon[35476]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:32.740 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.738+0000 7f8ddb7fe640 1 -- 172.21.15.176:0/1367028718 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7f8dd4080410 con 0x7f8de4100860 2024-09-21T12:43:32.740 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2024-09-21T12:43:32.740 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQB0v+5m1czjKxAAtZXPHzbSjc1rgBYQKdJi+w== 2024-09-21T12:43:32.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8dd006e2b0 msgr2=0x7f8dd0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:32.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8dd006e2b0 0x7f8dd0070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8de406a9b0 tx=0x7f8dcc008040 comp rx=0 tx=0).stop 2024-09-21T12:43:32.742 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 msgr2=0x7f8de406ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de406ac30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4006010 tx=0x7f8dd40048f0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 shutdown_connections 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8dd006e2b0 0x7f8dd0070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8de4101a60 0x7f8de419e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 --2- 172.21.15.176:0/1367028718 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8de4100860 0x7f8de406ac30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 >> 172.21.15.176:0/1367028718 conn(0x7f8de40fc010 msgr2=0x7f8de4105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.740+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 shutdown_connections 2024-09-21T12:43:32.743 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:43:32.741+0000 7f8de8b91640 1 -- 172.21.15.176:0/1367028718 wait complete. 2024-09-21T12:43:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:32 smithi046 ceph-mon[27868]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:33.374 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:43:33.374 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T12:43:33.374 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T12:43:33.412 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T12:43:33.684 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:33.806 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:33 smithi046 ceph-mon[27868]: from='client.? 172.21.15.176:0/1367028718' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:43:33.806 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:33 smithi046 ceph-mon[27868]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:43:33.806 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:33 smithi046 ceph-mon[27868]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:43:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:33 smithi176 ceph-mon[35476]: from='client.? 172.21.15.176:0/1367028718' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:43:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:33 smithi176 ceph-mon[35476]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:43:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:33 smithi176 ceph-mon[35476]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1919532794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 msgr2=0x7f97b4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1919532794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b4107ce0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f97a4009880 tx=0x7f97a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1919532794 shutdown_connections 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1919532794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 0x7f97b4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1919532794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b4107ce0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1919532794 >> 172.21.15.46:0/1919532794 conn(0x7f97b40fd600 msgr2=0x7f97b40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1919532794 shutdown_connections 2024-09-21T12:43:34.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.144+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1919532794 wait complete. 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97ba9e8640 1 Processor -- start 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97ba9e8640 1 -- start start 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97ba9e8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 0x7f97b419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97ba9e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97ba9e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f97b410edd0 con 0x7f97b4107900 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97ba9e8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f97b410ec50 con 0x7f97b4101900 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b419fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39136/0 (socket says 172.21.15.46:39136) 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97abfff640 1 -- 172.21.15.46:0/1494278898 learned_addr learned my addr 172.21.15.46:0/1494278898 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97b3fff640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 0x7f97b419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97abfff640 1 -- 172.21.15.46:0/1494278898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 msgr2=0x7f97b419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97abfff640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 0x7f97b419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97abfff640 1 -- 172.21.15.46:0/1494278898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b4199a10 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.145+0000 7f97b3fff640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 0x7f97b419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.146+0000 7f97abfff640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b419fd90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f979c00d6f0 tx=0x7f979c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.146+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f979c017070 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.146+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f979c00de00 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.146+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f979c004bb0 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.146+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b4199d00 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.146+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b419a290 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.147+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b4103040 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.147+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f979c009a30 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.148+0000 7f97b1ffb640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f97a006e300 0x7f97a00707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.148+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f979c08d980 con 0x7f97b4107900 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.148+0000 7f97b3fff640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f97a006e300 0x7f97a00707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.148+0000 7f97b3fff640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f97a006e300 0x7f97a00707c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f97a4000c00 tx=0x7f97a4031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:34.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.152+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f979c05b6a0 con 0x7f97b4107900 2024-09-21T12:43:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.330+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f97b419b010 con 0x7f97b4107900 2024-09-21T12:43:34.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.330+0000 7f97b1ffb640 1 -- 172.21.15.46:0/1494278898 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v37) ==== 86+0+187 (secure 0 0 0) 0x7f979c05f350 con 0x7f97b4107900 2024-09-21T12:43:34.331 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:34.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f97a006e300 msgr2=0x7f97a00707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:34.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f97a006e300 0x7f97a00707c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f97a4000c00 tx=0x7f97a4031400 comp rx=0 tx=0).stop 2024-09-21T12:43:34.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 msgr2=0x7f97b419fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:34.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b419fd90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f979c00d6f0 tx=0x7f979c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 shutdown_connections 2024-09-21T12:43:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f97a006e300 0x7f97a00707c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f97b4107900 0x7f97b419fd90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 --2- 172.21.15.46:0/1494278898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97b4101900 0x7f97b419f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 >> 172.21.15.46:0/1494278898 conn(0x7f97b40fd600 msgr2=0x7f97b4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 shutdown_connections 2024-09-21T12:43:34.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:34.333+0000 7f97ba9e8640 1 -- 172.21.15.46:0/1494278898 wait complete. 2024-09-21T12:43:34.633 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:34 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1494278898' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T12:43:34.633 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:34 smithi046 ceph-mon[27868]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:34.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:34 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1494278898' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T12:43:34.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:34 smithi176 ceph-mon[35476]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:35.021 INFO:teuthology.orchestra.run.smithi046.stdout:[{"version":37,"timestamp":"2024-09-21T12:43:22.967143+0000","name":"","changes":[{"name":"osd/host:smithi176/osd_memory_target","previous_value":"7818251673","new_value":"5212167782"}]}] 2024-09-21T12:43:35.021 INFO:tasks.ceph_manager:config epoch is 37 2024-09-21T12:43:35.021 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T12:43:35.021 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T12:43:35.022 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T12:43:35.279 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:35.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 -- 172.21.15.46:0/2060753717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 msgr2=0x7fd140102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 --2- 172.21.15.46:0/2060753717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd140102f50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd130009c20 tx=0x7fd13002aa00 comp rx=0 tx=0).stop 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 -- 172.21.15.46:0/2060753717 shutdown_connections 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 --2- 172.21.15.46:0/2060753717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 0x7fd14010b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 --2- 172.21.15.46:0/2060753717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd140102f50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 -- 172.21.15.46:0/2060753717 >> 172.21.15.46:0/2060753717 conn(0x7fd1400fc550 msgr2=0x7fd1400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 -- 172.21.15.46:0/2060753717 shutdown_connections 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 -- 172.21.15.46:0/2060753717 wait complete. 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.692+0000 7fd1456b5640 1 Processor -- start 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd1456b5640 1 -- start start 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd1456b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd14019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd1456b5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 0x7fd14019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd1456b5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd14010ede0 con 0x7fd140102b70 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd1456b5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd14010ec60 con 0x7fd140103490 2024-09-21T12:43:35.696 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd14019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd14019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:39150/0 (socket says 172.21.15.46:39150) 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 -- 172.21.15.46:0/67820445 learned_addr learned my addr 172.21.15.46:0/67820445 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13e7fc640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 0x7fd14019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 -- 172.21.15.46:0/67820445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 msgr2=0x7fd14019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 0x7fd14019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 -- 172.21.15.46:0/67820445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1401977b0 con 0x7fd140102b70 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13e7fc640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 0x7fd14019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.693+0000 7fd13effd640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd14019d630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd130005cc0 tx=0x7fd13002ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.694+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd130047070 con 0x7fd140102b70 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.694+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd140197a40 con 0x7fd140102b70 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.694+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd130003e30 con 0x7fd140102b70 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.694+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd130033050 con 0x7fd140102b70 2024-09-21T12:43:35.697 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.694+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd140197f70 con 0x7fd140102b70 2024-09-21T12:43:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.695+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd14006a4c0 con 0x7fd140102b70 2024-09-21T12:43:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.695+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd13004a070 con 0x7fd140102b70 2024-09-21T12:43:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.696+0000 7fd127fff640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd12806e2b0 0x7fd128070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.696+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd13003e030 con 0x7fd140102b70 2024-09-21T12:43:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.696+0000 7fd13e7fc640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd12806e2b0 0x7fd128070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:35.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.696+0000 7fd13e7fc640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd12806e2b0 0x7fd128070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd140108940 tx=0x7fd134005d30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:35.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.700+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd13007cca0 con 0x7fd140102b70 2024-09-21T12:43:35.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.924+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fd140105fd0 con 0x7fd140102b70 2024-09-21T12:43:35.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.927+0000 7fd127fff640 1 -- 172.21.15.46:0/67820445 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176564 (secure 0 0 0) 0x7fd130080950 con 0x7fd140102b70 2024-09-21T12:43:35.931 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:35.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd12806e2b0 msgr2=0x7fd128070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:35.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd12806e2b0 0x7fd128070770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd140108940 tx=0x7fd134005d30 comp rx=0 tx=0).stop 2024-09-21T12:43:35.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 msgr2=0x7fd14019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd14019d630 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd130005cc0 tx=0x7fd13002ee50 comp rx=0 tx=0).stop 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 shutdown_connections 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd12806e2b0 0x7fd128070770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd140103490 0x7fd14019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 --2- 172.21.15.46:0/67820445 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd140102b70 0x7fd14019d630 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 >> 172.21.15.46:0/67820445 conn(0x7fd1400fc550 msgr2=0x7fd140108f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 shutdown_connections 2024-09-21T12:43:35.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:35.931+0000 7fd1456b5640 1 -- 172.21.15.46:0/67820445 wait complete. 2024-09-21T12:43:36.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:35 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/67820445' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T12:43:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:35 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/67820445' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T12:43:36.860 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi046.vedsjs","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6800","nonce":2026840811},{"type":"v1","addr":"172.21.15.46:6801","nonce":2026840811}]},"active_addr":"172.21.15.46:6801/2026840811","active_change":"2024-09-21T12:39:28.313897+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14242,"name":"smithi176.rmyfjh","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.46:8443/","prometheus":"http://172.21.15.46:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3100933281}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":3239992248}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":37892782}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.46:0","nonce":4011409884}]}]} 2024-09-21T12:43:36.866 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T12:43:36.866 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T12:43:36.866 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T12:43:37.134 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:37.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:36 smithi046 ceph-mon[27868]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:36 smithi176 ceph-mon[35476]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:37.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/3489291277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8100800 msgr2=0x7fc9d8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/3489291277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8100800 0x7fc9d8100c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009880 tx=0x7fc9c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/3489291277 shutdown_connections 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/3489291277 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8100800 0x7fc9d8100c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/3489291277 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d8106800 0x7fc9d8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/3489291277 >> 172.21.15.46:0/3489291277 conn(0x7fc9d80fc520 msgr2=0x7fc9d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/3489291277 shutdown_connections 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.615+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/3489291277 wait complete. 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9ddeb9640 1 Processor -- start 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9ddeb9640 1 -- start start 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9ddeb9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d8100800 0x7fc9d8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:37.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9ddeb9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 0x7fc9d8198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9ddeb9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d810dd30 con 0x7fc9d8106800 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9ddeb9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9d810dbb0 con 0x7fc9d8100800 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 0x7fc9d8198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 0x7fc9d8198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44822/0 (socket says 172.21.15.46:44822) 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d6ffd640 1 -- 172.21.15.46:0/549378071 learned_addr learned my addr 172.21.15.46:0/549378071 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d77fe640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d8100800 0x7fc9d8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d6ffd640 1 -- 172.21.15.46:0/549378071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d8100800 msgr2=0x7fc9d8198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d6ffd640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d8100800 0x7fc9d8198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.616+0000 7fc9d6ffd640 1 -- 172.21.15.46:0/549378071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9d81993c0 con 0x7fc9d8106800 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.617+0000 7fc9d6ffd640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 0x7fc9d8198dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0031460 tx=0x7fc9c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.617+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9c003f070 con 0x7fc9d8106800 2024-09-21T12:43:37.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.617+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9c0004cf0 con 0x7fc9d8106800 2024-09-21T12:43:37.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.617+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9d8199650 con 0x7fc9d8106800 2024-09-21T12:43:37.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.617+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9c0035030 con 0x7fc9d8106800 2024-09-21T12:43:37.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.617+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9d81a1c00 con 0x7fc9d8106800 2024-09-21T12:43:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.618+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9d8101f40 con 0x7fc9d8106800 2024-09-21T12:43:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.619+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc9c0042070 con 0x7fc9d8106800 2024-09-21T12:43:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.619+0000 7fc9d4ff9640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc9c406e310 0x7fc9c40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.619+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc9c00ae840 con 0x7fc9d8106800 2024-09-21T12:43:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.619+0000 7fc9d77fe640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc9c406e310 0x7fc9c40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:37.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.620+0000 7fc9d77fe640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc9c406e310 0x7fc9c40707d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009890 tx=0x7fc9c8008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.624+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9c007c560 con 0x7fc9d8106800 2024-09-21T12:43:37.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.803+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9d8108d90 con 0x7fc9d8106800 2024-09-21T12:43:37.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.804+0000 7fc9d4ff9640 1 -- 172.21.15.46:0/549378071 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11361 (secure 0 0 0) 0x7fc9c0080210 con 0x7fc9d8106800 2024-09-21T12:43:37.806 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:37.806 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","created":"2024-09-21T12:37:29.103706+0000","modified":"2024-09-21T12:43:25.220166+0000","last_up_change":"2024-09-21T12:43:24.214531+0000","last_in_change":"2024-09-21T12:43:00.824836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T12:42:08.829984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72e260bc-7dd4-4165-91b7-79c05b1bca54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6803","nonce":493901196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6805","nonce":493901196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6809","nonce":493901196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6807","nonce":493901196}]},"public_addr":"172.21.15.46:6803/493901196","cluster_addr":"172.21.15.46:6805/493901196","heartbeat_back_addr":"172.21.15.46:6809/493901196","heartbeat_front_addr":"172.21.15.46:6807/493901196","state":["exists","up"]},{"osd":1,"uuid":"d92ad225-134c-4b1a-9b18-906a96fab115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6811","nonce":3172280334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6813","nonce":3172280334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6817","nonce":3172280334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6815","nonce":3172280334}]},"public_addr":"172.21.15.46:6811/3172280334","cluster_addr":"172.21.15.46:6813/3172280334","heartbeat_back_addr":"172.21.15.46:6817/3172280334","heartbeat_front_addr":"172.21.15.46:6815/3172280334","state":["exists","up"]},{"osd":2,"uuid":"99af3cc6-64df-4851-916e-2a097d183686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6819","nonce":720202274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6821","nonce":720202274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6825","nonce":720202274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6823","nonce":720202274}]},"public_addr":"172.21.15.46:6819/720202274","cluster_addr":"172.21.15.46:6821/720202274","heartbeat_back_addr":"172.21.15.46:6825/720202274","heartbeat_front_addr":"172.21.15.46:6823/720202274","state":["exists","up"]},{"osd":3,"uuid":"f1c05a03-79b8-46d8-8507-6c7d9c04629b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6801","nonce":3674681341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6803","nonce":3674681341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6807","nonce":3674681341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6805","nonce":3674681341}]},"public_addr":"172.21.15.176:6801/3674681341","cluster_addr":"172.21.15.176:6803/3674681341","heartbeat_back_addr":"172.21.15.176:6807/3674681341","heartbeat_front_addr":"172.21.15.176:6805/3674681341","state":["exists","up"]},{"osd":4,"uuid":"891f2ba1-c4c6-4f70-8281-1d23c31de8d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6809","nonce":2392731042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6811","nonce":2392731042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6815","nonce":2392731042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6813","nonce":2392731042}]},"public_addr":"172.21.15.176:6809/2392731042","cluster_addr":"172.21.15.176:6811/2392731042","heartbeat_back_addr":"172.21.15.176:6815/2392731042","heartbeat_front_addr":"172.21.15.176:6813/2392731042","state":["exists","up"]},{"osd":5,"uuid":"0014df04-7f89-498a-9e46-ffafb6de20c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6817","nonce":58490774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6819","nonce":58490774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6823","nonce":58490774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6821","nonce":58490774}]},"public_addr":"172.21.15.176:6817/58490774","cluster_addr":"172.21.15.176:6819/58490774","heartbeat_back_addr":"172.21.15.176:6823/58490774","heartbeat_front_addr":"172.21.15.176:6821/58490774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:41:04.126215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:41:36.414842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:05.486585+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:29.988430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:56.430814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:43:22.479273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/4175095776":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6800/2799026186":"2024-09-22T12:37:59.843813+0000","172.21.15.46:6801/2799026186":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/1961061203":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/2569846456":"2024-09-22T12:37:59.843813+0000","172.21.15.46:6800/2190573753":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/2476197265":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/3333048124":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/2703068580":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/3638928701":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6800/3815949737":"2024-09-22T12:39:28.313737+0000","172.21.15.46:0/2844834476":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6801/2190573753":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/3184981437":"2024-09-22T12:38:32.104639+0000","172.21.15.46:6801/3815949737":"2024-09-22T12:39:28.313737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T12:43:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc9c406e310 msgr2=0x7fc9c40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc9c406e310 0x7fc9c40707d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009890 tx=0x7fc9c8008040 comp rx=0 tx=0).stop 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 msgr2=0x7fc9d8198dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 0x7fc9d8198dc0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0031460 tx=0x7fc9c00048f0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 shutdown_connections 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc9c406e310 0x7fc9c40707d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9d8106800 0x7fc9d8198dc0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 --2- 172.21.15.46:0/549378071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9d8100800 0x7fc9d8198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 >> 172.21.15.46:0/549378071 conn(0x7fc9d80fc520 msgr2=0x7fc9d80fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 shutdown_connections 2024-09-21T12:43:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:37.806+0000 7fc9ddeb9640 1 -- 172.21.15.46:0/549378071 wait complete. 2024-09-21T12:43:38.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:37 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/549378071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:43:38.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:37 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/549378071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:43:38.588 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T12:43:38.588 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T12:43:38.847 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:39.243 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:38 smithi046 ceph-mon[27868]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:38 smithi176 ceph-mon[35476]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 -- 172.21.15.46:0/4147792472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 msgr2=0x7f1d080ffde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/4147792472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d080ffde0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009880 tx=0x7f1cfc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 -- 172.21.15.46:0/4147792472 shutdown_connections 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/4147792472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d080ffde0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/4147792472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 0x7f1d08106ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 -- 172.21.15.46:0/4147792472 >> 172.21.15.46:0/4147792472 conn(0x7f1d080fb870 msgr2=0x7f1d080fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 -- 172.21.15.46:0/4147792472 shutdown_connections 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 -- 172.21.15.46:0/4147792472 wait complete. 2024-09-21T12:43:39.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.325+0000 7f1d0ea58640 1 Processor -- start 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d0ea58640 1 -- start start 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d0ea58640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d0819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d0ea58640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 0x7f1d0819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d0ea58640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810ee00 con 0x7f1d080ff980 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d0ea58640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0810ec80 con 0x7f1d08106900 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d0819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d0819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44842/0 (socket says 172.21.15.46:44842) 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 -- 172.21.15.46:0/292980060 learned_addr learned my addr 172.21.15.46:0/292980060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d077fe640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 0x7f1d0819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 -- 172.21.15.46:0/292980060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 msgr2=0x7f1d0819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 0x7f1d0819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 -- 172.21.15.46:0/292980060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d081977b0 con 0x7f1d080ff980 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d077fe640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 0x7f1d0819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:43:39.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.326+0000 7f1d07fff640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d0819d630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800b420 tx=0x7f1cf800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.327+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf8011630 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.327+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cf8016070 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.327+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d08197aa0 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.327+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cf8010d40 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.327+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d081980b0 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.328+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d08100e00 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.328+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1cf801b460 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.329+0000 7f1d057fa640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1cf006e2b0 0x7f1cf0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.329+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1cf808d680 con 0x7f1d080ff980 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.329+0000 7f1d077fe640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1cf006e2b0 0x7f1cf0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.329+0000 7f1d077fe640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1cf006e2b0 0x7f1cf0070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc031460 tx=0x7f1cfc0095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:39.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.333+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1cf805b320 con 0x7f1d080ff980 2024-09-21T12:43:39.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.508+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d08109e40 con 0x7f1d080ff980 2024-09-21T12:43:39.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.509+0000 7f1d057fa640 1 -- 172.21.15.46:0/292980060 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+11361 (secure 0 0 0) 0x7f1cf805efd0 con 0x7f1d080ff980 2024-09-21T12:43:39.510 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:39.510 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"fsid":"297e1ece-7816-11ef-baf6-efdc52797490","created":"2024-09-21T12:37:29.103706+0000","modified":"2024-09-21T12:43:25.220166+0000","last_up_change":"2024-09-21T12:43:24.214531+0000","last_in_change":"2024-09-21T12:43:00.824836+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T12:42:08.829984+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"72e260bc-7dd4-4165-91b7-79c05b1bca54","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6802","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6803","nonce":493901196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6804","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6805","nonce":493901196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6808","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6809","nonce":493901196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6806","nonce":493901196},{"type":"v1","addr":"172.21.15.46:6807","nonce":493901196}]},"public_addr":"172.21.15.46:6803/493901196","cluster_addr":"172.21.15.46:6805/493901196","heartbeat_back_addr":"172.21.15.46:6809/493901196","heartbeat_front_addr":"172.21.15.46:6807/493901196","state":["exists","up"]},{"osd":1,"uuid":"d92ad225-134c-4b1a-9b18-906a96fab115","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6810","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6811","nonce":3172280334}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6812","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6813","nonce":3172280334}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6816","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6817","nonce":3172280334}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6814","nonce":3172280334},{"type":"v1","addr":"172.21.15.46:6815","nonce":3172280334}]},"public_addr":"172.21.15.46:6811/3172280334","cluster_addr":"172.21.15.46:6813/3172280334","heartbeat_back_addr":"172.21.15.46:6817/3172280334","heartbeat_front_addr":"172.21.15.46:6815/3172280334","state":["exists","up"]},{"osd":2,"uuid":"99af3cc6-64df-4851-916e-2a097d183686","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6818","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6819","nonce":720202274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6820","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6821","nonce":720202274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6824","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6825","nonce":720202274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6822","nonce":720202274},{"type":"v1","addr":"172.21.15.46:6823","nonce":720202274}]},"public_addr":"172.21.15.46:6819/720202274","cluster_addr":"172.21.15.46:6821/720202274","heartbeat_back_addr":"172.21.15.46:6825/720202274","heartbeat_front_addr":"172.21.15.46:6823/720202274","state":["exists","up"]},{"osd":3,"uuid":"f1c05a03-79b8-46d8-8507-6c7d9c04629b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6801","nonce":3674681341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6803","nonce":3674681341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6807","nonce":3674681341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":3674681341},{"type":"v1","addr":"172.21.15.176:6805","nonce":3674681341}]},"public_addr":"172.21.15.176:6801/3674681341","cluster_addr":"172.21.15.176:6803/3674681341","heartbeat_back_addr":"172.21.15.176:6807/3674681341","heartbeat_front_addr":"172.21.15.176:6805/3674681341","state":["exists","up"]},{"osd":4,"uuid":"891f2ba1-c4c6-4f70-8281-1d23c31de8d7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6809","nonce":2392731042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6811","nonce":2392731042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6815","nonce":2392731042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":2392731042},{"type":"v1","addr":"172.21.15.176:6813","nonce":2392731042}]},"public_addr":"172.21.15.176:6809/2392731042","cluster_addr":"172.21.15.176:6811/2392731042","heartbeat_back_addr":"172.21.15.176:6815/2392731042","heartbeat_front_addr":"172.21.15.176:6813/2392731042","state":["exists","up"]},{"osd":5,"uuid":"0014df04-7f89-498a-9e46-ffafb6de20c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6817","nonce":58490774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6819","nonce":58490774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6823","nonce":58490774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":58490774},{"type":"v1","addr":"172.21.15.176:6821","nonce":58490774}]},"public_addr":"172.21.15.176:6817/58490774","cluster_addr":"172.21.15.176:6819/58490774","heartbeat_back_addr":"172.21.15.176:6823/58490774","heartbeat_front_addr":"172.21.15.176:6821/58490774","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:41:04.126215+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:41:36.414842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:05.486585+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:29.988430+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:42:56.430814+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:43:22.479273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.46:0/4175095776":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6800/2799026186":"2024-09-22T12:37:59.843813+0000","172.21.15.46:6801/2799026186":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/1961061203":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/2569846456":"2024-09-22T12:37:59.843813+0000","172.21.15.46:6800/2190573753":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/2476197265":"2024-09-22T12:37:59.843813+0000","172.21.15.46:0/3333048124":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/2703068580":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/3638928701":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6800/3815949737":"2024-09-22T12:39:28.313737+0000","172.21.15.46:0/2844834476":"2024-09-22T12:39:28.313737+0000","172.21.15.46:6801/2190573753":"2024-09-22T12:38:32.104639+0000","172.21.15.46:0/3184981437":"2024-09-22T12:38:32.104639+0000","172.21.15.46:6801/3815949737":"2024-09-22T12:39:28.313737+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T12:43:39.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1cf006e2b0 msgr2=0x7f1cf0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1cf006e2b0 0x7f1cf0070770 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc031460 tx=0x7f1cfc0095f0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 msgr2=0x7f1d0819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d0819d630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1cf800b420 tx=0x7f1cf800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 shutdown_connections 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1cf006e2b0 0x7f1cf0070770 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d08106900 0x7f1d0819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 --2- 172.21.15.46:0/292980060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d080ff980 0x7f1d0819d630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 >> 172.21.15.46:0/292980060 conn(0x7f1d080fb870 msgr2=0x7f1d080fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 shutdown_connections 2024-09-21T12:43:39.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:39.511+0000 7f1d0ea58640 1 -- 172.21.15.46:0/292980060 wait complete. 2024-09-21T12:43:40.250 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:39 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/292980060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:43:40.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T12:43:40.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T12:43:40.252 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T12:43:40.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T12:43:40.253 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T12:43:40.254 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T12:43:40.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:39 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/292980060' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:43:40.588 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:40.592 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:41.252 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:40 smithi046 ceph-mon[27868]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:40 smithi176 ceph-mon[35476]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:41.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 -- 172.21.15.46:0/1700177971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 msgr2=0x7fef80100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 --2- 172.21.15.46:0/1700177971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef80100c60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fef74009880 tx=0x7fef7402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 -- 172.21.15.46:0/1700177971 shutdown_connections 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 --2- 172.21.15.46:0/1700177971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef80100c60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 --2- 172.21.15.46:0/1700177971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef80106800 0x7fef80106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 -- 172.21.15.46:0/1700177971 >> 172.21.15.46:0/1700177971 conn(0x7fef800fc520 msgr2=0x7fef800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 -- 172.21.15.46:0/1700177971 shutdown_connections 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.444+0000 7fef84e4c640 1 -- 172.21.15.46:0/1700177971 wait complete. 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef84e4c640 1 Processor -- start 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef84e4c640 1 -- start start 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef84e4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef8019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef84e4c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef80106800 0x7fef8019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:41.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef84e4c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010dd30 con 0x7fef80100800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef84e4c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010dbb0 con 0x7fef80106800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef8019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef8019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44874/0 (socket says 172.21.15.46:44874) 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7e59c640 1 -- 172.21.15.46:0/643250584 learned_addr learned my addr 172.21.15.46:0/643250584 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7dd9b640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef80106800 0x7fef8019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7e59c640 1 -- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef80106800 msgr2=0x7fef8019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7e59c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef80106800 0x7fef8019dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.445+0000 7fef7e59c640 1 -- 172.21.15.46:0/643250584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef80197850 con 0x7fef80100800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.446+0000 7fef7e59c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef8019d6d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef7000b420 tx=0x7fef7000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.446+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef70011630 con 0x7fef80100800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.446+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef70016070 con 0x7fef80100800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.446+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef80197b40 con 0x7fef80100800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.446+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef70010d40 con 0x7fef80100800 2024-09-21T12:43:41.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.446+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801980d0 con 0x7fef80100800 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.447+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fef801986f0 con 0x7fef80100800 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.447+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fef700243d0 con 0x7fef80100800 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef6f7fe640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fef6806e310 0x7fef680707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fef7008e090 con 0x7fef80100800 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef7dd9b640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fef6806e310 0x7fef680707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef6f7fe640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] conn(0x7fef68074100 0x7fef68076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 --> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef68076bd0 con 0x7fef68074100 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fef7008e530 con 0x7fef80100800 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef7ed9d640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] conn(0x7fef68074100 0x7fef68076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.448+0000 7fef7dd9b640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fef6806e310 0x7fef680707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef74031460 tx=0x7fef74009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.449+0000 7fef7ed9d640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] conn(0x7fef68074100 0x7fef68076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:41.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.450+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== osd.5 v2:172.21.15.176:6816/58490774 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fef68076bd0 con 0x7fef68074100 2024-09-21T12:43:41.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.464+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 --> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fef80062880 con 0x7fef68074100 2024-09-21T12:43:41.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.464+0000 7fef6f7fe640 1 -- 172.21.15.46:0/643250584 <== osd.5 v2:172.21.15.176:6816/58490774 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fef80062880 con 0x7fef68074100 2024-09-21T12:43:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.464+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] conn(0x7fef68074100 msgr2=0x7fef68076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:41.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.464+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] conn(0x7fef68074100 0x7fef68076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fef6806e310 msgr2=0x7fef680707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fef6806e310 0x7fef680707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fef74031460 tx=0x7fef74009560 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 msgr2=0x7fef8019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef8019d6d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef7000b420 tx=0x7fef7000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 shutdown_connections 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:6816/58490774,v1:172.21.15.176:6817/58490774] conn(0x7fef68074100 0x7fef68076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fef6806e310 0x7fef680707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef80106800 0x7fef8019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 --2- 172.21.15.46:0/643250584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef80100800 0x7fef8019d6d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 >> 172.21.15.46:0/643250584 conn(0x7fef800fc520 msgr2=0x7fef8006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 shutdown_connections 2024-09-21T12:43:41.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.465+0000 7fef84e4c640 1 -- 172.21.15.46:0/643250584 wait complete. 2024-09-21T12:43:42.139 INFO:teuthology.orchestra.run.smithi046.stdout:163208757254 2024-09-21T12:43:42.140 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 -- 172.21.15.46:0/2862774793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44106800 msgr2=0x7f0a44106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 --2- 172.21.15.46:0/2862774793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44106800 0x7f0a44106be0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0a34009880 tx=0x7f0a3402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 -- 172.21.15.46:0/2862774793 shutdown_connections 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 --2- 172.21.15.46:0/2862774793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a44100800 0x7f0a44100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 --2- 172.21.15.46:0/2862774793 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44106800 0x7f0a44106be0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 -- 172.21.15.46:0/2862774793 >> 172.21.15.46:0/2862774793 conn(0x7f0a440fc520 msgr2=0x7f0a440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:42.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 -- 172.21.15.46:0/2862774793 shutdown_connections 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.334+0000 7f0a49902640 1 -- 172.21.15.46:0/2862774793 wait complete. 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a49902640 1 Processor -- start 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a49902640 1 -- start start 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a49902640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 0x7f0a441987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a49902640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a44106800 0x7f0a44198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a49902640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4410dcd0 con 0x7f0a44100800 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a49902640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a4410db50 con 0x7f0a44106800 2024-09-21T12:43:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 0x7f0a441987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a42ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 0x7f0a441987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44854/0 (socket says 172.21.15.46:44854) 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a42ffd640 1 -- 172.21.15.46:0/1652103596 learned_addr learned my addr 172.21.15.46:0/1652103596 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.335+0000 7f0a427fc640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a44106800 0x7f0a44198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a42ffd640 1 -- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a44106800 msgr2=0x7f0a44198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a42ffd640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a44106800 0x7f0a44198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a42ffd640 1 -- 172.21.15.46:0/1652103596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a44199320 con 0x7f0a44100800 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a42ffd640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 0x7f0a441987e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a34031460 tx=0x7f0a340045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a3403f070 con 0x7f0a44100800 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a340035f0 con 0x7f0a44100800 2024-09-21T12:43:42.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a441995b0 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a34035030 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.336+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a441a1b60 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.337+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a440628c0 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0a34042070 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a48900640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0a2c06e2b0 0x7f0a2c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f0a340ae740 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a427fc640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0a2c06e2b0 0x7f0a2c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a48900640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] conn(0x7f0a2c0740a0 0x7f0a2c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 --> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a340054e0 con 0x7f0a2c0740a0 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.338+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f0a340b32a0 con 0x7f0a44100800 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.339+0000 7f0a427fc640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0a2c06e2b0 0x7f0a2c070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a4406ad00 tx=0x7f0a3800b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.339+0000 7f0a437fe640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] conn(0x7f0a2c0740a0 0x7f0a2c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.339+0000 7f0a437fe640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] conn(0x7f0a2c0740a0 0x7f0a2c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.340+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== osd.4 v2:172.21.15.176:6808/2392731042 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a340054e0 con 0x7f0a2c0740a0 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 --> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0a44062d10 con 0x7f0a2c0740a0 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a48900640 1 -- 172.21.15.46:0/1652103596 <== osd.4 v2:172.21.15.176:6808/2392731042 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0a44062d10 con 0x7f0a2c0740a0 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] conn(0x7f0a2c0740a0 msgr2=0x7f0a2c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] conn(0x7f0a2c0740a0 0x7f0a2c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0a2c06e2b0 msgr2=0x7f0a2c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0a2c06e2b0 0x7f0a2c070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0a4406ad00 tx=0x7f0a3800b390 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 msgr2=0x7f0a441987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.354+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 0x7f0a441987e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0a34031460 tx=0x7f0a340045e0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 shutdown_connections 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:6808/2392731042,v1:172.21.15.176:6809/2392731042] conn(0x7f0a2c0740a0 0x7f0a2c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0a2c06e2b0 0x7f0a2c070770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a44106800 0x7f0a44198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 --2- 172.21.15.46:0/1652103596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a44100800 0x7f0a441987e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:42.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 >> 172.21.15.46:0/1652103596 conn(0x7f0a440fc520 msgr2=0x7f0a440fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 shutdown_connections 2024-09-21T12:43:42.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:41.355+0000 7f0a49902640 1 -- 172.21.15.46:0/1652103596 wait complete. 2024-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:42.512 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:42.753 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:42 smithi176 ceph-mon[35476]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:42.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:42 smithi046 ceph-mon[27868]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:43.016 INFO:teuthology.orchestra.run.smithi046.stdout:141733920780 2024-09-21T12:43:43.016 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T12:43:43.625 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:43 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:43 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:43.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/1908103030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 msgr2=0x7f8cb4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:43.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/1908103030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb4101d60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009880 tx=0x7f8ca802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/1908103030 shutdown_connections 2024-09-21T12:43:43.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/1908103030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb4101d60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/1908103030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 0x7f8cb4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/1908103030 >> 172.21.15.46:0/1908103030 conn(0x7f8cb40fd600 msgr2=0x7f8cb40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:43.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/1908103030 shutdown_connections 2024-09-21T12:43:43.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.825+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/1908103030 wait complete. 2024-09-21T12:43:43.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb8a7c640 1 Processor -- start 2024-09-21T12:43:43.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb8a7c640 1 -- start start 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb8a7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb8a7c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 0x7f8cb4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb8a7c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb410edd0 con 0x7f8cb4101900 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb8a7c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb410ec50 con 0x7f8cb4107900 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44894/0 (socket says 172.21.15.46:44894) 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb259c640 1 -- 172.21.15.46:0/2643202806 learned_addr learned my addr 172.21.15.46:0/2643202806 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb1d9b640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 0x7f8cb4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb259c640 1 -- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 msgr2=0x7f8cb4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.826+0000 7f8cb259c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 0x7f8cb4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8cb259c640 1 -- 172.21.15.46:0/2643202806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb4074f70 con 0x7f8cb4101900 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8cb1d9b640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 0x7f8cb4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:43:43.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8cb259c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb40744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e970 tx=0x7f8ca400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:43.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ca400cac0 con 0x7f8cb4101900 2024-09-21T12:43:43.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb4075260 con 0x7f8cb4101900 2024-09-21T12:43:43.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ca40054e0 con 0x7f8cb4101900 2024-09-21T12:43:43.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ca4010430 con 0x7f8cb4101900 2024-09-21T12:43:43.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.827+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb41a3e20 con 0x7f8cb4101900 2024-09-21T12:43:43.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.828+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8cb40628c0 con 0x7f8cb4101900 2024-09-21T12:43:43.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.828+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f8ca4004f00 con 0x7f8cb4101900 2024-09-21T12:43:43.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8ca37fe640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8c9c06e2b0 0x7f8c9c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:43.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f8ca408e460 con 0x7f8cb4101900 2024-09-21T12:43:43.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8cb1d9b640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8c9c06e2b0 0x7f8c9c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:43.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8ca37fe640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] conn(0x7f8c9c0740a0 0x7f8c9c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:43.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 --> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c9c076b70 con 0x7f8c9c0740a0 2024-09-21T12:43:43.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8ca4095050 con 0x7f8cb4101900 2024-09-21T12:43:43.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.829+0000 7f8cb2d9d640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] conn(0x7f8c9c0740a0 0x7f8c9c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:43.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.830+0000 7f8cb1d9b640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8c9c06e2b0 0x7f8c9c070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4075f80 tx=0x7f8ca8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:43.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.830+0000 7f8cb2d9d640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] conn(0x7f8c9c0740a0 0x7f8c9c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:43.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.831+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== osd.3 v2:172.21.15.176:6800/3674681341 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c9c076b70 con 0x7f8c9c0740a0 2024-09-21T12:43:43.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.844+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 --> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8cb4062d10 con 0x7f8c9c0740a0 2024-09-21T12:43:43.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.844+0000 7f8ca37fe640 1 -- 172.21.15.46:0/2643202806 <== osd.3 v2:172.21.15.176:6800/3674681341 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8cb4062d10 con 0x7f8c9c0740a0 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] conn(0x7f8c9c0740a0 msgr2=0x7f8c9c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] conn(0x7f8c9c0740a0 0x7f8c9c0764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8c9c06e2b0 msgr2=0x7f8c9c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8c9c06e2b0 0x7f8c9c070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4075f80 tx=0x7f8ca8031400 comp rx=0 tx=0).stop 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 msgr2=0x7f8cb40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb40744f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400e970 tx=0x7f8ca400ed70 comp rx=0 tx=0).stop 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 shutdown_connections 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:6800/3674681341,v1:172.21.15.176:6801/3674681341] conn(0x7f8c9c0740a0 0x7f8c9c0764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f8c9c06e2b0 0x7f8c9c070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cb4107900 0x7f8cb4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 --2- 172.21.15.46:0/2643202806 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cb4101900 0x7f8cb40744f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:43.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 >> 172.21.15.46:0/2643202806 conn(0x7f8cb40fd600 msgr2=0x7f8cb40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:43.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 shutdown_connections 2024-09-21T12:43:43.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:43.845+0000 7f8cb8a7c640 1 -- 172.21.15.46:0/2643202806 wait complete. 2024-09-21T12:43:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 -- 172.21.15.46:0/1161358634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130102b20 msgr2=0x7f7130102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 --2- 172.21.15.46:0/1161358634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130102b20 0x7f7130102f00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f71200098b0 tx=0x7f712002a560 comp rx=0 tx=0).stop 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 -- 172.21.15.46:0/1161358634 shutdown_connections 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 --2- 172.21.15.46:0/1161358634 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7130103440 0x7f713010b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 --2- 172.21.15.46:0/1161358634 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130102b20 0x7f7130102f00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 -- 172.21.15.46:0/1161358634 >> 172.21.15.46:0/1161358634 conn(0x7f71300fc520 msgr2=0x7f71300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 -- 172.21.15.46:0/1161358634 shutdown_connections 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.269+0000 7f7135821640 1 -- 172.21.15.46:0/1161358634 wait complete. 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7135821640 1 Processor -- start 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7135821640 1 -- start start 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7135821640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7130102b20 0x7f713019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7135821640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 0x7f713019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7135821640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f713010ee50 con 0x7f7130103440 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7135821640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f713010ecd0 con 0x7f7130102b20 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7127fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 0x7f713019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7127fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 0x7f713019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44914/0 (socket says 172.21.15.46:44914) 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7127fff640 1 -- 172.21.15.46:0/679341481 learned_addr learned my addr 172.21.15.46:0/679341481 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f712effd640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7130102b20 0x7f713019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7127fff640 1 -- 172.21.15.46:0/679341481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7130102b20 msgr2=0x7f713019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7127fff640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7130102b20 0x7f713019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.270+0000 7f7127fff640 1 -- 172.21.15.46:0/679341481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7130197860 con 0x7f7130103440 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.271+0000 7f7127fff640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 0x7f713019dbe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f711800b420 tx=0x7f711800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.271+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7118011630 con 0x7f7130103440 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.271+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7118016070 con 0x7f7130103440 2024-09-21T12:43:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.271+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7130197b50 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.271+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7118010d40 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.271+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71301980e0 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.272+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f713006aa30 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.272+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f711801b460 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f713481f640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f711c06e2b0 0x7f711c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f711808d5f0 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f712effd640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f711c06e2b0 0x7f711c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f713481f640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] conn(0x7f711c0740a0 0x7f711c0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 --> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f711c076b70 con 0x7f711c0740a0 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f7118094050 con 0x7f7130103440 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f712f7fe640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] conn(0x7f711c0740a0 0x7f711c0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:44.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.273+0000 7f712effd640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f711c06e2b0 0x7f711c070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7120009230 tx=0x7f7120031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:44.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.274+0000 7f712f7fe640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] conn(0x7f711c0740a0 0x7f711c0764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:44.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.274+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== osd.0 v2:172.21.15.46:6802/493901196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f711c076b70 con 0x7f711c0740a0 2024-09-21T12:43:44.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.289+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 --> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7130062880 con 0x7f711c0740a0 2024-09-21T12:43:44.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f713481f640 1 -- 172.21.15.46:0/679341481 <== osd.0 v2:172.21.15.46:6802/493901196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7130062880 con 0x7f711c0740a0 2024-09-21T12:43:44.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] conn(0x7f711c0740a0 msgr2=0x7f711c0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:44.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] conn(0x7f711c0740a0 0x7f711c0764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f711c06e2b0 msgr2=0x7f711c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:44.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f711c06e2b0 0x7f711c070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7120009230 tx=0x7f7120031400 comp rx=0 tx=0).stop 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 msgr2=0x7f713019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 0x7f713019dbe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f711800b420 tx=0x7f711800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 shutdown_connections 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f711c06e2b0 0x7f711c070770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:6802/493901196,v1:172.21.15.46:6803/493901196] conn(0x7f711c0740a0 0x7f711c0764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7130103440 0x7f713019dbe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 --2- 172.21.15.46:0/679341481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7130102b20 0x7f713019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.290+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 >> 172.21.15.46:0/679341481 conn(0x7f71300fc520 msgr2=0x7f7130108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.291+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 shutdown_connections 2024-09-21T12:43:44.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:44.291+0000 7f7135821640 1 -- 172.21.15.46:0/679341481 wait complete. 2024-09-21T12:43:44.567 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:44 smithi176 ceph-mon[35476]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:44.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:44 smithi046 ceph-mon[27868]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:45.039 INFO:teuthology.orchestra.run.smithi046.stdout:38654705698 2024-09-21T12:43:45.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T12:43:45.229 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:45.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 -- 172.21.15.46:0/1568668325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 msgr2=0x7f907c100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 --2- 172.21.15.46:0/1568668325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c100630 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f906c009880 tx=0x7f906c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 -- 172.21.15.46:0/1568668325 shutdown_connections 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 --2- 172.21.15.46:0/1568668325 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f907c100c00 0x7f907c104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 --2- 172.21.15.46:0/1568668325 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c100630 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 -- 172.21.15.46:0/1568668325 >> 172.21.15.46:0/1568668325 conn(0x7f907c0fbc90 msgr2=0x7f907c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 -- 172.21.15.46:0/1568668325 shutdown_connections 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 -- 172.21.15.46:0/1568668325 wait complete. 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.620+0000 7f90815e8640 1 Processor -- start 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f90815e8640 1 -- start start 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f90815e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:45.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f90815e8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f907c100c00 0x7f907c19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f90815e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f907c10cc40 con 0x7f907c100250 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f90815e8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f907c10cac0 con 0x7f907c100c00 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f907affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f907affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44940/0 (socket says 172.21.15.46:44940) 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f907affd640 1 -- 172.21.15.46:0/3329230136 learned_addr learned my addr 172.21.15.46:0/3329230136 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.621+0000 7f907a7fc640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f907c100c00 0x7f907c19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f907affd640 1 -- 172.21.15.46:0/3329230136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f907c100c00 msgr2=0x7f907c19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f907affd640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f907c100c00 0x7f907c19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f907affd640 1 -- 172.21.15.46:0/3329230136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c197810 con 0x7f907c100250 2024-09-21T12:43:45.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f907affd640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c19d690 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f906c031460 tx=0x7f906c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f906c03f070 con 0x7f907c100250 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c197aa0 con 0x7f907c100250 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f906c004b10 con 0x7f907c100250 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f906c035030 con 0x7f907c100250 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.622+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c197fd0 con 0x7f907c100250 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.623+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f907c1985d0 con 0x7f907c100250 2024-09-21T12:43:45.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.623+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f906c042070 con 0x7f907c100250 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f9063fff640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f906406e2b0 0x7f9064070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f906c0ae970 con 0x7f907c100250 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f907a7fc640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f906406e2b0 0x7f9064070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f9063fff640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] conn(0x7f90640740a0 0x7f90640764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 --> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f906c0054e0 con 0x7f90640740a0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f906c0b32a0 con 0x7f907c100250 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.624+0000 7f907b7fe640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] conn(0x7f90640740a0 0x7f90640764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.625+0000 7f907a7fc640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f906406e2b0 0x7f9064070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9070005fd0 tx=0x7f9070005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.625+0000 7f907b7fe640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] conn(0x7f90640740a0 0x7f90640764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.625+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== osd.1 v2:172.21.15.46:6810/3172280334 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f906c0054e0 con 0x7f90640740a0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 --> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f907c062880 con 0x7f90640740a0 2024-09-21T12:43:45.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f9063fff640 1 -- 172.21.15.46:0/3329230136 <== osd.1 v2:172.21.15.46:6810/3172280334 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f907c062880 con 0x7f90640740a0 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] conn(0x7f90640740a0 msgr2=0x7f90640764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] conn(0x7f90640740a0 0x7f90640764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f906406e2b0 msgr2=0x7f9064070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f906406e2b0 0x7f9064070770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9070005fd0 tx=0x7f9070005850 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 msgr2=0x7f907c19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c19d690 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f906c031460 tx=0x7f906c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 shutdown_connections 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6810/3172280334,v1:172.21.15.46:6811/3172280334] conn(0x7f90640740a0 0x7f90640764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f906406e2b0 0x7f9064070770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f907c100c00 0x7f907c19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 --2- 172.21.15.46:0/3329230136 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f907c100250 0x7f907c19d690 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.639+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 >> 172.21.15.46:0/3329230136 conn(0x7f907c0fbc90 msgr2=0x7f907c0fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.640+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 shutdown_connections 2024-09-21T12:43:45.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:45.640+0000 7f90815e8640 1 -- 172.21.15.46:0/3329230136 wait complete. 2024-09-21T12:43:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 -- 172.21.15.46:0/4139598528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 msgr2=0x7fe22c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 --2- 172.21.15.46:0/4139598528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c102e90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe228009880 tx=0x7fe22802a530 comp rx=0 tx=0).stop 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 -- 172.21.15.46:0/4139598528 shutdown_connections 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 --2- 172.21.15.46:0/4139598528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c1033d0 0x7fe22c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 --2- 172.21.15.46:0/4139598528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c102e90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 -- 172.21.15.46:0/4139598528 >> 172.21.15.46:0/4139598528 conn(0x7fe22c0fc550 msgr2=0x7fe22c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 -- 172.21.15.46:0/4139598528 shutdown_connections 2024-09-21T12:43:46.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.091+0000 7fe233dd7640 1 -- 172.21.15.46:0/4139598528 wait complete. 2024-09-21T12:43:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe233dd7640 1 Processor -- start 2024-09-21T12:43:46.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe233dd7640 1 -- start start 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe233dd7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe233dd7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c1033d0 0x7fe22c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe233dd7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c10edc0 con 0x7fe22c102ab0 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe233dd7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c10ec40 con 0x7fe22c1033d0 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231b73640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231b73640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44960/0 (socket says 172.21.15.46:44960) 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231b73640 1 -- 172.21.15.46:0/2519954903 learned_addr learned my addr 172.21.15.46:0/2519954903 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231372640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c1033d0 0x7fe22c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231b73640 1 -- 172.21.15.46:0/2519954903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c1033d0 msgr2=0x7fe22c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231b73640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c1033d0 0x7fe22c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.092+0000 7fe231b73640 1 -- 172.21.15.46:0/2519954903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c101190 con 0x7fe22c102ab0 2024-09-21T12:43:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.093+0000 7fe231b73640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c100710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe228031460 tx=0x7fe2280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.093+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe22803f070 con 0x7fe22c102ab0 2024-09-21T12:43:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.093+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c101420 con 0x7fe22c102ab0 2024-09-21T12:43:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.093+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2280035f0 con 0x7fe22c102ab0 2024-09-21T12:43:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.093+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe228035030 con 0x7fe22c102ab0 2024-09-21T12:43:46.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.093+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c1a3d70 con 0x7fe22c102ab0 2024-09-21T12:43:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.094+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22c06a580 con 0x7fe22c102ab0 2024-09-21T12:43:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.095+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe228042070 con 0x7fe22c102ab0 2024-09-21T12:43:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.095+0000 7fe222ffd640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe21806e2b0 0x7fe218070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.095+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fe2280ae740 con 0x7fe22c102ab0 2024-09-21T12:43:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.095+0000 7fe231372640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe21806e2b0 0x7fe218070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:46.097 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.096+0000 7fe231372640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe21806e2b0 0x7fe218070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe22c1021a0 tx=0x7fe21c00b2e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:46.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.100+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe228080090 con 0x7fe22c102ab0 2024-09-21T12:43:46.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.277+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe22c105f80 con 0x7fe22c102ab0 2024-09-21T12:43:46.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.277+0000 7fe222ffd640 1 -- 172.21.15.46:0/2519954903 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe2280848c0 con 0x7fe22c102ab0 2024-09-21T12:43:46.279 INFO:teuthology.orchestra.run.smithi046.stdout:141733920781 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe21806e2b0 msgr2=0x7fe218070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe21806e2b0 0x7fe218070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe22c1021a0 tx=0x7fe21c00b2e0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 msgr2=0x7fe22c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c100710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe228031460 tx=0x7fe2280045e0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 shutdown_connections 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe21806e2b0 0x7fe218070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe22c1033d0 0x7fe22c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 --2- 172.21.15.46:0/2519954903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe22c102ab0 0x7fe22c100710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 >> 172.21.15.46:0/2519954903 conn(0x7fe22c0fc550 msgr2=0x7fe22c108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.279+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 shutdown_connections 2024-09-21T12:43:46.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:46.280+0000 7fe233dd7640 1 -- 172.21.15.46:0/2519954903 wait complete. 2024-09-21T12:43:46.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:46 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2519954903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T12:43:46.603 INFO:teuthology.orchestra.run.smithi046.stdout:60129542172 2024-09-21T12:43:46.604 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T12:43:46.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:46 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2519954903' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T12:43:47.034 INFO:teuthology.orchestra.run.smithi046.stdout:111669149714 2024-09-21T12:43:47.034 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T12:43:47.622 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:47 smithi046 ceph-mon[27868]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:47.754 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:47 smithi176 ceph-mon[35476]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:47.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 -- 172.21.15.46:0/384852419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c1068b0 msgr2=0x7ffa3c106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 --2- 172.21.15.46:0/384852419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c1068b0 0x7ffa3c106c90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009880 tx=0x7ffa2c02a530 comp rx=0 tx=0).stop 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 -- 172.21.15.46:0/384852419 shutdown_connections 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 --2- 172.21.15.46:0/384852419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 --2- 172.21.15.46:0/384852419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c1068b0 0x7ffa3c106c90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 -- 172.21.15.46:0/384852419 >> 172.21.15.46:0/384852419 conn(0x7ffa3c0fbc90 msgr2=0x7ffa3c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 -- 172.21.15.46:0/384852419 shutdown_connections 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.832+0000 7ffa41aae640 1 -- 172.21.15.46:0/384852419 wait complete. 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa41aae640 1 Processor -- start 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa41aae640 1 -- start start 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa41aae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa41aae640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa3c1068b0 0x7ffa3c1029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:47.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa41aae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c10ddd0 con 0x7ffa3c100fd0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa41aae640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c10dc50 con 0x7ffa3c1068b0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa3b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa3b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c102470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54600/0 (socket says 172.21.15.46:54600) 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.833+0000 7ffa3b7fe640 1 -- 172.21.15.46:0/1169996954 learned_addr learned my addr 172.21.15.46:0/1169996954 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa3affd640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa3c1068b0 0x7ffa3c1029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa3b7fe640 1 -- 172.21.15.46:0/1169996954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa3c1068b0 msgr2=0x7ffa3c1029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa3b7fe640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa3c1068b0 0x7ffa3c1029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa3b7fe640 1 -- 172.21.15.46:0/1169996954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c102ef0 con 0x7ffa3c100fd0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa3b7fe640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c102470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c031460 tx=0x7ffa2c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa2c03f070 con 0x7ffa3c100fd0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa2c004cf0 con 0x7ffa3c100fd0 2024-09-21T12:43:47.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa2c035030 con 0x7ffa3c100fd0 2024-09-21T12:43:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c103180 con 0x7ffa3c100fd0 2024-09-21T12:43:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.834+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c1a3f10 con 0x7ffa3c100fd0 2024-09-21T12:43:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.835+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa3c101430 con 0x7ffa3c100fd0 2024-09-21T12:43:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.836+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ffa2c042070 con 0x7ffa3c100fd0 2024-09-21T12:43:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.836+0000 7ffa38ff9640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ffa2406e310 0x7ffa240707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.836+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7ffa2c0ae810 con 0x7ffa3c100fd0 2024-09-21T12:43:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.836+0000 7ffa3affd640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ffa2406e310 0x7ffa240707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.837+0000 7ffa3affd640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ffa2406e310 0x7ffa240707d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c103f00 tx=0x7ffa30008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:47.841+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa2c07c530 con 0x7ffa3c100fd0 2024-09-21T12:43:48.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.017+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ffa3c101fa0 con 0x7ffa3c100fd0 2024-09-21T12:43:48.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.017+0000 7ffa38ff9640 1 -- 172.21.15.46:0/1169996954 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffa2c0801e0 con 0x7ffa3c100fd0 2024-09-21T12:43:48.019 INFO:teuthology.orchestra.run.smithi046.stdout:163208757255 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ffa2406e310 msgr2=0x7ffa240707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ffa2406e310 0x7ffa240707d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c103f00 tx=0x7ffa30008040 comp rx=0 tx=0).stop 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 msgr2=0x7ffa3c102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c102470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c031460 tx=0x7ffa2c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 shutdown_connections 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ffa2406e310 0x7ffa240707d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:48.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa3c1068b0 0x7ffa3c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 --2- 172.21.15.46:0/1169996954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa3c100fd0 0x7ffa3c102470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 >> 172.21.15.46:0/1169996954 conn(0x7ffa3c0fbc90 msgr2=0x7ffa3c100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 shutdown_connections 2024-09-21T12:43:48.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:48.020+0000 7ffa41aae640 1 -- 172.21.15.46:0/1169996954 wait complete. 2024-09-21T12:43:48.313 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920780 got 141733920781 for osd.4 2024-09-21T12:43:48.314 DEBUG:teuthology.parallel:result is None 2024-09-21T12:43:48.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:48 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1169996954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T12:43:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:48 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1169996954' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T12:43:49.030 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757254 got 163208757255 for osd.5 2024-09-21T12:43:49.030 DEBUG:teuthology.parallel:result is None 2024-09-21T12:43:49.056 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:49.571 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:49 smithi046 ceph-mon[27868]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:49.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 -- 172.21.15.46:0/3821554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c102ac0 msgr2=0x7f1d7c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/3821554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c102ac0 0x7f1d7c102ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c009880 tx=0x7f1d6c02a540 comp rx=0 tx=0).stop 2024-09-21T12:43:49.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 -- 172.21.15.46:0/3821554484 shutdown_connections 2024-09-21T12:43:49.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/3821554484 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/3821554484 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c102ac0 0x7f1d7c102ea0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 -- 172.21.15.46:0/3821554484 >> 172.21.15.46:0/3821554484 conn(0x7f1d7c0fc520 msgr2=0x7f1d7c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:49.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 -- 172.21.15.46:0/3821554484 shutdown_connections 2024-09-21T12:43:49.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 -- 172.21.15.46:0/3821554484 wait complete. 2024-09-21T12:43:49.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.787+0000 7f1d80ef7640 1 Processor -- start 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d80ef7640 1 -- start start 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d80ef7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d7c102ac0 0x7f1d7c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d80ef7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d80ef7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c10edd0 con 0x7f1d7c1033e0 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d80ef7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c10ec50 con 0x7f1d7c102ac0 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d71d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d71d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54654/0 (socket says 172.21.15.46:54654) 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d71d9b640 1 -- 172.21.15.46:0/314118162 learned_addr learned my addr 172.21.15.46:0/314118162 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.788+0000 7f1d7a59c640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d7c102ac0 0x7f1d7c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d71d9b640 1 -- 172.21.15.46:0/314118162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d7c102ac0 msgr2=0x7f1d7c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d71d9b640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d7c102ac0 0x7f1d7c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d71d9b640 1 -- 172.21.15.46:0/314118162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c1011a0 con 0x7f1d7c1033e0 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d71d9b640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c100c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c8f0 tx=0x7f1d6400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d640079b0 con 0x7f1d7c1033e0 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c101490 con 0x7f1d7c1033e0 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d64007b50 con 0x7f1d7c1033e0 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c1a3f00 con 0x7f1d7c1033e0 2024-09-21T12:43:49.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.789+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d64018610 con 0x7f1d7c1033e0 2024-09-21T12:43:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.791+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7c06aa90 con 0x7f1d7c1033e0 2024-09-21T12:43:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.791+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1d64007d00 con 0x7f1d7c1033e0 2024-09-21T12:43:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.791+0000 7f1d73fff640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1d6806e2b0 0x7f1d68070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.791+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f1d6408df40 con 0x7f1d7c1033e0 2024-09-21T12:43:49.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.791+0000 7f1d7a59c640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1d6806e2b0 0x7f1d68070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.792+0000 7f1d7a59c640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1d6806e2b0 0x7f1d68070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c000c00 tx=0x7f1d6c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:49.795 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:49.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.796+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d64014030 con 0x7f1d7c1033e0 2024-09-21T12:43:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:49 smithi176 ceph-mon[35476]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.652+0000 7f75f1fa3640 1 -- 172.21.15.46:0/206400910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec106800 msgr2=0x7f75ec106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.652+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/206400910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec106800 0x7f75ec106be0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f75dc009c20 tx=0x7f75dc02a970 comp rx=0 tx=0).stop 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 -- 172.21.15.46:0/206400910 shutdown_connections 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/206400910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75ec100800 0x7f75ec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/206400910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec106800 0x7f75ec106be0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 -- 172.21.15.46:0/206400910 >> 172.21.15.46:0/206400910 conn(0x7f75ec0fc520 msgr2=0x7f75ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:49.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 -- 172.21.15.46:0/206400910 shutdown_connections 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 -- 172.21.15.46:0/206400910 wait complete. 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.653+0000 7f75f1fa3640 1 Processor -- start 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75f1fa3640 1 -- start start 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75f1fa3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 0x7f75ec0fcd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75f1fa3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75ec106800 0x7f75ec0fd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75f1fa3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10dd30 con 0x7f75ec100800 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75f1fa3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f75ec10dbb0 con 0x7f75ec106800 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 0x7f75ec0fcd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 0x7f75ec0fcd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54626/0 (socket says 172.21.15.46:54626) 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eb7fe640 1 -- 172.21.15.46:0/2891141644 learned_addr learned my addr 172.21.15.46:0/2891141644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eaffd640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75ec106800 0x7f75ec0fd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eb7fe640 1 -- 172.21.15.46:0/2891141644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75ec106800 msgr2=0x7f75ec0fd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eb7fe640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75ec106800 0x7f75ec0fd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.654+0000 7f75eb7fe640 1 -- 172.21.15.46:0/2891141644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ec0fd790 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.655+0000 7f75eb7fe640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 0x7f75ec0fcd10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f75dc005cc0 tx=0x7f75dc02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.655+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75dc047070 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.655+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75dc02f7e0 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.655+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f75dc034070 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.655+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ec0fda20 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.655+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ec1a3e70 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.656+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75ec062880 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.656+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f75dc04a070 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75e8ff9640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f75d406e2b0 0x7f75d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f75dc0aedc0 con 0x7f75ec100800 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75eaffd640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f75d406e2b0 0x7f75d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75e8ff9640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] conn(0x7f75d40740a0 0x7f75d40764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:49.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 --> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75dc02eec0 con 0x7f75d40740a0 2024-09-21T12:43:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f75dc0b44e0 con 0x7f75ec100800 2024-09-21T12:43:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.657+0000 7f75ebfff640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] conn(0x7f75d40740a0 0x7f75d40764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.658+0000 7f75eaffd640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f75d406e2b0 0x7f75d4070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0fe7a0 tx=0x7f75e0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.658+0000 7f75ebfff640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] conn(0x7f75d40740a0 0x7f75d40764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.658+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== osd.2 v2:172.21.15.46:6818/720202274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75dc02eec0 con 0x7f75d40740a0 2024-09-21T12:43:49.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.672+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 --> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75ec062c80 con 0x7f75d40740a0 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.672+0000 7f75e8ff9640 1 -- 172.21.15.46:0/2891141644 <== osd.2 v2:172.21.15.46:6818/720202274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75ec062c80 con 0x7f75d40740a0 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] conn(0x7f75d40740a0 msgr2=0x7f75d40764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] conn(0x7f75d40740a0 0x7f75d40764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f75d406e2b0 msgr2=0x7f75d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f75d406e2b0 0x7f75d4070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0fe7a0 tx=0x7f75e0008040 comp rx=0 tx=0).stop 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 msgr2=0x7f75ec0fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 0x7f75ec0fcd10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f75dc005cc0 tx=0x7f75dc02f5f0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 shutdown_connections 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f75d406e2b0 0x7f75d4070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:6818/720202274,v1:172.21.15.46:6819/720202274] conn(0x7f75d40740a0 0x7f75d40764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75ec106800 0x7f75ec0fd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 --2- 172.21.15.46:0/2891141644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75ec100800 0x7f75ec0fcd10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 >> 172.21.15.46:0/2891141644 conn(0x7f75ec0fc520 msgr2=0x7f75ec06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 shutdown_connections 2024-09-21T12:43:49.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.673+0000 7f75f1fa3640 1 -- 172.21.15.46:0/2891141644 wait complete. 2024-09-21T12:43:49.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.976+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1d7c102ea0 con 0x7f1d7c1033e0 2024-09-21T12:43:49.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.976+0000 7f1d73fff640 1 -- 172.21.15.46:0/314118162 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1d6405bbe0 con 0x7f1d7c1033e0 2024-09-21T12:43:49.978 INFO:teuthology.orchestra.run.smithi046.stdout:111669149715 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1d6806e2b0 msgr2=0x7f1d68070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1d6806e2b0 0x7f1d68070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c000c00 tx=0x7f1d6c031400 comp rx=0 tx=0).stop 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 msgr2=0x7f1d7c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c100c60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400c8f0 tx=0x7f1d6400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 shutdown_connections 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1d6806e2b0 0x7f1d68070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d7c1033e0 0x7f1d7c100c60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 --2- 172.21.15.46:0/314118162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d7c102ac0 0x7f1d7c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 >> 172.21.15.46:0/314118162 conn(0x7f1d7c0fc520 msgr2=0x7f1d7c108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 shutdown_connections 2024-09-21T12:43:49.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:49.978+0000 7f1d80ef7640 1 -- 172.21.15.46:0/314118162 wait complete. 2024-09-21T12:43:50.129 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:50.651 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:50 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/314118162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T12:43:50.682 INFO:teuthology.orchestra.run.smithi046.stdout:81604378647 2024-09-21T12:43:50.683 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T12:43:50.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:50 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/314118162' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T12:43:51.623 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:51 smithi046 ceph-mon[27868]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:51.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149715 for osd.3 2024-09-21T12:43:51.688 DEBUG:teuthology.parallel:result is None 2024-09-21T12:43:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:51 smithi176 ceph-mon[35476]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 -- 172.21.15.46:0/20078512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 msgr2=0x7fa60c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 --2- 172.21.15.46:0/20078512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c100c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009880 tx=0x7fa5fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 -- 172.21.15.46:0/20078512 shutdown_connections 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 --2- 172.21.15.46:0/20078512 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c100c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 --2- 172.21.15.46:0/20078512 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa60c1067f0 0x7fa60c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 -- 172.21.15.46:0/20078512 >> 172.21.15.46:0/20078512 conn(0x7fa60c0fc550 msgr2=0x7fa60c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:51.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 -- 172.21.15.46:0/20078512 shutdown_connections 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.860+0000 7fa613746640 1 -- 172.21.15.46:0/20078512 wait complete. 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa613746640 1 Processor -- start 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa613746640 1 -- start start 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa613746640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa613746640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa60c1067f0 0x7fa60c19db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa613746640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10dcc0 con 0x7fa60c1007f0 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa613746640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10db40 con 0x7fa60c1067f0 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.861+0000 7fa6114e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6114e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54676/0 (socket says 172.21.15.46:54676) 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6114e2640 1 -- 172.21.15.46:0/3663795345 learned_addr learned my addr 172.21.15.46:0/3663795345 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa610ce1640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa60c1067f0 0x7fa60c19db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6114e2640 1 -- 172.21.15.46:0/3663795345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa60c1067f0 msgr2=0x7fa60c19db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6114e2640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa60c1067f0 0x7fa60c19db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:51.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6114e2640 1 -- 172.21.15.46:0/3663795345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c197780 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6114e2640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c19d600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e970 tx=0x7fa60800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa60800cac0 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c197a70 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6080054e0 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa608010430 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.862+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c197fd0 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.863+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c101f30 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.864+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa608004e80 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.864+0000 7fa6027fc640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa5f806e2b0 0x7fa5f8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.865+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fa60808e450 con 0x7fa60c1007f0 2024-09-21T12:43:51.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.865+0000 7fa610ce1640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa5f806e2b0 0x7fa5f8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:51.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.865+0000 7fa610ce1640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa5f806e2b0 0x7fa5f8070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa60c198ad0 tx=0x7fa5fc031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:51.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:51.869+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa60805c0f0 con 0x7fa60c1007f0 2024-09-21T12:43:52.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.049+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa60c1982e0 con 0x7fa60c1007f0 2024-09-21T12:43:52.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.049+0000 7fa6027fc640 1 -- 172.21.15.46:0/3663795345 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa60805fda0 con 0x7fa60c1007f0 2024-09-21T12:43:52.050 INFO:teuthology.orchestra.run.smithi046.stdout:60129542173 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa5f806e2b0 msgr2=0x7fa5f8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa5f806e2b0 0x7fa5f8070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa60c198ad0 tx=0x7fa5fc031400 comp rx=0 tx=0).stop 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 msgr2=0x7fa60c19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c19d600 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa60800e970 tx=0x7fa60800ed70 comp rx=0 tx=0).stop 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 shutdown_connections 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa5f806e2b0 0x7fa5f8070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa60c1067f0 0x7fa60c19db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 --2- 172.21.15.46:0/3663795345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa60c1007f0 0x7fa60c19d600 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 >> 172.21.15.46:0/3663795345 conn(0x7fa60c0fc550 msgr2=0x7fa60c104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:52.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 shutdown_connections 2024-09-21T12:43:52.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.051+0000 7fa613746640 1 -- 172.21.15.46:0/3663795345 wait complete. 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.537+0000 7fc3df5cb640 1 -- 172.21.15.46:0/619654725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8102b70 msgr2=0x7fc3d8102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.537+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/619654725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8102b70 0x7fc3d8102f50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009880 tx=0x7fc3d402a530 comp rx=0 tx=0).stop 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.537+0000 7fc3df5cb640 1 -- 172.21.15.46:0/619654725 shutdown_connections 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/619654725 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8103490 0x7fc3d810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/619654725 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8102b70 0x7fc3d8102f50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 -- 172.21.15.46:0/619654725 >> 172.21.15.46:0/619654725 conn(0x7fc3d80fc550 msgr2=0x7fc3d80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 -- 172.21.15.46:0/619654725 shutdown_connections 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 -- 172.21.15.46:0/619654725 wait complete. 2024-09-21T12:43:52.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 Processor -- start 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.538+0000 7fc3df5cb640 1 -- start start 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3df5cb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8102b70 0x7fc3d81007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3df5cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 0x7fc3d8100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3df5cb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d810edc0 con 0x7fc3d8103490 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3df5cb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d810ec40 con 0x7fc3d8102b70 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 0x7fc3d8100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 0x7fc3d8100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54704/0 (socket says 172.21.15.46:54704) 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 -- 172.21.15.46:0/2814128132 learned_addr learned my addr 172.21.15.46:0/2814128132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dd367640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8102b70 0x7fc3d81007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 -- 172.21.15.46:0/2814128132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8102b70 msgr2=0x7fc3d81007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8102b70 0x7fc3d81007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 -- 172.21.15.46:0/2814128132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d8101250 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dd367640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8102b70 0x7fc3d81007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.539+0000 7fc3dcb66640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 0x7fc3d8100d10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c8a0 tx=0x7fc3c800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.540+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc3c80079b0 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.540+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc3c8007b50 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.540+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc3c8018700 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.540+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d8101540 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.540+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d81a3dd0 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.541+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d806a4c0 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.541+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fc3c8007d00 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.542+0000 7fc3ce7fc640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc3c406e310 0x7fc3c40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.542+0000 7fc3dd367640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc3c406e310 0x7fc3c40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.542+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fc3c808e020 con 0x7fc3d8103490 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.542+0000 7fc3dd367640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc3c406e310 0x7fc3c40707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4006010 tx=0x7fc3d40095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:52.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.546+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3c8014030 con 0x7fc3d8103490 2024-09-21T12:43:52.650 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:52 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3663795345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T12:43:52.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.732+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc3d8102f50 con 0x7fc3d8103490 2024-09-21T12:43:52.734 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.732+0000 7fc3ce7fc640 1 -- 172.21.15.46:0/2814128132 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc3c8057070 con 0x7fc3d8103490 2024-09-21T12:43:52.734 INFO:teuthology.orchestra.run.smithi046.stdout:38654705699 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.734+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc3c406e310 msgr2=0x7fc3c40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.734+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc3c406e310 0x7fc3c40707d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4006010 tx=0x7fc3d40095f0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.734+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 msgr2=0x7fc3d8100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.734+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 0x7fc3d8100d10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc3c800c8a0 tx=0x7fc3c800cd60 comp rx=0 tx=0).stop 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 shutdown_connections 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fc3c406e310 0x7fc3c40707d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3d8103490 0x7fc3d8100d10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 --2- 172.21.15.46:0/2814128132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3d8102b70 0x7fc3d81007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 >> 172.21.15.46:0/2814128132 conn(0x7fc3d80fc550 msgr2=0x7fc3d8108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 shutdown_connections 2024-09-21T12:43:52.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:52.735+0000 7fc3df5cb640 1 -- 172.21.15.46:0/2814128132 wait complete. 2024-09-21T12:43:52.754 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:52 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3663795345' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T12:43:52.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542172 got 60129542173 for osd.1 2024-09-21T12:43:52.973 DEBUG:teuthology.parallel:result is None 2024-09-21T12:43:53.592 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.0 2024-09-21T12:43:53.592 DEBUG:teuthology.parallel:result is None 2024-09-21T12:43:53.660 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:53 smithi046 ceph-mon[27868]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:53 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2814128132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T12:43:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:53 smithi176 ceph-mon[35476]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:53 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2814128132' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T12:43:54.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 -- 172.21.15.46:0/2512708279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520106800 msgr2=0x7fd520106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 --2- 172.21.15.46:0/2512708279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520106800 0x7fd520106be0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd510009880 tx=0x7fd51002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 -- 172.21.15.46:0/2512708279 shutdown_connections 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 --2- 172.21.15.46:0/2512708279 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd520100800 0x7fd520100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 --2- 172.21.15.46:0/2512708279 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520106800 0x7fd520106be0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 -- 172.21.15.46:0/2512708279 >> 172.21.15.46:0/2512708279 conn(0x7fd5200fc520 msgr2=0x7fd5200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 -- 172.21.15.46:0/2512708279 shutdown_connections 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.122+0000 7fd5255f7640 1 -- 172.21.15.46:0/2512708279 wait complete. 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd5255f7640 1 Processor -- start 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd5255f7640 1 -- start start 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd5255f7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 0x7fd52019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd5255f7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd520106800 0x7fd52019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd5255f7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010dcd0 con 0x7fd520100800 2024-09-21T12:43:54.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd5255f7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd52010db50 con 0x7fd520106800 2024-09-21T12:43:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd51effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 0x7fd52019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd51effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 0x7fd52019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54730/0 (socket says 172.21.15.46:54730) 2024-09-21T12:43:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd51effd640 1 -- 172.21.15.46:0/3010434083 learned_addr learned my addr 172.21.15.46:0/3010434083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:54.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.123+0000 7fd517fff640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd520106800 0x7fd52019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51effd640 1 -- 172.21.15.46:0/3010434083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd520106800 msgr2=0x7fd52019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51effd640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd520106800 0x7fd52019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51effd640 1 -- 172.21.15.46:0/3010434083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5201977b0 con 0x7fd520100800 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51effd640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 0x7fd52019d630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd510031460 tx=0x7fd5100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd51003f070 con 0x7fd520100800 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd520197a40 con 0x7fd520100800 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5100035f0 con 0x7fd520100800 2024-09-21T12:43:54.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd510035030 con 0x7fd520100800 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.124+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd520197f70 con 0x7fd520100800 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.125+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd520101f40 con 0x7fd520100800 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.126+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd510042070 con 0x7fd520100800 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.126+0000 7fd51cff9640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd50c06e2b0 0x7fd50c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.126+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fd5100ae7a0 con 0x7fd520100800 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.126+0000 7fd517fff640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd50c06e2b0 0x7fd50c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:54.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.127+0000 7fd517fff640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd50c06e2b0 0x7fd50c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd520104f70 tx=0x7fd50800b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:54.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.130+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd510080090 con 0x7fd520100800 2024-09-21T12:43:54.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.306+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd520109d80 con 0x7fd520100800 2024-09-21T12:43:54.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.306+0000 7fd51cff9640 1 -- 172.21.15.46:0/3010434083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5100848c0 con 0x7fd520100800 2024-09-21T12:43:54.308 INFO:teuthology.orchestra.run.smithi046.stdout:81604378647 2024-09-21T12:43:54.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd50c06e2b0 msgr2=0x7fd50c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd50c06e2b0 0x7fd50c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd520104f70 tx=0x7fd50800b390 comp rx=0 tx=0).stop 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 msgr2=0x7fd52019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 0x7fd52019d630 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd510031460 tx=0x7fd5100045e0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 shutdown_connections 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd50c06e2b0 0x7fd50c070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd520106800 0x7fd52019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 --2- 172.21.15.46:0/3010434083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd520100800 0x7fd52019d630 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 >> 172.21.15.46:0/3010434083 conn(0x7fd5200fc520 msgr2=0x7fd52006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 shutdown_connections 2024-09-21T12:43:54.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:54.308+0000 7fd5255f7640 1 -- 172.21.15.46:0/3010434083 wait complete. 2024-09-21T12:43:54.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:54 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3010434083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T12:43:54.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:54 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3010434083' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T12:43:54.954 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378647 for osd.2 2024-09-21T12:43:54.955 DEBUG:teuthology.parallel:result is None 2024-09-21T12:43:54.955 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T12:43:54.955 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T12:43:55.212 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:55.655 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:55 smithi046 ceph-mon[27868]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:55.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 -- 172.21.15.46:0/3802198102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 msgr2=0x7fed78100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:55.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 --2- 172.21.15.46:0/3802198102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed78100c50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed60009880 tx=0x7fed6002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 -- 172.21.15.46:0/3802198102 shutdown_connections 2024-09-21T12:43:55.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 --2- 172.21.15.46:0/3802198102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed78100c50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 --2- 172.21.15.46:0/3802198102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed781067f0 0x7fed78106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 -- 172.21.15.46:0/3802198102 >> 172.21.15.46:0/3802198102 conn(0x7fed780fc550 msgr2=0x7fed780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:55.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 -- 172.21.15.46:0/3802198102 shutdown_connections 2024-09-21T12:43:55.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.655+0000 7fed7d459640 1 -- 172.21.15.46:0/3802198102 wait complete. 2024-09-21T12:43:55.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed7d459640 1 Processor -- start 2024-09-21T12:43:55.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed7d459640 1 -- start start 2024-09-21T12:43:55.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed7d459640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed781023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:55.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed7d459640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed781067f0 0x7fed78102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed7d459640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fed7810dcc0 con 0x7fed781007f0 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed7d459640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fed7810db40 con 0x7fed781067f0 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed76ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed781023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed76ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed781023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54738/0 (socket says 172.21.15.46:54738) 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.656+0000 7fed76ffd640 1 -- 172.21.15.46:0/1287191541 learned_addr learned my addr 172.21.15.46:0/1287191541 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed6ffff640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed781067f0 0x7fed78102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed76ffd640 1 -- 172.21.15.46:0/1287191541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed781067f0 msgr2=0x7fed78102900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed76ffd640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed781067f0 0x7fed78102900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed76ffd640 1 -- 172.21.15.46:0/1287191541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed78102e40 con 0x7fed781007f0 2024-09-21T12:43:55.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed76ffd640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed781023c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d6f0 tx=0x7fed6800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:55.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed68017070 con 0x7fed781007f0 2024-09-21T12:43:55.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fed6800de00 con 0x7fed781007f0 2024-09-21T12:43:55.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed78103130 con 0x7fed781007f0 2024-09-21T12:43:55.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fed68004bb0 con 0x7fed781007f0 2024-09-21T12:43:55.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.657+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed781a3e00 con 0x7fed781007f0 2024-09-21T12:43:55.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.658+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed78101f30 con 0x7fed781007f0 2024-09-21T12:43:55.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.659+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fed68009a30 con 0x7fed781007f0 2024-09-21T12:43:55.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.659+0000 7fed74ff9640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fed6406e310 0x7fed640707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:55.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.659+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fed6808d9c0 con 0x7fed781007f0 2024-09-21T12:43:55.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.659+0000 7fed6ffff640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fed6406e310 0x7fed640707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:55.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.660+0000 7fed6ffff640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fed6406e310 0x7fed640707d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed78103e50 tx=0x7fed60031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:55.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.664+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed6805b6e0 con 0x7fed781007f0 2024-09-21T12:43:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:55 smithi176 ceph-mon[35476]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:55.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.836+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed78069ca0 con 0x7fed6406e310 2024-09-21T12:43:55.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.837+0000 7fed74ff9640 1 -- 172.21.15.46:0/1287191541 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7fed78069ca0 con 0x7fed6406e310 2024-09-21T12:43:55.838 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T12:43:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fed6406e310 msgr2=0x7fed640707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fed6406e310 0x7fed640707d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fed78103e50 tx=0x7fed60031400 comp rx=0 tx=0).stop 2024-09-21T12:43:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 msgr2=0x7fed781023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed781023c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fed6800d6f0 tx=0x7fed6800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 shutdown_connections 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fed6406e310 0x7fed640707d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed781067f0 0x7fed78102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 --2- 172.21.15.46:0/1287191541 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fed781007f0 0x7fed781023c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 >> 172.21.15.46:0/1287191541 conn(0x7fed780fc550 msgr2=0x7fed78104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 shutdown_connections 2024-09-21T12:43:55.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:55.839+0000 7fed7d459640 1 -- 172.21.15.46:0/1287191541 wait complete. 2024-09-21T12:43:56.493 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2024-09-21T12:43:54.362421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":166016,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":562304896,"statfs":{"total":575970213888,"available":575800213504,"internally_reserved":0,"allocated":3919872,"data_stored":2585772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001966"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T12:43:25.226437+0000","last_change":"2024-09-21T12:42:57.918951+0000","last_active":"2024-09-21T12:43:25.226437+0000","last_peered":"2024-09-21T12:43:25.226437+0000","last_clean":"2024-09-21T12:43:25.226437+0000","last_became_active":"2024-09-21T12:42:57.918523+0000","last_became_peered":"2024-09-21T12:42:57.918523+0000","last_unstale":"2024-09-21T12:43:25.226437+0000","last_undegraded":"2024-09-21T12:43:25.226437+0000","last_fullsized":"2024-09-21T12:43:25.226437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T12:42:08.897077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T12:42:08.897077+0000","last_clean_scrub_stamp":"2024-09-21T12:42:08.897077+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:55:49.686844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757256,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T12:43:56.494 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T12:43:56.754 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:56.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:56 smithi176 ceph-mon[35476]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:43:56.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:56 smithi176 ceph-mon[35476]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:56.875 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:56 smithi046 ceph-mon[27868]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:43:56.875 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:56 smithi046 ceph-mon[27868]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 -- 172.21.15.46:0/850656247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2534102ad0 msgr2=0x7f2534102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 --2- 172.21.15.46:0/850656247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2534102ad0 0x7f2534102eb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2530009880 tx=0x7f253002a530 comp rx=0 tx=0).stop 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 -- 172.21.15.46:0/850656247 shutdown_connections 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 --2- 172.21.15.46:0/850656247 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25341033f0 0x7f253410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 --2- 172.21.15.46:0/850656247 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2534102ad0 0x7f2534102eb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 -- 172.21.15.46:0/850656247 >> 172.21.15.46:0/850656247 conn(0x7f25340fc510 msgr2=0x7f25340fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:57.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 -- 172.21.15.46:0/850656247 shutdown_connections 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 -- 172.21.15.46:0/850656247 wait complete. 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 Processor -- start 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.213+0000 7f253b3fc640 1 -- start start 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f253b3fc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2534102ad0 0x7f253419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f253b3fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 0x7f253419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f253b3fc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f253410ede0 con 0x7f25341033f0 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f253b3fc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f253410ec60 con 0x7f2534102ad0 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 0x7f253419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 0x7f253419db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54762/0 (socket says 172.21.15.46:54762) 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 -- 172.21.15.46:0/2228567641 learned_addr learned my addr 172.21.15.46:0/2228567641 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2539198640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2534102ad0 0x7f253419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 -- 172.21.15.46:0/2228567641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2534102ad0 msgr2=0x7f253419d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2534102ad0 0x7f253419d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 -- 172.21.15.46:0/2228567641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25341977b0 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2539198640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2534102ad0 0x7f253419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f2538997640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 0x7f253419db70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f252400c8f0 tx=0x7f252400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25240079b0 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2524007b50 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2534197aa0 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.214+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2524018610 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.215+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2534198030 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.215+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253406ada0 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.216+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2524007d00 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.216+0000 7f252a7fc640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f252006e310 0x7f25200707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.217+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f252408dfa0 con 0x7f25341033f0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.217+0000 7f2539198640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f252006e310 0x7f25200707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.217+0000 7f2539198640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f252006e310 0x7f25200707d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2530006010 tx=0x7f25300095f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:57.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.221+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2524014030 con 0x7f25341033f0 2024-09-21T12:43:57.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.392+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2534198340 con 0x7f252006e310 2024-09-21T12:43:57.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.393+0000 7f252a7fc640 1 -- 172.21.15.46:0/2228567641 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f2534198340 con 0x7f252006e310 2024-09-21T12:43:57.395 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:57.395 INFO:teuthology.orchestra.run.smithi046.stderr:dumped all 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f252006e310 msgr2=0x7f25200707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f252006e310 0x7f25200707d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2530006010 tx=0x7f25300095f0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 msgr2=0x7f253419db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 0x7f253419db70 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f252400c8f0 tx=0x7f252400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 shutdown_connections 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f252006e310 0x7f25200707d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25341033f0 0x7f253419db70 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 --2- 172.21.15.46:0/2228567641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2534102ad0 0x7f253419d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:57.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.395+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 >> 172.21.15.46:0/2228567641 conn(0x7f25340fc510 msgr2=0x7f253410af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:57.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.396+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 shutdown_connections 2024-09-21T12:43:57.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:57.396+0000 7f253b3fc640 1 -- 172.21.15.46:0/2228567641 wait complete. 2024-09-21T12:43:58.030 INFO:teuthology.orchestra.run.smithi046.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2024-09-21T12:43:56.362721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":166016,"kb_used_data":3828,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":562304896,"statfs":{"total":575970213888,"available":575800213504,"internally_reserved":0,"allocated":3919872,"data_stored":2585772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001897"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":192,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-21T12:43:25.226437+0000","last_change":"2024-09-21T12:42:57.918951+0000","last_active":"2024-09-21T12:43:25.226437+0000","last_peered":"2024-09-21T12:43:25.226437+0000","last_clean":"2024-09-21T12:43:25.226437+0000","last_became_active":"2024-09-21T12:42:57.918523+0000","last_became_peered":"2024-09-21T12:42:57.918523+0000","last_unstale":"2024-09-21T12:43:25.226437+0000","last_undegraded":"2024-09-21T12:43:25.226437+0000","last_fullsized":"2024-09-21T12:43:25.226437+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T12:42:08.897077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T12:42:08.897077+0000","last_clean_scrub_stamp":"2024-09-21T12:42:08.897077+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T23:55:49.686844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":38,"seq":163208757257,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":33,"seq":141733920783,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149716,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378648,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27376,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717776,"statfs":{"total":95995035648,"available":95967002624,"internally_reserved":0,"allocated":356352,"data_stored":135778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":950272,"data_stored":726146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T12:43:58.031 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T12:43:58.031 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T12:43:58.031 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T12:43:58.031 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T12:43:58.288 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:43:58.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:58 smithi046 ceph-mon[27868]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:43:58.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:58 smithi046 ceph-mon[27868]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:58.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 -- 172.21.15.46:0/4162085650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 msgr2=0x7f6dec10dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 --2- 172.21.15.46:0/4162085650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec10dcc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc009880 tx=0x7f6ddc02a490 comp rx=0 tx=0).stop 2024-09-21T12:43:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 -- 172.21.15.46:0/4162085650 shutdown_connections 2024-09-21T12:43:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 --2- 172.21.15.46:0/4162085650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec10dcc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 --2- 172.21.15.46:0/4162085650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dec100650 0x7f6dec100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 -- 172.21.15.46:0/4162085650 >> 172.21.15.46:0/4162085650 conn(0x7f6dec0fc520 msgr2=0x7f6dec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 -- 172.21.15.46:0/4162085650 shutdown_connections 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.742+0000 7f6df3985640 1 -- 172.21.15.46:0/4162085650 wait complete. 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.743+0000 7f6df3985640 1 Processor -- start 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.743+0000 7f6df3985640 1 -- start start 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.743+0000 7f6df3985640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dec100650 0x7f6dec19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.743+0000 7f6df3985640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.743+0000 7f6df3985640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec110f70 con 0x7f6dec101000 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df3985640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6dec110df0 con 0x7f6dec100650 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51112/0 (socket says 172.21.15.46:51112) 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 -- 172.21.15.46:0/510015490 learned_addr learned my addr 172.21.15.46:0/510015490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df1721640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dec100650 0x7f6dec19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:58.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 -- 172.21.15.46:0/510015490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dec100650 msgr2=0x7f6dec19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dec100650 0x7f6dec19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 -- 172.21.15.46:0/510015490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dec1a04b0 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df0f20640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec19fe00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc031460 tx=0x7f6ddc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ddc03f070 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ddc004cf0 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dec199b40 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ddc035030 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.744+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dec19a0a0 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.745+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dec06aa90 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.746+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6ddc042070 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.746+0000 7f6de27fc640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6dd806e2b0 0x7f6dd8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.746+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f6ddc0ae8a0 con 0x7f6dec101000 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.746+0000 7f6df1721640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6dd806e2b0 0x7f6dd8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.747+0000 7f6df1721640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6dd806e2b0 0x7f6dd8070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6de8005e10 tx=0x7f6de8005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:43:58.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.751+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6ddc07c540 con 0x7f6dec101000 2024-09-21T12:43:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:58 smithi176 ceph-mon[35476]: from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:43:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:58 smithi176 ceph-mon[35476]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:43:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:43:58.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.965+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6dec19afb0 con 0x7f6dec101000 2024-09-21T12:43:58.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.965+0000 7f6de27fc640 1 -- 172.21.15.46:0/510015490 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6ddc0801f0 con 0x7f6dec101000 2024-09-21T12:43:58.967 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:43:58.967 INFO:teuthology.orchestra.run.smithi046.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6dd806e2b0 msgr2=0x7f6dd8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6dd806e2b0 0x7f6dd8070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6de8005e10 tx=0x7f6de8005da0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 msgr2=0x7f6dec19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec19fe00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc031460 tx=0x7f6ddc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 shutdown_connections 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f6dd806e2b0 0x7f6dd8070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6dec101000 0x7f6dec19fe00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 --2- 172.21.15.46:0/510015490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6dec100650 0x7f6dec19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.968+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 >> 172.21.15.46:0/510015490 conn(0x7f6dec0fc520 msgr2=0x7f6dec0fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.969+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 shutdown_connections 2024-09-21T12:43:58.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:43:58.969+0000 7f6df3985640 1 -- 172.21.15.46:0/510015490 wait complete. 2024-09-21T12:43:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:43:59 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/510015490' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T12:43:59.736 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T12:43:59.736 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T12:43:59.737 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:43:59.745 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-21T12:43:59.745 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:43:59.766 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:43:59.766 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-21T12:43:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:43:59 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/510015490' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T12:44:00.038 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.491+0000 7fcc4a492640 1 -- 172.21.15.46:0/3047529819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44101a60 msgr2=0x7fcc44101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.491+0000 7fcc4a492640 1 --2- 172.21.15.46:0/3047529819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44101a60 0x7fcc44101ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fcc38009880 tx=0x7fcc3802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.491+0000 7fcc4a492640 1 -- 172.21.15.46:0/3047529819 shutdown_connections 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.491+0000 7fcc4a492640 1 --2- 172.21.15.46:0/3047529819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44101a60 0x7fcc44101ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.491+0000 7fcc4a492640 1 --2- 172.21.15.46:0/3047529819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc44100860 0x7fcc44100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.491+0000 7fcc4a492640 1 -- 172.21.15.46:0/3047529819 >> 172.21.15.46:0/3047529819 conn(0x7fcc440fc010 msgr2=0x7fcc440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:00.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.492+0000 7fcc4a492640 1 -- 172.21.15.46:0/3047529819 shutdown_connections 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.492+0000 7fcc4a492640 1 -- 172.21.15.46:0/3047529819 wait complete. 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.492+0000 7fcc4a492640 1 Processor -- start 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.492+0000 7fcc4a492640 1 -- start start 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc4a492640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 0x7fcc44104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc4a492640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc44101a60 0x7fcc44102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc4a492640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcc44109720 con 0x7fcc44100860 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc4a492640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcc441095a0 con 0x7fcc44101a60 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 0x7fcc44104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 0x7fcc44104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51130/0 (socket says 172.21.15.46:51130) 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 -- 172.21.15.46:0/490513346 learned_addr learned my addr 172.21.15.46:0/490513346 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 -- 172.21.15.46:0/490513346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc44101a60 msgr2=0x7fcc44102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc44101a60 0x7fcc44102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 -- 172.21.15.46:0/490513346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc44103380 con 0x7fcc44100860 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc43fff640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 0x7fcc44104780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400b3d0 tx=0x7fcc3400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:00.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc34015020 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc44103670 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcc34011af0 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcc34010da0 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.493+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc44103c80 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.494+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc44100c60 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.495+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fcc34018020 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.496+0000 7fcc417fa640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fcc2c06e2b0 0x7fcc2c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.496+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7fcc3408d9e0 con 0x7fcc44100860 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.496+0000 7fcc437fe640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fcc2c06e2b0 0x7fcc2c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.496+0000 7fcc437fe640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fcc2c06e2b0 0x7fcc2c070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc380096c0 tx=0x7fcc38000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:00.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.500+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcc3401f020 con 0x7fcc44100860 2024-09-21T12:44:00.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.676+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7fcc4419f6e0 con 0x7fcc44100860 2024-09-21T12:44:00.678 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:00 smithi046 ceph-mon[27868]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:00.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.680+0000 7fcc417fa640 1 -- 172.21.15.46:0/490513346 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v38)=0 v38) ==== 143+0+0 (secure 0 0 0) 0x7fcc3405b680 con 0x7fcc44100860 2024-09-21T12:44:00.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fcc2c06e2b0 msgr2=0x7fcc2c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:00.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fcc2c06e2b0 0x7fcc2c070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcc380096c0 tx=0x7fcc38000bc0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 msgr2=0x7fcc44104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 0x7fcc44104780 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcc3400b3d0 tx=0x7fcc3400b890 comp rx=0 tx=0).stop 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 shutdown_connections 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fcc2c06e2b0 0x7fcc2c070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcc44101a60 0x7fcc44102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 --2- 172.21.15.46:0/490513346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcc44100860 0x7fcc44104780 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 >> 172.21.15.46:0/490513346 conn(0x7fcc440fc010 msgr2=0x7fcc44069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 shutdown_connections 2024-09-21T12:44:00.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:00.682+0000 7fcc4a492640 1 -- 172.21.15.46:0/490513346 wait complete. 2024-09-21T12:44:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:00 smithi176 ceph-mon[35476]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:01.384 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:44:01.396 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-21T12:44:01.396 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:44:01.404 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:01.405 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T12:44:01.663 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:02.002 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:01 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/490513346' entity='client.admin' 2024-09-21T12:44:02.002 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:02.002 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:02.002 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:02.002 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:01 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:02.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:01 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/490513346' entity='client.admin' 2024-09-21T12:44:02.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:02.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:02.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:02.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:01 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:02.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 -- 172.21.15.46:0/2438539165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8101a60 msgr2=0x7f9ee8101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:02.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 --2- 172.21.15.46:0/2438539165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8101a60 0x7f9ee8101ee0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009880 tx=0x7f9ed002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 -- 172.21.15.46:0/2438539165 shutdown_connections 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 --2- 172.21.15.46:0/2438539165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8101a60 0x7f9ee8101ee0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 --2- 172.21.15.46:0/2438539165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee8100860 0x7f9ee8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 -- 172.21.15.46:0/2438539165 >> 172.21.15.46:0/2438539165 conn(0x7f9ee80fc010 msgr2=0x7f9ee80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 -- 172.21.15.46:0/2438539165 shutdown_connections 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 -- 172.21.15.46:0/2438539165 wait complete. 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.084+0000 7f9eece48640 1 Processor -- start 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9eece48640 1 -- start start 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9eece48640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 0x7f9ee8104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9eece48640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee8101a60 0x7f9ee8102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9eece48640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee81096a0 con 0x7f9ee8100860 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9eece48640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee8109520 con 0x7f9ee8101a60 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 0x7f9ee8104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 0x7f9ee8104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51144/0 (socket says 172.21.15.46:51144) 2024-09-21T12:44:02.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 -- 172.21.15.46:0/404191493 learned_addr learned my addr 172.21.15.46:0/404191493 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9eddd9b640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee8101a60 0x7f9ee8102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 -- 172.21.15.46:0/404191493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee8101a60 msgr2=0x7f9ee8102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee8101a60 0x7f9ee8102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 -- 172.21.15.46:0/404191493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee8103380 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.085+0000 7f9ee659c640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 0x7f9ee8104780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c8f0 tx=0x7f9ed800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.086+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ed8004020 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.086+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ed80041c0 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.086+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee8103670 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.086+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ed80047a0 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.086+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee8103bd0 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.087+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee8100c60 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.087+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9ed8004370 con 0x7f9ee8100860 2024-09-21T12:44:02.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.088+0000 7f9edffff640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ed406e2b0 0x7f9ed4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:02.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.088+0000 7f9eddd9b640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ed406e2b0 0x7f9ed4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:02.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.088+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f9ed808dc00 con 0x7f9ee8100860 2024-09-21T12:44:02.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.089+0000 7f9eddd9b640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ed406e2b0 0x7f9ed4070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed00058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:02.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.095+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ed8093020 con 0x7f9ee8100860 2024-09-21T12:44:02.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.287+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f9ee806a910 con 0x7f9ed406e2b0 2024-09-21T12:44:02.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.288+0000 7f9edffff640 1 -- 172.21.15.46:0/404191493 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f9ee806a910 con 0x7f9ed406e2b0 2024-09-21T12:44:02.289 INFO:teuthology.orchestra.run.smithi046.stdout:Backend: cephadm 2024-09-21T12:44:02.290 INFO:teuthology.orchestra.run.smithi046.stdout:Available: Yes 2024-09-21T12:44:02.290 INFO:teuthology.orchestra.run.smithi046.stdout:Paused: No 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ed406e2b0 msgr2=0x7f9ed4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ed406e2b0 0x7f9ed4070770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0000c00 tx=0x7f9ed00058d0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 msgr2=0x7f9ee8104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 0x7f9ee8104780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ed800c8f0 tx=0x7f9ed800cdb0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 shutdown_connections 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9ed406e2b0 0x7f9ed4070770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ee8101a60 0x7f9ee8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 --2- 172.21.15.46:0/404191493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ee8100860 0x7f9ee8104780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:02.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.290+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 >> 172.21.15.46:0/404191493 conn(0x7f9ee80fc010 msgr2=0x7f9ee806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:02.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.291+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 shutdown_connections 2024-09-21T12:44:02.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:02.291+0000 7f9eece48640 1 -- 172.21.15.46:0/404191493 wait complete. 2024-09-21T12:44:02.908 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T12:44:03.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:02 smithi176 ceph-mon[35476]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:03.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:02 smithi176 ceph-mon[35476]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:02 smithi046 ceph-mon[27868]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:02 smithi046 ceph-mon[27868]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:03.162 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.626+0000 7f78b881b640 1 -- 172.21.15.46:0/148699182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 msgr2=0x7f78b4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.626+0000 7f78b881b640 1 --2- 172.21.15.46:0/148699182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4101d60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f78a4009880 tx=0x7f78a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.626+0000 7f78b881b640 1 -- 172.21.15.46:0/148699182 shutdown_connections 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.626+0000 7f78b881b640 1 --2- 172.21.15.46:0/148699182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 0x7f78b4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.626+0000 7f78b881b640 1 --2- 172.21.15.46:0/148699182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4101d60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.626+0000 7f78b881b640 1 -- 172.21.15.46:0/148699182 >> 172.21.15.46:0/148699182 conn(0x7f78b40fd0f0 msgr2=0x7f78b40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.627+0000 7f78b881b640 1 -- 172.21.15.46:0/148699182 shutdown_connections 2024-09-21T12:44:03.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.627+0000 7f78b881b640 1 -- 172.21.15.46:0/148699182 wait complete. 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.627+0000 7f78b881b640 1 Processor -- start 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b881b640 1 -- start start 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b881b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b881b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 0x7f78b40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b881b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f78b410a7a0 con 0x7f78b4101960 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b881b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78b410a620 con 0x7f78b4102b60 2024-09-21T12:44:03.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51160/0 (socket says 172.21.15.46:51160) 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 -- 172.21.15.46:0/1748131673 learned_addr learned my addr 172.21.15.46:0/1748131673 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78a9d9b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 0x7f78b40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 -- 172.21.15.46:0/1748131673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 msgr2=0x7f78b40745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 0x7f78b40745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 -- 172.21.15.46:0/1748131673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b4074b20 con 0x7f78b4101960 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78a9d9b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 0x7f78b40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.628+0000 7f78b259c640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4075f20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78a4006010 tx=0x7f78a40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.629+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78a403f070 con 0x7f78b4101960 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.629+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78b4074db0 con 0x7f78b4101960 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.629+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78a40044d0 con 0x7f78b4101960 2024-09-21T12:44:03.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.629+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78a4035030 con 0x7f78b4101960 2024-09-21T12:44:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.629+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78b40752e0 con 0x7f78b4101960 2024-09-21T12:44:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.630+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78b4101d60 con 0x7f78b4101960 2024-09-21T12:44:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.631+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f78a4042070 con 0x7f78b4101960 2024-09-21T12:44:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.631+0000 7f78abfff640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f78a006e2b0 0x7f78a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:03.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.631+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f78a40aeb80 con 0x7f78b4101960 2024-09-21T12:44:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.631+0000 7f78a9d9b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f78a006e2b0 0x7f78a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:03.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.632+0000 7f78a9d9b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f78a006e2b0 0x7f78a0070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f789c005fd0 tx=0x7f789c005ea0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:03.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.635+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f78a407c780 con 0x7f78b4101960 2024-09-21T12:44:03.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.823+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f78b4062630 con 0x7f78a006e2b0 2024-09-21T12:44:03.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.831+0000 7f78abfff640 1 -- 172.21.15.46:0/1748131673 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7f78b4062630 con 0x7f78a006e2b0 2024-09-21T12:44:03.832 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 118s ago 5m 25.6M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (5m) 118s ago 5m 7680k - 19.1.1-373-g4e45e6b4 164465d2334a f8608c24a9a8 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (4m) 43s ago 4m 9411k - 19.1.1-373-g4e45e6b4 164465d2334a 3c8b950c3981 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 118s ago 5m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (4m) 43s ago 4m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 118s ago 4m 73.1M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:9283,8765,8443 running (6m) 118s ago 6m 489M - 19.1.1-373-g4e45e6b4 164465d2334a a9438678095d 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (4m) 43s ago 4m 440M - 19.1.1-373-g4e45e6b4 164465d2334a 918a325e02f4 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (6m) 118s ago 6m 44.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (4m) 43s ago 4m 42.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 118s ago 5m 14.4M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (4m) 43s ago 4m 15.6M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:44:03.833 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 118s ago 3m 39.5M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 118s ago 2m 37.3M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 118s ago 2m 11.1M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (101s) 43s ago 100s 39.2M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (75s) 43s ago 74s 38.5M 4970M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (49s) 43s ago 48s 11.2M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 118s ago 4m 44.7M - 2.43.0 a07b618ecd1d 965906d87e59 2024-09-21T12:44:03.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f78a006e2b0 msgr2=0x7f78a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f78a006e2b0 0x7f78a0070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f789c005fd0 tx=0x7f789c005ea0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 msgr2=0x7f78b4075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4075f20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f78a4006010 tx=0x7f78a40048f0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 shutdown_connections 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f78a006e2b0 0x7f78a0070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78b4102b60 0x7f78b40745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 --2- 172.21.15.46:0/1748131673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78b4101960 0x7f78b4075f20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 >> 172.21.15.46:0/1748131673 conn(0x7f78b40fd0f0 msgr2=0x7f78b4106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 shutdown_connections 2024-09-21T12:44:03.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:03.833+0000 7f78b881b640 1 -- 172.21.15.46:0/1748131673 wait complete. 2024-09-21T12:44:04.460 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T12:44:04.725 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:04.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:04 smithi176 ceph-mon[35476]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:04.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:04 smithi176 ceph-mon[35476]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:04 smithi046 ceph-mon[27868]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:04.836 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:04 smithi046 ceph-mon[27868]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.164+0000 7f880caef640 1 -- 172.21.15.46:0/2333061933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 msgr2=0x7f8808107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.164+0000 7f880caef640 1 --2- 172.21.15.46:0/2333061933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f8808107110 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87fc0098b0 tx=0x7f87fc02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 -- 172.21.15.46:0/2333061933 shutdown_connections 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 --2- 172.21.15.46:0/2333061933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f8808107110 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 --2- 172.21.15.46:0/2333061933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88081023f0 0x7f88081047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 -- 172.21.15.46:0/2333061933 >> 172.21.15.46:0/2333061933 conn(0x7f88080fc010 msgr2=0x7f88080fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:05.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 -- 172.21.15.46:0/2333061933 shutdown_connections 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 -- 172.21.15.46:0/2333061933 wait complete. 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 Processor -- start 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.165+0000 7f880caef640 1 -- start start 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f880caef640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88081023f0 0x7f8808101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f880caef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f88081003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f880caef640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f880810a810 con 0x7f8808104d20 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f880caef640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f880810a690 con 0x7f88081023f0 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f88081003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f88081003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51188/0 (socket says 172.21.15.46:51188) 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 -- 172.21.15.46:0/2306872860 learned_addr learned my addr 172.21.15.46:0/2306872860 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f880659c640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88081023f0 0x7f8808101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 -- 172.21.15.46:0/2306872860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88081023f0 msgr2=0x7f8808101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:05.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88081023f0 0x7f8808101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 -- 172.21.15.46:0/2306872860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88081008e0 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f8805d9b640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f88081003a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009230 tx=0x7f87fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87fc03f070 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8808100b70 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87fc0044d0 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.166+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87fc035030 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.167+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8808101120 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.167+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88081027d0 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.168+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f87fc042070 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.169+0000 7f87f77fe640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f87f006e2b0 0x7f87f0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.169+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f87fc0ae9d0 con 0x7f8808104d20 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.169+0000 7f880659c640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f87f006e2b0 0x7f87f0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:05.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.169+0000 7f880659c640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f87f006e2b0 0x7f87f0070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009990 tx=0x7f87f8009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:05.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.173+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87fc07c670 con 0x7f8808104d20 2024-09-21T12:44:05.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.356+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f88081057a0 con 0x7f87f006e2b0 2024-09-21T12:44:05.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.361+0000 7f87f77fe640 1 -- 172.21.15.46:0/2306872860 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1300 (secure 0 0 0) 0x7f88081057a0 con 0x7f87f006e2b0 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:crash 2/2 2m ago 5m * 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:mgr 2/2 2m ago 5m count:2 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:mon 2/2 2m ago 5m smithi046:172.21.15.46=smithi046;smithi176:172.21.15.176=smithi176;count:2 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:osd 6 2m ago - 2024-09-21T12:44:05.363 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f87f006e2b0 msgr2=0x7f87f0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f87f006e2b0 0x7f87f0070770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87f8009990 tx=0x7f87f8009110 comp rx=0 tx=0).stop 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 msgr2=0x7f88081003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f88081003a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87fc009230 tx=0x7f87fc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 shutdown_connections 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f87f006e2b0 0x7f87f0070770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8808104d20 0x7f88081003a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 --2- 172.21.15.46:0/2306872860 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88081023f0 0x7f8808101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 >> 172.21.15.46:0/2306872860 conn(0x7f88080fc010 msgr2=0x7f88080fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 shutdown_connections 2024-09-21T12:44:05.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:05.363+0000 7f880caef640 1 -- 172.21.15.46:0/2306872860 wait complete. 2024-09-21T12:44:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:05 smithi046 ceph-mon[27868]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:05 smithi176 ceph-mon[35476]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:05.976 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T12:44:06.235 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:06.631 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:06 smithi046 ceph-mon[27868]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 -- 172.21.15.46:0/3026314290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8102b60 msgr2=0x7f25e8102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3026314290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8102b60 0x7f25e8102fe0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009880 tx=0x7f25d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 -- 172.21.15.46:0/3026314290 shutdown_connections 2024-09-21T12:44:06.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3026314290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8102b60 0x7f25e8102fe0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3026314290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8101960 0x7f25e8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 -- 172.21.15.46:0/3026314290 >> 172.21.15.46:0/3026314290 conn(0x7f25e80fd0f0 msgr2=0x7f25e80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 -- 172.21.15.46:0/3026314290 shutdown_connections 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.714+0000 7f25ef13c640 1 -- 172.21.15.46:0/3026314290 wait complete. 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25ef13c640 1 Processor -- start 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25ef13c640 1 -- start start 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25ef13c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 0x7f25e8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25ef13c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8102b60 0x7f25e80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25ef13c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f25e810a820 con 0x7f25e8101960 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25ef13c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f25e810a6a0 con 0x7f25e8102b60 2024-09-21T12:44:06.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 0x7f25e8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 0x7f25e8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51194/0 (socket says 172.21.15.46:51194) 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 -- 172.21.15.46:0/3966884795 learned_addr learned my addr 172.21.15.46:0/3966884795 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25dffff640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8102b60 0x7f25e80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 -- 172.21.15.46:0/3966884795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8102b60 msgr2=0x7f25e80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8102b60 0x7f25e80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 -- 172.21.15.46:0/3966884795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e8074b20 con 0x7f25e8101960 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25dffff640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8102b60 0x7f25e80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.715+0000 7f25eced8640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 0x7f25e8075f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b3d0 tx=0x7f25e400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.716+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25e4015020 con 0x7f25e8101960 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.716+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e8074e10 con 0x7f25e8101960 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.716+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f25e4011af0 con 0x7f25e8101960 2024-09-21T12:44:06.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.716+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f25e4010da0 con 0x7f25e8101960 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.716+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e8075420 con 0x7f25e8101960 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.717+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e8101d60 con 0x7f25e8101960 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.717+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f25e4018020 con 0x7f25e8101960 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.718+0000 7f25ddffb640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f25d006e2b0 0x7f25d0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.718+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f25e408d970 con 0x7f25e8101960 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.718+0000 7f25dffff640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f25d006e2b0 0x7f25d0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.718+0000 7f25dffff640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f25d006e2b0 0x7f25d0070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25e8075ca0 tx=0x7f25d8005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:06.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.722+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f25e408fe20 con 0x7f25e8101960 2024-09-21T12:44:06.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:06 smithi176 ceph-mon[35476]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:06.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.902+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f25e8062630 con 0x7f25d006e2b0 2024-09-21T12:44:06.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.904+0000 7f25ddffb640 1 -- 172.21.15.46:0/3966884795 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f25e8062630 con 0x7f25d006e2b0 2024-09-21T12:44:06.905 INFO:teuthology.orchestra.run.smithi046.stdout:HOST ADDR LABELS STATUS 2024-09-21T12:44:06.905 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 172.21.15.46 2024-09-21T12:44:06.905 INFO:teuthology.orchestra.run.smithi046.stdout:smithi176 172.21.15.176 2024-09-21T12:44:06.905 INFO:teuthology.orchestra.run.smithi046.stdout:2 hosts in cluster 2024-09-21T12:44:06.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f25d006e2b0 msgr2=0x7f25d0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f25d006e2b0 0x7f25d0070770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f25e8075ca0 tx=0x7f25d8005a20 comp rx=0 tx=0).stop 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 msgr2=0x7f25e8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 0x7f25e8075f20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b3d0 tx=0x7f25e400b890 comp rx=0 tx=0).stop 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 shutdown_connections 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f25d006e2b0 0x7f25d0070770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25e8102b60 0x7f25e80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 --2- 172.21.15.46:0/3966884795 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f25e8101960 0x7f25e8075f20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 >> 172.21.15.46:0/3966884795 conn(0x7f25e80fd0f0 msgr2=0x7f25e8106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 shutdown_connections 2024-09-21T12:44:06.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:06.906+0000 7f25ef13c640 1 -- 172.21.15.46:0/3966884795 wait complete. 2024-09-21T12:44:07.537 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T12:44:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:07 smithi046 ceph-mon[27868]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:07.755 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:07 smithi176 ceph-mon[35476]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:07.799 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3405867815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 msgr2=0x7f52c8104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3405867815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8104880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009880 tx=0x7f52b802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3405867815 shutdown_connections 2024-09-21T12:44:08.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3405867815 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52c8104dc0 0x7f52c81071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3405867815 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8104880 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3405867815 >> 172.21.15.46:0/3405867815 conn(0x7f52c80fc010 msgr2=0x7f52c80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3405867815 shutdown_connections 2024-09-21T12:44:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.247+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3405867815 wait complete. 2024-09-21T12:44:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.248+0000 7f52ce2c8640 1 Processor -- start 2024-09-21T12:44:08.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.248+0000 7f52ce2c8640 1 -- start start 2024-09-21T12:44:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.248+0000 7f52ce2c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.248+0000 7f52ce2c8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52c8104dc0 0x7f52c8197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.248+0000 7f52ce2c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52c810a820 con 0x7f52c8102490 2024-09-21T12:44:08.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.248+0000 7f52ce2c8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52c810a6a0 con 0x7f52c8104dc0 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44828/0 (socket says 172.21.15.46:44828) 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 -- 172.21.15.46:0/3092275222 learned_addr learned my addr 172.21.15.46:0/3092275222 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52bffff640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52c8104dc0 0x7f52c8197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 -- 172.21.15.46:0/3092275222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52c8104dc0 msgr2=0x7f52c8197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52c8104dc0 0x7f52c8197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 -- 172.21.15.46:0/3092275222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c8198130 con 0x7f52c8102490 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c7fff640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8197570 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52b8006010 tx=0x7f52b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52b803f070 con 0x7f52c8102490 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c819cb10 con 0x7f52c8102490 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52b80044d0 con 0x7f52c8102490 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52b8035030 con 0x7f52c8102490 2024-09-21T12:44:08.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.249+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c819d0a0 con 0x7f52c8102490 2024-09-21T12:44:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.251+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c8102870 con 0x7f52c8102490 2024-09-21T12:44:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.251+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f52b8042070 con 0x7f52c8102490 2024-09-21T12:44:08.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.251+0000 7f52c5ffb640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f52b406e2b0 0x7f52b4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:08.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.252+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f52b80aeb30 con 0x7f52c8102490 2024-09-21T12:44:08.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.252+0000 7f52bffff640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f52b406e2b0 0x7f52b4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:08.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.252+0000 7f52bffff640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f52b406e2b0 0x7f52b4070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52c8198a20 tx=0x7f52b0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:08.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.256+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52b807c7d0 con 0x7f52c8102490 2024-09-21T12:44:08.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.438+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f52c8105740 con 0x7f52b406e2b0 2024-09-21T12:44:08.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.439+0000 7f52c5ffb640 1 -- 172.21.15.46:0/3092275222 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f52c8105740 con 0x7f52b406e2b0 2024-09-21T12:44:08.441 INFO:teuthology.orchestra.run.smithi046.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T12:44:08.441 INFO:teuthology.orchestra.run.smithi046.stdout:smithi046 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7512009A480DGN 447G No 119s ago Has a FileSystem, LVM detected 2024-09-21T12:44:08.441 INFO:teuthology.orchestra.run.smithi046.stdout:smithi176 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330099400BGN 372G No 45s ago Has a FileSystem, LVM detected 2024-09-21T12:44:08.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f52b406e2b0 msgr2=0x7f52b4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f52b406e2b0 0x7f52b4070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52c8198a20 tx=0x7f52b0008040 comp rx=0 tx=0).stop 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 msgr2=0x7f52c8197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8197570 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f52b8006010 tx=0x7f52b80048f0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 shutdown_connections 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f52b406e2b0 0x7f52b4070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52c8104dc0 0x7f52c8197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 --2- 172.21.15.46:0/3092275222 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52c8102490 0x7f52c8197570 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 >> 172.21.15.46:0/3092275222 conn(0x7f52c80fc010 msgr2=0x7f52c80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 shutdown_connections 2024-09-21T12:44:08.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:08.441+0000 7f52ce2c8640 1 -- 172.21.15.46:0/3092275222 wait complete. 2024-09-21T12:44:08.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:08 smithi046 ceph-mon[27868]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:08.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:08 smithi176 ceph-mon[35476]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:09.329 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:44:09.339 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:09.339 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-21T12:44:09.602 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:09.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:09 smithi046 ceph-mon[27868]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:09 smithi176 ceph-mon[35476]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 -- 172.21.15.46:0/1037883731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c102b60 msgr2=0x7f965c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 --2- 172.21.15.46:0/1037883731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c102b60 0x7f965c102fe0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9650009880 tx=0x7f965002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 -- 172.21.15.46:0/1037883731 shutdown_connections 2024-09-21T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 --2- 172.21.15.46:0/1037883731 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c102b60 0x7f965c102fe0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 --2- 172.21.15.46:0/1037883731 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f965c101960 0x7f965c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:10.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 -- 172.21.15.46:0/1037883731 >> 172.21.15.46:0/1037883731 conn(0x7f965c0fd0f0 msgr2=0x7f965c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 -- 172.21.15.46:0/1037883731 shutdown_connections 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.092+0000 7f9661acf640 1 -- 172.21.15.46:0/1037883731 wait complete. 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f9661acf640 1 Processor -- start 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f9661acf640 1 -- start start 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f9661acf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 0x7f965c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f9661acf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f965c102b60 0x7f965c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f9661acf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f965c10a780 con 0x7f965c101960 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f9661acf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f965c10a600 con 0x7f965c102b60 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f965b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 0x7f965c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f965b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 0x7f965c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44844/0 (socket says 172.21.15.46:44844) 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.093+0000 7f965b7fe640 1 -- 172.21.15.46:0/874423081 learned_addr learned my addr 172.21.15.46:0/874423081 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f965affd640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f965c102b60 0x7f965c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f965b7fe640 1 -- 172.21.15.46:0/874423081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f965c102b60 msgr2=0x7f965c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f965b7fe640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f965c102b60 0x7f965c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:10.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f965b7fe640 1 -- 172.21.15.46:0/874423081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c198060 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f965b7fe640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 0x7f965c1974a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f964c00c8f0 tx=0x7f964c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f964c0079b0 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f964c007b50 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f965c19caa0 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f964c018610 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.094+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f965c19d030 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.095+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f965c101d60 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.096+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f964c007d00 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.096+0000 7f9658ff9640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f964406e2b0 0x7f9644070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.097+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4638+0+0 (secure 0 0 0) 0x7f964c08e1c0 con 0x7f965c101960 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.097+0000 7f965affd640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f964406e2b0 0x7f9644070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.097+0000 7f965affd640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f964406e2b0 0x7f9644070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f965c198950 tx=0x7f9650005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:10.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.101+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f964c014030 con 0x7f965c101960 2024-09-21T12:44:10.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:10.302+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7f965c0626f0 con 0x7f964406e2b0 2024-09-21T12:44:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:11 smithi176 ceph-mon[35476]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:11 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T12:44:11.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:11 smithi176 ceph-mon[35476]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:11 smithi046 ceph-mon[27868]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:11 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T12:44:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:11 smithi046 ceph-mon[27868]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:11.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.819+0000 7f9658ff9640 1 -- 172.21.15.46:0/874423081 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f965c0626f0 con 0x7f964406e2b0 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f964406e2b0 msgr2=0x7f9644070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f964406e2b0 0x7f9644070770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f965c198950 tx=0x7f9650005a20 comp rx=0 tx=0).stop 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 msgr2=0x7f965c1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 0x7f965c1974a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f964c00c8f0 tx=0x7f964c00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 shutdown_connections 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f964406e2b0 0x7f9644070770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f965c102b60 0x7f965c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.822+0000 7f9661acf640 1 --2- 172.21.15.46:0/874423081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f965c101960 0x7f965c1974a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:11.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.823+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 >> 172.21.15.46:0/874423081 conn(0x7f965c0fd0f0 msgr2=0x7f965c106040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:11.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.823+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 shutdown_connections 2024-09-21T12:44:11.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:11.823+0000 7f9661acf640 1 -- 172.21.15.46:0/874423081 wait complete. 2024-09-21T12:44:12.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:11 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[27864]: 2024-09-21T12:44:11.798+0000 7f01ac6b2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:44:12.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T12:44:12.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T12:44:12.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:44:12.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T12:44:12.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T12:44:12.511 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: fsmap cephfs:0 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.ffxnex", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.ffxnex", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:12.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:12 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:12.539 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T12:44:12.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: fsmap cephfs:0 2024-09-21T12:44:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.ffxnex", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.ffxnex", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:12 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:13 smithi176 ceph-mon[35476]: Saving service mds.cephfs spec with placement count:4 2024-09-21T12:44:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:13 smithi176 ceph-mon[35476]: Deploying daemon mds.cephfs.smithi046.ffxnex on smithi046 2024-09-21T12:44:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:13 smithi176 ceph-mon[35476]: pgmap v172: 65 pgs: 12 creating+peering, 13 active+clean, 40 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:13 smithi176 ceph-mon[35476]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T12:44:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:13 smithi046 ceph-mon[27868]: Saving service mds.cephfs spec with placement count:4 2024-09-21T12:44:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:13 smithi046 ceph-mon[27868]: Deploying daemon mds.cephfs.smithi046.ffxnex on smithi046 2024-09-21T12:44:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:13 smithi046 ceph-mon[27868]: pgmap v172: 65 pgs: 12 creating+peering, 13 active+clean, 40 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:13 smithi046 ceph-mon[27868]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T12:44:13.749 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 -- 172.21.15.46:0/4241725594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 msgr2=0x7fe8dc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:14.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 --2- 172.21.15.46:0/4241725594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc101d60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009c20 tx=0x7fe8cc02a970 comp rx=0 tx=0).stop 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 -- 172.21.15.46:0/4241725594 shutdown_connections 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 --2- 172.21.15.46:0/4241725594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc102b60 0x7fe8dc102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 --2- 172.21.15.46:0/4241725594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc101d60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 -- 172.21.15.46:0/4241725594 >> 172.21.15.46:0/4241725594 conn(0x7fe8dc0fd0f0 msgr2=0x7fe8dc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 -- 172.21.15.46:0/4241725594 shutdown_connections 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.427+0000 7fe8e412b640 1 -- 172.21.15.46:0/4241725594 wait complete. 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e412b640 1 Processor -- start 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e412b640 1 -- start start 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e412b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc197590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e412b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc102b60 0x7fe8dc197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e412b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc10a800 con 0x7fe8dc101960 2024-09-21T12:44:14.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e412b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe8dc10a680 con 0x7fe8dc102b60 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc197590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc197590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44856/0 (socket says 172.21.15.46:44856) 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 -- 172.21.15.46:0/155576872 learned_addr learned my addr 172.21.15.46:0/155576872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 -- 172.21.15.46:0/155576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc102b60 msgr2=0x7fe8dc197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc102b60 0x7fe8dc197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 -- 172.21.15.46:0/155576872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8dc198150 con 0x7fe8dc101960 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.428+0000 7fe8e1ec7640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc197590 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006010 tx=0x7fe8cc02f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.429+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8cc047070 con 0x7fe8dc101960 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.429+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe8cc003e30 con 0x7fe8dc101960 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.429+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe8cc034070 con 0x7fe8dc101960 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.429+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8dc19cb30 con 0x7fe8dc101960 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.429+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8dc19d140 con 0x7fe8dc101960 2024-09-21T12:44:14.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.430+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8dc101de0 con 0x7fe8dc101960 2024-09-21T12:44:14.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.430+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fe8cc04a070 con 0x7fe8dc101960 2024-09-21T12:44:14.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.431+0000 7fe8daffd640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe8c406e310 0x7fe8c40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:14.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.431+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fe8cc0aef50 con 0x7fe8dc101960 2024-09-21T12:44:14.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.431+0000 7fe8e16c6640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe8c406e310 0x7fe8c40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:14.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.431+0000 7fe8e16c6640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe8c406e310 0x7fe8c40707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc198a40 tx=0x7fe8d0006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:14.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.435+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8cc03f070 con 0x7fe8dc101960 2024-09-21T12:44:14.610 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:14.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:14 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:14.611 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:14 smithi046 ceph-mon[27868]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T12:44:14.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.667+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fe8dc062df0 con 0x7fe8dc101960 2024-09-21T12:44:14.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.668+0000 7fe8daffd640 1 -- 172.21.15.46:0/155576872 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7fe8cc076e20 con 0x7fe8dc101960 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:e2 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:11:798672+0000 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 2 2024-09-21T12:44:14.670 INFO:teuthology.orchestra.run.smithi046.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:11.798473+0000 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 1 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:in 2024-09-21T12:44:14.671 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data disabled 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 0 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:14.672 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 2 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe8c406e310 msgr2=0x7fe8c40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe8c406e310 0x7fe8c40707d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc198a40 tx=0x7fe8d0006c90 comp rx=0 tx=0).stop 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 msgr2=0x7fe8dc197590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc197590 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc006010 tx=0x7fe8cc02f730 comp rx=0 tx=0).stop 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 shutdown_connections 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fe8c406e310 0x7fe8c40707d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:14.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8dc102b60 0x7fe8dc197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:14.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 --2- 172.21.15.46:0/155576872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe8dc101960 0x7fe8dc197590 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:14.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 >> 172.21.15.46:0/155576872 conn(0x7fe8dc0fd0f0 msgr2=0x7fe8dc106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:14.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 shutdown_connections 2024-09-21T12:44:14.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:14.670+0000 7fe8e412b640 1 -- 172.21.15.46:0/155576872 wait complete. 2024-09-21T12:44:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:14 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:14 smithi176 ceph-mon[35476]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T12:44:15.361 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:44:15.376 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:15.376 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-21T12:44:15.654 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:15.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:15 smithi046 ceph-mon[27868]: pgmap v175: 65 pgs: 1 creating+activating, 12 creating+peering, 39 active+clean, 13 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:15 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/155576872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:44:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:15 smithi176 ceph-mon[35476]: pgmap v175: 65 pgs: 1 creating+activating, 12 creating+peering, 39 active+clean, 13 unknown; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:15 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/155576872' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:44:16.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 -- 172.21.15.46:0/1410450042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34100860 msgr2=0x7fab34100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:16.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 --2- 172.21.15.46:0/1410450042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34100860 0x7fab34100c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fab24009880 tx=0x7fab2402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 -- 172.21.15.46:0/1410450042 shutdown_connections 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 --2- 172.21.15.46:0/1410450042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab34101a60 0x7fab34101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 --2- 172.21.15.46:0/1410450042 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34100860 0x7fab34100c60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 -- 172.21.15.46:0/1410450042 >> 172.21.15.46:0/1410450042 conn(0x7fab340fc010 msgr2=0x7fab340fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 -- 172.21.15.46:0/1410450042 shutdown_connections 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.123+0000 7fab39be8640 1 -- 172.21.15.46:0/1410450042 wait complete. 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab39be8640 1 Processor -- start 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab39be8640 1 -- start start 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab39be8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab34100860 0x7fab341974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab39be8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 0x7fab34197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab39be8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fab34109680 con 0x7fab34101a60 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab39be8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fab34109500 con 0x7fab34100860 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab32ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 0x7fab34197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:16.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab32ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 0x7fab34197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44892/0 (socket says 172.21.15.46:44892) 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab32ffd640 1 -- 172.21.15.46:0/2488057765 learned_addr learned my addr 172.21.15.46:0/2488057765 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.124+0000 7fab337fe640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab34100860 0x7fab341974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab32ffd640 1 -- 172.21.15.46:0/2488057765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab34100860 msgr2=0x7fab341974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab32ffd640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab34100860 0x7fab341974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab32ffd640 1 -- 172.21.15.46:0/2488057765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab341980b0 con 0x7fab34101a60 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab32ffd640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 0x7fab34197a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab2800d8d0 tx=0x7fab2800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:16.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab28017070 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3419caf0 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab28010460 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab2800f5f0 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.125+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3419d080 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.126+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab34100c60 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.127+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fab28009a30 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.127+0000 7fab30ff9640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fab1c06e2b0 0x7fab1c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.127+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7fab2808e040 con 0x7fab34101a60 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.128+0000 7fab337fe640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fab1c06e2b0 0x7fab1c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:16.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.128+0000 7fab337fe640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fab1c06e2b0 0x7fab1c070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab24000c00 tx=0x7fab24005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:16.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.132+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fab2805b9a0 con 0x7fab34101a60 2024-09-21T12:44:16.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.345+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) -- 0x7fab3419d520 con 0x7fab34101a60 2024-09-21T12:44:16.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.371+0000 7fab30ff9640 1 -- 172.21.15.46:0/2488057765 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v3) ==== 105+0+0 (secure 0 0 0) 0x7fab2805f650 con 0x7fab34101a60 2024-09-21T12:44:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.373+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fab1c06e2b0 msgr2=0x7fab1c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:16.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.373+0000 7fab39be8640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fab1c06e2b0 0x7fab1c070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fab24000c00 tx=0x7fab24005a20 comp rx=0 tx=0).stop 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.373+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 msgr2=0x7fab34197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.373+0000 7fab39be8640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 0x7fab34197a30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fab2800d8d0 tx=0x7fab2800dd90 comp rx=0 tx=0).stop 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 shutdown_connections 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fab1c06e2b0 0x7fab1c070770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab34101a60 0x7fab34197a30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 --2- 172.21.15.46:0/2488057765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab34100860 0x7fab341974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 >> 172.21.15.46:0/2488057765 conn(0x7fab340fc010 msgr2=0x7fab3406a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:16.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 shutdown_connections 2024-09-21T12:44:16.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:16.374+0000 7fab39be8640 1 -- 172.21.15.46:0/2488057765 wait complete. 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.kzzdid", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.kzzdid", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: Deploying daemon mds.cephfs.smithi176.kzzdid on smithi176 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2488057765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: pgmap v176: 65 pgs: 1 creating+activating, 12 creating+peering, 52 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2488057765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6826/1184759627,v1:172.21.15.46:6827/1184759627] up:boot 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: daemon mds.cephfs.smithi046.ffxnex assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: fsmap cephfs:0 1 up:standby 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: fsmap cephfs:1 {0=cephfs.smithi046.ffxnex=up:creating} 2024-09-21T12:44:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:16 smithi046 ceph-mon[27868]: daemon mds.cephfs.smithi046.ffxnex is now active in filesystem cephfs as rank 0 2024-09-21T12:44:16.995 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:44:17.007 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:17.007 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-21T12:44:17.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.kzzdid", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.kzzdid", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: Deploying daemon mds.cephfs.smithi176.kzzdid on smithi176 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2488057765' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: pgmap v176: 65 pgs: 1 creating+activating, 12 creating+peering, 52 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2488057765' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6826/1184759627,v1:172.21.15.46:6827/1184759627] up:boot 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: daemon mds.cephfs.smithi046.ffxnex assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T12:44:17.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:44:17.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: fsmap cephfs:0 1 up:standby 2024-09-21T12:44:17.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:44:17.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: fsmap cephfs:1 {0=cephfs.smithi046.ffxnex=up:creating} 2024-09-21T12:44:17.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:16 smithi176 ceph-mon[35476]: daemon mds.cephfs.smithi046.ffxnex is now active in filesystem cephfs as rank 0 2024-09-21T12:44:17.267 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 -- 172.21.15.46:0/1891702751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 msgr2=0x7f9e94101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 --2- 172.21.15.46:0/1891702751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94101d60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009880 tx=0x7f9e9002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 -- 172.21.15.46:0/1891702751 shutdown_connections 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 --2- 172.21.15.46:0/1891702751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94102b60 0x7f9e94102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 --2- 172.21.15.46:0/1891702751 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94101d60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 -- 172.21.15.46:0/1891702751 >> 172.21.15.46:0/1891702751 conn(0x7f9e940fd0f0 msgr2=0x7f9e940ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:17.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 -- 172.21.15.46:0/1891702751 shutdown_connections 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.745+0000 7f9e9b484640 1 -- 172.21.15.46:0/1891702751 wait complete. 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e9b484640 1 Processor -- start 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e9b484640 1 -- start start 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e9b484640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e9b484640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94102b60 0x7f9e941979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e9b484640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9410a780 con 0x7f9e94101960 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e9b484640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e9410a600 con 0x7f9e94102b60 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e99220640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e99220640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35266/0 (socket says 172.21.15.46:35266) 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.746+0000 7f9e99220640 1 -- 172.21.15.46:0/762200300 learned_addr learned my addr 172.21.15.46:0/762200300 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e98a1f640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94102b60 0x7f9e941979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e99220640 1 -- 172.21.15.46:0/762200300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94102b60 msgr2=0x7f9e941979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e99220640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94102b60 0x7f9e941979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e99220640 1 -- 172.21.15.46:0/762200300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94197fc0 con 0x7f9e94101960 2024-09-21T12:44:17.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e99220640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94197490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e90006010 tx=0x7f9e900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e9003f070 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e900044d0 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e9419c9d0 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e90035030 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.747+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e9419ced0 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.748+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9410af60 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.749+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f9e90042070 con 0x7f9e94101960 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.749+0000 7f9e8a7fc640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9e8006e2b0 0x7f9e80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:17.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.749+0000 7f9e98a1f640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9e8006e2b0 0x7f9e80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.749+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f9e900aedf0 con 0x7f9e94101960 2024-09-21T12:44:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.750+0000 7f9e98a1f640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9e8006e2b0 0x7f9e80070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005e10 tx=0x7f9e84005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:17.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.754+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e9007c750 con 0x7f9e94101960 2024-09-21T12:44:17.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:17.967+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f9e94101d60 con 0x7f9e94101960 2024-09-21T12:44:18.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.377+0000 7f9e8a7fc640 1 -- 172.21.15.46:0/762200300 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v6) ==== 121+0+0 (secure 0 0 0) 0x7f9e90080400 con 0x7f9e94101960 2024-09-21T12:44:18.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9e8006e2b0 msgr2=0x7f9e80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:18.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9e8006e2b0 0x7f9e80070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e84005e10 tx=0x7f9e84005da0 comp rx=0 tx=0).stop 2024-09-21T12:44:18.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 msgr2=0x7f9e94197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:18.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94197490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f9e90006010 tx=0x7f9e900048f0 comp rx=0 tx=0).stop 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 shutdown_connections 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f9e8006e2b0 0x7f9e80070770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e94102b60 0x7f9e941979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 --2- 172.21.15.46:0/762200300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e94101960 0x7f9e94197490 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 >> 172.21.15.46:0/762200300 conn(0x7f9e940fd0f0 msgr2=0x7f9e94105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 shutdown_connections 2024-09-21T12:44:18.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:18.380+0000 7f9e9b484640 1 -- 172.21.15.46:0/762200300 wait complete. 2024-09-21T12:44:18.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6826/1184759627,v1:172.21.15.46:6827/1184759627] up:active 2024-09-21T12:44:18.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: fsmap cephfs:1 {0=cephfs.smithi046.ffxnex=up:active} 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/762200300' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hxdqyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hxdqyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:18.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:18 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:18.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6826/1184759627,v1:172.21.15.46:6827/1184759627] up:active 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: fsmap cephfs:1 {0=cephfs.smithi046.ffxnex=up:active} 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/762200300' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hxdqyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hxdqyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:18.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:18 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:19.045 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:44:19.055 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:19.055 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-21T12:44:19.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: Deploying daemon mds.cephfs.smithi046.hxdqyf on smithi046 2024-09-21T12:44:19.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: pgmap v177: 65 pgs: 1 creating+activating, 64 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T12:44:19.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/762200300' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T12:44:19.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] up:boot 2024-09-21T12:44:19.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: daemon mds.cephfs.smithi176.kzzdid assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T12:44:19.431 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-21T12:44:19.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T12:44:19.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: fsmap cephfs:1 {0=cephfs.smithi046.ffxnex=up:active} 1 up:standby 2024-09-21T12:44:19.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"}]: dispatch 2024-09-21T12:44:19.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:creating} 2024-09-21T12:44:19.432 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:19 smithi176 ceph-mon[35476]: daemon mds.cephfs.smithi176.kzzdid is now active in filesystem cephfs as rank 1 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: Deploying daemon mds.cephfs.smithi046.hxdqyf on smithi046 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: pgmap v177: 65 pgs: 1 creating+activating, 64 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s wr, 3 op/s 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/762200300' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] up:boot 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: daemon mds.cephfs.smithi176.kzzdid assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-21T12:44:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T12:44:19.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: fsmap cephfs:1 {0=cephfs.smithi046.ffxnex=up:active} 1 up:standby 2024-09-21T12:44:19.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"}]: dispatch 2024-09-21T12:44:19.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:creating} 2024-09-21T12:44:19.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:19 smithi046 ceph-mon[27868]: daemon mds.cephfs.smithi176.kzzdid is now active in filesystem cephfs as rank 1 2024-09-21T12:44:20.393 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:20.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:20 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] up:active 2024-09-21T12:44:20.541 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:20 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2024-09-21T12:44:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:20 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] up:active 2024-09-21T12:44:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:20 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 -- 172.21.15.46:0/3206441991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4103910 msgr2=0x7f54a40ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/3206441991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4103910 0x7f54a40ff9e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5498009880 tx=0x7f549802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 -- 172.21.15.46:0/3206441991 shutdown_connections 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/3206441991 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4103910 0x7f54a40ff9e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/3206441991 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54a4102f40 0x7f54a4103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 -- 172.21.15.46:0/3206441991 >> 172.21.15.46:0/3206441991 conn(0x7f54a40fb770 msgr2=0x7f54a40fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 -- 172.21.15.46:0/3206441991 shutdown_connections 2024-09-21T12:44:21.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.001+0000 7f54a9ed5640 1 -- 172.21.15.46:0/3206441991 wait complete. 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.002+0000 7f54a9ed5640 1 Processor -- start 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.002+0000 7f54a9ed5640 1 -- start start 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a9ed5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 0x7f54a41025d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a9ed5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54a4103910 0x7f54a4100c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a9ed5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f54a410a7b0 con 0x7f54a4102f40 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a9ed5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f54a410a630 con 0x7f54a4103910 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 0x7f54a41025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 0x7f54a41025d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35274/0 (socket says 172.21.15.46:35274) 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 -- 172.21.15.46:0/425262295 learned_addr learned my addr 172.21.15.46:0/425262295 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a2ffd640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54a4103910 0x7f54a4100c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 -- 172.21.15.46:0/425262295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54a4103910 msgr2=0x7f54a4100c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:21.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54a4103910 0x7f54a4100c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 -- 172.21.15.46:0/425262295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a41011d0 con 0x7f54a4102f40 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a37fe640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 0x7f54a41025d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f549400d8d0 tx=0x7f549400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5494017070 con 0x7f54a4102f40 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54a41014c0 con 0x7f54a4102f40 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f549400be10 con 0x7f54a4102f40 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.003+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f549400f3c0 con 0x7f54a4102f40 2024-09-21T12:44:21.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.004+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54a4101a20 con 0x7f54a4102f40 2024-09-21T12:44:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.004+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54a4103340 con 0x7f54a4102f40 2024-09-21T12:44:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.005+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f549401a070 con 0x7f54a4102f40 2024-09-21T12:44:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.005+0000 7f54a0ff9640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f548c06e310 0x7f548c0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.006+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f549408dc20 con 0x7f54a4102f40 2024-09-21T12:44:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.006+0000 7f54a2ffd640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f548c06e310 0x7f548c0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:21.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.006+0000 7f54a2ffd640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f548c06e310 0x7f548c0707d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5498009230 tx=0x7f54980058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:21.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.010+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f549405f2b0 con 0x7f54a4102f40 2024-09-21T12:44:21.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.227+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7f54a402db50 con 0x7f54a4102f40 2024-09-21T12:44:21.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.397+0000 7f54a0ff9640 1 -- 172.21.15.46:0/425262295 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v9) ==== 168+0+0 (secure 0 0 0) 0x7f5494063ae0 con 0x7f54a4102f40 2024-09-21T12:44:21.398 INFO:teuthology.orchestra.run.smithi046.stderr:inline data enabled 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f548c06e310 msgr2=0x7f548c0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f548c06e310 0x7f548c0707d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5498009230 tx=0x7f54980058d0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 msgr2=0x7f54a41025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 0x7f54a41025d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f549400d8d0 tx=0x7f549400dd90 comp rx=0 tx=0).stop 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 shutdown_connections 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f548c06e310 0x7f548c0707d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f54a4103910 0x7f54a4100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 --2- 172.21.15.46:0/425262295 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54a4102f40 0x7f54a41025d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 >> 172.21.15.46:0/425262295 conn(0x7f54a40fb770 msgr2=0x7f54a41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 shutdown_connections 2024-09-21T12:44:21.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:21.399+0000 7f54a9ed5640 1 -- 172.21.15.46:0/425262295 wait complete. 2024-09-21T12:44:21.464 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:21 smithi046 ceph-mon[27868]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s wr, 8 op/s 2024-09-21T12:44:21.464 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:21 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/425262295' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T12:44:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:21 smithi176 ceph-mon[35476]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s wr, 8 op/s 2024-09-21T12:44:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:21 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/425262295' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T12:44:22.298 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:44:22.307 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:22.307 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/425262295' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:22.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.whwfab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:22.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.whwfab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:22.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:22.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: Deploying daemon mds.cephfs.smithi176.whwfab on smithi176 2024-09-21T12:44:22.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:22 smithi046 ceph-mon[27868]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T12:44:22.558 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T12:44:22.558 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/425262295' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T12:44:22.558 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2024-09-21T12:44:22.558 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:22.558 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:22.558 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:22.559 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.whwfab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:44:22.559 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.whwfab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:44:22.559 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:22.559 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: Deploying daemon mds.cephfs.smithi176.whwfab on smithi176 2024-09-21T12:44:22.559 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:22 smithi176 ceph-mon[35476]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s wr, 8 op/s 2024-09-21T12:44:22.579 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:23.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 -- 172.21.15.46:0/545430229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 msgr2=0x7ff5e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/545430229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4100c60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009880 tx=0x7ff5d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 -- 172.21.15.46:0/545430229 shutdown_connections 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/545430229 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e4101a60 0x7ff5e4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/545430229 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4100c60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 -- 172.21.15.46:0/545430229 >> 172.21.15.46:0/545430229 conn(0x7ff5e40fc010 msgr2=0x7ff5e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 -- 172.21.15.46:0/545430229 shutdown_connections 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 -- 172.21.15.46:0/545430229 wait complete. 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 Processor -- start 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.124+0000 7ff5eb20a640 1 -- start start 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5eb20a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:23.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5eb20a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e4101a60 0x7ff5e4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5eb20a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e41096a0 con 0x7ff5e4100860 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5eb20a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff5e4109520 con 0x7ff5e4101a60 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35306/0 (socket says 172.21.15.46:35306) 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 -- 172.21.15.46:0/2877587814 learned_addr learned my addr 172.21.15.46:0/2877587814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e3fff640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e4101a60 0x7ff5e4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 -- 172.21.15.46:0/2877587814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e4101a60 msgr2=0x7ff5e4197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e4101a60 0x7ff5e4197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 -- 172.21.15.46:0/2877587814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5e41980e0 con 0x7ff5e4100860 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e8fa6640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4197520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009230 tx=0x7ff5d80045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:23.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5d803f070 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff5d8004a50 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5e419cac0 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.125+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff5d8035030 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.126+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5e419d050 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.127+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5e4100c60 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.127+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff5d8042070 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.128+0000 7ff5e1ffb640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff5d406e2b0 0x7ff5d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.128+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7ff5d80aed20 con 0x7ff5e4100860 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.128+0000 7ff5e3fff640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff5d406e2b0 0x7ff5d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.129+0000 7ff5e3fff640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff5d406e2b0 0x7ff5d4070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5e41989d0 tx=0x7ff5d000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:23.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.133+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff5d8080330 con 0x7ff5e4100860 2024-09-21T12:44:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.346+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff5e419d280 con 0x7ff5e4100860 2024-09-21T12:44:23.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.347+0000 7ff5e1ffb640 1 -- 172.21.15.46:0/2877587814 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 11 v11) ==== 76+0+1821 (secure 0 0 0) 0x7ff5d8084b60 con 0x7ff5e4100860 2024-09-21T12:44:23.349 INFO:teuthology.orchestra.run.smithi046.stdout:e11 2024-09-21T12:44:23.349 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:22:400837+0000 2024-09-21T12:44:23.349 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:44:23.349 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:44:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:44:23.350 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:44:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:44:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 11 2024-09-21T12:44:23.350 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:22.400828+0000 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:44:23.351 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 0 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:44:23.352 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14552,1=24297} 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:44:23.353 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14552 members: 24297,14552 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:14552} state up:active seq 2 addr [v2:172.21.15.46:6826/1184759627,v1:172.21.15.46:6827/1184759627] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:standby-replay seq 1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 2 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:23.354 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:23.355 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 11 2024-09-21T12:44:23.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff5d406e2b0 msgr2=0x7ff5d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff5d406e2b0 0x7ff5d4070770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff5e41989d0 tx=0x7ff5d000b390 comp rx=0 tx=0).stop 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 msgr2=0x7ff5e4197520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4197520 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009230 tx=0x7ff5d80045c0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 shutdown_connections 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff5d406e2b0 0x7ff5d4070770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5e4101a60 0x7ff5e4197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 --2- 172.21.15.46:0/2877587814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5e4100860 0x7ff5e4197520 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 >> 172.21.15.46:0/2877587814 conn(0x7ff5e40fc010 msgr2=0x7ff5e4069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 shutdown_connections 2024-09-21T12:44:23.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:23.349+0000 7ff5eb20a640 1 -- 172.21.15.46:0/2877587814 wait complete. 2024-09-21T12:44:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:23 smithi176 ceph-mon[35476]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-21T12:44:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:23 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:boot 2024-09-21T12:44:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:23 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby 2024-09-21T12:44:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:23 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"}]: dispatch 2024-09-21T12:44:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:23 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 2024-09-21T12:44:23.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:23 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2877587814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:44:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:23 smithi046 ceph-mon[27868]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-21T12:44:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:23 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:boot 2024-09-21T12:44:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:23 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby 2024-09-21T12:44:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:23 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"}]: dispatch 2024-09-21T12:44:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:23 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 2024-09-21T12:44:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:23 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2877587814' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:44:24.041 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-21T12:44:24.304 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:24 smithi046 ceph-mon[27868]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 193 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T12:44:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:24 smithi176 ceph-mon[35476]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 193 B/s rd, 2.5 KiB/s wr, 8 op/s 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.781+0000 7f83bd05e640 1 -- 172.21.15.46:0/3430757370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 msgr2=0x7f83b8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.781+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3430757370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8107110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0098b0 tx=0x7f83ac02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.781+0000 7f83bd05e640 1 -- 172.21.15.46:0/3430757370 shutdown_connections 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.781+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3430757370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8107110 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.782+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3430757370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 0x7f83b81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.782+0000 7f83bd05e640 1 -- 172.21.15.46:0/3430757370 >> 172.21.15.46:0/3430757370 conn(0x7f83b80fbff0 msgr2=0x7f83b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.782+0000 7f83bd05e640 1 -- 172.21.15.46:0/3430757370 shutdown_connections 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.782+0000 7f83bd05e640 1 -- 172.21.15.46:0/3430757370 wait complete. 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.782+0000 7f83bd05e640 1 Processor -- start 2024-09-21T12:44:24.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83bd05e640 1 -- start start 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83bd05e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 0x7f83b8197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83bd05e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83bd05e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f83b810a7b0 con 0x7f83b8104d20 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83bd05e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f83b810a630 con 0x7f83b81023f0 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35322/0 (socket says 172.21.15.46:35322) 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b659c640 1 -- 172.21.15.46:0/3575600777 learned_addr learned my addr 172.21.15.46:0/3575600777 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b6d9d640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 0x7f83b8197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b6d9d640 1 -- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 msgr2=0x7f83b8197a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b6d9d640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8197a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b6d9d640 1 -- 172.21.15.46:0/3575600777 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b8198100 con 0x7f83b81023f0 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.783+0000 7f83b659c640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:44:24.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.784+0000 7f83b6d9d640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 0x7f83b8197540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e970 tx=0x7f83a800ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.784+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83a800cac0 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.784+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83a800cc60 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.784+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b819cb40 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.784+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83a80047a0 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.784+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b819d0d0 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.785+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83b81027d0 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.785+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f83a8004030 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.786+0000 7f839ffff640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f83a006e2b0 0x7f83a0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.786+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5468+0+0 (secure 0 0 0) 0x7f83a808e6a0 con 0x7f83b81023f0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.786+0000 7f83b659c640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f83a006e2b0 0x7f83a0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.786+0000 7f83b659c640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f83a006e2b0 0x7f83a0070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0096c0 tx=0x7f83ac0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:24.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:24.791+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83a805bf60 con 0x7f83b81023f0 2024-09-21T12:44:25.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.016+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83b819d3c0 con 0x7f83b81023f0 2024-09-21T12:44:25.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.017+0000 7f839ffff640 1 -- 172.21.15.46:0/3575600777 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5358 (secure 0 0 0) 0x7f83a805fc10 con 0x7f83b81023f0 2024-09-21T12:44:25.018 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 13 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.019+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f83a006e2b0 msgr2=0x7f83a0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.019+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f83a006e2b0 0x7f83a0070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83ac0096c0 tx=0x7f83ac0058d0 comp rx=0 tx=0).stop 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.019+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 msgr2=0x7f83b8197540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.019+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 0x7f83b8197540 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f83a800e970 tx=0x7f83a800ee30 comp rx=0 tx=0).stop 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 shutdown_connections 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f83a006e2b0 0x7f83a0070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:25.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f83b8104d20 0x7f83b8197a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:25.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 --2- 172.21.15.46:0/3575600777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83b81023f0 0x7f83b8197540 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:25.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 >> 172.21.15.46:0/3575600777 conn(0x7f83b80fbff0 msgr2=0x7f83b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:25.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 shutdown_connections 2024-09-21T12:44:25.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:25.020+0000 7f83bd05e640 1 -- 172.21.15.46:0/3575600777 wait complete. 2024-09-21T12:44:25.029 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:44:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] up:boot 2024-09-21T12:44:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"}]: dispatch 2024-09-21T12:44:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:44:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:25.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:25 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3575600777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:44:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] up:boot 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"}]: dispatch 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:25 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3575600777' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:44:26.308 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-21T12:44:26.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:26 smithi046 ceph-mon[27868]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 426 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T12:44:26.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:26 smithi176 ceph-mon[35476]: pgmap v181: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 426 B/s rd, 2.2 KiB/s wr, 7 op/s 2024-09-21T12:44:27.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:standby-replay 2024-09-21T12:44:27.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] up:active 2024-09-21T12:44:27.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: Dropping low affinity active daemon mds.cephfs.smithi046.ffxnex in favor of higher affinity standby. 2024-09-21T12:44:27.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: Replacing daemon mds.cephfs.smithi046.ffxnex as rank 0 with standby daemon mds.cephfs.smithi046.hxdqyf 2024-09-21T12:44:27.660 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:44:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:44:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T12:44:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:replay,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 2024-09-21T12:44:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:27 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:standby-replay 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] up:active 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: Dropping low affinity active daemon mds.cephfs.smithi046.ffxnex in favor of higher affinity standby. 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: Replacing daemon mds.cephfs.smithi046.ffxnex as rank 0 with standby daemon mds.cephfs.smithi046.hxdqyf 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:44:27.757 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T12:44:27.758 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:replay,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 2024-09-21T12:44:27.758 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:27.758 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:27 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:27.877 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:28.591 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:resolve 2024-09-21T12:44:28.591 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] up:boot 2024-09-21T12:44:28.591 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:resolve,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:28.592 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:44:28.592 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-21T12:44:28.592 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:28.592 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:28.592 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:28.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 -- 172.21.15.46:0/3746563573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 msgr2=0x7f0e00104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:28.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 --2- 172.21.15.46:0/3746563573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00104840 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0df0009880 tx=0x7f0df002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 -- 172.21.15.46:0/3746563573 shutdown_connections 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 --2- 172.21.15.46:0/3746563573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 0x7f0e00107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 --2- 172.21.15.46:0/3746563573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00104840 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 -- 172.21.15.46:0/3746563573 >> 172.21.15.46:0/3746563573 conn(0x7f0e000fc010 msgr2=0x7f0e000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 -- 172.21.15.46:0/3746563573 shutdown_connections 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 -- 172.21.15.46:0/3746563573 wait complete. 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.675+0000 7f0e05e20640 1 Processor -- start 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0e05e20640 1 -- start start 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0e05e20640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0e05e20640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 0x7f0e00197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0e05e20640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010a7c0 con 0x7f0e00102450 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0e05e20640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e0010a640 con 0x7f0e00104d80 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51472/0 (socket says 172.21.15.46:51472) 2024-09-21T12:44:28.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 -- 172.21.15.46:0/2983244239 learned_addr learned my addr 172.21.15.46:0/2983244239 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dfeffd640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 0x7f0e00197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 -- 172.21.15.46:0/2983244239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 msgr2=0x7f0e00197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 0x7f0e00197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 -- 172.21.15.46:0/2983244239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e001980d0 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dfeffd640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 0x7f0e00197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.676+0000 7f0dff7fe640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00197510 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0df0006010 tx=0x7f0df00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.677+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0df003f070 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.677+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0019cb10 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.677+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0df00044d0 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.677+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0df0035030 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.677+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e0019d0a0 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.678+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e00102830 con 0x7f0e00102450 2024-09-21T12:44:28.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.678+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f0df0042070 con 0x7f0e00102450 2024-09-21T12:44:28.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.679+0000 7f0dfcff9640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0de806e2b0 0x7f0de8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:28.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.679+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f0df00aeef0 con 0x7f0e00102450 2024-09-21T12:44:28.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.679+0000 7f0dfeffd640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0de806e2b0 0x7f0de8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:28.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.679+0000 7f0dfeffd640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0de806e2b0 0x7f0de8070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0df4006fd0 tx=0x7f0df4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:28.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.683+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0df007c7f0 con 0x7f0e00102450 2024-09-21T12:44:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:resolve 2024-09-21T12:44:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] up:boot 2024-09-21T12:44:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:resolve,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:44:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 1.5 KiB/s wr, 8 op/s 2024-09-21T12:44:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:28.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.929+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7f0e0019d580 con 0x7f0e00102450 2024-09-21T12:44:28.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.930+0000 7f0dfcff9640 1 -- 172.21.15.46:0/2983244239 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v17) ==== 78+0+98 (secure 0 0 0) 0x7f0df00804a0 con 0x7f0e00102450 2024-09-21T12:44:28.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0de806e2b0 msgr2=0x7f0de8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:28.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0de806e2b0 0x7f0de8070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0df4006fd0 tx=0x7f0df4008040 comp rx=0 tx=0).stop 2024-09-21T12:44:28.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 msgr2=0x7f0e00197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:28.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00197510 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0df0006010 tx=0x7f0df00048f0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 shutdown_connections 2024-09-21T12:44:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f0de806e2b0 0x7f0de8070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e00104d80 0x7f0e00197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 --2- 172.21.15.46:0/2983244239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e00102450 0x7f0e00197510 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 >> 172.21.15.46:0/2983244239 conn(0x7f0e000fc010 msgr2=0x7f0e000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 shutdown_connections 2024-09-21T12:44:28.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:28.932+0000 7f0e05e20640 1 -- 172.21.15.46:0/2983244239 wait complete. 2024-09-21T12:44:28.942 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:44:29.630 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:29 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:reconnect 2024-09-21T12:44:29.630 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:29 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] up:standby-replay 2024-09-21T12:44:29.631 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:29 smithi046 ceph-mon[27868]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:reconnect,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:29.631 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:29 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2983244239' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T12:44:29.660 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-21T12:44:29.671 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T12:44:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:29 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:reconnect 2024-09-21T12:44:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:29 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] up:standby-replay 2024-09-21T12:44:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:29 smithi176 ceph-mon[35476]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:reconnect,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:29 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2983244239' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T12:44:30.361 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:30.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:30 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:rejoin 2024-09-21T12:44:30.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:30 smithi046 ceph-mon[27868]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:rejoin,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:30.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:30 smithi046 ceph-mon[27868]: daemon mds.cephfs.smithi046.hxdqyf is now active in filesystem cephfs as rank 0 2024-09-21T12:44:30.653 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:30 smithi046 ceph-mon[27868]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-21T12:44:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:30 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:rejoin 2024-09-21T12:44:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:30 smithi176 ceph-mon[35476]: fsmap cephfs:2/2 {0=cephfs.smithi046.hxdqyf=up:rejoin,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:30 smithi176 ceph-mon[35476]: daemon mds.cephfs.smithi046.hxdqyf is now active in filesystem cephfs as rank 0 2024-09-21T12:44:30.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:30 smithi176 ceph-mon[35476]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.9 KiB/s rd, 102 B/s wr, 5 op/s 2024-09-21T12:44:30.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 -- 172.21.15.46:0/2470827288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 msgr2=0x7ff9e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:30.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 --2- 172.21.15.46:0/2470827288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e4100c60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009880 tx=0x7ff9d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:30.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 -- 172.21.15.46:0/2470827288 shutdown_connections 2024-09-21T12:44:30.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 --2- 172.21.15.46:0/2470827288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e4100c60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:30.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 --2- 172.21.15.46:0/2470827288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e4106800 0x7ff9e4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 -- 172.21.15.46:0/2470827288 >> 172.21.15.46:0/2470827288 conn(0x7ff9e40fc520 msgr2=0x7ff9e40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 -- 172.21.15.46:0/2470827288 shutdown_connections 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.866+0000 7ff9e949b640 1 -- 172.21.15.46:0/2470827288 wait complete. 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e949b640 1 Processor -- start 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e949b640 1 -- start start 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e949b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e419d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e949b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e4106800 0x7ff9e419dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e949b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e410dd30 con 0x7ff9e4100800 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e949b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e410dbb0 con 0x7ff9e4106800 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e419d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e419d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51484/0 (socket says 172.21.15.46:51484) 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.867+0000 7ff9e2ffd640 1 -- 172.21.15.46:0/3754408950 learned_addr learned my addr 172.21.15.46:0/3754408950 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e27fc640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e4106800 0x7ff9e419dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:30.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e2ffd640 1 -- 172.21.15.46:0/3754408950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e4106800 msgr2=0x7ff9e419dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e2ffd640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e4106800 0x7ff9e419dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e2ffd640 1 -- 172.21.15.46:0/3754408950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e4197870 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e2ffd640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e419d6b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400b420 tx=0x7ff9d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9d4011630 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e4197b60 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff9d4016070 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff9d4010d40 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.868+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e41980c0 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.869+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e4101f40 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.870+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7ff9d401b460 con 0x7ff9e4100800 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.870+0000 7ff9cbfff640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff9cc06e2b0 0x7ff9cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:30.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.870+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7ff9d408da20 con 0x7ff9e4100800 2024-09-21T12:44:30.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.870+0000 7ff9e27fc640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff9cc06e2b0 0x7ff9cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:30.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.871+0000 7ff9e27fc640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff9cc06e2b0 0x7ff9cc070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4199060 tx=0x7ff9d8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:30.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:30.875+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9d405b320 con 0x7ff9e4100800 2024-09-21T12:44:31.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.101+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9e4198da0 con 0x7ff9e4100800 2024-09-21T12:44:31.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.102+0000 7ff9cbfff640 1 -- 172.21.15.46:0/3754408950 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+5356 (secure 0 0 0) 0x7ff9d405efd0 con 0x7ff9e4100800 2024-09-21T12:44:31.105 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:44:31.105 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":20,"btime":"2024-09-21T12:44:30:428978+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:44:30.428965+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14570,"mds_1":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14570":{"gid":14570,"name":"cephfs.smithi046.hxdqyf","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6829/692972635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":692972635},{"type":"v1","addr":"172.21.15.46:6829","nonce":692972635}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24297":{"gid":24297,"name":"cephfs.smithi176.kzzdid","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6825/1059739183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1059739183},{"type":"v1","addr":"172.21.15.176:6825","nonce":1059739183}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24309":{"gid":24309,"name":"cephfs.smithi176.whwfab","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.176:6827/3542639331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3542639331},{"type":"v1","addr":"172.21.15.176:6827","nonce":3542639331}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24317":{"gid":24317,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.46:6827/2004308327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":2004308327},{"type":"v1","addr":"172.21.15.46:6827","nonce":2004308327}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14570,"qdb_cluster":[24297,14570]},"id":1}]} 2024-09-21T12:44:31.105 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:44:31.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff9cc06e2b0 msgr2=0x7ff9cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff9cc06e2b0 0x7ff9cc070770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4199060 tx=0x7ff9d8031400 comp rx=0 tx=0).stop 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 msgr2=0x7ff9e419d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e419d6b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff9d400b420 tx=0x7ff9d400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 shutdown_connections 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7ff9cc06e2b0 0x7ff9cc070770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9e4106800 0x7ff9e419dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 --2- 172.21.15.46:0/3754408950 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff9e4100800 0x7ff9e419d6b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 >> 172.21.15.46:0/3754408950 conn(0x7ff9e40fc520 msgr2=0x7ff9e406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 shutdown_connections 2024-09-21T12:44:31.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:31.105+0000 7ff9e949b640 1 -- 172.21.15.46:0/3754408950 wait complete. 2024-09-21T12:44:31.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:44:31.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:active 2024-09-21T12:44:31.790 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:31.791 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:44:31.791 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:31.791 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:31.791 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:31 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3754408950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:44:31.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:44:31.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: mds.? [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] up:active 2024-09-21T12:44:31.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 1 up:standby-replay 1 up:standby 2024-09-21T12:44:31.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:44:31.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:31.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:31.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:31 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3754408950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:44:31.819 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 20, 'max_mds': 2, 'flags': 50} 2024-09-21T12:44:31.819 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T12:44:31.845 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T12:44:31.845 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-21T12:44:31.845 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-21T12:44:31.845 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T12:44:31.845 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:31.846 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-21T12:44:31.846 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T12:44:31.846 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:31.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:31.846 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-21T12:44:31.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:31.863 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2024-09-21T12:44:31.933 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2024-09-21T12:44:31.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:44:31.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:31.935 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-21T12:44:31.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:31.952 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link delete ceph-brx 2024-09-21T12:44:32.022 INFO:teuthology.orchestra.run.smithi046.stderr:Cannot find device "ceph-brx" 2024-09-21T12:44:32.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:44:32.024 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T12:44:32.024 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T12:44:32.025 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T12:44:32.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:32.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:32.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:32.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:32 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:32.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:32 smithi176 ceph-mon[35476]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T12:44:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:32 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:44:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:32 smithi046 ceph-mon[27868]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T12:44:32.744 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 -- 172.21.15.46:0/936941186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 msgr2=0x7f70c410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 --2- 172.21.15.46:0/936941186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c410b8d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009880 tx=0x7f70ac02a530 comp rx=0 tx=0).stop 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 -- 172.21.15.46:0/936941186 shutdown_connections 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 --2- 172.21.15.46:0/936941186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c410b8d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 --2- 172.21.15.46:0/936941186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 0x7f70c4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 -- 172.21.15.46:0/936941186 >> 172.21.15.46:0/936941186 conn(0x7f70c40fc520 msgr2=0x7f70c40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 -- 172.21.15.46:0/936941186 shutdown_connections 2024-09-21T12:44:33.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.162+0000 7f70c9505640 1 -- 172.21.15.46:0/936941186 wait complete. 2024-09-21T12:44:33.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c9505640 1 Processor -- start 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c9505640 1 -- start start 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c9505640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 0x7f70c419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c9505640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c9505640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f70c410edd0 con 0x7f70c41033e0 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c9505640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70c410ec50 con 0x7f70c4102ac0 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c2ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 0x7f70c419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:33.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c27fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51506/0 (socket says 172.21.15.46:51506) 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.163+0000 7f70c27fc640 1 -- 172.21.15.46:0/840195947 learned_addr learned my addr 172.21.15.46:0/840195947 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c2ffd640 1 -- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 msgr2=0x7f70c419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c2ffd640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c419dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c2ffd640 1 -- 172.21.15.46:0/840195947 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c41977e0 con 0x7f70c4102ac0 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c27fc640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c2ffd640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 0x7f70c419d660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70b4005fd0 tx=0x7f70b400dd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70b400be30 con 0x7f70c4102ac0 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c4197ad0 con 0x7f70c4102ac0 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70b4004030 con 0x7f70c4102ac0 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70b4003cd0 con 0x7f70c4102ac0 2024-09-21T12:44:33.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.164+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c4198030 con 0x7f70c4102ac0 2024-09-21T12:44:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.165+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c406aa90 con 0x7f70c4102ac0 2024-09-21T12:44:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.166+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f70b40041e0 con 0x7f70c4102ac0 2024-09-21T12:44:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.166+0000 7f70bbfff640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f70b006e2b0 0x7f70b0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.166+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f70b408dbb0 con 0x7f70c4102ac0 2024-09-21T12:44:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.166+0000 7f70c27fc640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f70b006e2b0 0x7f70b0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:33.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.167+0000 7f70c27fc640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f70b006e2b0 0x7f70b0070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70c4198b30 tx=0x7f70ac0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:33.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.171+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70b4017020 con 0x7f70c4102ac0 2024-09-21T12:44:33.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.394+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f70c4105f60 con 0x7f70c4102ac0 2024-09-21T12:44:33.396 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.394+0000 7f70bbfff640 1 -- 172.21.15.46:0/840195947 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+83 (secure 0 0 0) 0x7f70b405f0c0 con 0x7f70c4102ac0 2024-09-21T12:44:33.396 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T12:44:33.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f70b006e2b0 msgr2=0x7f70b0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:33.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f70b006e2b0 0x7f70b0070770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f70c4198b30 tx=0x7f70ac0058d0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 msgr2=0x7f70c419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:33.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 0x7f70c419d660 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f70b4005fd0 tx=0x7f70b400dd60 comp rx=0 tx=0).stop 2024-09-21T12:44:33.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 shutdown_connections 2024-09-21T12:44:33.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f70b006e2b0 0x7f70b0070770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70c41033e0 0x7f70c419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 --2- 172.21.15.46:0/840195947 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70c4102ac0 0x7f70c419d660 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:33.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 >> 172.21.15.46:0/840195947 conn(0x7f70c40fc520 msgr2=0x7f70c4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:33.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 shutdown_connections 2024-09-21T12:44:33.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:33.397+0000 7f70c9505640 1 -- 172.21.15.46:0/840195947 wait complete. 2024-09-21T12:44:33.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:33 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/840195947' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:44:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:33 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/840195947' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:44:34.220 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi046.front.sepia.ceph.com 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T12:44:34.221 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T12:44:34.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:34.222 DEBUG:teuthology.orchestra.run.smithi046:> ip addr 2024-09-21T12:44:34.240 INFO:teuthology.orchestra.run.smithi046.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T12:44:34.240 INFO:teuthology.orchestra.run.smithi046.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T12:44:34.240 INFO:teuthology.orchestra.run.smithi046.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T12:44:34.240 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 ::1/128 scope host 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:10 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f0 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:6b:f6:11 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp7s0f1 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f8 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f0 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: inet 172.21.15.46/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft 42332sec preferred_lft 42332sec 2024-09-21T12:44:34.241 INFO:teuthology.orchestra.run.smithi046.stdout: inet6 fe80::ec4:7aff:febd:15f8/64 scope link 2024-09-21T12:44:34.242 INFO:teuthology.orchestra.run.smithi046.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:44:34.242 INFO:teuthology.orchestra.run.smithi046.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:44:34.242 INFO:teuthology.orchestra.run.smithi046.stdout: link/ether 0c:c4:7a:bd:15:f9 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:34.242 INFO:teuthology.orchestra.run.smithi046.stdout: altname enp1s0f1 2024-09-21T12:44:34.242 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add name ceph-brx type bridge 2024-09-21T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr flush dev ceph-brx 2024-09-21T12:44:34.242 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set ceph-brx up 2024-09-21T12:44:34.243 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T12:44:34.243 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T12:44:34.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:34.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:34.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:34.521 DEBUG:teuthology.orchestra.run.smithi046:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T12:44:34.548 INFO:teuthology.orchestra.run.smithi046.stdout:1 2024-09-21T12:44:34.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:34.550 DEBUG:teuthology.orchestra.run.smithi046:> route 2024-09-21T12:44:34.624 INFO:teuthology.orchestra.run.smithi046.stdout:Kernel IP routing table 2024-09-21T12:44:34.624 INFO:teuthology.orchestra.run.smithi046.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T12:44:34.624 INFO:teuthology.orchestra.run.smithi046.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T12:44:34.624 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T12:44:34.624 INFO:teuthology.orchestra.run.smithi046.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T12:44:34.624 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:34.624 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T12:44:34.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T12:44:34.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T12:44:34.625 DEBUG:teuthology.orchestra.run.smithi046:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T12:44:34.625 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T12:44:34.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:35.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:34 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:35.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:34 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:35.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:34 smithi176 ceph-mon[35476]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T12:44:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:34 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:34 smithi046 ceph-mon[27868]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T12:44:35.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:35.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:35.194 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list 2024-09-21T12:44:35.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:35.210 DEBUG:teuthology.orchestra.run.smithi046:> ip netns list-id 2024-09-21T12:44:35.266 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:35.266 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T12:44:35.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:35.267 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T12:44:35.267 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T12:44:35.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:35.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:35.386 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T12:44:35.387 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T12:44:35.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:35.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:35.533 DEBUG:teuthology.orchestra.run.smithi046:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:35.533 DEBUG:teuthology.orchestra.run.smithi046:> set -e 2024-09-21T12:44:35.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set brx.0 up 2024-09-21T12:44:35.533 DEBUG:teuthology.orchestra.run.smithi046:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T12:44:35.533 DEBUG:teuthology.orchestra.run.smithi046:> ') 2024-09-21T12:44:35.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:35.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:35.612 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-21T12:44:35.613 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:44:35.613 DEBUG:teuthology.orchestra.run.smithi046:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:35.629 INFO:teuthology.orchestra.run.smithi046.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T12:44:35.629 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:44:35.629 DEBUG:teuthology.orchestra.run.smithi046:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:35.685 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-09-21T12:44:35.754 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-09-21T12:44:35.811 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-09-21T12:44:35.812 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0dfba8ba9d1a6b78cbdb00a0a49446c875feb4195e20a11e280cf36d7979d62a/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/adc08f2e80134f8d6301d4ec4dcf7fdfe6f352cc526a1f82e4243f2b65ea7434/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d53316e5fb8a22bf9be696d638344b3bd735499fc53cb235365cdc863a054d93/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/8a61bc39f3f30a2fe2f7db5f3cef2060410e8f2070a05a8fd93cf05c98ff4008/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/3a578f590c169f16a2bc28aa0f619d5697e9f2918020b7f32f700f98b820b08a/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/83b0563373ee5f20c5cb6c19e186348923ad56eddcd056b5a45ee519b550ec84/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d8218293b52b3820eeac0846b478aa90a04bd37f2f808ffc50deb9e0c225015e/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/93bd7435ef687630f92e92601658a332fdceb02d60bb01e2e6016c58822be6bb/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/24e549a07becebcaa8bd12529b84a07e5282053e0910b7fdc16c2419b335d419/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b332fe6dd8e9ad42bb6dc86e2e289c3573935735964c6f4e6ced01b93e076160/merged 2024-09-21T12:44:35.813 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/464a08f608136b52e4cfc2819ae36eb52b2d9bdb4e517c72f947efdefb421077/merged 2024-09-21T12:44:35.814 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9bd90b366f2f192961f442dd1dbacec0abbee266e347703813a5458208d0424b/merged 2024-09-21T12:44:35.814 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/31b65fac34f716b3ca40f7c42e3c7692e56cb37db778fc074d665901728116de/merged 2024-09-21T12:44:35.814 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-09-21T12:44:35.814 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:35.814 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:35.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:35.815 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-09-21T12:44:35.873 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T12:44:35.873 DEBUG:teuthology.orchestra.run.smithi046:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-21T12:44:35.916 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-09-21T12:44:35.941 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-09-21T12:44:35.999 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:44:36.000 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0dfba8ba9d1a6b78cbdb00a0a49446c875feb4195e20a11e280cf36d7979d62a/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/adc08f2e80134f8d6301d4ec4dcf7fdfe6f352cc526a1f82e4243f2b65ea7434/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d53316e5fb8a22bf9be696d638344b3bd735499fc53cb235365cdc863a054d93/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/8a61bc39f3f30a2fe2f7db5f3cef2060410e8f2070a05a8fd93cf05c98ff4008/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/3a578f590c169f16a2bc28aa0f619d5697e9f2918020b7f32f700f98b820b08a/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/83b0563373ee5f20c5cb6c19e186348923ad56eddcd056b5a45ee519b550ec84/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d8218293b52b3820eeac0846b478aa90a04bd37f2f808ffc50deb9e0c225015e/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/93bd7435ef687630f92e92601658a332fdceb02d60bb01e2e6016c58822be6bb/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/24e549a07becebcaa8bd12529b84a07e5282053e0910b7fdc16c2419b335d419/merged 2024-09-21T12:44:36.001 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b332fe6dd8e9ad42bb6dc86e2e289c3573935735964c6f4e6ced01b93e076160/merged 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/464a08f608136b52e4cfc2819ae36eb52b2d9bdb4e517c72f947efdefb421077/merged 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9bd90b366f2f192961f442dd1dbacec0abbee266e347703813a5458208d0424b/merged 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/31b65fac34f716b3ca40f7c42e3c7692e56cb37db778fc074d665901728116de/merged 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:36.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:36.002 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-09-21T12:44:36.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:2024-09-21T12:44:36.085+0000 7f9c38e69480 -1 init, newargv = 0x55d2ad018090 newargc=15 2024-09-21T12:44:36.088 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[75125]: starting ceph client 2024-09-21T12:44:36.095 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[75125]: starting fuse 2024-09-21T12:44:36.759 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:36 smithi046 ceph-mon[27868]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T12:44:36.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:36 smithi176 ceph-mon[35476]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 11 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-21T12:44:37.156 DEBUG:teuthology.orchestra.run.smithi046:> sudo modprobe fuse 2024-09-21T12:44:37.186 DEBUG:teuthology.orchestra.run.smithi046:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:44:37.243 INFO:teuthology.orchestra.run.smithi046.stdout:/proc 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/sys 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/dev 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/security 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/shm 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/pts 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/run 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/cgroup 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/pstore 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/bpf 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/ 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/selinux 2024-09-21T12:44:37.244 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/hugepages 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/dev/mqueue 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/debug 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/tracing 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/fs/fuse/connections 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/sys/kernel/config 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/1000 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/ceph 2024-09-21T12:44:37.245 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/0dfba8ba9d1a6b78cbdb00a0a49446c875feb4195e20a11e280cf36d7979d62a/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/adc08f2e80134f8d6301d4ec4dcf7fdfe6f352cc526a1f82e4243f2b65ea7434/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/run/user/0 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d53316e5fb8a22bf9be696d638344b3bd735499fc53cb235365cdc863a054d93/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/8a61bc39f3f30a2fe2f7db5f3cef2060410e8f2070a05a8fd93cf05c98ff4008/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/3a578f590c169f16a2bc28aa0f619d5697e9f2918020b7f32f700f98b820b08a/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/83b0563373ee5f20c5cb6c19e186348923ad56eddcd056b5a45ee519b550ec84/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/d8218293b52b3820eeac0846b478aa90a04bd37f2f808ffc50deb9e0c225015e/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/93bd7435ef687630f92e92601658a332fdceb02d60bb01e2e6016c58822be6bb/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/24e549a07becebcaa8bd12529b84a07e5282053e0910b7fdc16c2419b335d419/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/b332fe6dd8e9ad42bb6dc86e2e289c3573935735964c6f4e6ced01b93e076160/merged 2024-09-21T12:44:37.246 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/464a08f608136b52e4cfc2819ae36eb52b2d9bdb4e517c72f947efdefb421077/merged 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/9bd90b366f2f192961f442dd1dbacec0abbee266e347703813a5458208d0424b/merged 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:/var/lib/containers/storage/overlay/31b65fac34f716b3ca40f7c42e3c7692e56cb37db778fc074d665901728116de/merged 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run.smithi046.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:37.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:37.247 DEBUG:teuthology.orchestra.run.smithi046:> ls /sys/fs/fuse/connections 2024-09-21T12:44:37.300 INFO:teuthology.orchestra.run.smithi046.stdout:137 2024-09-21T12:44:37.300 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [137] 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> sudo stdin-killer -- python3 -c ' 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> import glob 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> import re 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> import os 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> import subprocess 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> def _find_admin_socket(client_name): 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> files = glob.glob(asok_path) 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> # Given a non-glob path, it better be there 2024-09-21T12:44:37.301 DEBUG:teuthology.orchestra.run.smithi046:> if "*" not in asok_path: 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> assert(len(files) == 1) 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> return files[0] 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> for f in files: 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> contents = proc_f.read() 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> if mountpoint in contents: 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> return f 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> print(_find_admin_socket("client.0")) 2024-09-21T12:44:37.302 DEBUG:teuthology.orchestra.run.smithi046:> ' 2024-09-21T12:44:37.421 INFO:teuthology.orchestra.run.smithi046.stdout:/var/run/ceph/ceph-client.0.75125.asok 2024-09-21T12:44:37.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:37.431 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.75125.asok 2024-09-21T12:44:37.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:37.432 DEBUG:teuthology.orchestra.run.smithi046:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.75125.asok status 2024-09-21T12:44:37.569 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:44:37.569 INFO:teuthology.orchestra.run.smithi046.stdout: "metadata": { 2024-09-21T12:44:37.569 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "entity_id": "0", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "hostname": "smithi046", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "pid": "75125", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "root": "/" 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_count": 0, 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "dentry_pinned_count": 0, 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "id": 14600, 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "inst": { 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "name": { 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "client", 2024-09-21T12:44:37.570 INFO:teuthology.orchestra.run.smithi046.stdout: "num": 14600 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1427713140 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": { 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "type": "v1", 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "nonce": 1427713140 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "inst_str": "client.14600 192.168.0.1:0/1427713140", 2024-09-21T12:44:37.571 INFO:teuthology.orchestra.run.smithi046.stdout: "addr_str": "192.168.0.1:0/1427713140", 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout: "inode_count": 1, 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout: "mds_epoch": 20, 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch": 45, 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout: "osd_epoch_barrier": 0, 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout: "blocklisted": false, 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout: "fs_name": "cephfs" 2024-09-21T12:44:37.572 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:44:37.578 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T12:44:37.578 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T12:44:37.836 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:38.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:38.206 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:38.207 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:38.207 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:38.207 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:38 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 -- 172.21.15.46:0/884174366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc101900 msgr2=0x7fdddc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 --2- 172.21.15.46:0/884174366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc101900 0x7fdddc101d60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009880 tx=0x7fddd002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 -- 172.21.15.46:0/884174366 shutdown_connections 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 --2- 172.21.15.46:0/884174366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc101900 0x7fdddc101d60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 --2- 172.21.15.46:0/884174366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc107900 0x7fdddc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 -- 172.21.15.46:0/884174366 >> 172.21.15.46:0/884174366 conn(0x7fdddc0fd600 msgr2=0x7fdddc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 -- 172.21.15.46:0/884174366 shutdown_connections 2024-09-21T12:44:38.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.288+0000 7fdde427e640 1 -- 172.21.15.46:0/884174366 wait complete. 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde427e640 1 Processor -- start 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde427e640 1 -- start start 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde427e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc101900 0x7fdddc19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde427e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 0x7fdddc19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde427e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc10ee30 con 0x7fdddc107900 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde427e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdddc10ecb0 con 0x7fdddc101900 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde1819640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 0x7fdddc19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde1819640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 0x7fdddc19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60564/0 (socket says 172.21.15.46:60564) 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde1819640 1 -- 172.21.15.46:0/2500502689 learned_addr learned my addr 172.21.15.46:0/2500502689 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde201a640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc101900 0x7fdddc19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde1819640 1 -- 172.21.15.46:0/2500502689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc101900 msgr2=0x7fdddc19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:38.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde1819640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc101900 0x7fdddc19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde1819640 1 -- 172.21.15.46:0/2500502689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdddc197820 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.289+0000 7fdde201a640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc101900 0x7fdddc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.290+0000 7fdde1819640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 0x7fdddc19dbe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fddd0031460 tx=0x7fddd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.290+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fddd003f070 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.290+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fddd0004cf0 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.290+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdddc197ab0 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.290+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fddd0035030 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.290+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdddc197fe0 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.291+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdddc103040 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.291+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fddd0042070 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.292+0000 7fdddb7fe640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fddc406e2b0 0x7fddc4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.292+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fddd00aecb0 con 0x7fdddc107900 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.292+0000 7fdde201a640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fddc406e2b0 0x7fddc4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:38.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.292+0000 7fdde201a640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fddc406e2b0 0x7fddc4070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009930 tx=0x7fddd4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:38.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.296+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fddd007c5b0 con 0x7fdddc107900 2024-09-21T12:44:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.512+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdddc109e90 con 0x7fdddc107900 2024-09-21T12:44:38.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.512+0000 7fdddb7fe640 1 -- 172.21.15.46:0/2500502689 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v20) ==== 53+0+83 (secure 0 0 0) 0x7fddd0080260 con 0x7fdddc107900 2024-09-21T12:44:38.514 INFO:teuthology.orchestra.run.smithi046.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T12:44:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fddc406e2b0 msgr2=0x7fddc4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:38.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fddc406e2b0 0x7fddc4070770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fddd4009930 tx=0x7fddd4008040 comp rx=0 tx=0).stop 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 msgr2=0x7fdddc19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 0x7fdddc19dbe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fddd0031460 tx=0x7fddd00048f0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 shutdown_connections 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fddc406e2b0 0x7fddc4070770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdddc107900 0x7fdddc19dbe0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 --2- 172.21.15.46:0/2500502689 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdddc101900 0x7fdddc19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 >> 172.21.15.46:0/2500502689 conn(0x7fdddc0fd600 msgr2=0x7fdddc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 shutdown_connections 2024-09-21T12:44:38.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:38.514+0000 7fdde427e640 1 -- 172.21.15.46:0/2500502689 wait complete. 2024-09-21T12:44:38.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:38.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:44:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:44:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:38 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:39.206 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T12:44:39.206 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T12:44:39.207 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T12:44:39.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:39.207 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2024-09-21T12:44:39.226 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T12:44:39.226 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f0 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: altname enp7s0f1 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:39.227 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T12:44:39.228 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:44:39.228 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T12:44:39.228 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42317sec preferred_lft 42317sec 2024-09-21T12:44:39.228 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec4:7aff:fe88:6f61/64 scope link noprefixroute 2024-09-21T12:44:39.228 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:44:39.228 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T12:44:39.228 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:39.228 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-21T12:44:39.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2024-09-21T12:44:39.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2024-09-21T12:44:39.228 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2024-09-21T12:44:39.229 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T12:44:39.229 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-21T12:44:39.322 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:39 smithi046 ceph-mon[27868]: pgmap v188: 65 pgs: 65 active+clean; 581 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 171 B/s wr, 11 op/s 2024-09-21T12:44:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:39 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2500502689' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:44:39.446 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:39.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:39.454 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T12:44:39.468 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:39 smithi176 ceph-mon[35476]: pgmap v188: 65 pgs: 65 active+clean; 581 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 9.6 KiB/s rd, 171 B/s wr, 11 op/s 2024-09-21T12:44:39.468 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:39 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2500502689' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:44:39.478 INFO:teuthology.orchestra.run.smithi176.stdout:1 2024-09-21T12:44:39.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:39.480 DEBUG:teuthology.orchestra.run.smithi176:> route 2024-09-21T12:44:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2024-09-21T12:44:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T12:44:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T12:44:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T12:44:39.570 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T12:44:39.571 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:39.571 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-21T12:44:39.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T12:44:39.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T12:44:39.571 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T12:44:39.571 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-21T12:44:39.618 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:39.820 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:39.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:39.826 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2024-09-21T12:44:39.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:39.842 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2024-09-21T12:44:39.898 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:39.898 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-21T12:44:39.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:44:39.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T12:44:39.898 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-21T12:44:39.986 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:40.009 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:40.015 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T12:44:40.015 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T12:44:40.016 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-21T12:44:40.064 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:40.165 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:40.171 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:44:40.171 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2024-09-21T12:44:40.171 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2024-09-21T12:44:40.171 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T12:44:40.171 DEBUG:teuthology.orchestra.run.smithi176:> ') 2024-09-21T12:44:40.219 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:44:40.241 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:40.247 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-21T12:44:40.247 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:44:40.247 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:40.262 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T12:44:40.262 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:44:40.262 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:40.312 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-09-21T12:44:40.378 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:44:40.435 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-09-21T12:44:40.435 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-09-21T12:44:40.435 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/selinux 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-09-21T12:44:40.436 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/0 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/533cc8e3898354c152db0a9e6b76e204fe150d51635e36d727f9381d016b5ca8/merged 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/59d147dee7421e858736c68c1a1c8e03e30aff2fe502b004ced93a0212654e3f/merged 2024-09-21T12:44:40.437 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/79b35e0ec366019ed7f14fa3684965f3ca4b258b50a2a3243055b4f4fe04878e/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/b4ca13d6b3d774514ccc55b58cb02fe6d3f72556423644672ee4aaef73bc2ec7/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/05d06fd8c3b24c853af396adae99e789130810484fb2ef07ad78a437c094a6e8/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/68b75d991a2285ca74e8a5009410265d70abda8c59c1a1a5350aaa3a9e7411d0/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/d820a0c332244139effa648fe98803cae2a8e48571f8634adf32ce6e351b7ce6/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/d6f68328dbe7ee9734ad26862040f3ffdeaab15bc08a2fa6f77fdc7b29a9c0fd/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/a7e231d366cd86ade756c0db1692e20ac196b409c2dbe01c04ba314c9138191c/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/5a2c8941b63e1cfd61a64c42ef3134977cf6294f6a16e23a1611e09c49ff7f03/merged 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:44:40.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:40.439 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-09-21T12:44:40.491 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T12:44:40.492 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-21T12:44:40.534 DEBUG:teuthology.orchestra.run.smithi176:> sudo modprobe fuse 2024-09-21T12:44:40.559 DEBUG:teuthology.orchestra.run.smithi176:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:44:40.614 INFO:teuthology.orchestra.run.smithi176.stdout:/proc 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/sys 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/dev 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/security 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/shm 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/pts 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/run 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/cgroup 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/pstore 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/bpf 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/ 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/selinux 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:40.615 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/mqueue 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/dev/hugepages 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/debug 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/tracing 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/fs/fuse/connections 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/sys/kernel/config 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/1000 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/ceph 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/run/user/0 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:44:40.616 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/533cc8e3898354c152db0a9e6b76e204fe150d51635e36d727f9381d016b5ca8/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/59d147dee7421e858736c68c1a1c8e03e30aff2fe502b004ced93a0212654e3f/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/79b35e0ec366019ed7f14fa3684965f3ca4b258b50a2a3243055b4f4fe04878e/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/b4ca13d6b3d774514ccc55b58cb02fe6d3f72556423644672ee4aaef73bc2ec7/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/05d06fd8c3b24c853af396adae99e789130810484fb2ef07ad78a437c094a6e8/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/68b75d991a2285ca74e8a5009410265d70abda8c59c1a1a5350aaa3a9e7411d0/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/d820a0c332244139effa648fe98803cae2a8e48571f8634adf32ce6e351b7ce6/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/d6f68328dbe7ee9734ad26862040f3ffdeaab15bc08a2fa6f77fdc7b29a9c0fd/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/a7e231d366cd86ade756c0db1692e20ac196b409c2dbe01c04ba314c9138191c/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/var/lib/containers/storage/overlay/5a2c8941b63e1cfd61a64c42ef3134977cf6294f6a16e23a1611e09c49ff7f03/merged 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:44:40.617 INFO:teuthology.orchestra.run.smithi176.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:44:40.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:40.618 DEBUG:teuthology.orchestra.run.smithi176:> ls /sys/fs/fuse/connections 2024-09-21T12:44:40.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:2024-09-21T12:44:40.642+0000 7f90b6386480 -1 init, newargv = 0x55a9e7bab020 newargc=15 2024-09-21T12:44:40.643 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:ceph-fuse[61246]: starting ceph client 2024-09-21T12:44:40.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi176.stderr:ceph-fuse[61246]: starting fuse 2024-09-21T12:44:40.658 INFO:teuthology.orchestra.run.smithi176.stdout:129 2024-09-21T12:44:40.659 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> sudo stdin-killer -- python3 -c ' 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> import glob 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> import re 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> import os 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> import subprocess 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> def _find_admin_socket(client_name): 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-21T12:44:40.659 DEBUG:teuthology.orchestra.run.smithi176:> files = glob.glob(asok_path) 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> # Given a non-glob path, it better be there 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> if "*" not in asok_path: 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> assert(len(files) == 1) 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> return files[0] 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> for f in files: 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> contents = proc_f.read() 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> if mountpoint in contents: 2024-09-21T12:44:40.660 DEBUG:teuthology.orchestra.run.smithi176:> return f 2024-09-21T12:44:40.661 DEBUG:teuthology.orchestra.run.smithi176:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T12:44:40.661 DEBUG:teuthology.orchestra.run.smithi176:> 2024-09-21T12:44:40.661 DEBUG:teuthology.orchestra.run.smithi176:> print(_find_admin_socket("client.1")) 2024-09-21T12:44:40.661 DEBUG:teuthology.orchestra.run.smithi176:> ' 2024-09-21T12:44:40.720 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:40 smithi176 ceph-mon[35476]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 9.0 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T12:44:40.777 INFO:teuthology.orchestra.run.smithi176.stdout:/var/run/ceph/ceph-client.1.61246.asok 2024-09-21T12:44:40.780 INFO:teuthology.orchestra.run.smithi176.stderr:2024-09-21T12:44:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:44:40.787 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61246.asok 2024-09-21T12:44:40.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:40.787 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61246.asok status 2024-09-21T12:44:40.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:40 smithi046 ceph-mon[27868]: pgmap v189: 65 pgs: 65 active+clean; 581 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 9.0 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout:{ 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "metadata": { 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "entity_id": "1", 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "hostname": "smithi176", 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "pid": "61246", 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: "root": "/" 2024-09-21T12:44:40.919 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_count": 0, 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "dentry_pinned_count": 0, 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "id": 24329, 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "inst": { 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "name": { 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "client", 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "num": 24329 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 2508730095 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: } 2024-09-21T12:44:40.920 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": { 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v1", 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "nonce": 2508730095 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: }, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "inst_str": "client.24329 192.168.0.1:0/2508730095", 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "addr_str": "192.168.0.1:0/2508730095", 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "inode_count": 1, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "mds_epoch": 20, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch": 45, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "osd_epoch_barrier": 0, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "blocklisted": false, 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout: "fs_name": "cephfs" 2024-09-21T12:44:40.921 INFO:teuthology.orchestra.run.smithi176.stdout:} 2024-09-21T12:44:40.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:40.927 DEBUG:teuthology.orchestra.run.smithi046:> stat --file-system '--printf=%T 2024-09-21T12:44:40.927 DEBUG:teuthology.orchestra.run.smithi046:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:40.948 INFO:teuthology.orchestra.run.smithi046.stdout:fuseblk 2024-09-21T12:44:40.948 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:40.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:40.948 DEBUG:teuthology.orchestra.run.smithi046:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:41.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:41.022 DEBUG:teuthology.orchestra.run.smithi176:> stat --file-system '--printf=%T 2024-09-21T12:44:41.022 DEBUG:teuthology.orchestra.run.smithi176:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:41.038 INFO:teuthology.orchestra.run.smithi176.stdout:fuseblk 2024-09-21T12:44:41.038 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:41.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:44:41.038 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:41.499 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:44:41.517 INFO:teuthology.task.print:**** done client 2024-09-21T12:44:41.517 INFO:teuthology.run_tasks:Running task parallel... 2024-09-21T12:44:41.549 INFO:teuthology.task.parallel:starting parallel... 2024-09-21T12:44:41.549 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T12:44:41.549 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:44:41.550 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:44:41.550 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T12:44:41.550 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T12:44:41.551 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-21T12:44:41.555 INFO:tasks.workunit:Pulling workunits from ref 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:44:41.555 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T12:44:41.555 INFO:tasks.workunit:timeout=3h 2024-09-21T12:44:41.555 INFO:tasks.workunit:cleanup=True 2024-09-21T12:44:41.555 DEBUG:teuthology.orchestra.run.smithi046:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout:Device: 89h/137d Inode: 1 Links: 2 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout:Modify: 2024-09-21 12:44:16.380025247 +0000 2024-09-21T12:44:41.577 INFO:teuthology.orchestra.run.smithi046.stdout:Change: 2024-09-21 12:44:41.017218576 +0000 2024-09-21T12:44:41.578 INFO:teuthology.orchestra.run.smithi046.stdout: Birth: - 2024-09-21T12:44:41.578 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T12:44:41.578 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T12:44:41.652 DEBUG:teuthology.orchestra.run.smithi176:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T12:44:41.670 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2024-09-21 12:44:41.645978775 +0000 2024-09-21T12:44:41.671 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2024-09-21 12:44:41.645978775 +0000 2024-09-21T12:44:41.671 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2024-09-21T12:44:41.671 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T12:44:41.671 DEBUG:teuthology.orchestra.run.smithi176:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T12:44:41.741 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:44:41.742 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:44:41.759 INFO:tasks.workunit.client.0.smithi046.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T12:44:41.797 INFO:tasks.workunit.client.1.smithi176.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T12:44:41.838 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 -- 172.21.15.46:0/1790291473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30101960 msgr2=0x7efd30101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 --2- 172.21.15.46:0/1790291473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30101960 0x7efd30101d60 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efd2c009c20 tx=0x7efd2c02a970 comp rx=0 tx=0).stop 2024-09-21T12:44:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 -- 172.21.15.46:0/1790291473 shutdown_connections 2024-09-21T12:44:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 --2- 172.21.15.46:0/1790291473 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd30102b60 0x7efd30102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 --2- 172.21.15.46:0/1790291473 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30101960 0x7efd30101d60 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 -- 172.21.15.46:0/1790291473 >> 172.21.15.46:0/1790291473 conn(0x7efd300fd0f0 msgr2=0x7efd300ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 -- 172.21.15.46:0/1790291473 shutdown_connections 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.400+0000 7efd38312640 1 -- 172.21.15.46:0/1790291473 wait complete. 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd38312640 1 Processor -- start 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd38312640 1 -- start start 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd38312640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd30101960 0x7efd30075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd38312640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 0x7efd300745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd38312640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efd3010a7a0 con 0x7efd30102b60 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd38312640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efd3010a620 con 0x7efd30101960 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd358ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 0x7efd300745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd358ad640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 0x7efd300745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60582/0 (socket says 172.21.15.46:60582) 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd358ad640 1 -- 172.21.15.46:0/3700398682 learned_addr learned my addr 172.21.15.46:0/3700398682 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd360ae640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd30101960 0x7efd30075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd358ad640 1 -- 172.21.15.46:0/3700398682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd30101960 msgr2=0x7efd30075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd358ad640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd30101960 0x7efd30075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.401+0000 7efd358ad640 1 -- 172.21.15.46:0/3700398682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd30074b20 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.402+0000 7efd358ad640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 0x7efd300745e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d6f0 tx=0x7efd2000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.402+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd20017070 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.402+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efd2000de00 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.402+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd30074e10 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.402+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efd20004bb0 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.402+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd30075420 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.403+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd30101d60 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.404+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7efd20004e60 con 0x7efd30102b60 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.404+0000 7efd277fe640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7efd1c06e2b0 0x7efd1c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:42.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.404+0000 7efd360ae640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7efd1c06e2b0 0x7efd1c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:42.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.404+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7efd2008dd10 con 0x7efd30102b60 2024-09-21T12:44:42.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.405+0000 7efd360ae640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7efd1c06e2b0 0x7efd1c070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000f80 tx=0x7efd2c03c040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:42.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.409+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd2005f2c0 con 0x7efd30102b60 2024-09-21T12:44:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.585+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7efd30062df0 con 0x7efd30102b60 2024-09-21T12:44:42.587 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:42 smithi046 ceph-mon[27868]: pgmap v190: 65 pgs: 65 active+clean; 586 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-21T12:44:42.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.585+0000 7efd277fe640 1 -- 172.21.15.46:0/3700398682 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v39)=0 v39) ==== 155+0+0 (secure 0 0 0) 0x7efd20063af0 con 0x7efd30102b60 2024-09-21T12:44:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7efd1c06e2b0 msgr2=0x7efd1c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7efd1c06e2b0 0x7efd1c070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efd2c000f80 tx=0x7efd2c03c040 comp rx=0 tx=0).stop 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 msgr2=0x7efd300745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 0x7efd300745e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd2000d6f0 tx=0x7efd2000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 shutdown_connections 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7efd1c06e2b0 0x7efd1c070770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efd30102b60 0x7efd300745e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 --2- 172.21.15.46:0/3700398682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efd30101960 0x7efd30075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 >> 172.21.15.46:0/3700398682 conn(0x7efd300fd0f0 msgr2=0x7efd30105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 shutdown_connections 2024-09-21T12:44:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:42.587+0000 7efd38312640 1 -- 172.21.15.46:0/3700398682 wait complete. 2024-09-21T12:44:42.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:42 smithi176 ceph-mon[35476]: pgmap v190: 65 pgs: 65 active+clean; 586 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 8.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-09-21T12:44:43.222 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T12:44:43.535 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 -- 172.21.15.46:0/2867410093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4100860 msgr2=0x7f7ba4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 --2- 172.21.15.46:0/2867410093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4100860 0x7f7ba4100c60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7b98009880 tx=0x7f7b9802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 -- 172.21.15.46:0/2867410093 shutdown_connections 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 --2- 172.21.15.46:0/2867410093 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4101a60 0x7f7ba4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 --2- 172.21.15.46:0/2867410093 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4100860 0x7f7ba4100c60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 -- 172.21.15.46:0/2867410093 >> 172.21.15.46:0/2867410093 conn(0x7f7ba40fc010 msgr2=0x7f7ba40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 -- 172.21.15.46:0/2867410093 shutdown_connections 2024-09-21T12:44:44.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.029+0000 7f7baae4e640 1 -- 172.21.15.46:0/2867410093 wait complete. 2024-09-21T12:44:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7baae4e640 1 Processor -- start 2024-09-21T12:44:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7baae4e640 1 -- start start 2024-09-21T12:44:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7baae4e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4100860 0x7f7ba4197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7baae4e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 0x7f7ba4197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7baae4e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4109700 con 0x7f7ba4101a60 2024-09-21T12:44:44.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7baae4e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba4109580 con 0x7f7ba4100860 2024-09-21T12:44:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 0x7f7ba4197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:44.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 0x7f7ba4197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60606/0 (socket says 172.21.15.46:60606) 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba3fff640 1 -- 172.21.15.46:0/1305843330 learned_addr learned my addr 172.21.15.46:0/1305843330 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba8bea640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4100860 0x7f7ba4197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba3fff640 1 -- 172.21.15.46:0/1305843330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4100860 msgr2=0x7f7ba4197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba3fff640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4100860 0x7f7ba4197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba3fff640 1 -- 172.21.15.46:0/1305843330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba4198130 con 0x7f7ba4101a60 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.030+0000 7f7ba8bea640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4100860 0x7f7ba4197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.031+0000 7f7ba3fff640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 0x7f7ba4197ab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b420 tx=0x7f7b9000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.031+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b90011630 con 0x7f7ba4101a60 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.031+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba419cb70 con 0x7f7ba4101a60 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.031+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b90016070 con 0x7f7ba4101a60 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.031+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b90010d40 con 0x7f7ba4101a60 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.031+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba419d180 con 0x7f7ba4101a60 2024-09-21T12:44:44.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.032+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba4100c60 con 0x7f7ba4101a60 2024-09-21T12:44:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.032+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f7b9001b460 con 0x7f7ba4101a60 2024-09-21T12:44:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.033+0000 7f7ba1ffb640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f7b9406e2b0 0x7f7b94070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.033+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f7b9008dae0 con 0x7f7ba4101a60 2024-09-21T12:44:44.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.033+0000 7f7ba8bea640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f7b9406e2b0 0x7f7b94070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:44.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.033+0000 7f7ba8bea640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f7b9406e2b0 0x7f7b94070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b98000c00 tx=0x7f7b98005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:44.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.037+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b9005b3e0 con 0x7f7ba4101a60 2024-09-21T12:44:44.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.212+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f7ba419db10 con 0x7f7ba4101a60 2024-09-21T12:44:44.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.213+0000 7f7ba1ffb640 1 -- 172.21.15.46:0/1305843330 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v39)=0 v39) ==== 163+0+0 (secure 0 0 0) 0x7f7b9005f090 con 0x7f7ba4101a60 2024-09-21T12:44:44.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f7b9406e2b0 msgr2=0x7f7b94070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:44.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f7b9406e2b0 0x7f7b94070770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7b98000c00 tx=0x7f7b98005a20 comp rx=0 tx=0).stop 2024-09-21T12:44:44.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 msgr2=0x7f7ba4197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:44.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 0x7f7ba4197ab0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000b420 tx=0x7f7b9000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 shutdown_connections 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f7b9406e2b0 0x7f7b94070770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ba4101a60 0x7f7ba4197ab0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 --2- 172.21.15.46:0/1305843330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ba4100860 0x7f7ba4197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 >> 172.21.15.46:0/1305843330 conn(0x7f7ba40fc010 msgr2=0x7f7ba4069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 shutdown_connections 2024-09-21T12:44:44.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:44.215+0000 7f7baae4e640 1 -- 172.21.15.46:0/1305843330 wait complete. 2024-09-21T12:44:44.573 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:44 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:44.574 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:44 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:44 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:44:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:44 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:44.869 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T12:44:45.132 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:45.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:45 smithi046 ceph-mon[27868]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T12:44:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 -- 172.21.15.46:0/1081983416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 msgr2=0x7f30ec104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 --2- 172.21.15.46:0/1081983416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec104880 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009c20 tx=0x7f30dc02a970 comp rx=0 tx=0).stop 2024-09-21T12:44:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 -- 172.21.15.46:0/1081983416 shutdown_connections 2024-09-21T12:44:45.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 --2- 172.21.15.46:0/1081983416 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30ec104dc0 0x7f30ec1071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 --2- 172.21.15.46:0/1081983416 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec104880 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 -- 172.21.15.46:0/1081983416 >> 172.21.15.46:0/1081983416 conn(0x7f30ec0fc010 msgr2=0x7f30ec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 -- 172.21.15.46:0/1081983416 shutdown_connections 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.604+0000 7f30f1030640 1 -- 172.21.15.46:0/1081983416 wait complete. 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.605+0000 7f30f1030640 1 Processor -- start 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.605+0000 7f30f1030640 1 -- start start 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.605+0000 7f30f1030640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.605+0000 7f30f1030640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30ec104dc0 0x7f30ec197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.605+0000 7f30f1030640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10a7d0 con 0x7f30ec102490 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.605+0000 7f30f1030640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f30ec10a650 con 0x7f30ec104dc0 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60630/0 (socket says 172.21.15.46:60630) 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 -- 172.21.15.46:0/2459195254 learned_addr learned my addr 172.21.15.46:0/2459195254 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:45.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ea59c640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30ec104dc0 0x7f30ec197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 -- 172.21.15.46:0/2459195254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30ec104dc0 msgr2=0x7f30ec197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30ec104dc0 0x7f30ec197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 -- 172.21.15.46:0/2459195254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ec1980f0 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30ead9d640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec197530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009d40 tx=0x7f30dc02f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30dc047070 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ec19cad0 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f30dc003e30 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f30dc034070 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.606+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ec19d060 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.607+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ec102870 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.608+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f30dc04a070 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.608+0000 7f30d3fff640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f30d406e2b0 0x7f30d4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.609+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f30dc0af0c0 con 0x7f30ec102490 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.609+0000 7f30ea59c640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f30d406e2b0 0x7f30d4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:45.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.609+0000 7f30ea59c640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f30d406e2b0 0x7f30d4070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30ec1989e0 tx=0x7f30e000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:45.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.616+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f30dc03f070 con 0x7f30ec102490 2024-09-21T12:44:45.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.796+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f30ec19d380 con 0x7f30ec102490 2024-09-21T12:44:45.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.796+0000 7f30d3fff640 1 -- 172.21.15.46:0/2459195254 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v39)=0 v39) ==== 135+0+0 (secure 0 0 0) 0x7f30dc0806f0 con 0x7f30ec102490 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f30d406e2b0 msgr2=0x7f30d4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f30d406e2b0 0x7f30d4070770 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f30ec1989e0 tx=0x7f30e000b390 comp rx=0 tx=0).stop 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 msgr2=0x7f30ec197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec197530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f30dc009d40 tx=0x7f30dc02f730 comp rx=0 tx=0).stop 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 shutdown_connections 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f30d406e2b0 0x7f30d4070770 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f30ec104dc0 0x7f30ec197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 --2- 172.21.15.46:0/2459195254 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f30ec102490 0x7f30ec197530 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.798+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 >> 172.21.15.46:0/2459195254 conn(0x7f30ec0fc010 msgr2=0x7f30ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.799+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 shutdown_connections 2024-09-21T12:44:45.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:45.799+0000 7f30f1030640 1 -- 172.21.15.46:0/2459195254 wait complete. 2024-09-21T12:44:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:45 smithi176 ceph-mon[35476]: pgmap v191: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2024-09-21T12:44:46.402 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-21T12:44:46.666 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 -- 172.21.15.46:0/1770155250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94101a60 msgr2=0x7f1b94101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1770155250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94101a60 0x7f1b94101ee0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009880 tx=0x7f1b7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 -- 172.21.15.46:0/1770155250 shutdown_connections 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1770155250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94101a60 0x7f1b94101ee0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1770155250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b94100860 0x7f1b94100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 -- 172.21.15.46:0/1770155250 >> 172.21.15.46:0/1770155250 conn(0x7f1b940fc010 msgr2=0x7f1b940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:44:47.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 -- 172.21.15.46:0/1770155250 shutdown_connections 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 -- 172.21.15.46:0/1770155250 wait complete. 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 Processor -- start 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.086+0000 7f1b99db7640 1 -- start start 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b99db7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 0x7f1b94104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b99db7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b94101a60 0x7f1b94103120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b99db7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1b941096a0 con 0x7f1b94100860 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b99db7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b94109520 con 0x7f1b94101a60 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 0x7f1b94104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 0x7f1b94104a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60644/0 (socket says 172.21.15.46:60644) 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 -- 172.21.15.46:0/1551003607 learned_addr learned my addr 172.21.15.46:0/1551003607 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b8affd640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b94101a60 0x7f1b94103120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:47.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 -- 172.21.15.46:0/1551003607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b94101a60 msgr2=0x7f1b94103120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b94101a60 0x7f1b94103120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 -- 172.21.15.46:0/1551003607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b94103660 con 0x7f1b94100860 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b937fe640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 0x7f1b94104a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400d8d0 tx=0x7f1b8400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.087+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b84017070 con 0x7f1b94100860 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.088+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b94103950 con 0x7f1b94100860 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.088+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b8400be10 con 0x7f1b94100860 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.088+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b8400f3c0 con 0x7f1b94100860 2024-09-21T12:44:47.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.088+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b94103eb0 con 0x7f1b94100860 2024-09-21T12:44:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.089+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b94100c60 con 0x7f1b94100860 2024-09-21T12:44:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.089+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1b8401a070 con 0x7f1b94100860 2024-09-21T12:44:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.090+0000 7f1b917fa640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1b8006e2b0 0x7f1b80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:44:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.090+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f1b8408dd70 con 0x7f1b94100860 2024-09-21T12:44:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.090+0000 7f1b8affd640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1b8006e2b0 0x7f1b80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:44:47.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.090+0000 7f1b8affd640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1b8006e2b0 0x7f1b80070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c000c00 tx=0x7f1b7c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:44:47.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.094+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b8405f320 con 0x7f1b94100860 2024-09-21T12:44:47.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:44:47.284+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f1b94062630 con 0x7f1b8006e2b0 2024-09-21T12:44:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:47 smithi046 ceph-mon[27868]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T12:44:47.760 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:47 smithi176 ceph-mon[35476]: pgmap v192: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T12:44:48.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:48 smithi046 ceph-mon[27868]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:48 smithi176 ceph-mon[35476]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:44:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:49 smithi046 ceph-mon[27868]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T12:44:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:49 smithi176 ceph-mon[35476]: pgmap v193: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 1.2 KiB/s wr, 5 op/s 2024-09-21T12:44:51.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:51 smithi046 ceph-mon[27868]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T12:44:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:51 smithi176 ceph-mon[35476]: pgmap v194: 65 pgs: 65 active+clean; 587 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-21T12:44:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:53 smithi046 ceph-mon[27868]: pgmap v195: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T12:44:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:53 smithi176 ceph-mon[35476]: pgmap v195: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.7 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-21T12:44:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:55 smithi046 ceph-mon[27868]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T12:44:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:55 smithi176 ceph-mon[35476]: pgmap v196: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 938 B/s wr, 5 op/s 2024-09-21T12:44:57.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:57 smithi046 ceph-mon[27868]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:44:57.760 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:57 smithi176 ceph-mon[35476]: pgmap v197: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:44:58.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:44:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:44:59 smithi046 ceph-mon[27868]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:44:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:44:59 smithi176 ceph-mon[35476]: pgmap v198: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:45:00.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:00 smithi046 ceph-mon[27868]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:45:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:00 smithi176 ceph-mon[35476]: pgmap v199: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:45:02.760 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:02 smithi176 ceph-mon[35476]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T12:45:02.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:02 smithi046 ceph-mon[27868]: pgmap v200: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-21T12:45:04.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:04 smithi176 ceph-mon[35476]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:45:04.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:04 smithi046 ceph-mon[27868]: pgmap v201: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:45:06.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:06 smithi176 ceph-mon[35476]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T12:45:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:06 smithi046 ceph-mon[27868]: pgmap v202: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 3 op/s 2024-09-21T12:45:08.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:08 smithi176 ceph-mon[35476]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:45:08.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:08 smithi046 ceph-mon[27868]: pgmap v203: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:45:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:10 smithi176 ceph-mon[35476]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:10.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:10 smithi046 ceph-mon[27868]: pgmap v204: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:12.760 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:12 smithi176 ceph-mon[35476]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:12.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:12 smithi046 ceph-mon[27868]: pgmap v205: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:13.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:14 smithi176 ceph-mon[35476]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:14.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:14 smithi046 ceph-mon[27868]: pgmap v206: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:16.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:16 smithi046 ceph-mon[27868]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:16 smithi176 ceph-mon[35476]: pgmap v207: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:18.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:18 smithi176 ceph-mon[35476]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:18.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:18 smithi046 ceph-mon[27868]: pgmap v208: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:20.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:20 smithi046 ceph-mon[27868]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:20 smithi176 ceph-mon[35476]: pgmap v209: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:21.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.321+0000 7f1b917fa640 1 -- 172.21.15.46:0/1551003607 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f1b94062630 con 0x7f1b8006e2b0 2024-09-21T12:45:21.323 INFO:teuthology.orchestra.run.smithi046.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:45:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1b8006e2b0 msgr2=0x7f1b80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1b8006e2b0 0x7f1b80070770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c000c00 tx=0x7f1b7c0058d0 comp rx=0 tx=0).stop 2024-09-21T12:45:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 msgr2=0x7f1b94104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:21.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 0x7f1b94104a60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1b8400d8d0 tx=0x7f1b8400dd90 comp rx=0 tx=0).stop 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 shutdown_connections 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f1b8006e2b0 0x7f1b80070770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b94101a60 0x7f1b94103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 --2- 172.21.15.46:0/1551003607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b94100860 0x7f1b94104a60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.324+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 >> 172.21.15.46:0/1551003607 conn(0x7f1b940fc010 msgr2=0x7f1b940fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.325+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 shutdown_connections 2024-09-21T12:45:21.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:21.325+0000 7f1b99db7640 1 -- 172.21.15.46:0/1551003607 wait complete. 2024-09-21T12:45:22.144 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T12:45:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:22 smithi046 ceph-mon[27868]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:45:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:45:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:45:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:45:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:22 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:22.464 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:45:22.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:22 smithi176 ceph-mon[35476]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:45:22.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:22.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:45:22.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:45:22.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:45:22.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:22 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:23.395 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:23 smithi046 ceph-mon[27868]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:45:23.395 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:23 smithi046 ceph-mon[27868]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.412+0000 7f1797bb0640 1 -- 172.21.15.46:0/122543304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17901023f0 msgr2=0x7f17901047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.412+0000 7f1797bb0640 1 --2- 172.21.15.46:0/122543304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17901023f0 0x7f17901047e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f178c0098b0 tx=0x7f178c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.413+0000 7f1797bb0640 1 -- 172.21.15.46:0/122543304 shutdown_connections 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.413+0000 7f1797bb0640 1 --2- 172.21.15.46:0/122543304 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1790104d20 0x7f1790107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.413+0000 7f1797bb0640 1 --2- 172.21.15.46:0/122543304 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f17901023f0 0x7f17901047e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.413+0000 7f1797bb0640 1 -- 172.21.15.46:0/122543304 >> 172.21.15.46:0/122543304 conn(0x7f17900fc010 msgr2=0x7f17900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.413+0000 7f1797bb0640 1 -- 172.21.15.46:0/122543304 shutdown_connections 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.413+0000 7f1797bb0640 1 -- 172.21.15.46:0/122543304 wait complete. 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.414+0000 7f1797bb0640 1 Processor -- start 2024-09-21T12:45:23.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.414+0000 7f1797bb0640 1 -- start start 2024-09-21T12:45:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f1797bb0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17901023f0 0x7f1790101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f1797bb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 0x7f17901003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f179594c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17901023f0 0x7f1790101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f179514b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 0x7f17901003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f179594c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17901023f0 0x7f1790101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:50710/0 (socket says 172.21.15.46:50710) 2024-09-21T12:45:23.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f179514b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 0x7f17901003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50328/0 (socket says 172.21.15.46:50328) 2024-09-21T12:45:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f179594c640 1 -- 172.21.15.46:0/361060660 learned_addr learned my addr 172.21.15.46:0/361060660 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f179010a7e0 con 0x7f1790104d20 2024-09-21T12:45:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.415+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f179010a660 con 0x7f17901023f0 2024-09-21T12:45:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f179514b640 1 -- 172.21.15.46:0/361060660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17901023f0 msgr2=0x7f1790101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f179514b640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17901023f0 0x7f1790101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f179514b640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17901008e0 con 0x7f1790104d20 2024-09-21T12:45:23.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f179514b640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 0x7f17901003a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f178000ea80 tx=0x7f178000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f178000ca30 con 0x7f1790104d20 2024-09-21T12:45:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1790100bd0 con 0x7f1790104d20 2024-09-21T12:45:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.416+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1790101160 con 0x7f1790104d20 2024-09-21T12:45:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.417+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f178000cbd0 con 0x7f1790104d20 2024-09-21T12:45:23.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.417+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17800047a0 con 0x7f1790104d20 2024-09-21T12:45:23.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.419+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17740052c0 con 0x7f1790104d20 2024-09-21T12:45:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.419+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f1780004aa0 con 0x7f1790104d20 2024-09-21T12:45:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.420+0000 7f1786ffd640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f177c06e350 0x7f177c070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:23.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.420+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f178008e5f0 con 0x7f1790104d20 2024-09-21T12:45:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.421+0000 7f179594c640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f177c06e350 0x7f177c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:23.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.421+0000 7f179594c640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f177c06e350 0x7f177c070810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c009620 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:23.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.426+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f178005bed0 con 0x7f1790104d20 2024-09-21T12:45:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.626+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1774000bf0 con 0x7f177c06e350 2024-09-21T12:45:23.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.627+0000 7f1786ffd640 1 -- 172.21.15.46:0/361060660 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f1774000bf0 con 0x7f177c06e350 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f177c06e350 msgr2=0x7f177c070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f177c06e350 0x7f177c070810 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f178c000c00 tx=0x7f178c009620 comp rx=0 tx=0).stop 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 msgr2=0x7f17901003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 0x7f17901003a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f178000ea80 tx=0x7f178000ef40 comp rx=0 tx=0).stop 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 shutdown_connections 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f177c06e350 0x7f177c070810 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1790104d20 0x7f17901003a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 --2- 172.21.15.46:0/361060660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17901023f0 0x7f1790101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.630+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 >> 172.21.15.46:0/361060660 conn(0x7f17900fc010 msgr2=0x7f17900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:23.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.631+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 shutdown_connections 2024-09-21T12:45:23.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.631+0000 7f1797bb0640 1 -- 172.21.15.46:0/361060660 wait complete. 2024-09-21T12:45:23.644 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:45:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/2794426786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 msgr2=0x7fdbe0109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/2794426786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 0x7fdbe0109670 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0009880 tx=0x7fdbd002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/2794426786 shutdown_connections 2024-09-21T12:45:23.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/2794426786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 0x7fdbe0109670 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/2794426786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe0073680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/2794426786 >> 172.21.15.46:0/2794426786 conn(0x7fdbe006ea50 msgr2=0x7fdbe0070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/2794426786 shutdown_connections 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.771+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/2794426786 wait complete. 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.772+0000 7fdbe4ff9640 1 Processor -- start 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.772+0000 7fdbe4ff9640 1 -- start start 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.772+0000 7fdbe4ff9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe01a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:23.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbe4ff9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 0x7fdbe01a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbe4ff9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01195b0 con 0x7fdbe01091f0 2024-09-21T12:45:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbe4ff9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0119430 con 0x7fdbe00732a0 2024-09-21T12:45:23.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbde59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe01a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbde59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe01a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:50734/0 (socket says 172.21.15.46:50734) 2024-09-21T12:45:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbde59c640 1 -- 172.21.15.46:0/1399904506 learned_addr learned my addr 172.21.15.46:0/1399904506 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.773+0000 7fdbddd9b640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 0x7fdbe01a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbde59c640 1 -- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 msgr2=0x7fdbe01a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:23.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbde59c640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 0x7fdbe01a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbde59c640 1 -- 172.21.15.46:0/1399904506 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe01a6e50 con 0x7fdbe00732a0 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbde59c640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe01a6290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e940 tx=0x7fdbd400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbd400cb80 con 0x7fdbe00732a0 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdbd400cd20 con 0x7fdbe00732a0 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.774+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdbd4018810 con 0x7fdbe00732a0 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.775+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe01ab890 con 0x7fdbe00732a0 2024-09-21T12:45:23.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.775+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe01abdf0 con 0x7fdbe00732a0 2024-09-21T12:45:23.778 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.777+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe0119d90 con 0x7fdbe00732a0 2024-09-21T12:45:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.778+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdbd40189f0 con 0x7fdbe00732a0 2024-09-21T12:45:23.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.778+0000 7fdbcf7fe640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdbc806e350 0x7fdbc8070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.778+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fdbd408e880 con 0x7fdbe00732a0 2024-09-21T12:45:23.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.779+0000 7fdbddd9b640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdbc806e350 0x7fdbc8070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:23.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.780+0000 7fdbddd9b640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdbc806e350 0x7fdbc8070810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0000c00 tx=0x7fdbd0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:23.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:23.787+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdbd4054210 con 0x7fdbe00732a0 2024-09-21T12:45:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:23 smithi176 ceph-mon[35476]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:45:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:23 smithi176 ceph-mon[35476]: pgmap v210: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:24.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.013+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdbe002dbc0 con 0x7fdbc806e350 2024-09-21T12:45:24.016 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.015+0000 7fdbcf7fe640 1 -- 172.21.15.46:0/1399904506 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fdbd0004340 con 0x7fdbc806e350 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdbc806e350 msgr2=0x7fdbc8070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdbc806e350 0x7fdbc8070810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0000c00 tx=0x7fdbd0005a20 comp rx=0 tx=0).stop 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 msgr2=0x7fdbe01a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe01a6290 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdbd400e940 tx=0x7fdbd400ee00 comp rx=0 tx=0).stop 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 shutdown_connections 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdbc806e350 0x7fdbc8070810 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdbe01091f0 0x7fdbe01a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 --2- 172.21.15.46:0/1399904506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdbe00732a0 0x7fdbe01a6290 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 >> 172.21.15.46:0/1399904506 conn(0x7fdbe006ea50 msgr2=0x7fdbe010c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 shutdown_connections 2024-09-21T12:45:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.017+0000 7fdbe4ff9640 1 -- 172.21.15.46:0/1399904506 wait complete. 2024-09-21T12:45:24.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.107+0000 7fdc2000b640 1 -- 172.21.15.46:0/1136099171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc18101a60 msgr2=0x7fdc18101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.107+0000 7fdc2000b640 1 --2- 172.21.15.46:0/1136099171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc18101a60 0x7fdc18101ee0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009880 tx=0x7fdc0802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.108+0000 7fdc2000b640 1 -- 172.21.15.46:0/1136099171 shutdown_connections 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.108+0000 7fdc2000b640 1 --2- 172.21.15.46:0/1136099171 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc18101a60 0x7fdc18101ee0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.108+0000 7fdc2000b640 1 --2- 172.21.15.46:0/1136099171 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 0x7fdc18100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.108+0000 7fdc2000b640 1 -- 172.21.15.46:0/1136099171 >> 172.21.15.46:0/1136099171 conn(0x7fdc180fc010 msgr2=0x7fdc180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.108+0000 7fdc2000b640 1 -- 172.21.15.46:0/1136099171 shutdown_connections 2024-09-21T12:45:24.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.108+0000 7fdc2000b640 1 -- 172.21.15.46:0/1136099171 wait complete. 2024-09-21T12:45:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc2000b640 1 Processor -- start 2024-09-21T12:45:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc2000b640 1 -- start start 2024-09-21T12:45:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc2000b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 0x7fdc180734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc2000b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180739f0 0x7fdc181a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:24.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc2000b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1810a780 con 0x7fdc180739f0 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc2000b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1810a600 con 0x7fdc18100860 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc1d5a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180739f0 0x7fdc181a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc1d5a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180739f0 0x7fdc181a53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50372/0 (socket says 172.21.15.46:50372) 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc1dda7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 0x7fdc180734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.109+0000 7fdc1d5a6640 1 -- 172.21.15.46:0/2944068103 learned_addr learned my addr 172.21.15.46:0/2944068103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc1dda7640 1 -- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180739f0 msgr2=0x7fdc181a53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc1dda7640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180739f0 0x7fdc181a53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc1dda7640 1 -- 172.21.15.46:0/2944068103 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc18073f20 con 0x7fdc18100860 2024-09-21T12:45:24.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc1dda7640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 0x7fdc180734b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400e940 tx=0x7fdc1400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc1400cac0 con 0x7fdc18100860 2024-09-21T12:45:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc181a5930 con 0x7fdc18100860 2024-09-21T12:45:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc1400cc60 con 0x7fdc18100860 2024-09-21T12:45:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc181a5e30 con 0x7fdc18100860 2024-09-21T12:45:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.110+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc14003e10 con 0x7fdc18100860 2024-09-21T12:45:24.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.112+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc1810af60 con 0x7fdc18100860 2024-09-21T12:45:24.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.113+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fdc14004020 con 0x7fdc18100860 2024-09-21T12:45:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.113+0000 7fdc0effd640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdc0406e2b0 0x7fdc04070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.114+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fdc1408e860 con 0x7fdc18100860 2024-09-21T12:45:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.114+0000 7fdc1d5a6640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdc0406e2b0 0x7fdc04070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:24.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.115+0000 7fdc1d5a6640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdc0406e2b0 0x7fdc04070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005ab0 tx=0x7fdc08005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:24.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.122+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc1405c0d0 con 0x7fdc18100860 2024-09-21T12:45:24.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.370+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdc1802dba0 con 0x7fdc0406e2b0 2024-09-21T12:45:24.392 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:45:24.392 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (4m) 47s ago 6m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:45:24.392 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (6m) 47s ago 6m 8270k - 19.1.1-373-g4e45e6b4 164465d2334a f8608c24a9a8 2024-09-21T12:45:24.392 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (5m) 50s ago 5m 9411k - 19.1.1-373-g4e45e6b4 164465d2334a 3c8b950c3981 2024-09-21T12:45:24.392 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (6m) 47s ago 6m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (5m) 50s ago 5m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (4m) 47s ago 6m 82.4M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (69s) 47s ago 68s 12.3M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (63s) 47s ago 62s 16.8M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (66s) 50s ago 66s 15.7M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (60s) 50s ago 59s 14.3M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:9283,8765,8443 running (7m) 47s ago 7m 500M - 19.1.1-373-g4e45e6b4 164465d2334a a9438678095d 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (5m) 50s ago 5m 440M - 19.1.1-373-g4e45e6b4 164465d2334a 918a325e02f4 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (7m) 47s ago 7m 47.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (5m) 50s ago 5m 38.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 47s ago 6m 14.1M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (5m) 50s ago 5m 15.2M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 47s ago 4m 48.7M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:45:24.393 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 47s ago 3m 47.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 47s ago 3m 45.7M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (3m) 50s ago 3m 44.6M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (2m) 50s ago 2m 43.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (2m) 50s ago 2m 41.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 47s ago 6m 58.8M - 2.43.0 a07b618ecd1d 965906d87e59 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.389+0000 7fdc0effd640 1 -- 172.21.15.46:0/2944068103 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7fdc1802dba0 con 0x7fdc0406e2b0 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdc0406e2b0 msgr2=0x7fdc04070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdc0406e2b0 0x7fdc04070770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdc08005ab0 tx=0x7fdc08005a20 comp rx=0 tx=0).stop 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 msgr2=0x7fdc180734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 0x7fdc180734b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400e940 tx=0x7fdc1400ee00 comp rx=0 tx=0).stop 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 shutdown_connections 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fdc0406e2b0 0x7fdc04070770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdc180739f0 0x7fdc181a53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 --2- 172.21.15.46:0/2944068103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdc18100860 0x7fdc180734b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 >> 172.21.15.46:0/2944068103 conn(0x7fdc180fc010 msgr2=0x7fdc18105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 shutdown_connections 2024-09-21T12:45:24.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.392+0000 7fdc2000b640 1 -- 172.21.15.46:0/2944068103 wait complete. 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 -- 172.21.15.46:0/563451763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0101960 msgr2=0x7f2fd0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/563451763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0101960 0x7f2fd0101d60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009880 tx=0x7f2fc002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 -- 172.21.15.46:0/563451763 shutdown_connections 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/563451763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0102b60 0x7f2fd0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/563451763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0101960 0x7f2fd0101d60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 -- 172.21.15.46:0/563451763 >> 172.21.15.46:0/563451763 conn(0x7f2fd00fd110 msgr2=0x7f2fd00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 -- 172.21.15.46:0/563451763 shutdown_connections 2024-09-21T12:45:24.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.499+0000 7f2fd64b8640 1 -- 172.21.15.46:0/563451763 wait complete. 2024-09-21T12:45:24.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fd64b8640 1 Processor -- start 2024-09-21T12:45:24.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fd64b8640 1 -- start start 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fd64b8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 0x7f2fd0194680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fd64b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0102b60 0x7f2fd0194bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fd64b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd010a7a0 con 0x7f2fd0102b60 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fd64b8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd010a620 con 0x7f2fd0101960 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fcffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 0x7f2fd0194680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fcffff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 0x7f2fd0194680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:50772/0 (socket says 172.21.15.46:50772) 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.500+0000 7f2fcffff640 1 -- 172.21.15.46:0/3460274672 learned_addr learned my addr 172.21.15.46:0/3460274672 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.501+0000 7f2fc7fff640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0102b60 0x7f2fd0194bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.501+0000 7f2fcffff640 1 -- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0102b60 msgr2=0x7f2fd0194bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.501+0000 7f2fcffff640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0102b60 0x7f2fd0194bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.501+0000 7f2fcffff640 1 -- 172.21.15.46:0/3460274672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd0195240 con 0x7f2fd0101960 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.501+0000 7f2fcffff640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 0x7f2fd0194680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009230 tx=0x7f2fc00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:24.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.501+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fc003f070 con 0x7f2fd0101960 2024-09-21T12:45:24.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.502+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fc00049d0 con 0x7f2fd0101960 2024-09-21T12:45:24.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.502+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd0199c20 con 0x7f2fd0101960 2024-09-21T12:45:24.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.502+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fc0035030 con 0x7f2fd0101960 2024-09-21T12:45:24.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.502+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd019a0f0 con 0x7f2fd0101960 2024-09-21T12:45:24.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.503+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd0101d60 con 0x7f2fd0101960 2024-09-21T12:45:24.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.504+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f2fc0042070 con 0x7f2fd0101960 2024-09-21T12:45:24.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.505+0000 7f2fcdffb640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f2fbc06e350 0x7f2fbc070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:24.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.505+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f2fc00aecd0 con 0x7f2fd0101960 2024-09-21T12:45:24.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.505+0000 7f2fc7fff640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f2fbc06e350 0x7f2fbc070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:24.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.506+0000 7f2fc7fff640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f2fbc06e350 0x7f2fbc070810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0195b30 tx=0x7f2fb8005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:24.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:24.513+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fc00b4020 con 0x7f2fd0101960 2024-09-21T12:45:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:24 smithi046 ceph-mon[27868]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:24 smithi046 ceph-mon[27868]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:24 smithi046 ceph-mon[27868]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:24 smithi046 ceph-mon[27868]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:24 smithi176 ceph-mon[35476]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:24 smithi176 ceph-mon[35476]: from='client.24351 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:24 smithi176 ceph-mon[35476]: from='client.24355 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:24 smithi176 ceph-mon[35476]: pgmap v211: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:25.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.018+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2fd019ab10 con 0x7f2fd0101960 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.019+0000 7f2fcdffb640 1 -- 172.21.15.46:0/3460274672 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f2fc007c5b0 con 0x7f2fd0101960 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:45:25.020 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:45:25.021 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:45:25.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f2fbc06e350 msgr2=0x7f2fbc070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:25.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f2fbc06e350 0x7f2fbc070810 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0195b30 tx=0x7f2fb8005f90 comp rx=0 tx=0).stop 2024-09-21T12:45:25.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 msgr2=0x7f2fd0194680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:25.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 0x7f2fd0194680 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2fc0009230 tx=0x7f2fc00045e0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 shutdown_connections 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f2fbc06e350 0x7f2fbc070810 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fd0102b60 0x7f2fd0194bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 --2- 172.21.15.46:0/3460274672 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fd0101960 0x7f2fd0194680 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 >> 172.21.15.46:0/3460274672 conn(0x7f2fd00fd110 msgr2=0x7f2fd00746b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 shutdown_connections 2024-09-21T12:45:25.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.022+0000 7f2fd64b8640 1 -- 172.21.15.46:0/3460274672 wait complete. 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 -- 172.21.15.46:0/1095290591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c101960 msgr2=0x7feb3c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 --2- 172.21.15.46:0/1095290591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c101960 0x7feb3c101d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb38009880 tx=0x7feb3802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 -- 172.21.15.46:0/1095290591 shutdown_connections 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 --2- 172.21.15.46:0/1095290591 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 0x7feb3c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 --2- 172.21.15.46:0/1095290591 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c101960 0x7feb3c101d60 secure :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7feb38009880 tx=0x7feb3802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 -- 172.21.15.46:0/1095290591 >> 172.21.15.46:0/1095290591 conn(0x7feb3c0fd110 msgr2=0x7feb3c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 -- 172.21.15.46:0/1095290591 shutdown_connections 2024-09-21T12:45:25.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.113+0000 7feb435ea640 1 -- 172.21.15.46:0/1095290591 wait complete. 2024-09-21T12:45:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.114+0000 7feb435ea640 1 Processor -- start 2024-09-21T12:45:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.114+0000 7feb435ea640 1 -- start start 2024-09-21T12:45:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.114+0000 7feb435ea640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 0x7feb3c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.114+0000 7feb435ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 0x7feb3c074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.114+0000 7feb435ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c10a7a0 con 0x7feb3c0745e0 2024-09-21T12:45:25.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.114+0000 7feb435ea640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c10a620 con 0x7feb3c102b60 2024-09-21T12:45:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb40b85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 0x7feb3c074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb41386640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 0x7feb3c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb41386640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 0x7feb3c075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:50792/0 (socket says 172.21.15.46:50792) 2024-09-21T12:45:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb40b85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 0x7feb3c074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50398/0 (socket says 172.21.15.46:50398) 2024-09-21T12:45:25.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb41386640 1 -- 172.21.15.46:0/2716733604 learned_addr learned my addr 172.21.15.46:0/2716733604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb40b85640 1 -- 172.21.15.46:0/2716733604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 msgr2=0x7feb3c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb40b85640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 0x7feb3c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.115+0000 7feb40b85640 1 -- 172.21.15.46:0/2716733604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c19b310 con 0x7feb3c0745e0 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.116+0000 7feb40b85640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 0x7feb3c074a60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00d6a0 tx=0x7feb2c00db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.116+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb2c017070 con 0x7feb3c0745e0 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.116+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feb2c0054e0 con 0x7feb3c0745e0 2024-09-21T12:45:25.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.116+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c074fa0 con 0x7feb3c0745e0 2024-09-21T12:45:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.117+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feb2c004af0 con 0x7feb3c0745e0 2024-09-21T12:45:25.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.117+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c1a3f10 con 0x7feb3c0745e0 2024-09-21T12:45:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.118+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7feb2c0097c0 con 0x7feb3c0745e0 2024-09-21T12:45:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.119+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c10af80 con 0x7feb3c0745e0 2024-09-21T12:45:25.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.119+0000 7feb327fc640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7feb2806e310 0x7feb280707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.119+0000 7feb41386640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7feb2806e310 0x7feb280707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.120+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7feb2c08d1c0 con 0x7feb3c0745e0 2024-09-21T12:45:25.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.120+0000 7feb41386640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7feb2806e310 0x7feb280707d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb380096c0 tx=0x7feb380058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:25.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.124+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7feb2c05e6d0 con 0x7feb3c0745e0 2024-09-21T12:45:25.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.320+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feb3c02da80 con 0x7feb2806e310 2024-09-21T12:45:25.323 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:45:25.323 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 image on host smithi176", 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:45:25.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.321+0000 7feb327fc640 1 -- 172.21.15.46:0/2716733604 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7feb3c02da80 con 0x7feb2806e310 2024-09-21T12:45:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.325+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7feb2806e310 msgr2=0x7feb280707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.325+0000 7feb435ea640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7feb2806e310 0x7feb280707d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7feb380096c0 tx=0x7feb380058d0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.325+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 msgr2=0x7feb3c074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:25.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.325+0000 7feb435ea640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 0x7feb3c074a60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7feb2c00d6a0 tx=0x7feb2c00db60 comp rx=0 tx=0).stop 2024-09-21T12:45:25.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 shutdown_connections 2024-09-21T12:45:25.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7feb2806e310 0x7feb280707d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feb3c0745e0 0x7feb3c074a60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 --2- 172.21.15.46:0/2716733604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb3c102b60 0x7feb3c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:25.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 >> 172.21.15.46:0/2716733604 conn(0x7feb3c0fd110 msgr2=0x7feb3c106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:25.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 shutdown_connections 2024-09-21T12:45:25.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:25.326+0000 7feb435ea640 1 -- 172.21.15.46:0/2716733604 wait complete. 2024-09-21T12:45:26.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: Upgrade: Target is version 19.3.0-5104-g44178494 (squid) 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5'] 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: Upgrade: Need to upgrade myself (mgr.smithi046.vedsjs) 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3460274672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 on smithi176 2024-09-21T12:45:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:25 smithi176 ceph-mon[35476]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: Upgrade: Target is version 19.3.0-5104-g44178494 (squid) 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5'] 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: Upgrade: Need to upgrade myself (mgr.smithi046.vedsjs) 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3460274672' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 on smithi176 2024-09-21T12:45:26.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:25 smithi046 ceph-mon[27868]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:27.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:26 smithi176 ceph-mon[35476]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:27.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:26 smithi046 ceph-mon[27868]: pgmap v212: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:28 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:28 smithi176 ceph-mon[35476]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:28.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:28 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:28 smithi046 ceph-mon[27868]: pgmap v213: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:30 smithi176 ceph-mon[35476]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:30.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:30 smithi046 ceph-mon[27868]: pgmap v214: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:32.761 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:32 smithi176 ceph-mon[35476]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:32.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:32 smithi046 ceph-mon[27868]: pgmap v215: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:34.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:34 smithi176 ceph-mon[35476]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:34.841 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:34 smithi046 ceph-mon[27868]: pgmap v216: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:36.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:36 smithi176 ceph-mon[35476]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:36.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:36 smithi046 ceph-mon[27868]: pgmap v217: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:38.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:38 smithi176 ceph-mon[35476]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:38.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:38 smithi046 ceph-mon[27868]: pgmap v218: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:40 smithi176 ceph-mon[35476]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:40.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:40 smithi046 ceph-mon[27868]: pgmap v219: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:42.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:42 smithi176 ceph-mon[35476]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:42.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:42 smithi046 ceph-mon[27868]: pgmap v220: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:43.815 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:43 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:43 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:44 smithi176 ceph-mon[35476]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:44.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:44 smithi046 ceph-mon[27868]: pgmap v221: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:45:46.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:46 smithi176 ceph-mon[35476]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:46.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:46 smithi046 ceph-mon[27868]: pgmap v222: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:45:48.512 INFO:tasks.workunit.client.1.smithi176.stderr:Updating files: 83% (10554/12697) Updating files: 84% (10666/12697) Updating files: 85% (10793/12697) Updating files: 86% (10920/12697) Updating files: 87% (11047/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T12:45:48.590 INFO:tasks.workunit.client.0.smithi046.stderr:Updating files: 91% (11565/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T12:45:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:48 smithi176 ceph-mon[35476]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:48.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:48 smithi046 ceph-mon[27868]: pgmap v223: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:49.382 INFO:tasks.workunit.client.0.smithi046.stderr:Note: switching to '441784946648ff53dd310293f9dd752afeeea72a'. 2024-09-21T12:45:49.382 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: git switch -c 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr:Or undo this operation with: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: git switch - 2024-09-21T12:45:49.383 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.384 INFO:tasks.workunit.client.0.smithi046.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T12:45:49.384 INFO:tasks.workunit.client.0.smithi046.stderr: 2024-09-21T12:45:49.384 INFO:tasks.workunit.client.0.smithi046.stderr:HEAD is now at 44178494664 Merge branch 'activate-lvm-tpm2' of https://github.com/guits/ceph into wip-guits-main-2024-09-21-0842 2024-09-21T12:45:49.388 DEBUG:teuthology.orchestra.run.smithi046:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr:Note: switching to '441784946648ff53dd310293f9dd752afeeea72a'. 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr: git switch -c 2024-09-21T12:45:49.452 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr:Or undo this operation with: 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr: git switch - 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr: 2024-09-21T12:45:49.453 INFO:tasks.workunit.client.1.smithi176.stderr:HEAD is now at 44178494664 Merge branch 'activate-lvm-tpm2' of https://github.com/guits/ceph into wip-guits-main-2024-09-21-0842 2024-09-21T12:45:49.460 DEBUG:teuthology.orchestra.run.smithi176:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T12:45:49.512 INFO:tasks.workunit.client.0.smithi046.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T12:45:49.514 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T12:45:49.514 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T12:45:49.523 INFO:tasks.workunit.client.1.smithi176.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T12:45:49.526 INFO:tasks.workunit.client.1.smithi176.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T12:45:49.526 INFO:tasks.workunit.client.1.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T12:45:50.202 INFO:tasks.workunit.client.1.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T12:45:50.221 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T12:45:50.272 INFO:tasks.workunit.client.1.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T12:45:50.292 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T12:45:50.316 INFO:tasks.workunit.client.1.smithi176.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T12:45:50.318 INFO:tasks.workunit.client.1.smithi176.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T12:45:50.319 INFO:tasks.workunit.client.1.smithi176.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T12:45:50.334 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T12:45:50.336 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T12:45:50.336 INFO:tasks.workunit.client.0.smithi046.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T12:45:50.363 INFO:tasks.workunit.client.1.smithi176.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T12:45:50.366 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2024-09-21T12:45:50.366 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T12:45:50.377 INFO:tasks.workunit.client.0.smithi046.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T12:45:50.380 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T12:45:50.380 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T12:45:50.397 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-21T12:45:50.398 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T12:45:50.398 DEBUG:teuthology.orchestra.run.smithi046:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=441784946648ff53dd310293f9dd752afeeea72a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-21T12:45:50.425 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-21T12:45:50.426 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T12:45:50.426 DEBUG:teuthology.orchestra.run.smithi176:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=441784946648ff53dd310293f9dd752afeeea72a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-21T12:45:50.465 INFO:tasks.workunit.client.0.smithi046.stderr:+ mkdir -p fsstress 2024-09-21T12:45:50.467 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd fsstress 2024-09-21T12:45:50.468 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:45:50.468 INFO:tasks.workunit.client.0.smithi046.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T12:45:50.493 INFO:tasks.workunit.client.1.smithi176.stderr:+ mkdir -p fsstress 2024-09-21T12:45:50.496 INFO:tasks.workunit.client.1.smithi176.stderr:+ pushd fsstress 2024-09-21T12:45:50.497 INFO:tasks.workunit.client.1.smithi176.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:45:50.497 INFO:tasks.workunit.client.1.smithi176.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T12:45:50.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:50 smithi176 ceph-mon[35476]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:50.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:50 smithi046 ceph-mon[27868]: pgmap v224: 65 pgs: 65 active+clean; 590 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:45:50.999 INFO:tasks.workunit.client.0.smithi046.stderr:+ tar xzf ltp-full.tgz 2024-09-21T12:45:51.855 INFO:tasks.workunit.client.1.smithi176.stderr:+ tar xzf ltp-full.tgz 2024-09-21T12:45:52.762 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:52 smithi176 ceph-mon[35476]: pgmap v225: 65 pgs: 65 active+clean; 8.4 MiB data, 181 MiB used, 536 GiB / 536 GiB avail; 38 KiB/s rd, 667 KiB/s wr, 14 op/s 2024-09-21T12:45:52.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:52 smithi046 ceph-mon[27868]: pgmap v225: 65 pgs: 65 active+clean; 8.4 MiB data, 181 MiB used, 536 GiB / 536 GiB avail; 38 KiB/s rd, 667 KiB/s wr, 14 op/s 2024-09-21T12:45:54.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:54 smithi176 ceph-mon[35476]: pgmap v226: 65 pgs: 65 active+clean; 16 MiB data, 219 MiB used, 536 GiB / 536 GiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 34 op/s 2024-09-21T12:45:54.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:54 smithi046 ceph-mon[27868]: pgmap v226: 65 pgs: 65 active+clean; 16 MiB data, 219 MiB used, 536 GiB / 536 GiB avail; 37 KiB/s rd, 1.3 MiB/s wr, 34 op/s 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 -- 172.21.15.46:0/4258316613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868102490 msgr2=0x7fd868104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 --2- 172.21.15.46:0/4258316613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868102490 0x7fd868104880 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd858009880 tx=0x7fd85802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 -- 172.21.15.46:0/4258316613 shutdown_connections 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 --2- 172.21.15.46:0/4258316613 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868104dc0 0x7fd8681071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 --2- 172.21.15.46:0/4258316613 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868102490 0x7fd868104880 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 -- 172.21.15.46:0/4258316613 >> 172.21.15.46:0/4258316613 conn(0x7fd8680fc010 msgr2=0x7fd8680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 -- 172.21.15.46:0/4258316613 shutdown_connections 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.437+0000 7fd86d717640 1 -- 172.21.15.46:0/4258316613 wait complete. 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.438+0000 7fd86d717640 1 Processor -- start 2024-09-21T12:45:55.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.438+0000 7fd86d717640 1 -- start start 2024-09-21T12:45:55.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd86d717640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868102490 0x7fd868199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd86d717640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868104dc0 0x7fd868199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd86d717640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810a7d0 con 0x7fd868104dc0 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd86d717640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd86810a650 con 0x7fd868102490 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd866ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868102490 0x7fd868199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd8667fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868104dc0 0x7fd868199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd866ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868102490 0x7fd868199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:50406/0 (socket says 172.21.15.46:50406) 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd866ffd640 1 -- 172.21.15.46:0/3591059580 learned_addr learned my addr 172.21.15.46:0/3591059580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd8667fc640 1 -- 172.21.15.46:0/3591059580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868102490 msgr2=0x7fd868199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd8667fc640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868102490 0x7fd868199700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.439+0000 7fd8667fc640 1 -- 172.21.15.46:0/3591059580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd86819a2c0 con 0x7fd868104dc0 2024-09-21T12:45:55.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.440+0000 7fd8667fc640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868104dc0 0x7fd868199c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e940 tx=0x7fd85c00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.440+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd85c00cac0 con 0x7fd868104dc0 2024-09-21T12:45:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.440+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd85c00cc60 con 0x7fd868104dc0 2024-09-21T12:45:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.441+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd85c0047a0 con 0x7fd868104dc0 2024-09-21T12:45:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.441+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd86819ed00 con 0x7fd868104dc0 2024-09-21T12:45:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.441+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd86819f230 con 0x7fd868104dc0 2024-09-21T12:45:55.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.442+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd868102870 con 0x7fd868104dc0 2024-09-21T12:45:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.443+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fd85c004a10 con 0x7fd868104dc0 2024-09-21T12:45:55.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.443+0000 7fd84ffff640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd85006e2b0 0x7fd850070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:55.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.443+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fd85c08e680 con 0x7fd868104dc0 2024-09-21T12:45:55.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.444+0000 7fd866ffd640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd85006e2b0 0x7fd850070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:55.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.444+0000 7fd866ffd640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd85006e2b0 0x7fd850070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd8580096c0 tx=0x7fd858005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:55.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.449+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd85c05bee0 con 0x7fd868104dc0 2024-09-21T12:45:55.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.718+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd868062630 con 0x7fd85006e2b0 2024-09-21T12:45:55.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.719+0000 7fd84ffff640 1 -- 172.21.15.46:0/3591059580 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fd868062630 con 0x7fd85006e2b0 2024-09-21T12:45:55.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd85006e2b0 msgr2=0x7fd850070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:55.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd85006e2b0 0x7fd850070770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd8580096c0 tx=0x7fd858005a20 comp rx=0 tx=0).stop 2024-09-21T12:45:55.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868104dc0 msgr2=0x7fd868199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:55.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868104dc0 0x7fd868199c40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e940 tx=0x7fd85c00ee00 comp rx=0 tx=0).stop 2024-09-21T12:45:55.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 shutdown_connections 2024-09-21T12:45:55.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fd85006e2b0 0x7fd850070770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd868104dc0 0x7fd868199c40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 --2- 172.21.15.46:0/3591059580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd868102490 0x7fd868199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.722+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 >> 172.21.15.46:0/3591059580 conn(0x7fd8680fc010 msgr2=0x7fd868101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:55.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.723+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 shutdown_connections 2024-09-21T12:45:55.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.723+0000 7fd86d717640 1 -- 172.21.15.46:0/3591059580 wait complete. 2024-09-21T12:45:55.735 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:45:55.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 -- 172.21.15.46:0/2000141903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600fffa0 msgr2=0x7f6760107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 --2- 172.21.15.46:0/2000141903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600fffa0 0x7f6760107110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f674c009880 tx=0x7f674c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 -- 172.21.15.46:0/2000141903 shutdown_connections 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 --2- 172.21.15.46:0/2000141903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600fffa0 0x7f6760107110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 --2- 172.21.15.46:0/2000141903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600ff5d0 0x7f67600ff9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 -- 172.21.15.46:0/2000141903 >> 172.21.15.46:0/2000141903 conn(0x7f67600fb350 msgr2=0x7f67600fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 -- 172.21.15.46:0/2000141903 shutdown_connections 2024-09-21T12:45:55.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.838+0000 7f67670a6640 1 -- 172.21.15.46:0/2000141903 wait complete. 2024-09-21T12:45:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.839+0000 7f67670a6640 1 Processor -- start 2024-09-21T12:45:55.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.839+0000 7f67670a6640 1 -- start start 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.839+0000 7f67670a6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600ff5d0 0x7f67601974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.839+0000 7f67670a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 0x7f6760197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.839+0000 7f67670a6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f676010a790 con 0x7f67600fffa0 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f67670a6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f676010a610 con 0x7f67600ff5d0 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 0x7f6760197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 0x7f6760197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58712/0 (socket says 172.21.15.46:58712) 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 -- 172.21.15.46:0/3737573648 learned_addr learned my addr 172.21.15.46:0/3737573648 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f6764e42640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600ff5d0 0x7f67601974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 -- 172.21.15.46:0/3737573648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600ff5d0 msgr2=0x7f67601974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:55.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600ff5d0 0x7f67601974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 -- 172.21.15.46:0/3737573648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67601980a0 con 0x7f67600fffa0 2024-09-21T12:45:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.840+0000 7f675ffff640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 0x7f6760197a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f674c0099a0 tx=0x7f674c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.841+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f674c03f070 con 0x7f67600fffa0 2024-09-21T12:45:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.841+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f674c004a50 con 0x7f67600fffa0 2024-09-21T12:45:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.841+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f674c035030 con 0x7f67600fffa0 2024-09-21T12:45:55.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.842+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676019ca80 con 0x7f67600fffa0 2024-09-21T12:45:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.842+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676019d010 con 0x7f67600fffa0 2024-09-21T12:45:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.843+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67600ff9d0 con 0x7f67600fffa0 2024-09-21T12:45:55.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.844+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f674c042070 con 0x7f67600fffa0 2024-09-21T12:45:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.845+0000 7f675dffb640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f675006e420 0x7f67500708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.845+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f674c0aeed0 con 0x7f67600fffa0 2024-09-21T12:45:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.845+0000 7f6764e42640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f675006e420 0x7f67500708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.846+0000 7f6764e42640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f675006e420 0x7f67500708e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6754009b60 tx=0x7f6754005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:55.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:55.851+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f674c07c830 con 0x7f67600fffa0 2024-09-21T12:45:56.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.130+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6760106a00 con 0x7f675006e420 2024-09-21T12:45:56.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.131+0000 7f675dffb640 1 -- 172.21.15.46:0/3737573648 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f6760106a00 con 0x7f675006e420 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f675006e420 msgr2=0x7f67500708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f675006e420 0x7f67500708e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f6754009b60 tx=0x7f6754005f90 comp rx=0 tx=0).stop 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 msgr2=0x7f6760197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 0x7f6760197a20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f674c0099a0 tx=0x7f674c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 shutdown_connections 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f675006e420 0x7f67500708e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f67600fffa0 0x7f6760197a20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 --2- 172.21.15.46:0/3737573648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67600ff5d0 0x7f67601974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.133+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 >> 172.21.15.46:0/3737573648 conn(0x7f67600fb350 msgr2=0x7f67601052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.134+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 shutdown_connections 2024-09-21T12:45:56.135 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.134+0000 7f67670a6640 1 -- 172.21.15.46:0/3737573648 wait complete. 2024-09-21T12:45:56.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 -- 172.21.15.46:0/3410133437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f81023f0 msgr2=0x7fa3f81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/3410133437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f81023f0 0x7fa3f81047e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa3e80098b0 tx=0x7fa3e802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 -- 172.21.15.46:0/3410133437 shutdown_connections 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/3410133437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f8104d20 0x7fa3f8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/3410133437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f81023f0 0x7fa3f81047e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 -- 172.21.15.46:0/3410133437 >> 172.21.15.46:0/3410133437 conn(0x7fa3f80fbff0 msgr2=0x7fa3f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 -- 172.21.15.46:0/3410133437 shutdown_connections 2024-09-21T12:45:56.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.233+0000 7fa3fd0af640 1 -- 172.21.15.46:0/3410133437 wait complete. 2024-09-21T12:45:56.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.234+0000 7fa3fd0af640 1 Processor -- start 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.234+0000 7fa3fd0af640 1 -- start start 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3fd0af640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f81023f0 0x7fa3f8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3fd0af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 0x7fa3f81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3fd0af640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f810a7c0 con 0x7fa3f8104d20 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3fd0af640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f810a640 con 0x7fa3f81023f0 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 0x7fa3f81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 0x7fa3f81003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58740/0 (socket says 172.21.15.46:58740) 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f659c640 1 -- 172.21.15.46:0/2893945674 learned_addr learned my addr 172.21.15.46:0/2893945674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f6d9d640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f81023f0 0x7fa3f8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f659c640 1 -- 172.21.15.46:0/2893945674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f81023f0 msgr2=0x7fa3f8101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f659c640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f81023f0 0x7fa3f8101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f659c640 1 -- 172.21.15.46:0/2893945674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f81008e0 con 0x7fa3f8104d20 2024-09-21T12:45:56.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.235+0000 7fa3f6d9d640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f81023f0 0x7fa3f8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:45:56.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.236+0000 7fa3f659c640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 0x7fa3f81003a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00e920 tx=0x7fa3ec00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:56.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.236+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3ec00cb80 con 0x7fa3f8104d20 2024-09-21T12:45:56.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.236+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f8100bd0 con 0x7fa3f8104d20 2024-09-21T12:45:56.238 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.236+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3ec00cd20 con 0x7fa3f8104d20 2024-09-21T12:45:56.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.236+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3ec0049d0 con 0x7fa3f8104d20 2024-09-21T12:45:56.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.236+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f8101160 con 0x7fa3f8104d20 2024-09-21T12:45:56.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.237+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f81027d0 con 0x7fa3f8104d20 2024-09-21T12:45:56.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.238+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7fa3ec004c80 con 0x7fa3f8104d20 2024-09-21T12:45:56.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.239+0000 7fa3dffff640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa3e006e2b0 0x7fa3e0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:56.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.239+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7fa3ec08e340 con 0x7fa3f8104d20 2024-09-21T12:45:56.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.239+0000 7fa3f6d9d640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa3e006e2b0 0x7fa3e0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:56.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.240+0000 7fa3f6d9d640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa3e006e2b0 0x7fa3e0070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8006010 tx=0x7fa3e80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:56.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.247+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa3ec05bc40 con 0x7fa3f8104d20 2024-09-21T12:45:56.500 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.499+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa3f819f600 con 0x7fa3e006e2b0 2024-09-21T12:45:56.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.514+0000 7fa3dffff640 1 -- 172.21.15.46:0/2893945674 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa3f819f600 con 0x7fa3e006e2b0 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 79s ago 6m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (7m) 79s ago 7m 8270k - 19.1.1-373-g4e45e6b4 164465d2334a f8608c24a9a8 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (6m) 82s ago 6m 9411k - 19.1.1-373-g4e45e6b4 164465d2334a 3c8b950c3981 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 79s ago 7m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (6m) 82s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 79s ago 6m 82.4M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (101s) 79s ago 100s 12.3M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (95s) 79s ago 94s 16.8M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (98s) 82s ago 98s 15.7M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (92s) 82s ago 92s 14.3M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:9283,8765,8443 running (8m) 79s ago 8m 500M - 19.1.1-373-g4e45e6b4 164465d2334a a9438678095d 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (6m) 82s ago 6m 440M - 19.1.1-373-g4e45e6b4 164465d2334a 918a325e02f4 2024-09-21T12:45:56.516 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 79s ago 8m 47.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (6m) 82s ago 6m 38.0M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 79s ago 7m 14.1M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (6m) 82s ago 6m 15.2M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 79s ago 4m 48.7M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 79s ago 4m 47.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 79s ago 3m 45.7M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (3m) 82s ago 3m 44.6M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (3m) 82s ago 3m 43.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (2m) 82s ago 2m 41.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:45:56.517 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 79s ago 6m 58.8M - 2.43.0 a07b618ecd1d 965906d87e59 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.517+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa3e006e2b0 msgr2=0x7fa3e0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.517+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa3e006e2b0 0x7fa3e0070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8006010 tx=0x7fa3e80058d0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.517+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 msgr2=0x7fa3f81003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.517+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 0x7fa3f81003a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec00e920 tx=0x7fa3ec00ede0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 shutdown_connections 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7fa3e006e2b0 0x7fa3e0070770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa3f8104d20 0x7fa3f81003a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 --2- 172.21.15.46:0/2893945674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3f81023f0 0x7fa3f8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 >> 172.21.15.46:0/2893945674 conn(0x7fa3f80fbff0 msgr2=0x7fa3f80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 shutdown_connections 2024-09-21T12:45:56.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.518+0000 7fa3fd0af640 1 -- 172.21.15.46:0/2893945674 wait complete. 2024-09-21T12:45:56.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.624+0000 7f6872177640 1 -- 172.21.15.46:0/4271773759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 msgr2=0x7f686c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.624+0000 7f6872177640 1 --2- 172.21.15.46:0/4271773759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 0x7f686c101d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f685c009880 tx=0x7f685c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.624+0000 7f6872177640 1 -- 172.21.15.46:0/4271773759 shutdown_connections 2024-09-21T12:45:56.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.624+0000 7f6872177640 1 --2- 172.21.15.46:0/4271773759 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.624+0000 7f6872177640 1 --2- 172.21.15.46:0/4271773759 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 0x7f686c101d60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.624+0000 7f6872177640 1 -- 172.21.15.46:0/4271773759 >> 172.21.15.46:0/4271773759 conn(0x7f686c0fd0f0 msgr2=0x7f686c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:56.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.625+0000 7f6872177640 1 -- 172.21.15.46:0/4271773759 shutdown_connections 2024-09-21T12:45:56.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.625+0000 7f6872177640 1 -- 172.21.15.46:0/4271773759 wait complete. 2024-09-21T12:45:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f6872177640 1 Processor -- start 2024-09-21T12:45:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f6872177640 1 -- start start 2024-09-21T12:45:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f6872177640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 0x7f686c075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f6872177640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f6872177640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f686c10a7a0 con 0x7f686c102b60 2024-09-21T12:45:56.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f6872177640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f686c10a620 con 0x7f686c101960 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f686affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f686affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58758/0 (socket says 172.21.15.46:58758) 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f686affd640 1 -- 172.21.15.46:0/1949811540 learned_addr learned my addr 172.21.15.46:0/1949811540 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.626+0000 7f686b7fe640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 0x7f686c075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f686affd640 1 -- 172.21.15.46:0/1949811540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 msgr2=0x7f686c075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f686affd640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 0x7f686c075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f686affd640 1 -- 172.21.15.46:0/1949811540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f686c074b20 con 0x7f686c102b60 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f686affd640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c0745e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f686000e970 tx=0x7f686000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f686000cac0 con 0x7f686c102b60 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68600054e0 con 0x7f686c102b60 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f686c074e10 con 0x7f686c102b60 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6860010430 con 0x7f686c102b60 2024-09-21T12:45:56.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.627+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f686c0753a0 con 0x7f686c102b60 2024-09-21T12:45:56.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.629+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f686c101d60 con 0x7f686c102b60 2024-09-21T12:45:56.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.629+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f6860004f00 con 0x7f686c102b60 2024-09-21T12:45:56.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.630+0000 7f6868ff9640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f685406e350 0x7f6854070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:56.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.630+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f686008e800 con 0x7f686c102b60 2024-09-21T12:45:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.630+0000 7f686b7fe640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f685406e350 0x7f6854070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:56.632 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.631+0000 7f686b7fe640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f685406e350 0x7f6854070810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f685c006010 tx=0x7f685c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:56.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:56.636+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f686005c0e0 con 0x7f686c102b60 2024-09-21T12:45:56.680 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:56 smithi176 ceph-mon[35476]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:56.680 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:56 smithi176 ceph-mon[35476]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:56.680 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:56 smithi176 ceph-mon[35476]: pgmap v227: 65 pgs: 65 active+clean; 25 MiB data, 238 MiB used, 536 GiB / 536 GiB avail; 38 KiB/s rd, 2.1 MiB/s wr, 54 op/s 2024-09-21T12:45:56.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:56 smithi046 ceph-mon[27868]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:56.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:56 smithi046 ceph-mon[27868]: from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:56.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:56 smithi046 ceph-mon[27868]: pgmap v227: 65 pgs: 65 active+clean; 25 MiB data, 238 MiB used, 536 GiB / 536 GiB avail; 38 KiB/s rd, 2.1 MiB/s wr, 54 op/s 2024-09-21T12:45:57.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.006+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f686c1977b0 con 0x7f686c102b60 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.006+0000 7f6868ff9640 1 -- 172.21.15.46:0/1949811540 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7f686005fd90 con 0x7f686c102b60 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:57.008 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:45:57.009 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:45:57.009 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:45:57.009 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:45:57.009 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T12:45:57.009 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:45:57.009 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f685406e350 msgr2=0x7f6854070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f685406e350 0x7f6854070810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f685c006010 tx=0x7f685c005a20 comp rx=0 tx=0).stop 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 msgr2=0x7f686c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c0745e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f686000e970 tx=0x7f686000ed70 comp rx=0 tx=0).stop 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 shutdown_connections 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f685406e350 0x7f6854070810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f686c102b60 0x7f686c0745e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 --2- 172.21.15.46:0/1949811540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f686c101960 0x7f686c075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.009+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 >> 172.21.15.46:0/1949811540 conn(0x7f686c0fd0f0 msgr2=0x7f686c0ff320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.010+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 shutdown_connections 2024-09-21T12:45:57.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.010+0000 7f6872177640 1 -- 172.21.15.46:0/1949811540 wait complete. 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.119+0000 7f4656c63640 1 -- 172.21.15.46:0/2249248398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 msgr2=0x7f46501047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.119+0000 7f4656c63640 1 --2- 172.21.15.46:0/2249248398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f46501047e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f46440098b0 tx=0x7f464402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.119+0000 7f4656c63640 1 -- 172.21.15.46:0/2249248398 shutdown_connections 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.119+0000 7f4656c63640 1 --2- 172.21.15.46:0/2249248398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 0x7f4650107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.119+0000 7f4656c63640 1 --2- 172.21.15.46:0/2249248398 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f46501047e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.119+0000 7f4656c63640 1 -- 172.21.15.46:0/2249248398 >> 172.21.15.46:0/2249248398 conn(0x7f46500fc010 msgr2=0x7f46500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:57.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.120+0000 7f4656c63640 1 -- 172.21.15.46:0/2249248398 shutdown_connections 2024-09-21T12:45:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.120+0000 7f4656c63640 1 -- 172.21.15.46:0/2249248398 wait complete. 2024-09-21T12:45:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.120+0000 7f4656c63640 1 Processor -- start 2024-09-21T12:45:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f4656c63640 1 -- start start 2024-09-21T12:45:57.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f4656c63640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f4650197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:57.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f4656c63640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 0x7f4650197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:57.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f4656c63640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f465010a7e0 con 0x7f46501023f0 2024-09-21T12:45:57.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f4656c63640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f465010a660 con 0x7f4650104d20 2024-09-21T12:45:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f46549ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f4650197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f46549ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f4650197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58786/0 (socket says 172.21.15.46:58786) 2024-09-21T12:45:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f46549ff640 1 -- 172.21.15.46:0/430863319 learned_addr learned my addr 172.21.15.46:0/430863319 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:45:57.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.121+0000 7f464ffff640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 0x7f4650197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464ffff640 1 -- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 msgr2=0x7f4650197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464ffff640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f4650197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464ffff640 1 -- 172.21.15.46:0/430863319 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46501980c0 con 0x7f4650104d20 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f46549ff640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f4650197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464ffff640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 0x7f4650197a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f463c00e940 tx=0x7f463c00ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f463c00cac0 con 0x7f4650104d20 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f463c00cc60 con 0x7f4650104d20 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f465019cb00 con 0x7f4650104d20 2024-09-21T12:45:57.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.122+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f463c0047a0 con 0x7f4650104d20 2024-09-21T12:45:57.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.123+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465019d090 con 0x7f4650104d20 2024-09-21T12:45:57.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.124+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46501027d0 con 0x7f4650104d20 2024-09-21T12:45:57.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.125+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 19) ==== 92551+0+0 (secure 0 0 0) 0x7f463c004960 con 0x7f4650104d20 2024-09-21T12:45:57.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.126+0000 7f464dffb640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f464006e310 0x7f46400707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:45:57.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.126+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5554+0+0 (secure 0 0 0) 0x7f463c08e5b0 con 0x7f4650104d20 2024-09-21T12:45:57.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.126+0000 7f46549ff640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f464006e310 0x7f46400707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:45:57.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.127+0000 7f46549ff640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f464006e310 0x7f46400707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f46440096c0 tx=0x7f4644005e50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:45:57.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.130+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f463c05be90 con 0x7f4650104d20 2024-09-21T12:45:57.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.338+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 --> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4650105680 con 0x7f464006e310 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.340+0000 7f464dffb640 1 -- 172.21.15.46:0/430863319 <== mgr.14217 v2:172.21.15.46:6800/2026840811 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f4650105680 con 0x7f464006e310 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 image on host smithi176", 2024-09-21T12:45:57.341 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:45:57.342 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f464006e310 msgr2=0x7f46400707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f464006e310 0x7f46400707d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f46440096c0 tx=0x7f4644005e50 comp rx=0 tx=0).stop 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 msgr2=0x7f4650197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 0x7f4650197a40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f463c00e940 tx=0x7f463c00ee00 comp rx=0 tx=0).stop 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 shutdown_connections 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:6800/2026840811,v1:172.21.15.46:6801/2026840811] conn(0x7f464006e310 0x7f46400707d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4650104d20 0x7f4650197a40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 --2- 172.21.15.46:0/430863319 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46501023f0 0x7f4650197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 >> 172.21.15.46:0/430863319 conn(0x7f46500fc010 msgr2=0x7f46500fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.342+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 shutdown_connections 2024-09-21T12:45:57.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:45:57.343+0000 7f4656c63640 1 -- 172.21.15.46:0/430863319 wait complete. 2024-09-21T12:45:57.763 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:57 smithi176 ceph-mon[35476]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:57.763 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:57 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1949811540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:45:57.763 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:57 smithi176 ceph-mon[35476]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:57 smithi046 ceph-mon[27868]: from='client.14656 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:57 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1949811540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:45:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:57 smithi046 ceph-mon[27868]: from='client.24383 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: Upgrade: Updating mgr.smithi176.rmyfjh 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: Deploying daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:45:58 smithi046 ceph-mon[27868]: pgmap v228: 65 pgs: 65 active+clean; 30 MiB data, 253 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.5 MiB/s wr, 81 op/s 2024-09-21T12:45:59.209 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: Upgrade: Updating mgr.smithi176.rmyfjh 2024-09-21T12:45:59.209 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:45:59.209 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:45:59.209 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:45:59.209 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:45:59.209 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: Deploying daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:45:59.210 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:45:59.210 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:45:58 smithi176 ceph-mon[35476]: pgmap v228: 65 pgs: 65 active+clean; 30 MiB data, 253 MiB used, 536 GiB / 536 GiB avail; 343 KiB/s rd, 2.5 MiB/s wr, 81 op/s 2024-09-21T12:46:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:00 smithi176 ceph-mon[35476]: pgmap v229: 65 pgs: 65 active+clean; 35 MiB data, 282 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.0 MiB/s wr, 117 op/s 2024-09-21T12:46:00.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:00 smithi046 ceph-mon[27868]: pgmap v229: 65 pgs: 65 active+clean; 35 MiB data, 282 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.0 MiB/s wr, 117 op/s 2024-09-21T12:46:02.763 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:02 smithi176 ceph-mon[35476]: pgmap v230: 65 pgs: 65 active+clean; 49 MiB data, 312 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 148 op/s 2024-09-21T12:46:02.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:02 smithi046 ceph-mon[27868]: pgmap v230: 65 pgs: 65 active+clean; 49 MiB data, 312 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.1 MiB/s wr, 148 op/s 2024-09-21T12:46:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:05 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:05 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:05 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:05 smithi176 ceph-mon[35476]: pgmap v231: 65 pgs: 65 active+clean; 53 MiB data, 340 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 160 op/s 2024-09-21T12:46:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:05 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:05 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:05 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:05 smithi046 ceph-mon[27868]: pgmap v231: 65 pgs: 65 active+clean; 53 MiB data, 340 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 160 op/s 2024-09-21T12:46:06.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:06 smithi176 ceph-mon[35476]: pgmap v232: 65 pgs: 65 active+clean; 55 MiB data, 356 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 155 op/s 2024-09-21T12:46:06.906 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:06 smithi046 ceph-mon[27868]: pgmap v232: 65 pgs: 65 active+clean; 55 MiB data, 356 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.3 MiB/s wr, 155 op/s 2024-09-21T12:46:09.520 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.520 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.520 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:09 smithi176 ceph-mon[35476]: pgmap v233: 65 pgs: 65 active+clean; 69 MiB data, 389 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 165 op/s 2024-09-21T12:46:09.520 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.520 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:09 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:09 smithi046 ceph-mon[27868]: pgmap v233: 65 pgs: 65 active+clean; 69 MiB data, 389 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 3.7 MiB/s wr, 165 op/s 2024-09-21T12:46:09.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:09.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:09 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:10.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:10 smithi176 ceph-mon[35476]: Standby manager daemon smithi176.rmyfjh restarted 2024-09-21T12:46:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:10 smithi176 ceph-mon[35476]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:46:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:10 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:46:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:10 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:46:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:10 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:46:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:10 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:46:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:10 smithi046 ceph-mon[27868]: Standby manager daemon smithi176.rmyfjh restarted 2024-09-21T12:46:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:10 smithi046 ceph-mon[27868]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:46:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:10 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:46:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:10 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:46:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:10 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:46:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:10 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:46:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:11 smithi176 ceph-mon[35476]: mgrmap e20: smithi046.vedsjs(active, since 6m), standbys: smithi176.rmyfjh 2024-09-21T12:46:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:11 smithi176 ceph-mon[35476]: pgmap v234: 65 pgs: 65 active+clean; 81 MiB data, 435 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 197 op/s 2024-09-21T12:46:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:11 smithi046 ceph-mon[27868]: mgrmap e20: smithi046.vedsjs(active, since 6m), standbys: smithi176.rmyfjh 2024-09-21T12:46:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:11 smithi046 ceph-mon[27868]: pgmap v234: 65 pgs: 65 active+clean; 81 MiB data, 435 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.4 MiB/s wr, 197 op/s 2024-09-21T12:46:13.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:13.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:13.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: pgmap v235: 65 pgs: 65 active+clean; 93 MiB data, 467 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 187 op/s 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr fail", "who": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: Activating manager daemon smithi176.rmyfjh 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "mgr fail", "who": "smithi046.vedsjs"}]': finished 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"}]: dispatch 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: mgrmap e21: smithi176.rmyfjh(active, starting, since 0.00868074s) 2024-09-21T12:46:13.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr metadata", "who": "smithi176.rmyfjh", "id": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: Manager daemon smithi176.rmyfjh is now available 2024-09-21T12:46:13.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:13.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:13.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:13.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:46:13.661 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:13.661 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:13.661 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:13.661 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: pgmap v235: 65 pgs: 65 active+clean; 93 MiB data, 467 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.9 MiB/s wr, 187 op/s 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr fail", "who": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: Activating manager daemon smithi176.rmyfjh 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.14217 172.21.15.46:0/154163622' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "mgr fail", "who": "smithi046.vedsjs"}]': finished 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: mgrmap e21: smithi176.rmyfjh(active, starting, since 0.00868074s) 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"}]: dispatch 2024-09-21T12:46:13.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr metadata", "who": "smithi176.rmyfjh", "id": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: Manager daemon smithi176.rmyfjh is now available 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:13.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:13.664 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:13.664 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/trash_purge_schedule"}]: dispatch 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/trash_purge_schedule"}]: dispatch 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: mgrmap e22: smithi176.rmyfjh(active, since 1.01022s) 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: Deploying cephadm binary to smithi176 2024-09-21T12:46:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:14 smithi046 ceph-mon[27868]: Deploying cephadm binary to smithi046 2024-09-21T12:46:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:46:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:46:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/trash_purge_schedule"}]: dispatch 2024-09-21T12:46:14.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi176.rmyfjh/trash_purge_schedule"}]: dispatch 2024-09-21T12:46:14.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: mgrmap e22: smithi176.rmyfjh(active, since 1.01022s) 2024-09-21T12:46:14.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: Deploying cephadm binary to smithi176 2024-09-21T12:46:14.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:14 smithi176 ceph-mon[35476]: Deploying cephadm binary to smithi046 2024-09-21T12:46:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: pgmap v4: 65 pgs: 65 active+clean; 101 MiB data, 503 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: mgrmap e23: smithi176.rmyfjh(active, since 2s) 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: [21/Sep/2024:12:46:14] ENGINE Bus STARTING 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: [21/Sep/2024:12:46:14] ENGINE Serving on http://172.21.15.176:8765 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: [21/Sep/2024:12:46:14] ENGINE Serving on https://172.21.15.176:7150 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: [21/Sep/2024:12:46:14] ENGINE Bus STARTED 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:15 smithi176 ceph-mon[35476]: [21/Sep/2024:12:46:14] ENGINE Error in HTTPServer.serve 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Traceback (most recent call last): 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._run(expiration_interval) 2024-09-21T12:46:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: s = self.context.wrap_socket( 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: return self.sslsocket_class._create( 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self.do_handshake() 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._sslobj.do_handshake() 2024-09-21T12:46:15.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: pgmap v4: 65 pgs: 65 active+clean; 101 MiB data, 503 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: mgrmap e23: smithi176.rmyfjh(active, since 2s) 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: [21/Sep/2024:12:46:14] ENGINE Bus STARTING 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: [21/Sep/2024:12:46:14] ENGINE Serving on http://172.21.15.176:8765 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: [21/Sep/2024:12:46:14] ENGINE Serving on https://172.21.15.176:7150 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: [21/Sep/2024:12:46:14] ENGINE Bus STARTED 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:15 smithi046 ceph-mon[27868]: [21/Sep/2024:12:46:14] ENGINE Error in HTTPServer.serve 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:46:15.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T12:46:15.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:46:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:17 smithi046 ceph-mon[27868]: pgmap v5: 65 pgs: 65 active+clean; 101 MiB data, 503 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:46:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:17 smithi046 ceph-mon[27868]: mgrmap e24: smithi176.rmyfjh(active, since 4s) 2024-09-21T12:46:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:17 smithi176 ceph-mon[35476]: pgmap v5: 65 pgs: 65 active+clean; 101 MiB data, 503 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:46:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:17 smithi176 ceph-mon[35476]: mgrmap e24: smithi176.rmyfjh(active, since 4s) 2024-09-21T12:46:19.714 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:19 smithi046 ceph-mon[27868]: pgmap v6: 65 pgs: 65 active+clean; 106 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 822 KiB/s rd, 1004 KiB/s wr, 56 op/s 2024-09-21T12:46:19.714 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:19 smithi046 ceph-mon[27868]: Standby manager daemon smithi046.vedsjs started 2024-09-21T12:46:19.714 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:19 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/crt"}]: dispatch 2024-09-21T12:46:19.715 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:19 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:46:19.715 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:19 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/key"}]: dispatch 2024-09-21T12:46:19.715 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:19 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:46:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:19 smithi176 ceph-mon[35476]: pgmap v6: 65 pgs: 65 active+clean; 106 MiB data, 524 MiB used, 536 GiB / 536 GiB avail; 822 KiB/s rd, 1004 KiB/s wr, 56 op/s 2024-09-21T12:46:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:19 smithi176 ceph-mon[35476]: Standby manager daemon smithi046.vedsjs started 2024-09-21T12:46:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:19 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/crt"}]: dispatch 2024-09-21T12:46:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:19 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:46:19.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:19 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/key"}]: dispatch 2024-09-21T12:46:19.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:19 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/635981444' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:46:20.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:20 smithi046 ceph-mon[27868]: mgrmap e25: smithi176.rmyfjh(active, since 7s), standbys: smithi046.vedsjs 2024-09-21T12:46:20.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:20 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:46:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:20 smithi176 ceph-mon[35476]: mgrmap e25: smithi176.rmyfjh(active, since 7s), standbys: smithi046.vedsjs 2024-09-21T12:46:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:20 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:46:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:21 smithi176 ceph-mon[35476]: pgmap v7: 65 pgs: 65 active+clean; 112 MiB data, 554 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-09-21T12:46:21.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:21 smithi046 ceph-mon[27868]: pgmap v7: 65 pgs: 65 active+clean; 112 MiB data, 554 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 112 op/s 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:22 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:23.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:22 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:24.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:23 smithi046 ceph-mon[27868]: pgmap v8: 65 pgs: 65 active+clean; 112 MiB data, 554 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-09-21T12:46:24.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:23 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi046 to 1217M 2024-09-21T12:46:24.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:23 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:24.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:23 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:24.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:23 smithi176 ceph-mon[35476]: pgmap v8: 65 pgs: 65 active+clean; 112 MiB data, 554 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 87 op/s 2024-09-21T12:46:24.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:23 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi046 to 1217M 2024-09-21T12:46:24.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:23 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:24.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:23 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:25 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:25 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:25 smithi176 ceph-mon[35476]: pgmap v9: 65 pgs: 65 active+clean; 124 MiB data, 595 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 142 op/s 2024-09-21T12:46:25.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:25 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:25.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:25 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:25.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:25 smithi046 ceph-mon[27868]: pgmap v9: 65 pgs: 65 active+clean; 124 MiB data, 595 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 142 op/s 2024-09-21T12:46:27.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.468+0000 7f5a79be3640 1 -- 172.21.15.46:0/3671972889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 msgr2=0x7f5a74102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.468+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3671972889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74102ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5a680097e0 tx=0x7f5a6802a3f0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.468+0000 7f5a79be3640 1 -- 172.21.15.46:0/3671972889 shutdown_connections 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.468+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3671972889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74102ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.468+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3671972889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a74101970 0x7f5a74101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.468+0000 7f5a79be3640 1 -- 172.21.15.46:0/3671972889 >> 172.21.15.46:0/3671972889 conn(0x7f5a740fd140 msgr2=0x7f5a740ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.469+0000 7f5a79be3640 1 -- 172.21.15.46:0/3671972889 shutdown_connections 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.469+0000 7f5a79be3640 1 -- 172.21.15.46:0/3671972889 wait complete. 2024-09-21T12:46:27.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.469+0000 7f5a79be3640 1 Processor -- start 2024-09-21T12:46:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a79be3640 1 -- start start 2024-09-21T12:46:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a79be3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a74101970 0x7f5a74073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a79be3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74073770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a79be3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7410a790 con 0x7f5a74101970 2024-09-21T12:46:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a79be3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a7410a610 con 0x7f5a74102b70 2024-09-21T12:46:27.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a72ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a72ffd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74073770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:59534/0 (socket says 172.21.15.46:59534) 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.470+0000 7f5a72ffd640 1 -- 172.21.15.46:0/3425310996 learned_addr learned my addr 172.21.15.46:0/3425310996 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.471+0000 7f5a737fe640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a74101970 0x7f5a74073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.471+0000 7f5a72ffd640 1 -- 172.21.15.46:0/3425310996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a74101970 msgr2=0x7f5a74073230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.471+0000 7f5a72ffd640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a74101970 0x7f5a74073230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.471+0000 7f5a72ffd640 1 -- 172.21.15.46:0/3425310996 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a74073df0 con 0x7f5a74102b70 2024-09-21T12:46:27.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.471+0000 7f5a72ffd640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74073770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009900 tx=0x7f5a680043b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:27.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.471+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a68040070 con 0x7f5a74102b70 2024-09-21T12:46:27.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.473+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a68030c00 con 0x7f5a74102b70 2024-09-21T12:46:27.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.473+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a74074420 con 0x7f5a74102b70 2024-09-21T12:46:27.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.473+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a68003d40 con 0x7f5a74102b70 2024-09-21T12:46:27.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.473+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a74074840 con 0x7f5a74102b70 2024-09-21T12:46:27.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.473+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a74101d70 con 0x7f5a74102b70 2024-09-21T12:46:27.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.474+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f5a68039040 con 0x7f5a74102b70 2024-09-21T12:46:27.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.475+0000 7f5a70ff9640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f5a5c074b80 0x7f5a5c077040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:27.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.475+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f5a680b7620 con 0x7f5a74102b70 2024-09-21T12:46:27.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.475+0000 7f5a737fe640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f5a5c074b80 0x7f5a5c077040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:27.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.475+0000 7f5a737fe640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f5a5c074b80 0x7f5a5c077040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a741a1120 tx=0x7f5a64009260 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:27.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.480+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5a68082bb0 con 0x7f5a74102b70 2024-09-21T12:46:27.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.831+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5a74107110 con 0x7f5a5c074b80 2024-09-21T12:46:27.834 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:27 smithi046 ceph-mon[27868]: pgmap v10: 65 pgs: 65 active+clean; 124 MiB data, 595 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-09-21T12:46:27.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.832+0000 7f5a70ff9640 1 -- 172.21.15.46:0/3425310996 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f5a74107110 con 0x7f5a5c074b80 2024-09-21T12:46:27.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f5a5c074b80 msgr2=0x7f5a5c077040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f5a5c074b80 0x7f5a5c077040 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f5a741a1120 tx=0x7f5a64009260 comp rx=0 tx=0).stop 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 msgr2=0x7f5a74073770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74073770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009900 tx=0x7f5a680043b0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 shutdown_connections 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f5a5c074b80 0x7f5a5c077040 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a74102b70 0x7f5a74073770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 --2- 172.21.15.46:0/3425310996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a74101970 0x7f5a74073230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 >> 172.21.15.46:0/3425310996 conn(0x7f5a740fd140 msgr2=0x7f5a740ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.835+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 shutdown_connections 2024-09-21T12:46:27.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.836+0000 7f5a79be3640 1 -- 172.21.15.46:0/3425310996 wait complete. 2024-09-21T12:46:27.847 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:46:27.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 -- 172.21.15.46:0/766279310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104102b60 msgr2=0x7f6104102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 --2- 172.21.15.46:0/766279310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104102b60 0x7f6104102fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f60f8009880 tx=0x7f60f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 -- 172.21.15.46:0/766279310 shutdown_connections 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 --2- 172.21.15.46:0/766279310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104102b60 0x7f6104102fe0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 --2- 172.21.15.46:0/766279310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104101960 0x7f6104101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 -- 172.21.15.46:0/766279310 >> 172.21.15.46:0/766279310 conn(0x7f61040fd0d0 msgr2=0x7f61040ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 -- 172.21.15.46:0/766279310 shutdown_connections 2024-09-21T12:46:27.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.935+0000 7f610a493640 1 -- 172.21.15.46:0/766279310 wait complete. 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.936+0000 7f610a493640 1 Processor -- start 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.936+0000 7f610a493640 1 -- start start 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.936+0000 7f610a493640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 0x7f6104197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.936+0000 7f610a493640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104102b60 0x7f61041979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.936+0000 7f610a493640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f610410a780 con 0x7f6104101960 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.936+0000 7f610a493640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f610410a600 con 0x7f6104102b60 2024-09-21T12:46:27.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 0x7f6104197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f61037fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104102b60 0x7f61041979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 0x7f6104197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42120/0 (socket says 172.21.15.46:42120) 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f61037fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104102b60 0x7f61041979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:59544/0 (socket says 172.21.15.46:59544) 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 -- 172.21.15.46:0/3033808353 learned_addr learned my addr 172.21.15.46:0/3033808353 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 -- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104102b60 msgr2=0x7f61041979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104102b60 0x7f61041979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 -- 172.21.15.46:0/3033808353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6104198050 con 0x7f6104101960 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f6103fff640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 0x7f6104197490 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60f400e940 tx=0x7f60f400ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.937+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60f400cac0 con 0x7f6104101960 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.938+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6104074480 con 0x7f6104101960 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.938+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60f400cc60 con 0x7f6104101960 2024-09-21T12:46:27.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.938+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60f4003be0 con 0x7f6104101960 2024-09-21T12:46:27.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.938+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61040749e0 con 0x7f6104101960 2024-09-21T12:46:27.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.939+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6104076460 con 0x7f6104101960 2024-09-21T12:46:27.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.940+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f60f4018430 con 0x7f6104101960 2024-09-21T12:46:27.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.941+0000 7f61017fa640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f60ec074a80 0x7f60ec076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:27.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.942+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f60f40966a0 con 0x7f6104101960 2024-09-21T12:46:27.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.942+0000 7f61037fe640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f60ec074a80 0x7f60ec076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:27.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.943+0000 7f61037fe640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f60ec074a80 0x7f60ec076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f80058d0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:27.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:27.950+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f60f400ce10 con 0x7f6104101960 2024-09-21T12:46:28.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:27 smithi176 ceph-mon[35476]: pgmap v10: 65 pgs: 65 active+clean; 124 MiB data, 595 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 130 op/s 2024-09-21T12:46:28.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.262+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6104062630 con 0x7f60ec074a80 2024-09-21T12:46:28.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.263+0000 7f61017fa640 1 -- 172.21.15.46:0/3033808353 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f6104062630 con 0x7f60ec074a80 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.265+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f60ec074a80 msgr2=0x7f60ec076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.265+0000 7f610a493640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f60ec074a80 0x7f60ec076f40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f60f8000c00 tx=0x7f60f80058d0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.265+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 msgr2=0x7f6104197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.265+0000 7f610a493640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 0x7f6104197490 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f60f400e940 tx=0x7f60f400ee00 comp rx=0 tx=0).stop 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 shutdown_connections 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f60ec074a80 0x7f60ec076f40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6104102b60 0x7f61041979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 --2- 172.21.15.46:0/3033808353 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6104101960 0x7f6104197490 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 >> 172.21.15.46:0/3033808353 conn(0x7f61040fd0d0 msgr2=0x7f6104105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:28.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 shutdown_connections 2024-09-21T12:46:28.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.266+0000 7f610a493640 1 -- 172.21.15.46:0/3033808353 wait complete. 2024-09-21T12:46:28.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 -- 172.21.15.46:0/2638177984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4100860 msgr2=0x7f95a4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 --2- 172.21.15.46:0/2638177984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4100860 0x7f95a4100c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9594009880 tx=0x7f959402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 -- 172.21.15.46:0/2638177984 shutdown_connections 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 --2- 172.21.15.46:0/2638177984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4101a60 0x7f95a4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 --2- 172.21.15.46:0/2638177984 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4100860 0x7f95a4100c60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 -- 172.21.15.46:0/2638177984 >> 172.21.15.46:0/2638177984 conn(0x7f95a40fc010 msgr2=0x7f95a40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 -- 172.21.15.46:0/2638177984 shutdown_connections 2024-09-21T12:46:28.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.376+0000 7f95aa928640 1 -- 172.21.15.46:0/2638177984 wait complete. 2024-09-21T12:46:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.377+0000 7f95aa928640 1 Processor -- start 2024-09-21T12:46:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.377+0000 7f95aa928640 1 -- start start 2024-09-21T12:46:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.377+0000 7f95aa928640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 0x7f95a4197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:28.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95aa928640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4101a60 0x7f95a4197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:28.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95aa928640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410a780 con 0x7f95a4101a60 2024-09-21T12:46:28.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95aa928640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f95a410a600 con 0x7f95a4100860 2024-09-21T12:46:28.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95a3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 0x7f95a4197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:28.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95a3fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 0x7f95a4197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:59550/0 (socket says 172.21.15.46:59550) 2024-09-21T12:46:28.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95a3fff640 1 -- 172.21.15.46:0/3482473036 learned_addr learned my addr 172.21.15.46:0/3482473036 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:46:28.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.378+0000 7f95a37fe640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4101a60 0x7f95a4197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a37fe640 1 -- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 msgr2=0x7f95a4197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a37fe640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 0x7f95a4197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a37fe640 1 -- 172.21.15.46:0/3482473036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a41980f0 con 0x7f95a4101a60 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a3fff640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 0x7f95a4197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a37fe640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4101a60 0x7f95a4197a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f959800e970 tx=0x7f959800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f959800cac0 con 0x7f95a4101a60 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f959800cc60 con 0x7f95a4101a60 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9598018720 con 0x7f95a4101a60 2024-09-21T12:46:28.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.379+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a419cb30 con 0x7f95a4101a60 2024-09-21T12:46:28.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.380+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a419d0c0 con 0x7f95a4101a60 2024-09-21T12:46:28.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.381+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a4100c60 con 0x7f95a4101a60 2024-09-21T12:46:28.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.382+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9598010430 con 0x7f95a4101a60 2024-09-21T12:46:28.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.382+0000 7f95a17fa640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f958c074ad0 0x7f958c076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:28.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.383+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f9598096750 con 0x7f95a4101a60 2024-09-21T12:46:28.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.383+0000 7f95a3fff640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f958c074ad0 0x7f958c076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:28.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.383+0000 7f95a3fff640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f958c074ad0 0x7f958c076f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95940096c0 tx=0x7f959402a9a0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:28.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.387+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9598061d00 con 0x7f95a4101a60 2024-09-21T12:46:28.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.704+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f95a40626f0 con 0x7f958c074ad0 2024-09-21T12:46:28.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.715+0000 7f95a17fa640 1 -- 172.21.15.46:0/3482473036 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f95a40626f0 con 0x7f958c074ad0 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 6s ago 7m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (7m) 6s ago 7m 8656k - 19.1.1-373-g4e45e6b4 164465d2334a f8608c24a9a8 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (6m) 4s ago 6m 9411k - 19.1.1-373-g4e45e6b4 164465d2334a 3c8b950c3981 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 6s ago 7m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (6m) 4s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 6s ago 7m 79.9M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (2m) 6s ago 2m 106M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (2m) 6s ago 2m 131M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (2m) 4s ago 2m 20.6M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (2m) 4s ago 2m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:46:28.717 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:9283,8765,8443 running (8m) 6s ago 8m 211M - 19.1.1-373-g4e45e6b4 164465d2334a a9438678095d 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (27s) 4s ago 6m 497M - 19.3.0-5104-g44178494 b415816db8b4 95f2eac0602f 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 6s ago 8m 51.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (6m) 4s ago 6m 45.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 6s ago 7m 15.1M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (6m) 4s ago 6m 17.4M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 6s ago 5m 77.2M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 6s ago 4m 78.0M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 6s ago 4m 65.1M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (4m) 4s ago 4m 74.2M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (3m) 4s ago 3m 69.7M 4970M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (3m) 4s ago 3m 67.7M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:46:28.718 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 6s ago 7m 58.4M - 2.43.0 a07b618ecd1d 965906d87e59 2024-09-21T12:46:28.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f958c074ad0 msgr2=0x7f958c076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f958c074ad0 0x7f958c076f90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f95940096c0 tx=0x7f959402a9a0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4101a60 msgr2=0x7f95a4197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4101a60 0x7f95a4197a70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f959800e970 tx=0x7f959800ee30 comp rx=0 tx=0).stop 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 shutdown_connections 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f958c074ad0 0x7f958c076f90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f95a4101a60 0x7f95a4197a70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 --2- 172.21.15.46:0/3482473036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95a4100860 0x7f95a4197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 >> 172.21.15.46:0/3482473036 conn(0x7f95a40fc010 msgr2=0x7f95a4104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 shutdown_connections 2024-09-21T12:46:28.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.719+0000 7f95aa928640 1 -- 172.21.15.46:0/3482473036 wait complete. 2024-09-21T12:46:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:28 smithi176 ceph-mon[35476]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:28 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 -- 172.21.15.46:0/136733566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c100860 msgr2=0x7f952c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 --2- 172.21.15.46:0/136733566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c100860 0x7f952c100c60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f951c009880 tx=0x7f951c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 -- 172.21.15.46:0/136733566 shutdown_connections 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 --2- 172.21.15.46:0/136733566 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c101a60 0x7f952c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 --2- 172.21.15.46:0/136733566 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c100860 0x7f952c100c60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 -- 172.21.15.46:0/136733566 >> 172.21.15.46:0/136733566 conn(0x7f952c0fc010 msgr2=0x7f952c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 -- 172.21.15.46:0/136733566 shutdown_connections 2024-09-21T12:46:28.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.821+0000 7f9531ce8640 1 -- 172.21.15.46:0/136733566 wait complete. 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.822+0000 7f9531ce8640 1 Processor -- start 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.822+0000 7f9531ce8640 1 -- start start 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f9531ce8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c100860 0x7f952c1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f9531ce8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 0x7f952c199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f9531ce8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f952c10a780 con 0x7f952c101a60 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f9531ce8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f952c10a600 con 0x7f952c100860 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 0x7f952c199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 0x7f952c199c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42168/0 (socket says 172.21.15.46:42168) 2024-09-21T12:46:28.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 -- 172.21.15.46:0/3561975107 learned_addr learned my addr 172.21.15.46:0/3561975107 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:46:28.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952b7fe640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c100860 0x7f952c1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:28.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 -- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c100860 msgr2=0x7f952c1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c100860 0x7f952c1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 -- 172.21.15.46:0/3561975107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c19a2a0 con 0x7f952c101a60 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.823+0000 7f952affd640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 0x7f952c199c20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f952000e970 tx=0x7f952000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.824+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f952000cac0 con 0x7f952c101a60 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.824+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f952000cc60 con 0x7f952c101a60 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.824+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c19ece0 con 0x7f952c101a60 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.824+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9520018720 con 0x7f952c101a60 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.824+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c19f210 con 0x7f952c101a60 2024-09-21T12:46:28.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.825+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c100c60 con 0x7f952c101a60 2024-09-21T12:46:28.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.826+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f9520018a00 con 0x7f952c101a60 2024-09-21T12:46:28.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.827+0000 7f9528ff9640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9514074a20 0x7f9514076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:28.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.827+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f95200968b0 con 0x7f952c101a60 2024-09-21T12:46:28.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.827+0000 7f952b7fe640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9514074a20 0x7f9514076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:28.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.828+0000 7f952b7fe640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9514074a20 0x7f9514076ee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f951c006010 tx=0x7f951c005a20 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:28.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:28.833+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9520061de0 con 0x7f952c101a60 2024-09-21T12:46:28.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:28 smithi046 ceph-mon[27868]: from='client.24417 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:28.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:28 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:29.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.222+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f952c062df0 con 0x7f952c101a60 2024-09-21T12:46:29.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.222+0000 7f9528ff9640 1 -- 172.21.15.46:0/3561975107 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f9520066c90 con 0x7f952c101a60 2024-09-21T12:46:29.224 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:46:29.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:46:29.224 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:46:29.224 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:46:29.224 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:46:29.225 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:46:29.226 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9514074a20 msgr2=0x7f9514076ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9514074a20 0x7f9514076ee0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f951c006010 tx=0x7f951c005a20 comp rx=0 tx=0).stop 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 msgr2=0x7f952c199c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 0x7f952c199c20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f952000e970 tx=0x7f952000ee30 comp rx=0 tx=0).stop 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 shutdown_connections 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9514074a20 0x7f9514076ee0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f952c101a60 0x7f952c199c20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 --2- 172.21.15.46:0/3561975107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f952c100860 0x7f952c1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.225+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 >> 172.21.15.46:0/3561975107 conn(0x7f952c0fc010 msgr2=0x7f952c104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:29.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.226+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 shutdown_connections 2024-09-21T12:46:29.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.226+0000 7f9531ce8640 1 -- 172.21.15.46:0/3561975107 wait complete. 2024-09-21T12:46:29.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 -- 172.21.15.46:0/3025751080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34101a60 msgr2=0x7f8e34101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/3025751080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34101a60 0x7f8e34101ee0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009880 tx=0x7f8e2402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 -- 172.21.15.46:0/3025751080 shutdown_connections 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/3025751080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34101a60 0x7f8e34101ee0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/3025751080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e34100860 0x7f8e34100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 -- 172.21.15.46:0/3025751080 >> 172.21.15.46:0/3025751080 conn(0x7f8e340fc010 msgr2=0x7f8e340fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 -- 172.21.15.46:0/3025751080 shutdown_connections 2024-09-21T12:46:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.333+0000 7f8e3c46d640 1 -- 172.21.15.46:0/3025751080 wait complete. 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3c46d640 1 Processor -- start 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3c46d640 1 -- start start 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3c46d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 0x7f8e341996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3c46d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e34101a60 0x7f8e34199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3c46d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3410a780 con 0x7f8e34100860 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3c46d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e3410a600 con 0x7f8e34101a60 2024-09-21T12:46:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3a209640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 0x7f8e341996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3a209640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 0x7f8e341996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42190/0 (socket says 172.21.15.46:42190) 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e3a209640 1 -- 172.21.15.46:0/2998171732 learned_addr learned my addr 172.21.15.46:0/2998171732 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.334+0000 7f8e39a08640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e34101a60 0x7f8e34199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e3a209640 1 -- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e34101a60 msgr2=0x7f8e34199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e3a209640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e34101a60 0x7f8e34199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e3a209640 1 -- 172.21.15.46:0/2998171732 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e3419a290 con 0x7f8e34100860 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e3a209640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 0x7f8e341996d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000d8d0 tx=0x7f8e3000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:29.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e30017020 con 0x7f8e34100860 2024-09-21T12:46:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e30010460 con 0x7f8e34100860 2024-09-21T12:46:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e3000f5b0 con 0x7f8e34100860 2024-09-21T12:46:29.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e3419ecd0 con 0x7f8e34100860 2024-09-21T12:46:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.335+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e3419f180 con 0x7f8e34100860 2024-09-21T12:46:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.337+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e34100c60 con 0x7f8e34100860 2024-09-21T12:46:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.337+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8e3001a020 con 0x7f8e34100860 2024-09-21T12:46:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.338+0000 7f8e2b7fe640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8e20074a30 0x7f8e20076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.338+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f8e30096280 con 0x7f8e34100860 2024-09-21T12:46:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.338+0000 7f8e39a08640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8e20074a30 0x7f8e20076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:29.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.339+0000 7f8e39a08640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8e20074a30 0x7f8e20076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e24000c00 tx=0x7f8e240058d0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:29.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.344+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8e30021030 con 0x7f8e34100860 2024-09-21T12:46:29.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.680+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8e34062630 con 0x7f8e20074a30 2024-09-21T12:46:29.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.682+0000 7f8e2b7fe640 1 -- 172.21.15.46:0/2998171732 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f8e34062630 con 0x7f8e20074a30 2024-09-21T12:46:29.683 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:46:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:46:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:46:29.683 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:46:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-09-21T12:46:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T12:46:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-09-21T12:46:29.684 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:46:29.684 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:46:29.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.684+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8e20074a30 msgr2=0x7f8e20076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.684+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8e20074a30 0x7f8e20076ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8e24000c00 tx=0x7f8e240058d0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.684+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 msgr2=0x7f8e341996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.684+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 0x7f8e341996d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8e3000d8d0 tx=0x7f8e3000dd90 comp rx=0 tx=0).stop 2024-09-21T12:46:29.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 shutdown_connections 2024-09-21T12:46:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8e20074a30 0x7f8e20076ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e34101a60 0x7f8e34199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 --2- 172.21.15.46:0/2998171732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e34100860 0x7f8e341996d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 >> 172.21.15.46:0/2998171732 conn(0x7f8e340fc010 msgr2=0x7f8e34104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 shutdown_connections 2024-09-21T12:46:29.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:29.685+0000 7f8e3c46d640 1 -- 172.21.15.46:0/2998171732 wait complete. 2024-09-21T12:46:29.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:29 smithi046 ceph-mon[27868]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:29 smithi046 ceph-mon[27868]: pgmap v11: 65 pgs: 65 active+clean; 133 MiB data, 631 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 193 op/s 2024-09-21T12:46:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:29 smithi046 ceph-mon[27868]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:29 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3561975107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:46:29.964 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:29 smithi176 ceph-mon[35476]: from='client.14702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:29.964 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:29 smithi176 ceph-mon[35476]: pgmap v11: 65 pgs: 65 active+clean; 133 MiB data, 631 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.8 MiB/s wr, 193 op/s 2024-09-21T12:46:29.965 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:29 smithi176 ceph-mon[35476]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:29.965 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:29 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3561975107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: Adjusting osd_memory_target on smithi176 to 2240M 2024-09-21T12:46:31.308 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:31.309 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: Adjusting osd_memory_target on smithi176 to 2240M 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:31.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:31.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:46:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:46:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:46:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:46:32.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:46:32.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:46:32.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: pgmap v12: 65 pgs: 65 active+clean; 149 MiB data, 681 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2024-09-21T12:46:32.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Reconfiguring ceph-exporter.smithi046 (dependencies changed)... 2024-09-21T12:46:32.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:32 smithi176 ceph-mon[35476]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: pgmap v12: 65 pgs: 65 active+clean; 149 MiB data, 681 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 234 op/s 2024-09-21T12:46:32.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Reconfiguring ceph-exporter.smithi046 (dependencies changed)... 2024-09-21T12:46:32.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:32 smithi046 ceph-mon[27868]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-09-21T12:46:34.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:34 smithi046 ceph-mon[27868]: pgmap v13: 65 pgs: 65 active+clean; 149 MiB data, 681 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 192 op/s 2024-09-21T12:46:34.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:34 smithi176 ceph-mon[35476]: pgmap v13: 65 pgs: 65 active+clean; 149 MiB data, 681 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.1 MiB/s wr, 192 op/s 2024-09-21T12:46:36.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:36 smithi046 ceph-mon[27868]: pgmap v14: 65 pgs: 65 active+clean; 166 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-09-21T12:46:36.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:36 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:36.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:36 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:36.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:36 smithi176 ceph-mon[35476]: pgmap v14: 65 pgs: 65 active+clean; 166 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.6 MiB/s wr, 310 op/s 2024-09-21T12:46:36.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:36 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:36.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:36 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:37 smithi176 ceph-mon[35476]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-21T12:46:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:37 smithi176 ceph-mon[35476]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-21T12:46:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:37 smithi046 ceph-mon[27868]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-21T12:46:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:37 smithi046 ceph-mon[27868]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-21T12:46:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:38 smithi176 ceph-mon[35476]: pgmap v15: 65 pgs: 65 active+clean; 166 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-09-21T12:46:38.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:38 smithi046 ceph-mon[27868]: pgmap v15: 65 pgs: 65 active+clean; 166 MiB data, 758 MiB used, 536 GiB / 536 GiB avail; 1.8 MiB/s rd, 3.6 MiB/s wr, 245 op/s 2024-09-21T12:46:40.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:40 smithi046 ceph-mon[27868]: pgmap v16: 65 pgs: 65 active+clean; 172 MiB data, 749 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 327 op/s 2024-09-21T12:46:40.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:40 smithi176 ceph-mon[35476]: pgmap v16: 65 pgs: 65 active+clean; 172 MiB data, 749 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.1 MiB/s wr, 327 op/s 2024-09-21T12:46:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:42 smithi046 ceph-mon[27868]: pgmap v17: 65 pgs: 65 active+clean; 180 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 374 op/s 2024-09-21T12:46:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:42 smithi176 ceph-mon[35476]: pgmap v17: 65 pgs: 65 active+clean; 180 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 2.3 MiB/s rd, 4.1 MiB/s wr, 374 op/s 2024-09-21T12:46:44.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: pgmap v18: 65 pgs: 65 active+clean; 180 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2024-09-21T12:46:44.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:44.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:44.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:44.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:44.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:44.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:44.252 INFO:tasks.workunit.client.0.smithi046.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T12:46:44.260 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:46:44.261 INFO:tasks.workunit.client.0.smithi046.stderr:+ make 2024-09-21T12:46:44.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: pgmap v18: 65 pgs: 65 active+clean; 180 MiB data, 765 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.8 MiB/s wr, 310 op/s 2024-09-21T12:46:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:46:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:46:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:45.115 INFO:tasks.workunit.client.0.smithi046.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T12:46:45.298 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:45 smithi176 ceph-mon[35476]: Reconfiguring ceph-exporter.smithi176 (dependencies changed)... 2024-09-21T12:46:45.299 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:45 smithi176 ceph-mon[35476]: Deploying daemon ceph-exporter.smithi176 on smithi176 2024-09-21T12:46:45.370 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:45 smithi046 ceph-mon[27868]: Reconfiguring ceph-exporter.smithi176 (dependencies changed)... 2024-09-21T12:46:45.370 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:45 smithi046 ceph-mon[27868]: Deploying daemon ceph-exporter.smithi176 on smithi176 2024-09-21T12:46:45.556 INFO:tasks.workunit.client.0.smithi046.stderr:++ readlink -f fsstress 2024-09-21T12:46:45.558 INFO:tasks.workunit.client.0.smithi046.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T12:46:45.559 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-09-21T12:46:45.560 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:46:45.560 INFO:tasks.workunit.client.0.smithi046.stderr:+ popd 2024-09-21T12:46:45.561 INFO:tasks.workunit.client.0.smithi046.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:46:45.561 INFO:tasks.workunit.client.0.smithi046.stderr:++ mktemp -d -p . 2024-09-21T12:46:45.564 INFO:tasks.workunit.client.0.smithi046.stderr:+ T=./tmp.utkmvJtjTl 2024-09-21T12:46:45.564 INFO:tasks.workunit.client.0.smithi046.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.utkmvJtjTl -l 1 -n 1000 -p 10 -v 2024-09-21T12:46:45.567 INFO:tasks.workunit.client.0.smithi046.stdout:seed = 1726376385 2024-09-21T12:46:45.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/0: link - no file 2024-09-21T12:46:45.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/0: dwrite - no filename 2024-09-21T12:46:45.575 INFO:tasks.workunit.client.0.smithi046.stdout:2/1: unlink - no file 2024-09-21T12:46:45.575 INFO:tasks.workunit.client.0.smithi046.stdout:1/1: creat f0 x:0 0 0 2024-09-21T12:46:45.577 INFO:tasks.workunit.client.0.smithi046.stdout:1/2: write f0 [149838,99799] 0 2024-09-21T12:46:45.577 INFO:tasks.workunit.client.0.smithi046.stdout:2/2: creat f0 x:0 0 0 2024-09-21T12:46:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/0: chown . 1800771 1 2024-09-21T12:46:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/1: dwrite - no filename 2024-09-21T12:46:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:1/3: chown f0 353261839 1 2024-09-21T12:46:45.578 INFO:tasks.workunit.client.0.smithi046.stdout:2/3: chown f0 152400353 1 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/0: fsync - no filename 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/1: dwrite - no filename 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/2: dread - no filename 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/3: write - no filename 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/4: dwrite - no filename 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/5: unlink - no file 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/6: dwrite - no filename 2024-09-21T12:46:45.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/7: stat - no entries 2024-09-21T12:46:45.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/4: rename f0 to f1 0 2024-09-21T12:46:45.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/5: rmdir - no directory 2024-09-21T12:46:45.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/6: rmdir - no directory 2024-09-21T12:46:45.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/4: symlink l1 0 2024-09-21T12:46:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/2: creat f0 x:0 0 0 2024-09-21T12:46:45.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/3: chown f0 21467295 1 2024-09-21T12:46:45.584 INFO:tasks.workunit.client.0.smithi046.stdout:5/0: rename - no filename 2024-09-21T12:46:45.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/1: truncate - no filename 2024-09-21T12:46:45.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/2: rename - no filename 2024-09-21T12:46:45.585 INFO:tasks.workunit.client.0.smithi046.stdout:5/3: readlink - no filename 2024-09-21T12:46:45.585 INFO:tasks.workunit.client.0.smithi046.stdout:3/4: truncate f0 137420 0 2024-09-21T12:46:45.588 INFO:tasks.workunit.client.0.smithi046.stdout:2/5: creat f2 x:0 0 0 2024-09-21T12:46:45.588 INFO:tasks.workunit.client.0.smithi046.stdout:1/7: creat f2 x:0 0 0 2024-09-21T12:46:45.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/8: creat f0 x:0 0 0 2024-09-21T12:46:45.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/0: chown . 0 1 2024-09-21T12:46:45.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/1: dwrite - no filename 2024-09-21T12:46:45.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/9: chown f0 147 1 2024-09-21T12:46:45.591 INFO:tasks.workunit.client.0.smithi046.stdout:2/6: mknod c3 0 2024-09-21T12:46:45.593 INFO:tasks.workunit.client.0.smithi046.stdout:2/7: write f0 [207818,128667] 0 2024-09-21T12:46:45.594 INFO:tasks.workunit.client.0.smithi046.stdout:1/8: creat f3 x:0 0 0 2024-09-21T12:46:45.595 INFO:tasks.workunit.client.0.smithi046.stdout:5/4: creat f0 x:0 0 0 2024-09-21T12:46:45.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/9: fdatasync f2 0 2024-09-21T12:46:45.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/5: dwrite f0 [0,4194304] 0 2024-09-21T12:46:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/5: write f0 [805001,44660] 0 2024-09-21T12:46:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/0: dread - no filename 2024-09-21T12:46:45.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/1: fdatasync - no filename 2024-09-21T12:46:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:4/10: mkdir d1 0 2024-09-21T12:46:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/2: chown . 28856439 1 2024-09-21T12:46:45.599 INFO:tasks.workunit.client.0.smithi046.stdout:7/3: link - no file 2024-09-21T12:46:45.601 INFO:tasks.workunit.client.0.smithi046.stdout:5/6: chown f0 1634876 1 2024-09-21T12:46:45.606 INFO:tasks.workunit.client.0.smithi046.stdout:5/7: write f0 [80165,88093] 0 2024-09-21T12:46:45.609 INFO:tasks.workunit.client.0.smithi046.stdout:1/10: write f1 [429943,91361] 0 2024-09-21T12:46:45.610 INFO:tasks.workunit.client.0.smithi046.stdout:3/6: creat f1 x:0 0 0 2024-09-21T12:46:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:8/0: rename - no filename 2024-09-21T12:46:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:8/1: read - no filename 2024-09-21T12:46:45.611 INFO:tasks.workunit.client.0.smithi046.stdout:8/2: truncate - no filename 2024-09-21T12:46:45.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/8: dwrite f0 [0,4194304] 0 2024-09-21T12:46:45.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/4: symlink l0 0 2024-09-21T12:46:45.615 INFO:tasks.workunit.client.0.smithi046.stdout:5/8: creat f1 x:0 0 0 2024-09-21T12:46:45.616 INFO:tasks.workunit.client.0.smithi046.stdout:1/11: dread - f3 zero size 2024-09-21T12:46:45.617 INFO:tasks.workunit.client.0.smithi046.stdout:7/5: creat f1 x:0 0 0 2024-09-21T12:46:45.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/7: rename f0 to f2 0 2024-09-21T12:46:45.619 INFO:tasks.workunit.client.0.smithi046.stdout:7/6: fdatasync f1 0 2024-09-21T12:46:45.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/11: dwrite f0 [0,4194304] 0 2024-09-21T12:46:45.620 INFO:tasks.workunit.client.0.smithi046.stdout:2/9: mknod c4 0 2024-09-21T12:46:45.622 INFO:tasks.workunit.client.0.smithi046.stdout:1/12: mkdir d4 0 2024-09-21T12:46:45.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/8: chown f2 23 1 2024-09-21T12:46:45.623 INFO:tasks.workunit.client.0.smithi046.stdout:7/7: truncate f1 454498 0 2024-09-21T12:46:45.624 INFO:tasks.workunit.client.0.smithi046.stdout:8/3: mknod c0 0 2024-09-21T12:46:45.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/8: fdatasync f1 0 2024-09-21T12:46:45.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/10: symlink l5 0 2024-09-21T12:46:45.628 INFO:tasks.workunit.client.0.smithi046.stdout:3/9: creat f3 x:0 0 0 2024-09-21T12:46:45.629 INFO:tasks.workunit.client.0.smithi046.stdout:9/0: getdents . 0 2024-09-21T12:46:45.629 INFO:tasks.workunit.client.0.smithi046.stdout:9/1: rename - no filename 2024-09-21T12:46:45.631 INFO:tasks.workunit.client.0.smithi046.stdout:9/2: chown . 4777 1 2024-09-21T12:46:45.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/13: rename f2 to d4/f5 0 2024-09-21T12:46:45.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/3: chown . 28828 1 2024-09-21T12:46:45.632 INFO:tasks.workunit.client.0.smithi046.stdout:8/4: mkdir d1 0 2024-09-21T12:46:45.634 INFO:tasks.workunit.client.0.smithi046.stdout:5/9: dwrite f1 [0,4194304] 0 2024-09-21T12:46:45.634 INFO:tasks.workunit.client.0.smithi046.stdout:2/11: symlink l6 0 2024-09-21T12:46:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/12: symlink d1/l2 0 2024-09-21T12:46:45.636 INFO:tasks.workunit.client.0.smithi046.stdout:8/5: chown c0 2232380 1 2024-09-21T12:46:45.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/12: read - f2 zero size 2024-09-21T12:46:45.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/6: chown d1 2570 1 2024-09-21T12:46:45.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/10: rename f3 to f4 0 2024-09-21T12:46:45.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/13: write f0 [2134757,8816] 0 2024-09-21T12:46:45.640 INFO:tasks.workunit.client.0.smithi046.stdout:3/11: stat f2 0 2024-09-21T12:46:45.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/14: mknod d4/c6 0 2024-09-21T12:46:45.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/10: creat f2 x:0 0 0 2024-09-21T12:46:45.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/11: rmdir - no directory 2024-09-21T12:46:45.643 INFO:tasks.workunit.client.0.smithi046.stdout:7/9: dwrite f1 [0,4194304] 0 2024-09-21T12:46:45.644 INFO:tasks.workunit.client.0.smithi046.stdout:2/13: rename l5 to l7 0 2024-09-21T12:46:45.649 INFO:tasks.workunit.client.0.smithi046.stdout:9/4: creat f0 x:0 0 0 2024-09-21T12:46:45.650 INFO:tasks.workunit.client.0.smithi046.stdout:3/12: mkdir d5 0 2024-09-21T12:46:45.653 INFO:tasks.workunit.client.0.smithi046.stdout:4/14: mknod d1/c3 0 2024-09-21T12:46:45.655 INFO:tasks.workunit.client.0.smithi046.stdout:5/12: symlink l3 0 2024-09-21T12:46:45.656 INFO:tasks.workunit.client.0.smithi046.stdout:1/15: dwrite f3 [0,4194304] 0 2024-09-21T12:46:45.657 INFO:tasks.workunit.client.0.smithi046.stdout:2/14: dread f0 [0,4194304] 0 2024-09-21T12:46:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:8/7: mknod d1/c2 0 2024-09-21T12:46:45.660 INFO:tasks.workunit.client.0.smithi046.stdout:8/8: readlink - no filename 2024-09-21T12:46:45.665 INFO:tasks.workunit.client.0.smithi046.stdout:9/5: rename f0 to f1 0 2024-09-21T12:46:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/13: rename f1 to d5/f6 0 2024-09-21T12:46:45.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/14: readlink - no filename 2024-09-21T12:46:45.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/15: dwrite f0 [0,4194304] 0 2024-09-21T12:46:45.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/16: read f0 [916674,104160] 0 2024-09-21T12:46:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/16: dwrite f1 [0,4194304] 0 2024-09-21T12:46:45.671 INFO:tasks.workunit.client.0.smithi046.stdout:1/17: readlink - no filename 2024-09-21T12:46:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:5/13: unlink f0 0 2024-09-21T12:46:45.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/18: dread - d4/f5 zero size 2024-09-21T12:46:45.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/17: dread f0 [0,4194304] 0 2024-09-21T12:46:45.678 INFO:tasks.workunit.client.0.smithi046.stdout:8/9: creat d1/f3 x:0 0 0 2024-09-21T12:46:45.679 INFO:tasks.workunit.client.0.smithi046.stdout:8/10: truncate d1/f3 92594 0 2024-09-21T12:46:45.680 INFO:tasks.workunit.client.0.smithi046.stdout:8/11: chown d1/f3 1671 1 2024-09-21T12:46:45.680 INFO:tasks.workunit.client.0.smithi046.stdout:8/12: rename d1 to d1/d4 22 2024-09-21T12:46:45.684 INFO:tasks.workunit.client.0.smithi046.stdout:5/14: mkdir d4 0 2024-09-21T12:46:45.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/13: dread d1/f3 [0,4194304] 0 2024-09-21T12:46:45.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/19: creat d4/f7 x:0 0 0 2024-09-21T12:46:45.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/14: dread d1/f3 [0,4194304] 0 2024-09-21T12:46:45.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/20: stat d4/f5 0 2024-09-21T12:46:45.694 INFO:tasks.workunit.client.0.smithi046.stdout:9/6: dwrite f1 [0,4194304] 0 2024-09-21T12:46:45.695 INFO:tasks.workunit.client.0.smithi046.stdout:3/15: dwrite f2 [0,4194304] 0 2024-09-21T12:46:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:5/15: symlink d4/l5 0 2024-09-21T12:46:45.697 INFO:tasks.workunit.client.0.smithi046.stdout:5/16: chown l3 35730877 1 2024-09-21T12:46:45.701 INFO:tasks.workunit.client.0.smithi046.stdout:8/15: read d1/f3 [27503,93539] 0 2024-09-21T12:46:45.702 INFO:tasks.workunit.client.0.smithi046.stdout:1/21: symlink d4/l8 0 2024-09-21T12:46:45.702 INFO:tasks.workunit.client.0.smithi046.stdout:9/7: dread f1 [0,4194304] 0 2024-09-21T12:46:45.706 INFO:tasks.workunit.client.0.smithi046.stdout:3/16: creat d5/f7 x:0 0 0 2024-09-21T12:46:45.707 INFO:tasks.workunit.client.0.smithi046.stdout:8/16: creat d1/f5 x:0 0 0 2024-09-21T12:46:45.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/22: creat d4/f9 x:0 0 0 2024-09-21T12:46:45.709 INFO:tasks.workunit.client.0.smithi046.stdout:8/17: dread - d1/f5 zero size 2024-09-21T12:46:45.709 INFO:tasks.workunit.client.0.smithi046.stdout:9/8: creat f2 x:0 0 0 2024-09-21T12:46:45.710 INFO:tasks.workunit.client.0.smithi046.stdout:5/17: dwrite f2 [0,4194304] 0 2024-09-21T12:46:45.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/9: read f1 [543342,52265] 0 2024-09-21T12:46:45.711 INFO:tasks.workunit.client.0.smithi046.stdout:5/18: chown l3 27645 1 2024-09-21T12:46:45.712 INFO:tasks.workunit.client.0.smithi046.stdout:8/18: truncate d1/f5 800718 0 2024-09-21T12:46:45.717 INFO:tasks.workunit.client.0.smithi046.stdout:1/23: creat d4/fa x:0 0 0 2024-09-21T12:46:45.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/10: fdatasync f1 0 2024-09-21T12:46:45.721 INFO:tasks.workunit.client.0.smithi046.stdout:8/19: creat d1/f6 x:0 0 0 2024-09-21T12:46:45.723 INFO:tasks.workunit.client.0.smithi046.stdout:9/11: chown f1 414111 1 2024-09-21T12:46:45.724 INFO:tasks.workunit.client.0.smithi046.stdout:3/17: dwrite d5/f6 [0,4194304] 0 2024-09-21T12:46:45.725 INFO:tasks.workunit.client.0.smithi046.stdout:8/20: rmdir d1 39 2024-09-21T12:46:45.726 INFO:tasks.workunit.client.0.smithi046.stdout:1/24: dread f1 [0,4194304] 0 2024-09-21T12:46:45.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/25: write d4/fa [28786,39996] 0 2024-09-21T12:46:45.729 INFO:tasks.workunit.client.0.smithi046.stdout:9/12: creat f3 x:0 0 0 2024-09-21T12:46:45.732 INFO:tasks.workunit.client.0.smithi046.stdout:1/26: dread f3 [0,4194304] 0 2024-09-21T12:46:46.101 INFO:tasks.workunit.client.1.smithi176.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T12:46:46.106 INFO:tasks.workunit.client.1.smithi176.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:46:46.107 INFO:tasks.workunit.client.1.smithi176.stderr:+ make 2024-09-21T12:46:46.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/18: write f0 [5227808,41975] 0 2024-09-21T12:46:46.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/19: creat d1/f4 x:0 0 0 2024-09-21T12:46:46.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/20: chown d1/l2 9 1 2024-09-21T12:46:46.188 INFO:tasks.workunit.client.0.smithi046.stdout:4/21: write f0 [1780100,50960] 0 2024-09-21T12:46:46.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/22: unlink f0 0 2024-09-21T12:46:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/21: read d1/f3 [69973,81852] 0 2024-09-21T12:46:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:4/23: symlink d1/l5 0 2024-09-21T12:46:46.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/22: read d1/f5 [293549,66375] 0 2024-09-21T12:46:46.194 INFO:tasks.workunit.client.0.smithi046.stdout:4/24: creat d1/f6 x:0 0 0 2024-09-21T12:46:46.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/25: unlink d1/l5 0 2024-09-21T12:46:46.198 INFO:tasks.workunit.client.0.smithi046.stdout:4/26: rmdir d1 39 2024-09-21T12:46:46.199 INFO:tasks.workunit.client.0.smithi046.stdout:2/15: getdents . 0 2024-09-21T12:46:46.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/10: write f1 [4345783,111267] 0 2024-09-21T12:46:46.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/27: write d1/f6 [907986,76153] 0 2024-09-21T12:46:46.202 INFO:tasks.workunit.client.0.smithi046.stdout:4/28: write d1/f6 [1528125,80966] 0 2024-09-21T12:46:46.206 INFO:tasks.workunit.client.0.smithi046.stdout:7/11: fdatasync f1 0 2024-09-21T12:46:46.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/13: fsync f1 0 2024-09-21T12:46:46.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/12: dwrite f1 [0,4194304] 0 2024-09-21T12:46:46.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/13: truncate f1 5310198 0 2024-09-21T12:46:46.217 INFO:tasks.workunit.client.0.smithi046.stdout:8/23: truncate d1/f3 652929 0 2024-09-21T12:46:46.219 INFO:tasks.workunit.client.0.smithi046.stdout:8/24: rmdir d1 39 2024-09-21T12:46:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/14: dwrite f1 [4194304,4194304] 0 2024-09-21T12:46:46.221 INFO:tasks.workunit.client.0.smithi046.stdout:3/18: getdents d5 0 2024-09-21T12:46:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/25: creat d1/f7 x:0 0 0 2024-09-21T12:46:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:3/19: truncate d5/f7 813047 0 2024-09-21T12:46:46.223 INFO:tasks.workunit.client.0.smithi046.stdout:1/27: fsync d4/f9 0 2024-09-21T12:46:46.224 INFO:tasks.workunit.client.0.smithi046.stdout:3/20: write f2 [2961833,16763] 0 2024-09-21T12:46:46.224 INFO:tasks.workunit.client.0.smithi046.stdout:8/26: dread - d1/f7 zero size 2024-09-21T12:46:46.225 INFO:tasks.workunit.client.0.smithi046.stdout:1/28: chown d4/c6 0 1 2024-09-21T12:46:46.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/27: chown d1/f7 464488 1 2024-09-21T12:46:46.227 INFO:tasks.workunit.client.0.smithi046.stdout:3/21: fdatasync f4 0 2024-09-21T12:46:46.229 INFO:tasks.workunit.client.0.smithi046.stdout:8/28: rmdir d1 39 2024-09-21T12:46:46.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/22: write d5/f6 [2491303,28826] 0 2024-09-21T12:46:46.235 INFO:tasks.workunit.client.0.smithi046.stdout:8/29: dread - d1/f7 zero size 2024-09-21T12:46:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:3/23: write f4 [268248,87900] 0 2024-09-21T12:46:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:9/14: getdents . 0 2024-09-21T12:46:46.237 INFO:tasks.workunit.client.0.smithi046.stdout:9/15: rmdir - no directory 2024-09-21T12:46:46.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/19: dwrite f2 [4194304,4194304] 0 2024-09-21T12:46:46.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/16: creat f4 x:0 0 0 2024-09-21T12:46:46.242 INFO:tasks.workunit.client.0.smithi046.stdout:5/20: chown d4/l5 3 1 2024-09-21T12:46:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/29: dwrite f1 [0,4194304] 0 2024-09-21T12:46:46.243 INFO:tasks.workunit.client.0.smithi046.stdout:3/24: creat d5/f8 x:0 0 0 2024-09-21T12:46:46.248 INFO:tasks.workunit.client.0.smithi046.stdout:9/17: creat f5 x:0 0 0 2024-09-21T12:46:46.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/18: creat f6 x:0 0 0 2024-09-21T12:46:46.255 INFO:tasks.workunit.client.0.smithi046.stdout:3/25: dwrite f4 [0,4194304] 0 2024-09-21T12:46:46.259 INFO:tasks.workunit.client.0.smithi046.stdout:3/26: dread d5/f7 [0,4194304] 0 2024-09-21T12:46:46.260 INFO:tasks.workunit.client.0.smithi046.stdout:9/19: unlink f5 0 2024-09-21T12:46:46.262 INFO:tasks.workunit.client.0.smithi046.stdout:5/21: getdents d4 0 2024-09-21T12:46:46.265 INFO:tasks.workunit.client.0.smithi046.stdout:9/20: write f6 [975933,106687] 0 2024-09-21T12:46:46.266 INFO:tasks.workunit.client.0.smithi046.stdout:1/30: dwrite d4/f5 [0,4194304] 0 2024-09-21T12:46:46.267 INFO:tasks.workunit.client.0.smithi046.stdout:9/21: dread - f2 zero size 2024-09-21T12:46:46.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/27: dwrite f2 [0,4194304] 0 2024-09-21T12:46:46.273 INFO:tasks.workunit.client.0.smithi046.stdout:5/22: rename l3 to d4/l6 0 2024-09-21T12:46:46.275 INFO:tasks.workunit.client.0.smithi046.stdout:5/23: truncate f2 8851978 0 2024-09-21T12:46:46.276 INFO:tasks.workunit.client.0.smithi046.stdout:5/24: readlink d4/l5 0 2024-09-21T12:46:46.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/25: chown d4/l5 23823 1 2024-09-21T12:46:46.279 INFO:tasks.workunit.client.0.smithi046.stdout:5/26: fdatasync f1 0 2024-09-21T12:46:46.280 INFO:tasks.workunit.client.0.smithi046.stdout:3/28: rename f4 to d5/f9 0 2024-09-21T12:46:46.281 INFO:tasks.workunit.client.0.smithi046.stdout:1/31: dwrite d4/f9 [0,4194304] 0 2024-09-21T12:46:46.289 INFO:tasks.workunit.client.0.smithi046.stdout:5/27: dwrite f1 [0,4194304] 0 2024-09-21T12:46:46.291 INFO:tasks.workunit.client.0.smithi046.stdout:3/29: creat d5/fa x:0 0 0 2024-09-21T12:46:46.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/28: write f1 [2400776,55633] 0 2024-09-21T12:46:46.301 INFO:tasks.workunit.client.0.smithi046.stdout:1/32: link d4/c6 d4/cb 0 2024-09-21T12:46:46.302 INFO:tasks.workunit.client.0.smithi046.stdout:3/30: dwrite d5/f9 [0,4194304] 0 2024-09-21T12:46:46.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/33: readlink d4/l8 0 2024-09-21T12:46:46.303 INFO:tasks.workunit.client.0.smithi046.stdout:3/31: chown d5/f9 371300 1 2024-09-21T12:46:46.310 INFO:tasks.workunit.client.0.smithi046.stdout:1/34: mknod d4/cc 0 2024-09-21T12:46:46.314 INFO:tasks.workunit.client.0.smithi046.stdout:1/35: creat d4/fd x:0 0 0 2024-09-21T12:46:46.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:46 smithi176 ceph-mon[35476]: pgmap v19: 65 pgs: 65 active+clean; 206 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 453 op/s 2024-09-21T12:46:46.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:46 smithi046 ceph-mon[27868]: pgmap v19: 65 pgs: 65 active+clean; 206 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 453 op/s 2024-09-21T12:46:46.438 INFO:tasks.workunit.client.0.smithi046.stdout:4/29: fsync d1/f6 0 2024-09-21T12:46:46.438 INFO:tasks.workunit.client.0.smithi046.stdout:4/30: fsync d1/f6 0 2024-09-21T12:46:46.439 INFO:tasks.workunit.client.0.smithi046.stdout:2/16: truncate f0 650584 0 2024-09-21T12:46:46.440 INFO:tasks.workunit.client.0.smithi046.stdout:4/31: symlink d1/l7 0 2024-09-21T12:46:46.442 INFO:tasks.workunit.client.0.smithi046.stdout:2/17: rename l7 to l8 0 2024-09-21T12:46:46.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/30: fsync d1/f3 0 2024-09-21T12:46:46.443 INFO:tasks.workunit.client.1.smithi176.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T12:46:46.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/31: creat d1/f8 x:0 0 0 2024-09-21T12:46:46.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/22: fsync f4 0 2024-09-21T12:46:46.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/32: dwrite d1/f4 [0,4194304] 0 2024-09-21T12:46:46.450 INFO:tasks.workunit.client.0.smithi046.stdout:9/23: symlink l7 0 2024-09-21T12:46:46.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/24: write f3 [685591,97913] 0 2024-09-21T12:46:46.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/32: rename c0 to d1/c9 0 2024-09-21T12:46:46.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/25: write f2 [487852,116056] 0 2024-09-21T12:46:46.455 INFO:tasks.workunit.client.0.smithi046.stdout:9/26: write f6 [1206393,96178] 0 2024-09-21T12:46:46.455 INFO:tasks.workunit.client.0.smithi046.stdout:9/27: chown f2 9067370 1 2024-09-21T12:46:46.458 INFO:tasks.workunit.client.0.smithi046.stdout:8/33: rename d1/f5 to d1/fa 0 2024-09-21T12:46:46.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/28: symlink l8 0 2024-09-21T12:46:46.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/34: creat d1/fb x:0 0 0 2024-09-21T12:46:46.462 INFO:tasks.workunit.client.0.smithi046.stdout:8/35: symlink d1/lc 0 2024-09-21T12:46:46.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/36: link d1/f6 d1/fd 0 2024-09-21T12:46:46.469 INFO:tasks.workunit.client.0.smithi046.stdout:4/33: fdatasync d1/f4 0 2024-09-21T12:46:46.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/29: truncate f2 4510543 0 2024-09-21T12:46:46.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/32: truncate d5/f9 1110142 0 2024-09-21T12:46:46.476 INFO:tasks.workunit.client.0.smithi046.stdout:4/34: dwrite d1/f6 [0,4194304] 0 2024-09-21T12:46:46.479 INFO:tasks.workunit.client.0.smithi046.stdout:3/33: creat d5/fb x:0 0 0 2024-09-21T12:46:46.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/35: symlink d1/l8 0 2024-09-21T12:46:46.481 INFO:tasks.workunit.client.0.smithi046.stdout:3/34: mkdir d5/dc 0 2024-09-21T12:46:46.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/36: dwrite f3 [4194304,4194304] 0 2024-09-21T12:46:46.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/37: write d4/f9 [590625,96645] 0 2024-09-21T12:46:46.487 INFO:tasks.workunit.client.0.smithi046.stdout:3/35: symlink d5/dc/ld 0 2024-09-21T12:46:46.491 INFO:tasks.workunit.client.0.smithi046.stdout:1/38: creat d4/fe x:0 0 0 2024-09-21T12:46:46.494 INFO:tasks.workunit.client.0.smithi046.stdout:1/39: mkdir d4/df 0 2024-09-21T12:46:46.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/36: dwrite d5/fb [0,4194304] 0 2024-09-21T12:46:46.497 INFO:tasks.workunit.client.0.smithi046.stdout:1/40: rename d4/fa to d4/f10 0 2024-09-21T12:46:46.500 INFO:tasks.workunit.client.0.smithi046.stdout:3/37: creat d5/dc/fe x:0 0 0 2024-09-21T12:46:46.502 INFO:tasks.workunit.client.0.smithi046.stdout:3/38: rmdir d5 39 2024-09-21T12:46:46.504 INFO:tasks.workunit.client.0.smithi046.stdout:3/39: write d5/f6 [3662876,82046] 0 2024-09-21T12:46:46.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/41: rmdir d4/df 0 2024-09-21T12:46:46.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/42: read f1 [2082097,5945] 0 2024-09-21T12:46:46.506 INFO:tasks.workunit.client.0.smithi046.stdout:3/40: chown d5/f6 795576 1 2024-09-21T12:46:46.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/43: unlink d4/f7 0 2024-09-21T12:46:46.525 INFO:tasks.workunit.client.0.smithi046.stdout:1/44: symlink d4/l11 0 2024-09-21T12:46:46.527 INFO:tasks.workunit.client.0.smithi046.stdout:1/45: mknod d4/c12 0 2024-09-21T12:46:46.528 INFO:tasks.workunit.client.0.smithi046.stdout:1/46: mkdir d4/d13 0 2024-09-21T12:46:46.531 INFO:tasks.workunit.client.0.smithi046.stdout:1/47: unlink d4/fd 0 2024-09-21T12:46:46.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/48: write f1 [2335016,10806] 0 2024-09-21T12:46:46.536 INFO:tasks.workunit.client.0.smithi046.stdout:1/49: creat d4/d13/f14 x:0 0 0 2024-09-21T12:46:46.539 INFO:tasks.workunit.client.0.smithi046.stdout:1/50: unlink f3 0 2024-09-21T12:46:46.566 INFO:tasks.workunit.client.0.smithi046.stdout:9/29: getdents . 0 2024-09-21T12:46:46.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/30: creat f9 x:0 0 0 2024-09-21T12:46:46.573 INFO:tasks.workunit.client.0.smithi046.stdout:4/36: truncate d1/f6 1851105 0 2024-09-21T12:46:46.575 INFO:tasks.workunit.client.0.smithi046.stdout:9/31: dwrite f9 [0,4194304] 0 2024-09-21T12:46:46.576 INFO:tasks.workunit.client.0.smithi046.stdout:4/37: mknod d1/c9 0 2024-09-21T12:46:46.579 INFO:tasks.workunit.client.0.smithi046.stdout:4/38: creat d1/fa x:0 0 0 2024-09-21T12:46:46.579 INFO:tasks.workunit.client.0.smithi046.stdout:9/32: dread f2 [0,4194304] 0 2024-09-21T12:46:46.581 INFO:tasks.workunit.client.0.smithi046.stdout:3/41: fsync d5/dc/fe 0 2024-09-21T12:46:46.581 INFO:tasks.workunit.client.0.smithi046.stdout:3/42: readlink d5/dc/ld 0 2024-09-21T12:46:46.583 INFO:tasks.workunit.client.0.smithi046.stdout:9/33: link f1 fa 0 2024-09-21T12:46:46.588 INFO:tasks.workunit.client.0.smithi046.stdout:4/39: link d1/l7 d1/lb 0 2024-09-21T12:46:46.590 INFO:tasks.workunit.client.0.smithi046.stdout:3/43: dwrite d5/f8 [0,4194304] 0 2024-09-21T12:46:46.591 INFO:tasks.workunit.client.0.smithi046.stdout:9/34: dread fa [0,4194304] 0 2024-09-21T12:46:46.591 INFO:tasks.workunit.client.0.smithi046.stdout:4/40: write d1/f4 [2515902,124425] 0 2024-09-21T12:46:46.593 INFO:tasks.workunit.client.0.smithi046.stdout:4/41: truncate d1/fa 177526 0 2024-09-21T12:46:46.597 INFO:tasks.workunit.client.0.smithi046.stdout:3/44: dread d5/fb [0,4194304] 0 2024-09-21T12:46:46.597 INFO:tasks.workunit.client.0.smithi046.stdout:4/42: unlink d1/fa 0 2024-09-21T12:46:46.601 INFO:tasks.workunit.client.0.smithi046.stdout:3/45: creat d5/dc/ff x:0 0 0 2024-09-21T12:46:46.603 INFO:tasks.workunit.client.0.smithi046.stdout:4/43: unlink d1/f4 0 2024-09-21T12:46:46.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/44: stat d1/l8 0 2024-09-21T12:46:46.606 INFO:tasks.workunit.client.0.smithi046.stdout:4/45: creat d1/fc x:0 0 0 2024-09-21T12:46:46.609 INFO:tasks.workunit.client.0.smithi046.stdout:4/46: fdatasync d1/f6 0 2024-09-21T12:46:46.612 INFO:tasks.workunit.client.0.smithi046.stdout:4/47: creat d1/fd x:0 0 0 2024-09-21T12:46:46.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/46: dwrite d5/f9 [0,4194304] 0 2024-09-21T12:46:46.616 INFO:tasks.workunit.client.0.smithi046.stdout:4/48: creat d1/fe x:0 0 0 2024-09-21T12:46:46.617 INFO:tasks.workunit.client.0.smithi046.stdout:4/49: truncate d1/fe 382770 0 2024-09-21T12:46:46.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/47: creat d5/f10 x:0 0 0 2024-09-21T12:46:46.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/50: creat d1/ff x:0 0 0 2024-09-21T12:46:46.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/48: unlink d5/fa 0 2024-09-21T12:46:46.623 INFO:tasks.workunit.client.0.smithi046.stdout:4/51: creat d1/f10 x:0 0 0 2024-09-21T12:46:46.625 INFO:tasks.workunit.client.0.smithi046.stdout:3/49: symlink d5/dc/l11 0 2024-09-21T12:46:46.626 INFO:tasks.workunit.client.0.smithi046.stdout:4/52: mknod d1/c11 0 2024-09-21T12:46:46.627 INFO:tasks.workunit.client.0.smithi046.stdout:1/51: truncate f1 3935816 0 2024-09-21T12:46:46.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/18: write f0 [54567,96826] 0 2024-09-21T12:46:46.631 INFO:tasks.workunit.client.0.smithi046.stdout:4/53: rename d1/l2 to d1/l12 0 2024-09-21T12:46:46.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/52: write d4/f9 [177087,65288] 0 2024-09-21T12:46:46.635 INFO:tasks.workunit.client.0.smithi046.stdout:4/54: mkdir d1/d13 0 2024-09-21T12:46:46.636 INFO:tasks.workunit.client.0.smithi046.stdout:1/53: chown d4/fe 14565 1 2024-09-21T12:46:46.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/50: dwrite d5/dc/ff [0,4194304] 0 2024-09-21T12:46:46.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/54: creat d4/d13/f15 x:0 0 0 2024-09-21T12:46:46.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/19: getdents . 0 2024-09-21T12:46:46.643 INFO:tasks.workunit.client.0.smithi046.stdout:3/51: symlink d5/dc/l12 0 2024-09-21T12:46:46.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/30: dwrite f2 [4194304,4194304] 0 2024-09-21T12:46:46.646 INFO:tasks.workunit.client.0.smithi046.stdout:1/55: fdatasync d4/d13/f15 0 2024-09-21T12:46:46.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/20: dread - f2 zero size 2024-09-21T12:46:46.650 INFO:tasks.workunit.client.0.smithi046.stdout:3/52: symlink d5/dc/l13 0 2024-09-21T12:46:46.652 INFO:tasks.workunit.client.0.smithi046.stdout:2/21: mknod c9 0 2024-09-21T12:46:46.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/55: dwrite d1/f10 [0,4194304] 0 2024-09-21T12:46:46.658 INFO:tasks.workunit.client.0.smithi046.stdout:1/56: creat d4/d13/f16 x:0 0 0 2024-09-21T12:46:46.660 INFO:tasks.workunit.client.0.smithi046.stdout:3/53: mknod d5/c14 0 2024-09-21T12:46:46.663 INFO:tasks.workunit.client.0.smithi046.stdout:3/54: read - d5/f10 zero size 2024-09-21T12:46:46.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/22: dwrite f0 [0,4194304] 0 2024-09-21T12:46:46.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/56: dwrite d1/f6 [0,4194304] 0 2024-09-21T12:46:46.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/55: rename d5/f9 to d5/dc/f15 0 2024-09-21T12:46:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:3/56: fdatasync f2 0 2024-09-21T12:46:46.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/57: dread - d1/fc zero size 2024-09-21T12:46:46.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/57: link d4/c6 d4/c17 0 2024-09-21T12:46:46.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/58: read d1/f10 [3777898,48722] 0 2024-09-21T12:46:46.677 INFO:tasks.workunit.client.0.smithi046.stdout:3/57: dread d5/f8 [0,4194304] 0 2024-09-21T12:46:46.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/23: link f2 fa 0 2024-09-21T12:46:46.684 INFO:tasks.workunit.client.0.smithi046.stdout:3/58: mkdir d5/d16 0 2024-09-21T12:46:46.686 INFO:tasks.workunit.client.0.smithi046.stdout:2/24: dread f0 [0,4194304] 0 2024-09-21T12:46:46.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/59: unlink d1/f10 0 2024-09-21T12:46:46.690 INFO:tasks.workunit.client.0.smithi046.stdout:3/59: rmdir d5/dc 39 2024-09-21T12:46:46.692 INFO:tasks.workunit.client.0.smithi046.stdout:2/25: fdatasync fa 0 2024-09-21T12:46:46.694 INFO:tasks.workunit.client.0.smithi046.stdout:5/31: truncate f1 1897565 0 2024-09-21T12:46:46.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/58: getdents d4 0 2024-09-21T12:46:46.697 INFO:tasks.workunit.client.0.smithi046.stdout:4/60: dwrite d1/fe [0,4194304] 0 2024-09-21T12:46:46.697 INFO:tasks.workunit.client.0.smithi046.stdout:2/26: symlink lb 0 2024-09-21T12:46:46.699 INFO:tasks.workunit.client.0.smithi046.stdout:5/32: creat d4/f7 x:0 0 0 2024-09-21T12:46:46.700 INFO:tasks.workunit.client.0.smithi046.stdout:5/33: stat d4/l5 0 2024-09-21T12:46:46.703 INFO:tasks.workunit.client.0.smithi046.stdout:1/59: creat d4/f18 x:0 0 0 2024-09-21T12:46:46.705 INFO:tasks.workunit.client.0.smithi046.stdout:1/60: readlink d4/l11 0 2024-09-21T12:46:46.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/34: creat d4/f8 x:0 0 0 2024-09-21T12:46:46.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/61: fdatasync d4/fe 0 2024-09-21T12:46:46.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/35: mkdir d4/d9 0 2024-09-21T12:46:46.710 INFO:tasks.workunit.client.0.smithi046.stdout:4/61: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:46.712 INFO:tasks.workunit.client.0.smithi046.stdout:5/36: read - d4/f8 zero size 2024-09-21T12:46:46.713 INFO:tasks.workunit.client.0.smithi046.stdout:1/62: rmdir d4/d13 39 2024-09-21T12:46:46.715 INFO:tasks.workunit.client.0.smithi046.stdout:5/37: chown f2 881 1 2024-09-21T12:46:46.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/60: dwrite d5/dc/f15 [0,4194304] 0 2024-09-21T12:46:46.718 INFO:tasks.workunit.client.0.smithi046.stdout:4/62: chown d1/lb 6843 1 2024-09-21T12:46:46.719 INFO:tasks.workunit.client.0.smithi046.stdout:2/27: dwrite f0 [0,4194304] 0 2024-09-21T12:46:46.723 INFO:tasks.workunit.client.0.smithi046.stdout:2/28: write f0 [3670976,29812] 0 2024-09-21T12:46:46.726 INFO:tasks.workunit.client.0.smithi046.stdout:4/63: mkdir d1/d13/d14 0 2024-09-21T12:46:46.728 INFO:tasks.workunit.client.0.smithi046.stdout:3/61: symlink d5/l17 0 2024-09-21T12:46:46.729 INFO:tasks.workunit.client.0.smithi046.stdout:1/63: link d4/fe d4/d13/f19 0 2024-09-21T12:46:46.731 INFO:tasks.workunit.client.0.smithi046.stdout:4/64: dread d1/fe [0,4194304] 0 2024-09-21T12:46:46.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/62: mknod d5/dc/c18 0 2024-09-21T12:46:46.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/64: fsync f1 0 2024-09-21T12:46:46.736 INFO:tasks.workunit.client.0.smithi046.stdout:4/65: symlink d1/d13/d14/l15 0 2024-09-21T12:46:46.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/63: creat d5/d16/f19 x:0 0 0 2024-09-21T12:46:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/65: creat d4/d13/f1a x:0 0 0 2024-09-21T12:46:46.739 INFO:tasks.workunit.client.0.smithi046.stdout:3/64: symlink d5/d16/l1a 0 2024-09-21T12:46:46.741 INFO:tasks.workunit.client.0.smithi046.stdout:3/65: chown d5/dc/c18 4180931 1 2024-09-21T12:46:46.744 INFO:tasks.workunit.client.0.smithi046.stdout:1/66: getdents d4 0 2024-09-21T12:46:46.745 INFO:tasks.workunit.client.0.smithi046.stdout:4/66: dwrite d1/ff [0,4194304] 0 2024-09-21T12:46:46.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/38: dread f1 [0,4194304] 0 2024-09-21T12:46:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:3/66: dread d5/fb [0,4194304] 0 2024-09-21T12:46:46.748 INFO:tasks.workunit.client.0.smithi046.stdout:1/67: rename f1 to d4/f1b 0 2024-09-21T12:46:46.749 INFO:tasks.workunit.client.0.smithi046.stdout:4/67: write d1/fe [2739704,124383] 0 2024-09-21T12:46:46.750 INFO:tasks.workunit.client.0.smithi046.stdout:4/68: write d1/fe [3237462,34339] 0 2024-09-21T12:46:46.753 INFO:tasks.workunit.client.0.smithi046.stdout:5/39: rename f2 to d4/fa 0 2024-09-21T12:46:46.754 INFO:tasks.workunit.client.0.smithi046.stdout:5/40: chown d4/f8 120377 1 2024-09-21T12:46:46.755 INFO:tasks.workunit.client.0.smithi046.stdout:3/67: creat d5/dc/f1b x:0 0 0 2024-09-21T12:46:46.758 INFO:tasks.workunit.client.0.smithi046.stdout:4/69: rename d1/fc to d1/d13/f16 0 2024-09-21T12:46:46.760 INFO:tasks.workunit.client.0.smithi046.stdout:4/70: symlink d1/d13/d14/l17 0 2024-09-21T12:46:46.761 INFO:tasks.workunit.client.0.smithi046.stdout:4/71: chown d1/d13 644311 1 2024-09-21T12:46:46.763 INFO:tasks.workunit.client.0.smithi046.stdout:3/68: link d5/l17 d5/l1c 0 2024-09-21T12:46:46.764 INFO:tasks.workunit.client.0.smithi046.stdout:5/41: getdents d4 0 2024-09-21T12:46:46.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/72: write d1/d13/f16 [523238,42305] 0 2024-09-21T12:46:46.767 INFO:tasks.workunit.client.0.smithi046.stdout:4/73: fdatasync d1/d13/f16 0 2024-09-21T12:46:46.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/69: unlink d5/dc/l11 0 2024-09-21T12:46:46.771 INFO:tasks.workunit.client.0.smithi046.stdout:4/74: rename d1/lb to d1/l18 0 2024-09-21T12:46:46.772 INFO:tasks.workunit.client.0.smithi046.stdout:3/70: fdatasync d5/f7 0 2024-09-21T12:46:46.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/71: write f2 [561165,54595] 0 2024-09-21T12:46:46.773 INFO:tasks.workunit.client.0.smithi046.stdout:1/68: link d4/d13/f14 d4/d13/f1c 0 2024-09-21T12:46:46.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/72: write d5/dc/f15 [3001074,89759] 0 2024-09-21T12:46:46.775 INFO:tasks.workunit.client.0.smithi046.stdout:4/75: creat d1/d13/d14/f19 x:0 0 0 2024-09-21T12:46:46.776 INFO:tasks.workunit.client.0.smithi046.stdout:1/69: truncate d4/d13/f1c 550174 0 2024-09-21T12:46:46.777 INFO:tasks.workunit.client.0.smithi046.stdout:1/70: chown d4/d13/f16 368 1 2024-09-21T12:46:46.778 INFO:tasks.workunit.client.0.smithi046.stdout:4/76: symlink d1/d13/l1a 0 2024-09-21T12:46:46.781 INFO:tasks.workunit.client.0.smithi046.stdout:1/71: creat d4/d13/f1d x:0 0 0 2024-09-21T12:46:46.783 INFO:tasks.workunit.client.0.smithi046.stdout:3/73: dwrite d5/dc/fe [0,4194304] 0 2024-09-21T12:46:46.784 INFO:tasks.workunit.client.0.smithi046.stdout:4/77: link d1/ff d1/f1b 0 2024-09-21T12:46:46.789 INFO:tasks.workunit.client.0.smithi046.stdout:4/78: dread d1/fd [0,4194304] 0 2024-09-21T12:46:46.790 INFO:tasks.workunit.client.0.smithi046.stdout:1/72: rename d4/cb to d4/c1e 0 2024-09-21T12:46:46.793 INFO:tasks.workunit.client.0.smithi046.stdout:4/79: symlink d1/l1c 0 2024-09-21T12:46:46.799 INFO:tasks.workunit.client.0.smithi046.stdout:3/74: truncate d5/fb 327430 0 2024-09-21T12:46:46.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/73: readlink d4/l8 0 2024-09-21T12:46:46.801 INFO:tasks.workunit.client.0.smithi046.stdout:3/75: creat d5/dc/f1d x:0 0 0 2024-09-21T12:46:46.802 INFO:tasks.workunit.client.0.smithi046.stdout:3/76: readlink d5/l1c 0 2024-09-21T12:46:46.805 INFO:tasks.workunit.client.0.smithi046.stdout:4/80: dwrite d1/f1b [4194304,4194304] 0 2024-09-21T12:46:46.805 INFO:tasks.workunit.client.0.smithi046.stdout:1/74: link d4/d13/f16 d4/f1f 0 2024-09-21T12:46:46.807 INFO:tasks.workunit.client.0.smithi046.stdout:1/75: chown d4/f1b 294 1 2024-09-21T12:46:46.812 INFO:tasks.workunit.client.0.smithi046.stdout:3/77: dread d5/dc/fe [0,4194304] 0 2024-09-21T12:46:46.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/76: dread - d4/d13/f19 zero size 2024-09-21T12:46:46.816 INFO:tasks.workunit.client.0.smithi046.stdout:3/78: creat d5/d16/f1e x:0 0 0 2024-09-21T12:46:46.817 INFO:tasks.workunit.client.0.smithi046.stdout:1/77: creat d4/d13/f20 x:0 0 0 2024-09-21T12:46:46.817 INFO:tasks.workunit.client.0.smithi046.stdout:4/81: dwrite d1/d13/f16 [0,4194304] 0 2024-09-21T12:46:46.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/82: chown d1/d13/l1a 212166 1 2024-09-21T12:46:46.819 INFO:tasks.workunit.client.0.smithi046.stdout:1/78: rmdir d4/d13 39 2024-09-21T12:46:46.820 INFO:tasks.workunit.client.0.smithi046.stdout:4/83: symlink d1/l1d 0 2024-09-21T12:46:46.827 INFO:tasks.workunit.client.0.smithi046.stdout:1/79: creat d4/d13/f21 x:0 0 0 2024-09-21T12:46:46.827 INFO:tasks.workunit.client.0.smithi046.stdout:3/79: dwrite d5/d16/f1e [0,4194304] 0 2024-09-21T12:46:46.829 INFO:tasks.workunit.client.0.smithi046.stdout:1/80: creat d4/f22 x:0 0 0 2024-09-21T12:46:46.829 INFO:tasks.workunit.client.0.smithi046.stdout:4/84: dread d1/fd [0,4194304] 0 2024-09-21T12:46:46.830 INFO:tasks.workunit.client.0.smithi046.stdout:3/80: unlink d5/d16/l1a 0 2024-09-21T12:46:46.831 INFO:tasks.workunit.client.0.smithi046.stdout:4/85: creat d1/d13/d14/f1e x:0 0 0 2024-09-21T12:46:46.835 INFO:tasks.workunit.client.0.smithi046.stdout:4/86: mknod d1/d13/d14/c1f 0 2024-09-21T12:46:46.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/87: dread d1/fe [0,4194304] 0 2024-09-21T12:46:46.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/88: chown d1/d13/d14/f1e 232773 1 2024-09-21T12:46:46.839 INFO:tasks.workunit.client.0.smithi046.stdout:4/89: symlink d1/d13/l20 0 2024-09-21T12:46:46.840 INFO:tasks.workunit.client.0.smithi046.stdout:4/90: fsync d1/ff 0 2024-09-21T12:46:46.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/91: dread - d1/d13/d14/f1e zero size 2024-09-21T12:46:46.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/92: dread - d1/d13/d14/f1e zero size 2024-09-21T12:46:46.850 INFO:tasks.workunit.client.0.smithi046.stdout:4/93: dwrite d1/f1b [4194304,4194304] 0 2024-09-21T12:46:46.867 INFO:tasks.workunit.client.0.smithi046.stdout:3/81: dwrite d5/fb [0,4194304] 0 2024-09-21T12:46:46.874 INFO:tasks.workunit.client.0.smithi046.stdout:3/82: dwrite d5/dc/ff [0,4194304] 0 2024-09-21T12:46:46.874 INFO:tasks.workunit.client.0.smithi046.stdout:3/83: chown d5 67308 1 2024-09-21T12:46:46.943 INFO:tasks.workunit.client.0.smithi046.stdout:4/94: stat d1/l18 0 2024-09-21T12:46:46.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/84: getdents d5/dc 0 2024-09-21T12:46:46.947 INFO:tasks.workunit.client.0.smithi046.stdout:3/85: write f2 [4729211,63646] 0 2024-09-21T12:46:46.949 INFO:tasks.workunit.client.0.smithi046.stdout:3/86: symlink d5/dc/l1f 0 2024-09-21T12:46:46.950 INFO:tasks.workunit.client.0.smithi046.stdout:4/95: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:47.156 INFO:tasks.workunit.client.1.smithi176.stderr:++ readlink -f fsstress 2024-09-21T12:46:47.157 INFO:tasks.workunit.client.1.smithi176.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T12:46:47.157 INFO:tasks.workunit.client.1.smithi176.stderr:+ popd 2024-09-21T12:46:47.158 INFO:tasks.workunit.client.1.smithi176.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:46:47.158 INFO:tasks.workunit.client.1.smithi176.stderr:+ popd 2024-09-21T12:46:47.159 INFO:tasks.workunit.client.1.smithi176.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:46:47.159 INFO:tasks.workunit.client.1.smithi176.stderr:++ mktemp -d -p . 2024-09-21T12:46:47.162 INFO:tasks.workunit.client.1.smithi176.stderr:+ T=./tmp.kdE1rqEtKd 2024-09-21T12:46:47.162 INFO:tasks.workunit.client.1.smithi176.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.kdE1rqEtKd -l 1 -n 1000 -p 10 -v 2024-09-21T12:46:47.165 INFO:tasks.workunit.client.1.smithi176.stdout:seed = 1726760217 2024-09-21T12:46:47.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/0: chown . 1419 1 2024-09-21T12:46:47.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/1: write - no filename 2024-09-21T12:46:47.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/2: fsync - no filename 2024-09-21T12:46:47.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/3: write - no filename 2024-09-21T12:46:47.170 INFO:tasks.workunit.client.1.smithi176.stdout:1/0: unlink - no file 2024-09-21T12:46:47.171 INFO:tasks.workunit.client.1.smithi176.stdout:0/4: creat f0 x:0 0 0 2024-09-21T12:46:47.173 INFO:tasks.workunit.client.1.smithi176.stdout:0/5: symlink l1 0 2024-09-21T12:46:47.174 INFO:tasks.workunit.client.1.smithi176.stdout:1/1: mkdir d0 0 2024-09-21T12:46:47.174 INFO:tasks.workunit.client.1.smithi176.stdout:1/2: truncate - no filename 2024-09-21T12:46:47.174 INFO:tasks.workunit.client.1.smithi176.stdout:1/3: read - no filename 2024-09-21T12:46:47.174 INFO:tasks.workunit.client.1.smithi176.stdout:1/4: write - no filename 2024-09-21T12:46:47.174 INFO:tasks.workunit.client.1.smithi176.stdout:0/6: write f0 [305270,38420] 0 2024-09-21T12:46:47.176 INFO:tasks.workunit.client.1.smithi176.stdout:2/0: mknod c0 0 2024-09-21T12:46:47.176 INFO:tasks.workunit.client.1.smithi176.stdout:2/1: dwrite - no filename 2024-09-21T12:46:47.176 INFO:tasks.workunit.client.1.smithi176.stdout:2/2: readlink - no filename 2024-09-21T12:46:47.178 INFO:tasks.workunit.client.1.smithi176.stdout:1/5: mknod d0/c1 0 2024-09-21T12:46:47.179 INFO:tasks.workunit.client.1.smithi176.stdout:2/3: rename c0 to c1 0 2024-09-21T12:46:47.179 INFO:tasks.workunit.client.1.smithi176.stdout:2/4: dwrite - no filename 2024-09-21T12:46:47.179 INFO:tasks.workunit.client.1.smithi176.stdout:2/5: write - no filename 2024-09-21T12:46:47.179 INFO:tasks.workunit.client.1.smithi176.stdout:2/6: dread - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/0: getdents . 0 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/1: dwrite - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/2: readlink - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/3: fdatasync - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/4: truncate - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/5: dwrite - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/6: write - no filename 2024-09-21T12:46:47.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/7: rmdir - no directory 2024-09-21T12:46:47.181 INFO:tasks.workunit.client.1.smithi176.stdout:5/0: truncate - no filename 2024-09-21T12:46:47.182 INFO:tasks.workunit.client.1.smithi176.stdout:1/6: creat d0/f2 x:0 0 0 2024-09-21T12:46:47.183 INFO:tasks.workunit.client.1.smithi176.stdout:4/0: creat f0 x:0 0 0 2024-09-21T12:46:47.184 INFO:tasks.workunit.client.1.smithi176.stdout:0/7: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.184 INFO:tasks.workunit.client.1.smithi176.stdout:4/1: read - f0 zero size 2024-09-21T12:46:47.184 INFO:tasks.workunit.client.1.smithi176.stdout:6/0: truncate - no filename 2024-09-21T12:46:47.184 INFO:tasks.workunit.client.1.smithi176.stdout:6/1: truncate - no filename 2024-09-21T12:46:47.184 INFO:tasks.workunit.client.1.smithi176.stdout:6/2: write - no filename 2024-09-21T12:46:47.184 INFO:tasks.workunit.client.1.smithi176.stdout:6/3: readlink - no filename 2024-09-21T12:46:47.185 INFO:tasks.workunit.client.1.smithi176.stdout:3/8: creat f0 x:0 0 0 2024-09-21T12:46:47.185 INFO:tasks.workunit.client.1.smithi176.stdout:3/9: rmdir - no directory 2024-09-21T12:46:47.186 INFO:tasks.workunit.client.1.smithi176.stdout:1/7: unlink d0/c1 0 2024-09-21T12:46:47.187 INFO:tasks.workunit.client.1.smithi176.stdout:5/1: mkdir d0 0 2024-09-21T12:46:47.191 INFO:tasks.workunit.client.1.smithi176.stdout:1/8: creat d0/f3 x:0 0 0 2024-09-21T12:46:47.191 INFO:tasks.workunit.client.1.smithi176.stdout:7/0: dread - no filename 2024-09-21T12:46:47.195 INFO:tasks.workunit.client.1.smithi176.stdout:1/9: chown d0/f3 11670358 1 2024-09-21T12:46:47.195 INFO:tasks.workunit.client.1.smithi176.stdout:5/2: creat d0/f1 x:0 0 0 2024-09-21T12:46:47.201 INFO:tasks.workunit.client.1.smithi176.stdout:9/0: fsync - no filename 2024-09-21T12:46:47.202 INFO:tasks.workunit.client.1.smithi176.stdout:4/2: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.202 INFO:tasks.workunit.client.1.smithi176.stdout:3/10: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.202 INFO:tasks.workunit.client.1.smithi176.stdout:7/1: mkdir d0 0 2024-09-21T12:46:47.205 INFO:tasks.workunit.client.1.smithi176.stdout:1/10: mknod d0/c4 0 2024-09-21T12:46:47.206 INFO:tasks.workunit.client.1.smithi176.stdout:4/3: chown f0 1734906 1 2024-09-21T12:46:47.211 INFO:tasks.workunit.client.1.smithi176.stdout:8/0: creat f0 x:0 0 0 2024-09-21T12:46:47.212 INFO:tasks.workunit.client.1.smithi176.stdout:9/1: creat f0 x:0 0 0 2024-09-21T12:46:47.216 INFO:tasks.workunit.client.1.smithi176.stdout:7/2: creat d0/f1 x:0 0 0 2024-09-21T12:46:47.216 INFO:tasks.workunit.client.1.smithi176.stdout:7/3: readlink - no filename 2024-09-21T12:46:47.217 INFO:tasks.workunit.client.1.smithi176.stdout:8/1: symlink l1 0 2024-09-21T12:46:47.220 INFO:tasks.workunit.client.1.smithi176.stdout:8/2: readlink l1 0 2024-09-21T12:46:47.222 INFO:tasks.workunit.client.1.smithi176.stdout:9/2: mkdir d1 0 2024-09-21T12:46:47.222 INFO:tasks.workunit.client.1.smithi176.stdout:5/3: dwrite d0/f1 [0,4194304] 0 2024-09-21T12:46:47.225 INFO:tasks.workunit.client.1.smithi176.stdout:0/8: truncate f0 2661079 0 2024-09-21T12:46:47.225 INFO:tasks.workunit.client.1.smithi176.stdout:7/4: truncate d0/f1 910405 0 2024-09-21T12:46:47.227 INFO:tasks.workunit.client.1.smithi176.stdout:9/3: write f0 [473879,105129] 0 2024-09-21T12:46:47.229 INFO:tasks.workunit.client.1.smithi176.stdout:4/4: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.229 INFO:tasks.workunit.client.1.smithi176.stdout:9/4: stat f0 0 2024-09-21T12:46:47.230 INFO:tasks.workunit.client.1.smithi176.stdout:3/11: dread f0 [0,4194304] 0 2024-09-21T12:46:47.231 INFO:tasks.workunit.client.1.smithi176.stdout:5/4: symlink d0/l2 0 2024-09-21T12:46:47.233 INFO:tasks.workunit.client.1.smithi176.stdout:0/9: symlink l2 0 2024-09-21T12:46:47.233 INFO:tasks.workunit.client.1.smithi176.stdout:7/5: dread d0/f1 [0,4194304] 0 2024-09-21T12:46:47.236 INFO:tasks.workunit.client.1.smithi176.stdout:1/11: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:46:47.241 INFO:tasks.workunit.client.1.smithi176.stdout:3/12: fsync f0 0 2024-09-21T12:46:47.241 INFO:tasks.workunit.client.1.smithi176.stdout:0/10: symlink l3 0 2024-09-21T12:46:47.241 INFO:tasks.workunit.client.1.smithi176.stdout:3/13: readlink - no filename 2024-09-21T12:46:47.244 INFO:tasks.workunit.client.1.smithi176.stdout:3/14: stat f0 0 2024-09-21T12:46:47.244 INFO:tasks.workunit.client.1.smithi176.stdout:9/5: rename f0 to d1/f2 0 2024-09-21T12:46:47.244 INFO:tasks.workunit.client.1.smithi176.stdout:4/5: dread f0 [0,4194304] 0 2024-09-21T12:46:47.245 INFO:tasks.workunit.client.1.smithi176.stdout:3/15: stat f0 0 2024-09-21T12:46:47.245 INFO:tasks.workunit.client.1.smithi176.stdout:9/6: chown d1 645 1 2024-09-21T12:46:47.248 INFO:tasks.workunit.client.1.smithi176.stdout:3/16: mkdir d1 0 2024-09-21T12:46:47.248 INFO:tasks.workunit.client.1.smithi176.stdout:1/12: dread d0/f2 [0,4194304] 0 2024-09-21T12:46:47.248 INFO:tasks.workunit.client.1.smithi176.stdout:0/11: link l1 l4 0 2024-09-21T12:46:47.248 INFO:tasks.workunit.client.1.smithi176.stdout:9/7: chown d1/f2 0 1 2024-09-21T12:46:47.249 INFO:tasks.workunit.client.1.smithi176.stdout:3/17: chown d1 145 1 2024-09-21T12:46:47.249 INFO:tasks.workunit.client.1.smithi176.stdout:4/6: write f0 [1811722,1132] 0 2024-09-21T12:46:47.250 INFO:tasks.workunit.client.1.smithi176.stdout:9/8: rename d1 to d1/d3 22 2024-09-21T12:46:47.251 INFO:tasks.workunit.client.1.smithi176.stdout:3/18: read f0 [3825852,127241] 0 2024-09-21T12:46:47.252 INFO:tasks.workunit.client.1.smithi176.stdout:1/13: symlink d0/l5 0 2024-09-21T12:46:47.254 INFO:tasks.workunit.client.1.smithi176.stdout:9/9: mknod d1/c4 0 2024-09-21T12:46:47.256 INFO:tasks.workunit.client.1.smithi176.stdout:9/10: chown d1 353390629 1 2024-09-21T12:46:47.256 INFO:tasks.workunit.client.1.smithi176.stdout:3/19: symlink d1/l2 0 2024-09-21T12:46:47.257 INFO:tasks.workunit.client.1.smithi176.stdout:1/14: creat d0/f6 x:0 0 0 2024-09-21T12:46:47.258 INFO:tasks.workunit.client.1.smithi176.stdout:7/6: dwrite d0/f1 [0,4194304] 0 2024-09-21T12:46:47.261 INFO:tasks.workunit.client.1.smithi176.stdout:9/11: truncate d1/f2 1242914 0 2024-09-21T12:46:47.261 INFO:tasks.workunit.client.1.smithi176.stdout:1/15: creat d0/f7 x:0 0 0 2024-09-21T12:46:47.263 INFO:tasks.workunit.client.1.smithi176.stdout:4/7: dread f0 [0,4194304] 0 2024-09-21T12:46:47.264 INFO:tasks.workunit.client.1.smithi176.stdout:0/12: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.265 INFO:tasks.workunit.client.1.smithi176.stdout:1/16: unlink d0/c4 0 2024-09-21T12:46:47.265 INFO:tasks.workunit.client.1.smithi176.stdout:0/13: chown l2 292012 1 2024-09-21T12:46:47.265 INFO:tasks.workunit.client.1.smithi176.stdout:0/14: read f0 [3207733,67394] 0 2024-09-21T12:46:47.268 INFO:tasks.workunit.client.1.smithi176.stdout:4/8: write f0 [797586,40993] 0 2024-09-21T12:46:47.268 INFO:tasks.workunit.client.1.smithi176.stdout:3/20: link d1/l2 d1/l3 0 2024-09-21T12:46:47.273 INFO:tasks.workunit.client.1.smithi176.stdout:1/17: symlink d0/l8 0 2024-09-21T12:46:47.274 INFO:tasks.workunit.client.1.smithi176.stdout:0/15: creat f5 x:0 0 0 2024-09-21T12:46:47.275 INFO:tasks.workunit.client.1.smithi176.stdout:0/16: chown l2 29154 1 2024-09-21T12:46:47.275 INFO:tasks.workunit.client.1.smithi176.stdout:3/21: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.277 INFO:tasks.workunit.client.1.smithi176.stdout:7/7: fdatasync d0/f1 0 2024-09-21T12:46:47.277 INFO:tasks.workunit.client.1.smithi176.stdout:9/12: link d1/f2 d1/f5 0 2024-09-21T12:46:47.278 INFO:tasks.workunit.client.1.smithi176.stdout:9/13: stat d1/c4 0 2024-09-21T12:46:47.279 INFO:tasks.workunit.client.1.smithi176.stdout:4/9: rename f0 to f1 0 2024-09-21T12:46:47.279 INFO:tasks.workunit.client.1.smithi176.stdout:9/14: chown d1/f2 1 1 2024-09-21T12:46:47.279 INFO:tasks.workunit.client.1.smithi176.stdout:9/15: readlink - no filename 2024-09-21T12:46:47.280 INFO:tasks.workunit.client.1.smithi176.stdout:1/18: rmdir d0 39 2024-09-21T12:46:47.285 INFO:tasks.workunit.client.1.smithi176.stdout:0/17: symlink l6 0 2024-09-21T12:46:47.285 INFO:tasks.workunit.client.1.smithi176.stdout:3/22: creat d1/f4 x:0 0 0 2024-09-21T12:46:47.286 INFO:tasks.workunit.client.1.smithi176.stdout:7/8: mkdir d0/d2 0 2024-09-21T12:46:47.289 INFO:tasks.workunit.client.1.smithi176.stdout:4/10: write f1 [4817777,13832] 0 2024-09-21T12:46:47.295 INFO:tasks.workunit.client.1.smithi176.stdout:7/9: creat d0/f3 x:0 0 0 2024-09-21T12:46:47.298 INFO:tasks.workunit.client.1.smithi176.stdout:0/18: dwrite f5 [0,4194304] 0 2024-09-21T12:46:47.299 INFO:tasks.workunit.client.1.smithi176.stdout:3/23: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.300 INFO:tasks.workunit.client.1.smithi176.stdout:4/11: fsync f1 0 2024-09-21T12:46:47.304 INFO:tasks.workunit.client.1.smithi176.stdout:9/16: dwrite d1/f2 [0,4194304] 0 2024-09-21T12:46:47.307 INFO:tasks.workunit.client.1.smithi176.stdout:4/12: symlink l2 0 2024-09-21T12:46:47.309 INFO:tasks.workunit.client.1.smithi176.stdout:7/10: getdents d0/d2 0 2024-09-21T12:46:47.312 INFO:tasks.workunit.client.1.smithi176.stdout:1/19: dread d0/f2 [0,4194304] 0 2024-09-21T12:46:47.313 INFO:tasks.workunit.client.1.smithi176.stdout:4/13: mkdir d3 0 2024-09-21T12:46:47.314 INFO:tasks.workunit.client.1.smithi176.stdout:7/11: symlink d0/l4 0 2024-09-21T12:46:47.315 INFO:tasks.workunit.client.1.smithi176.stdout:1/20: creat d0/f9 x:0 0 0 2024-09-21T12:46:47.315 INFO:tasks.workunit.client.1.smithi176.stdout:3/24: dread f0 [0,4194304] 0 2024-09-21T12:46:47.317 INFO:tasks.workunit.client.1.smithi176.stdout:4/14: rename l2 to d3/l4 0 2024-09-21T12:46:47.317 INFO:tasks.workunit.client.1.smithi176.stdout:4/15: chown d3 5055 1 2024-09-21T12:46:47.317 INFO:tasks.workunit.client.1.smithi176.stdout:3/25: mkdir d1/d5 0 2024-09-21T12:46:47.320 INFO:tasks.workunit.client.1.smithi176.stdout:3/26: getdents d1/d5 0 2024-09-21T12:46:47.323 INFO:tasks.workunit.client.1.smithi176.stdout:3/27: chown d1/f4 12604849 1 2024-09-21T12:46:47.324 INFO:tasks.workunit.client.1.smithi176.stdout:7/12: dread d0/f1 [0,4194304] 0 2024-09-21T12:46:47.325 INFO:tasks.workunit.client.1.smithi176.stdout:7/13: fdatasync d0/f1 0 2024-09-21T12:46:47.327 INFO:tasks.workunit.client.1.smithi176.stdout:4/16: dread f1 [0,4194304] 0 2024-09-21T12:46:47.327 INFO:tasks.workunit.client.1.smithi176.stdout:1/21: dwrite d0/f7 [0,4194304] 0 2024-09-21T12:46:47.329 INFO:tasks.workunit.client.1.smithi176.stdout:1/22: dread - d0/f3 zero size 2024-09-21T12:46:47.330 INFO:tasks.workunit.client.1.smithi176.stdout:7/14: creat d0/d2/f5 x:0 0 0 2024-09-21T12:46:47.330 INFO:tasks.workunit.client.1.smithi176.stdout:4/17: write f1 [520763,49776] 0 2024-09-21T12:46:47.331 INFO:tasks.workunit.client.1.smithi176.stdout:1/23: readlink d0/l5 0 2024-09-21T12:46:47.333 INFO:tasks.workunit.client.1.smithi176.stdout:0/19: truncate f0 1462866 0 2024-09-21T12:46:47.334 INFO:tasks.workunit.client.1.smithi176.stdout:4/18: truncate f1 4952070 0 2024-09-21T12:46:47.334 INFO:tasks.workunit.client.1.smithi176.stdout:7/15: symlink d0/l6 0 2024-09-21T12:46:47.335 INFO:tasks.workunit.client.1.smithi176.stdout:9/17: truncate d1/f5 849794 0 2024-09-21T12:46:47.336 INFO:tasks.workunit.client.1.smithi176.stdout:1/24: creat d0/fa x:0 0 0 2024-09-21T12:46:47.336 INFO:tasks.workunit.client.1.smithi176.stdout:9/18: rename d1 to d1/d6 22 2024-09-21T12:46:47.337 INFO:tasks.workunit.client.1.smithi176.stdout:7/16: write d0/f3 [61421,62569] 0 2024-09-21T12:46:47.337 INFO:tasks.workunit.client.1.smithi176.stdout:4/19: mkdir d3/d5 0 2024-09-21T12:46:47.337 INFO:tasks.workunit.client.1.smithi176.stdout:3/28: dwrite f0 [0,4194304] 0 2024-09-21T12:46:47.341 INFO:tasks.workunit.client.1.smithi176.stdout:1/25: write d0/f7 [429674,97776] 0 2024-09-21T12:46:47.344 INFO:tasks.workunit.client.1.smithi176.stdout:1/26: dread - d0/f6 zero size 2024-09-21T12:46:47.346 INFO:tasks.workunit.client.1.smithi176.stdout:4/20: getdents d3/d5 0 2024-09-21T12:46:47.347 INFO:tasks.workunit.client.1.smithi176.stdout:4/21: rename d3/d5 to d3/d5/d6 22 2024-09-21T12:46:47.349 INFO:tasks.workunit.client.1.smithi176.stdout:3/29: dread f0 [0,4194304] 0 2024-09-21T12:46:47.351 INFO:tasks.workunit.client.1.smithi176.stdout:9/19: rename d1/f2 to d1/f7 0 2024-09-21T12:46:47.352 INFO:tasks.workunit.client.1.smithi176.stdout:4/22: dread f1 [4194304,4194304] 0 2024-09-21T12:46:47.354 INFO:tasks.workunit.client.1.smithi176.stdout:7/17: dwrite d0/f3 [0,4194304] 0 2024-09-21T12:46:47.354 INFO:tasks.workunit.client.1.smithi176.stdout:9/20: chown d1/c4 0 1 2024-09-21T12:46:47.356 INFO:tasks.workunit.client.1.smithi176.stdout:3/30: write f0 [367636,32090] 0 2024-09-21T12:46:47.358 INFO:tasks.workunit.client.1.smithi176.stdout:4/23: symlink d3/l7 0 2024-09-21T12:46:47.360 INFO:tasks.workunit.client.1.smithi176.stdout:1/27: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:46:47.360 INFO:tasks.workunit.client.1.smithi176.stdout:7/18: creat d0/d2/f7 x:0 0 0 2024-09-21T12:46:47.360 INFO:tasks.workunit.client.1.smithi176.stdout:1/28: readlink d0/l8 0 2024-09-21T12:46:47.361 INFO:tasks.workunit.client.1.smithi176.stdout:9/21: creat d1/f8 x:0 0 0 2024-09-21T12:46:47.361 INFO:tasks.workunit.client.1.smithi176.stdout:1/29: chown d0/f6 947714 1 2024-09-21T12:46:47.363 INFO:tasks.workunit.client.1.smithi176.stdout:4/24: fdatasync f1 0 2024-09-21T12:46:47.365 INFO:tasks.workunit.client.1.smithi176.stdout:7/19: creat d0/d2/f8 x:0 0 0 2024-09-21T12:46:47.366 INFO:tasks.workunit.client.1.smithi176.stdout:3/31: creat d1/d5/f6 x:0 0 0 2024-09-21T12:46:47.367 INFO:tasks.workunit.client.1.smithi176.stdout:9/22: creat d1/f9 x:0 0 0 2024-09-21T12:46:47.369 INFO:tasks.workunit.client.1.smithi176.stdout:1/30: dread d0/f7 [0,4194304] 0 2024-09-21T12:46:47.371 INFO:tasks.workunit.client.1.smithi176.stdout:7/20: rename d0/f1 to d0/d2/f9 0 2024-09-21T12:46:47.372 INFO:tasks.workunit.client.1.smithi176.stdout:7/21: chown d0/d2 43552 1 2024-09-21T12:46:47.372 INFO:tasks.workunit.client.1.smithi176.stdout:4/25: creat d3/d5/f8 x:0 0 0 2024-09-21T12:46:47.374 INFO:tasks.workunit.client.1.smithi176.stdout:1/31: mkdir d0/db 0 2024-09-21T12:46:47.375 INFO:tasks.workunit.client.1.smithi176.stdout:7/22: chown d0/d2/f5 3114 1 2024-09-21T12:46:47.377 INFO:tasks.workunit.client.1.smithi176.stdout:3/32: dwrite d1/f4 [0,4194304] 0 2024-09-21T12:46:47.377 INFO:tasks.workunit.client.1.smithi176.stdout:1/32: fdatasync d0/f9 0 2024-09-21T12:46:47.378 INFO:tasks.workunit.client.1.smithi176.stdout:3/33: write f0 [2038874,126579] 0 2024-09-21T12:46:47.381 INFO:tasks.workunit.client.1.smithi176.stdout:1/33: rmdir d0 39 2024-09-21T12:46:47.382 INFO:tasks.workunit.client.1.smithi176.stdout:3/34: symlink d1/d5/l7 0 2024-09-21T12:46:47.383 INFO:tasks.workunit.client.1.smithi176.stdout:9/23: fsync d1/f9 0 2024-09-21T12:46:47.384 INFO:tasks.workunit.client.1.smithi176.stdout:4/26: dwrite f1 [4194304,4194304] 0 2024-09-21T12:46:47.384 INFO:tasks.workunit.client.1.smithi176.stdout:3/35: dread - d1/d5/f6 zero size 2024-09-21T12:46:47.385 INFO:tasks.workunit.client.1.smithi176.stdout:4/27: stat f1 0 2024-09-21T12:46:47.385 INFO:tasks.workunit.client.1.smithi176.stdout:7/23: getdents d0/d2 0 2024-09-21T12:46:47.386 INFO:tasks.workunit.client.1.smithi176.stdout:7/24: fdatasync d0/d2/f8 0 2024-09-21T12:46:47.388 INFO:tasks.workunit.client.1.smithi176.stdout:9/24: creat d1/fa x:0 0 0 2024-09-21T12:46:47.391 INFO:tasks.workunit.client.1.smithi176.stdout:3/36: unlink d1/l2 0 2024-09-21T12:46:47.392 INFO:tasks.workunit.client.1.smithi176.stdout:9/25: creat d1/fb x:0 0 0 2024-09-21T12:46:47.394 INFO:tasks.workunit.client.1.smithi176.stdout:4/28: link f1 d3/f9 0 2024-09-21T12:46:47.395 INFO:tasks.workunit.client.1.smithi176.stdout:3/37: rmdir d1/d5 39 2024-09-21T12:46:47.396 INFO:tasks.workunit.client.1.smithi176.stdout:4/29: dread - d3/d5/f8 zero size 2024-09-21T12:46:47.397 INFO:tasks.workunit.client.1.smithi176.stdout:7/25: dwrite d0/d2/f7 [0,4194304] 0 2024-09-21T12:46:47.397 INFO:tasks.workunit.client.1.smithi176.stdout:4/30: stat d3/d5/f8 0 2024-09-21T12:46:47.399 INFO:tasks.workunit.client.1.smithi176.stdout:9/26: rename d1/c4 to d1/cc 0 2024-09-21T12:46:47.399 INFO:tasks.workunit.client.1.smithi176.stdout:3/38: fsync d1/d5/f6 0 2024-09-21T12:46:47.400 INFO:tasks.workunit.client.1.smithi176.stdout:7/26: creat d0/d2/fa x:0 0 0 2024-09-21T12:46:47.400 INFO:tasks.workunit.client.1.smithi176.stdout:7/27: readlink d0/l4 0 2024-09-21T12:46:47.402 INFO:tasks.workunit.client.1.smithi176.stdout:3/39: truncate d1/d5/f6 553113 0 2024-09-21T12:46:47.402 INFO:tasks.workunit.client.1.smithi176.stdout:4/31: write f1 [1588489,111770] 0 2024-09-21T12:46:47.404 INFO:tasks.workunit.client.1.smithi176.stdout:9/27: truncate d1/f5 1869050 0 2024-09-21T12:46:47.406 INFO:tasks.workunit.client.1.smithi176.stdout:3/40: symlink d1/l8 0 2024-09-21T12:46:47.407 INFO:tasks.workunit.client.1.smithi176.stdout:3/41: fdatasync d1/d5/f6 0 2024-09-21T12:46:47.408 INFO:tasks.workunit.client.1.smithi176.stdout:4/32: dread d3/f9 [4194304,4194304] 0 2024-09-21T12:46:47.410 INFO:tasks.workunit.client.1.smithi176.stdout:3/42: rmdir d1 39 2024-09-21T12:46:47.415 INFO:tasks.workunit.client.1.smithi176.stdout:7/28: fdatasync d0/d2/f7 0 2024-09-21T12:46:47.417 INFO:tasks.workunit.client.1.smithi176.stdout:4/33: dwrite d3/f9 [0,4194304] 0 2024-09-21T12:46:47.420 INFO:tasks.workunit.client.1.smithi176.stdout:4/34: mknod d3/d5/ca 0 2024-09-21T12:46:47.421 INFO:tasks.workunit.client.1.smithi176.stdout:4/35: dread - d3/d5/f8 zero size 2024-09-21T12:46:47.421 INFO:tasks.workunit.client.1.smithi176.stdout:7/29: dread d0/f3 [0,4194304] 0 2024-09-21T12:46:47.425 INFO:tasks.workunit.client.1.smithi176.stdout:4/36: mkdir d3/d5/db 0 2024-09-21T12:46:47.426 INFO:tasks.workunit.client.1.smithi176.stdout:4/37: write d3/f9 [9000835,99085] 0 2024-09-21T12:46:47.427 INFO:tasks.workunit.client.1.smithi176.stdout:7/30: write d0/f3 [1121280,118719] 0 2024-09-21T12:46:47.427 INFO:tasks.workunit.client.1.smithi176.stdout:9/28: link d1/f7 d1/fd 0 2024-09-21T12:46:47.430 INFO:tasks.workunit.client.1.smithi176.stdout:7/31: mkdir d0/d2/db 0 2024-09-21T12:46:47.432 INFO:tasks.workunit.client.1.smithi176.stdout:4/38: getdents d3/d5/db 0 2024-09-21T12:46:47.433 INFO:tasks.workunit.client.1.smithi176.stdout:3/43: creat d1/d5/f9 x:0 0 0 2024-09-21T12:46:47.433 INFO:tasks.workunit.client.1.smithi176.stdout:7/32: getdents d0/d2/db 0 2024-09-21T12:46:47.434 INFO:tasks.workunit.client.1.smithi176.stdout:4/39: rmdir d3/d5 39 2024-09-21T12:46:47.434 INFO:tasks.workunit.client.1.smithi176.stdout:7/33: dread - d0/d2/f5 zero size 2024-09-21T12:46:47.436 INFO:tasks.workunit.client.1.smithi176.stdout:9/29: dread d1/f7 [0,4194304] 0 2024-09-21T12:46:47.436 INFO:tasks.workunit.client.1.smithi176.stdout:7/34: write d0/f3 [1997966,119375] 0 2024-09-21T12:46:47.436 INFO:tasks.workunit.client.1.smithi176.stdout:4/40: write d3/f9 [669111,76385] 0 2024-09-21T12:46:47.437 INFO:tasks.workunit.client.1.smithi176.stdout:4/41: chown d3/f9 183 1 2024-09-21T12:46:47.439 INFO:tasks.workunit.client.1.smithi176.stdout:7/35: unlink d0/d2/f7 0 2024-09-21T12:46:47.442 INFO:tasks.workunit.client.1.smithi176.stdout:4/42: write d3/d5/f8 [749329,80372] 0 2024-09-21T12:46:47.445 INFO:tasks.workunit.client.1.smithi176.stdout:7/36: rename d0/d2/f8 to d0/d2/fc 0 2024-09-21T12:46:47.448 INFO:tasks.workunit.client.1.smithi176.stdout:4/43: dwrite d3/f9 [0,4194304] 0 2024-09-21T12:46:47.448 INFO:tasks.workunit.client.1.smithi176.stdout:7/37: fsync d0/d2/f9 0 2024-09-21T12:46:47.449 INFO:tasks.workunit.client.1.smithi176.stdout:7/38: fdatasync d0/d2/fa 0 2024-09-21T12:46:47.452 INFO:tasks.workunit.client.1.smithi176.stdout:4/44: creat d3/d5/fc x:0 0 0 2024-09-21T12:46:47.456 INFO:tasks.workunit.client.1.smithi176.stdout:7/39: dread d0/d2/f9 [0,4194304] 0 2024-09-21T12:46:47.458 INFO:tasks.workunit.client.1.smithi176.stdout:9/30: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:47.459 INFO:tasks.workunit.client.1.smithi176.stdout:9/31: truncate d1/fb 327714 0 2024-09-21T12:46:47.460 INFO:tasks.workunit.client.1.smithi176.stdout:9/32: mknod d1/ce 0 2024-09-21T12:46:47.460 INFO:tasks.workunit.client.1.smithi176.stdout:9/33: dread - d1/f8 zero size 2024-09-21T12:46:47.461 INFO:tasks.workunit.client.1.smithi176.stdout:9/34: chown d1/fa 2790 1 2024-09-21T12:46:47.461 INFO:tasks.workunit.client.1.smithi176.stdout:7/40: rename d0/d2/fc to d0/d2/db/fd 0 2024-09-21T12:46:47.462 INFO:tasks.workunit.client.1.smithi176.stdout:9/35: mkdir d1/df 0 2024-09-21T12:46:47.463 INFO:tasks.workunit.client.1.smithi176.stdout:4/45: fdatasync f1 0 2024-09-21T12:46:47.463 INFO:tasks.workunit.client.1.smithi176.stdout:9/36: dread d1/fb [0,4194304] 0 2024-09-21T12:46:47.464 INFO:tasks.workunit.client.1.smithi176.stdout:7/41: creat d0/d2/db/fe x:0 0 0 2024-09-21T12:46:47.464 INFO:tasks.workunit.client.1.smithi176.stdout:9/37: chown d1/df 187076 1 2024-09-21T12:46:47.465 INFO:tasks.workunit.client.1.smithi176.stdout:7/42: chown d0/d2/f5 6817277 1 2024-09-21T12:46:47.465 INFO:tasks.workunit.client.1.smithi176.stdout:9/38: dread d1/fb [0,4194304] 0 2024-09-21T12:46:47.466 INFO:tasks.workunit.client.1.smithi176.stdout:9/39: truncate d1/fa 963095 0 2024-09-21T12:46:47.466 INFO:tasks.workunit.client.1.smithi176.stdout:9/40: fsync d1/f8 0 2024-09-21T12:46:47.467 INFO:tasks.workunit.client.1.smithi176.stdout:9/41: chown d1/f8 2256 1 2024-09-21T12:46:47.467 INFO:tasks.workunit.client.1.smithi176.stdout:4/46: unlink d3/f9 0 2024-09-21T12:46:47.467 INFO:tasks.workunit.client.1.smithi176.stdout:9/42: chown d1/fa 1704639 1 2024-09-21T12:46:47.468 INFO:tasks.workunit.client.1.smithi176.stdout:7/43: creat d0/d2/db/ff x:0 0 0 2024-09-21T12:46:47.469 INFO:tasks.workunit.client.1.smithi176.stdout:9/43: write d1/f7 [2730532,70893] 0 2024-09-21T12:46:47.469 INFO:tasks.workunit.client.1.smithi176.stdout:4/47: creat d3/d5/fd x:0 0 0 2024-09-21T12:46:47.471 INFO:tasks.workunit.client.1.smithi176.stdout:7/44: mkdir d0/d2/db/d10 0 2024-09-21T12:46:47.472 INFO:tasks.workunit.client.1.smithi176.stdout:9/44: mkdir d1/d10 0 2024-09-21T12:46:47.473 INFO:tasks.workunit.client.1.smithi176.stdout:7/45: creat d0/d2/db/f11 x:0 0 0 2024-09-21T12:46:47.473 INFO:tasks.workunit.client.1.smithi176.stdout:7/46: chown d0 11923 1 2024-09-21T12:46:47.473 INFO:tasks.workunit.client.1.smithi176.stdout:4/48: symlink d3/d5/db/le 0 2024-09-21T12:46:47.474 INFO:tasks.workunit.client.1.smithi176.stdout:9/45: unlink d1/fb 0 2024-09-21T12:46:47.478 INFO:tasks.workunit.client.1.smithi176.stdout:4/49: rename d3/l4 to d3/d5/lf 0 2024-09-21T12:46:47.478 INFO:tasks.workunit.client.1.smithi176.stdout:7/47: creat d0/d2/db/d10/f12 x:0 0 0 2024-09-21T12:46:47.479 INFO:tasks.workunit.client.1.smithi176.stdout:7/48: stat d0/d2/db/fd 0 2024-09-21T12:46:47.479 INFO:tasks.workunit.client.1.smithi176.stdout:9/46: symlink d1/df/l11 0 2024-09-21T12:46:47.480 INFO:tasks.workunit.client.1.smithi176.stdout:7/49: truncate d0/d2/db/d10/f12 899803 0 2024-09-21T12:46:47.481 INFO:tasks.workunit.client.1.smithi176.stdout:4/50: rename d3/l7 to d3/d5/l10 0 2024-09-21T12:46:47.484 INFO:tasks.workunit.client.1.smithi176.stdout:7/50: dread d0/f3 [0,4194304] 0 2024-09-21T12:46:47.484 INFO:tasks.workunit.client.1.smithi176.stdout:9/47: rmdir d1/d10 0 2024-09-21T12:46:47.485 INFO:tasks.workunit.client.1.smithi176.stdout:7/51: read - d0/d2/f5 zero size 2024-09-21T12:46:47.486 INFO:tasks.workunit.client.1.smithi176.stdout:9/48: write d1/f8 [391521,113128] 0 2024-09-21T12:46:47.487 INFO:tasks.workunit.client.1.smithi176.stdout:7/52: readlink d0/l4 0 2024-09-21T12:46:47.489 INFO:tasks.workunit.client.1.smithi176.stdout:4/51: dwrite d3/d5/f8 [0,4194304] 0 2024-09-21T12:46:47.489 INFO:tasks.workunit.client.1.smithi176.stdout:7/53: mknod d0/d2/db/c13 0 2024-09-21T12:46:47.490 INFO:tasks.workunit.client.1.smithi176.stdout:4/52: chown d3/d5/fc 20759439 1 2024-09-21T12:46:47.494 INFO:tasks.workunit.client.1.smithi176.stdout:7/54: creat d0/d2/db/f14 x:0 0 0 2024-09-21T12:46:47.494 INFO:tasks.workunit.client.1.smithi176.stdout:7/55: chown d0/l6 116766342 1 2024-09-21T12:46:47.497 INFO:tasks.workunit.client.1.smithi176.stdout:7/56: creat d0/f15 x:0 0 0 2024-09-21T12:46:47.497 INFO:tasks.workunit.client.1.smithi176.stdout:7/57: readlink d0/l6 0 2024-09-21T12:46:47.497 INFO:tasks.workunit.client.1.smithi176.stdout:7/58: stat d0/d2/db/fd 0 2024-09-21T12:46:47.500 INFO:tasks.workunit.client.1.smithi176.stdout:9/49: getdents d1/df 0 2024-09-21T12:46:47.501 INFO:tasks.workunit.client.1.smithi176.stdout:9/50: fsync d1/fd 0 2024-09-21T12:46:47.504 INFO:tasks.workunit.client.1.smithi176.stdout:9/51: rename d1/fa to d1/df/f12 0 2024-09-21T12:46:47.504 INFO:tasks.workunit.client.1.smithi176.stdout:4/53: write f1 [3325345,94545] 0 2024-09-21T12:46:47.506 INFO:tasks.workunit.client.1.smithi176.stdout:7/59: dwrite d0/f3 [0,4194304] 0 2024-09-21T12:46:47.507 INFO:tasks.workunit.client.1.smithi176.stdout:7/60: fdatasync d0/d2/db/d10/f12 0 2024-09-21T12:46:47.508 INFO:tasks.workunit.client.1.smithi176.stdout:9/52: rename d1/cc to d1/df/c13 0 2024-09-21T12:46:47.511 INFO:tasks.workunit.client.1.smithi176.stdout:7/61: creat d0/f16 x:0 0 0 2024-09-21T12:46:47.511 INFO:tasks.workunit.client.1.smithi176.stdout:4/54: fdatasync f1 0 2024-09-21T12:46:47.511 INFO:tasks.workunit.client.1.smithi176.stdout:9/53: mkdir d1/df/d14 0 2024-09-21T12:46:47.513 INFO:tasks.workunit.client.1.smithi176.stdout:4/55: write f1 [6039217,123609] 0 2024-09-21T12:46:47.514 INFO:tasks.workunit.client.1.smithi176.stdout:9/54: unlink d1/f9 0 2024-09-21T12:46:47.515 INFO:tasks.workunit.client.1.smithi176.stdout:9/55: write d1/f5 [904367,10540] 0 2024-09-21T12:46:47.516 INFO:tasks.workunit.client.1.smithi176.stdout:9/56: write d1/f8 [39213,31667] 0 2024-09-21T12:46:47.517 INFO:tasks.workunit.client.1.smithi176.stdout:7/62: link d0/d2/db/f11 d0/f17 0 2024-09-21T12:46:47.518 INFO:tasks.workunit.client.1.smithi176.stdout:7/63: chown d0/f15 49396 1 2024-09-21T12:46:47.519 INFO:tasks.workunit.client.1.smithi176.stdout:4/56: link d3/d5/ca d3/d5/c11 0 2024-09-21T12:46:47.519 INFO:tasks.workunit.client.1.smithi176.stdout:7/64: chown d0/d2 7521380 1 2024-09-21T12:46:47.522 INFO:tasks.workunit.client.1.smithi176.stdout:7/65: creat d0/d2/db/f18 x:0 0 0 2024-09-21T12:46:47.523 INFO:tasks.workunit.client.1.smithi176.stdout:9/57: dwrite d1/f8 [0,4194304] 0 2024-09-21T12:46:47.524 INFO:tasks.workunit.client.1.smithi176.stdout:9/58: readlink d1/df/l11 0 2024-09-21T12:46:47.524 INFO:tasks.workunit.client.1.smithi176.stdout:4/57: rename d3/d5/f8 to d3/f12 0 2024-09-21T12:46:47.525 INFO:tasks.workunit.client.1.smithi176.stdout:7/66: mknod d0/d2/db/c19 0 2024-09-21T12:46:47.528 INFO:tasks.workunit.client.1.smithi176.stdout:9/59: creat d1/df/d14/f15 x:0 0 0 2024-09-21T12:46:47.528 INFO:tasks.workunit.client.1.smithi176.stdout:7/67: unlink d0/d2/db/f11 0 2024-09-21T12:46:47.530 INFO:tasks.workunit.client.1.smithi176.stdout:7/68: chown d0/d2/db/f18 28685384 1 2024-09-21T12:46:47.530 INFO:tasks.workunit.client.1.smithi176.stdout:9/60: symlink d1/df/l16 0 2024-09-21T12:46:47.530 INFO:tasks.workunit.client.1.smithi176.stdout:4/58: dread f1 [0,4194304] 0 2024-09-21T12:46:47.531 INFO:tasks.workunit.client.1.smithi176.stdout:9/61: mknod d1/c17 0 2024-09-21T12:46:47.532 INFO:tasks.workunit.client.1.smithi176.stdout:9/62: chown d1/f7 1978587 1 2024-09-21T12:46:47.538 INFO:tasks.workunit.client.1.smithi176.stdout:7/69: dwrite d0/d2/db/f14 [0,4194304] 0 2024-09-21T12:46:47.540 INFO:tasks.workunit.client.1.smithi176.stdout:9/63: dread d1/f7 [0,4194304] 0 2024-09-21T12:46:47.545 INFO:tasks.workunit.client.1.smithi176.stdout:9/64: dread d1/f7 [0,4194304] 0 2024-09-21T12:46:47.545 INFO:tasks.workunit.client.1.smithi176.stdout:7/70: truncate d0/d2/f5 1009629 0 2024-09-21T12:46:47.546 INFO:tasks.workunit.client.1.smithi176.stdout:7/71: chown d0/d2/db/fd 233 1 2024-09-21T12:46:47.547 INFO:tasks.workunit.client.1.smithi176.stdout:7/72: chown d0/f16 124 1 2024-09-21T12:46:47.551 INFO:tasks.workunit.client.1.smithi176.stdout:7/73: rename d0/d2/f5 to d0/f1a 0 2024-09-21T12:46:47.553 INFO:tasks.workunit.client.1.smithi176.stdout:7/74: dread - d0/d2/db/f18 zero size 2024-09-21T12:46:47.553 INFO:tasks.workunit.client.1.smithi176.stdout:9/65: dwrite d1/f5 [4194304,4194304] 0 2024-09-21T12:46:47.554 INFO:tasks.workunit.client.1.smithi176.stdout:7/75: dread - d0/d2/db/fd zero size 2024-09-21T12:46:47.561 INFO:tasks.workunit.client.1.smithi176.stdout:9/66: dread d1/fd [0,4194304] 0 2024-09-21T12:46:47.565 INFO:tasks.workunit.client.1.smithi176.stdout:7/76: dwrite d0/d2/fa [0,4194304] 0 2024-09-21T12:46:47.565 INFO:tasks.workunit.client.1.smithi176.stdout:9/67: rename d1/df/d14 to d1/d18 0 2024-09-21T12:46:47.566 INFO:tasks.workunit.client.1.smithi176.stdout:7/77: chown d0/f15 0 1 2024-09-21T12:46:47.572 INFO:tasks.workunit.client.1.smithi176.stdout:9/68: getdents d1/df 0 2024-09-21T12:46:48.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:48 smithi176 ceph-mon[35476]: pgmap v20: 65 pgs: 65 active+clean; 206 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 336 op/s 2024-09-21T12:46:48.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:48 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:48.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:48 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:48.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:48 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:46:48.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:48 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:48 smithi046 ceph-mon[27868]: pgmap v20: 65 pgs: 65 active+clean; 206 MiB data, 821 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.5 MiB/s wr, 336 op/s 2024-09-21T12:46:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:48 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:48 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:46:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:48 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:46:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:48 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:46:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:49 smithi176 ceph-mon[35476]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:46:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:49 smithi176 ceph-mon[35476]: Upgrade: Need to upgrade myself (mgr.smithi176.rmyfjh) 2024-09-21T12:46:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:49 smithi176 ceph-mon[35476]: Upgrade: Need to upgrade myself (mgr.smithi176.rmyfjh) 2024-09-21T12:46:49.341 INFO:tasks.workunit.client.1.smithi176.stdout:2/7: sync 2024-09-21T12:46:49.341 INFO:tasks.workunit.client.1.smithi176.stdout:2/8: fsync - no filename 2024-09-21T12:46:49.365 INFO:tasks.workunit.client.1.smithi176.stdout:4/59: sync 2024-09-21T12:46:49.365 INFO:tasks.workunit.client.1.smithi176.stdout:1/34: sync 2024-09-21T12:46:49.365 INFO:tasks.workunit.client.1.smithi176.stdout:8/3: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:0/20: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:3/44: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:5/5: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:6/4: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:6/5: dwrite - no filename 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:7/78: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:9/69: sync 2024-09-21T12:46:49.366 INFO:tasks.workunit.client.1.smithi176.stdout:6/6: chown . 28 1 2024-09-21T12:46:49.367 INFO:tasks.workunit.client.1.smithi176.stdout:6/7: fdatasync - no filename 2024-09-21T12:46:49.367 INFO:tasks.workunit.client.1.smithi176.stdout:6/8: truncate - no filename 2024-09-21T12:46:49.367 INFO:tasks.workunit.client.1.smithi176.stdout:6/9: chown . 3040624 1 2024-09-21T12:46:49.367 INFO:tasks.workunit.client.1.smithi176.stdout:6/10: dread - no filename 2024-09-21T12:46:49.407 INFO:tasks.workunit.client.1.smithi176.stdout:2/9: creat f2 x:0 0 0 2024-09-21T12:46:49.407 INFO:tasks.workunit.client.1.smithi176.stdout:2/10: dread - f2 zero size 2024-09-21T12:46:49.407 INFO:tasks.workunit.client.1.smithi176.stdout:0/21: creat f7 x:0 0 0 2024-09-21T12:46:49.408 INFO:tasks.workunit.client.1.smithi176.stdout:0/22: dread - f7 zero size 2024-09-21T12:46:49.408 INFO:tasks.workunit.client.1.smithi176.stdout:4/60: creat d3/d5/f13 x:0 0 0 2024-09-21T12:46:49.410 INFO:tasks.workunit.client.1.smithi176.stdout:5/6: rename d0/l2 to d0/l3 0 2024-09-21T12:46:49.411 INFO:tasks.workunit.client.1.smithi176.stdout:1/35: creat d0/fc x:0 0 0 2024-09-21T12:46:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:49 smithi046 ceph-mon[27868]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:46:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:49 smithi046 ceph-mon[27868]: Upgrade: Need to upgrade myself (mgr.smithi176.rmyfjh) 2024-09-21T12:46:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:49 smithi046 ceph-mon[27868]: Upgrade: Need to upgrade myself (mgr.smithi176.rmyfjh) 2024-09-21T12:46:49.412 INFO:tasks.workunit.client.1.smithi176.stdout:3/45: mkdir d1/da 0 2024-09-21T12:46:49.413 INFO:tasks.workunit.client.1.smithi176.stdout:6/11: symlink l0 0 2024-09-21T12:46:49.413 INFO:tasks.workunit.client.1.smithi176.stdout:6/12: truncate - no filename 2024-09-21T12:46:49.413 INFO:tasks.workunit.client.1.smithi176.stdout:6/13: fsync - no filename 2024-09-21T12:46:49.415 INFO:tasks.workunit.client.1.smithi176.stdout:5/7: mknod d0/c4 0 2024-09-21T12:46:49.416 INFO:tasks.workunit.client.1.smithi176.stdout:1/36: symlink d0/ld 0 2024-09-21T12:46:49.418 INFO:tasks.workunit.client.1.smithi176.stdout:2/11: rename c1 to c3 0 2024-09-21T12:46:49.418 INFO:tasks.workunit.client.1.smithi176.stdout:4/61: chown d3/d5/c11 7 1 2024-09-21T12:46:49.420 INFO:tasks.workunit.client.1.smithi176.stdout:6/14: creat f1 x:0 0 0 2024-09-21T12:46:49.420 INFO:tasks.workunit.client.1.smithi176.stdout:2/12: dread - f2 zero size 2024-09-21T12:46:49.421 INFO:tasks.workunit.client.1.smithi176.stdout:8/4: getdents . 0 2024-09-21T12:46:49.422 INFO:tasks.workunit.client.1.smithi176.stdout:4/62: mknod d3/d5/c14 0 2024-09-21T12:46:49.422 INFO:tasks.workunit.client.1.smithi176.stdout:3/46: creat d1/da/fb x:0 0 0 2024-09-21T12:46:49.423 INFO:tasks.workunit.client.1.smithi176.stdout:9/70: dwrite d1/fd [4194304,4194304] 0 2024-09-21T12:46:49.424 INFO:tasks.workunit.client.1.smithi176.stdout:1/37: rename d0/f9 to d0/db/fe 0 2024-09-21T12:46:49.424 INFO:tasks.workunit.client.1.smithi176.stdout:6/15: truncate f1 451689 0 2024-09-21T12:46:49.425 INFO:tasks.workunit.client.1.smithi176.stdout:2/13: dread - f2 zero size 2024-09-21T12:46:49.425 INFO:tasks.workunit.client.1.smithi176.stdout:0/23: dwrite f5 [0,4194304] 0 2024-09-21T12:46:49.425 INFO:tasks.workunit.client.1.smithi176.stdout:8/5: symlink l2 0 2024-09-21T12:46:49.426 INFO:tasks.workunit.client.1.smithi176.stdout:4/63: chown d3/d5/fd 56 1 2024-09-21T12:46:49.427 INFO:tasks.workunit.client.1.smithi176.stdout:4/64: stat d3/d5/fd 0 2024-09-21T12:46:49.427 INFO:tasks.workunit.client.1.smithi176.stdout:6/16: mkdir d2 0 2024-09-21T12:46:49.427 INFO:tasks.workunit.client.1.smithi176.stdout:6/17: chown d2 1 1 2024-09-21T12:46:49.430 INFO:tasks.workunit.client.1.smithi176.stdout:8/6: mknod c3 0 2024-09-21T12:46:49.431 INFO:tasks.workunit.client.1.smithi176.stdout:3/47: creat d1/d5/fc x:0 0 0 2024-09-21T12:46:49.431 INFO:tasks.workunit.client.1.smithi176.stdout:8/7: dread - f0 zero size 2024-09-21T12:46:49.433 INFO:tasks.workunit.client.1.smithi176.stdout:0/24: creat f8 x:0 0 0 2024-09-21T12:46:49.434 INFO:tasks.workunit.client.1.smithi176.stdout:8/8: write f0 [794933,28689] 0 2024-09-21T12:46:49.437 INFO:tasks.workunit.client.1.smithi176.stdout:4/65: dread f1 [0,4194304] 0 2024-09-21T12:46:49.439 INFO:tasks.workunit.client.1.smithi176.stdout:4/66: chown d3/d5/fc 16373890 1 2024-09-21T12:46:49.440 INFO:tasks.workunit.client.1.smithi176.stdout:0/25: truncate f0 769738 0 2024-09-21T12:46:49.440 INFO:tasks.workunit.client.1.smithi176.stdout:8/9: creat f4 x:0 0 0 2024-09-21T12:46:49.442 INFO:tasks.workunit.client.1.smithi176.stdout:4/67: creat d3/d5/f15 x:0 0 0 2024-09-21T12:46:49.444 INFO:tasks.workunit.client.1.smithi176.stdout:0/26: mkdir d9 0 2024-09-21T12:46:49.445 INFO:tasks.workunit.client.1.smithi176.stdout:8/10: mknod c5 0 2024-09-21T12:46:49.445 INFO:tasks.workunit.client.1.smithi176.stdout:9/71: link d1/c17 d1/c19 0 2024-09-21T12:46:49.450 INFO:tasks.workunit.client.1.smithi176.stdout:0/27: getdents d9 0 2024-09-21T12:46:49.450 INFO:tasks.workunit.client.1.smithi176.stdout:9/72: write d1/f7 [3258869,54118] 0 2024-09-21T12:46:49.451 INFO:tasks.workunit.client.1.smithi176.stdout:2/14: dwrite f2 [0,4194304] 0 2024-09-21T12:46:49.458 INFO:tasks.workunit.client.1.smithi176.stdout:1/38: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:46:49.463 INFO:tasks.workunit.client.1.smithi176.stdout:4/68: dwrite d3/d5/fc [0,4194304] 0 2024-09-21T12:46:49.468 INFO:tasks.workunit.client.1.smithi176.stdout:1/39: creat d0/db/ff x:0 0 0 2024-09-21T12:46:49.468 INFO:tasks.workunit.client.1.smithi176.stdout:8/11: dwrite f0 [0,4194304] 0 2024-09-21T12:46:49.469 INFO:tasks.workunit.client.1.smithi176.stdout:8/12: write f0 [3618142,43555] 0 2024-09-21T12:46:49.470 INFO:tasks.workunit.client.1.smithi176.stdout:1/40: write d0/f3 [699247,127204] 0 2024-09-21T12:46:49.471 INFO:tasks.workunit.client.1.smithi176.stdout:0/28: link l4 d9/la 0 2024-09-21T12:46:49.472 INFO:tasks.workunit.client.1.smithi176.stdout:4/69: rename d3/d5/ca to d3/d5/c16 0 2024-09-21T12:46:49.473 INFO:tasks.workunit.client.1.smithi176.stdout:9/73: link d1/df/l16 d1/d18/l1a 0 2024-09-21T12:46:49.474 INFO:tasks.workunit.client.1.smithi176.stdout:8/13: mkdir d6 0 2024-09-21T12:46:49.477 INFO:tasks.workunit.client.1.smithi176.stdout:4/70: symlink d3/d5/l17 0 2024-09-21T12:46:49.477 INFO:tasks.workunit.client.1.smithi176.stdout:4/71: dread - d3/d5/f15 zero size 2024-09-21T12:46:49.480 INFO:tasks.workunit.client.1.smithi176.stdout:0/29: mknod d9/cb 0 2024-09-21T12:46:49.481 INFO:tasks.workunit.client.1.smithi176.stdout:4/72: fsync d3/f12 0 2024-09-21T12:46:49.482 INFO:tasks.workunit.client.1.smithi176.stdout:0/30: mkdir d9/dc 0 2024-09-21T12:46:49.525 INFO:tasks.workunit.client.1.smithi176.stdout:0/31: link d9/la d9/dc/ld 0 2024-09-21T12:46:49.526 INFO:tasks.workunit.client.1.smithi176.stdout:0/32: write f8 [143484,120463] 0 2024-09-21T12:46:49.543 INFO:tasks.workunit.client.1.smithi176.stdout:7/79: sync 2024-09-21T12:46:49.608 INFO:tasks.workunit.client.1.smithi176.stdout:6/18: sync 2024-09-21T12:46:49.609 INFO:tasks.workunit.client.1.smithi176.stdout:6/19: dread f1 [0,4194304] 0 2024-09-21T12:46:49.610 INFO:tasks.workunit.client.1.smithi176.stdout:6/20: mknod d2/c3 0 2024-09-21T12:46:49.611 INFO:tasks.workunit.client.1.smithi176.stdout:6/21: truncate f1 453589 0 2024-09-21T12:46:49.612 INFO:tasks.workunit.client.1.smithi176.stdout:6/22: fdatasync f1 0 2024-09-21T12:46:49.617 INFO:tasks.workunit.client.1.smithi176.stdout:5/8: rename d0/l3 to d0/l5 0 2024-09-21T12:46:49.618 INFO:tasks.workunit.client.1.smithi176.stdout:5/9: symlink d0/l6 0 2024-09-21T12:46:49.619 INFO:tasks.workunit.client.1.smithi176.stdout:5/10: write d0/f1 [4049629,48653] 0 2024-09-21T12:46:49.621 INFO:tasks.workunit.client.1.smithi176.stdout:5/11: mknod d0/c7 0 2024-09-21T12:46:49.626 INFO:tasks.workunit.client.1.smithi176.stdout:3/48: getdents d1/d5 0 2024-09-21T12:46:49.626 INFO:tasks.workunit.client.1.smithi176.stdout:5/12: dwrite d0/f1 [0,4194304] 0 2024-09-21T12:46:49.626 INFO:tasks.workunit.client.1.smithi176.stdout:8/14: fsync f4 0 2024-09-21T12:46:49.628 INFO:tasks.workunit.client.1.smithi176.stdout:5/13: write d0/f1 [582636,67191] 0 2024-09-21T12:46:49.628 INFO:tasks.workunit.client.1.smithi176.stdout:3/49: truncate d1/d5/fc 316413 0 2024-09-21T12:46:49.629 INFO:tasks.workunit.client.1.smithi176.stdout:5/14: write d0/f1 [4568970,59828] 0 2024-09-21T12:46:49.631 INFO:tasks.workunit.client.1.smithi176.stdout:8/15: creat d6/f7 x:0 0 0 2024-09-21T12:46:49.632 INFO:tasks.workunit.client.1.smithi176.stdout:8/16: fsync f4 0 2024-09-21T12:46:49.632 INFO:tasks.workunit.client.1.smithi176.stdout:3/50: symlink d1/da/ld 0 2024-09-21T12:46:49.637 INFO:tasks.workunit.client.1.smithi176.stdout:2/15: truncate f2 3732947 0 2024-09-21T12:46:49.641 INFO:tasks.workunit.client.1.smithi176.stdout:3/51: dwrite d1/d5/f9 [0,4194304] 0 2024-09-21T12:46:49.643 INFO:tasks.workunit.client.1.smithi176.stdout:4/73: rename d3/d5/c16 to d3/d5/db/c18 0 2024-09-21T12:46:49.643 INFO:tasks.workunit.client.1.smithi176.stdout:9/74: write d1/f8 [4280315,25537] 0 2024-09-21T12:46:49.643 INFO:tasks.workunit.client.1.smithi176.stdout:0/33: getdents d9 0 2024-09-21T12:46:49.645 INFO:tasks.workunit.client.1.smithi176.stdout:3/52: rmdir d1/d5 39 2024-09-21T12:46:49.646 INFO:tasks.workunit.client.1.smithi176.stdout:9/75: mknod d1/df/c1b 0 2024-09-21T12:46:49.647 INFO:tasks.workunit.client.1.smithi176.stdout:0/34: mknod d9/ce 0 2024-09-21T12:46:49.648 INFO:tasks.workunit.client.1.smithi176.stdout:9/76: mkdir d1/df/d1c 0 2024-09-21T12:46:49.650 INFO:tasks.workunit.client.1.smithi176.stdout:4/74: creat d3/f19 x:0 0 0 2024-09-21T12:46:49.655 INFO:tasks.workunit.client.1.smithi176.stdout:0/35: rmdir d9/dc 39 2024-09-21T12:46:49.656 INFO:tasks.workunit.client.1.smithi176.stdout:6/23: truncate f1 9908 0 2024-09-21T12:46:49.656 INFO:tasks.workunit.client.1.smithi176.stdout:4/75: dwrite d3/d5/f15 [0,4194304] 0 2024-09-21T12:46:49.657 INFO:tasks.workunit.client.1.smithi176.stdout:3/53: creat d1/fe x:0 0 0 2024-09-21T12:46:49.657 INFO:tasks.workunit.client.1.smithi176.stdout:3/54: write f0 [4233106,62043] 0 2024-09-21T12:46:49.658 INFO:tasks.workunit.client.1.smithi176.stdout:9/77: symlink d1/l1d 0 2024-09-21T12:46:49.658 INFO:tasks.workunit.client.1.smithi176.stdout:9/78: chown d1 0 1 2024-09-21T12:46:49.662 INFO:tasks.workunit.client.1.smithi176.stdout:8/17: getdents d6 0 2024-09-21T12:46:49.662 INFO:tasks.workunit.client.1.smithi176.stdout:9/79: mkdir d1/df/d1e 0 2024-09-21T12:46:49.664 INFO:tasks.workunit.client.1.smithi176.stdout:2/16: write f2 [2257180,112449] 0 2024-09-21T12:46:49.665 INFO:tasks.workunit.client.1.smithi176.stdout:2/17: stat f2 0 2024-09-21T12:46:49.667 INFO:tasks.workunit.client.1.smithi176.stdout:8/18: mkdir d6/d8 0 2024-09-21T12:46:49.668 INFO:tasks.workunit.client.1.smithi176.stdout:0/36: creat d9/ff x:0 0 0 2024-09-21T12:46:49.670 INFO:tasks.workunit.client.1.smithi176.stdout:6/24: dread f1 [0,4194304] 0 2024-09-21T12:46:49.671 INFO:tasks.workunit.client.1.smithi176.stdout:1/41: sync 2024-09-21T12:46:49.671 INFO:tasks.workunit.client.1.smithi176.stdout:7/80: sync 2024-09-21T12:46:49.673 INFO:tasks.workunit.client.1.smithi176.stdout:6/25: chown l0 3162 1 2024-09-21T12:46:49.675 INFO:tasks.workunit.client.1.smithi176.stdout:2/18: fdatasync f2 0 2024-09-21T12:46:49.676 INFO:tasks.workunit.client.1.smithi176.stdout:3/55: dwrite d1/f4 [0,4194304] 0 2024-09-21T12:46:49.678 INFO:tasks.workunit.client.1.smithi176.stdout:4/76: truncate f1 307597 0 2024-09-21T12:46:49.680 INFO:tasks.workunit.client.1.smithi176.stdout:6/26: chown d2/c3 0 1 2024-09-21T12:46:49.680 INFO:tasks.workunit.client.1.smithi176.stdout:9/80: dwrite d1/d18/f15 [0,4194304] 0 2024-09-21T12:46:49.683 INFO:tasks.workunit.client.1.smithi176.stdout:1/42: creat d0/db/f10 x:0 0 0 2024-09-21T12:46:49.685 INFO:tasks.workunit.client.1.smithi176.stdout:2/19: mkdir d4 0 2024-09-21T12:46:49.685 INFO:tasks.workunit.client.1.smithi176.stdout:0/37: unlink f0 0 2024-09-21T12:46:49.687 INFO:tasks.workunit.client.1.smithi176.stdout:3/56: creat d1/da/ff x:0 0 0 2024-09-21T12:46:49.688 INFO:tasks.workunit.client.1.smithi176.stdout:6/27: mkdir d2/d4 0 2024-09-21T12:46:49.688 INFO:tasks.workunit.client.1.smithi176.stdout:8/19: dwrite d6/f7 [0,4194304] 0 2024-09-21T12:46:49.689 INFO:tasks.workunit.client.1.smithi176.stdout:1/43: symlink d0/l11 0 2024-09-21T12:46:49.692 INFO:tasks.workunit.client.1.smithi176.stdout:7/81: dwrite d0/d2/db/f18 [0,4194304] 0 2024-09-21T12:46:49.695 INFO:tasks.workunit.client.1.smithi176.stdout:9/81: rename d1/d18/l1a to d1/df/d1e/l1f 0 2024-09-21T12:46:49.699 INFO:tasks.workunit.client.1.smithi176.stdout:2/20: getdents d4 0 2024-09-21T12:46:49.702 INFO:tasks.workunit.client.1.smithi176.stdout:1/44: dread d0/f3 [0,4194304] 0 2024-09-21T12:46:49.702 INFO:tasks.workunit.client.1.smithi176.stdout:8/20: mknod d6/d8/c9 0 2024-09-21T12:46:49.703 INFO:tasks.workunit.client.1.smithi176.stdout:9/82: symlink d1/df/d1e/l20 0 2024-09-21T12:46:49.703 INFO:tasks.workunit.client.1.smithi176.stdout:6/28: link l0 d2/l5 0 2024-09-21T12:46:49.705 INFO:tasks.workunit.client.1.smithi176.stdout:1/45: read d0/f7 [3323846,62205] 0 2024-09-21T12:46:49.705 INFO:tasks.workunit.client.1.smithi176.stdout:3/57: link d1/da/ff d1/f10 0 2024-09-21T12:46:49.706 INFO:tasks.workunit.client.1.smithi176.stdout:4/77: dread f1 [0,4194304] 0 2024-09-21T12:46:49.706 INFO:tasks.workunit.client.1.smithi176.stdout:7/82: dwrite d0/d2/fa [0,4194304] 0 2024-09-21T12:46:49.706 INFO:tasks.workunit.client.1.smithi176.stdout:8/21: creat d6/fa x:0 0 0 2024-09-21T12:46:49.707 INFO:tasks.workunit.client.1.smithi176.stdout:3/58: chown d1 851837 1 2024-09-21T12:46:49.707 INFO:tasks.workunit.client.1.smithi176.stdout:6/29: fsync f1 0 2024-09-21T12:46:49.708 INFO:tasks.workunit.client.1.smithi176.stdout:1/46: fdatasync d0/f6 0 2024-09-21T12:46:49.709 INFO:tasks.workunit.client.1.smithi176.stdout:3/59: fsync d1/fe 0 2024-09-21T12:46:49.714 INFO:tasks.workunit.client.1.smithi176.stdout:1/47: creat d0/db/f12 x:0 0 0 2024-09-21T12:46:49.715 INFO:tasks.workunit.client.1.smithi176.stdout:4/78: symlink d3/d5/db/l1a 0 2024-09-21T12:46:49.716 INFO:tasks.workunit.client.1.smithi176.stdout:7/83: write d0/d2/db/d10/f12 [1169268,3427] 0 2024-09-21T12:46:49.717 INFO:tasks.workunit.client.1.smithi176.stdout:3/60: mknod d1/da/c11 0 2024-09-21T12:46:49.718 INFO:tasks.workunit.client.1.smithi176.stdout:2/21: dwrite f2 [0,4194304] 0 2024-09-21T12:46:49.718 INFO:tasks.workunit.client.1.smithi176.stdout:6/30: rmdir d2/d4 0 2024-09-21T12:46:49.720 INFO:tasks.workunit.client.1.smithi176.stdout:4/79: chown d3/d5/db/le 1327081 1 2024-09-21T12:46:49.720 INFO:tasks.workunit.client.1.smithi176.stdout:1/48: creat d0/f13 x:0 0 0 2024-09-21T12:46:49.723 INFO:tasks.workunit.client.1.smithi176.stdout:9/83: dread d1/f8 [0,4194304] 0 2024-09-21T12:46:49.723 INFO:tasks.workunit.client.1.smithi176.stdout:8/22: dwrite d6/f7 [0,4194304] 0 2024-09-21T12:46:49.724 INFO:tasks.workunit.client.1.smithi176.stdout:4/80: write d3/d5/fc [1547683,21159] 0 2024-09-21T12:46:49.726 INFO:tasks.workunit.client.1.smithi176.stdout:4/81: fdatasync d3/f19 0 2024-09-21T12:46:49.726 INFO:tasks.workunit.client.1.smithi176.stdout:9/84: stat d1/df/c13 0 2024-09-21T12:46:49.726 INFO:tasks.workunit.client.1.smithi176.stdout:8/23: dread - f4 zero size 2024-09-21T12:46:49.726 INFO:tasks.workunit.client.1.smithi176.stdout:2/22: getdents d4 0 2024-09-21T12:46:49.726 INFO:tasks.workunit.client.1.smithi176.stdout:9/85: chown d1 1129 1 2024-09-21T12:46:49.727 INFO:tasks.workunit.client.1.smithi176.stdout:6/31: rename d2/l5 to d2/l6 0 2024-09-21T12:46:49.727 INFO:tasks.workunit.client.1.smithi176.stdout:8/24: dread - f4 zero size 2024-09-21T12:46:49.728 INFO:tasks.workunit.client.1.smithi176.stdout:4/82: readlink d3/d5/l17 0 2024-09-21T12:46:49.728 INFO:tasks.workunit.client.1.smithi176.stdout:9/86: fdatasync d1/d18/f15 0 2024-09-21T12:46:49.732 INFO:tasks.workunit.client.1.smithi176.stdout:6/32: symlink d2/l7 0 2024-09-21T12:46:49.732 INFO:tasks.workunit.client.1.smithi176.stdout:1/49: dread d0/f6 [0,4194304] 0 2024-09-21T12:46:49.733 INFO:tasks.workunit.client.1.smithi176.stdout:3/61: rename d1/d5/l7 to d1/l12 0 2024-09-21T12:46:49.735 INFO:tasks.workunit.client.1.smithi176.stdout:2/23: rename d4 to d4/d5 22 2024-09-21T12:46:49.736 INFO:tasks.workunit.client.1.smithi176.stdout:7/84: getdents d0/d2/db 0 2024-09-21T12:46:49.738 INFO:tasks.workunit.client.1.smithi176.stdout:9/87: creat d1/df/d1e/f21 x:0 0 0 2024-09-21T12:46:49.739 INFO:tasks.workunit.client.1.smithi176.stdout:6/33: creat d2/f8 x:0 0 0 2024-09-21T12:46:49.739 INFO:tasks.workunit.client.1.smithi176.stdout:1/50: mknod d0/c14 0 2024-09-21T12:46:49.740 INFO:tasks.workunit.client.1.smithi176.stdout:4/83: mknod d3/c1b 0 2024-09-21T12:46:49.741 INFO:tasks.workunit.client.1.smithi176.stdout:8/25: dwrite f4 [0,4194304] 0 2024-09-21T12:46:49.741 INFO:tasks.workunit.client.1.smithi176.stdout:3/62: mknod d1/d5/c13 0 2024-09-21T12:46:49.742 INFO:tasks.workunit.client.1.smithi176.stdout:9/88: rmdir d1/df 39 2024-09-21T12:46:49.743 INFO:tasks.workunit.client.1.smithi176.stdout:7/85: unlink d0/d2/f9 0 2024-09-21T12:46:49.743 INFO:tasks.workunit.client.1.smithi176.stdout:8/26: write d6/f7 [575620,31279] 0 2024-09-21T12:46:49.744 INFO:tasks.workunit.client.1.smithi176.stdout:4/84: stat d3/d5/lf 0 2024-09-21T12:46:49.744 INFO:tasks.workunit.client.1.smithi176.stdout:6/34: unlink l0 0 2024-09-21T12:46:49.746 INFO:tasks.workunit.client.1.smithi176.stdout:3/63: write d1/f4 [4609090,118057] 0 2024-09-21T12:46:49.748 INFO:tasks.workunit.client.1.smithi176.stdout:2/24: dread f2 [0,4194304] 0 2024-09-21T12:46:49.749 INFO:tasks.workunit.client.1.smithi176.stdout:8/27: unlink c3 0 2024-09-21T12:46:49.750 INFO:tasks.workunit.client.1.smithi176.stdout:4/85: stat d3/d5/c11 0 2024-09-21T12:46:49.750 INFO:tasks.workunit.client.1.smithi176.stdout:5/15: sync 2024-09-21T12:46:49.751 INFO:tasks.workunit.client.1.smithi176.stdout:3/64: truncate d1/d5/f6 1267912 0 2024-09-21T12:46:49.752 INFO:tasks.workunit.client.1.smithi176.stdout:9/89: unlink d1/df/c1b 0 2024-09-21T12:46:49.753 INFO:tasks.workunit.client.1.smithi176.stdout:1/51: dread d0/f7 [0,4194304] 0 2024-09-21T12:46:49.756 INFO:tasks.workunit.client.1.smithi176.stdout:4/86: truncate d3/d5/fd 1031727 0 2024-09-21T12:46:49.758 INFO:tasks.workunit.client.1.smithi176.stdout:9/90: symlink d1/l22 0 2024-09-21T12:46:49.759 INFO:tasks.workunit.client.1.smithi176.stdout:1/52: creat d0/db/f15 x:0 0 0 2024-09-21T12:46:49.759 INFO:tasks.workunit.client.1.smithi176.stdout:7/86: dwrite d0/f3 [0,4194304] 0 2024-09-21T12:46:49.760 INFO:tasks.workunit.client.1.smithi176.stdout:2/25: dread f2 [0,4194304] 0 2024-09-21T12:46:49.760 INFO:tasks.workunit.client.1.smithi176.stdout:3/65: link d1/fe d1/d5/f14 0 2024-09-21T12:46:49.761 INFO:tasks.workunit.client.1.smithi176.stdout:7/87: rename d0 to d0/d2/d1b 22 2024-09-21T12:46:49.761 INFO:tasks.workunit.client.1.smithi176.stdout:6/35: getdents d2 0 2024-09-21T12:46:49.762 INFO:tasks.workunit.client.1.smithi176.stdout:8/28: dread f4 [0,4194304] 0 2024-09-21T12:46:49.762 INFO:tasks.workunit.client.1.smithi176.stdout:4/87: creat d3/d5/f1c x:0 0 0 2024-09-21T12:46:49.763 INFO:tasks.workunit.client.1.smithi176.stdout:6/36: truncate d2/f8 916698 0 2024-09-21T12:46:49.764 INFO:tasks.workunit.client.1.smithi176.stdout:5/16: getdents d0 0 2024-09-21T12:46:49.765 INFO:tasks.workunit.client.1.smithi176.stdout:1/53: rmdir d0 39 2024-09-21T12:46:49.767 INFO:tasks.workunit.client.1.smithi176.stdout:5/17: chown d0/l5 25 1 2024-09-21T12:46:49.770 INFO:tasks.workunit.client.1.smithi176.stdout:9/91: getdents d1/df/d1c 0 2024-09-21T12:46:49.771 INFO:tasks.workunit.client.1.smithi176.stdout:2/26: creat d4/f6 x:0 0 0 2024-09-21T12:46:49.773 INFO:tasks.workunit.client.1.smithi176.stdout:5/18: creat d0/f8 x:0 0 0 2024-09-21T12:46:49.773 INFO:tasks.workunit.client.1.smithi176.stdout:3/66: dwrite f0 [4194304,4194304] 0 2024-09-21T12:46:49.775 INFO:tasks.workunit.client.1.smithi176.stdout:1/54: write d0/f13 [76786,44104] 0 2024-09-21T12:46:49.776 INFO:tasks.workunit.client.1.smithi176.stdout:3/67: chown d1/f4 5312 1 2024-09-21T12:46:49.776 INFO:tasks.workunit.client.1.smithi176.stdout:5/19: write d0/f1 [4892070,85371] 0 2024-09-21T12:46:49.777 INFO:tasks.workunit.client.1.smithi176.stdout:2/27: creat d4/f7 x:0 0 0 2024-09-21T12:46:49.778 INFO:tasks.workunit.client.1.smithi176.stdout:8/29: dwrite d6/fa [0,4194304] 0 2024-09-21T12:46:49.779 INFO:tasks.workunit.client.1.smithi176.stdout:3/68: dread - d1/da/fb zero size 2024-09-21T12:46:49.779 INFO:tasks.workunit.client.1.smithi176.stdout:1/55: chown d0/f13 33121293 1 2024-09-21T12:46:49.780 INFO:tasks.workunit.client.1.smithi176.stdout:8/30: chown d6/d8/c9 229653144 1 2024-09-21T12:46:49.782 INFO:tasks.workunit.client.1.smithi176.stdout:8/31: write f0 [91474,89190] 0 2024-09-21T12:46:49.783 INFO:tasks.workunit.client.1.smithi176.stdout:5/20: mknod d0/c9 0 2024-09-21T12:46:49.784 INFO:tasks.workunit.client.1.smithi176.stdout:5/21: truncate d0/f8 578993 0 2024-09-21T12:46:49.785 INFO:tasks.workunit.client.1.smithi176.stdout:5/22: chown d0/l6 538995049 1 2024-09-21T12:46:49.785 INFO:tasks.workunit.client.1.smithi176.stdout:4/88: rename d3/d5/l10 to d3/l1d 0 2024-09-21T12:46:49.786 INFO:tasks.workunit.client.1.smithi176.stdout:1/56: mknod d0/c16 0 2024-09-21T12:46:49.786 INFO:tasks.workunit.client.1.smithi176.stdout:3/69: fsync d1/d5/f14 0 2024-09-21T12:46:49.787 INFO:tasks.workunit.client.1.smithi176.stdout:7/88: link d0/l6 d0/l1c 0 2024-09-21T12:46:49.788 INFO:tasks.workunit.client.1.smithi176.stdout:1/57: write d0/db/f10 [473375,122155] 0 2024-09-21T12:46:49.788 INFO:tasks.workunit.client.1.smithi176.stdout:8/32: fsync f0 0 2024-09-21T12:46:49.788 INFO:tasks.workunit.client.1.smithi176.stdout:1/58: readlink d0/l8 0 2024-09-21T12:46:49.788 INFO:tasks.workunit.client.1.smithi176.stdout:0/38: sync 2024-09-21T12:46:49.790 INFO:tasks.workunit.client.1.smithi176.stdout:5/23: rename d0/l6 to d0/la 0 2024-09-21T12:46:49.791 INFO:tasks.workunit.client.1.smithi176.stdout:4/89: creat d3/d5/f1e x:0 0 0 2024-09-21T12:46:49.791 INFO:tasks.workunit.client.1.smithi176.stdout:3/70: dread d1/d5/f9 [0,4194304] 0 2024-09-21T12:46:49.793 INFO:tasks.workunit.client.1.smithi176.stdout:1/59: creat d0/db/f17 x:0 0 0 2024-09-21T12:46:49.794 INFO:tasks.workunit.client.1.smithi176.stdout:1/60: chown d0/f7 64501688 1 2024-09-21T12:46:49.794 INFO:tasks.workunit.client.1.smithi176.stdout:0/39: creat d9/dc/f10 x:0 0 0 2024-09-21T12:46:49.795 INFO:tasks.workunit.client.1.smithi176.stdout:5/24: mknod d0/cb 0 2024-09-21T12:46:49.795 INFO:tasks.workunit.client.1.smithi176.stdout:0/40: write f5 [3416684,2719] 0 2024-09-21T12:46:49.796 INFO:tasks.workunit.client.1.smithi176.stdout:3/71: mknod d1/d5/c15 0 2024-09-21T12:46:49.798 INFO:tasks.workunit.client.1.smithi176.stdout:6/37: rename f1 to d2/f9 0 2024-09-21T12:46:49.799 INFO:tasks.workunit.client.1.smithi176.stdout:5/25: rename d0/f1 to d0/fc 0 2024-09-21T12:46:49.800 INFO:tasks.workunit.client.1.smithi176.stdout:3/72: symlink d1/d5/l16 0 2024-09-21T12:46:49.804 INFO:tasks.workunit.client.1.smithi176.stdout:9/92: rename d1/d18 to d1/df/d23 0 2024-09-21T12:46:49.805 INFO:tasks.workunit.client.1.smithi176.stdout:5/26: creat d0/fd x:0 0 0 2024-09-21T12:46:49.805 INFO:tasks.workunit.client.1.smithi176.stdout:5/27: stat d0/fc 0 2024-09-21T12:46:49.807 INFO:tasks.workunit.client.1.smithi176.stdout:0/41: creat d9/f11 x:0 0 0 2024-09-21T12:46:49.807 INFO:tasks.workunit.client.1.smithi176.stdout:2/28: truncate f2 1487177 0 2024-09-21T12:46:49.808 INFO:tasks.workunit.client.1.smithi176.stdout:0/42: stat l2 0 2024-09-21T12:46:49.808 INFO:tasks.workunit.client.1.smithi176.stdout:9/93: creat d1/df/d23/f24 x:0 0 0 2024-09-21T12:46:49.809 INFO:tasks.workunit.client.1.smithi176.stdout:5/28: symlink d0/le 0 2024-09-21T12:46:49.810 INFO:tasks.workunit.client.1.smithi176.stdout:9/94: write d1/fd [7785430,65511] 0 2024-09-21T12:46:49.811 INFO:tasks.workunit.client.1.smithi176.stdout:5/29: read - d0/fd zero size 2024-09-21T12:46:49.811 INFO:tasks.workunit.client.1.smithi176.stdout:2/29: rename d4/f7 to d4/f8 0 2024-09-21T12:46:49.813 INFO:tasks.workunit.client.1.smithi176.stdout:4/90: rename d3/d5/lf to d3/l1f 0 2024-09-21T12:46:49.814 INFO:tasks.workunit.client.1.smithi176.stdout:3/73: dwrite d1/d5/f9 [0,4194304] 0 2024-09-21T12:46:49.814 INFO:tasks.workunit.client.1.smithi176.stdout:9/95: rmdir d1/df 39 2024-09-21T12:46:49.816 INFO:tasks.workunit.client.1.smithi176.stdout:2/30: rmdir d4 39 2024-09-21T12:46:49.817 INFO:tasks.workunit.client.1.smithi176.stdout:8/33: truncate f4 423297 0 2024-09-21T12:46:49.818 INFO:tasks.workunit.client.1.smithi176.stdout:5/30: creat d0/ff x:0 0 0 2024-09-21T12:46:49.821 INFO:tasks.workunit.client.1.smithi176.stdout:8/34: chown l2 81413 1 2024-09-21T12:46:49.821 INFO:tasks.workunit.client.1.smithi176.stdout:5/31: dread - d0/ff zero size 2024-09-21T12:46:49.822 INFO:tasks.workunit.client.1.smithi176.stdout:0/43: dwrite d9/dc/f10 [0,4194304] 0 2024-09-21T12:46:49.822 INFO:tasks.workunit.client.1.smithi176.stdout:4/91: creat d3/d5/db/f20 x:0 0 0 2024-09-21T12:46:49.824 INFO:tasks.workunit.client.1.smithi176.stdout:0/44: dread - d9/ff zero size 2024-09-21T12:46:49.825 INFO:tasks.workunit.client.1.smithi176.stdout:3/74: symlink d1/l17 0 2024-09-21T12:46:49.825 INFO:tasks.workunit.client.1.smithi176.stdout:2/31: chown c3 18 1 2024-09-21T12:46:49.826 INFO:tasks.workunit.client.1.smithi176.stdout:5/32: mkdir d0/d10 0 2024-09-21T12:46:49.831 INFO:tasks.workunit.client.1.smithi176.stdout:9/96: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:49.832 INFO:tasks.workunit.client.1.smithi176.stdout:5/33: write d0/ff [241801,40022] 0 2024-09-21T12:46:49.833 INFO:tasks.workunit.client.1.smithi176.stdout:0/45: rename f8 to d9/dc/f12 0 2024-09-21T12:46:49.836 INFO:tasks.workunit.client.1.smithi176.stdout:2/32: symlink d4/l9 0 2024-09-21T12:46:49.836 INFO:tasks.workunit.client.1.smithi176.stdout:9/97: read d1/f5 [5141832,21817] 0 2024-09-21T12:46:49.837 INFO:tasks.workunit.client.1.smithi176.stdout:5/34: readlink d0/l5 0 2024-09-21T12:46:49.837 INFO:tasks.workunit.client.1.smithi176.stdout:0/46: dread - d9/ff zero size 2024-09-21T12:46:49.840 INFO:tasks.workunit.client.1.smithi176.stdout:8/35: dread f0 [0,4194304] 0 2024-09-21T12:46:49.840 INFO:tasks.workunit.client.1.smithi176.stdout:6/38: rename d2/c3 to d2/ca 0 2024-09-21T12:46:49.840 INFO:tasks.workunit.client.1.smithi176.stdout:0/47: fsync f7 0 2024-09-21T12:46:49.841 INFO:tasks.workunit.client.1.smithi176.stdout:2/33: chown d4/f8 2 1 2024-09-21T12:46:49.841 INFO:tasks.workunit.client.1.smithi176.stdout:3/75: creat d1/f18 x:0 0 0 2024-09-21T12:46:49.844 INFO:tasks.workunit.client.1.smithi176.stdout:8/36: fsync d6/f7 0 2024-09-21T12:46:49.845 INFO:tasks.workunit.client.1.smithi176.stdout:4/92: dwrite d3/d5/f1e [0,4194304] 0 2024-09-21T12:46:49.847 INFO:tasks.workunit.client.1.smithi176.stdout:5/35: getdents d0/d10 0 2024-09-21T12:46:49.848 INFO:tasks.workunit.client.1.smithi176.stdout:9/98: write d1/df/f12 [875267,119252] 0 2024-09-21T12:46:49.850 INFO:tasks.workunit.client.1.smithi176.stdout:5/36: fsync d0/f8 0 2024-09-21T12:46:49.851 INFO:tasks.workunit.client.1.smithi176.stdout:3/76: symlink d1/l19 0 2024-09-21T12:46:49.853 INFO:tasks.workunit.client.1.smithi176.stdout:4/93: mkdir d3/d21 0 2024-09-21T12:46:49.853 INFO:tasks.workunit.client.1.smithi176.stdout:0/48: dread d9/dc/f10 [0,4194304] 0 2024-09-21T12:46:49.854 INFO:tasks.workunit.client.1.smithi176.stdout:0/49: readlink l3 0 2024-09-21T12:46:49.856 INFO:tasks.workunit.client.1.smithi176.stdout:0/50: fdatasync d9/f11 0 2024-09-21T12:46:49.856 INFO:tasks.workunit.client.1.smithi176.stdout:2/34: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:46:49.857 INFO:tasks.workunit.client.1.smithi176.stdout:4/94: unlink d3/d5/f1e 0 2024-09-21T12:46:49.859 INFO:tasks.workunit.client.1.smithi176.stdout:5/37: mkdir d0/d10/d11 0 2024-09-21T12:46:49.861 INFO:tasks.workunit.client.1.smithi176.stdout:4/95: chown d3/d5/f15 1106168172 1 2024-09-21T12:46:49.864 INFO:tasks.workunit.client.1.smithi176.stdout:0/51: chown l1 1755887 1 2024-09-21T12:46:49.865 INFO:tasks.workunit.client.1.smithi176.stdout:6/39: creat d2/fb x:0 0 0 2024-09-21T12:46:49.865 INFO:tasks.workunit.client.1.smithi176.stdout:5/38: fsync d0/fc 0 2024-09-21T12:46:49.866 INFO:tasks.workunit.client.1.smithi176.stdout:4/96: dread - d3/d5/f1c zero size 2024-09-21T12:46:49.866 INFO:tasks.workunit.client.1.smithi176.stdout:3/77: link d1/f4 d1/f1a 0 2024-09-21T12:46:49.869 INFO:tasks.workunit.client.1.smithi176.stdout:0/52: creat d9/dc/f13 x:0 0 0 2024-09-21T12:46:49.871 INFO:tasks.workunit.client.1.smithi176.stdout:9/99: dwrite d1/f8 [0,4194304] 0 2024-09-21T12:46:49.871 INFO:tasks.workunit.client.1.smithi176.stdout:6/40: mknod d2/cc 0 2024-09-21T12:46:49.872 INFO:tasks.workunit.client.1.smithi176.stdout:4/97: write d3/d5/fd [1644257,112208] 0 2024-09-21T12:46:49.872 INFO:tasks.workunit.client.1.smithi176.stdout:5/39: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:49.875 INFO:tasks.workunit.client.1.smithi176.stdout:8/37: write f4 [1094072,104062] 0 2024-09-21T12:46:49.875 INFO:tasks.workunit.client.1.smithi176.stdout:3/78: rename d1/f10 to d1/d5/f1b 0 2024-09-21T12:46:49.876 INFO:tasks.workunit.client.1.smithi176.stdout:0/53: write d9/ff [1042448,11037] 0 2024-09-21T12:46:49.878 INFO:tasks.workunit.client.1.smithi176.stdout:2/35: dwrite d4/f8 [4194304,4194304] 0 2024-09-21T12:46:49.878 INFO:tasks.workunit.client.1.smithi176.stdout:4/98: readlink d3/d5/db/le 0 2024-09-21T12:46:49.878 INFO:tasks.workunit.client.1.smithi176.stdout:9/100: symlink d1/df/d23/l25 0 2024-09-21T12:46:49.879 INFO:tasks.workunit.client.1.smithi176.stdout:8/38: stat d6/f7 0 2024-09-21T12:46:49.880 INFO:tasks.workunit.client.1.smithi176.stdout:9/101: chown d1/fd 15 1 2024-09-21T12:46:49.880 INFO:tasks.workunit.client.1.smithi176.stdout:6/41: mkdir d2/dd 0 2024-09-21T12:46:49.880 INFO:tasks.workunit.client.1.smithi176.stdout:8/39: chown d6/d8/c9 16 1 2024-09-21T12:46:49.880 INFO:tasks.workunit.client.1.smithi176.stdout:7/89: sync 2024-09-21T12:46:49.881 INFO:tasks.workunit.client.1.smithi176.stdout:2/36: mknod d4/ca 0 2024-09-21T12:46:49.883 INFO:tasks.workunit.client.1.smithi176.stdout:5/40: truncate d0/fc 2509017 0 2024-09-21T12:46:49.884 INFO:tasks.workunit.client.1.smithi176.stdout:0/54: creat d9/f14 x:0 0 0 2024-09-21T12:46:49.885 INFO:tasks.workunit.client.1.smithi176.stdout:6/42: write d2/f8 [1031444,123852] 0 2024-09-21T12:46:49.886 INFO:tasks.workunit.client.1.smithi176.stdout:7/90: rename d0/d2/db/f18 to d0/d2/db/d10/f1d 0 2024-09-21T12:46:49.892 INFO:tasks.workunit.client.1.smithi176.stdout:4/99: creat d3/f22 x:0 0 0 2024-09-21T12:46:49.892 INFO:tasks.workunit.client.1.smithi176.stdout:9/102: truncate d1/df/d23/f15 1043639 0 2024-09-21T12:46:49.893 INFO:tasks.workunit.client.1.smithi176.stdout:5/41: mknod d0/d10/d11/c12 0 2024-09-21T12:46:49.893 INFO:tasks.workunit.client.1.smithi176.stdout:7/91: rmdir d0/d2/db/d10 39 2024-09-21T12:46:49.894 INFO:tasks.workunit.client.1.smithi176.stdout:6/43: write d2/f8 [2058837,128679] 0 2024-09-21T12:46:49.895 INFO:tasks.workunit.client.1.smithi176.stdout:2/37: dread f2 [0,4194304] 0 2024-09-21T12:46:49.895 INFO:tasks.workunit.client.1.smithi176.stdout:5/42: fsync d0/f8 0 2024-09-21T12:46:49.895 INFO:tasks.workunit.client.1.smithi176.stdout:0/55: rename f7 to d9/dc/f15 0 2024-09-21T12:46:49.895 INFO:tasks.workunit.client.1.smithi176.stdout:4/100: chown d3/d5/f1c 312 1 2024-09-21T12:46:49.896 INFO:tasks.workunit.client.1.smithi176.stdout:8/40: dread d6/f7 [0,4194304] 0 2024-09-21T12:46:49.896 INFO:tasks.workunit.client.1.smithi176.stdout:7/92: fdatasync d0/d2/fa 0 2024-09-21T12:46:49.896 INFO:tasks.workunit.client.1.smithi176.stdout:9/103: unlink d1/f8 0 2024-09-21T12:46:49.898 INFO:tasks.workunit.client.1.smithi176.stdout:5/43: rmdir d0 39 2024-09-21T12:46:49.898 INFO:tasks.workunit.client.1.smithi176.stdout:7/93: dread - d0/d2/db/ff zero size 2024-09-21T12:46:49.899 INFO:tasks.workunit.client.1.smithi176.stdout:8/41: rmdir d6/d8 39 2024-09-21T12:46:49.900 INFO:tasks.workunit.client.1.smithi176.stdout:6/44: mkdir d2/dd/de 0 2024-09-21T12:46:49.902 INFO:tasks.workunit.client.1.smithi176.stdout:4/101: symlink d3/d5/db/l23 0 2024-09-21T12:46:49.902 INFO:tasks.workunit.client.1.smithi176.stdout:8/42: chown d6/f7 48908 1 2024-09-21T12:46:49.904 INFO:tasks.workunit.client.1.smithi176.stdout:5/44: fsync d0/ff 0 2024-09-21T12:46:49.905 INFO:tasks.workunit.client.1.smithi176.stdout:2/38: dwrite d4/f8 [4194304,4194304] 0 2024-09-21T12:46:49.906 INFO:tasks.workunit.client.1.smithi176.stdout:5/45: readlink d0/le 0 2024-09-21T12:46:49.908 INFO:tasks.workunit.client.1.smithi176.stdout:6/45: symlink d2/dd/lf 0 2024-09-21T12:46:49.910 INFO:tasks.workunit.client.1.smithi176.stdout:0/56: creat d9/f16 x:0 0 0 2024-09-21T12:46:49.912 INFO:tasks.workunit.client.1.smithi176.stdout:2/39: dread f2 [0,4194304] 0 2024-09-21T12:46:49.912 INFO:tasks.workunit.client.1.smithi176.stdout:7/94: dwrite d0/d2/db/ff [0,4194304] 0 2024-09-21T12:46:49.916 INFO:tasks.workunit.client.1.smithi176.stdout:8/43: dread d6/f7 [0,4194304] 0 2024-09-21T12:46:49.917 INFO:tasks.workunit.client.1.smithi176.stdout:4/102: symlink d3/l24 0 2024-09-21T12:46:49.920 INFO:tasks.workunit.client.1.smithi176.stdout:6/46: read d2/f9 [8609,403] 0 2024-09-21T12:46:49.920 INFO:tasks.workunit.client.1.smithi176.stdout:5/46: dwrite d0/ff [0,4194304] 0 2024-09-21T12:46:49.922 INFO:tasks.workunit.client.1.smithi176.stdout:5/47: chown d0/d10 15 1 2024-09-21T12:46:49.928 INFO:tasks.workunit.client.1.smithi176.stdout:2/40: fdatasync f2 0 2024-09-21T12:46:49.931 INFO:tasks.workunit.client.1.smithi176.stdout:7/95: rmdir d0/d2 39 2024-09-21T12:46:49.932 INFO:tasks.workunit.client.1.smithi176.stdout:8/44: dwrite f4 [0,4194304] 0 2024-09-21T12:46:49.932 INFO:tasks.workunit.client.1.smithi176.stdout:4/103: creat d3/d5/f25 x:0 0 0 2024-09-21T12:46:49.934 INFO:tasks.workunit.client.1.smithi176.stdout:2/41: write d4/f8 [1656059,4988] 0 2024-09-21T12:46:49.934 INFO:tasks.workunit.client.1.smithi176.stdout:6/47: readlink d2/l6 0 2024-09-21T12:46:49.936 INFO:tasks.workunit.client.1.smithi176.stdout:2/42: write d4/f8 [9032126,13476] 0 2024-09-21T12:46:49.941 INFO:tasks.workunit.client.1.smithi176.stdout:4/104: symlink d3/d5/l26 0 2024-09-21T12:46:49.941 INFO:tasks.workunit.client.1.smithi176.stdout:5/48: dwrite d0/ff [0,4194304] 0 2024-09-21T12:46:49.942 INFO:tasks.workunit.client.1.smithi176.stdout:1/61: sync 2024-09-21T12:46:49.943 INFO:tasks.workunit.client.1.smithi176.stdout:5/49: write d0/f8 [1185811,84243] 0 2024-09-21T12:46:49.944 INFO:tasks.workunit.client.1.smithi176.stdout:0/57: link d9/ff d9/f17 0 2024-09-21T12:46:49.947 INFO:tasks.workunit.client.1.smithi176.stdout:0/58: rename d9/dc to d9/dc/d18 22 2024-09-21T12:46:49.947 INFO:tasks.workunit.client.1.smithi176.stdout:7/96: creat d0/d2/f1e x:0 0 0 2024-09-21T12:46:49.948 INFO:tasks.workunit.client.1.smithi176.stdout:8/45: dwrite d6/fa [0,4194304] 0 2024-09-21T12:46:49.949 INFO:tasks.workunit.client.1.smithi176.stdout:9/104: write d1/df/d23/f15 [151777,47449] 0 2024-09-21T12:46:49.949 INFO:tasks.workunit.client.1.smithi176.stdout:1/62: mknod d0/c18 0 2024-09-21T12:46:49.952 INFO:tasks.workunit.client.1.smithi176.stdout:6/48: mkdir d2/dd/de/d10 0 2024-09-21T12:46:49.952 INFO:tasks.workunit.client.1.smithi176.stdout:5/50: mkdir d0/d13 0 2024-09-21T12:46:49.952 INFO:tasks.workunit.client.1.smithi176.stdout:4/105: mkdir d3/d21/d27 0 2024-09-21T12:46:49.954 INFO:tasks.workunit.client.1.smithi176.stdout:5/51: fsync d0/fd 0 2024-09-21T12:46:49.958 INFO:tasks.workunit.client.1.smithi176.stdout:0/59: symlink d9/dc/l19 0 2024-09-21T12:46:49.958 INFO:tasks.workunit.client.1.smithi176.stdout:1/63: creat d0/db/f19 x:0 0 0 2024-09-21T12:46:49.958 INFO:tasks.workunit.client.1.smithi176.stdout:1/64: chown d0/f3 232205 1 2024-09-21T12:46:49.958 INFO:tasks.workunit.client.1.smithi176.stdout:1/65: write d0/db/f10 [101035,105314] 0 2024-09-21T12:46:49.959 INFO:tasks.workunit.client.1.smithi176.stdout:9/105: mknod d1/df/d23/c26 0 2024-09-21T12:46:49.959 INFO:tasks.workunit.client.1.smithi176.stdout:1/66: fsync d0/db/ff 0 2024-09-21T12:46:49.960 INFO:tasks.workunit.client.1.smithi176.stdout:6/49: rmdir d2/dd 39 2024-09-21T12:46:49.961 INFO:tasks.workunit.client.1.smithi176.stdout:6/50: dread d2/f9 [0,4194304] 0 2024-09-21T12:46:49.962 INFO:tasks.workunit.client.1.smithi176.stdout:6/51: chown d2/fb 249961991 1 2024-09-21T12:46:49.962 INFO:tasks.workunit.client.1.smithi176.stdout:6/52: write d2/fb [440079,121243] 0 2024-09-21T12:46:49.963 INFO:tasks.workunit.client.1.smithi176.stdout:7/97: symlink d0/l1f 0 2024-09-21T12:46:49.966 INFO:tasks.workunit.client.1.smithi176.stdout:5/52: mkdir d0/d10/d11/d14 0 2024-09-21T12:46:49.967 INFO:tasks.workunit.client.1.smithi176.stdout:0/60: fdatasync d9/f17 0 2024-09-21T12:46:49.971 INFO:tasks.workunit.client.1.smithi176.stdout:1/67: fsync d0/f3 0 2024-09-21T12:46:49.972 INFO:tasks.workunit.client.1.smithi176.stdout:8/46: truncate f0 4130457 0 2024-09-21T12:46:49.973 INFO:tasks.workunit.client.1.smithi176.stdout:1/68: fdatasync d0/f13 0 2024-09-21T12:46:49.977 INFO:tasks.workunit.client.1.smithi176.stdout:4/106: truncate d3/f12 2553383 0 2024-09-21T12:46:49.977 INFO:tasks.workunit.client.1.smithi176.stdout:9/106: dwrite d1/f5 [0,4194304] 0 2024-09-21T12:46:49.980 INFO:tasks.workunit.client.1.smithi176.stdout:8/47: dwrite d6/f7 [0,4194304] 0 2024-09-21T12:46:49.984 INFO:tasks.workunit.client.1.smithi176.stdout:1/69: unlink d0/db/fe 0 2024-09-21T12:46:49.986 INFO:tasks.workunit.client.1.smithi176.stdout:0/61: dwrite d9/dc/f10 [4194304,4194304] 0 2024-09-21T12:46:49.987 INFO:tasks.workunit.client.1.smithi176.stdout:0/62: chown d9/f11 117288549 1 2024-09-21T12:46:49.989 INFO:tasks.workunit.client.1.smithi176.stdout:6/53: rename d2/fb to d2/dd/f11 0 2024-09-21T12:46:49.997 INFO:tasks.workunit.client.1.smithi176.stdout:1/70: rmdir d0 39 2024-09-21T12:46:50.006 INFO:tasks.workunit.client.1.smithi176.stdout:8/48: mkdir d6/db 0 2024-09-21T12:46:50.008 INFO:tasks.workunit.client.1.smithi176.stdout:8/49: write d6/fa [5174491,127063] 0 2024-09-21T12:46:50.008 INFO:tasks.workunit.client.1.smithi176.stdout:7/98: getdents d0/d2 0 2024-09-21T12:46:50.009 INFO:tasks.workunit.client.1.smithi176.stdout:8/50: write f4 [1214109,89560] 0 2024-09-21T12:46:50.009 INFO:tasks.workunit.client.1.smithi176.stdout:8/51: readlink l1 0 2024-09-21T12:46:50.010 INFO:tasks.workunit.client.1.smithi176.stdout:0/63: mkdir d9/d1a 0 2024-09-21T12:46:50.014 INFO:tasks.workunit.client.1.smithi176.stdout:6/54: creat d2/dd/de/d10/f12 x:0 0 0 2024-09-21T12:46:50.015 INFO:tasks.workunit.client.1.smithi176.stdout:6/55: read d2/dd/f11 [241016,82829] 0 2024-09-21T12:46:50.015 INFO:tasks.workunit.client.1.smithi176.stdout:3/79: sync 2024-09-21T12:46:50.024 INFO:tasks.workunit.client.1.smithi176.stdout:1/71: mkdir d0/db/d1a 0 2024-09-21T12:46:50.027 INFO:tasks.workunit.client.1.smithi176.stdout:4/107: rename d3/d5/db/le to d3/l28 0 2024-09-21T12:46:50.029 INFO:tasks.workunit.client.1.smithi176.stdout:7/99: dwrite d0/d2/db/d10/f12 [0,4194304] 0 2024-09-21T12:46:50.030 INFO:tasks.workunit.client.1.smithi176.stdout:9/107: getdents d1 0 2024-09-21T12:46:50.031 INFO:tasks.workunit.client.1.smithi176.stdout:5/53: dwrite d0/fc [0,4194304] 0 2024-09-21T12:46:50.031 INFO:tasks.workunit.client.1.smithi176.stdout:9/108: dread - d1/df/d23/f24 zero size 2024-09-21T12:46:50.031 INFO:tasks.workunit.client.1.smithi176.stdout:7/100: dread - d0/d2/f1e zero size 2024-09-21T12:46:50.033 INFO:tasks.workunit.client.1.smithi176.stdout:6/56: creat d2/dd/de/d10/f13 x:0 0 0 2024-09-21T12:46:50.036 INFO:tasks.workunit.client.1.smithi176.stdout:7/101: dread d0/d2/db/f14 [0,4194304] 0 2024-09-21T12:46:50.038 INFO:tasks.workunit.client.1.smithi176.stdout:1/72: creat d0/db/f1b x:0 0 0 2024-09-21T12:46:50.040 INFO:tasks.workunit.client.1.smithi176.stdout:8/52: symlink d6/lc 0 2024-09-21T12:46:50.042 INFO:tasks.workunit.client.1.smithi176.stdout:7/102: dwrite d0/f15 [0,4194304] 0 2024-09-21T12:46:50.045 INFO:tasks.workunit.client.1.smithi176.stdout:0/64: mkdir d9/d1b 0 2024-09-21T12:46:50.049 INFO:tasks.workunit.client.1.smithi176.stdout:7/103: dread d0/f15 [0,4194304] 0 2024-09-21T12:46:50.050 INFO:tasks.workunit.client.1.smithi176.stdout:2/43: sync 2024-09-21T12:46:50.052 INFO:tasks.workunit.client.1.smithi176.stdout:6/57: fdatasync d2/dd/f11 0 2024-09-21T12:46:50.052 INFO:tasks.workunit.client.1.smithi176.stdout:9/109: chown d1/df/d1e/l1f 193024 1 2024-09-21T12:46:50.052 INFO:tasks.workunit.client.1.smithi176.stdout:1/73: creat d0/f1c x:0 0 0 2024-09-21T12:46:50.053 INFO:tasks.workunit.client.1.smithi176.stdout:2/44: fdatasync d4/f6 0 2024-09-21T12:46:50.054 INFO:tasks.workunit.client.1.smithi176.stdout:4/108: truncate d3/f12 1171363 0 2024-09-21T12:46:50.055 INFO:tasks.workunit.client.1.smithi176.stdout:3/80: creat d1/f1c x:0 0 0 2024-09-21T12:46:50.055 INFO:tasks.workunit.client.1.smithi176.stdout:5/54: mkdir d0/d13/d15 0 2024-09-21T12:46:50.056 INFO:tasks.workunit.client.1.smithi176.stdout:1/74: dread - d0/db/ff zero size 2024-09-21T12:46:50.056 INFO:tasks.workunit.client.1.smithi176.stdout:2/45: chown f2 2744 1 2024-09-21T12:46:50.057 INFO:tasks.workunit.client.1.smithi176.stdout:8/53: symlink d6/db/ld 0 2024-09-21T12:46:50.059 INFO:tasks.workunit.client.1.smithi176.stdout:4/109: creat d3/d21/f29 x:0 0 0 2024-09-21T12:46:50.059 INFO:tasks.workunit.client.1.smithi176.stdout:9/110: creat d1/df/d1e/f27 x:0 0 0 2024-09-21T12:46:50.060 INFO:tasks.workunit.client.1.smithi176.stdout:0/65: dwrite d9/f14 [0,4194304] 0 2024-09-21T12:46:50.060 INFO:tasks.workunit.client.1.smithi176.stdout:3/81: symlink d1/da/l1d 0 2024-09-21T12:46:50.061 INFO:tasks.workunit.client.1.smithi176.stdout:2/46: read - d4/f6 zero size 2024-09-21T12:46:50.061 INFO:tasks.workunit.client.1.smithi176.stdout:5/55: truncate d0/fd 1009942 0 2024-09-21T12:46:50.061 INFO:tasks.workunit.client.1.smithi176.stdout:1/75: symlink d0/l1d 0 2024-09-21T12:46:50.061 INFO:tasks.workunit.client.1.smithi176.stdout:4/110: dread - d3/d5/f25 zero size 2024-09-21T12:46:50.065 INFO:tasks.workunit.client.1.smithi176.stdout:9/111: write d1/f5 [6954831,23879] 0 2024-09-21T12:46:50.066 INFO:tasks.workunit.client.1.smithi176.stdout:1/76: stat d0/c14 0 2024-09-21T12:46:50.067 INFO:tasks.workunit.client.1.smithi176.stdout:7/104: creat d0/f20 x:0 0 0 2024-09-21T12:46:50.067 INFO:tasks.workunit.client.1.smithi176.stdout:0/66: fdatasync d9/dc/f15 0 2024-09-21T12:46:50.072 INFO:tasks.workunit.client.1.smithi176.stdout:4/111: rename d3/f19 to d3/d21/f2a 0 2024-09-21T12:46:50.073 INFO:tasks.workunit.client.1.smithi176.stdout:7/105: stat d0/d2/db/d10 0 2024-09-21T12:46:50.073 INFO:tasks.workunit.client.1.smithi176.stdout:9/112: symlink d1/df/d1e/l28 0 2024-09-21T12:46:50.078 INFO:tasks.workunit.client.1.smithi176.stdout:0/67: fsync d9/f14 0 2024-09-21T12:46:50.080 INFO:tasks.workunit.client.1.smithi176.stdout:8/54: dwrite d6/f7 [0,4194304] 0 2024-09-21T12:46:50.082 INFO:tasks.workunit.client.1.smithi176.stdout:0/68: chown d9/f11 12 1 2024-09-21T12:46:50.083 INFO:tasks.workunit.client.1.smithi176.stdout:2/47: dwrite d4/f8 [4194304,4194304] 0 2024-09-21T12:46:50.084 INFO:tasks.workunit.client.1.smithi176.stdout:5/56: dwrite d0/fc [0,4194304] 0 2024-09-21T12:46:50.085 INFO:tasks.workunit.client.1.smithi176.stdout:3/82: dwrite d1/da/fb [0,4194304] 0 2024-09-21T12:46:50.089 INFO:tasks.workunit.client.1.smithi176.stdout:4/112: fdatasync f1 0 2024-09-21T12:46:50.089 INFO:tasks.workunit.client.1.smithi176.stdout:8/55: fsync d6/fa 0 2024-09-21T12:46:50.090 INFO:tasks.workunit.client.1.smithi176.stdout:1/77: rename d0/f7 to d0/db/f1e 0 2024-09-21T12:46:50.092 INFO:tasks.workunit.client.1.smithi176.stdout:9/113: symlink d1/df/l29 0 2024-09-21T12:46:50.092 INFO:tasks.workunit.client.1.smithi176.stdout:2/48: read d4/f8 [6112583,31904] 0 2024-09-21T12:46:50.095 INFO:tasks.workunit.client.1.smithi176.stdout:4/113: write d3/f22 [195894,61301] 0 2024-09-21T12:46:50.098 INFO:tasks.workunit.client.1.smithi176.stdout:7/106: dwrite d0/d2/db/fe [0,4194304] 0 2024-09-21T12:46:50.099 INFO:tasks.workunit.client.1.smithi176.stdout:8/56: unlink d6/lc 0 2024-09-21T12:46:50.102 INFO:tasks.workunit.client.1.smithi176.stdout:0/69: mknod d9/d1b/c1c 0 2024-09-21T12:46:50.105 INFO:tasks.workunit.client.1.smithi176.stdout:9/114: creat d1/f2a x:0 0 0 2024-09-21T12:46:50.105 INFO:tasks.workunit.client.1.smithi176.stdout:1/78: dwrite d0/db/f10 [0,4194304] 0 2024-09-21T12:46:50.106 INFO:tasks.workunit.client.1.smithi176.stdout:1/79: dread - d0/db/ff zero size 2024-09-21T12:46:50.107 INFO:tasks.workunit.client.1.smithi176.stdout:4/114: mknod d3/d5/db/c2b 0 2024-09-21T12:46:50.112 INFO:tasks.workunit.client.1.smithi176.stdout:0/70: unlink l2 0 2024-09-21T12:46:50.112 INFO:tasks.workunit.client.1.smithi176.stdout:0/71: chown d9/d1a 0 1 2024-09-21T12:46:50.115 INFO:tasks.workunit.client.1.smithi176.stdout:5/57: rmdir d0/d10/d11/d14 0 2024-09-21T12:46:50.118 INFO:tasks.workunit.client.1.smithi176.stdout:1/80: rename d0/db/f12 to d0/db/f1f 0 2024-09-21T12:46:50.118 INFO:tasks.workunit.client.1.smithi176.stdout:1/81: stat d0/l1d 0 2024-09-21T12:46:50.119 INFO:tasks.workunit.client.1.smithi176.stdout:1/82: dread - d0/f1c zero size 2024-09-21T12:46:50.119 INFO:tasks.workunit.client.1.smithi176.stdout:5/58: dread d0/ff [0,4194304] 0 2024-09-21T12:46:50.122 INFO:tasks.workunit.client.1.smithi176.stdout:4/115: mkdir d3/d21/d27/d2c 0 2024-09-21T12:46:50.124 INFO:tasks.workunit.client.1.smithi176.stdout:7/107: link d0/f20 d0/d2/db/f21 0 2024-09-21T12:46:50.125 INFO:tasks.workunit.client.1.smithi176.stdout:0/72: mkdir d9/d1a/d1d 0 2024-09-21T12:46:50.127 INFO:tasks.workunit.client.1.smithi176.stdout:1/83: write d0/db/f1f [753182,9886] 0 2024-09-21T12:46:50.127 INFO:tasks.workunit.client.1.smithi176.stdout:5/59: dwrite d0/fd [0,4194304] 0 2024-09-21T12:46:50.128 INFO:tasks.workunit.client.1.smithi176.stdout:1/84: read - d0/db/f15 zero size 2024-09-21T12:46:50.129 INFO:tasks.workunit.client.1.smithi176.stdout:1/85: read - d0/db/ff zero size 2024-09-21T12:46:50.129 INFO:tasks.workunit.client.1.smithi176.stdout:4/116: creat d3/d21/d27/f2d x:0 0 0 2024-09-21T12:46:50.130 INFO:tasks.workunit.client.1.smithi176.stdout:8/57: truncate d6/fa 1502576 0 2024-09-21T12:46:50.133 INFO:tasks.workunit.client.1.smithi176.stdout:7/108: write d0/f16 [298154,5500] 0 2024-09-21T12:46:50.133 INFO:tasks.workunit.client.1.smithi176.stdout:0/73: mkdir d9/dc/d1e 0 2024-09-21T12:46:50.134 INFO:tasks.workunit.client.1.smithi176.stdout:0/74: fdatasync d9/dc/f13 0 2024-09-21T12:46:50.135 INFO:tasks.workunit.client.1.smithi176.stdout:7/109: read d0/d2/db/d10/f12 [2309270,119717] 0 2024-09-21T12:46:50.139 INFO:tasks.workunit.client.1.smithi176.stdout:8/58: fsync f0 0 2024-09-21T12:46:50.141 INFO:tasks.workunit.client.1.smithi176.stdout:0/75: creat d9/d1b/f1f x:0 0 0 2024-09-21T12:46:50.145 INFO:tasks.workunit.client.1.smithi176.stdout:8/59: dread f4 [0,4194304] 0 2024-09-21T12:46:50.145 INFO:tasks.workunit.client.1.smithi176.stdout:7/110: creat d0/d2/db/d10/f22 x:0 0 0 2024-09-21T12:46:50.147 INFO:tasks.workunit.client.1.smithi176.stdout:7/111: dread d0/d2/fa [0,4194304] 0 2024-09-21T12:46:50.147 INFO:tasks.workunit.client.1.smithi176.stdout:9/115: rename d1/df/l16 to d1/df/l2b 0 2024-09-21T12:46:50.148 INFO:tasks.workunit.client.1.smithi176.stdout:4/117: getdents d3/d5 0 2024-09-21T12:46:50.151 INFO:tasks.workunit.client.1.smithi176.stdout:7/112: rmdir d0 39 2024-09-21T12:46:50.152 INFO:tasks.workunit.client.1.smithi176.stdout:9/116: symlink d1/df/d23/l2c 0 2024-09-21T12:46:50.153 INFO:tasks.workunit.client.1.smithi176.stdout:1/86: truncate d0/db/f1e 2281784 0 2024-09-21T12:46:50.154 INFO:tasks.workunit.client.1.smithi176.stdout:8/60: symlink d6/d8/le 0 2024-09-21T12:46:50.155 INFO:tasks.workunit.client.1.smithi176.stdout:5/60: dwrite d0/fd [4194304,4194304] 0 2024-09-21T12:46:50.157 INFO:tasks.workunit.client.1.smithi176.stdout:4/118: link d3/d21/f29 d3/d21/f2e 0 2024-09-21T12:46:50.157 INFO:tasks.workunit.client.1.smithi176.stdout:9/117: write d1/fd [6101911,26884] 0 2024-09-21T12:46:50.157 INFO:tasks.workunit.client.1.smithi176.stdout:0/76: getdents d9/d1b 0 2024-09-21T12:46:50.158 INFO:tasks.workunit.client.1.smithi176.stdout:8/61: creat d6/db/ff x:0 0 0 2024-09-21T12:46:50.159 INFO:tasks.workunit.client.1.smithi176.stdout:9/118: chown d1/df/d1e/l20 139218 1 2024-09-21T12:46:50.159 INFO:tasks.workunit.client.1.smithi176.stdout:7/113: mkdir d0/d2/db/d10/d23 0 2024-09-21T12:46:50.160 INFO:tasks.workunit.client.1.smithi176.stdout:0/77: truncate d9/d1b/f1f 47548 0 2024-09-21T12:46:50.160 INFO:tasks.workunit.client.1.smithi176.stdout:5/61: symlink d0/d10/d11/l16 0 2024-09-21T12:46:50.162 INFO:tasks.workunit.client.1.smithi176.stdout:1/87: creat d0/db/d1a/f20 x:0 0 0 2024-09-21T12:46:50.164 INFO:tasks.workunit.client.1.smithi176.stdout:4/119: mkdir d3/d21/d27/d2f 0 2024-09-21T12:46:50.165 INFO:tasks.workunit.client.1.smithi176.stdout:7/114: dread d0/d2/db/fe [0,4194304] 0 2024-09-21T12:46:50.165 INFO:tasks.workunit.client.1.smithi176.stdout:8/62: creat d6/d8/f10 x:0 0 0 2024-09-21T12:46:50.165 INFO:tasks.workunit.client.1.smithi176.stdout:5/62: dread d0/fc [0,4194304] 0 2024-09-21T12:46:50.166 INFO:tasks.workunit.client.1.smithi176.stdout:7/115: chown d0/d2/db/ff 552713652 1 2024-09-21T12:46:50.167 INFO:tasks.workunit.client.1.smithi176.stdout:8/63: dread - d6/db/ff zero size 2024-09-21T12:46:50.168 INFO:tasks.workunit.client.1.smithi176.stdout:0/78: mkdir d9/d1a/d20 0 2024-09-21T12:46:50.168 INFO:tasks.workunit.client.1.smithi176.stdout:0/79: chown l1 1696 1 2024-09-21T12:46:50.170 INFO:tasks.workunit.client.1.smithi176.stdout:9/119: dread d1/f5 [4194304,4194304] 0 2024-09-21T12:46:50.173 INFO:tasks.workunit.client.1.smithi176.stdout:4/120: write d3/d21/f2e [72428,115278] 0 2024-09-21T12:46:50.176 INFO:tasks.workunit.client.1.smithi176.stdout:8/64: mknod d6/db/c11 0 2024-09-21T12:46:50.178 INFO:tasks.workunit.client.1.smithi176.stdout:7/116: creat d0/d2/db/d10/f24 x:0 0 0 2024-09-21T12:46:50.182 INFO:tasks.workunit.client.1.smithi176.stdout:1/88: link d0/db/f19 d0/db/d1a/f21 0 2024-09-21T12:46:50.186 INFO:tasks.workunit.client.1.smithi176.stdout:6/58: sync 2024-09-21T12:46:50.186 INFO:tasks.workunit.client.1.smithi176.stdout:5/63: unlink d0/la 0 2024-09-21T12:46:50.186 INFO:tasks.workunit.client.1.smithi176.stdout:6/59: stat d2/dd/f11 0 2024-09-21T12:46:50.186 INFO:tasks.workunit.client.1.smithi176.stdout:6/60: chown d2 3846066 1 2024-09-21T12:46:50.189 INFO:tasks.workunit.client.1.smithi176.stdout:0/80: getdents d9/d1b 0 2024-09-21T12:46:50.190 INFO:tasks.workunit.client.1.smithi176.stdout:9/120: symlink d1/df/d1c/l2d 0 2024-09-21T12:46:50.191 INFO:tasks.workunit.client.1.smithi176.stdout:9/121: dread - d1/df/d1e/f27 zero size 2024-09-21T12:46:50.192 INFO:tasks.workunit.client.1.smithi176.stdout:1/89: creat d0/db/f22 x:0 0 0 2024-09-21T12:46:50.192 INFO:tasks.workunit.client.1.smithi176.stdout:5/64: rmdir d0/d10/d11 39 2024-09-21T12:46:50.193 INFO:tasks.workunit.client.1.smithi176.stdout:5/65: chown d0/f8 408 1 2024-09-21T12:46:50.196 INFO:tasks.workunit.client.1.smithi176.stdout:7/117: mkdir d0/d2/db/d25 0 2024-09-21T12:46:50.198 INFO:tasks.workunit.client.1.smithi176.stdout:5/66: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:50.201 INFO:tasks.workunit.client.1.smithi176.stdout:4/121: getdents d3/d5 0 2024-09-21T12:46:50.202 INFO:tasks.workunit.client.1.smithi176.stdout:7/118: dread - d0/f20 zero size 2024-09-21T12:46:50.203 INFO:tasks.workunit.client.1.smithi176.stdout:9/122: rename d1/df/l2b to d1/df/d23/l2e 0 2024-09-21T12:46:50.204 INFO:tasks.workunit.client.1.smithi176.stdout:5/67: dwrite d0/fd [4194304,4194304] 0 2024-09-21T12:46:50.205 INFO:tasks.workunit.client.1.smithi176.stdout:4/122: symlink d3/d5/db/l30 0 2024-09-21T12:46:50.206 INFO:tasks.workunit.client.1.smithi176.stdout:6/61: write d2/f9 [1032695,17516] 0 2024-09-21T12:46:50.207 INFO:tasks.workunit.client.1.smithi176.stdout:8/65: truncate d6/f7 1348559 0 2024-09-21T12:46:50.208 INFO:tasks.workunit.client.1.smithi176.stdout:8/66: readlink l2 0 2024-09-21T12:46:50.212 INFO:tasks.workunit.client.1.smithi176.stdout:6/62: creat d2/dd/de/f14 x:0 0 0 2024-09-21T12:46:50.212 INFO:tasks.workunit.client.1.smithi176.stdout:8/67: symlink d6/d8/l12 0 2024-09-21T12:46:50.213 INFO:tasks.workunit.client.1.smithi176.stdout:7/119: creat d0/d2/db/f26 x:0 0 0 2024-09-21T12:46:50.214 INFO:tasks.workunit.client.1.smithi176.stdout:9/123: creat d1/f2f x:0 0 0 2024-09-21T12:46:50.214 INFO:tasks.workunit.client.1.smithi176.stdout:5/68: link d0/l5 d0/l17 0 2024-09-21T12:46:50.216 INFO:tasks.workunit.client.1.smithi176.stdout:1/90: dread d0/db/f1e [0,4194304] 0 2024-09-21T12:46:50.217 INFO:tasks.workunit.client.1.smithi176.stdout:4/123: dwrite d3/d21/f2a [0,4194304] 0 2024-09-21T12:46:50.218 INFO:tasks.workunit.client.1.smithi176.stdout:7/120: fdatasync d0/d2/db/f21 0 2024-09-21T12:46:50.219 INFO:tasks.workunit.client.1.smithi176.stdout:1/91: chown d0/f3 4578 1 2024-09-21T12:46:50.220 INFO:tasks.workunit.client.1.smithi176.stdout:1/92: chown d0/db 61 1 2024-09-21T12:46:50.220 INFO:tasks.workunit.client.1.smithi176.stdout:5/69: truncate d0/ff 1006910 0 2024-09-21T12:46:50.221 INFO:tasks.workunit.client.1.smithi176.stdout:8/68: read d6/f7 [279929,14689] 0 2024-09-21T12:46:50.223 INFO:tasks.workunit.client.1.smithi176.stdout:1/93: truncate d0/db/f1b 208713 0 2024-09-21T12:46:50.223 INFO:tasks.workunit.client.1.smithi176.stdout:6/63: creat d2/f15 x:0 0 0 2024-09-21T12:46:50.225 INFO:tasks.workunit.client.1.smithi176.stdout:4/124: creat d3/d5/db/f31 x:0 0 0 2024-09-21T12:46:50.226 INFO:tasks.workunit.client.1.smithi176.stdout:9/124: dwrite d1/df/f12 [0,4194304] 0 2024-09-21T12:46:50.227 INFO:tasks.workunit.client.1.smithi176.stdout:4/125: chown d3/d5/f15 3 1 2024-09-21T12:46:50.229 INFO:tasks.workunit.client.1.smithi176.stdout:5/70: creat d0/f18 x:0 0 0 2024-09-21T12:46:50.232 INFO:tasks.workunit.client.1.smithi176.stdout:5/71: chown d0/f8 35449 1 2024-09-21T12:46:50.232 INFO:tasks.workunit.client.1.smithi176.stdout:1/94: mknod d0/c23 0 2024-09-21T12:46:50.232 INFO:tasks.workunit.client.1.smithi176.stdout:6/64: unlink d2/f9 0 2024-09-21T12:46:50.233 INFO:tasks.workunit.client.1.smithi176.stdout:7/121: symlink d0/d2/db/l27 0 2024-09-21T12:46:50.233 INFO:tasks.workunit.client.1.smithi176.stdout:4/126: dread d3/d5/f15 [0,4194304] 0 2024-09-21T12:46:50.234 INFO:tasks.workunit.client.1.smithi176.stdout:7/122: chown d0/d2 0 1 2024-09-21T12:46:50.238 INFO:tasks.workunit.client.1.smithi176.stdout:1/95: mkdir d0/db/d1a/d24 0 2024-09-21T12:46:50.238 INFO:tasks.workunit.client.1.smithi176.stdout:6/65: symlink d2/dd/de/l16 0 2024-09-21T12:46:50.240 INFO:tasks.workunit.client.1.smithi176.stdout:5/72: mknod d0/d10/c19 0 2024-09-21T12:46:50.241 INFO:tasks.workunit.client.1.smithi176.stdout:1/96: fsync d0/db/d1a/f21 0 2024-09-21T12:46:50.241 INFO:tasks.workunit.client.1.smithi176.stdout:7/123: link d0/d2/f1e d0/d2/db/d10/d23/f28 0 2024-09-21T12:46:50.242 INFO:tasks.workunit.client.1.smithi176.stdout:1/97: fsync d0/f2 0 2024-09-21T12:46:50.250 INFO:tasks.workunit.client.1.smithi176.stdout:6/66: dwrite d2/dd/de/d10/f12 [0,4194304] 0 2024-09-21T12:46:50.250 INFO:tasks.workunit.client.1.smithi176.stdout:7/124: rename d0/d2/db/d10/f24 to d0/d2/db/d10/f29 0 2024-09-21T12:46:50.251 INFO:tasks.workunit.client.1.smithi176.stdout:6/67: chown d2/dd/de 9604 1 2024-09-21T12:46:50.252 INFO:tasks.workunit.client.1.smithi176.stdout:5/73: dread d0/fc [0,4194304] 0 2024-09-21T12:46:50.255 INFO:tasks.workunit.client.1.smithi176.stdout:1/98: dwrite d0/f13 [0,4194304] 0 2024-09-21T12:46:50.255 INFO:tasks.workunit.client.1.smithi176.stdout:7/125: write d0/d2/db/fd [738266,81374] 0 2024-09-21T12:46:50.255 INFO:tasks.workunit.client.1.smithi176.stdout:9/125: write d1/fd [8060005,124327] 0 2024-09-21T12:46:50.258 INFO:tasks.workunit.client.1.smithi176.stdout:4/127: truncate d3/d5/f15 4201982 0 2024-09-21T12:46:50.259 INFO:tasks.workunit.client.1.smithi176.stdout:4/128: dread - d3/d5/f25 zero size 2024-09-21T12:46:50.262 INFO:tasks.workunit.client.1.smithi176.stdout:4/129: chown d3/d5/l26 1189929 1 2024-09-21T12:46:50.263 INFO:tasks.workunit.client.1.smithi176.stdout:9/126: dread d1/fd [0,4194304] 0 2024-09-21T12:46:50.263 INFO:tasks.workunit.client.1.smithi176.stdout:1/99: rename d0/db/d1a/d24 to d0/db/d25 0 2024-09-21T12:46:50.264 INFO:tasks.workunit.client.1.smithi176.stdout:9/127: write d1/df/f12 [2201058,66619] 0 2024-09-21T12:46:50.265 INFO:tasks.workunit.client.1.smithi176.stdout:6/68: link d2/dd/de/d10/f13 d2/f17 0 2024-09-21T12:46:50.266 INFO:tasks.workunit.client.1.smithi176.stdout:6/69: dread - d2/f15 zero size 2024-09-21T12:46:50.266 INFO:tasks.workunit.client.1.smithi176.stdout:7/126: symlink d0/d2/db/l2a 0 2024-09-21T12:46:50.267 INFO:tasks.workunit.client.1.smithi176.stdout:4/130: unlink d3/f22 0 2024-09-21T12:46:50.268 INFO:tasks.workunit.client.1.smithi176.stdout:5/74: rmdir d0/d13/d15 0 2024-09-21T12:46:50.270 INFO:tasks.workunit.client.1.smithi176.stdout:7/127: readlink d0/l4 0 2024-09-21T12:46:50.270 INFO:tasks.workunit.client.1.smithi176.stdout:1/100: getdents d0/db/d25 0 2024-09-21T12:46:50.271 INFO:tasks.workunit.client.1.smithi176.stdout:1/101: read - d0/db/ff zero size 2024-09-21T12:46:50.271 INFO:tasks.workunit.client.1.smithi176.stdout:7/128: stat d0/d2/db/d10/f12 0 2024-09-21T12:46:50.285 INFO:tasks.workunit.client.1.smithi176.stdout:3/83: sync 2024-09-21T12:46:50.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:50 smithi176 ceph-mon[35476]: pgmap v21: 65 pgs: 65 active+clean; 290 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 379 op/s 2024-09-21T12:46:50.378 INFO:tasks.workunit.client.1.smithi176.stdout:2/49: sync 2024-09-21T12:46:50.378 INFO:tasks.workunit.client.1.smithi176.stdout:2/50: read d4/f8 [2523976,80988] 0 2024-09-21T12:46:50.378 INFO:tasks.workunit.client.1.smithi176.stdout:2/51: chown f2 25 1 2024-09-21T12:46:50.403 INFO:tasks.workunit.client.1.smithi176.stdout:4/131: creat d3/f32 x:0 0 0 2024-09-21T12:46:50.410 INFO:tasks.workunit.client.1.smithi176.stdout:8/69: sync 2024-09-21T12:46:50.410 INFO:tasks.workunit.client.1.smithi176.stdout:0/81: sync 2024-09-21T12:46:50.410 INFO:tasks.workunit.client.1.smithi176.stdout:5/75: sync 2024-09-21T12:46:50.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:50 smithi046 ceph-mon[27868]: pgmap v21: 65 pgs: 65 active+clean; 290 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 379 op/s 2024-09-21T12:46:50.422 INFO:tasks.workunit.client.1.smithi176.stdout:9/128: truncate d1/f7 1225566 0 2024-09-21T12:46:50.426 INFO:tasks.workunit.client.1.smithi176.stdout:3/84: dwrite d1/da/ff [0,4194304] 0 2024-09-21T12:46:50.436 INFO:tasks.workunit.client.1.smithi176.stdout:3/85: dread d1/f1a [4194304,4194304] 0 2024-09-21T12:46:50.523 INFO:tasks.workunit.client.1.smithi176.stdout:2/52: fdatasync d4/f8 0 2024-09-21T12:46:50.523 INFO:tasks.workunit.client.1.smithi176.stdout:6/70: rename d2/l7 to d2/l18 0 2024-09-21T12:46:50.524 INFO:tasks.workunit.client.1.smithi176.stdout:4/132: creat d3/d5/db/f33 x:0 0 0 2024-09-21T12:46:50.525 INFO:tasks.workunit.client.1.smithi176.stdout:2/53: dread f2 [0,4194304] 0 2024-09-21T12:46:50.525 INFO:tasks.workunit.client.1.smithi176.stdout:7/129: unlink d0/l6 0 2024-09-21T12:46:50.526 INFO:tasks.workunit.client.1.smithi176.stdout:7/130: read - d0/d2/f1e zero size 2024-09-21T12:46:50.526 INFO:tasks.workunit.client.1.smithi176.stdout:8/70: mkdir d6/db/d13 0 2024-09-21T12:46:50.527 INFO:tasks.workunit.client.1.smithi176.stdout:5/76: truncate d0/f8 2280258 0 2024-09-21T12:46:50.530 INFO:tasks.workunit.client.1.smithi176.stdout:3/86: mknod d1/d5/c1e 0 2024-09-21T12:46:50.532 INFO:tasks.workunit.client.1.smithi176.stdout:2/54: dwrite d4/f6 [0,4194304] 0 2024-09-21T12:46:50.532 INFO:tasks.workunit.client.1.smithi176.stdout:4/133: unlink d3/d5/db/l1a 0 2024-09-21T12:46:50.534 INFO:tasks.workunit.client.1.smithi176.stdout:8/71: rmdir d6/d8 39 2024-09-21T12:46:50.534 INFO:tasks.workunit.client.1.smithi176.stdout:4/134: fdatasync d3/f32 0 2024-09-21T12:46:50.534 INFO:tasks.workunit.client.1.smithi176.stdout:8/72: stat f0 0 2024-09-21T12:46:50.535 INFO:tasks.workunit.client.1.smithi176.stdout:7/131: rename d0/f15 to d0/d2/db/d10/f2b 0 2024-09-21T12:46:50.536 INFO:tasks.workunit.client.1.smithi176.stdout:5/77: mknod d0/d13/c1a 0 2024-09-21T12:46:50.538 INFO:tasks.workunit.client.1.smithi176.stdout:1/102: getdents d0 0 2024-09-21T12:46:50.541 INFO:tasks.workunit.client.1.smithi176.stdout:0/82: link d9/cb d9/d1a/d20/c21 0 2024-09-21T12:46:50.542 INFO:tasks.workunit.client.1.smithi176.stdout:2/55: dwrite d4/f6 [0,4194304] 0 2024-09-21T12:46:50.543 INFO:tasks.workunit.client.1.smithi176.stdout:8/73: read d6/fa [939198,59268] 0 2024-09-21T12:46:50.543 INFO:tasks.workunit.client.1.smithi176.stdout:7/132: dread - d0/f17 zero size 2024-09-21T12:46:50.544 INFO:tasks.workunit.client.1.smithi176.stdout:2/56: rename d4 to d4/db 22 2024-09-21T12:46:50.546 INFO:tasks.workunit.client.1.smithi176.stdout:1/103: dread d0/f6 [0,4194304] 0 2024-09-21T12:46:50.548 INFO:tasks.workunit.client.1.smithi176.stdout:1/104: dread - d0/db/d1a/f20 zero size 2024-09-21T12:46:50.549 INFO:tasks.workunit.client.1.smithi176.stdout:1/105: fdatasync d0/db/f1b 0 2024-09-21T12:46:50.553 INFO:tasks.workunit.client.1.smithi176.stdout:3/87: creat d1/f1f x:0 0 0 2024-09-21T12:46:50.554 INFO:tasks.workunit.client.1.smithi176.stdout:5/78: symlink d0/d10/l1b 0 2024-09-21T12:46:50.555 INFO:tasks.workunit.client.1.smithi176.stdout:0/83: mkdir d9/d1a/d1d/d22 0 2024-09-21T12:46:50.555 INFO:tasks.workunit.client.1.smithi176.stdout:4/135: link d3/d5/db/c2b d3/d21/d27/c34 0 2024-09-21T12:46:50.557 INFO:tasks.workunit.client.1.smithi176.stdout:1/106: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:46:50.557 INFO:tasks.workunit.client.1.smithi176.stdout:0/84: truncate d9/f11 685116 0 2024-09-21T12:46:50.558 INFO:tasks.workunit.client.1.smithi176.stdout:4/136: truncate d3/d5/f1c 887790 0 2024-09-21T12:46:50.558 INFO:tasks.workunit.client.1.smithi176.stdout:3/88: mknod d1/d5/c20 0 2024-09-21T12:46:50.559 INFO:tasks.workunit.client.1.smithi176.stdout:3/89: read d1/d5/f6 [215756,17677] 0 2024-09-21T12:46:50.560 INFO:tasks.workunit.client.1.smithi176.stdout:0/85: mkdir d9/d1a/d1d/d23 0 2024-09-21T12:46:50.563 INFO:tasks.workunit.client.1.smithi176.stdout:2/57: getdents d4 0 2024-09-21T12:46:50.563 INFO:tasks.workunit.client.1.smithi176.stdout:4/137: truncate f1 721286 0 2024-09-21T12:46:50.564 INFO:tasks.workunit.client.1.smithi176.stdout:3/90: creat d1/da/f21 x:0 0 0 2024-09-21T12:46:50.567 INFO:tasks.workunit.client.1.smithi176.stdout:0/86: rename d9/dc/f12 to d9/d1a/d1d/d22/f24 0 2024-09-21T12:46:50.568 INFO:tasks.workunit.client.1.smithi176.stdout:0/87: dread - d9/dc/f13 zero size 2024-09-21T12:46:50.568 INFO:tasks.workunit.client.1.smithi176.stdout:2/58: dread d4/f8 [0,4194304] 0 2024-09-21T12:46:50.568 INFO:tasks.workunit.client.1.smithi176.stdout:2/59: fsync d4/f8 0 2024-09-21T12:46:50.569 INFO:tasks.workunit.client.1.smithi176.stdout:0/88: dread - d9/dc/f13 zero size 2024-09-21T12:46:50.569 INFO:tasks.workunit.client.1.smithi176.stdout:4/138: unlink d3/d5/fc 0 2024-09-21T12:46:50.570 INFO:tasks.workunit.client.1.smithi176.stdout:2/60: dread f2 [0,4194304] 0 2024-09-21T12:46:50.574 INFO:tasks.workunit.client.1.smithi176.stdout:3/91: rmdir d1 39 2024-09-21T12:46:50.574 INFO:tasks.workunit.client.1.smithi176.stdout:2/61: dread f2 [0,4194304] 0 2024-09-21T12:46:50.574 INFO:tasks.workunit.client.1.smithi176.stdout:3/92: chown d1 1697 1 2024-09-21T12:46:50.576 INFO:tasks.workunit.client.1.smithi176.stdout:2/62: rename d4/f6 to d4/fc 0 2024-09-21T12:46:50.578 INFO:tasks.workunit.client.1.smithi176.stdout:4/139: link d3/d5/f1c d3/d21/d27/d2c/f35 0 2024-09-21T12:46:50.578 INFO:tasks.workunit.client.1.smithi176.stdout:3/93: rmdir d1 39 2024-09-21T12:46:50.580 INFO:tasks.workunit.client.1.smithi176.stdout:2/63: symlink d4/ld 0 2024-09-21T12:46:50.581 INFO:tasks.workunit.client.1.smithi176.stdout:2/64: chown d4/l9 22 1 2024-09-21T12:46:50.581 INFO:tasks.workunit.client.1.smithi176.stdout:4/140: mkdir d3/d5/db/d36 0 2024-09-21T12:46:50.582 INFO:tasks.workunit.client.1.smithi176.stdout:4/141: chown d3/d21/d27/f2d 3915 1 2024-09-21T12:46:50.583 INFO:tasks.workunit.client.1.smithi176.stdout:2/65: creat d4/fe x:0 0 0 2024-09-21T12:46:50.585 INFO:tasks.workunit.client.1.smithi176.stdout:2/66: mkdir d4/df 0 2024-09-21T12:46:50.587 INFO:tasks.workunit.client.1.smithi176.stdout:2/67: mknod d4/df/c10 0 2024-09-21T12:46:50.592 INFO:tasks.workunit.client.1.smithi176.stdout:2/68: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:46:50.593 INFO:tasks.workunit.client.1.smithi176.stdout:2/69: symlink d4/l11 0 2024-09-21T12:46:50.595 INFO:tasks.workunit.client.1.smithi176.stdout:2/70: write d4/f8 [8178928,38718] 0 2024-09-21T12:46:50.598 INFO:tasks.workunit.client.1.smithi176.stdout:2/71: symlink d4/l12 0 2024-09-21T12:46:50.598 INFO:tasks.workunit.client.1.smithi176.stdout:2/72: chown d4/l11 55582398 1 2024-09-21T12:46:50.600 INFO:tasks.workunit.client.1.smithi176.stdout:2/73: symlink d4/df/l13 0 2024-09-21T12:46:50.601 INFO:tasks.workunit.client.1.smithi176.stdout:2/74: dread f2 [0,4194304] 0 2024-09-21T12:46:50.602 INFO:tasks.workunit.client.1.smithi176.stdout:2/75: dread f2 [0,4194304] 0 2024-09-21T12:46:50.604 INFO:tasks.workunit.client.1.smithi176.stdout:2/76: mknod d4/df/c14 0 2024-09-21T12:46:50.605 INFO:tasks.workunit.client.1.smithi176.stdout:2/77: creat d4/df/f15 x:0 0 0 2024-09-21T12:46:50.606 INFO:tasks.workunit.client.1.smithi176.stdout:2/78: chown d4/fe 552055 1 2024-09-21T12:46:50.607 INFO:tasks.workunit.client.1.smithi176.stdout:2/79: dread f2 [0,4194304] 0 2024-09-21T12:46:50.608 INFO:tasks.workunit.client.1.smithi176.stdout:2/80: write d4/fe [857730,47484] 0 2024-09-21T12:46:50.635 INFO:tasks.workunit.client.1.smithi176.stdout:5/79: getdents d0/d13 0 2024-09-21T12:46:50.635 INFO:tasks.workunit.client.1.smithi176.stdout:9/129: write d1/f7 [1699260,89087] 0 2024-09-21T12:46:50.636 INFO:tasks.workunit.client.1.smithi176.stdout:6/71: dwrite d2/f17 [0,4194304] 0 2024-09-21T12:46:50.639 INFO:tasks.workunit.client.1.smithi176.stdout:5/80: chown d0/d10/d11/c12 1 1 2024-09-21T12:46:50.639 INFO:tasks.workunit.client.1.smithi176.stdout:9/130: symlink d1/df/l30 0 2024-09-21T12:46:50.641 INFO:tasks.workunit.client.1.smithi176.stdout:3/94: getdents d1/da 0 2024-09-21T12:46:50.643 INFO:tasks.workunit.client.1.smithi176.stdout:0/89: fsync d9/d1a/d1d/d22/f24 0 2024-09-21T12:46:50.645 INFO:tasks.workunit.client.1.smithi176.stdout:9/131: mknod d1/df/d1e/c31 0 2024-09-21T12:46:50.647 INFO:tasks.workunit.client.1.smithi176.stdout:5/81: mknod d0/d10/c1c 0 2024-09-21T12:46:50.649 INFO:tasks.workunit.client.1.smithi176.stdout:7/133: dwrite d0/d2/db/d10/f12 [4194304,4194304] 0 2024-09-21T12:46:50.650 INFO:tasks.workunit.client.1.smithi176.stdout:3/95: creat d1/da/f22 x:0 0 0 2024-09-21T12:46:50.653 INFO:tasks.workunit.client.1.smithi176.stdout:1/107: dwrite d0/db/f10 [4194304,4194304] 0 2024-09-21T12:46:50.654 INFO:tasks.workunit.client.1.smithi176.stdout:0/90: symlink d9/l25 0 2024-09-21T12:46:50.654 INFO:tasks.workunit.client.1.smithi176.stdout:5/82: truncate d0/f18 990035 0 2024-09-21T12:46:50.656 INFO:tasks.workunit.client.1.smithi176.stdout:6/72: dwrite d2/f15 [0,4194304] 0 2024-09-21T12:46:50.656 INFO:tasks.workunit.client.1.smithi176.stdout:8/74: sync 2024-09-21T12:46:50.659 INFO:tasks.workunit.client.1.smithi176.stdout:1/108: chown d0/db/d1a/f21 0 1 2024-09-21T12:46:50.659 INFO:tasks.workunit.client.1.smithi176.stdout:6/73: readlink d2/l6 0 2024-09-21T12:46:50.662 INFO:tasks.workunit.client.1.smithi176.stdout:5/83: rename d0/d10/l1b to d0/l1d 0 2024-09-21T12:46:50.663 INFO:tasks.workunit.client.1.smithi176.stdout:1/109: mkdir d0/db/d26 0 2024-09-21T12:46:50.665 INFO:tasks.workunit.client.1.smithi176.stdout:9/132: dwrite d1/df/d23/f15 [0,4194304] 0 2024-09-21T12:46:50.667 INFO:tasks.workunit.client.1.smithi176.stdout:1/110: truncate d0/db/f22 988181 0 2024-09-21T12:46:50.667 INFO:tasks.workunit.client.1.smithi176.stdout:6/74: creat d2/dd/de/f19 x:0 0 0 2024-09-21T12:46:50.667 INFO:tasks.workunit.client.1.smithi176.stdout:9/133: chown d1/f2f 9 1 2024-09-21T12:46:50.670 INFO:tasks.workunit.client.1.smithi176.stdout:5/84: unlink d0/c4 0 2024-09-21T12:46:50.671 INFO:tasks.workunit.client.1.smithi176.stdout:6/75: read d2/dd/de/d10/f13 [4135060,102406] 0 2024-09-21T12:46:50.672 INFO:tasks.workunit.client.1.smithi176.stdout:9/134: mknod d1/df/c32 0 2024-09-21T12:46:50.677 INFO:tasks.workunit.client.1.smithi176.stdout:5/85: truncate d0/f18 1221446 0 2024-09-21T12:46:50.677 INFO:tasks.workunit.client.1.smithi176.stdout:8/75: rename l1 to d6/l14 0 2024-09-21T12:46:50.685 INFO:tasks.workunit.client.1.smithi176.stdout:3/96: dwrite d1/d5/f6 [0,4194304] 0 2024-09-21T12:46:50.685 INFO:tasks.workunit.client.1.smithi176.stdout:5/86: rmdir d0 39 2024-09-21T12:46:50.686 INFO:tasks.workunit.client.1.smithi176.stdout:1/111: dwrite d0/f13 [0,4194304] 0 2024-09-21T12:46:50.691 INFO:tasks.workunit.client.1.smithi176.stdout:7/134: rename d0/f1a to d0/d2/db/d10/f2c 0 2024-09-21T12:46:50.692 INFO:tasks.workunit.client.1.smithi176.stdout:8/76: dread d6/f7 [0,4194304] 0 2024-09-21T12:46:50.695 INFO:tasks.workunit.client.1.smithi176.stdout:8/77: stat f4 0 2024-09-21T12:46:50.697 INFO:tasks.workunit.client.1.smithi176.stdout:9/135: dwrite d1/f2f [0,4194304] 0 2024-09-21T12:46:50.697 INFO:tasks.workunit.client.1.smithi176.stdout:1/112: truncate d0/db/f10 8555843 0 2024-09-21T12:46:50.700 INFO:tasks.workunit.client.1.smithi176.stdout:8/78: write d6/db/ff [23304,89927] 0 2024-09-21T12:46:50.701 INFO:tasks.workunit.client.1.smithi176.stdout:6/76: dwrite d2/f17 [0,4194304] 0 2024-09-21T12:46:50.702 INFO:tasks.workunit.client.1.smithi176.stdout:1/113: creat d0/f27 x:0 0 0 2024-09-21T12:46:50.705 INFO:tasks.workunit.client.1.smithi176.stdout:6/77: write d2/dd/de/d10/f12 [2827819,30342] 0 2024-09-21T12:46:50.705 INFO:tasks.workunit.client.1.smithi176.stdout:1/114: chown d0/db/f22 357711 1 2024-09-21T12:46:50.706 INFO:tasks.workunit.client.1.smithi176.stdout:8/79: creat d6/f15 x:0 0 0 2024-09-21T12:46:50.707 INFO:tasks.workunit.client.1.smithi176.stdout:9/136: getdents d1/df/d1c 0 2024-09-21T12:46:50.708 INFO:tasks.workunit.client.1.smithi176.stdout:7/135: dread d0/d2/db/d10/f1d [0,4194304] 0 2024-09-21T12:46:50.708 INFO:tasks.workunit.client.1.smithi176.stdout:6/78: creat d2/dd/de/d10/f1a x:0 0 0 2024-09-21T12:46:50.709 INFO:tasks.workunit.client.1.smithi176.stdout:8/80: mkdir d6/d16 0 2024-09-21T12:46:50.709 INFO:tasks.workunit.client.1.smithi176.stdout:7/136: write d0/d2/fa [2328693,119662] 0 2024-09-21T12:46:50.712 INFO:tasks.workunit.client.1.smithi176.stdout:6/79: unlink d2/dd/de/d10/f1a 0 2024-09-21T12:46:50.713 INFO:tasks.workunit.client.1.smithi176.stdout:8/81: creat d6/db/f17 x:0 0 0 2024-09-21T12:46:50.715 INFO:tasks.workunit.client.1.smithi176.stdout:7/137: write d0/d2/db/d10/f2c [1628797,5848] 0 2024-09-21T12:46:50.716 INFO:tasks.workunit.client.1.smithi176.stdout:1/115: fdatasync d0/f13 0 2024-09-21T12:46:50.717 INFO:tasks.workunit.client.1.smithi176.stdout:8/82: rename d6/db/ff to d6/db/f18 0 2024-09-21T12:46:50.719 INFO:tasks.workunit.client.1.smithi176.stdout:7/138: read d0/f16 [181138,56428] 0 2024-09-21T12:46:50.722 INFO:tasks.workunit.client.1.smithi176.stdout:8/83: dread d6/fa [0,4194304] 0 2024-09-21T12:46:50.725 INFO:tasks.workunit.client.1.smithi176.stdout:7/139: symlink d0/d2/db/d10/d23/l2d 0 2024-09-21T12:46:50.728 INFO:tasks.workunit.client.1.smithi176.stdout:8/84: rename d6/f7 to d6/db/d13/f19 0 2024-09-21T12:46:50.730 INFO:tasks.workunit.client.1.smithi176.stdout:1/116: dwrite d0/fa [0,4194304] 0 2024-09-21T12:46:50.733 INFO:tasks.workunit.client.1.smithi176.stdout:3/97: dwrite d1/fe [0,4194304] 0 2024-09-21T12:46:50.734 INFO:tasks.workunit.client.1.smithi176.stdout:3/98: write d1/f1c [428311,107853] 0 2024-09-21T12:46:50.735 INFO:tasks.workunit.client.1.smithi176.stdout:1/117: unlink d0/c14 0 2024-09-21T12:46:50.735 INFO:tasks.workunit.client.1.smithi176.stdout:8/85: write f4 [3267966,47941] 0 2024-09-21T12:46:50.738 INFO:tasks.workunit.client.1.smithi176.stdout:3/99: rmdir d1/da 39 2024-09-21T12:46:50.740 INFO:tasks.workunit.client.1.smithi176.stdout:8/86: fdatasync d6/fa 0 2024-09-21T12:46:50.740 INFO:tasks.workunit.client.1.smithi176.stdout:8/87: readlink l2 0 2024-09-21T12:46:50.741 INFO:tasks.workunit.client.1.smithi176.stdout:3/100: chown d1/da/c11 0 1 2024-09-21T12:46:50.779 INFO:tasks.workunit.client.1.smithi176.stdout:4/142: sync 2024-09-21T12:46:50.779 INFO:tasks.workunit.client.1.smithi176.stdout:2/81: sync 2024-09-21T12:46:50.789 INFO:tasks.workunit.client.1.smithi176.stdout:3/101: fdatasync d1/da/ff 0 2024-09-21T12:46:50.791 INFO:tasks.workunit.client.1.smithi176.stdout:7/140: truncate d0/d2/db/ff 2670028 0 2024-09-21T12:46:50.791 INFO:tasks.workunit.client.1.smithi176.stdout:8/88: creat d6/f1a x:0 0 0 2024-09-21T12:46:50.793 INFO:tasks.workunit.client.1.smithi176.stdout:7/141: chown d0/d2/db/f26 19 1 2024-09-21T12:46:50.793 INFO:tasks.workunit.client.1.smithi176.stdout:1/118: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:46:50.794 INFO:tasks.workunit.client.1.smithi176.stdout:3/102: symlink d1/d5/l23 0 2024-09-21T12:46:50.796 INFO:tasks.workunit.client.1.smithi176.stdout:2/82: rename d4/l12 to d4/df/l16 0 2024-09-21T12:46:50.798 INFO:tasks.workunit.client.1.smithi176.stdout:1/119: creat d0/f28 x:0 0 0 2024-09-21T12:46:50.798 INFO:tasks.workunit.client.1.smithi176.stdout:3/103: write d1/da/fb [356564,94067] 0 2024-09-21T12:46:50.799 INFO:tasks.workunit.client.1.smithi176.stdout:2/83: chown d4/df/f15 623 1 2024-09-21T12:46:50.801 INFO:tasks.workunit.client.1.smithi176.stdout:2/84: rmdir d4 39 2024-09-21T12:46:50.803 INFO:tasks.workunit.client.1.smithi176.stdout:1/120: mknod d0/db/d26/c29 0 2024-09-21T12:46:50.803 INFO:tasks.workunit.client.1.smithi176.stdout:4/143: dwrite d3/d21/d27/f2d [0,4194304] 0 2024-09-21T12:46:50.804 INFO:tasks.workunit.client.1.smithi176.stdout:3/104: write d1/fe [915027,44630] 0 2024-09-21T12:46:50.804 INFO:tasks.workunit.client.1.smithi176.stdout:8/89: dread f4 [0,4194304] 0 2024-09-21T12:46:50.807 INFO:tasks.workunit.client.1.smithi176.stdout:1/121: mkdir d0/db/d2a 0 2024-09-21T12:46:50.808 INFO:tasks.workunit.client.1.smithi176.stdout:7/142: dread d0/d2/db/fe [0,4194304] 0 2024-09-21T12:46:50.808 INFO:tasks.workunit.client.1.smithi176.stdout:8/90: fsync f0 0 2024-09-21T12:46:50.811 INFO:tasks.workunit.client.1.smithi176.stdout:3/105: fdatasync d1/d5/f14 0 2024-09-21T12:46:50.813 INFO:tasks.workunit.client.1.smithi176.stdout:1/122: dread d0/f6 [0,4194304] 0 2024-09-21T12:46:50.814 INFO:tasks.workunit.client.1.smithi176.stdout:8/91: symlink d6/db/l1b 0 2024-09-21T12:46:50.817 INFO:tasks.workunit.client.1.smithi176.stdout:7/143: link d0/d2/db/d10/f12 d0/d2/db/d10/d23/f2e 0 2024-09-21T12:46:50.817 INFO:tasks.workunit.client.1.smithi176.stdout:3/106: dread d1/f4 [0,4194304] 0 2024-09-21T12:46:50.820 INFO:tasks.workunit.client.1.smithi176.stdout:3/107: rmdir d1/da 39 2024-09-21T12:46:50.821 INFO:tasks.workunit.client.1.smithi176.stdout:7/144: mkdir d0/d2f 0 2024-09-21T12:46:50.824 INFO:tasks.workunit.client.1.smithi176.stdout:3/108: mknod d1/c24 0 2024-09-21T12:46:50.824 INFO:tasks.workunit.client.1.smithi176.stdout:1/123: dwrite d0/db/ff [0,4194304] 0 2024-09-21T12:46:50.825 INFO:tasks.workunit.client.1.smithi176.stdout:7/145: mkdir d0/d2/d30 0 2024-09-21T12:46:50.827 INFO:tasks.workunit.client.1.smithi176.stdout:3/109: truncate d1/f18 92372 0 2024-09-21T12:46:50.828 INFO:tasks.workunit.client.1.smithi176.stdout:1/124: mkdir d0/db/d25/d2b 0 2024-09-21T12:46:50.829 INFO:tasks.workunit.client.1.smithi176.stdout:8/92: dwrite f4 [0,4194304] 0 2024-09-21T12:46:50.829 INFO:tasks.workunit.client.1.smithi176.stdout:3/110: readlink d1/d5/l16 0 2024-09-21T12:46:50.830 INFO:tasks.workunit.client.1.smithi176.stdout:2/85: dwrite f2 [0,4194304] 0 2024-09-21T12:46:50.831 INFO:tasks.workunit.client.1.smithi176.stdout:7/146: mkdir d0/d2/db/d10/d31 0 2024-09-21T12:46:50.835 INFO:tasks.workunit.client.1.smithi176.stdout:2/86: read d4/f8 [4452608,122976] 0 2024-09-21T12:46:50.835 INFO:tasks.workunit.client.1.smithi176.stdout:1/125: mkdir d0/db/d1a/d2c 0 2024-09-21T12:46:50.836 INFO:tasks.workunit.client.1.smithi176.stdout:2/87: readlink d4/ld 0 2024-09-21T12:46:50.837 INFO:tasks.workunit.client.1.smithi176.stdout:3/111: mkdir d1/d5/d25 0 2024-09-21T12:46:50.838 INFO:tasks.workunit.client.1.smithi176.stdout:3/112: chown d1/d5/c15 246470638 1 2024-09-21T12:46:50.838 INFO:tasks.workunit.client.1.smithi176.stdout:7/147: truncate d0/f20 199684 0 2024-09-21T12:46:50.840 INFO:tasks.workunit.client.1.smithi176.stdout:1/126: link d0/f1c d0/db/d1a/d2c/f2d 0 2024-09-21T12:46:50.842 INFO:tasks.workunit.client.1.smithi176.stdout:2/88: dread d4/fc [0,4194304] 0 2024-09-21T12:46:50.842 INFO:tasks.workunit.client.1.smithi176.stdout:8/93: rename d6/db/c11 to d6/c1c 0 2024-09-21T12:46:50.845 INFO:tasks.workunit.client.1.smithi176.stdout:3/113: creat d1/d5/d25/f26 x:0 0 0 2024-09-21T12:46:50.848 INFO:tasks.workunit.client.1.smithi176.stdout:7/148: symlink d0/d2/db/l32 0 2024-09-21T12:46:50.852 INFO:tasks.workunit.client.1.smithi176.stdout:7/149: write d0/d2/db/d10/f2c [1199262,65002] 0 2024-09-21T12:46:50.852 INFO:tasks.workunit.client.1.smithi176.stdout:3/114: unlink d1/d5/f9 0 2024-09-21T12:46:50.853 INFO:tasks.workunit.client.1.smithi176.stdout:1/127: dwrite d0/db/f17 [0,4194304] 0 2024-09-21T12:46:50.854 INFO:tasks.workunit.client.1.smithi176.stdout:1/128: truncate d0/db/d1a/d2c/f2d 246770 0 2024-09-21T12:46:50.859 INFO:tasks.workunit.client.1.smithi176.stdout:7/150: creat d0/f33 x:0 0 0 2024-09-21T12:46:50.860 INFO:tasks.workunit.client.1.smithi176.stdout:2/89: fsync f2 0 2024-09-21T12:46:50.866 INFO:tasks.workunit.client.1.smithi176.stdout:8/94: dwrite f0 [4194304,4194304] 0 2024-09-21T12:46:50.866 INFO:tasks.workunit.client.1.smithi176.stdout:3/115: truncate d1/d5/f6 840766 0 2024-09-21T12:46:50.868 INFO:tasks.workunit.client.1.smithi176.stdout:7/151: write d0/d2/db/fe [419175,24235] 0 2024-09-21T12:46:50.871 INFO:tasks.workunit.client.1.smithi176.stdout:8/95: creat d6/d16/f1d x:0 0 0 2024-09-21T12:46:50.873 INFO:tasks.workunit.client.1.smithi176.stdout:2/90: dwrite d4/df/f15 [0,4194304] 0 2024-09-21T12:46:50.874 INFO:tasks.workunit.client.1.smithi176.stdout:2/91: fsync f2 0 2024-09-21T12:46:50.878 INFO:tasks.workunit.client.1.smithi176.stdout:2/92: symlink d4/l17 0 2024-09-21T12:46:50.879 INFO:tasks.workunit.client.1.smithi176.stdout:7/152: link d0/d2/db/d10/f2c d0/d2/db/d25/f34 0 2024-09-21T12:46:50.883 INFO:tasks.workunit.client.1.smithi176.stdout:8/96: dread f4 [0,4194304] 0 2024-09-21T12:46:50.884 INFO:tasks.workunit.client.1.smithi176.stdout:7/153: rename d0/f3 to d0/d2/f35 0 2024-09-21T12:46:50.885 INFO:tasks.workunit.client.1.smithi176.stdout:3/116: dwrite d1/da/f22 [0,4194304] 0 2024-09-21T12:46:50.886 INFO:tasks.workunit.client.1.smithi176.stdout:8/97: creat d6/d16/f1e x:0 0 0 2024-09-21T12:46:50.887 INFO:tasks.workunit.client.1.smithi176.stdout:7/154: unlink d0/l4 0 2024-09-21T12:46:50.889 INFO:tasks.workunit.client.1.smithi176.stdout:0/91: sync 2024-09-21T12:46:50.889 INFO:tasks.workunit.client.1.smithi176.stdout:8/98: mknod d6/db/c1f 0 2024-09-21T12:46:50.890 INFO:tasks.workunit.client.1.smithi176.stdout:7/155: readlink d0/l1c 0 2024-09-21T12:46:50.891 INFO:tasks.workunit.client.1.smithi176.stdout:2/93: getdents d4 0 2024-09-21T12:46:50.893 INFO:tasks.workunit.client.1.smithi176.stdout:3/117: rename d1/l17 to d1/l27 0 2024-09-21T12:46:50.894 INFO:tasks.workunit.client.1.smithi176.stdout:0/92: creat d9/d1a/d1d/f26 x:0 0 0 2024-09-21T12:46:50.897 INFO:tasks.workunit.client.1.smithi176.stdout:2/94: symlink d4/l18 0 2024-09-21T12:46:50.899 INFO:tasks.workunit.client.1.smithi176.stdout:3/118: mkdir d1/d5/d28 0 2024-09-21T12:46:50.899 INFO:tasks.workunit.client.1.smithi176.stdout:8/99: fdatasync d6/db/d13/f19 0 2024-09-21T12:46:50.900 INFO:tasks.workunit.client.1.smithi176.stdout:7/156: symlink d0/d2f/l36 0 2024-09-21T12:46:50.901 INFO:tasks.workunit.client.1.smithi176.stdout:2/95: creat d4/f19 x:0 0 0 2024-09-21T12:46:50.902 INFO:tasks.workunit.client.1.smithi176.stdout:8/100: dread d6/db/f18 [0,4194304] 0 2024-09-21T12:46:50.904 INFO:tasks.workunit.client.1.smithi176.stdout:0/93: link d9/f14 d9/f27 0 2024-09-21T12:46:50.905 INFO:tasks.workunit.client.1.smithi176.stdout:2/96: creat d4/f1a x:0 0 0 2024-09-21T12:46:50.907 INFO:tasks.workunit.client.1.smithi176.stdout:7/157: mknod d0/d2/db/c37 0 2024-09-21T12:46:50.908 INFO:tasks.workunit.client.1.smithi176.stdout:2/97: mknod d4/df/c1b 0 2024-09-21T12:46:50.910 INFO:tasks.workunit.client.1.smithi176.stdout:8/101: dwrite d6/db/f17 [0,4194304] 0 2024-09-21T12:46:50.911 INFO:tasks.workunit.client.1.smithi176.stdout:0/94: dread d9/ff [0,4194304] 0 2024-09-21T12:46:50.911 INFO:tasks.workunit.client.1.smithi176.stdout:3/119: chown d1/d5/f6 39 1 2024-09-21T12:46:50.911 INFO:tasks.workunit.client.1.smithi176.stdout:2/98: creat d4/df/f1c x:0 0 0 2024-09-21T12:46:50.913 INFO:tasks.workunit.client.1.smithi176.stdout:7/158: rename d0/d2/db/d25/f34 to d0/d2/db/d25/f38 0 2024-09-21T12:46:50.914 INFO:tasks.workunit.client.1.smithi176.stdout:0/95: symlink d9/dc/l28 0 2024-09-21T12:46:50.915 INFO:tasks.workunit.client.1.smithi176.stdout:3/120: mknod d1/da/c29 0 2024-09-21T12:46:50.916 INFO:tasks.workunit.client.1.smithi176.stdout:7/159: fsync d0/d2/db/d10/f29 0 2024-09-21T12:46:50.917 INFO:tasks.workunit.client.1.smithi176.stdout:3/121: chown d1/f18 6 1 2024-09-21T12:46:50.919 INFO:tasks.workunit.client.1.smithi176.stdout:0/96: unlink d9/dc/f10 0 2024-09-21T12:46:50.919 INFO:tasks.workunit.client.1.smithi176.stdout:8/102: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:46:50.920 INFO:tasks.workunit.client.1.smithi176.stdout:8/103: fdatasync f0 0 2024-09-21T12:46:50.921 INFO:tasks.workunit.client.1.smithi176.stdout:7/160: symlink d0/d2/l39 0 2024-09-21T12:46:50.926 INFO:tasks.workunit.client.1.smithi176.stdout:8/104: symlink d6/db/l20 0 2024-09-21T12:46:50.930 INFO:tasks.workunit.client.1.smithi176.stdout:0/97: link d9/d1a/d1d/d22/f24 d9/d1a/d1d/d22/f29 0 2024-09-21T12:46:50.930 INFO:tasks.workunit.client.1.smithi176.stdout:8/105: symlink d6/l21 0 2024-09-21T12:46:50.931 INFO:tasks.workunit.client.1.smithi176.stdout:0/98: readlink d9/dc/l28 0 2024-09-21T12:46:50.932 INFO:tasks.workunit.client.1.smithi176.stdout:3/122: dwrite d1/f1f [0,4194304] 0 2024-09-21T12:46:50.934 INFO:tasks.workunit.client.1.smithi176.stdout:3/123: chown d1/da/c29 55609 1 2024-09-21T12:46:50.934 INFO:tasks.workunit.client.1.smithi176.stdout:2/99: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:46:50.934 INFO:tasks.workunit.client.1.smithi176.stdout:8/106: unlink d6/db/f18 0 2024-09-21T12:46:50.937 INFO:tasks.workunit.client.1.smithi176.stdout:3/124: read d1/f1a [2554295,17956] 0 2024-09-21T12:46:50.939 INFO:tasks.workunit.client.1.smithi176.stdout:7/161: getdents d0/d2 0 2024-09-21T12:46:50.944 INFO:tasks.workunit.client.1.smithi176.stdout:8/107: rename f0 to d6/d16/f22 0 2024-09-21T12:46:50.944 INFO:tasks.workunit.client.1.smithi176.stdout:2/100: write d4/df/f15 [5235389,123578] 0 2024-09-21T12:46:50.946 INFO:tasks.workunit.client.1.smithi176.stdout:7/162: write d0/d2/db/f26 [29514,81543] 0 2024-09-21T12:46:50.947 INFO:tasks.workunit.client.1.smithi176.stdout:8/108: fsync d6/db/f17 0 2024-09-21T12:46:50.948 INFO:tasks.workunit.client.1.smithi176.stdout:0/99: dwrite d9/dc/f15 [0,4194304] 0 2024-09-21T12:46:50.951 INFO:tasks.workunit.client.1.smithi176.stdout:8/109: chown d6/f15 106432312 1 2024-09-21T12:46:50.951 INFO:tasks.workunit.client.1.smithi176.stdout:9/137: sync 2024-09-21T12:46:50.951 INFO:tasks.workunit.client.1.smithi176.stdout:5/87: sync 2024-09-21T12:46:50.951 INFO:tasks.workunit.client.1.smithi176.stdout:7/163: symlink d0/d2/db/d25/l3a 0 2024-09-21T12:46:50.952 INFO:tasks.workunit.client.1.smithi176.stdout:0/100: creat d9/d1a/d1d/d22/f2a x:0 0 0 2024-09-21T12:46:50.953 INFO:tasks.workunit.client.1.smithi176.stdout:9/138: dread - d1/f2a zero size 2024-09-21T12:46:50.954 INFO:tasks.workunit.client.1.smithi176.stdout:3/125: dwrite d1/f1c [0,4194304] 0 2024-09-21T12:46:50.956 INFO:tasks.workunit.client.1.smithi176.stdout:8/110: unlink d6/l14 0 2024-09-21T12:46:50.960 INFO:tasks.workunit.client.1.smithi176.stdout:3/126: stat d1/d5/d25/f26 0 2024-09-21T12:46:50.962 INFO:tasks.workunit.client.1.smithi176.stdout:2/101: dread d4/df/f15 [0,4194304] 0 2024-09-21T12:46:50.963 INFO:tasks.workunit.client.1.smithi176.stdout:5/88: rename d0/d10/d11/l16 to d0/d13/l1e 0 2024-09-21T12:46:50.963 INFO:tasks.workunit.client.1.smithi176.stdout:8/111: write d6/f15 [4010205,113331] 0 2024-09-21T12:46:50.968 INFO:tasks.workunit.client.1.smithi176.stdout:0/101: dread d9/d1a/d1d/d22/f29 [0,4194304] 0 2024-09-21T12:46:50.968 INFO:tasks.workunit.client.1.smithi176.stdout:7/164: dwrite d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:46:50.970 INFO:tasks.workunit.client.1.smithi176.stdout:3/127: creat d1/d5/d28/f2a x:0 0 0 2024-09-21T12:46:50.971 INFO:tasks.workunit.client.1.smithi176.stdout:0/102: chown d9/d1b/f1f 410591852 1 2024-09-21T12:46:50.972 INFO:tasks.workunit.client.1.smithi176.stdout:2/102: rename d4/f8 to d4/f1d 0 2024-09-21T12:46:50.976 INFO:tasks.workunit.client.1.smithi176.stdout:7/165: mkdir d0/d2/db/d10/d3b 0 2024-09-21T12:46:50.977 INFO:tasks.workunit.client.1.smithi176.stdout:9/139: dwrite d1/f7 [0,4194304] 0 2024-09-21T12:46:50.977 INFO:tasks.workunit.client.1.smithi176.stdout:5/89: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:50.978 INFO:tasks.workunit.client.1.smithi176.stdout:2/103: creat d4/df/f1e x:0 0 0 2024-09-21T12:46:50.978 INFO:tasks.workunit.client.1.smithi176.stdout:0/103: write d9/dc/f13 [1036952,28797] 0 2024-09-21T12:46:50.981 INFO:tasks.workunit.client.1.smithi176.stdout:7/166: symlink d0/l3c 0 2024-09-21T12:46:50.982 INFO:tasks.workunit.client.1.smithi176.stdout:2/104: mknod d4/c1f 0 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:5/90: mknod d0/d10/d11/c1f 0 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:7/167: fsync d0/d2/fa 0 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:2/105: stat d4/fc 0 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:6/80: sync 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:4/144: sync 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:1/129: sync 2024-09-21T12:46:50.986 INFO:tasks.workunit.client.1.smithi176.stdout:0/104: creat d9/f2b x:0 0 0 2024-09-21T12:46:50.988 INFO:tasks.workunit.client.1.smithi176.stdout:6/81: stat d2/dd/f11 0 2024-09-21T12:46:50.988 INFO:tasks.workunit.client.1.smithi176.stdout:8/112: dwrite d6/d16/f22 [4194304,4194304] 0 2024-09-21T12:46:50.995 INFO:tasks.workunit.client.1.smithi176.stdout:4/145: mkdir d3/d5/d37 0 2024-09-21T12:46:50.997 INFO:tasks.workunit.client.1.smithi176.stdout:6/82: write d2/f8 [2819997,42571] 0 2024-09-21T12:46:50.997 INFO:tasks.workunit.client.1.smithi176.stdout:9/140: dwrite d1/df/d1e/f27 [0,4194304] 0 2024-09-21T12:46:51.001 INFO:tasks.workunit.client.1.smithi176.stdout:8/113: mkdir d6/db/d23 0 2024-09-21T12:46:51.003 INFO:tasks.workunit.client.1.smithi176.stdout:4/146: stat d3/f12 0 2024-09-21T12:46:51.004 INFO:tasks.workunit.client.1.smithi176.stdout:6/83: write d2/dd/de/f14 [729041,20466] 0 2024-09-21T12:46:51.005 INFO:tasks.workunit.client.1.smithi176.stdout:0/105: symlink d9/d1a/d1d/d23/l2c 0 2024-09-21T12:46:51.006 INFO:tasks.workunit.client.1.smithi176.stdout:9/141: fsync d1/f5 0 2024-09-21T12:46:51.006 INFO:tasks.workunit.client.1.smithi176.stdout:1/130: symlink d0/db/d25/d2b/l2e 0 2024-09-21T12:46:51.006 INFO:tasks.workunit.client.1.smithi176.stdout:3/128: dwrite d1/f4 [0,4194304] 0 2024-09-21T12:46:51.015 INFO:tasks.workunit.client.1.smithi176.stdout:4/147: chown d3/d5/db/l30 705 1 2024-09-21T12:46:51.015 INFO:tasks.workunit.client.1.smithi176.stdout:1/131: stat d0/db/d26 0 2024-09-21T12:46:51.017 INFO:tasks.workunit.client.1.smithi176.stdout:9/142: read d1/fd [906232,20684] 0 2024-09-21T12:46:51.019 INFO:tasks.workunit.client.1.smithi176.stdout:4/148: stat d3/d21/f2e 0 2024-09-21T12:46:51.022 INFO:tasks.workunit.client.1.smithi176.stdout:2/106: dwrite d4/fc [0,4194304] 0 2024-09-21T12:46:51.024 INFO:tasks.workunit.client.1.smithi176.stdout:0/106: write d9/d1a/d1d/f26 [446432,47953] 0 2024-09-21T12:46:51.024 INFO:tasks.workunit.client.1.smithi176.stdout:8/114: getdents d6/db 0 2024-09-21T12:46:51.025 INFO:tasks.workunit.client.1.smithi176.stdout:5/91: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:46:51.026 INFO:tasks.workunit.client.1.smithi176.stdout:7/168: dwrite d0/d2/db/d10/f2c [0,4194304] 0 2024-09-21T12:46:51.028 INFO:tasks.workunit.client.1.smithi176.stdout:2/107: chown d4/df/f1e 14623227 1 2024-09-21T12:46:51.033 INFO:tasks.workunit.client.1.smithi176.stdout:9/143: creat d1/f33 x:0 0 0 2024-09-21T12:46:51.034 INFO:tasks.workunit.client.1.smithi176.stdout:2/108: read f2 [2644822,1793] 0 2024-09-21T12:46:51.034 INFO:tasks.workunit.client.1.smithi176.stdout:5/92: chown d0/d10/c1c 532927010 1 2024-09-21T12:46:51.039 INFO:tasks.workunit.client.1.smithi176.stdout:6/84: dwrite d2/dd/de/f14 [0,4194304] 0 2024-09-21T12:46:51.040 INFO:tasks.workunit.client.1.smithi176.stdout:9/144: creat d1/df/d23/f34 x:0 0 0 2024-09-21T12:46:51.043 INFO:tasks.workunit.client.1.smithi176.stdout:0/107: creat d9/d1a/d20/f2d x:0 0 0 2024-09-21T12:46:51.043 INFO:tasks.workunit.client.1.smithi176.stdout:8/115: rename d6/db/d23 to d6/d8/d24 0 2024-09-21T12:46:51.044 INFO:tasks.workunit.client.1.smithi176.stdout:9/145: read d1/f5 [3358592,88982] 0 2024-09-21T12:46:51.045 INFO:tasks.workunit.client.1.smithi176.stdout:2/109: symlink d4/df/l20 0 2024-09-21T12:46:51.047 INFO:tasks.workunit.client.1.smithi176.stdout:1/132: dread d0/db/f17 [0,4194304] 0 2024-09-21T12:46:51.047 INFO:tasks.workunit.client.1.smithi176.stdout:6/85: mkdir d2/dd/de/d10/d1b 0 2024-09-21T12:46:51.047 INFO:tasks.workunit.client.1.smithi176.stdout:4/149: dread d3/d21/d27/f2d [0,4194304] 0 2024-09-21T12:46:51.049 INFO:tasks.workunit.client.1.smithi176.stdout:2/110: write d4/f1a [24999,25005] 0 2024-09-21T12:46:51.050 INFO:tasks.workunit.client.1.smithi176.stdout:4/150: chown d3/c1b 1 1 2024-09-21T12:46:51.050 INFO:tasks.workunit.client.1.smithi176.stdout:8/116: creat d6/d16/f25 x:0 0 0 2024-09-21T12:46:51.050 INFO:tasks.workunit.client.1.smithi176.stdout:2/111: fsync f2 0 2024-09-21T12:46:51.052 INFO:tasks.workunit.client.1.smithi176.stdout:5/93: write d0/ff [473499,83644] 0 2024-09-21T12:46:51.052 INFO:tasks.workunit.client.1.smithi176.stdout:1/133: creat d0/db/d26/f2f x:0 0 0 2024-09-21T12:46:51.053 INFO:tasks.workunit.client.1.smithi176.stdout:4/151: chown d3/d5/l17 0 1 2024-09-21T12:46:51.056 INFO:tasks.workunit.client.1.smithi176.stdout:2/112: creat d4/df/f21 x:0 0 0 2024-09-21T12:46:51.058 INFO:tasks.workunit.client.1.smithi176.stdout:1/134: dread d0/f1c [0,4194304] 0 2024-09-21T12:46:51.058 INFO:tasks.workunit.client.1.smithi176.stdout:2/113: stat d4/df/f21 0 2024-09-21T12:46:51.060 INFO:tasks.workunit.client.1.smithi176.stdout:3/129: dread f0 [0,4194304] 0 2024-09-21T12:46:51.060 INFO:tasks.workunit.client.1.smithi176.stdout:9/146: truncate d1/f5 932231 0 2024-09-21T12:46:51.060 INFO:tasks.workunit.client.1.smithi176.stdout:7/169: dwrite d0/d2/f1e [0,4194304] 0 2024-09-21T12:46:51.062 INFO:tasks.workunit.client.1.smithi176.stdout:5/94: mknod d0/d13/c20 0 2024-09-21T12:46:51.062 INFO:tasks.workunit.client.1.smithi176.stdout:1/135: write d0/f13 [2039865,52556] 0 2024-09-21T12:46:51.063 INFO:tasks.workunit.client.1.smithi176.stdout:6/86: dread d2/f17 [0,4194304] 0 2024-09-21T12:46:51.066 INFO:tasks.workunit.client.1.smithi176.stdout:9/147: fdatasync d1/f7 0 2024-09-21T12:46:51.067 INFO:tasks.workunit.client.1.smithi176.stdout:2/114: fsync d4/df/f21 0 2024-09-21T12:46:51.067 INFO:tasks.workunit.client.1.smithi176.stdout:3/130: mknod d1/d5/d28/c2b 0 2024-09-21T12:46:51.072 INFO:tasks.workunit.client.1.smithi176.stdout:1/136: mkdir d0/db/d25/d2b/d30 0 2024-09-21T12:46:51.072 INFO:tasks.workunit.client.1.smithi176.stdout:7/170: write d0/d2/db/d10/f1d [862787,42149] 0 2024-09-21T12:46:51.072 INFO:tasks.workunit.client.1.smithi176.stdout:9/148: write d1/f2a [355868,56481] 0 2024-09-21T12:46:51.074 INFO:tasks.workunit.client.1.smithi176.stdout:6/87: symlink d2/dd/de/d10/l1c 0 2024-09-21T12:46:51.075 INFO:tasks.workunit.client.1.smithi176.stdout:9/149: chown d1/df/d1e 716693 1 2024-09-21T12:46:51.076 INFO:tasks.workunit.client.1.smithi176.stdout:2/115: rename d4/fc to d4/df/f22 0 2024-09-21T12:46:51.076 INFO:tasks.workunit.client.1.smithi176.stdout:4/152: write d3/d5/f15 [372803,18461] 0 2024-09-21T12:46:51.079 INFO:tasks.workunit.client.1.smithi176.stdout:9/150: readlink d1/df/d1e/l28 0 2024-09-21T12:46:51.080 INFO:tasks.workunit.client.1.smithi176.stdout:5/95: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:46:51.080 INFO:tasks.workunit.client.1.smithi176.stdout:1/137: unlink d0/f1c 0 2024-09-21T12:46:51.082 INFO:tasks.workunit.client.1.smithi176.stdout:7/171: symlink d0/d2/db/d10/d23/l3d 0 2024-09-21T12:46:51.082 INFO:tasks.workunit.client.1.smithi176.stdout:2/116: mknod d4/df/c23 0 2024-09-21T12:46:51.087 INFO:tasks.workunit.client.1.smithi176.stdout:5/96: creat d0/d10/d11/f21 x:0 0 0 2024-09-21T12:46:51.089 INFO:tasks.workunit.client.1.smithi176.stdout:1/138: dread d0/db/f1b [0,4194304] 0 2024-09-21T12:46:51.089 INFO:tasks.workunit.client.1.smithi176.stdout:2/117: mknod d4/c24 0 2024-09-21T12:46:51.092 INFO:tasks.workunit.client.1.smithi176.stdout:8/117: dwrite d6/db/d13/f19 [0,4194304] 0 2024-09-21T12:46:51.096 INFO:tasks.workunit.client.1.smithi176.stdout:4/153: link d3/d5/l17 d3/d5/db/d36/l38 0 2024-09-21T12:46:51.096 INFO:tasks.workunit.client.1.smithi176.stdout:2/118: chown d4/df/c1b 23551360 1 2024-09-21T12:46:51.096 INFO:tasks.workunit.client.1.smithi176.stdout:8/118: chown d6/f15 5 1 2024-09-21T12:46:51.097 INFO:tasks.workunit.client.1.smithi176.stdout:3/131: dwrite d1/f1c [4194304,4194304] 0 2024-09-21T12:46:51.100 INFO:tasks.workunit.client.1.smithi176.stdout:7/172: write d0/d2/db/d10/f12 [2073425,112566] 0 2024-09-21T12:46:51.102 INFO:tasks.workunit.client.1.smithi176.stdout:9/151: dread d1/df/f12 [0,4194304] 0 2024-09-21T12:46:51.102 INFO:tasks.workunit.client.1.smithi176.stdout:6/88: dwrite d2/f17 [4194304,4194304] 0 2024-09-21T12:46:51.103 INFO:tasks.workunit.client.1.smithi176.stdout:1/139: mkdir d0/db/d25/d2b/d31 0 2024-09-21T12:46:51.105 INFO:tasks.workunit.client.1.smithi176.stdout:4/154: rmdir d3 39 2024-09-21T12:46:51.106 INFO:tasks.workunit.client.1.smithi176.stdout:8/119: truncate d6/d16/f1e 590782 0 2024-09-21T12:46:51.106 INFO:tasks.workunit.client.1.smithi176.stdout:7/173: unlink d0/d2/db/d25/l3a 0 2024-09-21T12:46:51.108 INFO:tasks.workunit.client.1.smithi176.stdout:8/120: dread - d6/d8/f10 zero size 2024-09-21T12:46:51.108 INFO:tasks.workunit.client.1.smithi176.stdout:3/132: truncate d1/d5/d28/f2a 492737 0 2024-09-21T12:46:51.109 INFO:tasks.workunit.client.1.smithi176.stdout:5/97: rename d0/d13/l1e to d0/d10/l22 0 2024-09-21T12:46:51.109 INFO:tasks.workunit.client.1.smithi176.stdout:8/121: stat d6/d8/le 0 2024-09-21T12:46:51.110 INFO:tasks.workunit.client.1.smithi176.stdout:9/152: rename d1 to d1/df/d35 22 2024-09-21T12:46:51.110 INFO:tasks.workunit.client.1.smithi176.stdout:2/119: dread f2 [0,4194304] 0 2024-09-21T12:46:51.110 INFO:tasks.workunit.client.1.smithi176.stdout:6/89: symlink d2/l1d 0 2024-09-21T12:46:51.112 INFO:tasks.workunit.client.1.smithi176.stdout:8/122: write d6/db/d13/f19 [1083402,120143] 0 2024-09-21T12:46:51.113 INFO:tasks.workunit.client.1.smithi176.stdout:3/133: rename d1/da/ff to d1/da/f2c 0 2024-09-21T12:46:51.113 INFO:tasks.workunit.client.1.smithi176.stdout:3/134: readlink d1/l19 0 2024-09-21T12:46:51.114 INFO:tasks.workunit.client.1.smithi176.stdout:3/135: truncate d1/d5/d28/f2a 920699 0 2024-09-21T12:46:51.115 INFO:tasks.workunit.client.1.smithi176.stdout:3/136: truncate d1/fe 4874429 0 2024-09-21T12:46:51.117 INFO:tasks.workunit.client.1.smithi176.stdout:9/153: creat d1/df/d23/f36 x:0 0 0 2024-09-21T12:46:51.119 INFO:tasks.workunit.client.1.smithi176.stdout:8/123: creat d6/db/d13/f26 x:0 0 0 2024-09-21T12:46:51.120 INFO:tasks.workunit.client.1.smithi176.stdout:8/124: read d6/d16/f22 [5298235,24015] 0 2024-09-21T12:46:51.122 INFO:tasks.workunit.client.1.smithi176.stdout:1/140: write d0/db/d1a/f21 [1040501,72999] 0 2024-09-21T12:46:51.122 INFO:tasks.workunit.client.1.smithi176.stdout:3/137: creat d1/d5/d25/f2d x:0 0 0 2024-09-21T12:46:51.123 INFO:tasks.workunit.client.1.smithi176.stdout:1/141: stat d0/db/f19 0 2024-09-21T12:46:51.124 INFO:tasks.workunit.client.1.smithi176.stdout:2/120: dwrite d4/df/f22 [0,4194304] 0 2024-09-21T12:46:51.124 INFO:tasks.workunit.client.1.smithi176.stdout:9/154: creat d1/df/d1e/f37 x:0 0 0 2024-09-21T12:46:51.125 INFO:tasks.workunit.client.1.smithi176.stdout:2/121: dread - d4/f19 zero size 2024-09-21T12:46:51.126 INFO:tasks.workunit.client.1.smithi176.stdout:5/98: creat d0/d10/f23 x:0 0 0 2024-09-21T12:46:51.126 INFO:tasks.workunit.client.1.smithi176.stdout:2/122: readlink d4/ld 0 2024-09-21T12:46:51.127 INFO:tasks.workunit.client.1.smithi176.stdout:1/142: write d0/db/f22 [1783287,47291] 0 2024-09-21T12:46:51.127 INFO:tasks.workunit.client.1.smithi176.stdout:8/125: mknod d6/db/d13/c27 0 2024-09-21T12:46:51.127 INFO:tasks.workunit.client.1.smithi176.stdout:8/126: readlink l2 0 2024-09-21T12:46:51.128 INFO:tasks.workunit.client.1.smithi176.stdout:1/143: fsync d0/db/f19 0 2024-09-21T12:46:51.128 INFO:tasks.workunit.client.1.smithi176.stdout:8/127: chown d6/db/l20 31 1 2024-09-21T12:46:51.129 INFO:tasks.workunit.client.1.smithi176.stdout:3/138: creat d1/da/f2e x:0 0 0 2024-09-21T12:46:51.129 INFO:tasks.workunit.client.1.smithi176.stdout:7/174: truncate d0/d2/db/d10/f12 8258023 0 2024-09-21T12:46:51.129 INFO:tasks.workunit.client.1.smithi176.stdout:8/128: write d6/d16/f1d [115555,23407] 0 2024-09-21T12:46:51.130 INFO:tasks.workunit.client.1.smithi176.stdout:1/144: write d0/db/ff [3315943,58861] 0 2024-09-21T12:46:51.131 INFO:tasks.workunit.client.1.smithi176.stdout:5/99: stat d0/l1d 0 2024-09-21T12:46:51.131 INFO:tasks.workunit.client.1.smithi176.stdout:3/139: dread d1/d5/f6 [0,4194304] 0 2024-09-21T12:46:51.132 INFO:tasks.workunit.client.1.smithi176.stdout:3/140: fdatasync d1/da/f22 0 2024-09-21T12:46:51.132 INFO:tasks.workunit.client.1.smithi176.stdout:9/155: mkdir d1/df/d1e/d38 0 2024-09-21T12:46:51.133 INFO:tasks.workunit.client.1.smithi176.stdout:6/90: getdents d2/dd 0 2024-09-21T12:46:51.133 INFO:tasks.workunit.client.1.smithi176.stdout:9/156: dread - d1/df/d23/f24 zero size 2024-09-21T12:46:51.134 INFO:tasks.workunit.client.1.smithi176.stdout:2/123: symlink d4/df/l25 0 2024-09-21T12:46:51.134 INFO:tasks.workunit.client.1.smithi176.stdout:6/91: fsync d2/dd/de/f19 0 2024-09-21T12:46:51.135 INFO:tasks.workunit.client.1.smithi176.stdout:9/157: chown d1/df/d23/f15 57 1 2024-09-21T12:46:51.138 INFO:tasks.workunit.client.1.smithi176.stdout:9/158: write d1/f2f [4134232,46786] 0 2024-09-21T12:46:51.138 INFO:tasks.workunit.client.1.smithi176.stdout:2/124: creat d4/df/f26 x:0 0 0 2024-09-21T12:46:51.139 INFO:tasks.workunit.client.1.smithi176.stdout:7/175: symlink d0/d2/db/d10/d31/l3e 0 2024-09-21T12:46:51.140 INFO:tasks.workunit.client.1.smithi176.stdout:8/129: write d6/d16/f22 [493335,64446] 0 2024-09-21T12:46:51.141 INFO:tasks.workunit.client.1.smithi176.stdout:1/145: symlink d0/db/d2a/l32 0 2024-09-21T12:46:51.141 INFO:tasks.workunit.client.1.smithi176.stdout:2/125: readlink d4/df/l20 0 2024-09-21T12:46:51.142 INFO:tasks.workunit.client.1.smithi176.stdout:5/100: mknod d0/d10/c24 0 2024-09-21T12:46:51.143 INFO:tasks.workunit.client.1.smithi176.stdout:7/176: mknod d0/d2f/c3f 0 2024-09-21T12:46:51.143 INFO:tasks.workunit.client.1.smithi176.stdout:8/130: truncate d6/f1a 845839 0 2024-09-21T12:46:51.145 INFO:tasks.workunit.client.1.smithi176.stdout:5/101: dread - d0/d10/f23 zero size 2024-09-21T12:46:51.146 INFO:tasks.workunit.client.1.smithi176.stdout:3/141: creat d1/f2f x:0 0 0 2024-09-21T12:46:51.147 INFO:tasks.workunit.client.1.smithi176.stdout:8/131: chown d6/db/d13/f26 18 1 2024-09-21T12:46:51.147 INFO:tasks.workunit.client.1.smithi176.stdout:9/159: link d1/f5 d1/df/f39 0 2024-09-21T12:46:51.148 INFO:tasks.workunit.client.1.smithi176.stdout:5/102: chown d0/d10/c19 381 1 2024-09-21T12:46:51.151 INFO:tasks.workunit.client.1.smithi176.stdout:8/132: write d6/db/f17 [1831905,51731] 0 2024-09-21T12:46:51.152 INFO:tasks.workunit.client.1.smithi176.stdout:6/92: dread d2/f8 [0,4194304] 0 2024-09-21T12:46:51.152 INFO:tasks.workunit.client.1.smithi176.stdout:3/142: symlink d1/d5/d25/l30 0 2024-09-21T12:46:51.153 INFO:tasks.workunit.client.1.smithi176.stdout:1/146: dwrite d0/fc [0,4194304] 0 2024-09-21T12:46:51.153 INFO:tasks.workunit.client.1.smithi176.stdout:9/160: creat d1/df/d1c/f3a x:0 0 0 2024-09-21T12:46:51.155 INFO:tasks.workunit.client.1.smithi176.stdout:7/177: mknod d0/d2/db/d10/d3b/c40 0 2024-09-21T12:46:51.155 INFO:tasks.workunit.client.1.smithi176.stdout:6/93: stat d2/dd/de/f14 0 2024-09-21T12:46:51.158 INFO:tasks.workunit.client.1.smithi176.stdout:8/133: symlink d6/d8/l28 0 2024-09-21T12:46:51.158 INFO:tasks.workunit.client.1.smithi176.stdout:3/143: symlink d1/da/l31 0 2024-09-21T12:46:51.158 INFO:tasks.workunit.client.1.smithi176.stdout:1/147: mknod d0/db/c33 0 2024-09-21T12:46:51.165 INFO:tasks.workunit.client.1.smithi176.stdout:5/103: dwrite d0/d10/f23 [0,4194304] 0 2024-09-21T12:46:51.165 INFO:tasks.workunit.client.1.smithi176.stdout:1/148: symlink d0/db/d25/l34 0 2024-09-21T12:46:51.165 INFO:tasks.workunit.client.1.smithi176.stdout:6/94: symlink d2/dd/de/d10/d1b/l1e 0 2024-09-21T12:46:51.167 INFO:tasks.workunit.client.1.smithi176.stdout:3/144: creat d1/d5/d28/f32 x:0 0 0 2024-09-21T12:46:51.171 INFO:tasks.workunit.client.1.smithi176.stdout:5/104: mkdir d0/d10/d11/d25 0 2024-09-21T12:46:51.171 INFO:tasks.workunit.client.1.smithi176.stdout:1/149: rmdir d0/db/d25/d2b 39 2024-09-21T12:46:51.172 INFO:tasks.workunit.client.1.smithi176.stdout:9/161: dwrite d1/df/d23/f24 [0,4194304] 0 2024-09-21T12:46:51.172 INFO:tasks.workunit.client.1.smithi176.stdout:3/145: rename d1/c24 to d1/da/c33 0 2024-09-21T12:46:51.172 INFO:tasks.workunit.client.1.smithi176.stdout:7/178: write d0/f20 [231719,111069] 0 2024-09-21T12:46:51.173 INFO:tasks.workunit.client.1.smithi176.stdout:5/105: chown d0/l1d 19 1 2024-09-21T12:46:51.175 INFO:tasks.workunit.client.1.smithi176.stdout:9/162: dread - d1/f33 zero size 2024-09-21T12:46:51.175 INFO:tasks.workunit.client.1.smithi176.stdout:6/95: creat d2/dd/de/d10/f1f x:0 0 0 2024-09-21T12:46:51.175 INFO:tasks.workunit.client.1.smithi176.stdout:3/146: stat d1/d5/f14 0 2024-09-21T12:46:51.178 INFO:tasks.workunit.client.1.smithi176.stdout:1/150: creat d0/db/d25/d2b/f35 x:0 0 0 2024-09-21T12:46:51.179 INFO:tasks.workunit.client.1.smithi176.stdout:7/179: symlink d0/d2/db/d10/d23/l41 0 2024-09-21T12:46:51.180 INFO:tasks.workunit.client.1.smithi176.stdout:3/147: write d1/d5/d25/f2d [721849,58699] 0 2024-09-21T12:46:51.182 INFO:tasks.workunit.client.1.smithi176.stdout:0/108: sync 2024-09-21T12:46:51.182 INFO:tasks.workunit.client.1.smithi176.stdout:6/96: creat d2/f20 x:0 0 0 2024-09-21T12:46:51.183 INFO:tasks.workunit.client.1.smithi176.stdout:8/134: dwrite d6/fa [0,4194304] 0 2024-09-21T12:46:51.183 INFO:tasks.workunit.client.1.smithi176.stdout:9/163: rename d1/df/l29 to d1/df/d1e/d38/l3b 0 2024-09-21T12:46:51.184 INFO:tasks.workunit.client.1.smithi176.stdout:3/148: read d1/f1f [2662076,1447] 0 2024-09-21T12:46:51.186 INFO:tasks.workunit.client.1.smithi176.stdout:1/151: creat d0/db/d1a/f36 x:0 0 0 2024-09-21T12:46:51.188 INFO:tasks.workunit.client.1.smithi176.stdout:8/135: chown d6/db/d13/f19 9 1 2024-09-21T12:46:51.190 INFO:tasks.workunit.client.1.smithi176.stdout:5/106: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:51.190 INFO:tasks.workunit.client.1.smithi176.stdout:3/149: write d1/d5/d28/f32 [939007,123068] 0 2024-09-21T12:46:51.191 INFO:tasks.workunit.client.1.smithi176.stdout:8/136: readlink d6/d8/l12 0 2024-09-21T12:46:51.194 INFO:tasks.workunit.client.1.smithi176.stdout:3/150: fsync d1/da/f21 0 2024-09-21T12:46:51.195 INFO:tasks.workunit.client.1.smithi176.stdout:9/164: creat d1/df/d1c/f3c x:0 0 0 2024-09-21T12:46:51.195 INFO:tasks.workunit.client.1.smithi176.stdout:0/109: creat d9/dc/d1e/f2e x:0 0 0 2024-09-21T12:46:51.198 INFO:tasks.workunit.client.1.smithi176.stdout:1/152: getdents d0/db/d26 0 2024-09-21T12:46:51.199 INFO:tasks.workunit.client.1.smithi176.stdout:6/97: dwrite d2/f17 [0,4194304] 0 2024-09-21T12:46:51.201 INFO:tasks.workunit.client.1.smithi176.stdout:3/151: getdents d1/d5 0 2024-09-21T12:46:51.203 INFO:tasks.workunit.client.1.smithi176.stdout:3/152: fdatasync d1/f2f 0 2024-09-21T12:46:51.204 INFO:tasks.workunit.client.1.smithi176.stdout:0/110: truncate d9/d1a/d1d/d22/f2a 711027 0 2024-09-21T12:46:51.205 INFO:tasks.workunit.client.1.smithi176.stdout:5/107: dwrite d0/fd [8388608,4194304] 0 2024-09-21T12:46:51.210 INFO:tasks.workunit.client.1.smithi176.stdout:6/98: getdents d2/dd/de 0 2024-09-21T12:46:51.211 INFO:tasks.workunit.client.1.smithi176.stdout:7/180: write d0/d2/db/ff [3283025,79511] 0 2024-09-21T12:46:51.212 INFO:tasks.workunit.client.1.smithi176.stdout:9/165: getdents d1/df/d1c 0 2024-09-21T12:46:51.215 INFO:tasks.workunit.client.1.smithi176.stdout:8/137: truncate d6/f15 1226435 0 2024-09-21T12:46:51.216 INFO:tasks.workunit.client.1.smithi176.stdout:7/181: creat d0/d2/f42 x:0 0 0 2024-09-21T12:46:51.217 INFO:tasks.workunit.client.1.smithi176.stdout:1/153: dwrite d0/db/f22 [0,4194304] 0 2024-09-21T12:46:51.219 INFO:tasks.workunit.client.1.smithi176.stdout:6/99: rename d2/l6 to d2/dd/l21 0 2024-09-21T12:46:51.222 INFO:tasks.workunit.client.1.smithi176.stdout:9/166: creat d1/df/d1e/f3d x:0 0 0 2024-09-21T12:46:51.226 INFO:tasks.workunit.client.1.smithi176.stdout:3/153: dwrite d1/f4 [0,4194304] 0 2024-09-21T12:46:51.228 INFO:tasks.workunit.client.1.smithi176.stdout:9/167: unlink d1/df/d23/f15 0 2024-09-21T12:46:51.228 INFO:tasks.workunit.client.1.smithi176.stdout:0/111: dwrite d9/d1a/d20/f2d [0,4194304] 0 2024-09-21T12:46:51.229 INFO:tasks.workunit.client.1.smithi176.stdout:1/154: mkdir d0/db/d1a/d2c/d37 0 2024-09-21T12:46:51.233 INFO:tasks.workunit.client.1.smithi176.stdout:9/168: write d1/df/d23/f36 [950349,127157] 0 2024-09-21T12:46:51.234 INFO:tasks.workunit.client.1.smithi176.stdout:3/154: mkdir d1/d34 0 2024-09-21T12:46:51.235 INFO:tasks.workunit.client.1.smithi176.stdout:8/138: dwrite d6/db/d13/f19 [0,4194304] 0 2024-09-21T12:46:51.237 INFO:tasks.workunit.client.1.smithi176.stdout:1/155: creat d0/db/d1a/f38 x:0 0 0 2024-09-21T12:46:51.239 INFO:tasks.workunit.client.1.smithi176.stdout:0/112: mknod d9/d1a/d1d/d23/c2f 0 2024-09-21T12:46:51.241 INFO:tasks.workunit.client.1.smithi176.stdout:9/169: chown d1/c17 42870 1 2024-09-21T12:46:51.241 INFO:tasks.workunit.client.1.smithi176.stdout:0/113: read d9/dc/f13 [627955,80386] 0 2024-09-21T12:46:51.242 INFO:tasks.workunit.client.1.smithi176.stdout:0/114: dread - d9/f2b zero size 2024-09-21T12:46:51.244 INFO:tasks.workunit.client.1.smithi176.stdout:7/182: truncate d0/d2/db/d10/d23/f28 3471471 0 2024-09-21T12:46:51.244 INFO:tasks.workunit.client.1.smithi176.stdout:6/100: link d2/ca d2/dd/de/c22 0 2024-09-21T12:46:51.246 INFO:tasks.workunit.client.1.smithi176.stdout:6/101: readlink d2/l1d 0 2024-09-21T12:46:51.251 INFO:tasks.workunit.client.1.smithi176.stdout:1/156: dread d0/db/d1a/d2c/f2d [0,4194304] 0 2024-09-21T12:46:51.251 INFO:tasks.workunit.client.1.smithi176.stdout:9/170: dwrite d1/df/d23/f24 [0,4194304] 0 2024-09-21T12:46:51.252 INFO:tasks.workunit.client.1.smithi176.stdout:3/155: rename d1/d5/d28 to d1/d35 0 2024-09-21T12:46:51.252 INFO:tasks.workunit.client.1.smithi176.stdout:6/102: rmdir d2/dd/de 39 2024-09-21T12:46:51.254 INFO:tasks.workunit.client.1.smithi176.stdout:0/115: dwrite d9/f2b [0,4194304] 0 2024-09-21T12:46:51.255 INFO:tasks.workunit.client.1.smithi176.stdout:6/103: fdatasync d2/f20 0 2024-09-21T12:46:51.259 INFO:tasks.workunit.client.1.smithi176.stdout:0/116: creat d9/d1a/f30 x:0 0 0 2024-09-21T12:46:51.261 INFO:tasks.workunit.client.1.smithi176.stdout:9/171: symlink d1/l3e 0 2024-09-21T12:46:51.262 INFO:tasks.workunit.client.1.smithi176.stdout:3/156: dwrite d1/f1a [0,4194304] 0 2024-09-21T12:46:51.263 INFO:tasks.workunit.client.1.smithi176.stdout:0/117: mknod d9/d1b/c31 0 2024-09-21T12:46:51.263 INFO:tasks.workunit.client.1.smithi176.stdout:9/172: write d1/df/d23/f24 [2297969,33232] 0 2024-09-21T12:46:51.264 INFO:tasks.workunit.client.1.smithi176.stdout:6/104: symlink d2/l23 0 2024-09-21T12:46:51.268 INFO:tasks.workunit.client.1.smithi176.stdout:3/157: creat d1/d35/f36 x:0 0 0 2024-09-21T12:46:51.270 INFO:tasks.workunit.client.1.smithi176.stdout:6/105: dread d2/f8 [0,4194304] 0 2024-09-21T12:46:51.270 INFO:tasks.workunit.client.1.smithi176.stdout:9/173: fsync d1/f5 0 2024-09-21T12:46:51.272 INFO:tasks.workunit.client.1.smithi176.stdout:8/139: write d6/f15 [1855488,45319] 0 2024-09-21T12:46:51.274 INFO:tasks.workunit.client.1.smithi176.stdout:8/140: write d6/db/d13/f26 [560349,32265] 0 2024-09-21T12:46:51.275 INFO:tasks.workunit.client.1.smithi176.stdout:3/158: truncate d1/d5/f6 893585 0 2024-09-21T12:46:51.277 INFO:tasks.workunit.client.1.smithi176.stdout:9/174: symlink d1/l3f 0 2024-09-21T12:46:51.279 INFO:tasks.workunit.client.1.smithi176.stdout:3/159: rmdir d1/d5 39 2024-09-21T12:46:51.280 INFO:tasks.workunit.client.1.smithi176.stdout:9/175: read - d1/df/d1c/f3c zero size 2024-09-21T12:46:51.282 INFO:tasks.workunit.client.1.smithi176.stdout:3/160: truncate d1/d35/f2a 1515464 0 2024-09-21T12:46:51.283 INFO:tasks.workunit.client.1.smithi176.stdout:9/176: mkdir d1/df/d1e/d40 0 2024-09-21T12:46:51.283 INFO:tasks.workunit.client.1.smithi176.stdout:6/106: dread d2/dd/de/f14 [0,4194304] 0 2024-09-21T12:46:51.284 INFO:tasks.workunit.client.1.smithi176.stdout:6/107: chown d2/cc 2289 1 2024-09-21T12:46:51.284 INFO:tasks.workunit.client.1.smithi176.stdout:9/177: dread - d1/df/d23/f34 zero size 2024-09-21T12:46:51.284 INFO:tasks.workunit.client.1.smithi176.stdout:3/161: mkdir d1/d35/d37 0 2024-09-21T12:46:51.284 INFO:tasks.workunit.client.1.smithi176.stdout:8/141: dread d6/db/f17 [0,4194304] 0 2024-09-21T12:46:51.285 INFO:tasks.workunit.client.1.smithi176.stdout:6/108: chown d2/dd/l21 6540992 1 2024-09-21T12:46:51.285 INFO:tasks.workunit.client.1.smithi176.stdout:3/162: fsync d1/f18 0 2024-09-21T12:46:51.286 INFO:tasks.workunit.client.1.smithi176.stdout:9/178: creat d1/df/f41 x:0 0 0 2024-09-21T12:46:51.288 INFO:tasks.workunit.client.1.smithi176.stdout:8/142: creat d6/db/d13/f29 x:0 0 0 2024-09-21T12:46:51.288 INFO:tasks.workunit.client.1.smithi176.stdout:6/109: rename d2/cc to d2/dd/de/d10/c24 0 2024-09-21T12:46:51.290 INFO:tasks.workunit.client.1.smithi176.stdout:8/143: write d6/f1a [1703646,123663] 0 2024-09-21T12:46:51.290 INFO:tasks.workunit.client.1.smithi176.stdout:3/163: mkdir d1/d5/d25/d38 0 2024-09-21T12:46:51.290 INFO:tasks.workunit.client.1.smithi176.stdout:0/118: dread d9/f27 [0,4194304] 0 2024-09-21T12:46:51.291 INFO:tasks.workunit.client.1.smithi176.stdout:6/110: write d2/f8 [371198,53851] 0 2024-09-21T12:46:51.291 INFO:tasks.workunit.client.1.smithi176.stdout:9/179: rename d1/df/d1e/l1f to d1/df/d1c/l42 0 2024-09-21T12:46:51.293 INFO:tasks.workunit.client.1.smithi176.stdout:3/164: creat d1/f39 x:0 0 0 2024-09-21T12:46:51.294 INFO:tasks.workunit.client.1.smithi176.stdout:6/111: creat d2/dd/de/d10/f25 x:0 0 0 2024-09-21T12:46:51.294 INFO:tasks.workunit.client.1.smithi176.stdout:3/165: dread - d1/d5/d25/f26 zero size 2024-09-21T12:46:51.295 INFO:tasks.workunit.client.1.smithi176.stdout:0/119: truncate d9/d1a/d1d/d22/f24 32710 0 2024-09-21T12:46:51.296 INFO:tasks.workunit.client.1.smithi176.stdout:9/180: link d1/df/d1c/f3a d1/df/d1e/d38/f43 0 2024-09-21T12:46:51.296 INFO:tasks.workunit.client.1.smithi176.stdout:9/181: dread - d1/df/f41 zero size 2024-09-21T12:46:51.297 INFO:tasks.workunit.client.1.smithi176.stdout:0/120: fsync d9/f27 0 2024-09-21T12:46:51.298 INFO:tasks.workunit.client.1.smithi176.stdout:9/182: truncate d1/df/d1e/f37 645773 0 2024-09-21T12:46:51.298 INFO:tasks.workunit.client.1.smithi176.stdout:0/121: chown d9/d1a/d1d/d22/f2a 1997 1 2024-09-21T12:46:51.298 INFO:tasks.workunit.client.1.smithi176.stdout:6/112: mkdir d2/dd/d26 0 2024-09-21T12:46:51.299 INFO:tasks.workunit.client.1.smithi176.stdout:3/166: mknod d1/d34/c3a 0 2024-09-21T12:46:51.299 INFO:tasks.workunit.client.1.smithi176.stdout:0/122: chown d9/dc/d1e 10 1 2024-09-21T12:46:51.299 INFO:tasks.workunit.client.1.smithi176.stdout:0/123: stat d9/f27 0 2024-09-21T12:46:51.300 INFO:tasks.workunit.client.1.smithi176.stdout:3/167: dread - d1/da/f21 zero size 2024-09-21T12:46:51.300 INFO:tasks.workunit.client.1.smithi176.stdout:0/124: stat d9/d1a/d20 0 2024-09-21T12:46:51.300 INFO:tasks.workunit.client.1.smithi176.stdout:6/113: symlink d2/dd/d26/l27 0 2024-09-21T12:46:51.301 INFO:tasks.workunit.client.1.smithi176.stdout:3/168: chown d1/d5/c20 7 1 2024-09-21T12:46:51.301 INFO:tasks.workunit.client.1.smithi176.stdout:9/183: getdents d1 0 2024-09-21T12:46:51.302 INFO:tasks.workunit.client.1.smithi176.stdout:0/125: creat d9/d1a/d1d/d23/f32 x:0 0 0 2024-09-21T12:46:51.303 INFO:tasks.workunit.client.1.smithi176.stdout:6/114: truncate d2/dd/de/d10/f25 585661 0 2024-09-21T12:46:51.303 INFO:tasks.workunit.client.1.smithi176.stdout:3/169: rename d1/f4 to d1/d5/f3b 0 2024-09-21T12:46:51.304 INFO:tasks.workunit.client.1.smithi176.stdout:0/126: symlink d9/d1a/l33 0 2024-09-21T12:46:51.305 INFO:tasks.workunit.client.1.smithi176.stdout:6/115: symlink d2/dd/de/l28 0 2024-09-21T12:46:51.305 INFO:tasks.workunit.client.1.smithi176.stdout:0/127: write d9/d1a/f30 [118443,25866] 0 2024-09-21T12:46:51.306 INFO:tasks.workunit.client.1.smithi176.stdout:6/116: dread - d2/dd/de/d10/f1f zero size 2024-09-21T12:46:51.308 INFO:tasks.workunit.client.1.smithi176.stdout:3/170: dread d1/d5/f3b [0,4194304] 0 2024-09-21T12:46:51.309 INFO:tasks.workunit.client.1.smithi176.stdout:3/171: chown d1/d34/c3a 0 1 2024-09-21T12:46:51.310 INFO:tasks.workunit.client.1.smithi176.stdout:6/117: creat d2/dd/de/d10/d1b/f29 x:0 0 0 2024-09-21T12:46:51.311 INFO:tasks.workunit.client.1.smithi176.stdout:3/172: read d1/da/f2c [2574191,93006] 0 2024-09-21T12:46:51.311 INFO:tasks.workunit.client.1.smithi176.stdout:0/128: dread d9/d1a/d20/f2d [0,4194304] 0 2024-09-21T12:46:51.314 INFO:tasks.workunit.client.1.smithi176.stdout:6/118: dread d2/f8 [0,4194304] 0 2024-09-21T12:46:51.314 INFO:tasks.workunit.client.1.smithi176.stdout:3/173: rename d1/f1f to d1/d5/d25/f3c 0 2024-09-21T12:46:51.316 INFO:tasks.workunit.client.1.smithi176.stdout:3/174: chown d1/da/f22 60 1 2024-09-21T12:46:51.316 INFO:tasks.workunit.client.1.smithi176.stdout:6/119: rmdir d2/dd/d26 39 2024-09-21T12:46:51.319 INFO:tasks.workunit.client.1.smithi176.stdout:0/129: dwrite d9/d1a/d1d/f26 [0,4194304] 0 2024-09-21T12:46:51.319 INFO:tasks.workunit.client.1.smithi176.stdout:6/120: rmdir d2/dd/de 39 2024-09-21T12:46:51.320 INFO:tasks.workunit.client.1.smithi176.stdout:3/175: symlink d1/d5/d25/d38/l3d 0 2024-09-21T12:46:51.322 INFO:tasks.workunit.client.1.smithi176.stdout:4/155: sync 2024-09-21T12:46:51.454 INFO:tasks.workunit.client.1.smithi176.stdout:6/121: rename d2/dd/de/d10/f25 to d2/dd/de/d10/d1b/f2a 0 2024-09-21T12:46:51.455 INFO:tasks.workunit.client.1.smithi176.stdout:6/122: fdatasync d2/dd/f11 0 2024-09-21T12:46:51.455 INFO:tasks.workunit.client.1.smithi176.stdout:0/130: unlink d9/d1a/d1d/d22/f29 0 2024-09-21T12:46:51.458 INFO:tasks.workunit.client.1.smithi176.stdout:4/156: dread d3/f12 [0,4194304] 0 2024-09-21T12:46:51.461 INFO:tasks.workunit.client.1.smithi176.stdout:4/157: creat d3/d21/d27/d2c/f39 x:0 0 0 2024-09-21T12:46:51.462 INFO:tasks.workunit.client.1.smithi176.stdout:4/158: dread - d3/d5/db/f33 zero size 2024-09-21T12:46:51.463 INFO:tasks.workunit.client.1.smithi176.stdout:4/159: fsync d3/d5/f13 0 2024-09-21T12:46:51.466 INFO:tasks.workunit.client.1.smithi176.stdout:4/160: mkdir d3/d5/db/d36/d3a 0 2024-09-21T12:46:51.468 INFO:tasks.workunit.client.1.smithi176.stdout:4/161: mknod d3/d5/db/d36/d3a/c3b 0 2024-09-21T12:46:51.470 INFO:tasks.workunit.client.1.smithi176.stdout:4/162: creat d3/f3c x:0 0 0 2024-09-21T12:46:51.470 INFO:tasks.workunit.client.1.smithi176.stdout:2/126: sync 2024-09-21T12:46:51.471 INFO:tasks.workunit.client.1.smithi176.stdout:2/127: chown d4/df 558 1 2024-09-21T12:46:51.471 INFO:tasks.workunit.client.1.smithi176.stdout:2/128: chown d4/l17 945928973 1 2024-09-21T12:46:51.471 INFO:tasks.workunit.client.1.smithi176.stdout:2/129: read f2 [2731572,45092] 0 2024-09-21T12:46:51.473 INFO:tasks.workunit.client.1.smithi176.stdout:2/130: mknod d4/df/c27 0 2024-09-21T12:46:51.474 INFO:tasks.workunit.client.1.smithi176.stdout:2/131: creat d4/f28 x:0 0 0 2024-09-21T12:46:51.477 INFO:tasks.workunit.client.1.smithi176.stdout:2/132: link d4/ca d4/df/c29 0 2024-09-21T12:46:51.531 INFO:tasks.workunit.client.1.smithi176.stdout:6/123: rename d2/dd/de to d2/dd/d26/d2b 0 2024-09-21T12:46:51.533 INFO:tasks.workunit.client.1.smithi176.stdout:6/124: fsync d2/dd/d26/d2b/f14 0 2024-09-21T12:46:51.535 INFO:tasks.workunit.client.1.smithi176.stdout:6/125: mknod d2/dd/d26/d2b/c2c 0 2024-09-21T12:46:51.536 INFO:tasks.workunit.client.1.smithi176.stdout:4/163: rename d3/d5/db/c2b to d3/c3d 0 2024-09-21T12:46:51.540 INFO:tasks.workunit.client.1.smithi176.stdout:6/126: creat d2/dd/f2d x:0 0 0 2024-09-21T12:46:51.540 INFO:tasks.workunit.client.1.smithi176.stdout:4/164: symlink d3/d21/d27/d2f/l3e 0 2024-09-21T12:46:51.541 INFO:tasks.workunit.client.1.smithi176.stdout:6/127: write d2/f17 [8173417,129672] 0 2024-09-21T12:46:51.543 INFO:tasks.workunit.client.1.smithi176.stdout:4/165: mknod d3/d5/c3f 0 2024-09-21T12:46:51.544 INFO:tasks.workunit.client.1.smithi176.stdout:4/166: readlink d3/d5/db/l23 0 2024-09-21T12:46:51.545 INFO:tasks.workunit.client.1.smithi176.stdout:4/167: fdatasync d3/d5/f15 0 2024-09-21T12:46:51.545 INFO:tasks.workunit.client.1.smithi176.stdout:6/128: rename d2/dd/d26/d2b/d10/d1b/f29 to d2/dd/d26/d2b/f2e 0 2024-09-21T12:46:51.548 INFO:tasks.workunit.client.1.smithi176.stdout:4/168: rename d3/d21/d27/f2d to d3/d21/d27/f40 0 2024-09-21T12:46:51.549 INFO:tasks.workunit.client.1.smithi176.stdout:7/183: sync 2024-09-21T12:46:51.549 INFO:tasks.workunit.client.1.smithi176.stdout:5/108: sync 2024-09-21T12:46:51.549 INFO:tasks.workunit.client.1.smithi176.stdout:6/129: unlink d2/dd/d26/d2b/d10/c24 0 2024-09-21T12:46:51.550 INFO:tasks.workunit.client.1.smithi176.stdout:7/184: chown d0/d2/db/d10/d23 1636232 1 2024-09-21T12:46:51.552 INFO:tasks.workunit.client.1.smithi176.stdout:5/109: creat d0/d13/f26 x:0 0 0 2024-09-21T12:46:51.552 INFO:tasks.workunit.client.1.smithi176.stdout:7/185: write d0/f33 [722576,46123] 0 2024-09-21T12:46:51.553 INFO:tasks.workunit.client.1.smithi176.stdout:4/169: unlink d3/d5/db/d36/d3a/c3b 0 2024-09-21T12:46:51.554 INFO:tasks.workunit.client.1.smithi176.stdout:6/130: creat d2/dd/d26/d2b/d10/f2f x:0 0 0 2024-09-21T12:46:51.555 INFO:tasks.workunit.client.1.smithi176.stdout:5/110: creat d0/f27 x:0 0 0 2024-09-21T12:46:51.556 INFO:tasks.workunit.client.1.smithi176.stdout:6/131: readlink d2/l1d 0 2024-09-21T12:46:51.557 INFO:tasks.workunit.client.1.smithi176.stdout:4/170: creat d3/d21/d27/d2c/f41 x:0 0 0 2024-09-21T12:46:51.558 INFO:tasks.workunit.client.1.smithi176.stdout:5/111: mknod d0/c28 0 2024-09-21T12:46:51.561 INFO:tasks.workunit.client.1.smithi176.stdout:6/132: rename d2/l1d to d2/dd/d26/d2b/l30 0 2024-09-21T12:46:51.562 INFO:tasks.workunit.client.1.smithi176.stdout:7/186: dwrite d0/d2/db/d10/f22 [0,4194304] 0 2024-09-21T12:46:51.566 INFO:tasks.workunit.client.1.smithi176.stdout:7/187: mkdir d0/d2f/d43 0 2024-09-21T12:46:51.570 INFO:tasks.workunit.client.1.smithi176.stdout:5/112: dwrite d0/fd [0,4194304] 0 2024-09-21T12:46:51.572 INFO:tasks.workunit.client.1.smithi176.stdout:5/113: fdatasync d0/ff 0 2024-09-21T12:46:51.577 INFO:tasks.workunit.client.1.smithi176.stdout:6/133: dwrite d2/dd/d26/d2b/d10/d1b/f2a [0,4194304] 0 2024-09-21T12:46:51.579 INFO:tasks.workunit.client.1.smithi176.stdout:7/188: dread d0/d2/db/fe [0,4194304] 0 2024-09-21T12:46:51.580 INFO:tasks.workunit.client.1.smithi176.stdout:6/134: write d2/dd/d26/d2b/d10/d1b/f2a [353221,38319] 0 2024-09-21T12:46:51.581 INFO:tasks.workunit.client.1.smithi176.stdout:5/114: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:51.582 INFO:tasks.workunit.client.1.smithi176.stdout:5/115: chown d0/d10/c19 274962 1 2024-09-21T12:46:51.586 INFO:tasks.workunit.client.1.smithi176.stdout:7/189: creat d0/d2/d30/f44 x:0 0 0 2024-09-21T12:46:51.590 INFO:tasks.workunit.client.1.smithi176.stdout:7/190: dread - d0/f17 zero size 2024-09-21T12:46:51.591 INFO:tasks.workunit.client.1.smithi176.stdout:7/191: chown d0/d2/f35 579605163 1 2024-09-21T12:46:51.592 INFO:tasks.workunit.client.1.smithi176.stdout:6/135: rename d2/dd/d26/d2b/d10/f13 to d2/f31 0 2024-09-21T12:46:51.593 INFO:tasks.workunit.client.1.smithi176.stdout:6/136: dread - d2/dd/d26/d2b/d10/f1f zero size 2024-09-21T12:46:51.596 INFO:tasks.workunit.client.1.smithi176.stdout:7/192: mkdir d0/d2f/d43/d45 0 2024-09-21T12:46:51.600 INFO:tasks.workunit.client.1.smithi176.stdout:6/137: link d2/dd/d26/l27 d2/dd/d26/l32 0 2024-09-21T12:46:51.600 INFO:tasks.workunit.client.1.smithi176.stdout:5/116: dread d0/ff [0,4194304] 0 2024-09-21T12:46:51.601 INFO:tasks.workunit.client.1.smithi176.stdout:6/138: dread - d2/dd/f2d zero size 2024-09-21T12:46:51.602 INFO:tasks.workunit.client.1.smithi176.stdout:5/117: write d0/d10/d11/f21 [352368,25689] 0 2024-09-21T12:46:51.603 INFO:tasks.workunit.client.1.smithi176.stdout:7/193: dread d0/d2/db/d25/f38 [0,4194304] 0 2024-09-21T12:46:51.604 INFO:tasks.workunit.client.1.smithi176.stdout:6/139: unlink d2/f17 0 2024-09-21T12:46:51.605 INFO:tasks.workunit.client.1.smithi176.stdout:7/194: write d0/d2/db/d25/f38 [2351186,19778] 0 2024-09-21T12:46:51.606 INFO:tasks.workunit.client.1.smithi176.stdout:7/195: chown d0/f20 71 1 2024-09-21T12:46:51.607 INFO:tasks.workunit.client.1.smithi176.stdout:6/140: symlink d2/dd/d26/d2b/d10/l33 0 2024-09-21T12:46:51.610 INFO:tasks.workunit.client.1.smithi176.stdout:6/141: creat d2/f34 x:0 0 0 2024-09-21T12:46:51.610 INFO:tasks.workunit.client.1.smithi176.stdout:6/142: stat d2/dd/d26/d2b/d10/l1c 0 2024-09-21T12:46:51.611 INFO:tasks.workunit.client.1.smithi176.stdout:6/143: read - d2/dd/d26/d2b/f19 zero size 2024-09-21T12:46:51.615 INFO:tasks.workunit.client.1.smithi176.stdout:6/144: truncate d2/dd/d26/d2b/f14 3353261 0 2024-09-21T12:46:51.616 INFO:tasks.workunit.client.1.smithi176.stdout:6/145: fsync d2/f20 0 2024-09-21T12:46:51.619 INFO:tasks.workunit.client.1.smithi176.stdout:7/196: dread d0/d2/db/f14 [0,4194304] 0 2024-09-21T12:46:51.620 INFO:tasks.workunit.client.1.smithi176.stdout:7/197: stat d0/d2/db/ff 0 2024-09-21T12:46:51.622 INFO:tasks.workunit.client.1.smithi176.stdout:6/146: dwrite d2/f20 [0,4194304] 0 2024-09-21T12:46:51.625 INFO:tasks.workunit.client.1.smithi176.stdout:6/147: symlink d2/dd/d26/l35 0 2024-09-21T12:46:51.626 INFO:tasks.workunit.client.1.smithi176.stdout:6/148: read d2/f31 [6778055,88268] 0 2024-09-21T12:46:51.627 INFO:tasks.workunit.client.1.smithi176.stdout:7/198: dread d0/d2/db/fd [0,4194304] 0 2024-09-21T12:46:51.629 INFO:tasks.workunit.client.1.smithi176.stdout:7/199: write d0/d2/db/d25/f38 [4370278,104826] 0 2024-09-21T12:46:51.632 INFO:tasks.workunit.client.1.smithi176.stdout:7/200: unlink d0/d2/db/d10/d23/l41 0 2024-09-21T12:46:51.634 INFO:tasks.workunit.client.1.smithi176.stdout:7/201: creat d0/d2f/d43/f46 x:0 0 0 2024-09-21T12:46:51.634 INFO:tasks.workunit.client.1.smithi176.stdout:7/202: dread - d0/f17 zero size 2024-09-21T12:46:51.637 INFO:tasks.workunit.client.1.smithi176.stdout:7/203: creat d0/d2f/d43/d45/f47 x:0 0 0 2024-09-21T12:46:51.638 INFO:tasks.workunit.client.1.smithi176.stdout:6/149: write d2/dd/d26/d2b/f14 [3416135,74499] 0 2024-09-21T12:46:51.638 INFO:tasks.workunit.client.1.smithi176.stdout:7/204: read d0/d2/db/d10/f2c [3321179,45940] 0 2024-09-21T12:46:51.639 INFO:tasks.workunit.client.1.smithi176.stdout:6/150: write d2/dd/d26/d2b/d10/f12 [996077,13036] 0 2024-09-21T12:46:51.640 INFO:tasks.workunit.client.1.smithi176.stdout:7/205: symlink d0/d2/l48 0 2024-09-21T12:46:51.641 INFO:tasks.workunit.client.1.smithi176.stdout:7/206: truncate d0/d2f/d43/d45/f47 758155 0 2024-09-21T12:46:51.642 INFO:tasks.workunit.client.1.smithi176.stdout:6/151: symlink d2/dd/d26/d2b/l36 0 2024-09-21T12:46:51.643 INFO:tasks.workunit.client.1.smithi176.stdout:7/207: mknod d0/d2f/d43/c49 0 2024-09-21T12:46:51.644 INFO:tasks.workunit.client.1.smithi176.stdout:1/157: sync 2024-09-21T12:46:51.644 INFO:tasks.workunit.client.1.smithi176.stdout:2/133: sync 2024-09-21T12:46:51.644 INFO:tasks.workunit.client.1.smithi176.stdout:0/131: sync 2024-09-21T12:46:51.644 INFO:tasks.workunit.client.1.smithi176.stdout:9/184: sync 2024-09-21T12:46:51.644 INFO:tasks.workunit.client.1.smithi176.stdout:3/176: sync 2024-09-21T12:46:51.644 INFO:tasks.workunit.client.1.smithi176.stdout:8/144: sync 2024-09-21T12:46:51.645 INFO:tasks.workunit.client.1.smithi176.stdout:6/152: mkdir d2/dd/d26/d2b/d10/d1b/d37 0 2024-09-21T12:46:51.645 INFO:tasks.workunit.client.1.smithi176.stdout:8/145: fdatasync d6/d8/f10 0 2024-09-21T12:46:51.646 INFO:tasks.workunit.client.1.smithi176.stdout:1/158: write d0/db/d1a/f21 [945779,85809] 0 2024-09-21T12:46:51.646 INFO:tasks.workunit.client.1.smithi176.stdout:3/177: rmdir d1 39 2024-09-21T12:46:51.647 INFO:tasks.workunit.client.1.smithi176.stdout:8/146: chown d6/d16/f1e 85466 1 2024-09-21T12:46:51.647 INFO:tasks.workunit.client.1.smithi176.stdout:0/132: symlink d9/d1b/l34 0 2024-09-21T12:46:51.648 INFO:tasks.workunit.client.1.smithi176.stdout:8/147: write d6/d16/f1d [197297,59944] 0 2024-09-21T12:46:51.648 INFO:tasks.workunit.client.1.smithi176.stdout:2/134: creat d4/df/f2a x:0 0 0 2024-09-21T12:46:51.649 INFO:tasks.workunit.client.1.smithi176.stdout:8/148: stat d6/db/d13/f19 0 2024-09-21T12:46:51.650 INFO:tasks.workunit.client.1.smithi176.stdout:2/135: dread - d4/df/f2a zero size 2024-09-21T12:46:51.651 INFO:tasks.workunit.client.1.smithi176.stdout:6/153: creat d2/dd/d26/f38 x:0 0 0 2024-09-21T12:46:51.653 INFO:tasks.workunit.client.1.smithi176.stdout:0/133: dread d9/f2b [0,4194304] 0 2024-09-21T12:46:51.654 INFO:tasks.workunit.client.1.smithi176.stdout:3/178: read d1/d5/d25/f2d [290529,94348] 0 2024-09-21T12:46:51.655 INFO:tasks.workunit.client.1.smithi176.stdout:9/185: mknod d1/df/d1e/d40/c44 0 2024-09-21T12:46:51.657 INFO:tasks.workunit.client.1.smithi176.stdout:6/154: rmdir d2 39 2024-09-21T12:46:51.657 INFO:tasks.workunit.client.1.smithi176.stdout:8/149: dwrite d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:51.658 INFO:tasks.workunit.client.1.smithi176.stdout:9/186: dread - d1/df/d1e/d38/f43 zero size 2024-09-21T12:46:51.660 INFO:tasks.workunit.client.1.smithi176.stdout:8/150: write d6/d16/f1d [1156779,9657] 0 2024-09-21T12:46:51.661 INFO:tasks.workunit.client.1.smithi176.stdout:7/208: write d0/d2/db/d10/d23/f2e [7454833,2351] 0 2024-09-21T12:46:51.662 INFO:tasks.workunit.client.1.smithi176.stdout:8/151: write d6/d8/f10 [838958,25046] 0 2024-09-21T12:46:51.667 INFO:tasks.workunit.client.1.smithi176.stdout:7/209: truncate d0/f20 355883 0 2024-09-21T12:46:51.667 INFO:tasks.workunit.client.1.smithi176.stdout:3/179: dwrite d1/f18 [0,4194304] 0 2024-09-21T12:46:51.667 INFO:tasks.workunit.client.1.smithi176.stdout:0/134: mkdir d9/d35 0 2024-09-21T12:46:51.668 INFO:tasks.workunit.client.1.smithi176.stdout:6/155: write d2/dd/d26/f38 [711313,39379] 0 2024-09-21T12:46:51.668 INFO:tasks.workunit.client.1.smithi176.stdout:8/152: rmdir d6/d8 39 2024-09-21T12:46:51.669 INFO:tasks.workunit.client.1.smithi176.stdout:1/159: getdents d0/db/d1a/d2c 0 2024-09-21T12:46:51.671 INFO:tasks.workunit.client.1.smithi176.stdout:2/136: getdents d4/df 0 2024-09-21T12:46:51.671 INFO:tasks.workunit.client.1.smithi176.stdout:7/210: readlink d0/l1f 0 2024-09-21T12:46:51.673 INFO:tasks.workunit.client.1.smithi176.stdout:6/156: mkdir d2/dd/d26/d2b/d10/d39 0 2024-09-21T12:46:51.674 INFO:tasks.workunit.client.1.smithi176.stdout:1/160: write d0/db/d1a/f20 [973026,84195] 0 2024-09-21T12:46:51.674 INFO:tasks.workunit.client.1.smithi176.stdout:7/211: chown d0/d2/db/d10/f22 56216 1 2024-09-21T12:46:51.674 INFO:tasks.workunit.client.1.smithi176.stdout:2/137: mkdir d4/d2b 0 2024-09-21T12:46:51.675 INFO:tasks.workunit.client.1.smithi176.stdout:3/180: mkdir d1/d3e 0 2024-09-21T12:46:51.677 INFO:tasks.workunit.client.1.smithi176.stdout:6/157: symlink d2/dd/d26/l3a 0 2024-09-21T12:46:51.678 INFO:tasks.workunit.client.1.smithi176.stdout:0/135: link d9/ce d9/d35/c36 0 2024-09-21T12:46:51.679 INFO:tasks.workunit.client.1.smithi176.stdout:0/136: chown d9/f14 29544 1 2024-09-21T12:46:51.679 INFO:tasks.workunit.client.1.smithi176.stdout:8/153: link d6/d8/f10 d6/d8/f2a 0 2024-09-21T12:46:51.680 INFO:tasks.workunit.client.1.smithi176.stdout:2/138: creat d4/d2b/f2c x:0 0 0 2024-09-21T12:46:51.681 INFO:tasks.workunit.client.1.smithi176.stdout:3/181: creat d1/d5/d25/d38/f3f x:0 0 0 2024-09-21T12:46:51.681 INFO:tasks.workunit.client.1.smithi176.stdout:1/161: creat d0/db/d25/d2b/d31/f39 x:0 0 0 2024-09-21T12:46:51.682 INFO:tasks.workunit.client.1.smithi176.stdout:6/158: creat d2/dd/d26/d2b/f3b x:0 0 0 2024-09-21T12:46:51.686 INFO:tasks.workunit.client.1.smithi176.stdout:9/187: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:51.687 INFO:tasks.workunit.client.1.smithi176.stdout:3/182: mkdir d1/d5/d25/d40 0 2024-09-21T12:46:51.688 INFO:tasks.workunit.client.1.smithi176.stdout:1/162: creat d0/db/d25/d2b/f3a x:0 0 0 2024-09-21T12:46:51.690 INFO:tasks.workunit.client.1.smithi176.stdout:9/188: dread - d1/df/d1e/f21 zero size 2024-09-21T12:46:51.690 INFO:tasks.workunit.client.1.smithi176.stdout:3/183: rmdir d1/da 39 2024-09-21T12:46:51.692 INFO:tasks.workunit.client.1.smithi176.stdout:6/159: creat d2/dd/d26/d2b/d10/d1b/d37/f3c x:0 0 0 2024-09-21T12:46:51.693 INFO:tasks.workunit.client.1.smithi176.stdout:8/154: dread d6/db/d13/f19 [0,4194304] 0 2024-09-21T12:46:51.693 INFO:tasks.workunit.client.1.smithi176.stdout:7/212: truncate d0/d2/f35 1338546 0 2024-09-21T12:46:51.694 INFO:tasks.workunit.client.1.smithi176.stdout:0/137: dwrite d9/dc/f15 [0,4194304] 0 2024-09-21T12:46:51.694 INFO:tasks.workunit.client.1.smithi176.stdout:2/139: dread d4/df/f15 [0,4194304] 0 2024-09-21T12:46:51.695 INFO:tasks.workunit.client.1.smithi176.stdout:9/189: write d1/df/f12 [3664207,8924] 0 2024-09-21T12:46:51.695 INFO:tasks.workunit.client.1.smithi176.stdout:6/160: fdatasync d2/dd/d26/d2b/d10/f1f 0 2024-09-21T12:46:51.696 INFO:tasks.workunit.client.1.smithi176.stdout:3/184: rmdir d1/d34 39 2024-09-21T12:46:51.696 INFO:tasks.workunit.client.1.smithi176.stdout:8/155: chown d6/db/f17 41 1 2024-09-21T12:46:51.697 INFO:tasks.workunit.client.1.smithi176.stdout:2/140: readlink d4/df/l16 0 2024-09-21T12:46:51.698 INFO:tasks.workunit.client.1.smithi176.stdout:1/163: rename d0/db/f1e to d0/db/d25/d2b/f3b 0 2024-09-21T12:46:51.700 INFO:tasks.workunit.client.1.smithi176.stdout:9/190: dread - d1/df/d1e/f3d zero size 2024-09-21T12:46:51.700 INFO:tasks.workunit.client.1.smithi176.stdout:3/185: write d1/d5/f14 [3543304,57215] 0 2024-09-21T12:46:51.700 INFO:tasks.workunit.client.1.smithi176.stdout:2/141: mkdir d4/d2b/d2d 0 2024-09-21T12:46:51.701 INFO:tasks.workunit.client.1.smithi176.stdout:7/213: dread d0/f16 [0,4194304] 0 2024-09-21T12:46:51.703 INFO:tasks.workunit.client.1.smithi176.stdout:6/161: write d2/dd/d26/d2b/d10/f2f [799619,108554] 0 2024-09-21T12:46:51.703 INFO:tasks.workunit.client.1.smithi176.stdout:1/164: write d0/fa [2970918,17763] 0 2024-09-21T12:46:51.703 INFO:tasks.workunit.client.1.smithi176.stdout:8/156: rename d6/d16/f25 to d6/d8/d24/f2b 0 2024-09-21T12:46:51.703 INFO:tasks.workunit.client.1.smithi176.stdout:2/142: chown d4/l17 14928 1 2024-09-21T12:46:51.704 INFO:tasks.workunit.client.1.smithi176.stdout:3/186: write d1/f39 [363220,103713] 0 2024-09-21T12:46:51.705 INFO:tasks.workunit.client.1.smithi176.stdout:9/191: rmdir d1/df/d1e/d38 39 2024-09-21T12:46:51.708 INFO:tasks.workunit.client.1.smithi176.stdout:7/214: write d0/d2/d30/f44 [832927,4597] 0 2024-09-21T12:46:51.708 INFO:tasks.workunit.client.1.smithi176.stdout:2/143: write d4/fe [384472,41473] 0 2024-09-21T12:46:51.709 INFO:tasks.workunit.client.1.smithi176.stdout:1/165: creat d0/f3c x:0 0 0 2024-09-21T12:46:51.710 INFO:tasks.workunit.client.1.smithi176.stdout:9/192: read - d1/df/d23/f34 zero size 2024-09-21T12:46:51.710 INFO:tasks.workunit.client.1.smithi176.stdout:8/157: write d6/d16/f22 [9189334,48797] 0 2024-09-21T12:46:51.711 INFO:tasks.workunit.client.1.smithi176.stdout:2/144: readlink d4/l18 0 2024-09-21T12:46:51.713 INFO:tasks.workunit.client.1.smithi176.stdout:0/138: dread d9/d1a/d20/f2d [0,4194304] 0 2024-09-21T12:46:51.716 INFO:tasks.workunit.client.1.smithi176.stdout:3/187: dread d1/d5/f6 [0,4194304] 0 2024-09-21T12:46:51.718 INFO:tasks.workunit.client.1.smithi176.stdout:6/162: truncate d2/f8 2356019 0 2024-09-21T12:46:51.720 INFO:tasks.workunit.client.1.smithi176.stdout:0/139: symlink d9/d1a/l37 0 2024-09-21T12:46:51.721 INFO:tasks.workunit.client.1.smithi176.stdout:1/166: dread d0/db/f19 [0,4194304] 0 2024-09-21T12:46:51.723 INFO:tasks.workunit.client.1.smithi176.stdout:0/140: fdatasync d9/f17 0 2024-09-21T12:46:51.725 INFO:tasks.workunit.client.1.smithi176.stdout:3/188: creat d1/d3e/f41 x:0 0 0 2024-09-21T12:46:51.730 INFO:tasks.workunit.client.1.smithi176.stdout:3/189: mkdir d1/d34/d42 0 2024-09-21T12:46:51.732 INFO:tasks.workunit.client.1.smithi176.stdout:9/193: dwrite d1/f33 [0,4194304] 0 2024-09-21T12:46:51.734 INFO:tasks.workunit.client.1.smithi176.stdout:2/145: dwrite d4/f28 [0,4194304] 0 2024-09-21T12:46:51.734 INFO:tasks.workunit.client.1.smithi176.stdout:7/215: dwrite d0/d2/db/d10/d23/f2e [4194304,4194304] 0 2024-09-21T12:46:51.735 INFO:tasks.workunit.client.1.smithi176.stdout:0/141: getdents d9/d1a/d20 0 2024-09-21T12:46:51.735 INFO:tasks.workunit.client.1.smithi176.stdout:6/163: truncate d2/dd/d26/d2b/d10/f2f 1097203 0 2024-09-21T12:46:51.736 INFO:tasks.workunit.client.1.smithi176.stdout:3/190: write d1/d5/d25/d38/f3f [222385,33557] 0 2024-09-21T12:46:51.736 INFO:tasks.workunit.client.1.smithi176.stdout:1/167: rename d0/db/d25/d2b/d31/f39 to d0/f3d 0 2024-09-21T12:46:51.737 INFO:tasks.workunit.client.1.smithi176.stdout:8/158: dread d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:51.737 INFO:tasks.workunit.client.1.smithi176.stdout:7/216: fdatasync d0/d2/f42 0 2024-09-21T12:46:51.739 INFO:tasks.workunit.client.1.smithi176.stdout:9/194: creat d1/df/d23/f45 x:0 0 0 2024-09-21T12:46:51.740 INFO:tasks.workunit.client.1.smithi176.stdout:0/142: creat d9/dc/f38 x:0 0 0 2024-09-21T12:46:51.740 INFO:tasks.workunit.client.1.smithi176.stdout:3/191: write d1/f1c [492182,61665] 0 2024-09-21T12:46:51.741 INFO:tasks.workunit.client.1.smithi176.stdout:2/146: truncate d4/df/f1c 882298 0 2024-09-21T12:46:51.742 INFO:tasks.workunit.client.1.smithi176.stdout:2/147: chown d4/df/f1c 0 1 2024-09-21T12:46:51.742 INFO:tasks.workunit.client.1.smithi176.stdout:3/192: truncate d1/d35/f36 597678 0 2024-09-21T12:46:51.743 INFO:tasks.workunit.client.1.smithi176.stdout:8/159: creat d6/db/f2c x:0 0 0 2024-09-21T12:46:51.744 INFO:tasks.workunit.client.1.smithi176.stdout:7/217: creat d0/d2f/d43/d45/f4a x:0 0 0 2024-09-21T12:46:51.745 INFO:tasks.workunit.client.1.smithi176.stdout:8/160: fdatasync d6/db/d13/f29 0 2024-09-21T12:46:51.747 INFO:tasks.workunit.client.1.smithi176.stdout:1/168: rename d0/ld to d0/db/d1a/l3e 0 2024-09-21T12:46:51.749 INFO:tasks.workunit.client.1.smithi176.stdout:2/148: mkdir d4/df/d2e 0 2024-09-21T12:46:51.750 INFO:tasks.workunit.client.1.smithi176.stdout:6/164: dread d2/dd/d26/d2b/d10/f2f [0,4194304] 0 2024-09-21T12:46:51.753 INFO:tasks.workunit.client.1.smithi176.stdout:2/149: rmdir d4/d2b 39 2024-09-21T12:46:51.755 INFO:tasks.workunit.client.1.smithi176.stdout:7/218: symlink d0/l4b 0 2024-09-21T12:46:51.756 INFO:tasks.workunit.client.1.smithi176.stdout:0/143: dwrite f5 [4194304,4194304] 0 2024-09-21T12:46:51.757 INFO:tasks.workunit.client.1.smithi176.stdout:8/161: link d6/db/f2c d6/d16/f2d 0 2024-09-21T12:46:51.758 INFO:tasks.workunit.client.1.smithi176.stdout:3/193: dwrite d1/d5/fc [0,4194304] 0 2024-09-21T12:46:51.761 INFO:tasks.workunit.client.1.smithi176.stdout:9/195: write d1/df/d1c/f3a [1047104,87860] 0 2024-09-21T12:46:51.762 INFO:tasks.workunit.client.1.smithi176.stdout:2/150: mknod d4/df/d2e/c2f 0 2024-09-21T12:46:51.767 INFO:tasks.workunit.client.1.smithi176.stdout:2/151: stat d4/f1a 0 2024-09-21T12:46:51.767 INFO:tasks.workunit.client.1.smithi176.stdout:0/144: truncate d9/d1a/f30 994146 0 2024-09-21T12:46:51.768 INFO:tasks.workunit.client.1.smithi176.stdout:3/194: chown d1/d5/l23 181 1 2024-09-21T12:46:51.771 INFO:tasks.workunit.client.1.smithi176.stdout:9/196: creat d1/df/f46 x:0 0 0 2024-09-21T12:46:51.771 INFO:tasks.workunit.client.1.smithi176.stdout:8/162: dread d6/f15 [0,4194304] 0 2024-09-21T12:46:51.771 INFO:tasks.workunit.client.1.smithi176.stdout:1/169: dwrite d0/db/f1b [0,4194304] 0 2024-09-21T12:46:51.772 INFO:tasks.workunit.client.1.smithi176.stdout:3/195: mknod d1/d35/c43 0 2024-09-21T12:46:51.772 INFO:tasks.workunit.client.1.smithi176.stdout:4/171: sync 2024-09-21T12:46:51.773 INFO:tasks.workunit.client.1.smithi176.stdout:5/118: sync 2024-09-21T12:46:51.773 INFO:tasks.workunit.client.1.smithi176.stdout:2/152: write d4/df/f2a [904348,29043] 0 2024-09-21T12:46:51.776 INFO:tasks.workunit.client.1.smithi176.stdout:8/163: chown d6/d16/f22 9199622 1 2024-09-21T12:46:51.776 INFO:tasks.workunit.client.1.smithi176.stdout:7/219: truncate d0/d2/db/d10/f2c 4522922 0 2024-09-21T12:46:51.776 INFO:tasks.workunit.client.1.smithi176.stdout:1/170: chown d0/f13 964 1 2024-09-21T12:46:51.776 INFO:tasks.workunit.client.1.smithi176.stdout:3/196: write d1/d35/f32 [1431037,66252] 0 2024-09-21T12:46:51.777 INFO:tasks.workunit.client.1.smithi176.stdout:4/172: mkdir d3/d42 0 2024-09-21T12:46:51.779 INFO:tasks.workunit.client.1.smithi176.stdout:7/220: chown d0/d2/db/d25 2540066 1 2024-09-21T12:46:51.779 INFO:tasks.workunit.client.1.smithi176.stdout:6/165: dwrite d2/f31 [0,4194304] 0 2024-09-21T12:46:51.783 INFO:tasks.workunit.client.1.smithi176.stdout:9/197: rename d1/df/l30 to d1/df/d1e/d38/l47 0 2024-09-21T12:46:51.783 INFO:tasks.workunit.client.1.smithi176.stdout:1/171: write d0/db/d25/d2b/f35 [520727,48454] 0 2024-09-21T12:46:51.784 INFO:tasks.workunit.client.1.smithi176.stdout:0/145: dwrite f5 [0,4194304] 0 2024-09-21T12:46:51.784 INFO:tasks.workunit.client.1.smithi176.stdout:8/164: creat d6/d8/f2e x:0 0 0 2024-09-21T12:46:51.787 INFO:tasks.workunit.client.1.smithi176.stdout:3/197: creat d1/da/f44 x:0 0 0 2024-09-21T12:46:51.789 INFO:tasks.workunit.client.1.smithi176.stdout:1/172: write d0/f3 [1379199,115796] 0 2024-09-21T12:46:51.789 INFO:tasks.workunit.client.1.smithi176.stdout:5/119: link d0/d10/d11/f21 d0/d13/f29 0 2024-09-21T12:46:51.791 INFO:tasks.workunit.client.1.smithi176.stdout:6/166: creat d2/dd/d26/f3d x:0 0 0 2024-09-21T12:46:51.792 INFO:tasks.workunit.client.1.smithi176.stdout:7/221: symlink d0/d2/db/d10/d23/l4c 0 2024-09-21T12:46:51.795 INFO:tasks.workunit.client.1.smithi176.stdout:9/198: rmdir d1/df/d1e/d38 39 2024-09-21T12:46:51.795 INFO:tasks.workunit.client.1.smithi176.stdout:0/146: rename d9/l25 to d9/d35/l39 0 2024-09-21T12:46:51.795 INFO:tasks.workunit.client.1.smithi176.stdout:7/222: dread - d0/d2f/d43/f46 zero size 2024-09-21T12:46:51.796 INFO:tasks.workunit.client.1.smithi176.stdout:3/198: symlink d1/d5/d25/d38/l45 0 2024-09-21T12:46:51.799 INFO:tasks.workunit.client.1.smithi176.stdout:4/173: write d3/d5/f1c [1099129,67203] 0 2024-09-21T12:46:51.800 INFO:tasks.workunit.client.1.smithi176.stdout:8/165: rename d6/d8/l28 to d6/d16/l2f 0 2024-09-21T12:46:51.801 INFO:tasks.workunit.client.1.smithi176.stdout:6/167: rename d2/dd/d26/d2b/d10/d1b to d2/dd/d26/d2b/d10/d1b/d3e 22 2024-09-21T12:46:51.802 INFO:tasks.workunit.client.1.smithi176.stdout:9/199: mkdir d1/df/d48 0 2024-09-21T12:46:51.803 INFO:tasks.workunit.client.1.smithi176.stdout:6/168: stat d2/dd/d26/f38 0 2024-09-21T12:46:51.803 INFO:tasks.workunit.client.1.smithi176.stdout:3/199: dwrite d1/fe [4194304,4194304] 0 2024-09-21T12:46:51.803 INFO:tasks.workunit.client.1.smithi176.stdout:7/223: mkdir d0/d2/d4d 0 2024-09-21T12:46:51.807 INFO:tasks.workunit.client.1.smithi176.stdout:4/174: creat d3/d5/db/d36/f43 x:0 0 0 2024-09-21T12:46:51.807 INFO:tasks.workunit.client.1.smithi176.stdout:9/200: dread d1/fd [0,4194304] 0 2024-09-21T12:46:51.808 INFO:tasks.workunit.client.1.smithi176.stdout:9/201: fsync d1/df/d1e/f27 0 2024-09-21T12:46:51.808 INFO:tasks.workunit.client.1.smithi176.stdout:4/175: chown d3/d5/db/l23 378 1 2024-09-21T12:46:51.809 INFO:tasks.workunit.client.1.smithi176.stdout:4/176: dread - d3/d21/d27/d2c/f39 zero size 2024-09-21T12:46:51.812 INFO:tasks.workunit.client.1.smithi176.stdout:6/169: mknod d2/dd/d26/d2b/d10/d1b/c3f 0 2024-09-21T12:46:51.813 INFO:tasks.workunit.client.1.smithi176.stdout:7/224: symlink d0/d2f/d43/l4e 0 2024-09-21T12:46:51.816 INFO:tasks.workunit.client.1.smithi176.stdout:1/173: rmdir d0/db/d25/d2b/d30 0 2024-09-21T12:46:51.817 INFO:tasks.workunit.client.1.smithi176.stdout:5/120: link d0/d10/d11/c1f d0/d13/c2a 0 2024-09-21T12:46:51.819 INFO:tasks.workunit.client.1.smithi176.stdout:9/202: creat d1/df/d1c/f49 x:0 0 0 2024-09-21T12:46:51.820 INFO:tasks.workunit.client.1.smithi176.stdout:8/166: dwrite d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:51.820 INFO:tasks.workunit.client.1.smithi176.stdout:4/177: creat d3/d5/f44 x:0 0 0 2024-09-21T12:46:51.822 INFO:tasks.workunit.client.1.smithi176.stdout:9/203: dread - d1/df/d1e/f21 zero size 2024-09-21T12:46:51.823 INFO:tasks.workunit.client.1.smithi176.stdout:2/153: truncate d4/df/f15 2204568 0 2024-09-21T12:46:51.824 INFO:tasks.workunit.client.1.smithi176.stdout:3/200: dwrite d1/da/f2c [0,4194304] 0 2024-09-21T12:46:51.825 INFO:tasks.workunit.client.1.smithi176.stdout:5/121: rmdir d0 39 2024-09-21T12:46:51.826 INFO:tasks.workunit.client.1.smithi176.stdout:2/154: dread - d4/f19 zero size 2024-09-21T12:46:51.827 INFO:tasks.workunit.client.1.smithi176.stdout:8/167: mknod d6/d16/c30 0 2024-09-21T12:46:51.828 INFO:tasks.workunit.client.1.smithi176.stdout:4/178: fsync d3/d21/f29 0 2024-09-21T12:46:51.829 INFO:tasks.workunit.client.1.smithi176.stdout:9/204: write d1/df/d1e/f3d [444596,66597] 0 2024-09-21T12:46:51.829 INFO:tasks.workunit.client.1.smithi176.stdout:6/170: mknod d2/dd/c40 0 2024-09-21T12:46:51.832 INFO:tasks.workunit.client.1.smithi176.stdout:4/179: fdatasync d3/d5/db/f33 0 2024-09-21T12:46:51.834 INFO:tasks.workunit.client.1.smithi176.stdout:5/122: chown d0/f27 1904 1 2024-09-21T12:46:51.834 INFO:tasks.workunit.client.1.smithi176.stdout:3/201: rename d1/d35/f2a to d1/d5/d25/d38/f46 0 2024-09-21T12:46:51.835 INFO:tasks.workunit.client.1.smithi176.stdout:6/171: dread - d2/dd/d26/d2b/f19 zero size 2024-09-21T12:46:51.837 INFO:tasks.workunit.client.1.smithi176.stdout:8/168: creat d6/db/d13/f31 x:0 0 0 2024-09-21T12:46:51.838 INFO:tasks.workunit.client.1.smithi176.stdout:0/147: write d9/d1a/d1d/d22/f24 [711189,9164] 0 2024-09-21T12:46:51.841 INFO:tasks.workunit.client.1.smithi176.stdout:4/180: write d3/d5/f13 [249126,77480] 0 2024-09-21T12:46:51.842 INFO:tasks.workunit.client.1.smithi176.stdout:1/174: getdents d0/db/d2a 0 2024-09-21T12:46:51.843 INFO:tasks.workunit.client.1.smithi176.stdout:7/225: dwrite d0/d2/db/fe [0,4194304] 0 2024-09-21T12:46:51.844 INFO:tasks.workunit.client.1.smithi176.stdout:6/172: dread - d2/dd/d26/d2b/f2e zero size 2024-09-21T12:46:51.847 INFO:tasks.workunit.client.1.smithi176.stdout:2/155: dwrite d4/df/f2a [0,4194304] 0 2024-09-21T12:46:51.847 INFO:tasks.workunit.client.1.smithi176.stdout:9/205: dwrite d1/df/f46 [0,4194304] 0 2024-09-21T12:46:51.847 INFO:tasks.workunit.client.1.smithi176.stdout:6/173: write d2/f34 [1030581,51874] 0 2024-09-21T12:46:51.850 INFO:tasks.workunit.client.1.smithi176.stdout:2/156: write d4/df/f26 [535053,30396] 0 2024-09-21T12:46:51.854 INFO:tasks.workunit.client.1.smithi176.stdout:2/157: chown c3 46 1 2024-09-21T12:46:51.854 INFO:tasks.workunit.client.1.smithi176.stdout:6/174: chown d2/dd/d26/d2b/d10/d1b/d37 571702 1 2024-09-21T12:46:51.855 INFO:tasks.workunit.client.1.smithi176.stdout:2/158: fsync d4/f1a 0 2024-09-21T12:46:51.857 INFO:tasks.workunit.client.1.smithi176.stdout:4/181: dwrite d3/d5/f25 [0,4194304] 0 2024-09-21T12:46:51.875 INFO:tasks.workunit.client.1.smithi176.stdout:9/206: dread d1/f2f [0,4194304] 0 2024-09-21T12:46:51.880 INFO:tasks.workunit.client.1.smithi176.stdout:9/207: dwrite d1/df/f12 [0,4194304] 0 2024-09-21T12:46:51.881 INFO:tasks.workunit.client.1.smithi176.stdout:9/208: write d1/df/d1c/f3a [532287,3507] 0 2024-09-21T12:46:51.933 INFO:tasks.workunit.client.1.smithi176.stdout:8/169: mkdir d6/db/d32 0 2024-09-21T12:46:51.938 INFO:tasks.workunit.client.1.smithi176.stdout:3/202: rename d1/d35/c43 to d1/d5/c47 0 2024-09-21T12:46:51.941 INFO:tasks.workunit.client.1.smithi176.stdout:0/148: unlink d9/d1a/d1d/d23/l2c 0 2024-09-21T12:46:51.946 INFO:tasks.workunit.client.1.smithi176.stdout:7/226: unlink d0/l4b 0 2024-09-21T12:46:51.958 INFO:tasks.workunit.client.1.smithi176.stdout:2/159: dwrite d4/d2b/f2c [0,4194304] 0 2024-09-21T12:46:51.959 INFO:tasks.workunit.client.1.smithi176.stdout:2/160: fsync f2 0 2024-09-21T12:46:51.960 INFO:tasks.workunit.client.1.smithi176.stdout:6/175: dwrite d2/dd/d26/d2b/f2e [0,4194304] 0 2024-09-21T12:46:51.964 INFO:tasks.workunit.client.1.smithi176.stdout:3/203: mkdir d1/d34/d48 0 2024-09-21T12:46:51.964 INFO:tasks.workunit.client.1.smithi176.stdout:1/175: rename d0/db/d25/l34 to d0/db/d1a/d2c/d37/l3f 0 2024-09-21T12:46:51.967 INFO:tasks.workunit.client.1.smithi176.stdout:0/149: mkdir d9/d1a/d3a 0 2024-09-21T12:46:51.969 INFO:tasks.workunit.client.1.smithi176.stdout:7/227: creat d0/d2/f4f x:0 0 0 2024-09-21T12:46:51.970 INFO:tasks.workunit.client.1.smithi176.stdout:5/123: link d0/f18 d0/d10/f2b 0 2024-09-21T12:46:51.973 INFO:tasks.workunit.client.1.smithi176.stdout:1/176: dread d0/db/d25/d2b/f35 [0,4194304] 0 2024-09-21T12:46:51.974 INFO:tasks.workunit.client.1.smithi176.stdout:5/124: dread d0/f18 [0,4194304] 0 2024-09-21T12:46:51.974 INFO:tasks.workunit.client.1.smithi176.stdout:9/209: rename d1/df/d23/f34 to d1/df/d48/f4a 0 2024-09-21T12:46:51.975 INFO:tasks.workunit.client.1.smithi176.stdout:3/204: dwrite d1/da/f2c [0,4194304] 0 2024-09-21T12:46:51.977 INFO:tasks.workunit.client.1.smithi176.stdout:9/210: fsync d1/df/d1e/f21 0 2024-09-21T12:46:51.978 INFO:tasks.workunit.client.1.smithi176.stdout:9/211: chown d1/df/d1e 158105849 1 2024-09-21T12:46:51.980 INFO:tasks.workunit.client.1.smithi176.stdout:0/150: dwrite d9/d1a/d1d/d23/f32 [0,4194304] 0 2024-09-21T12:46:51.986 INFO:tasks.workunit.client.1.smithi176.stdout:4/182: getdents d3 0 2024-09-21T12:46:51.988 INFO:tasks.workunit.client.1.smithi176.stdout:1/177: symlink d0/db/d25/d2b/d31/l40 0 2024-09-21T12:46:51.990 INFO:tasks.workunit.client.1.smithi176.stdout:5/125: creat d0/d10/d11/f2c x:0 0 0 2024-09-21T12:46:51.993 INFO:tasks.workunit.client.1.smithi176.stdout:3/205: creat d1/d5/d25/d38/f49 x:0 0 0 2024-09-21T12:46:51.995 INFO:tasks.workunit.client.1.smithi176.stdout:0/151: creat d9/d1a/d1d/d22/f3b x:0 0 0 2024-09-21T12:46:51.997 INFO:tasks.workunit.client.1.smithi176.stdout:8/170: dwrite d6/db/f2c [0,4194304] 0 2024-09-21T12:46:51.997 INFO:tasks.workunit.client.1.smithi176.stdout:5/126: unlink d0/fd 0 2024-09-21T12:46:51.997 INFO:tasks.workunit.client.1.smithi176.stdout:8/171: dread - d6/d8/f2e zero size 2024-09-21T12:46:51.998 INFO:tasks.workunit.client.1.smithi176.stdout:6/176: getdents d2/dd 0 2024-09-21T12:46:51.999 INFO:tasks.workunit.client.1.smithi176.stdout:8/172: dread - d6/d8/f2e zero size 2024-09-21T12:46:51.999 INFO:tasks.workunit.client.1.smithi176.stdout:9/212: creat d1/df/d1e/d38/f4b x:0 0 0 2024-09-21T12:46:52.000 INFO:tasks.workunit.client.1.smithi176.stdout:8/173: readlink d6/db/ld 0 2024-09-21T12:46:52.001 INFO:tasks.workunit.client.1.smithi176.stdout:0/152: mknod d9/d1a/d20/c3c 0 2024-09-21T12:46:52.003 INFO:tasks.workunit.client.1.smithi176.stdout:1/178: rename d0/db/d26 to d0/db/d25/d41 0 2024-09-21T12:46:52.005 INFO:tasks.workunit.client.1.smithi176.stdout:6/177: mknod d2/dd/d26/c41 0 2024-09-21T12:46:52.007 INFO:tasks.workunit.client.1.smithi176.stdout:0/153: symlink d9/d1a/d20/l3d 0 2024-09-21T12:46:52.009 INFO:tasks.workunit.client.1.smithi176.stdout:3/206: dwrite d1/d5/d25/d38/f46 [0,4194304] 0 2024-09-21T12:46:52.011 INFO:tasks.workunit.client.1.smithi176.stdout:9/213: rename d1/df/d1c/l2d to d1/l4c 0 2024-09-21T12:46:52.012 INFO:tasks.workunit.client.1.smithi176.stdout:0/154: read d9/f17 [250420,17103] 0 2024-09-21T12:46:52.014 INFO:tasks.workunit.client.1.smithi176.stdout:6/178: mkdir d2/dd/d26/d2b/d42 0 2024-09-21T12:46:52.015 INFO:tasks.workunit.client.1.smithi176.stdout:0/155: write f5 [3953229,5742] 0 2024-09-21T12:46:52.018 INFO:tasks.workunit.client.1.smithi176.stdout:7/228: write d0/d2/f35 [2256848,98392] 0 2024-09-21T12:46:52.018 INFO:tasks.workunit.client.1.smithi176.stdout:1/179: dwrite d0/f2 [4194304,4194304] 0 2024-09-21T12:46:52.019 INFO:tasks.workunit.client.1.smithi176.stdout:3/207: mknod d1/d34/d48/c4a 0 2024-09-21T12:46:52.021 INFO:tasks.workunit.client.1.smithi176.stdout:6/179: symlink d2/dd/d26/d2b/d10/l43 0 2024-09-21T12:46:52.021 INFO:tasks.workunit.client.1.smithi176.stdout:0/156: mknod d9/d1a/d20/c3e 0 2024-09-21T12:46:52.024 INFO:tasks.workunit.client.1.smithi176.stdout:9/214: chown d1/df/d1e/f27 1575 1 2024-09-21T12:46:52.024 INFO:tasks.workunit.client.1.smithi176.stdout:7/229: creat d0/d2/db/d10/d31/f50 x:0 0 0 2024-09-21T12:46:52.024 INFO:tasks.workunit.client.1.smithi176.stdout:3/208: symlink d1/d3e/l4b 0 2024-09-21T12:46:52.027 INFO:tasks.workunit.client.1.smithi176.stdout:9/215: dread - d1/df/d1c/f49 zero size 2024-09-21T12:46:52.027 INFO:tasks.workunit.client.1.smithi176.stdout:0/157: rmdir d9/d1a/d3a 0 2024-09-21T12:46:52.031 INFO:tasks.workunit.client.1.smithi176.stdout:8/174: truncate d6/d16/f1d 1044346 0 2024-09-21T12:46:52.032 INFO:tasks.workunit.client.1.smithi176.stdout:0/158: mkdir d9/d1a/d3f 0 2024-09-21T12:46:52.032 INFO:tasks.workunit.client.1.smithi176.stdout:1/180: dwrite d0/db/d25/d41/f2f [0,4194304] 0 2024-09-21T12:46:52.033 INFO:tasks.workunit.client.1.smithi176.stdout:8/175: readlink d6/db/l1b 0 2024-09-21T12:46:52.036 INFO:tasks.workunit.client.1.smithi176.stdout:9/216: mkdir d1/df/d1e/d4d 0 2024-09-21T12:46:52.037 INFO:tasks.workunit.client.1.smithi176.stdout:8/176: creat d6/d8/f33 x:0 0 0 2024-09-21T12:46:52.039 INFO:tasks.workunit.client.1.smithi176.stdout:1/181: write d0/db/f15 [552562,27005] 0 2024-09-21T12:46:52.039 INFO:tasks.workunit.client.1.smithi176.stdout:6/180: dwrite d2/dd/d26/d2b/d10/f1f [0,4194304] 0 2024-09-21T12:46:52.041 INFO:tasks.workunit.client.1.smithi176.stdout:0/159: mkdir d9/d1a/d3f/d40 0 2024-09-21T12:46:52.042 INFO:tasks.workunit.client.1.smithi176.stdout:9/217: mknod d1/c4e 0 2024-09-21T12:46:52.045 INFO:tasks.workunit.client.1.smithi176.stdout:1/182: mknod d0/db/c42 0 2024-09-21T12:46:52.045 INFO:tasks.workunit.client.1.smithi176.stdout:8/177: dread d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:52.046 INFO:tasks.workunit.client.1.smithi176.stdout:7/230: dread d0/d2/f1e [0,4194304] 0 2024-09-21T12:46:52.047 INFO:tasks.workunit.client.1.smithi176.stdout:6/181: symlink d2/dd/d26/l44 0 2024-09-21T12:46:52.047 INFO:tasks.workunit.client.1.smithi176.stdout:7/231: chown d0/d2/db/fe 1 1 2024-09-21T12:46:52.048 INFO:tasks.workunit.client.1.smithi176.stdout:6/182: fsync d2/dd/d26/d2b/f3b 0 2024-09-21T12:46:52.048 INFO:tasks.workunit.client.1.smithi176.stdout:0/160: mknod d9/dc/d1e/c41 0 2024-09-21T12:46:52.050 INFO:tasks.workunit.client.1.smithi176.stdout:1/183: mkdir d0/db/d25/d2b/d43 0 2024-09-21T12:46:52.051 INFO:tasks.workunit.client.1.smithi176.stdout:0/161: fsync d9/dc/d1e/f2e 0 2024-09-21T12:46:52.051 INFO:tasks.workunit.client.1.smithi176.stdout:8/178: mknod d6/db/c34 0 2024-09-21T12:46:52.056 INFO:tasks.workunit.client.1.smithi176.stdout:0/162: creat d9/dc/d1e/f42 x:0 0 0 2024-09-21T12:46:52.057 INFO:tasks.workunit.client.1.smithi176.stdout:3/209: dwrite d1/d5/d25/f3c [0,4194304] 0 2024-09-21T12:46:52.058 INFO:tasks.workunit.client.1.smithi176.stdout:8/179: mkdir d6/d8/d24/d35 0 2024-09-21T12:46:52.060 INFO:tasks.workunit.client.1.smithi176.stdout:6/183: dwrite d2/dd/d26/f3d [0,4194304] 0 2024-09-21T12:46:52.060 INFO:tasks.workunit.client.1.smithi176.stdout:9/218: mkdir d1/df/d1e/d4f 0 2024-09-21T12:46:52.066 INFO:tasks.workunit.client.1.smithi176.stdout:0/163: mkdir d9/d1b/d43 0 2024-09-21T12:46:52.070 INFO:tasks.workunit.client.1.smithi176.stdout:3/210: symlink d1/d34/d42/l4c 0 2024-09-21T12:46:52.071 INFO:tasks.workunit.client.1.smithi176.stdout:0/164: creat d9/d1a/d1d/d23/f44 x:0 0 0 2024-09-21T12:46:52.071 INFO:tasks.workunit.client.1.smithi176.stdout:7/232: write d0/d2/db/d10/f2c [2336751,129775] 0 2024-09-21T12:46:52.072 INFO:tasks.workunit.client.1.smithi176.stdout:1/184: write d0/db/d25/d2b/f3b [222531,126714] 0 2024-09-21T12:46:52.075 INFO:tasks.workunit.client.1.smithi176.stdout:8/180: dwrite d6/d16/f22 [4194304,4194304] 0 2024-09-21T12:46:52.076 INFO:tasks.workunit.client.1.smithi176.stdout:1/185: readlink d0/db/d25/d2b/l2e 0 2024-09-21T12:46:52.079 INFO:tasks.workunit.client.1.smithi176.stdout:0/165: creat d9/f45 x:0 0 0 2024-09-21T12:46:52.079 INFO:tasks.workunit.client.1.smithi176.stdout:1/186: dread - d0/f3c zero size 2024-09-21T12:46:52.079 INFO:tasks.workunit.client.1.smithi176.stdout:6/184: dwrite d2/f31 [0,4194304] 0 2024-09-21T12:46:52.080 INFO:tasks.workunit.client.1.smithi176.stdout:1/187: truncate d0/f3c 1010430 0 2024-09-21T12:46:52.084 INFO:tasks.workunit.client.1.smithi176.stdout:7/233: getdents d0/d2f 0 2024-09-21T12:46:52.085 INFO:tasks.workunit.client.1.smithi176.stdout:1/188: write d0/db/d25/d2b/f3b [1612091,21277] 0 2024-09-21T12:46:52.087 INFO:tasks.workunit.client.1.smithi176.stdout:0/166: getdents d9/d1a 0 2024-09-21T12:46:52.088 INFO:tasks.workunit.client.1.smithi176.stdout:7/234: rmdir d0/d2 39 2024-09-21T12:46:52.092 INFO:tasks.workunit.client.1.smithi176.stdout:1/189: creat d0/db/d25/d2b/f44 x:0 0 0 2024-09-21T12:46:52.092 INFO:tasks.workunit.client.1.smithi176.stdout:8/181: dwrite d6/db/d13/f19 [0,4194304] 0 2024-09-21T12:46:52.094 INFO:tasks.workunit.client.1.smithi176.stdout:0/167: symlink d9/l46 0 2024-09-21T12:46:52.095 INFO:tasks.workunit.client.1.smithi176.stdout:6/185: dwrite d2/dd/f2d [0,4194304] 0 2024-09-21T12:46:52.096 INFO:tasks.workunit.client.1.smithi176.stdout:3/211: truncate d1/d5/d25/f3c 1246971 0 2024-09-21T12:46:52.096 INFO:tasks.workunit.client.1.smithi176.stdout:8/182: write d6/d16/f22 [3729901,14070] 0 2024-09-21T12:46:52.097 INFO:tasks.workunit.client.1.smithi176.stdout:1/190: creat d0/db/d1a/d2c/d37/f45 x:0 0 0 2024-09-21T12:46:52.097 INFO:tasks.workunit.client.1.smithi176.stdout:7/235: truncate d0/d2/f42 190821 0 2024-09-21T12:46:52.098 INFO:tasks.workunit.client.1.smithi176.stdout:0/168: stat d9/d1a/d20/c21 0 2024-09-21T12:46:52.099 INFO:tasks.workunit.client.1.smithi176.stdout:3/212: write d1/da/f21 [1006113,40369] 0 2024-09-21T12:46:52.099 INFO:tasks.workunit.client.1.smithi176.stdout:1/191: chown d0/db/f15 2 1 2024-09-21T12:46:52.101 INFO:tasks.workunit.client.1.smithi176.stdout:6/186: unlink d2/dd/f2d 0 2024-09-21T12:46:52.101 INFO:tasks.workunit.client.1.smithi176.stdout:8/183: rmdir d6/d8 39 2024-09-21T12:46:52.104 INFO:tasks.workunit.client.1.smithi176.stdout:0/169: dread d9/dc/f15 [0,4194304] 0 2024-09-21T12:46:52.104 INFO:tasks.workunit.client.1.smithi176.stdout:7/236: rmdir d0/d2f/d43 39 2024-09-21T12:46:52.105 INFO:tasks.workunit.client.1.smithi176.stdout:0/170: fdatasync d9/d1a/d1d/d22/f3b 0 2024-09-21T12:46:52.106 INFO:tasks.workunit.client.1.smithi176.stdout:3/213: fdatasync d1/d5/f3b 0 2024-09-21T12:46:52.108 INFO:tasks.workunit.client.1.smithi176.stdout:1/192: mknod d0/db/d1a/d2c/c46 0 2024-09-21T12:46:52.109 INFO:tasks.workunit.client.1.smithi176.stdout:3/214: read d1/f1c [1758946,82458] 0 2024-09-21T12:46:52.113 INFO:tasks.workunit.client.1.smithi176.stdout:0/171: write d9/dc/f15 [3206571,14787] 0 2024-09-21T12:46:52.115 INFO:tasks.workunit.client.1.smithi176.stdout:1/193: mknod d0/db/d25/d41/c47 0 2024-09-21T12:46:52.116 INFO:tasks.workunit.client.1.smithi176.stdout:8/184: rmdir d6/d8/d24 39 2024-09-21T12:46:52.118 INFO:tasks.workunit.client.1.smithi176.stdout:7/237: mkdir d0/d2/d4d/d51 0 2024-09-21T12:46:52.119 INFO:tasks.workunit.client.1.smithi176.stdout:7/238: fdatasync d0/d2/db/d10/f12 0 2024-09-21T12:46:52.119 INFO:tasks.workunit.client.1.smithi176.stdout:0/172: mkdir d9/dc/d1e/d47 0 2024-09-21T12:46:52.120 INFO:tasks.workunit.client.1.smithi176.stdout:8/185: rmdir d6/db 39 2024-09-21T12:46:52.121 INFO:tasks.workunit.client.1.smithi176.stdout:2/161: sync 2024-09-21T12:46:52.123 INFO:tasks.workunit.client.1.smithi176.stdout:8/186: dread d6/d16/f1e [0,4194304] 0 2024-09-21T12:46:52.125 INFO:tasks.workunit.client.1.smithi176.stdout:3/215: dread d1/da/fb [0,4194304] 0 2024-09-21T12:46:52.126 INFO:tasks.workunit.client.1.smithi176.stdout:1/194: getdents d0 0 2024-09-21T12:46:52.126 INFO:tasks.workunit.client.1.smithi176.stdout:6/187: link d2/dd/f11 d2/dd/d26/d2b/d10/d39/f45 0 2024-09-21T12:46:52.127 INFO:tasks.workunit.client.1.smithi176.stdout:0/173: link l6 d9/d1a/d3f/l48 0 2024-09-21T12:46:52.128 INFO:tasks.workunit.client.1.smithi176.stdout:6/188: write d2/dd/d26/d2b/d10/d1b/d37/f3c [795107,27477] 0 2024-09-21T12:46:52.128 INFO:tasks.workunit.client.1.smithi176.stdout:0/174: chown d9/f45 3937 1 2024-09-21T12:46:52.129 INFO:tasks.workunit.client.1.smithi176.stdout:6/189: fdatasync d2/dd/d26/d2b/f2e 0 2024-09-21T12:46:52.129 INFO:tasks.workunit.client.1.smithi176.stdout:8/187: mkdir d6/d16/d36 0 2024-09-21T12:46:52.130 INFO:tasks.workunit.client.1.smithi176.stdout:3/216: mknod d1/d3e/c4d 0 2024-09-21T12:46:52.132 INFO:tasks.workunit.client.1.smithi176.stdout:7/239: link d0/d2f/d43/d45/f47 d0/d2f/d43/f52 0 2024-09-21T12:46:52.132 INFO:tasks.workunit.client.1.smithi176.stdout:0/175: rmdir d9 39 2024-09-21T12:46:52.134 INFO:tasks.workunit.client.1.smithi176.stdout:0/176: write f5 [6450202,59587] 0 2024-09-21T12:46:52.135 INFO:tasks.workunit.client.1.smithi176.stdout:8/188: write d6/db/f2c [180868,112102] 0 2024-09-21T12:46:52.137 INFO:tasks.workunit.client.1.smithi176.stdout:2/162: link d4/l11 d4/l30 0 2024-09-21T12:46:52.139 INFO:tasks.workunit.client.1.smithi176.stdout:1/195: mkdir d0/db/d1a/d2c/d48 0 2024-09-21T12:46:52.139 INFO:tasks.workunit.client.1.smithi176.stdout:8/189: mkdir d6/db/d37 0 2024-09-21T12:46:52.141 INFO:tasks.workunit.client.1.smithi176.stdout:8/190: chown d6/d8 30819759 1 2024-09-21T12:46:52.141 INFO:tasks.workunit.client.1.smithi176.stdout:6/190: dwrite d2/dd/d26/f3d [0,4194304] 0 2024-09-21T12:46:52.142 INFO:tasks.workunit.client.1.smithi176.stdout:7/240: rename d0/d2/db/d10/d3b/c40 to d0/d2/db/d10/d31/c53 0 2024-09-21T12:46:52.144 INFO:tasks.workunit.client.1.smithi176.stdout:7/241: chown d0/d2/d30 785 1 2024-09-21T12:46:52.145 INFO:tasks.workunit.client.1.smithi176.stdout:8/191: truncate d6/d8/f33 154541 0 2024-09-21T12:46:52.150 INFO:tasks.workunit.client.1.smithi176.stdout:2/163: dwrite d4/f19 [0,4194304] 0 2024-09-21T12:46:52.151 INFO:tasks.workunit.client.1.smithi176.stdout:0/177: dwrite d9/d1a/d1d/d22/f2a [0,4194304] 0 2024-09-21T12:46:52.153 INFO:tasks.workunit.client.1.smithi176.stdout:2/164: dread d4/df/f1c [0,4194304] 0 2024-09-21T12:46:52.154 INFO:tasks.workunit.client.1.smithi176.stdout:2/165: fsync d4/d2b/f2c 0 2024-09-21T12:46:52.155 INFO:tasks.workunit.client.1.smithi176.stdout:2/166: write d4/df/f22 [3972629,9346] 0 2024-09-21T12:46:52.176 INFO:tasks.workunit.client.1.smithi176.stdout:8/192: unlink d6/db/d13/f19 0 2024-09-21T12:46:52.181 INFO:tasks.workunit.client.1.smithi176.stdout:2/167: rename d4/fe to d4/df/f31 0 2024-09-21T12:46:52.181 INFO:tasks.workunit.client.1.smithi176.stdout:3/217: dwrite d1/d5/d25/f2d [0,4194304] 0 2024-09-21T12:46:52.184 INFO:tasks.workunit.client.1.smithi176.stdout:3/218: read d1/da/f22 [3524396,116278] 0 2024-09-21T12:46:52.187 INFO:tasks.workunit.client.1.smithi176.stdout:0/178: symlink d9/d1b/d43/l49 0 2024-09-21T12:46:52.187 INFO:tasks.workunit.client.1.smithi176.stdout:0/179: write d9/f14 [4485910,114711] 0 2024-09-21T12:46:52.189 INFO:tasks.workunit.client.1.smithi176.stdout:1/196: rename d0/c18 to d0/db/d1a/d2c/d37/c49 0 2024-09-21T12:46:52.190 INFO:tasks.workunit.client.1.smithi176.stdout:7/242: creat d0/d2/db/f54 x:0 0 0 2024-09-21T12:46:52.191 INFO:tasks.workunit.client.1.smithi176.stdout:3/219: creat d1/d34/d48/f4e x:0 0 0 2024-09-21T12:46:52.192 INFO:tasks.workunit.client.1.smithi176.stdout:8/193: creat d6/d8/d24/f38 x:0 0 0 2024-09-21T12:46:52.193 INFO:tasks.workunit.client.1.smithi176.stdout:1/197: unlink d0/db/f10 0 2024-09-21T12:46:52.194 INFO:tasks.workunit.client.1.smithi176.stdout:3/220: symlink d1/d35/l4f 0 2024-09-21T12:46:52.195 INFO:tasks.workunit.client.1.smithi176.stdout:0/180: dwrite d9/f27 [0,4194304] 0 2024-09-21T12:46:52.195 INFO:tasks.workunit.client.1.smithi176.stdout:1/198: chown d0/l1d 2126 1 2024-09-21T12:46:52.197 INFO:tasks.workunit.client.1.smithi176.stdout:2/168: rmdir d4/d2b/d2d 0 2024-09-21T12:46:52.200 INFO:tasks.workunit.client.1.smithi176.stdout:7/243: mkdir d0/d2/db/d55 0 2024-09-21T12:46:52.202 INFO:tasks.workunit.client.1.smithi176.stdout:0/181: rename d9/d1a/l37 to d9/d1a/d3f/l4a 0 2024-09-21T12:46:52.202 INFO:tasks.workunit.client.1.smithi176.stdout:2/169: mknod d4/df/c32 0 2024-09-21T12:46:52.203 INFO:tasks.workunit.client.1.smithi176.stdout:8/194: getdents d6/d16/d36 0 2024-09-21T12:46:52.204 INFO:tasks.workunit.client.1.smithi176.stdout:7/244: dread d0/f16 [0,4194304] 0 2024-09-21T12:46:52.207 INFO:tasks.workunit.client.1.smithi176.stdout:1/199: dwrite d0/db/d25/d2b/f3a [0,4194304] 0 2024-09-21T12:46:52.207 INFO:tasks.workunit.client.1.smithi176.stdout:2/170: creat d4/d2b/f33 x:0 0 0 2024-09-21T12:46:52.211 INFO:tasks.workunit.client.1.smithi176.stdout:3/221: getdents d1/d5 0 2024-09-21T12:46:52.215 INFO:tasks.workunit.client.1.smithi176.stdout:0/182: link d9/d1a/d20/c3c d9/d1b/c4b 0 2024-09-21T12:46:52.216 INFO:tasks.workunit.client.1.smithi176.stdout:8/195: dwrite f4 [0,4194304] 0 2024-09-21T12:46:52.218 INFO:tasks.workunit.client.1.smithi176.stdout:3/222: rename d1/d5/f6 to d1/d34/d48/f50 0 2024-09-21T12:46:52.220 INFO:tasks.workunit.client.1.smithi176.stdout:2/171: getdents d4 0 2024-09-21T12:46:52.223 INFO:tasks.workunit.client.1.smithi176.stdout:0/183: creat d9/d1a/d3f/d40/f4c x:0 0 0 2024-09-21T12:46:52.223 INFO:tasks.workunit.client.1.smithi176.stdout:1/200: dwrite d0/db/d25/d41/f2f [0,4194304] 0 2024-09-21T12:46:52.226 INFO:tasks.workunit.client.1.smithi176.stdout:2/172: rename d4/df/c23 to d4/df/d2e/c34 0 2024-09-21T12:46:52.227 INFO:tasks.workunit.client.1.smithi176.stdout:0/184: creat d9/dc/f4d x:0 0 0 2024-09-21T12:46:52.227 INFO:tasks.workunit.client.1.smithi176.stdout:2/173: chown d4/l17 51308 1 2024-09-21T12:46:52.227 INFO:tasks.workunit.client.1.smithi176.stdout:8/196: link d6/db/d13/c27 d6/db/d37/c39 0 2024-09-21T12:46:52.228 INFO:tasks.workunit.client.1.smithi176.stdout:0/185: write d9/f45 [637569,126861] 0 2024-09-21T12:46:52.230 INFO:tasks.workunit.client.1.smithi176.stdout:2/174: chown d4/df/l13 24778023 1 2024-09-21T12:46:52.230 INFO:tasks.workunit.client.1.smithi176.stdout:4/183: sync 2024-09-21T12:46:52.230 INFO:tasks.workunit.client.1.smithi176.stdout:1/201: creat d0/db/d1a/d2c/f4a x:0 0 0 2024-09-21T12:46:52.231 INFO:tasks.workunit.client.1.smithi176.stdout:8/197: write d6/d8/d24/f2b [153924,23431] 0 2024-09-21T12:46:52.232 INFO:tasks.workunit.client.1.smithi176.stdout:5/127: sync 2024-09-21T12:46:52.232 INFO:tasks.workunit.client.1.smithi176.stdout:9/219: sync 2024-09-21T12:46:52.233 INFO:tasks.workunit.client.1.smithi176.stdout:4/184: chown d3/d5/f1c 257293 1 2024-09-21T12:46:52.234 INFO:tasks.workunit.client.1.smithi176.stdout:0/186: stat d9/d1a/d3f/l4a 0 2024-09-21T12:46:52.234 INFO:tasks.workunit.client.1.smithi176.stdout:4/185: stat d3/d21/d27/d2c 0 2024-09-21T12:46:52.237 INFO:tasks.workunit.client.1.smithi176.stdout:9/220: dread d1/df/d1e/f3d [0,4194304] 0 2024-09-21T12:46:52.237 INFO:tasks.workunit.client.1.smithi176.stdout:8/198: creat d6/db/d37/f3a x:0 0 0 2024-09-21T12:46:52.239 INFO:tasks.workunit.client.1.smithi176.stdout:2/175: link d4/df/c32 d4/df/d2e/c35 0 2024-09-21T12:46:52.240 INFO:tasks.workunit.client.1.smithi176.stdout:1/202: mknod d0/db/d1a/d2c/d48/c4b 0 2024-09-21T12:46:52.241 INFO:tasks.workunit.client.1.smithi176.stdout:2/176: dread d4/f1a [0,4194304] 0 2024-09-21T12:46:52.243 INFO:tasks.workunit.client.1.smithi176.stdout:0/187: link d9/d35/l39 d9/d1a/d3f/l4e 0 2024-09-21T12:46:52.244 INFO:tasks.workunit.client.1.smithi176.stdout:2/177: write d4/d2b/f33 [928982,23368] 0 2024-09-21T12:46:52.247 INFO:tasks.workunit.client.1.smithi176.stdout:0/188: unlink d9/d1a/d1d/f26 0 2024-09-21T12:46:52.247 INFO:tasks.workunit.client.1.smithi176.stdout:2/178: truncate d4/df/f21 103904 0 2024-09-21T12:46:52.249 INFO:tasks.workunit.client.1.smithi176.stdout:5/128: write d0/d13/f29 [123637,56950] 0 2024-09-21T12:46:52.250 INFO:tasks.workunit.client.1.smithi176.stdout:0/189: mkdir d9/d1a/d1d/d4f 0 2024-09-21T12:46:52.250 INFO:tasks.workunit.client.1.smithi176.stdout:1/203: dwrite d0/f27 [0,4194304] 0 2024-09-21T12:46:52.252 INFO:tasks.workunit.client.1.smithi176.stdout:2/179: rename d4/df/c1b to d4/c36 0 2024-09-21T12:46:52.252 INFO:tasks.workunit.client.1.smithi176.stdout:5/129: symlink d0/d13/l2d 0 2024-09-21T12:46:52.252 INFO:tasks.workunit.client.1.smithi176.stdout:2/180: chown c3 7800 1 2024-09-21T12:46:52.253 INFO:tasks.workunit.client.1.smithi176.stdout:8/199: write d6/d8/f10 [1069519,63221] 0 2024-09-21T12:46:52.255 INFO:tasks.workunit.client.1.smithi176.stdout:1/204: creat d0/db/d2a/f4c x:0 0 0 2024-09-21T12:46:52.256 INFO:tasks.workunit.client.1.smithi176.stdout:5/130: write d0/f27 [361698,126317] 0 2024-09-21T12:46:52.262 INFO:tasks.workunit.client.1.smithi176.stdout:1/205: symlink d0/db/d25/d2b/l4d 0 2024-09-21T12:46:52.262 INFO:tasks.workunit.client.1.smithi176.stdout:5/131: truncate d0/d13/f29 1365618 0 2024-09-21T12:46:52.265 INFO:tasks.workunit.client.1.smithi176.stdout:0/190: dwrite d9/dc/f15 [0,4194304] 0 2024-09-21T12:46:52.269 INFO:tasks.workunit.client.1.smithi176.stdout:1/206: symlink d0/db/l4e 0 2024-09-21T12:46:52.270 INFO:tasks.workunit.client.1.smithi176.stdout:4/186: dwrite f1 [0,4194304] 0 2024-09-21T12:46:52.270 INFO:tasks.workunit.client.1.smithi176.stdout:2/181: creat d4/f37 x:0 0 0 2024-09-21T12:46:52.274 INFO:tasks.workunit.client.1.smithi176.stdout:8/200: dwrite d6/db/d13/f29 [0,4194304] 0 2024-09-21T12:46:52.275 INFO:tasks.workunit.client.1.smithi176.stdout:1/207: symlink d0/db/l4f 0 2024-09-21T12:46:52.278 INFO:tasks.workunit.client.1.smithi176.stdout:4/187: truncate d3/d21/d27/d2c/f39 243062 0 2024-09-21T12:46:52.279 INFO:tasks.workunit.client.1.smithi176.stdout:2/182: creat d4/f38 x:0 0 0 2024-09-21T12:46:52.280 INFO:tasks.workunit.client.1.smithi176.stdout:8/201: symlink d6/db/l3b 0 2024-09-21T12:46:52.281 INFO:tasks.workunit.client.1.smithi176.stdout:8/202: chown d6/db 102 1 2024-09-21T12:46:52.282 INFO:tasks.workunit.client.1.smithi176.stdout:4/188: write d3/d5/fd [984034,52141] 0 2024-09-21T12:46:52.282 INFO:tasks.workunit.client.1.smithi176.stdout:0/191: dwrite d9/f14 [0,4194304] 0 2024-09-21T12:46:52.282 INFO:tasks.workunit.client.1.smithi176.stdout:2/183: readlink d4/df/l25 0 2024-09-21T12:46:52.284 INFO:tasks.workunit.client.1.smithi176.stdout:4/189: fsync d3/d21/f2a 0 2024-09-21T12:46:52.284 INFO:tasks.workunit.client.1.smithi176.stdout:1/208: rename d0/db/d25/d2b/d31 to d0/db/d1a/d2c/d48/d50 0 2024-09-21T12:46:52.286 INFO:tasks.workunit.client.1.smithi176.stdout:2/184: write f2 [2416301,125246] 0 2024-09-21T12:46:52.287 INFO:tasks.workunit.client.1.smithi176.stdout:4/190: write d3/f3c [751152,22151] 0 2024-09-21T12:46:52.291 INFO:tasks.workunit.client.1.smithi176.stdout:1/209: mknod d0/db/d1a/d2c/d48/c51 0 2024-09-21T12:46:52.293 INFO:tasks.workunit.client.1.smithi176.stdout:5/132: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:52.294 INFO:tasks.workunit.client.1.smithi176.stdout:4/191: rename d3/d5/db/c18 to d3/d21/d27/c45 0 2024-09-21T12:46:52.294 INFO:tasks.workunit.client.1.smithi176.stdout:1/210: write d0/db/ff [4009230,37284] 0 2024-09-21T12:46:52.294 INFO:tasks.workunit.client.1.smithi176.stdout:8/203: dread d6/db/f2c [0,4194304] 0 2024-09-21T12:46:52.295 INFO:tasks.workunit.client.1.smithi176.stdout:2/185: mkdir d4/df/d2e/d39 0 2024-09-21T12:46:52.295 INFO:tasks.workunit.client.1.smithi176.stdout:5/133: dread - d0/d10/d11/f2c zero size 2024-09-21T12:46:52.296 INFO:tasks.workunit.client.1.smithi176.stdout:5/134: stat d0/d10/d11/c12 0 2024-09-21T12:46:52.297 INFO:tasks.workunit.client.1.smithi176.stdout:8/204: mknod d6/d8/d24/c3c 0 2024-09-21T12:46:52.297 INFO:tasks.workunit.client.1.smithi176.stdout:0/192: getdents d9/d1a/d1d 0 2024-09-21T12:46:52.298 INFO:tasks.workunit.client.1.smithi176.stdout:5/135: rmdir d0/d13 39 2024-09-21T12:46:52.299 INFO:tasks.workunit.client.1.smithi176.stdout:1/211: creat d0/db/d25/d2b/d43/f52 x:0 0 0 2024-09-21T12:46:52.300 INFO:tasks.workunit.client.1.smithi176.stdout:2/186: dread d4/df/f31 [0,4194304] 0 2024-09-21T12:46:52.301 INFO:tasks.workunit.client.1.smithi176.stdout:8/205: rename d6/l21 to d6/d16/d36/l3d 0 2024-09-21T12:46:52.301 INFO:tasks.workunit.client.1.smithi176.stdout:8/206: chown d6/d16/d36 4418057 1 2024-09-21T12:46:52.302 INFO:tasks.workunit.client.1.smithi176.stdout:0/193: creat d9/dc/f50 x:0 0 0 2024-09-21T12:46:52.304 INFO:tasks.workunit.client.1.smithi176.stdout:2/187: stat d4/f28 0 2024-09-21T12:46:52.308 INFO:tasks.workunit.client.1.smithi176.stdout:8/207: symlink d6/db/d32/l3e 0 2024-09-21T12:46:52.309 INFO:tasks.workunit.client.1.smithi176.stdout:5/136: dwrite d0/d13/f26 [0,4194304] 0 2024-09-21T12:46:52.310 INFO:tasks.workunit.client.1.smithi176.stdout:0/194: dread f5 [0,4194304] 0 2024-09-21T12:46:52.312 INFO:tasks.workunit.client.1.smithi176.stdout:2/188: getdents d4 0 2024-09-21T12:46:52.314 INFO:tasks.workunit.client.1.smithi176.stdout:2/189: fsync d4/d2b/f2c 0 2024-09-21T12:46:52.316 INFO:tasks.workunit.client.1.smithi176.stdout:8/208: dread d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:52.316 INFO:tasks.workunit.client.1.smithi176.stdout:5/137: write d0/d10/f2b [924346,68929] 0 2024-09-21T12:46:52.317 INFO:tasks.workunit.client.1.smithi176.stdout:2/190: mkdir d4/d3a 0 2024-09-21T12:46:52.317 INFO:tasks.workunit.client.1.smithi176.stdout:5/138: dread - d0/d10/d11/f2c zero size 2024-09-21T12:46:52.318 INFO:tasks.workunit.client.1.smithi176.stdout:8/209: creat d6/d8/d24/f3f x:0 0 0 2024-09-21T12:46:52.319 INFO:tasks.workunit.client.1.smithi176.stdout:4/192: dread d3/d5/f15 [0,4194304] 0 2024-09-21T12:46:52.323 INFO:tasks.workunit.client.1.smithi176.stdout:0/195: dread d9/dc/f13 [0,4194304] 0 2024-09-21T12:46:52.323 INFO:tasks.workunit.client.1.smithi176.stdout:8/210: creat d6/db/d32/f40 x:0 0 0 2024-09-21T12:46:52.327 INFO:tasks.workunit.client.1.smithi176.stdout:0/196: chown d9/d35/l39 187 1 2024-09-21T12:46:52.327 INFO:tasks.workunit.client.1.smithi176.stdout:2/191: mknod d4/df/c3b 0 2024-09-21T12:46:52.328 INFO:tasks.workunit.client.1.smithi176.stdout:8/211: read d6/db/f17 [4106937,62796] 0 2024-09-21T12:46:52.331 INFO:tasks.workunit.client.1.smithi176.stdout:4/193: dwrite d3/d5/db/d36/f43 [0,4194304] 0 2024-09-21T12:46:52.338 INFO:tasks.workunit.client.1.smithi176.stdout:0/197: dread d9/f17 [0,4194304] 0 2024-09-21T12:46:52.344 INFO:tasks.workunit.client.1.smithi176.stdout:2/192: dwrite d4/d2b/f33 [0,4194304] 0 2024-09-21T12:46:52.344 INFO:tasks.workunit.client.1.smithi176.stdout:4/194: getdents d3/d5/db/d36 0 2024-09-21T12:46:52.345 INFO:tasks.workunit.client.1.smithi176.stdout:8/212: dwrite d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:52.346 INFO:tasks.workunit.client.1.smithi176.stdout:0/198: write d9/dc/f13 [1553863,103082] 0 2024-09-21T12:46:52.347 INFO:tasks.workunit.client.1.smithi176.stdout:6/191: sync 2024-09-21T12:46:52.348 INFO:tasks.workunit.client.1.smithi176.stdout:5/139: dread d0/d10/f23 [0,4194304] 0 2024-09-21T12:46:52.349 INFO:tasks.workunit.client.1.smithi176.stdout:2/193: creat d4/df/f3c x:0 0 0 2024-09-21T12:46:52.350 INFO:tasks.workunit.client.1.smithi176.stdout:8/213: symlink d6/d8/d24/l41 0 2024-09-21T12:46:52.352 INFO:tasks.workunit.client.1.smithi176.stdout:8/214: dread - d6/d8/d24/f3f zero size 2024-09-21T12:46:52.355 INFO:tasks.workunit.client.1.smithi176.stdout:4/195: getdents d3/d5/db/d36 0 2024-09-21T12:46:52.358 INFO:tasks.workunit.client.1.smithi176.stdout:5/140: mkdir d0/d10/d11/d2e 0 2024-09-21T12:46:52.361 INFO:tasks.workunit.client.1.smithi176.stdout:4/196: write d3/d21/d27/d2c/f35 [26838,98956] 0 2024-09-21T12:46:52.362 INFO:tasks.workunit.client.1.smithi176.stdout:8/215: link d6/d8/f33 d6/d8/d24/d35/f42 0 2024-09-21T12:46:52.363 INFO:tasks.workunit.client.1.smithi176.stdout:4/197: readlink d3/l1f 0 2024-09-21T12:46:52.365 INFO:tasks.workunit.client.1.smithi176.stdout:5/141: creat d0/d10/d11/d2e/f2f x:0 0 0 2024-09-21T12:46:52.365 INFO:tasks.workunit.client.1.smithi176.stdout:6/192: dwrite d2/dd/d26/d2b/f2e [0,4194304] 0 2024-09-21T12:46:52.366 INFO:tasks.workunit.client.1.smithi176.stdout:0/199: dwrite d9/f45 [0,4194304] 0 2024-09-21T12:46:52.368 INFO:tasks.workunit.client.1.smithi176.stdout:8/216: chown d6/d8/f33 6675838 1 2024-09-21T12:46:52.370 INFO:tasks.workunit.client.1.smithi176.stdout:4/198: read - d3/d21/d27/d2c/f41 zero size 2024-09-21T12:46:52.373 INFO:tasks.workunit.client.1.smithi176.stdout:0/200: fdatasync d9/dc/d1e/f2e 0 2024-09-21T12:46:52.373 INFO:tasks.workunit.client.1.smithi176.stdout:2/194: dwrite d4/df/f26 [0,4194304] 0 2024-09-21T12:46:52.374 INFO:tasks.workunit.client.1.smithi176.stdout:5/142: rmdir d0/d10/d11/d25 0 2024-09-21T12:46:52.378 INFO:tasks.workunit.client.1.smithi176.stdout:2/195: mkdir d4/d3d 0 2024-09-21T12:46:52.379 INFO:tasks.workunit.client.1.smithi176.stdout:5/143: write d0/ff [306102,129797] 0 2024-09-21T12:46:52.379 INFO:tasks.workunit.client.1.smithi176.stdout:0/201: creat d9/d1a/d1d/f51 x:0 0 0 2024-09-21T12:46:52.382 INFO:tasks.workunit.client.1.smithi176.stdout:4/199: rmdir d3/d5/db/d36/d3a 0 2024-09-21T12:46:52.382 INFO:tasks.workunit.client.1.smithi176.stdout:5/144: rename d0/d10 to d0/d10/d11/d2e/d30 22 2024-09-21T12:46:52.384 INFO:tasks.workunit.client.1.smithi176.stdout:0/202: dread d9/ff [0,4194304] 0 2024-09-21T12:46:52.384 INFO:tasks.workunit.client.1.smithi176.stdout:2/196: creat d4/d2b/f3e x:0 0 0 2024-09-21T12:46:52.384 INFO:tasks.workunit.client.1.smithi176.stdout:6/193: dwrite d2/dd/d26/d2b/f19 [0,4194304] 0 2024-09-21T12:46:52.385 INFO:tasks.workunit.client.1.smithi176.stdout:5/145: stat d0/d10/d11/d2e 0 2024-09-21T12:46:52.391 INFO:tasks.workunit.client.1.smithi176.stdout:2/197: unlink d4/df/f3c 0 2024-09-21T12:46:52.394 INFO:tasks.workunit.client.1.smithi176.stdout:6/194: dread d2/dd/d26/d2b/d10/f1f [0,4194304] 0 2024-09-21T12:46:52.394 INFO:tasks.workunit.client.1.smithi176.stdout:4/200: rename d3/d5/db/d36/l38 to d3/d21/l46 0 2024-09-21T12:46:52.395 INFO:tasks.workunit.client.1.smithi176.stdout:0/203: creat d9/f52 x:0 0 0 2024-09-21T12:46:52.395 INFO:tasks.workunit.client.1.smithi176.stdout:5/146: dwrite d0/d10/f2b [0,4194304] 0 2024-09-21T12:46:52.395 INFO:tasks.workunit.client.1.smithi176.stdout:6/195: fsync d2/f34 0 2024-09-21T12:46:52.396 INFO:tasks.workunit.client.1.smithi176.stdout:2/198: mkdir d4/df/d3f 0 2024-09-21T12:46:52.397 INFO:tasks.workunit.client.1.smithi176.stdout:5/147: read d0/d13/f26 [1381131,25616] 0 2024-09-21T12:46:52.397 INFO:tasks.workunit.client.1.smithi176.stdout:0/204: write d9/dc/d1e/f42 [856985,67995] 0 2024-09-21T12:46:52.403 INFO:tasks.workunit.client.1.smithi176.stdout:2/199: mkdir d4/d40 0 2024-09-21T12:46:52.404 INFO:tasks.workunit.client.1.smithi176.stdout:0/205: dread d9/f17 [0,4194304] 0 2024-09-21T12:46:52.404 INFO:tasks.workunit.client.1.smithi176.stdout:5/148: mkdir d0/d31 0 2024-09-21T12:46:52.407 INFO:tasks.workunit.client.1.smithi176.stdout:5/149: fdatasync d0/d13/f29 0 2024-09-21T12:46:52.407 INFO:tasks.workunit.client.1.smithi176.stdout:4/201: dwrite d3/d5/db/f33 [0,4194304] 0 2024-09-21T12:46:52.407 INFO:tasks.workunit.client.1.smithi176.stdout:0/206: dread - d9/d1a/d3f/d40/f4c zero size 2024-09-21T12:46:52.409 INFO:tasks.workunit.client.1.smithi176.stdout:0/207: dread - d9/d1a/d1d/d23/f44 zero size 2024-09-21T12:46:52.411 INFO:tasks.workunit.client.1.smithi176.stdout:2/200: dread d4/df/f2a [0,4194304] 0 2024-09-21T12:46:52.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:52 smithi046 ceph-mon[27868]: pgmap v22: 65 pgs: 65 active+clean; 419 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 30 MiB/s wr, 348 op/s 2024-09-21T12:46:52.413 INFO:tasks.workunit.client.1.smithi176.stdout:0/208: mkdir d9/d1a/d1d/d53 0 2024-09-21T12:46:52.418 INFO:tasks.workunit.client.1.smithi176.stdout:6/196: write d2/f8 [1416465,104902] 0 2024-09-21T12:46:52.418 INFO:tasks.workunit.client.1.smithi176.stdout:4/202: mkdir d3/d42/d47 0 2024-09-21T12:46:52.418 INFO:tasks.workunit.client.1.smithi176.stdout:4/203: dread - d3/d5/f44 zero size 2024-09-21T12:46:52.418 INFO:tasks.workunit.client.1.smithi176.stdout:0/209: symlink d9/d1a/d1d/d23/l54 0 2024-09-21T12:46:52.418 INFO:tasks.workunit.client.1.smithi176.stdout:6/197: write d2/dd/d26/d2b/f19 [2067445,54916] 0 2024-09-21T12:46:52.419 INFO:tasks.workunit.client.1.smithi176.stdout:4/204: chown d3/d5/db/d36 4 1 2024-09-21T12:46:52.419 INFO:tasks.workunit.client.1.smithi176.stdout:2/201: dwrite f2 [0,4194304] 0 2024-09-21T12:46:52.424 INFO:tasks.workunit.client.1.smithi176.stdout:5/150: truncate d0/f27 441059 0 2024-09-21T12:46:52.424 INFO:tasks.workunit.client.1.smithi176.stdout:2/202: fdatasync d4/df/f2a 0 2024-09-21T12:46:52.425 INFO:tasks.workunit.client.1.smithi176.stdout:4/205: mknod d3/d21/d27/c48 0 2024-09-21T12:46:52.427 INFO:tasks.workunit.client.1.smithi176.stdout:6/198: creat d2/dd/d26/d2b/d10/d39/f46 x:0 0 0 2024-09-21T12:46:52.430 INFO:tasks.workunit.client.1.smithi176.stdout:2/203: stat d4/l30 0 2024-09-21T12:46:52.430 INFO:tasks.workunit.client.1.smithi176.stdout:0/210: dwrite d9/d1a/d3f/d40/f4c [0,4194304] 0 2024-09-21T12:46:52.433 INFO:tasks.workunit.client.1.smithi176.stdout:6/199: chown d2/dd/d26/d2b/d10/d39/f46 120 1 2024-09-21T12:46:52.433 INFO:tasks.workunit.client.1.smithi176.stdout:0/211: write d9/dc/f15 [4028338,35393] 0 2024-09-21T12:46:52.435 INFO:tasks.workunit.client.1.smithi176.stdout:5/151: dwrite d0/f18 [0,4194304] 0 2024-09-21T12:46:52.439 INFO:tasks.workunit.client.1.smithi176.stdout:2/204: symlink d4/l41 0 2024-09-21T12:46:52.439 INFO:tasks.workunit.client.1.smithi176.stdout:6/200: mkdir d2/d47 0 2024-09-21T12:46:52.440 INFO:tasks.workunit.client.1.smithi176.stdout:2/205: mkdir d4/df/d2e/d42 0 2024-09-21T12:46:52.442 INFO:tasks.workunit.client.1.smithi176.stdout:0/212: dread d9/ff [0,4194304] 0 2024-09-21T12:46:52.449 INFO:tasks.workunit.client.1.smithi176.stdout:5/152: dwrite d0/d13/f29 [0,4194304] 0 2024-09-21T12:46:52.451 INFO:tasks.workunit.client.1.smithi176.stdout:2/206: dread f2 [0,4194304] 0 2024-09-21T12:46:52.453 INFO:tasks.workunit.client.1.smithi176.stdout:5/153: fdatasync d0/d10/f23 0 2024-09-21T12:46:52.454 INFO:tasks.workunit.client.1.smithi176.stdout:2/207: fsync d4/df/f21 0 2024-09-21T12:46:52.456 INFO:tasks.workunit.client.1.smithi176.stdout:5/154: readlink d0/d13/l2d 0 2024-09-21T12:46:52.457 INFO:tasks.workunit.client.1.smithi176.stdout:0/213: dwrite d9/f17 [0,4194304] 0 2024-09-21T12:46:52.458 INFO:tasks.workunit.client.1.smithi176.stdout:6/201: dwrite d2/dd/d26/d2b/d10/d1b/d37/f3c [0,4194304] 0 2024-09-21T12:46:52.459 INFO:tasks.workunit.client.1.smithi176.stdout:0/214: fsync d9/f52 0 2024-09-21T12:46:52.459 INFO:tasks.workunit.client.1.smithi176.stdout:2/208: mknod d4/df/c43 0 2024-09-21T12:46:52.460 INFO:tasks.workunit.client.1.smithi176.stdout:5/155: creat d0/d13/f32 x:0 0 0 2024-09-21T12:46:52.460 INFO:tasks.workunit.client.1.smithi176.stdout:6/202: write d2/f31 [4923875,107973] 0 2024-09-21T12:46:52.461 INFO:tasks.workunit.client.1.smithi176.stdout:5/156: rmdir d0 39 2024-09-21T12:46:52.462 INFO:tasks.workunit.client.1.smithi176.stdout:2/209: symlink d4/df/d3f/l44 0 2024-09-21T12:46:52.464 INFO:tasks.workunit.client.1.smithi176.stdout:2/210: stat d4/df/f1e 0 2024-09-21T12:46:52.465 INFO:tasks.workunit.client.1.smithi176.stdout:0/215: dread d9/f27 [0,4194304] 0 2024-09-21T12:46:52.466 INFO:tasks.workunit.client.1.smithi176.stdout:6/203: creat d2/dd/f48 x:0 0 0 2024-09-21T12:46:52.471 INFO:tasks.workunit.client.1.smithi176.stdout:5/157: rmdir d0/d31 0 2024-09-21T12:46:52.473 INFO:tasks.workunit.client.1.smithi176.stdout:6/204: write d2/dd/d26/d2b/d10/f12 [1284924,108168] 0 2024-09-21T12:46:52.474 INFO:tasks.workunit.client.1.smithi176.stdout:0/216: dwrite d9/f11 [0,4194304] 0 2024-09-21T12:46:52.475 INFO:tasks.workunit.client.1.smithi176.stdout:5/158: chown d0/d13/f26 0 1 2024-09-21T12:46:52.476 INFO:tasks.workunit.client.1.smithi176.stdout:2/211: link d4/f28 d4/d3a/f45 0 2024-09-21T12:46:52.476 INFO:tasks.workunit.client.1.smithi176.stdout:0/217: readlink d9/d1a/l33 0 2024-09-21T12:46:52.477 INFO:tasks.workunit.client.1.smithi176.stdout:7/245: sync 2024-09-21T12:46:52.482 INFO:tasks.workunit.client.1.smithi176.stdout:5/159: dread d0/d10/f2b [0,4194304] 0 2024-09-21T12:46:52.482 INFO:tasks.workunit.client.1.smithi176.stdout:7/246: write d0/d2/db/d10/f2b [1899478,91810] 0 2024-09-21T12:46:52.484 INFO:tasks.workunit.client.1.smithi176.stdout:7/247: write d0/d2/db/d10/d23/f2e [6792884,119192] 0 2024-09-21T12:46:52.487 INFO:tasks.workunit.client.1.smithi176.stdout:7/248: mknod d0/d2/db/d25/c56 0 2024-09-21T12:46:52.489 INFO:tasks.workunit.client.1.smithi176.stdout:6/205: fsync d2/dd/d26/d2b/d10/f12 0 2024-09-21T12:46:52.495 INFO:tasks.workunit.client.1.smithi176.stdout:7/249: dwrite d0/f16 [0,4194304] 0 2024-09-21T12:46:52.497 INFO:tasks.workunit.client.1.smithi176.stdout:5/160: dread d0/fc [0,4194304] 0 2024-09-21T12:46:52.498 INFO:tasks.workunit.client.1.smithi176.stdout:5/161: readlink d0/l1d 0 2024-09-21T12:46:52.499 INFO:tasks.workunit.client.1.smithi176.stdout:5/162: stat d0 0 2024-09-21T12:46:52.502 INFO:tasks.workunit.client.1.smithi176.stdout:5/163: write d0/d10/d11/f2c [780708,123685] 0 2024-09-21T12:46:52.504 INFO:tasks.workunit.client.1.smithi176.stdout:5/164: write d0/d10/d11/f21 [4322684,50007] 0 2024-09-21T12:46:52.505 INFO:tasks.workunit.client.1.smithi176.stdout:7/250: dwrite d0/d2/db/d10/f22 [4194304,4194304] 0 2024-09-21T12:46:52.506 INFO:tasks.workunit.client.1.smithi176.stdout:5/165: chown d0/d10 132 1 2024-09-21T12:46:52.508 INFO:tasks.workunit.client.1.smithi176.stdout:5/166: symlink d0/d10/l33 0 2024-09-21T12:46:52.510 INFO:tasks.workunit.client.1.smithi176.stdout:2/212: truncate d4/df/f26 537125 0 2024-09-21T12:46:52.511 INFO:tasks.workunit.client.1.smithi176.stdout:5/167: write d0/f18 [4050272,8801] 0 2024-09-21T12:46:52.513 INFO:tasks.workunit.client.1.smithi176.stdout:2/213: write d4/f19 [4006448,98252] 0 2024-09-21T12:46:52.518 INFO:tasks.workunit.client.1.smithi176.stdout:6/206: dwrite d2/dd/f11 [0,4194304] 0 2024-09-21T12:46:52.520 INFO:tasks.workunit.client.1.smithi176.stdout:6/207: write d2/dd/f11 [1594023,125062] 0 2024-09-21T12:46:52.521 INFO:tasks.workunit.client.1.smithi176.stdout:6/208: fdatasync d2/dd/d26/f38 0 2024-09-21T12:46:52.523 INFO:tasks.workunit.client.1.smithi176.stdout:6/209: chown d2/dd/d26/d2b/d10 5393684 1 2024-09-21T12:46:52.523 INFO:tasks.workunit.client.1.smithi176.stdout:6/210: readlink d2/dd/d26/l3a 0 2024-09-21T12:46:52.526 INFO:tasks.workunit.client.1.smithi176.stdout:6/211: chown d2/dd/d26/d2b/d10/d1b/l1e 166 1 2024-09-21T12:46:52.530 INFO:tasks.workunit.client.1.smithi176.stdout:5/168: dwrite d0/fc [0,4194304] 0 2024-09-21T12:46:52.531 INFO:tasks.workunit.client.1.smithi176.stdout:2/214: dwrite d4/d3a/f45 [0,4194304] 0 2024-09-21T12:46:52.533 INFO:tasks.workunit.client.1.smithi176.stdout:2/215: symlink d4/df/d2e/l46 0 2024-09-21T12:46:52.533 INFO:tasks.workunit.client.1.smithi176.stdout:5/169: mknod d0/d10/d11/c34 0 2024-09-21T12:46:52.536 INFO:tasks.workunit.client.1.smithi176.stdout:5/170: mknod d0/d10/d11/c35 0 2024-09-21T12:46:52.538 INFO:tasks.workunit.client.1.smithi176.stdout:5/171: write d0/d13/f32 [731252,107373] 0 2024-09-21T12:46:52.543 INFO:tasks.workunit.client.1.smithi176.stdout:2/216: dwrite d4/f1a [0,4194304] 0 2024-09-21T12:46:52.544 INFO:tasks.workunit.client.1.smithi176.stdout:2/217: fsync d4/df/f2a 0 2024-09-21T12:46:52.546 INFO:tasks.workunit.client.1.smithi176.stdout:5/172: dread d0/d10/d11/f21 [0,4194304] 0 2024-09-21T12:46:52.552 INFO:tasks.workunit.client.1.smithi176.stdout:2/218: dwrite d4/d3a/f45 [0,4194304] 0 2024-09-21T12:46:52.553 INFO:tasks.workunit.client.1.smithi176.stdout:5/173: dread d0/f18 [0,4194304] 0 2024-09-21T12:46:52.554 INFO:tasks.workunit.client.1.smithi176.stdout:5/174: dread - d0/d10/d11/d2e/f2f zero size 2024-09-21T12:46:52.556 INFO:tasks.workunit.client.1.smithi176.stdout:2/219: dread d4/f28 [0,4194304] 0 2024-09-21T12:46:52.557 INFO:tasks.workunit.client.1.smithi176.stdout:2/220: write d4/f1a [1498750,17653] 0 2024-09-21T12:46:52.559 INFO:tasks.workunit.client.1.smithi176.stdout:2/221: mknod d4/df/d3f/c47 0 2024-09-21T12:46:52.562 INFO:tasks.workunit.client.1.smithi176.stdout:2/222: fdatasync d4/f1d 0 2024-09-21T12:46:52.563 INFO:tasks.workunit.client.1.smithi176.stdout:2/223: write d4/d2b/f2c [28926,119246] 0 2024-09-21T12:46:52.563 INFO:tasks.workunit.client.1.smithi176.stdout:2/224: readlink d4/df/l16 0 2024-09-21T12:46:52.565 INFO:tasks.workunit.client.1.smithi176.stdout:2/225: creat d4/df/f48 x:0 0 0 2024-09-21T12:46:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:52 smithi176 ceph-mon[35476]: pgmap v22: 65 pgs: 65 active+clean; 419 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 30 MiB/s wr, 348 op/s 2024-09-21T12:46:52.566 INFO:tasks.workunit.client.1.smithi176.stdout:2/226: fsync d4/df/f1e 0 2024-09-21T12:46:52.567 INFO:tasks.workunit.client.1.smithi176.stdout:6/212: dread d2/dd/d26/d2b/d10/f12 [0,4194304] 0 2024-09-21T12:46:52.570 INFO:tasks.workunit.client.1.smithi176.stdout:6/213: rmdir d2/d47 0 2024-09-21T12:46:52.571 INFO:tasks.workunit.client.1.smithi176.stdout:6/214: chown d2/dd/d26/d2b/d10/d1b 27 1 2024-09-21T12:46:52.573 INFO:tasks.workunit.client.1.smithi176.stdout:2/227: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:46:52.574 INFO:tasks.workunit.client.1.smithi176.stdout:2/228: dread - d4/d2b/f3e zero size 2024-09-21T12:46:52.638 INFO:tasks.workunit.client.1.smithi176.stdout:3/223: sync 2024-09-21T12:46:52.644 INFO:tasks.workunit.client.1.smithi176.stdout:3/224: dwrite f0 [8388608,4194304] 0 2024-09-21T12:46:52.644 INFO:tasks.workunit.client.1.smithi176.stdout:3/225: chown d1/f1c 138598 1 2024-09-21T12:46:52.648 INFO:tasks.workunit.client.1.smithi176.stdout:3/226: creat d1/f51 x:0 0 0 2024-09-21T12:46:52.652 INFO:tasks.workunit.client.1.smithi176.stdout:3/227: link d1/d5/f1b d1/d34/f52 0 2024-09-21T12:46:52.654 INFO:tasks.workunit.client.1.smithi176.stdout:3/228: symlink d1/d5/d25/d40/l53 0 2024-09-21T12:46:52.655 INFO:tasks.workunit.client.1.smithi176.stdout:3/229: dread - d1/d5/d25/d38/f49 zero size 2024-09-21T12:46:52.659 INFO:tasks.workunit.client.1.smithi176.stdout:3/230: rename d1/f1c to d1/d5/d25/d38/f54 0 2024-09-21T12:46:52.661 INFO:tasks.workunit.client.1.smithi176.stdout:3/231: rename d1/d5/d25/f3c to d1/da/f55 0 2024-09-21T12:46:52.662 INFO:tasks.workunit.client.1.smithi176.stdout:3/232: symlink d1/d34/l56 0 2024-09-21T12:46:52.663 INFO:tasks.workunit.client.1.smithi176.stdout:3/233: mkdir d1/d34/d57 0 2024-09-21T12:46:52.669 INFO:tasks.workunit.client.1.smithi176.stdout:3/234: dwrite d1/da/f2e [0,4194304] 0 2024-09-21T12:46:52.672 INFO:tasks.workunit.client.1.smithi176.stdout:3/235: link d1/f1a d1/d3e/f58 0 2024-09-21T12:46:52.674 INFO:tasks.workunit.client.1.smithi176.stdout:3/236: mkdir d1/d34/d42/d59 0 2024-09-21T12:46:52.680 INFO:tasks.workunit.client.1.smithi176.stdout:3/237: dwrite d1/d5/d25/d38/f46 [0,4194304] 0 2024-09-21T12:46:52.684 INFO:tasks.workunit.client.1.smithi176.stdout:3/238: unlink d1/da/c33 0 2024-09-21T12:46:52.685 INFO:tasks.workunit.client.1.smithi176.stdout:3/239: stat d1/d3e/f58 0 2024-09-21T12:46:52.688 INFO:tasks.workunit.client.1.smithi176.stdout:3/240: dread d1/da/fb [0,4194304] 0 2024-09-21T12:46:52.689 INFO:tasks.workunit.client.1.smithi176.stdout:3/241: truncate d1/d5/d25/d38/f49 907208 0 2024-09-21T12:46:52.690 INFO:tasks.workunit.client.1.smithi176.stdout:3/242: write d1/f2f [640222,99997] 0 2024-09-21T12:46:52.692 INFO:tasks.workunit.client.1.smithi176.stdout:3/243: write d1/da/f55 [561686,110137] 0 2024-09-21T12:46:52.696 INFO:tasks.workunit.client.1.smithi176.stdout:3/244: write d1/d5/f1b [603599,75328] 0 2024-09-21T12:46:52.698 INFO:tasks.workunit.client.1.smithi176.stdout:3/245: creat d1/d3e/f5a x:0 0 0 2024-09-21T12:46:52.700 INFO:tasks.workunit.client.1.smithi176.stdout:3/246: rename d1/d35/d37 to d1/d34/d42/d5b 0 2024-09-21T12:46:52.700 INFO:tasks.workunit.client.1.smithi176.stdout:3/247: fdatasync d1/da/f21 0 2024-09-21T12:46:52.704 INFO:tasks.workunit.client.1.smithi176.stdout:3/248: dread d1/d5/d25/d38/f46 [0,4194304] 0 2024-09-21T12:46:52.705 INFO:tasks.workunit.client.1.smithi176.stdout:3/249: mkdir d1/d5/d25/d5c 0 2024-09-21T12:46:52.706 INFO:tasks.workunit.client.1.smithi176.stdout:3/250: mkdir d1/d34/d5d 0 2024-09-21T12:46:52.707 INFO:tasks.workunit.client.1.smithi176.stdout:3/251: chown d1/d5/d25/d38 17677 1 2024-09-21T12:46:52.709 INFO:tasks.workunit.client.1.smithi176.stdout:3/252: rename d1/d34/d42/d59 to d1/d35/d5e 0 2024-09-21T12:46:52.712 INFO:tasks.workunit.client.1.smithi176.stdout:3/253: getdents d1/da 0 2024-09-21T12:46:52.713 INFO:tasks.workunit.client.1.smithi176.stdout:3/254: write d1/d5/d25/f26 [880140,6675] 0 2024-09-21T12:46:52.713 INFO:tasks.workunit.client.1.smithi176.stdout:3/255: fsync d1/d5/fc 0 2024-09-21T12:46:52.715 INFO:tasks.workunit.client.1.smithi176.stdout:3/256: unlink d1/d35/l4f 0 2024-09-21T12:46:52.718 INFO:tasks.workunit.client.1.smithi176.stdout:3/257: dread d1/d5/d25/d38/f3f [0,4194304] 0 2024-09-21T12:46:52.718 INFO:tasks.workunit.client.1.smithi176.stdout:3/258: write d1/d34/f52 [4913095,117474] 0 2024-09-21T12:46:52.729 INFO:tasks.workunit.client.1.smithi176.stdout:3/259: dread d1/da/f22 [0,4194304] 0 2024-09-21T12:46:52.730 INFO:tasks.workunit.client.1.smithi176.stdout:3/260: creat d1/d5/d25/f5f x:0 0 0 2024-09-21T12:46:52.731 INFO:tasks.workunit.client.1.smithi176.stdout:9/221: sync 2024-09-21T12:46:52.733 INFO:tasks.workunit.client.1.smithi176.stdout:3/261: link d1/d5/c13 d1/d3e/c60 0 2024-09-21T12:46:52.734 INFO:tasks.workunit.client.1.smithi176.stdout:3/262: readlink d1/l19 0 2024-09-21T12:46:52.736 INFO:tasks.workunit.client.1.smithi176.stdout:3/263: mkdir d1/d5/d25/d61 0 2024-09-21T12:46:52.736 INFO:tasks.workunit.client.1.smithi176.stdout:9/222: dwrite d1/df/d23/f36 [0,4194304] 0 2024-09-21T12:46:52.739 INFO:tasks.workunit.client.1.smithi176.stdout:3/264: rename d1/d5/f3b to d1/d5/d25/d5c/f62 0 2024-09-21T12:46:52.740 INFO:tasks.workunit.client.1.smithi176.stdout:9/223: truncate d1/df/d1e/f27 241720 0 2024-09-21T12:46:52.741 INFO:tasks.workunit.client.1.smithi176.stdout:3/265: creat d1/d5/d25/d38/f63 x:0 0 0 2024-09-21T12:46:52.747 INFO:tasks.workunit.client.1.smithi176.stdout:9/224: link d1/l3f d1/df/d1c/l50 0 2024-09-21T12:46:52.748 INFO:tasks.workunit.client.1.smithi176.stdout:3/266: link d1/d5/d25/d38/l45 d1/d34/d42/l64 0 2024-09-21T12:46:52.749 INFO:tasks.workunit.client.1.smithi176.stdout:3/267: chown d1/d34/f52 4626405 1 2024-09-21T12:46:52.749 INFO:tasks.workunit.client.1.smithi176.stdout:3/268: chown d1/d3e/f58 6 1 2024-09-21T12:46:52.750 INFO:tasks.workunit.client.1.smithi176.stdout:9/225: symlink d1/df/l51 0 2024-09-21T12:46:52.750 INFO:tasks.workunit.client.1.smithi176.stdout:3/269: chown d1/da/fb 233618 1 2024-09-21T12:46:52.752 INFO:tasks.workunit.client.1.smithi176.stdout:9/226: stat d1/l3f 0 2024-09-21T12:46:52.760 INFO:tasks.workunit.client.1.smithi176.stdout:9/227: truncate d1/df/f12 3671983 0 2024-09-21T12:46:52.760 INFO:tasks.workunit.client.1.smithi176.stdout:9/228: write d1/df/d1c/f49 [969873,21635] 0 2024-09-21T12:46:52.761 INFO:tasks.workunit.client.1.smithi176.stdout:9/229: chown d1/c4e 88 1 2024-09-21T12:46:52.762 INFO:tasks.workunit.client.1.smithi176.stdout:9/230: dread - d1/df/d1c/f3c zero size 2024-09-21T12:46:52.763 INFO:tasks.workunit.client.1.smithi176.stdout:3/270: dread d1/d34/f52 [0,4194304] 0 2024-09-21T12:46:52.765 INFO:tasks.workunit.client.1.smithi176.stdout:7/251: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:1/212: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:5/175: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:6/215: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:8/217: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:0/218: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:4/206: sync 2024-09-21T12:46:52.766 INFO:tasks.workunit.client.1.smithi176.stdout:2/229: sync 2024-09-21T12:46:52.769 INFO:tasks.workunit.client.1.smithi176.stdout:0/219: write d9/f17 [4482709,116384] 0 2024-09-21T12:46:52.771 INFO:tasks.workunit.client.1.smithi176.stdout:7/252: rmdir d0/d2f/d43/d45 39 2024-09-21T12:46:52.771 INFO:tasks.workunit.client.1.smithi176.stdout:3/271: dread d1/f1a [4194304,4194304] 0 2024-09-21T12:46:52.771 INFO:tasks.workunit.client.1.smithi176.stdout:6/216: write d2/dd/d26/f38 [691486,4886] 0 2024-09-21T12:46:52.772 INFO:tasks.workunit.client.1.smithi176.stdout:8/218: creat d6/db/f43 x:0 0 0 2024-09-21T12:46:52.773 INFO:tasks.workunit.client.1.smithi176.stdout:2/230: write d4/d2b/f33 [4953440,9960] 0 2024-09-21T12:46:52.774 INFO:tasks.workunit.client.1.smithi176.stdout:4/207: mknod d3/d5/db/d36/c49 0 2024-09-21T12:46:52.775 INFO:tasks.workunit.client.1.smithi176.stdout:6/217: fsync d2/dd/d26/d2b/d10/f12 0 2024-09-21T12:46:52.776 INFO:tasks.workunit.client.1.smithi176.stdout:3/272: write d1/da/f22 [4992667,110181] 0 2024-09-21T12:46:52.776 INFO:tasks.workunit.client.1.smithi176.stdout:1/213: mknod d0/db/d25/c53 0 2024-09-21T12:46:52.776 INFO:tasks.workunit.client.1.smithi176.stdout:4/208: stat d3/d5/db/f20 0 2024-09-21T12:46:52.777 INFO:tasks.workunit.client.1.smithi176.stdout:0/220: symlink d9/d1a/d1d/d23/l55 0 2024-09-21T12:46:52.779 INFO:tasks.workunit.client.1.smithi176.stdout:9/231: dwrite d1/df/f39 [0,4194304] 0 2024-09-21T12:46:52.780 INFO:tasks.workunit.client.1.smithi176.stdout:6/218: chown d2/dd/d26/d2b/d10/l43 238 1 2024-09-21T12:46:52.780 INFO:tasks.workunit.client.1.smithi176.stdout:0/221: read d9/f27 [2231943,126093] 0 2024-09-21T12:46:52.781 INFO:tasks.workunit.client.1.smithi176.stdout:7/253: mknod d0/d2f/d43/d45/c57 0 2024-09-21T12:46:52.784 INFO:tasks.workunit.client.1.smithi176.stdout:4/209: getdents d3/d5/d37 0 2024-09-21T12:46:52.784 INFO:tasks.workunit.client.1.smithi176.stdout:9/232: mknod d1/df/d23/c52 0 2024-09-21T12:46:52.788 INFO:tasks.workunit.client.1.smithi176.stdout:5/176: getdents d0/d10/d11 0 2024-09-21T12:46:52.791 INFO:tasks.workunit.client.1.smithi176.stdout:4/210: write d3/d5/f44 [764070,85539] 0 2024-09-21T12:46:52.794 INFO:tasks.workunit.client.1.smithi176.stdout:2/231: getdents d4/d2b 0 2024-09-21T12:46:52.795 INFO:tasks.workunit.client.1.smithi176.stdout:1/214: dwrite d0/f3c [0,4194304] 0 2024-09-21T12:46:52.796 INFO:tasks.workunit.client.1.smithi176.stdout:3/273: truncate d1/f1a 1974134 0 2024-09-21T12:46:52.799 INFO:tasks.workunit.client.1.smithi176.stdout:4/211: read d3/d5/f13 [127756,74092] 0 2024-09-21T12:46:52.801 INFO:tasks.workunit.client.1.smithi176.stdout:3/274: stat d1/f18 0 2024-09-21T12:46:52.806 INFO:tasks.workunit.client.1.smithi176.stdout:8/219: dwrite d6/d8/f33 [0,4194304] 0 2024-09-21T12:46:52.807 INFO:tasks.workunit.client.1.smithi176.stdout:6/219: dwrite d2/dd/d26/f38 [0,4194304] 0 2024-09-21T12:46:52.807 INFO:tasks.workunit.client.1.smithi176.stdout:1/215: stat d0/db/d25/d41/f2f 0 2024-09-21T12:46:52.809 INFO:tasks.workunit.client.1.smithi176.stdout:0/222: dread d9/d1a/d1d/d22/f2a [0,4194304] 0 2024-09-21T12:46:52.810 INFO:tasks.workunit.client.1.smithi176.stdout:7/254: dwrite d0/d2/f42 [0,4194304] 0 2024-09-21T12:46:52.811 INFO:tasks.workunit.client.1.smithi176.stdout:1/216: chown d0/c16 389 1 2024-09-21T12:46:52.812 INFO:tasks.workunit.client.1.smithi176.stdout:4/212: unlink d3/d21/d27/c48 0 2024-09-21T12:46:52.814 INFO:tasks.workunit.client.1.smithi176.stdout:3/275: creat d1/d34/d48/f65 x:0 0 0 2024-09-21T12:46:52.818 INFO:tasks.workunit.client.1.smithi176.stdout:2/232: rename d4/l9 to d4/d3a/l49 0 2024-09-21T12:46:52.819 INFO:tasks.workunit.client.1.smithi176.stdout:8/220: mknod d6/db/d13/c44 0 2024-09-21T12:46:52.819 INFO:tasks.workunit.client.1.smithi176.stdout:5/177: creat d0/d10/f36 x:0 0 0 2024-09-21T12:46:52.823 INFO:tasks.workunit.client.1.smithi176.stdout:1/217: creat d0/db/d25/d2b/d43/f54 x:0 0 0 2024-09-21T12:46:52.824 INFO:tasks.workunit.client.1.smithi176.stdout:9/233: link d1/df/d1e/f27 d1/df/d1e/d40/f53 0 2024-09-21T12:46:52.825 INFO:tasks.workunit.client.1.smithi176.stdout:4/213: rename d3/f12 to d3/d5/f4a 0 2024-09-21T12:46:52.826 INFO:tasks.workunit.client.1.smithi176.stdout:2/233: symlink d4/df/l4a 0 2024-09-21T12:46:52.828 INFO:tasks.workunit.client.1.smithi176.stdout:8/221: write d6/d8/f33 [280694,123931] 0 2024-09-21T12:46:52.830 INFO:tasks.workunit.client.1.smithi176.stdout:7/255: getdents d0/d2f/d43 0 2024-09-21T12:46:52.830 INFO:tasks.workunit.client.1.smithi176.stdout:6/220: dwrite d2/dd/d26/d2b/f3b [0,4194304] 0 2024-09-21T12:46:52.834 INFO:tasks.workunit.client.1.smithi176.stdout:0/223: dwrite d9/dc/f4d [0,4194304] 0 2024-09-21T12:46:52.834 INFO:tasks.workunit.client.1.smithi176.stdout:2/234: chown d4/c24 373050 1 2024-09-21T12:46:52.835 INFO:tasks.workunit.client.1.smithi176.stdout:5/178: dread d0/d13/f32 [0,4194304] 0 2024-09-21T12:46:52.835 INFO:tasks.workunit.client.1.smithi176.stdout:6/221: chown d2/dd/d26 43069 1 2024-09-21T12:46:52.837 INFO:tasks.workunit.client.1.smithi176.stdout:7/256: mknod d0/d2/d4d/c58 0 2024-09-21T12:46:52.840 INFO:tasks.workunit.client.1.smithi176.stdout:5/179: read d0/fc [2282513,121221] 0 2024-09-21T12:46:52.843 INFO:tasks.workunit.client.1.smithi176.stdout:2/235: mkdir d4/df/d4b 0 2024-09-21T12:46:52.846 INFO:tasks.workunit.client.1.smithi176.stdout:3/276: dwrite d1/d5/f14 [0,4194304] 0 2024-09-21T12:46:52.846 INFO:tasks.workunit.client.1.smithi176.stdout:7/257: readlink d0/d2/db/d10/d23/l3d 0 2024-09-21T12:46:52.847 INFO:tasks.workunit.client.1.smithi176.stdout:5/180: stat d0/f8 0 2024-09-21T12:46:52.848 INFO:tasks.workunit.client.1.smithi176.stdout:7/258: stat d0/d2/d30 0 2024-09-21T12:46:52.851 INFO:tasks.workunit.client.1.smithi176.stdout:2/236: symlink d4/d2b/l4c 0 2024-09-21T12:46:52.853 INFO:tasks.workunit.client.1.smithi176.stdout:6/222: creat d2/dd/d26/d2b/d42/f49 x:0 0 0 2024-09-21T12:46:52.853 INFO:tasks.workunit.client.1.smithi176.stdout:8/222: dwrite d6/d8/f2e [0,4194304] 0 2024-09-21T12:46:52.855 INFO:tasks.workunit.client.1.smithi176.stdout:7/259: write d0/d2/db/f26 [426152,17382] 0 2024-09-21T12:46:52.855 INFO:tasks.workunit.client.1.smithi176.stdout:0/224: getdents d9/d1a/d3f/d40 0 2024-09-21T12:46:52.856 INFO:tasks.workunit.client.1.smithi176.stdout:3/277: mknod d1/d3e/c66 0 2024-09-21T12:46:52.857 INFO:tasks.workunit.client.1.smithi176.stdout:5/181: mkdir d0/d10/d11/d2e/d37 0 2024-09-21T12:46:52.858 INFO:tasks.workunit.client.1.smithi176.stdout:8/223: stat d6/d8/l12 0 2024-09-21T12:46:52.858 INFO:tasks.workunit.client.1.smithi176.stdout:0/225: stat d9/d1a/d1d/d23/f32 0 2024-09-21T12:46:52.859 INFO:tasks.workunit.client.1.smithi176.stdout:9/234: dread d1/df/d23/f24 [0,4194304] 0 2024-09-21T12:46:52.859 INFO:tasks.workunit.client.1.smithi176.stdout:7/260: chown d0/d2/db/d10/f2b 11 1 2024-09-21T12:46:52.860 INFO:tasks.workunit.client.1.smithi176.stdout:7/261: dread - d0/d2/f4f zero size 2024-09-21T12:46:52.862 INFO:tasks.workunit.client.1.smithi176.stdout:0/226: creat d9/d1b/f56 x:0 0 0 2024-09-21T12:46:52.863 INFO:tasks.workunit.client.1.smithi176.stdout:9/235: symlink d1/df/d23/l54 0 2024-09-21T12:46:52.863 INFO:tasks.workunit.client.1.smithi176.stdout:4/214: write d3/d21/f29 [752747,6077] 0 2024-09-21T12:46:52.864 INFO:tasks.workunit.client.1.smithi176.stdout:3/278: dread d1/d5/d25/f26 [0,4194304] 0 2024-09-21T12:46:52.865 INFO:tasks.workunit.client.1.smithi176.stdout:7/262: write d0/d2/db/f21 [66309,126662] 0 2024-09-21T12:46:52.867 INFO:tasks.workunit.client.1.smithi176.stdout:1/218: dread d0/f6 [0,4194304] 0 2024-09-21T12:46:52.867 INFO:tasks.workunit.client.1.smithi176.stdout:3/279: chown d1/d5/c1e 23962573 1 2024-09-21T12:46:52.868 INFO:tasks.workunit.client.1.smithi176.stdout:1/219: chown d0/f6 147960634 1 2024-09-21T12:46:52.869 INFO:tasks.workunit.client.1.smithi176.stdout:6/223: getdents d2/dd/d26/d2b/d10/d1b/d37 0 2024-09-21T12:46:52.869 INFO:tasks.workunit.client.1.smithi176.stdout:2/237: truncate d4/d2b/f33 4861072 0 2024-09-21T12:46:52.869 INFO:tasks.workunit.client.1.smithi176.stdout:0/227: symlink d9/d1a/d1d/d23/l57 0 2024-09-21T12:46:52.869 INFO:tasks.workunit.client.1.smithi176.stdout:4/215: creat d3/d21/d27/d2c/f4b x:0 0 0 2024-09-21T12:46:52.870 INFO:tasks.workunit.client.1.smithi176.stdout:3/280: dread d1/d35/f36 [0,4194304] 0 2024-09-21T12:46:52.871 INFO:tasks.workunit.client.1.smithi176.stdout:0/228: dread - d9/dc/d1e/f2e zero size 2024-09-21T12:46:52.872 INFO:tasks.workunit.client.1.smithi176.stdout:1/220: write d0/db/d1a/d2c/d37/f45 [569494,111623] 0 2024-09-21T12:46:52.873 INFO:tasks.workunit.client.1.smithi176.stdout:3/281: chown d1/d34/f52 226 1 2024-09-21T12:46:52.873 INFO:tasks.workunit.client.1.smithi176.stdout:6/224: unlink d2/l18 0 2024-09-21T12:46:52.873 INFO:tasks.workunit.client.1.smithi176.stdout:2/238: write d4/d3a/f45 [2269715,26678] 0 2024-09-21T12:46:52.874 INFO:tasks.workunit.client.1.smithi176.stdout:7/263: rename d0/d2/d4d to d0/d2f/d59 0 2024-09-21T12:46:52.875 INFO:tasks.workunit.client.1.smithi176.stdout:0/229: unlink d9/d1b/c1c 0 2024-09-21T12:46:52.876 INFO:tasks.workunit.client.1.smithi176.stdout:7/264: chown d0/d2/l39 491 1 2024-09-21T12:46:52.877 INFO:tasks.workunit.client.1.smithi176.stdout:3/282: creat d1/d34/d42/f67 x:0 0 0 2024-09-21T12:46:52.878 INFO:tasks.workunit.client.1.smithi176.stdout:0/230: chown d9/d1a/l33 20588989 1 2024-09-21T12:46:52.879 INFO:tasks.workunit.client.1.smithi176.stdout:1/221: getdents d0/db/d2a 0 2024-09-21T12:46:52.880 INFO:tasks.workunit.client.1.smithi176.stdout:2/239: dread d4/df/f1c [0,4194304] 0 2024-09-21T12:46:52.882 INFO:tasks.workunit.client.1.smithi176.stdout:3/283: creat d1/d34/d48/f68 x:0 0 0 2024-09-21T12:46:52.883 INFO:tasks.workunit.client.1.smithi176.stdout:2/240: fdatasync d4/f1a 0 2024-09-21T12:46:52.883 INFO:tasks.workunit.client.1.smithi176.stdout:7/265: rename d0/d2/db/d25 to d0/d2/db/d10/d5a 0 2024-09-21T12:46:52.884 INFO:tasks.workunit.client.1.smithi176.stdout:4/216: dwrite d3/d5/f15 [0,4194304] 0 2024-09-21T12:46:52.885 INFO:tasks.workunit.client.1.smithi176.stdout:3/284: readlink d1/l3 0 2024-09-21T12:46:52.887 INFO:tasks.workunit.client.1.smithi176.stdout:7/266: chown d0/d2f/d43/d45 3 1 2024-09-21T12:46:52.892 INFO:tasks.workunit.client.1.smithi176.stdout:2/241: dread d4/df/f21 [0,4194304] 0 2024-09-21T12:46:52.892 INFO:tasks.workunit.client.1.smithi176.stdout:4/217: write d3/d5/db/f20 [595287,11804] 0 2024-09-21T12:46:52.893 INFO:tasks.workunit.client.1.smithi176.stdout:9/236: dread d1/f2f [0,4194304] 0 2024-09-21T12:46:52.894 INFO:tasks.workunit.client.1.smithi176.stdout:1/222: fdatasync d0/db/d1a/d2c/f2d 0 2024-09-21T12:46:52.895 INFO:tasks.workunit.client.1.smithi176.stdout:0/231: dwrite d9/dc/f50 [0,4194304] 0 2024-09-21T12:46:52.896 INFO:tasks.workunit.client.1.smithi176.stdout:0/232: stat d9/dc/ld 0 2024-09-21T12:46:52.896 INFO:tasks.workunit.client.1.smithi176.stdout:6/225: truncate d2/dd/d26/d2b/f19 349769 0 2024-09-21T12:46:52.897 INFO:tasks.workunit.client.1.smithi176.stdout:1/223: chown d0/db/c33 76 1 2024-09-21T12:46:52.897 INFO:tasks.workunit.client.1.smithi176.stdout:7/267: rename d0/d2/f1e to d0/d2/db/d10/d3b/f5b 0 2024-09-21T12:46:52.924 INFO:tasks.workunit.client.1.smithi176.stdout:4/218: read d3/d5/db/f20 [418275,70066] 0 2024-09-21T12:46:52.925 INFO:tasks.workunit.client.1.smithi176.stdout:0/233: readlink d9/d1a/d3f/l48 0 2024-09-21T12:46:52.926 INFO:tasks.workunit.client.1.smithi176.stdout:1/224: symlink d0/db/d25/d41/l55 0 2024-09-21T12:46:52.926 INFO:tasks.workunit.client.1.smithi176.stdout:2/242: dread d4/df/f31 [0,4194304] 0 2024-09-21T12:46:52.927 INFO:tasks.workunit.client.1.smithi176.stdout:9/237: dread d1/df/d1c/f49 [0,4194304] 0 2024-09-21T12:46:52.927 INFO:tasks.workunit.client.1.smithi176.stdout:3/285: link d1/d5/d25/d38/l45 d1/d34/l69 0 2024-09-21T12:46:52.927 INFO:tasks.workunit.client.1.smithi176.stdout:0/234: rmdir d9 39 2024-09-21T12:46:52.928 INFO:tasks.workunit.client.1.smithi176.stdout:6/226: creat d2/dd/d26/d2b/d10/d39/f4a x:0 0 0 2024-09-21T12:46:52.930 INFO:tasks.workunit.client.1.smithi176.stdout:3/286: truncate d1/d34/d48/f4e 771386 0 2024-09-21T12:46:52.931 INFO:tasks.workunit.client.1.smithi176.stdout:9/238: rmdir d1/df/d48 39 2024-09-21T12:46:52.932 INFO:tasks.workunit.client.1.smithi176.stdout:0/235: write d9/f11 [4773788,15847] 0 2024-09-21T12:46:52.933 INFO:tasks.workunit.client.1.smithi176.stdout:4/219: mknod d3/d5/d37/c4c 0 2024-09-21T12:46:52.935 INFO:tasks.workunit.client.1.smithi176.stdout:6/227: creat d2/dd/d26/d2b/d10/d1b/d37/f4b x:0 0 0 2024-09-21T12:46:52.936 INFO:tasks.workunit.client.1.smithi176.stdout:3/287: rename d1/d5/c20 to d1/d5/d25/c6a 0 2024-09-21T12:46:52.937 INFO:tasks.workunit.client.1.smithi176.stdout:0/236: creat d9/d1a/f58 x:0 0 0 2024-09-21T12:46:52.938 INFO:tasks.workunit.client.1.smithi176.stdout:2/243: dwrite d4/f19 [0,4194304] 0 2024-09-21T12:46:52.938 INFO:tasks.workunit.client.1.smithi176.stdout:4/220: unlink d3/d5/f1c 0 2024-09-21T12:46:52.939 INFO:tasks.workunit.client.1.smithi176.stdout:2/244: fdatasync d4/d3a/f45 0 2024-09-21T12:46:52.940 INFO:tasks.workunit.client.1.smithi176.stdout:9/239: creat d1/df/d48/f55 x:0 0 0 2024-09-21T12:46:52.941 INFO:tasks.workunit.client.1.smithi176.stdout:6/228: dread d2/dd/f11 [0,4194304] 0 2024-09-21T12:46:52.942 INFO:tasks.workunit.client.1.smithi176.stdout:3/288: symlink d1/d5/l6b 0 2024-09-21T12:46:52.944 INFO:tasks.workunit.client.1.smithi176.stdout:0/237: write d9/f27 [5021268,123742] 0 2024-09-21T12:46:52.946 INFO:tasks.workunit.client.1.smithi176.stdout:7/268: dread d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:46:52.947 INFO:tasks.workunit.client.1.smithi176.stdout:4/221: unlink d3/d21/f29 0 2024-09-21T12:46:52.950 INFO:tasks.workunit.client.1.smithi176.stdout:3/289: symlink d1/d34/d42/d5b/l6c 0 2024-09-21T12:46:52.952 INFO:tasks.workunit.client.1.smithi176.stdout:7/269: creat d0/d2/f5c x:0 0 0 2024-09-21T12:46:52.954 INFO:tasks.workunit.client.1.smithi176.stdout:6/229: rename d2/ca to d2/dd/d26/d2b/d10/d1b/d37/c4c 0 2024-09-21T12:46:52.954 INFO:tasks.workunit.client.1.smithi176.stdout:0/238: creat d9/d1a/d1d/d4f/f59 x:0 0 0 2024-09-21T12:46:52.957 INFO:tasks.workunit.client.1.smithi176.stdout:6/230: write d2/dd/d26/d2b/d10/d39/f46 [653795,45458] 0 2024-09-21T12:46:52.957 INFO:tasks.workunit.client.1.smithi176.stdout:7/270: fsync d0/f17 0 2024-09-21T12:46:52.957 INFO:tasks.workunit.client.1.smithi176.stdout:4/222: mkdir d3/d42/d4d 0 2024-09-21T12:46:52.958 INFO:tasks.workunit.client.1.smithi176.stdout:0/239: write d9/d1a/f58 [1013660,56868] 0 2024-09-21T12:46:52.958 INFO:tasks.workunit.client.1.smithi176.stdout:2/245: getdents d4/df/d3f 0 2024-09-21T12:46:52.959 INFO:tasks.workunit.client.1.smithi176.stdout:6/231: stat d2/dd/d26/l32 0 2024-09-21T12:46:52.960 INFO:tasks.workunit.client.1.smithi176.stdout:9/240: link d1/l3e d1/df/d48/l56 0 2024-09-21T12:46:52.960 INFO:tasks.workunit.client.1.smithi176.stdout:0/240: chown d9/d1a/d1d/d4f/f59 147752019 1 2024-09-21T12:46:52.960 INFO:tasks.workunit.client.1.smithi176.stdout:2/246: chown d4/f37 166 1 2024-09-21T12:46:52.962 INFO:tasks.workunit.client.1.smithi176.stdout:9/241: chown d1/df/c13 892237348 1 2024-09-21T12:46:52.964 INFO:tasks.workunit.client.1.smithi176.stdout:0/241: stat d9/d1a/d20/l3d 0 2024-09-21T12:46:52.964 INFO:tasks.workunit.client.1.smithi176.stdout:2/247: unlink d4/df/f31 0 2024-09-21T12:46:52.964 INFO:tasks.workunit.client.1.smithi176.stdout:6/232: truncate d2/dd/f48 503739 0 2024-09-21T12:46:52.966 INFO:tasks.workunit.client.1.smithi176.stdout:2/248: readlink d4/ld 0 2024-09-21T12:46:52.967 INFO:tasks.workunit.client.1.smithi176.stdout:6/233: write d2/dd/d26/f3d [1504197,74715] 0 2024-09-21T12:46:52.969 INFO:tasks.workunit.client.1.smithi176.stdout:0/242: creat d9/d1a/d1d/d53/f5a x:0 0 0 2024-09-21T12:46:52.969 INFO:tasks.workunit.client.1.smithi176.stdout:2/249: stat d4/df/d2e/l46 0 2024-09-21T12:46:52.971 INFO:tasks.workunit.client.1.smithi176.stdout:4/223: dwrite d3/d5/db/d36/f43 [0,4194304] 0 2024-09-21T12:46:52.973 INFO:tasks.workunit.client.1.smithi176.stdout:7/271: dwrite d0/d2/db/d10/d5a/f38 [0,4194304] 0 2024-09-21T12:46:52.973 INFO:tasks.workunit.client.1.smithi176.stdout:3/290: write d1/d35/f36 [235538,14453] 0 2024-09-21T12:46:52.973 INFO:tasks.workunit.client.1.smithi176.stdout:2/250: write d4/df/f2a [3266480,69297] 0 2024-09-21T12:46:52.974 INFO:tasks.workunit.client.1.smithi176.stdout:6/234: fsync d2/dd/d26/d2b/d10/d1b/f2a 0 2024-09-21T12:46:52.976 INFO:tasks.workunit.client.1.smithi176.stdout:2/251: fdatasync d4/d3a/f45 0 2024-09-21T12:46:52.978 INFO:tasks.workunit.client.1.smithi176.stdout:3/291: read d1/d5/f1b [1817476,68032] 0 2024-09-21T12:46:52.980 INFO:tasks.workunit.client.1.smithi176.stdout:7/272: mkdir d0/d5d 0 2024-09-21T12:46:52.981 INFO:tasks.workunit.client.1.smithi176.stdout:2/252: truncate d4/f38 631694 0 2024-09-21T12:46:52.983 INFO:tasks.workunit.client.1.smithi176.stdout:2/253: read d4/f38 [362331,114168] 0 2024-09-21T12:46:52.984 INFO:tasks.workunit.client.1.smithi176.stdout:3/292: mknod d1/c6d 0 2024-09-21T12:46:52.986 INFO:tasks.workunit.client.1.smithi176.stdout:2/254: fdatasync d4/df/f22 0 2024-09-21T12:46:52.988 INFO:tasks.workunit.client.1.smithi176.stdout:9/242: dread d1/df/f46 [0,4194304] 0 2024-09-21T12:46:52.989 INFO:tasks.workunit.client.1.smithi176.stdout:7/273: mkdir d0/d5d/d5e 0 2024-09-21T12:46:52.990 INFO:tasks.workunit.client.1.smithi176.stdout:0/243: dwrite d9/d1a/d1d/d22/f2a [0,4194304] 0 2024-09-21T12:46:52.990 INFO:tasks.workunit.client.1.smithi176.stdout:4/224: dwrite d3/d5/f13 [0,4194304] 0 2024-09-21T12:46:52.992 INFO:tasks.workunit.client.1.smithi176.stdout:6/235: link d2/dd/c40 d2/dd/d26/c4d 0 2024-09-21T12:46:52.993 INFO:tasks.workunit.client.1.smithi176.stdout:9/243: readlink d1/l1d 0 2024-09-21T12:46:52.996 INFO:tasks.workunit.client.1.smithi176.stdout:3/293: getdents d1/d34/d48 0 2024-09-21T12:46:52.998 INFO:tasks.workunit.client.1.smithi176.stdout:6/236: mknod d2/dd/d26/d2b/d10/c4e 0 2024-09-21T12:46:52.999 INFO:tasks.workunit.client.1.smithi176.stdout:9/244: read d1/df/d1e/d40/f53 [35148,98427] 0 2024-09-21T12:46:52.999 INFO:tasks.workunit.client.1.smithi176.stdout:5/182: sync 2024-09-21T12:46:53.003 INFO:tasks.workunit.client.1.smithi176.stdout:0/244: truncate f5 3863032 0 2024-09-21T12:46:53.004 INFO:tasks.workunit.client.1.smithi176.stdout:6/237: rename d2/f15 to d2/dd/d26/d2b/d10/d1b/d37/f4f 0 2024-09-21T12:46:53.006 INFO:tasks.workunit.client.1.smithi176.stdout:0/245: rmdir d9/d1a/d3f 39 2024-09-21T12:46:53.006 INFO:tasks.workunit.client.1.smithi176.stdout:6/238: write d2/dd/d26/d2b/d10/d39/f46 [1005821,1572] 0 2024-09-21T12:46:53.007 INFO:tasks.workunit.client.1.smithi176.stdout:7/274: dread d0/d2/db/ff [0,4194304] 0 2024-09-21T12:46:53.009 INFO:tasks.workunit.client.1.smithi176.stdout:5/183: dread d0/ff [0,4194304] 0 2024-09-21T12:46:53.009 INFO:tasks.workunit.client.1.smithi176.stdout:7/275: rmdir d0/d2/db/d10/d5a 39 2024-09-21T12:46:53.010 INFO:tasks.workunit.client.1.smithi176.stdout:7/276: chown d0/f16 67 1 2024-09-21T12:46:53.010 INFO:tasks.workunit.client.1.smithi176.stdout:0/246: getdents d9/d1b/d43 0 2024-09-21T12:46:53.012 INFO:tasks.workunit.client.1.smithi176.stdout:0/247: unlink d9/f11 0 2024-09-21T12:46:53.014 INFO:tasks.workunit.client.1.smithi176.stdout:7/277: creat d0/d5d/d5e/f5f x:0 0 0 2024-09-21T12:46:53.016 INFO:tasks.workunit.client.1.smithi176.stdout:6/239: fsync d2/dd/d26/d2b/d10/d1b/d37/f4f 0 2024-09-21T12:46:53.018 INFO:tasks.workunit.client.1.smithi176.stdout:6/240: stat d2/dd/f11 0 2024-09-21T12:46:53.020 INFO:tasks.workunit.client.1.smithi176.stdout:7/278: rename d0/d2f/c3f to d0/d2/d30/c60 0 2024-09-21T12:46:53.023 INFO:tasks.workunit.client.1.smithi176.stdout:0/248: dwrite d9/f52 [0,4194304] 0 2024-09-21T12:46:53.024 INFO:tasks.workunit.client.1.smithi176.stdout:6/241: fdatasync d2/dd/d26/d2b/f19 0 2024-09-21T12:46:53.024 INFO:tasks.workunit.client.1.smithi176.stdout:7/279: readlink d0/d2/db/d10/d23/l4c 0 2024-09-21T12:46:53.024 INFO:tasks.workunit.client.1.smithi176.stdout:4/225: dwrite d3/d5/f4a [0,4194304] 0 2024-09-21T12:46:53.026 INFO:tasks.workunit.client.1.smithi176.stdout:0/249: write d9/f16 [4797,92325] 0 2024-09-21T12:46:53.026 INFO:tasks.workunit.client.1.smithi176.stdout:6/242: chown d2/dd/d26/d2b/f2e 32154404 1 2024-09-21T12:46:53.034 INFO:tasks.workunit.client.1.smithi176.stdout:6/243: getdents d2/dd/d26/d2b/d10 0 2024-09-21T12:46:53.038 INFO:tasks.workunit.client.1.smithi176.stdout:0/250: dwrite d9/d1a/d1d/d22/f3b [0,4194304] 0 2024-09-21T12:46:53.038 INFO:tasks.workunit.client.1.smithi176.stdout:6/244: chown d2/dd/d26/d2b/l16 5578 1 2024-09-21T12:46:53.041 INFO:tasks.workunit.client.1.smithi176.stdout:6/245: rename d2/dd/d26/d2b/d42 to d2/dd/d26/d2b/d10/d1b/d50 0 2024-09-21T12:46:53.043 INFO:tasks.workunit.client.1.smithi176.stdout:7/280: write d0/d2/db/d10/d3b/f5b [78479,64140] 0 2024-09-21T12:46:53.043 INFO:tasks.workunit.client.1.smithi176.stdout:4/226: truncate d3/d21/d27/f40 1489673 0 2024-09-21T12:46:53.047 INFO:tasks.workunit.client.1.smithi176.stdout:6/246: write d2/dd/d26/d2b/d10/f12 [2597713,21823] 0 2024-09-21T12:46:53.047 INFO:tasks.workunit.client.1.smithi176.stdout:4/227: unlink f1 0 2024-09-21T12:46:53.048 INFO:tasks.workunit.client.1.smithi176.stdout:0/251: dwrite d9/dc/d1e/f2e [0,4194304] 0 2024-09-21T12:46:53.049 INFO:tasks.workunit.client.1.smithi176.stdout:7/281: mkdir d0/d2/db/d10/d61 0 2024-09-21T12:46:53.050 INFO:tasks.workunit.client.1.smithi176.stdout:4/228: mkdir d3/d21/d27/d2f/d4e 0 2024-09-21T12:46:53.051 INFO:tasks.workunit.client.1.smithi176.stdout:7/282: write d0/d2/db/d10/d23/f28 [1310210,69202] 0 2024-09-21T12:46:53.052 INFO:tasks.workunit.client.1.smithi176.stdout:0/252: creat d9/d1a/d1d/d23/f5b x:0 0 0 2024-09-21T12:46:53.053 INFO:tasks.workunit.client.1.smithi176.stdout:4/229: mknod d3/d5/db/d36/c4f 0 2024-09-21T12:46:53.060 INFO:tasks.workunit.client.1.smithi176.stdout:0/253: dwrite d9/dc/d1e/f2e [0,4194304] 0 2024-09-21T12:46:53.061 INFO:tasks.workunit.client.1.smithi176.stdout:4/230: link d3/f32 d3/d5/db/f50 0 2024-09-21T12:46:53.062 INFO:tasks.workunit.client.1.smithi176.stdout:0/254: chown d9/d1b/d43/l49 0 1 2024-09-21T12:46:53.062 INFO:tasks.workunit.client.1.smithi176.stdout:4/231: write d3/d5/f44 [399693,13924] 0 2024-09-21T12:46:53.064 INFO:tasks.workunit.client.1.smithi176.stdout:0/255: chown d9/d1a/d1d/d4f/f59 595227157 1 2024-09-21T12:46:53.064 INFO:tasks.workunit.client.1.smithi176.stdout:0/256: readlink d9/la 0 2024-09-21T12:46:53.065 INFO:tasks.workunit.client.1.smithi176.stdout:0/257: dread - d9/d1a/d1d/d23/f44 zero size 2024-09-21T12:46:53.065 INFO:tasks.workunit.client.1.smithi176.stdout:4/232: chown d3/d21/d27/d2c/f41 24 1 2024-09-21T12:46:53.067 INFO:tasks.workunit.client.1.smithi176.stdout:0/258: chown d9/d1a/d3f/d40/f4c 162 1 2024-09-21T12:46:53.068 INFO:tasks.workunit.client.1.smithi176.stdout:0/259: rename d9/dc/d1e to d9/dc/d1e/d47/d5c 22 2024-09-21T12:46:53.068 INFO:tasks.workunit.client.1.smithi176.stdout:4/233: symlink d3/l51 0 2024-09-21T12:46:53.068 INFO:tasks.workunit.client.1.smithi176.stdout:0/260: stat l4 0 2024-09-21T12:46:53.071 INFO:tasks.workunit.client.1.smithi176.stdout:0/261: rename d9/d1a/d1d/d22/f24 to d9/dc/f5d 0 2024-09-21T12:46:53.073 INFO:tasks.workunit.client.1.smithi176.stdout:4/234: creat d3/d21/d27/d2f/d4e/f52 x:0 0 0 2024-09-21T12:46:53.074 INFO:tasks.workunit.client.1.smithi176.stdout:0/262: mknod d9/dc/d1e/d47/c5e 0 2024-09-21T12:46:53.075 INFO:tasks.workunit.client.1.smithi176.stdout:4/235: fsync d3/d5/db/f31 0 2024-09-21T12:46:53.076 INFO:tasks.workunit.client.1.smithi176.stdout:0/263: write d9/d1a/d1d/d4f/f59 [493417,57908] 0 2024-09-21T12:46:53.076 INFO:tasks.workunit.client.1.smithi176.stdout:4/236: readlink d3/l24 0 2024-09-21T12:46:53.077 INFO:tasks.workunit.client.1.smithi176.stdout:4/237: stat d3/d5/f4a 0 2024-09-21T12:46:53.077 INFO:tasks.workunit.client.1.smithi176.stdout:0/264: write d9/dc/f15 [565436,15419] 0 2024-09-21T12:46:53.078 INFO:tasks.workunit.client.1.smithi176.stdout:7/283: dread d0/d2/db/fe [0,4194304] 0 2024-09-21T12:46:53.080 INFO:tasks.workunit.client.1.smithi176.stdout:0/265: unlink l6 0 2024-09-21T12:46:53.081 INFO:tasks.workunit.client.1.smithi176.stdout:0/266: write d9/d1a/d1d/d22/f3b [2050470,60208] 0 2024-09-21T12:46:53.081 INFO:tasks.workunit.client.1.smithi176.stdout:7/284: truncate d0/d2f/d43/f52 1027260 0 2024-09-21T12:46:53.083 INFO:tasks.workunit.client.1.smithi176.stdout:4/238: unlink d3/d21/d27/d2c/f39 0 2024-09-21T12:46:53.086 INFO:tasks.workunit.client.1.smithi176.stdout:0/267: mkdir d9/d1a/d1d/d23/d5f 0 2024-09-21T12:46:53.086 INFO:tasks.workunit.client.1.smithi176.stdout:0/268: stat d9/dc/d1e/d47/c5e 0 2024-09-21T12:46:53.089 INFO:tasks.workunit.client.1.smithi176.stdout:4/239: creat d3/d42/f53 x:0 0 0 2024-09-21T12:46:53.114 INFO:tasks.workunit.client.1.smithi176.stdout:8/224: sync 2024-09-21T12:46:53.114 INFO:tasks.workunit.client.1.smithi176.stdout:1/225: sync 2024-09-21T12:46:53.120 INFO:tasks.workunit.client.1.smithi176.stdout:7/285: rename d0/d2f/d59/c58 to d0/d2f/c62 0 2024-09-21T12:46:53.123 INFO:tasks.workunit.client.1.smithi176.stdout:0/269: rename d9/cb to d9/d1a/d1d/d4f/c60 0 2024-09-21T12:46:53.124 INFO:tasks.workunit.client.1.smithi176.stdout:0/270: fdatasync d9/d1a/f30 0 2024-09-21T12:46:53.124 INFO:tasks.workunit.client.1.smithi176.stdout:8/225: symlink d6/db/d37/l45 0 2024-09-21T12:46:53.125 INFO:tasks.workunit.client.1.smithi176.stdout:0/271: fdatasync d9/f16 0 2024-09-21T12:46:53.126 INFO:tasks.workunit.client.1.smithi176.stdout:4/240: dwrite d3/d21/d27/d2f/d4e/f52 [0,4194304] 0 2024-09-21T12:46:53.127 INFO:tasks.workunit.client.1.smithi176.stdout:4/241: dread - d3/d5/db/f50 zero size 2024-09-21T12:46:53.127 INFO:tasks.workunit.client.1.smithi176.stdout:1/226: readlink d0/db/d1a/d2c/d37/l3f 0 2024-09-21T12:46:53.131 INFO:tasks.workunit.client.1.smithi176.stdout:8/226: mknod d6/d8/d24/c46 0 2024-09-21T12:46:53.133 INFO:tasks.workunit.client.1.smithi176.stdout:8/227: write d6/db/d13/f29 [4877812,82226] 0 2024-09-21T12:46:53.134 INFO:tasks.workunit.client.1.smithi176.stdout:8/228: dread - d6/db/d37/f3a zero size 2024-09-21T12:46:53.135 INFO:tasks.workunit.client.1.smithi176.stdout:8/229: readlink d6/db/d37/l45 0 2024-09-21T12:46:53.136 INFO:tasks.workunit.client.1.smithi176.stdout:1/227: creat d0/db/d1a/d2c/d37/f56 x:0 0 0 2024-09-21T12:46:53.138 INFO:tasks.workunit.client.1.smithi176.stdout:7/286: link d0/f33 d0/f63 0 2024-09-21T12:46:53.141 INFO:tasks.workunit.client.1.smithi176.stdout:8/230: rmdir d6/d8/d24/d35 39 2024-09-21T12:46:53.142 INFO:tasks.workunit.client.1.smithi176.stdout:7/287: dread d0/d2/db/f21 [0,4194304] 0 2024-09-21T12:46:53.143 INFO:tasks.workunit.client.1.smithi176.stdout:7/288: chown d0/d2f/d43/c49 8124534 1 2024-09-21T12:46:53.143 INFO:tasks.workunit.client.1.smithi176.stdout:0/272: readlink d9/d1a/d3f/l4a 0 2024-09-21T12:46:53.144 INFO:tasks.workunit.client.1.smithi176.stdout:0/273: chown d9/dc/l19 8646272 1 2024-09-21T12:46:53.144 INFO:tasks.workunit.client.1.smithi176.stdout:0/274: chown d9/d1a/d1d/d4f 870035 1 2024-09-21T12:46:53.145 INFO:tasks.workunit.client.1.smithi176.stdout:8/231: readlink d6/d16/d36/l3d 0 2024-09-21T12:46:53.147 INFO:tasks.workunit.client.1.smithi176.stdout:7/289: rmdir d0/d2f 39 2024-09-21T12:46:53.147 INFO:tasks.workunit.client.1.smithi176.stdout:7/290: write d0/d2/f4f [261592,125354] 0 2024-09-21T12:46:53.148 INFO:tasks.workunit.client.1.smithi176.stdout:1/228: creat d0/db/d1a/d2c/f57 x:0 0 0 2024-09-21T12:46:53.149 INFO:tasks.workunit.client.1.smithi176.stdout:1/229: write d0/db/d1a/f20 [1983612,56191] 0 2024-09-21T12:46:53.149 INFO:tasks.workunit.client.1.smithi176.stdout:0/275: creat d9/d1a/d1d/d23/d5f/f61 x:0 0 0 2024-09-21T12:46:53.153 INFO:tasks.workunit.client.1.smithi176.stdout:4/242: dread d3/d21/f2a [0,4194304] 0 2024-09-21T12:46:53.155 INFO:tasks.workunit.client.1.smithi176.stdout:4/243: mknod d3/d5/d37/c54 0 2024-09-21T12:46:53.156 INFO:tasks.workunit.client.1.smithi176.stdout:8/232: truncate d6/db/f17 2592757 0 2024-09-21T12:46:53.159 INFO:tasks.workunit.client.1.smithi176.stdout:8/233: symlink d6/l47 0 2024-09-21T12:46:53.162 INFO:tasks.workunit.client.1.smithi176.stdout:7/291: dwrite d0/d2/db/f21 [0,4194304] 0 2024-09-21T12:46:53.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/276: dread d9/dc/f15 [0,4194304] 0 2024-09-21T12:46:53.171 INFO:tasks.workunit.client.1.smithi176.stdout:7/292: symlink d0/d2f/d43/d45/l64 0 2024-09-21T12:46:53.171 INFO:tasks.workunit.client.1.smithi176.stdout:4/244: dwrite d3/d21/d27/f40 [0,4194304] 0 2024-09-21T12:46:53.172 INFO:tasks.workunit.client.1.smithi176.stdout:0/277: write d9/d1a/d1d/d22/f2a [425589,63206] 0 2024-09-21T12:46:53.175 INFO:tasks.workunit.client.1.smithi176.stdout:8/234: truncate d6/d16/f2d 1143641 0 2024-09-21T12:46:53.178 INFO:tasks.workunit.client.1.smithi176.stdout:0/278: symlink d9/d1a/d1d/d53/l62 0 2024-09-21T12:46:53.180 INFO:tasks.workunit.client.1.smithi176.stdout:0/279: mkdir d9/d1b/d63 0 2024-09-21T12:46:53.182 INFO:tasks.workunit.client.1.smithi176.stdout:8/235: dwrite d6/d8/f2e [0,4194304] 0 2024-09-21T12:46:53.183 INFO:tasks.workunit.client.1.smithi176.stdout:0/280: write d9/d1a/d1d/d23/f5b [487026,76406] 0 2024-09-21T12:46:53.183 INFO:tasks.workunit.client.1.smithi176.stdout:7/293: rename d0/d2f/d43/d45 to d0/d2/db/d10/d31/d65 0 2024-09-21T12:46:53.186 INFO:tasks.workunit.client.1.smithi176.stdout:7/294: rmdir d0/d5d 39 2024-09-21T12:46:53.187 INFO:tasks.workunit.client.1.smithi176.stdout:0/281: unlink d9/dc/f15 0 2024-09-21T12:46:53.190 INFO:tasks.workunit.client.1.smithi176.stdout:8/236: rename d6/d16/l2f to d6/db/l48 0 2024-09-21T12:46:53.192 INFO:tasks.workunit.client.1.smithi176.stdout:4/245: truncate d3/d5/fd 783689 0 2024-09-21T12:46:53.195 INFO:tasks.workunit.client.1.smithi176.stdout:0/282: read f5 [2226370,37338] 0 2024-09-21T12:46:53.196 INFO:tasks.workunit.client.1.smithi176.stdout:7/295: creat d0/d2f/f66 x:0 0 0 2024-09-21T12:46:53.197 INFO:tasks.workunit.client.1.smithi176.stdout:7/296: read - d0/f17 zero size 2024-09-21T12:46:53.200 INFO:tasks.workunit.client.1.smithi176.stdout:0/283: unlink d9/l46 0 2024-09-21T12:46:53.200 INFO:tasks.workunit.client.1.smithi176.stdout:8/237: link l2 d6/l49 0 2024-09-21T12:46:53.201 INFO:tasks.workunit.client.1.smithi176.stdout:4/246: dwrite d3/d5/db/f20 [0,4194304] 0 2024-09-21T12:46:53.204 INFO:tasks.workunit.client.1.smithi176.stdout:8/238: creat d6/d8/d24/d35/f4a x:0 0 0 2024-09-21T12:46:53.206 INFO:tasks.workunit.client.1.smithi176.stdout:7/297: getdents d0/d2/db/d10/d23 0 2024-09-21T12:46:53.210 INFO:tasks.workunit.client.1.smithi176.stdout:8/239: creat d6/d16/f4b x:0 0 0 2024-09-21T12:46:53.212 INFO:tasks.workunit.client.1.smithi176.stdout:7/298: rmdir d0/d2/d30 39 2024-09-21T12:46:53.212 INFO:tasks.workunit.client.1.smithi176.stdout:0/284: dwrite d9/d1a/f30 [0,4194304] 0 2024-09-21T12:46:53.213 INFO:tasks.workunit.client.1.smithi176.stdout:4/247: dwrite d3/d42/f53 [0,4194304] 0 2024-09-21T12:46:53.215 INFO:tasks.workunit.client.1.smithi176.stdout:8/240: symlink d6/d8/l4c 0 2024-09-21T12:46:53.215 INFO:tasks.workunit.client.1.smithi176.stdout:0/285: truncate f5 2936464 0 2024-09-21T12:46:53.215 INFO:tasks.workunit.client.1.smithi176.stdout:7/299: readlink d0/d2/db/d10/d31/d65/l64 0 2024-09-21T12:46:53.219 INFO:tasks.workunit.client.1.smithi176.stdout:0/286: write d9/dc/f38 [911069,33424] 0 2024-09-21T12:46:53.222 INFO:tasks.workunit.client.1.smithi176.stdout:4/248: getdents d3/d21/d27/d2f/d4e 0 2024-09-21T12:46:53.223 INFO:tasks.workunit.client.1.smithi176.stdout:2/255: sync 2024-09-21T12:46:53.224 INFO:tasks.workunit.client.1.smithi176.stdout:0/287: truncate d9/dc/f38 1933914 0 2024-09-21T12:46:53.224 INFO:tasks.workunit.client.1.smithi176.stdout:7/300: dread d0/d2f/d43/f52 [0,4194304] 0 2024-09-21T12:46:53.226 INFO:tasks.workunit.client.1.smithi176.stdout:4/249: symlink d3/d5/db/l55 0 2024-09-21T12:46:53.227 INFO:tasks.workunit.client.1.smithi176.stdout:8/241: dwrite d6/db/d32/f40 [0,4194304] 0 2024-09-21T12:46:53.227 INFO:tasks.workunit.client.1.smithi176.stdout:0/288: write d9/dc/f4d [4294749,9776] 0 2024-09-21T12:46:53.227 INFO:tasks.workunit.client.1.smithi176.stdout:7/301: chown d0/d2/l39 569 1 2024-09-21T12:46:53.229 INFO:tasks.workunit.client.1.smithi176.stdout:8/242: chown d6/d8/d24 1202165 1 2024-09-21T12:46:53.230 INFO:tasks.workunit.client.1.smithi176.stdout:2/256: rmdir d4/df/d2e/d42 0 2024-09-21T12:46:53.230 INFO:tasks.workunit.client.1.smithi176.stdout:7/302: dread d0/d2/db/d10/d31/d65/f47 [0,4194304] 0 2024-09-21T12:46:53.231 INFO:tasks.workunit.client.1.smithi176.stdout:8/243: creat d6/db/d13/f4d x:0 0 0 2024-09-21T12:46:53.232 INFO:tasks.workunit.client.1.smithi176.stdout:0/289: symlink d9/d1a/d3f/l64 0 2024-09-21T12:46:53.234 INFO:tasks.workunit.client.1.smithi176.stdout:8/244: creat d6/d8/d24/d35/f4e x:0 0 0 2024-09-21T12:46:53.235 INFO:tasks.workunit.client.1.smithi176.stdout:0/290: mkdir d9/d1a/d20/d65 0 2024-09-21T12:46:53.238 INFO:tasks.workunit.client.1.smithi176.stdout:0/291: symlink d9/d1a/d1d/d22/l66 0 2024-09-21T12:46:53.243 INFO:tasks.workunit.client.1.smithi176.stdout:0/292: truncate d9/d1a/d1d/d23/f5b 1483810 0 2024-09-21T12:46:53.243 INFO:tasks.workunit.client.1.smithi176.stdout:8/245: dwrite d6/d16/f22 [0,4194304] 0 2024-09-21T12:46:53.244 INFO:tasks.workunit.client.1.smithi176.stdout:0/293: chown d9/d1a/f58 1114 1 2024-09-21T12:46:53.245 INFO:tasks.workunit.client.1.smithi176.stdout:0/294: readlink d9/d1b/l34 0 2024-09-21T12:46:53.246 INFO:tasks.workunit.client.1.smithi176.stdout:0/295: chown d9/f17 19925437 1 2024-09-21T12:46:53.247 INFO:tasks.workunit.client.1.smithi176.stdout:0/296: write d9/f52 [2360955,26179] 0 2024-09-21T12:46:53.250 INFO:tasks.workunit.client.1.smithi176.stdout:7/303: dread d0/d2/f35 [0,4194304] 0 2024-09-21T12:46:53.250 INFO:tasks.workunit.client.1.smithi176.stdout:2/257: dread d4/df/f15 [0,4194304] 0 2024-09-21T12:46:53.251 INFO:tasks.workunit.client.1.smithi176.stdout:3/294: sync 2024-09-21T12:46:53.253 INFO:tasks.workunit.client.1.smithi176.stdout:7/304: dread d0/f33 [0,4194304] 0 2024-09-21T12:46:53.255 INFO:tasks.workunit.client.1.smithi176.stdout:7/305: write d0/d2/db/d10/f1d [4945340,24777] 0 2024-09-21T12:46:53.260 INFO:tasks.workunit.client.1.smithi176.stdout:2/258: chown d4/df/d2e/c34 257519 1 2024-09-21T12:46:53.260 INFO:tasks.workunit.client.1.smithi176.stdout:3/295: rmdir d1/d34 39 2024-09-21T12:46:53.261 INFO:tasks.workunit.client.1.smithi176.stdout:4/250: write d3/d5/fd [125121,53900] 0 2024-09-21T12:46:53.262 INFO:tasks.workunit.client.1.smithi176.stdout:4/251: chown d3/d5/db/d36/c4f 34564 1 2024-09-21T12:46:53.263 INFO:tasks.workunit.client.1.smithi176.stdout:0/297: creat d9/d1a/d3f/d40/f67 x:0 0 0 2024-09-21T12:46:53.263 INFO:tasks.workunit.client.1.smithi176.stdout:4/252: stat d3/d5/db/l23 0 2024-09-21T12:46:53.263 INFO:tasks.workunit.client.1.smithi176.stdout:2/259: mkdir d4/df/d2e/d4d 0 2024-09-21T12:46:53.264 INFO:tasks.workunit.client.1.smithi176.stdout:3/296: mkdir d1/d5/d25/d5c/d6e 0 2024-09-21T12:46:53.265 INFO:tasks.workunit.client.1.smithi176.stdout:8/246: getdents d6/d8/d24/d35 0 2024-09-21T12:46:53.265 INFO:tasks.workunit.client.1.smithi176.stdout:4/253: rmdir d3/d5/d37 39 2024-09-21T12:46:53.266 INFO:tasks.workunit.client.1.smithi176.stdout:4/254: read d3/d21/f2a [2214878,9863] 0 2024-09-21T12:46:53.269 INFO:tasks.workunit.client.1.smithi176.stdout:8/247: creat d6/d8/d24/d35/f4f x:0 0 0 2024-09-21T12:46:53.269 INFO:tasks.workunit.client.1.smithi176.stdout:0/298: rename d9/d1a/d3f/l48 to d9/d1b/d63/l68 0 2024-09-21T12:46:53.269 INFO:tasks.workunit.client.1.smithi176.stdout:8/248: readlink d6/db/d37/l45 0 2024-09-21T12:46:53.271 INFO:tasks.workunit.client.1.smithi176.stdout:3/297: dread d1/d5/f14 [0,4194304] 0 2024-09-21T12:46:53.271 INFO:tasks.workunit.client.1.smithi176.stdout:7/306: getdents d0/d5d/d5e 0 2024-09-21T12:46:53.272 INFO:tasks.workunit.client.1.smithi176.stdout:4/255: rename d3/d21/d27/d2f to d3/d42/d56 0 2024-09-21T12:46:53.273 INFO:tasks.workunit.client.1.smithi176.stdout:0/299: mknod d9/d1a/d1d/d23/c69 0 2024-09-21T12:46:53.274 INFO:tasks.workunit.client.1.smithi176.stdout:8/249: symlink d6/db/d37/l50 0 2024-09-21T12:46:53.274 INFO:tasks.workunit.client.1.smithi176.stdout:3/298: mknod d1/d35/c6f 0 2024-09-21T12:46:53.275 INFO:tasks.workunit.client.1.smithi176.stdout:4/256: write d3/d5/db/f31 [202721,79512] 0 2024-09-21T12:46:53.275 INFO:tasks.workunit.client.1.smithi176.stdout:7/307: rename d0/d2/db/l2a to d0/d2/db/d10/d31/l67 0 2024-09-21T12:46:53.278 INFO:tasks.workunit.client.1.smithi176.stdout:0/300: unlink d9/dc/d1e/f2e 0 2024-09-21T12:46:53.279 INFO:tasks.workunit.client.1.smithi176.stdout:8/250: mkdir d6/d8/d24/d35/d51 0 2024-09-21T12:46:53.281 INFO:tasks.workunit.client.1.smithi176.stdout:4/257: chown d3/d5/d37/c4c 40 1 2024-09-21T12:46:53.281 INFO:tasks.workunit.client.1.smithi176.stdout:8/251: fdatasync d6/db/d13/f4d 0 2024-09-21T12:46:53.281 INFO:tasks.workunit.client.1.smithi176.stdout:3/299: symlink d1/d34/d57/l70 0 2024-09-21T12:46:53.282 INFO:tasks.workunit.client.1.smithi176.stdout:2/260: dwrite d4/df/f15 [0,4194304] 0 2024-09-21T12:46:53.282 INFO:tasks.workunit.client.1.smithi176.stdout:7/308: mknod d0/d2/db/c68 0 2024-09-21T12:46:53.284 INFO:tasks.workunit.client.1.smithi176.stdout:7/309: fsync d0/f20 0 2024-09-21T12:46:53.284 INFO:tasks.workunit.client.1.smithi176.stdout:8/252: dread - d6/db/f43 zero size 2024-09-21T12:46:53.286 INFO:tasks.workunit.client.1.smithi176.stdout:7/310: readlink d0/d2/db/l32 0 2024-09-21T12:46:53.286 INFO:tasks.workunit.client.1.smithi176.stdout:3/300: mkdir d1/d34/d71 0 2024-09-21T12:46:53.286 INFO:tasks.workunit.client.1.smithi176.stdout:4/258: rmdir d3/d21/d27 39 2024-09-21T12:46:53.293 INFO:tasks.workunit.client.1.smithi176.stdout:2/261: link d4/l18 d4/df/l4e 0 2024-09-21T12:46:53.294 INFO:tasks.workunit.client.1.smithi176.stdout:8/253: dwrite d6/d8/f10 [0,4194304] 0 2024-09-21T12:46:53.295 INFO:tasks.workunit.client.1.smithi176.stdout:2/262: dread - d4/df/f1e zero size 2024-09-21T12:46:53.296 INFO:tasks.workunit.client.1.smithi176.stdout:7/311: rename d0/d2/db/d10/d31/l67 to d0/d2/db/l69 0 2024-09-21T12:46:53.298 INFO:tasks.workunit.client.1.smithi176.stdout:6/247: sync 2024-09-21T12:46:53.298 INFO:tasks.workunit.client.1.smithi176.stdout:9/245: sync 2024-09-21T12:46:53.298 INFO:tasks.workunit.client.1.smithi176.stdout:5/184: sync 2024-09-21T12:46:53.298 INFO:tasks.workunit.client.1.smithi176.stdout:1/230: sync 2024-09-21T12:46:53.299 INFO:tasks.workunit.client.1.smithi176.stdout:0/301: dwrite d9/f2b [0,4194304] 0 2024-09-21T12:46:53.300 INFO:tasks.workunit.client.1.smithi176.stdout:2/263: chown d4/l17 39945 1 2024-09-21T12:46:53.300 INFO:tasks.workunit.client.1.smithi176.stdout:3/301: truncate d1/f2f 529301 0 2024-09-21T12:46:53.302 INFO:tasks.workunit.client.1.smithi176.stdout:8/254: truncate d6/d16/f2d 1916994 0 2024-09-21T12:46:53.303 INFO:tasks.workunit.client.1.smithi176.stdout:1/231: chown d0/db/d1a/d2c 1470 1 2024-09-21T12:46:53.304 INFO:tasks.workunit.client.1.smithi176.stdout:3/302: readlink d1/d34/d42/d5b/l6c 0 2024-09-21T12:46:53.304 INFO:tasks.workunit.client.1.smithi176.stdout:5/185: write d0/d10/d11/d2e/f2f [416185,121693] 0 2024-09-21T12:46:53.306 INFO:tasks.workunit.client.1.smithi176.stdout:9/246: write d1/df/d23/f36 [1770797,62189] 0 2024-09-21T12:46:53.308 INFO:tasks.workunit.client.1.smithi176.stdout:7/312: truncate d0/d2/fa 3302241 0 2024-09-21T12:46:53.309 INFO:tasks.workunit.client.1.smithi176.stdout:1/232: creat d0/f58 x:0 0 0 2024-09-21T12:46:53.315 INFO:tasks.workunit.client.1.smithi176.stdout:6/248: truncate d2/dd/d26/d2b/d10/d39/f46 1730603 0 2024-09-21T12:46:53.318 INFO:tasks.workunit.client.1.smithi176.stdout:3/303: mknod d1/d5/d25/d38/c72 0 2024-09-21T12:46:53.319 INFO:tasks.workunit.client.1.smithi176.stdout:4/259: dwrite d3/f32 [0,4194304] 0 2024-09-21T12:46:53.320 INFO:tasks.workunit.client.1.smithi176.stdout:1/233: mkdir d0/db/d25/d41/d59 0 2024-09-21T12:46:53.321 INFO:tasks.workunit.client.1.smithi176.stdout:2/264: link d4/df/c32 d4/df/d2e/c4f 0 2024-09-21T12:46:53.322 INFO:tasks.workunit.client.1.smithi176.stdout:5/186: dread d0/d10/d11/f2c [0,4194304] 0 2024-09-21T12:46:53.322 INFO:tasks.workunit.client.1.smithi176.stdout:8/255: getdents d6/d8/d24 0 2024-09-21T12:46:53.324 INFO:tasks.workunit.client.1.smithi176.stdout:0/302: dwrite d9/d1a/d20/f2d [4194304,4194304] 0 2024-09-21T12:46:53.325 INFO:tasks.workunit.client.1.smithi176.stdout:9/247: rename d1/df/d1e/l20 to d1/df/d1e/d4f/l57 0 2024-09-21T12:46:53.326 INFO:tasks.workunit.client.1.smithi176.stdout:7/313: creat d0/d2/db/f6a x:0 0 0 2024-09-21T12:46:53.330 INFO:tasks.workunit.client.1.smithi176.stdout:3/304: creat d1/d34/d71/f73 x:0 0 0 2024-09-21T12:46:53.330 INFO:tasks.workunit.client.1.smithi176.stdout:2/265: chown d4/df/d2e/c4f 191 1 2024-09-21T12:46:53.332 INFO:tasks.workunit.client.1.smithi176.stdout:7/314: chown d0/d2/f35 99 1 2024-09-21T12:46:53.341 INFO:tasks.workunit.client.1.smithi176.stdout:9/248: mknod d1/df/d1e/d38/c58 0 2024-09-21T12:46:53.341 INFO:tasks.workunit.client.1.smithi176.stdout:6/249: dwrite d2/dd/d26/d2b/d10/d39/f4a [0,4194304] 0 2024-09-21T12:46:53.343 INFO:tasks.workunit.client.1.smithi176.stdout:3/305: mknod d1/d35/d5e/c74 0 2024-09-21T12:46:53.345 INFO:tasks.workunit.client.1.smithi176.stdout:1/234: dread d0/db/d25/d2b/f35 [0,4194304] 0 2024-09-21T12:46:53.346 INFO:tasks.workunit.client.1.smithi176.stdout:2/266: mknod d4/df/d4b/c50 0 2024-09-21T12:46:53.348 INFO:tasks.workunit.client.1.smithi176.stdout:5/187: dwrite d0/d10/f2b [0,4194304] 0 2024-09-21T12:46:53.348 INFO:tasks.workunit.client.1.smithi176.stdout:6/250: chown d2/dd/d26/l35 10809927 1 2024-09-21T12:46:53.350 INFO:tasks.workunit.client.1.smithi176.stdout:1/235: mknod d0/c5a 0 2024-09-21T12:46:53.354 INFO:tasks.workunit.client.1.smithi176.stdout:0/303: dwrite d9/d1b/f1f [0,4194304] 0 2024-09-21T12:46:53.354 INFO:tasks.workunit.client.1.smithi176.stdout:7/315: link d0/d2f/f66 d0/d2f/d43/f6b 0 2024-09-21T12:46:53.358 INFO:tasks.workunit.client.1.smithi176.stdout:0/304: stat d9/f14 0 2024-09-21T12:46:53.359 INFO:tasks.workunit.client.1.smithi176.stdout:1/236: mkdir d0/d5b 0 2024-09-21T12:46:53.363 INFO:tasks.workunit.client.1.smithi176.stdout:3/306: write d1/f1a [808322,22546] 0 2024-09-21T12:46:53.364 INFO:tasks.workunit.client.1.smithi176.stdout:7/316: rmdir d0/d2/db 39 2024-09-21T12:46:53.366 INFO:tasks.workunit.client.1.smithi176.stdout:4/260: dwrite d3/d21/d27/d2c/f35 [0,4194304] 0 2024-09-21T12:46:53.368 INFO:tasks.workunit.client.1.smithi176.stdout:5/188: link d0/ff d0/d10/f38 0 2024-09-21T12:46:53.368 INFO:tasks.workunit.client.1.smithi176.stdout:9/249: truncate d1/df/d23/f36 51875 0 2024-09-21T12:46:53.368 INFO:tasks.workunit.client.1.smithi176.stdout:1/237: fsync d0/db/d1a/d2c/f4a 0 2024-09-21T12:46:53.371 INFO:tasks.workunit.client.1.smithi176.stdout:8/256: dread d6/db/d13/f29 [0,4194304] 0 2024-09-21T12:46:53.374 INFO:tasks.workunit.client.1.smithi176.stdout:2/267: dwrite d4/d3a/f45 [0,4194304] 0 2024-09-21T12:46:53.375 INFO:tasks.workunit.client.1.smithi176.stdout:4/261: chown d3/d5/db/f33 205711883 1 2024-09-21T12:46:53.376 INFO:tasks.workunit.client.1.smithi176.stdout:1/238: dread - d0/db/d1a/f38 zero size 2024-09-21T12:46:53.377 INFO:tasks.workunit.client.1.smithi176.stdout:5/189: write d0/fc [2876175,105242] 0 2024-09-21T12:46:53.377 INFO:tasks.workunit.client.1.smithi176.stdout:2/268: chown d4/d2b/l4c 114203 1 2024-09-21T12:46:53.378 INFO:tasks.workunit.client.1.smithi176.stdout:3/307: rename d1/d5/l16 to d1/d5/d25/l75 0 2024-09-21T12:46:53.380 INFO:tasks.workunit.client.1.smithi176.stdout:2/269: dread - d4/df/f1e zero size 2024-09-21T12:46:53.380 INFO:tasks.workunit.client.1.smithi176.stdout:9/250: fdatasync d1/df/d23/f36 0 2024-09-21T12:46:53.382 INFO:tasks.workunit.client.1.smithi176.stdout:7/317: symlink d0/d2/db/d55/l6c 0 2024-09-21T12:46:53.382 INFO:tasks.workunit.client.1.smithi176.stdout:0/305: dwrite d9/f45 [0,4194304] 0 2024-09-21T12:46:53.383 INFO:tasks.workunit.client.1.smithi176.stdout:5/190: mkdir d0/d10/d11/d2e/d39 0 2024-09-21T12:46:53.390 INFO:tasks.workunit.client.1.smithi176.stdout:4/262: dread d3/d21/d27/d2c/f35 [0,4194304] 0 2024-09-21T12:46:53.390 INFO:tasks.workunit.client.1.smithi176.stdout:5/191: write d0/d10/d11/d2e/f2f [136250,56679] 0 2024-09-21T12:46:53.391 INFO:tasks.workunit.client.1.smithi176.stdout:3/308: rename d1/d5/d25/d5c/d6e to d1/d5/d25/d76 0 2024-09-21T12:46:53.392 INFO:tasks.workunit.client.1.smithi176.stdout:7/318: mknod d0/d2/db/d10/d3b/c6d 0 2024-09-21T12:46:53.393 INFO:tasks.workunit.client.1.smithi176.stdout:9/251: unlink d1/df/d1c/l42 0 2024-09-21T12:46:53.393 INFO:tasks.workunit.client.1.smithi176.stdout:3/309: fdatasync d1/d34/d42/f67 0 2024-09-21T12:46:53.394 INFO:tasks.workunit.client.1.smithi176.stdout:2/270: mknod d4/d40/c51 0 2024-09-21T12:46:53.394 INFO:tasks.workunit.client.1.smithi176.stdout:4/263: creat d3/d42/f57 x:0 0 0 2024-09-21T12:46:53.395 INFO:tasks.workunit.client.1.smithi176.stdout:6/251: dread d2/dd/d26/d2b/d10/d1b/d37/f3c [0,4194304] 0 2024-09-21T12:46:53.395 INFO:tasks.workunit.client.1.smithi176.stdout:0/306: rename d9/d1a/d20/c3e to d9/d1b/d43/c6a 0 2024-09-21T12:46:53.396 INFO:tasks.workunit.client.1.smithi176.stdout:5/192: creat d0/d10/d11/f3a x:0 0 0 2024-09-21T12:46:53.399 INFO:tasks.workunit.client.1.smithi176.stdout:9/252: creat d1/df/d23/f59 x:0 0 0 2024-09-21T12:46:53.399 INFO:tasks.workunit.client.1.smithi176.stdout:0/307: write d9/f14 [5964400,66244] 0 2024-09-21T12:46:53.399 INFO:tasks.workunit.client.1.smithi176.stdout:5/193: chown d0/d10/f23 295 1 2024-09-21T12:46:53.399 INFO:tasks.workunit.client.1.smithi176.stdout:7/319: rename d0/d2/db/f54 to d0/d2f/d59/d51/f6e 0 2024-09-21T12:46:53.443 INFO:tasks.workunit.client.1.smithi176.stdout:3/310: creat d1/d5/d25/d61/f77 x:0 0 0 2024-09-21T12:46:53.443 INFO:tasks.workunit.client.1.smithi176.stdout:0/308: read d9/f2b [3564429,118629] 0 2024-09-21T12:46:53.444 INFO:tasks.workunit.client.1.smithi176.stdout:8/257: truncate d6/db/d32/f40 2458157 0 2024-09-21T12:46:53.444 INFO:tasks.workunit.client.1.smithi176.stdout:0/309: read d9/f16 [45418,40917] 0 2024-09-21T12:46:53.445 INFO:tasks.workunit.client.1.smithi176.stdout:9/253: mknod d1/df/d48/c5a 0 2024-09-21T12:46:53.445 INFO:tasks.workunit.client.1.smithi176.stdout:6/252: rename d2/dd/d26/d2b/f19 to d2/dd/d26/d2b/d10/d1b/d50/f51 0 2024-09-21T12:46:53.446 INFO:tasks.workunit.client.1.smithi176.stdout:5/194: mkdir d0/d10/d11/d2e/d39/d3b 0 2024-09-21T12:46:53.447 INFO:tasks.workunit.client.1.smithi176.stdout:1/239: dread d0/db/d25/d2b/f3b [0,4194304] 0 2024-09-21T12:46:53.447 INFO:tasks.workunit.client.1.smithi176.stdout:3/311: mkdir d1/d34/d5d/d78 0 2024-09-21T12:46:53.448 INFO:tasks.workunit.client.1.smithi176.stdout:9/254: write d1/df/d1c/f3c [779368,53734] 0 2024-09-21T12:46:53.448 INFO:tasks.workunit.client.1.smithi176.stdout:7/320: creat d0/f6f x:0 0 0 2024-09-21T12:46:53.449 INFO:tasks.workunit.client.1.smithi176.stdout:6/253: chown d2/dd/d26/d2b/f3b 2369 1 2024-09-21T12:46:53.450 INFO:tasks.workunit.client.1.smithi176.stdout:5/195: creat d0/d13/f3c x:0 0 0 2024-09-21T12:46:53.455 INFO:tasks.workunit.client.1.smithi176.stdout:0/310: dwrite d9/d1a/d1d/d23/f32 [4194304,4194304] 0 2024-09-21T12:46:53.459 INFO:tasks.workunit.client.1.smithi176.stdout:5/196: creat d0/d10/d11/f3d x:0 0 0 2024-09-21T12:46:53.459 INFO:tasks.workunit.client.1.smithi176.stdout:9/255: symlink d1/l5b 0 2024-09-21T12:46:53.460 INFO:tasks.workunit.client.1.smithi176.stdout:1/240: dwrite d0/db/f19 [0,4194304] 0 2024-09-21T12:46:53.462 INFO:tasks.workunit.client.1.smithi176.stdout:8/258: getdents d6/d8/d24/d35 0 2024-09-21T12:46:53.464 INFO:tasks.workunit.client.1.smithi176.stdout:8/259: dread - d6/db/f43 zero size 2024-09-21T12:46:53.464 INFO:tasks.workunit.client.1.smithi176.stdout:0/311: rmdir d9/d1a/d1d/d23 39 2024-09-21T12:46:53.465 INFO:tasks.workunit.client.1.smithi176.stdout:0/312: readlink d9/d1a/d20/l3d 0 2024-09-21T12:46:53.466 INFO:tasks.workunit.client.1.smithi176.stdout:5/197: dread d0/fc [0,4194304] 0 2024-09-21T12:46:53.466 INFO:tasks.workunit.client.1.smithi176.stdout:8/260: write d6/db/d13/f26 [2359057,102711] 0 2024-09-21T12:46:53.468 INFO:tasks.workunit.client.1.smithi176.stdout:8/261: write d6/db/d13/f31 [582433,48047] 0 2024-09-21T12:46:53.473 INFO:tasks.workunit.client.1.smithi176.stdout:9/256: creat d1/df/d1e/d38/f5c x:0 0 0 2024-09-21T12:46:53.476 INFO:tasks.workunit.client.1.smithi176.stdout:0/313: write d9/d1a/d1d/d23/f32 [453104,72294] 0 2024-09-21T12:46:53.478 INFO:tasks.workunit.client.1.smithi176.stdout:1/241: getdents d0/db/d2a 0 2024-09-21T12:46:53.479 INFO:tasks.workunit.client.1.smithi176.stdout:7/321: getdents d0/d5d 0 2024-09-21T12:46:53.481 INFO:tasks.workunit.client.1.smithi176.stdout:7/322: readlink d0/d2/db/d10/d23/l2d 0 2024-09-21T12:46:53.482 INFO:tasks.workunit.client.1.smithi176.stdout:3/312: dwrite d1/f2f [0,4194304] 0 2024-09-21T12:46:53.483 INFO:tasks.workunit.client.1.smithi176.stdout:6/254: write d2/dd/d26/d2b/d10/d1b/d50/f51 [76537,120246] 0 2024-09-21T12:46:53.483 INFO:tasks.workunit.client.1.smithi176.stdout:3/313: write d1/f51 [295189,20609] 0 2024-09-21T12:46:53.485 INFO:tasks.workunit.client.1.smithi176.stdout:0/314: rename d9/d1b/f56 to d9/dc/d1e/f6b 0 2024-09-21T12:46:53.487 INFO:tasks.workunit.client.1.smithi176.stdout:1/242: unlink d0/db/d1a/d2c/f2d 0 2024-09-21T12:46:53.487 INFO:tasks.workunit.client.1.smithi176.stdout:1/243: readlink d0/l11 0 2024-09-21T12:46:53.488 INFO:tasks.workunit.client.1.smithi176.stdout:5/198: link d0/ff d0/d10/d11/d2e/d39/d3b/f3e 0 2024-09-21T12:46:53.488 INFO:tasks.workunit.client.1.smithi176.stdout:5/199: chown d0/d10/d11/c34 99477238 1 2024-09-21T12:46:53.489 INFO:tasks.workunit.client.1.smithi176.stdout:7/323: creat d0/d2f/d59/f70 x:0 0 0 2024-09-21T12:46:53.491 INFO:tasks.workunit.client.1.smithi176.stdout:3/314: fsync d1/d5/f1b 0 2024-09-21T12:46:53.493 INFO:tasks.workunit.client.1.smithi176.stdout:0/315: creat d9/dc/d1e/f6c x:0 0 0 2024-09-21T12:46:53.493 INFO:tasks.workunit.client.1.smithi176.stdout:1/244: symlink d0/db/d1a/d2c/d48/d50/l5c 0 2024-09-21T12:46:53.495 INFO:tasks.workunit.client.1.smithi176.stdout:1/245: chown d0/db/d25/d2b/l2e 66830061 1 2024-09-21T12:46:53.495 INFO:tasks.workunit.client.1.smithi176.stdout:3/315: rename d1/da/f44 to d1/d5/d25/d38/f79 0 2024-09-21T12:46:53.496 INFO:tasks.workunit.client.1.smithi176.stdout:5/200: creat d0/d10/d11/d2e/d37/f3f x:0 0 0 2024-09-21T12:46:53.496 INFO:tasks.workunit.client.1.smithi176.stdout:1/246: write d0/db/f15 [653008,19007] 0 2024-09-21T12:46:53.497 INFO:tasks.workunit.client.1.smithi176.stdout:5/201: chown d0/d10/f36 502211 1 2024-09-21T12:46:53.499 INFO:tasks.workunit.client.1.smithi176.stdout:5/202: chown d0/d10/d11/d2e/f2f 40930625 1 2024-09-21T12:46:53.500 INFO:tasks.workunit.client.1.smithi176.stdout:3/316: symlink d1/d5/d25/d38/l7a 0 2024-09-21T12:46:53.501 INFO:tasks.workunit.client.1.smithi176.stdout:3/317: readlink d1/l19 0 2024-09-21T12:46:53.501 INFO:tasks.workunit.client.1.smithi176.stdout:0/316: mknod d9/d1a/d1d/c6d 0 2024-09-21T12:46:53.501 INFO:tasks.workunit.client.1.smithi176.stdout:7/324: write d0/d2f/d43/f52 [1953533,12943] 0 2024-09-21T12:46:53.505 INFO:tasks.workunit.client.1.smithi176.stdout:0/317: write d9/f45 [265187,73531] 0 2024-09-21T12:46:53.505 INFO:tasks.workunit.client.1.smithi176.stdout:5/203: link d0/d10/f38 d0/d10/d11/d2e/d37/f40 0 2024-09-21T12:46:53.506 INFO:tasks.workunit.client.1.smithi176.stdout:6/255: dwrite d2/dd/d26/d2b/d10/f2f [0,4194304] 0 2024-09-21T12:46:53.506 INFO:tasks.workunit.client.1.smithi176.stdout:7/325: mknod d0/d2/db/c71 0 2024-09-21T12:46:53.508 INFO:tasks.workunit.client.1.smithi176.stdout:0/318: write d9/dc/f50 [2266093,31437] 0 2024-09-21T12:46:53.508 INFO:tasks.workunit.client.1.smithi176.stdout:5/204: write d0/d13/f3c [268402,2144] 0 2024-09-21T12:46:53.509 INFO:tasks.workunit.client.1.smithi176.stdout:3/318: getdents d1/d34/d42 0 2024-09-21T12:46:53.511 INFO:tasks.workunit.client.1.smithi176.stdout:1/247: truncate d0/f6 1814171 0 2024-09-21T12:46:53.511 INFO:tasks.workunit.client.1.smithi176.stdout:3/319: write d1/d34/d48/f4e [868743,111440] 0 2024-09-21T12:46:53.512 INFO:tasks.workunit.client.1.smithi176.stdout:1/248: write d0/f58 [611960,22020] 0 2024-09-21T12:46:53.514 INFO:tasks.workunit.client.1.smithi176.stdout:0/319: creat d9/dc/d1e/f6e x:0 0 0 2024-09-21T12:46:53.515 INFO:tasks.workunit.client.1.smithi176.stdout:1/249: truncate d0/f58 1297605 0 2024-09-21T12:46:53.515 INFO:tasks.workunit.client.1.smithi176.stdout:3/320: creat d1/d5/f7b x:0 0 0 2024-09-21T12:46:53.517 INFO:tasks.workunit.client.1.smithi176.stdout:0/320: write d9/d1a/d1d/d4f/f59 [78538,104902] 0 2024-09-21T12:46:53.520 INFO:tasks.workunit.client.1.smithi176.stdout:1/250: fsync d0/db/d25/d2b/f3b 0 2024-09-21T12:46:53.520 INFO:tasks.workunit.client.1.smithi176.stdout:7/326: getdents d0/d2/d30 0 2024-09-21T12:46:53.520 INFO:tasks.workunit.client.1.smithi176.stdout:0/321: rmdir d9/d1a/d1d/d23 39 2024-09-21T12:46:53.524 INFO:tasks.workunit.client.1.smithi176.stdout:0/322: dread - d9/d1a/d1d/d23/d5f/f61 zero size 2024-09-21T12:46:53.524 INFO:tasks.workunit.client.1.smithi176.stdout:7/327: dread - d0/d2f/d43/f46 zero size 2024-09-21T12:46:53.526 INFO:tasks.workunit.client.1.smithi176.stdout:7/328: chown d0/d2/db/l27 7121 1 2024-09-21T12:46:53.526 INFO:tasks.workunit.client.1.smithi176.stdout:5/205: dwrite d0/d13/f26 [0,4194304] 0 2024-09-21T12:46:53.529 INFO:tasks.workunit.client.1.smithi176.stdout:5/206: chown d0/d13/f32 143054 1 2024-09-21T12:46:53.533 INFO:tasks.workunit.client.1.smithi176.stdout:1/251: dwrite d0/db/d25/d2b/d43/f54 [0,4194304] 0 2024-09-21T12:46:53.535 INFO:tasks.workunit.client.1.smithi176.stdout:0/323: dwrite d9/dc/f50 [0,4194304] 0 2024-09-21T12:46:53.538 INFO:tasks.workunit.client.1.smithi176.stdout:7/329: rename d0/d2f/d59 to d0/d2/db/d10/d72 0 2024-09-21T12:46:53.538 INFO:tasks.workunit.client.1.smithi176.stdout:5/207: fsync d0/d10/d11/d2e/d39/d3b/f3e 0 2024-09-21T12:46:53.539 INFO:tasks.workunit.client.1.smithi176.stdout:7/330: write d0/f16 [5051834,45828] 0 2024-09-21T12:46:53.541 INFO:tasks.workunit.client.1.smithi176.stdout:1/252: creat d0/db/d2a/f5d x:0 0 0 2024-09-21T12:46:53.546 INFO:tasks.workunit.client.1.smithi176.stdout:0/324: dwrite d9/ff [4194304,4194304] 0 2024-09-21T12:46:53.548 INFO:tasks.workunit.client.1.smithi176.stdout:5/208: write d0/d13/f3c [1136987,101994] 0 2024-09-21T12:46:53.548 INFO:tasks.workunit.client.1.smithi176.stdout:1/253: creat d0/f5e x:0 0 0 2024-09-21T12:46:53.550 INFO:tasks.workunit.client.1.smithi176.stdout:1/254: fdatasync d0/db/d1a/d2c/f57 0 2024-09-21T12:46:53.553 INFO:tasks.workunit.client.1.smithi176.stdout:0/325: write d9/f27 [2477838,100999] 0 2024-09-21T12:46:53.553 INFO:tasks.workunit.client.1.smithi176.stdout:7/331: write d0/d2/db/d10/d31/d65/f47 [1190219,26124] 0 2024-09-21T12:46:53.554 INFO:tasks.workunit.client.1.smithi176.stdout:0/326: chown d9/d1a/d20/f2d 0 1 2024-09-21T12:46:53.556 INFO:tasks.workunit.client.1.smithi176.stdout:1/255: creat d0/db/d2a/f5f x:0 0 0 2024-09-21T12:46:53.557 INFO:tasks.workunit.client.1.smithi176.stdout:0/327: creat d9/dc/d1e/f6f x:0 0 0 2024-09-21T12:46:53.558 INFO:tasks.workunit.client.1.smithi176.stdout:1/256: creat d0/db/d25/d2b/d43/f60 x:0 0 0 2024-09-21T12:46:53.559 INFO:tasks.workunit.client.1.smithi176.stdout:7/332: link d0/d2f/d43/f52 d0/d2f/f73 0 2024-09-21T12:46:53.560 INFO:tasks.workunit.client.1.smithi176.stdout:1/257: creat d0/d5b/f61 x:0 0 0 2024-09-21T12:46:53.562 INFO:tasks.workunit.client.1.smithi176.stdout:7/333: creat d0/d5d/d5e/f74 x:0 0 0 2024-09-21T12:46:53.563 INFO:tasks.workunit.client.1.smithi176.stdout:1/258: write d0/db/d25/d2b/d43/f54 [4362959,61947] 0 2024-09-21T12:46:53.564 INFO:tasks.workunit.client.1.smithi176.stdout:7/334: creat d0/d5d/d5e/f75 x:0 0 0 2024-09-21T12:46:53.565 INFO:tasks.workunit.client.1.smithi176.stdout:0/328: dwrite d9/d1a/d1d/d23/d5f/f61 [0,4194304] 0 2024-09-21T12:46:53.565 INFO:tasks.workunit.client.1.smithi176.stdout:1/259: stat d0/db/ff 0 2024-09-21T12:46:53.567 INFO:tasks.workunit.client.1.smithi176.stdout:0/329: symlink d9/d1a/d20/l70 0 2024-09-21T12:46:53.570 INFO:tasks.workunit.client.1.smithi176.stdout:0/330: rmdir d9 39 2024-09-21T12:46:53.572 INFO:tasks.workunit.client.1.smithi176.stdout:0/331: rmdir d9/d1b 39 2024-09-21T12:46:53.573 INFO:tasks.workunit.client.1.smithi176.stdout:1/260: dwrite d0/f13 [0,4194304] 0 2024-09-21T12:46:53.583 INFO:tasks.workunit.client.1.smithi176.stdout:0/332: dwrite d9/f45 [4194304,4194304] 0 2024-09-21T12:46:53.585 INFO:tasks.workunit.client.1.smithi176.stdout:1/261: dwrite d0/fa [4194304,4194304] 0 2024-09-21T12:46:53.585 INFO:tasks.workunit.client.1.smithi176.stdout:5/209: write d0/d10/d11/d2e/d37/f40 [68871,64766] 0 2024-09-21T12:46:53.588 INFO:tasks.workunit.client.1.smithi176.stdout:5/210: chown d0/d10/d11/d2e 62 1 2024-09-21T12:46:53.589 INFO:tasks.workunit.client.1.smithi176.stdout:0/333: creat d9/d1b/f71 x:0 0 0 2024-09-21T12:46:53.589 INFO:tasks.workunit.client.1.smithi176.stdout:1/262: truncate d0/f27 4345467 0 2024-09-21T12:46:53.591 INFO:tasks.workunit.client.1.smithi176.stdout:1/263: readlink d0/db/d25/d2b/l2e 0 2024-09-21T12:46:53.591 INFO:tasks.workunit.client.1.smithi176.stdout:1/264: fdatasync d0/db/d1a/d2c/f4a 0 2024-09-21T12:46:53.592 INFO:tasks.workunit.client.1.smithi176.stdout:1/265: chown d0/f3c 19049546 1 2024-09-21T12:46:53.593 INFO:tasks.workunit.client.1.smithi176.stdout:5/211: mkdir d0/d10/d11/d2e/d39/d41 0 2024-09-21T12:46:53.593 INFO:tasks.workunit.client.1.smithi176.stdout:1/266: read - d0/f28 zero size 2024-09-21T12:46:53.594 INFO:tasks.workunit.client.1.smithi176.stdout:5/212: write d0/d10/f2b [1697829,102461] 0 2024-09-21T12:46:53.596 INFO:tasks.workunit.client.1.smithi176.stdout:0/334: creat d9/d1a/d3f/d40/f72 x:0 0 0 2024-09-21T12:46:53.596 INFO:tasks.workunit.client.1.smithi176.stdout:5/213: truncate d0/d10/f36 293170 0 2024-09-21T12:46:53.598 INFO:tasks.workunit.client.1.smithi176.stdout:1/267: symlink d0/db/d1a/l62 0 2024-09-21T12:46:53.599 INFO:tasks.workunit.client.1.smithi176.stdout:1/268: fsync d0/f58 0 2024-09-21T12:46:53.601 INFO:tasks.workunit.client.1.smithi176.stdout:0/335: creat d9/d1a/d1d/d23/d5f/f73 x:0 0 0 2024-09-21T12:46:53.603 INFO:tasks.workunit.client.1.smithi176.stdout:1/269: rmdir d0/db/d1a/d2c/d48/d50 39 2024-09-21T12:46:53.603 INFO:tasks.workunit.client.1.smithi176.stdout:0/336: dread - d9/d1a/d1d/f51 zero size 2024-09-21T12:46:53.606 INFO:tasks.workunit.client.1.smithi176.stdout:5/214: dwrite d0/d10/d11/d2e/d37/f3f [0,4194304] 0 2024-09-21T12:46:53.611 INFO:tasks.workunit.client.1.smithi176.stdout:5/215: rename d0/d10/l33 to d0/d10/d11/d2e/l42 0 2024-09-21T12:46:53.613 INFO:tasks.workunit.client.1.smithi176.stdout:0/337: dwrite d9/d1a/d1d/d23/f5b [0,4194304] 0 2024-09-21T12:46:53.614 INFO:tasks.workunit.client.1.smithi176.stdout:7/335: dwrite d0/f63 [0,4194304] 0 2024-09-21T12:46:53.621 INFO:tasks.workunit.client.1.smithi176.stdout:7/336: dread d0/f16 [4194304,4194304] 0 2024-09-21T12:46:53.621 INFO:tasks.workunit.client.1.smithi176.stdout:0/338: mknod d9/d1a/d1d/d4f/c74 0 2024-09-21T12:46:53.623 INFO:tasks.workunit.client.1.smithi176.stdout:7/337: rmdir d0/d2/db 39 2024-09-21T12:46:53.626 INFO:tasks.workunit.client.1.smithi176.stdout:5/216: getdents d0/d13 0 2024-09-21T12:46:53.628 INFO:tasks.workunit.client.1.smithi176.stdout:5/217: dread d0/ff [0,4194304] 0 2024-09-21T12:46:53.629 INFO:tasks.workunit.client.1.smithi176.stdout:7/338: creat d0/d2f/d43/f76 x:0 0 0 2024-09-21T12:46:53.630 INFO:tasks.workunit.client.1.smithi176.stdout:0/339: dwrite d9/d1a/d1d/d22/f2a [0,4194304] 0 2024-09-21T12:46:53.631 INFO:tasks.workunit.client.1.smithi176.stdout:5/218: write d0/d10/d11/f3a [448325,93679] 0 2024-09-21T12:46:53.631 INFO:tasks.workunit.client.1.smithi176.stdout:0/340: readlink l3 0 2024-09-21T12:46:53.632 INFO:tasks.workunit.client.1.smithi176.stdout:0/341: write d9/f17 [1440151,128096] 0 2024-09-21T12:46:53.632 INFO:tasks.workunit.client.1.smithi176.stdout:7/339: creat d0/d5d/d5e/f77 x:0 0 0 2024-09-21T12:46:53.633 INFO:tasks.workunit.client.1.smithi176.stdout:5/219: fdatasync d0/ff 0 2024-09-21T12:46:53.634 INFO:tasks.workunit.client.1.smithi176.stdout:5/220: chown d0/d10/d11/d2e/d39/d41 40234660 1 2024-09-21T12:46:53.635 INFO:tasks.workunit.client.1.smithi176.stdout:7/340: stat d0/d2f/d43/c49 0 2024-09-21T12:46:53.635 INFO:tasks.workunit.client.1.smithi176.stdout:5/221: chown d0/d10/d11 515040 1 2024-09-21T12:46:53.639 INFO:tasks.workunit.client.1.smithi176.stdout:5/222: creat d0/d10/d11/d2e/d39/f43 x:0 0 0 2024-09-21T12:46:53.641 INFO:tasks.workunit.client.1.smithi176.stdout:0/342: dwrite d9/d1a/d1d/d4f/f59 [0,4194304] 0 2024-09-21T12:46:53.642 INFO:tasks.workunit.client.1.smithi176.stdout:5/223: write d0/d10/f23 [3300919,2839] 0 2024-09-21T12:46:53.644 INFO:tasks.workunit.client.1.smithi176.stdout:5/224: truncate d0/d10/f36 796020 0 2024-09-21T12:46:53.645 INFO:tasks.workunit.client.1.smithi176.stdout:0/343: mkdir d9/d1b/d63/d75 0 2024-09-21T12:46:53.649 INFO:tasks.workunit.client.1.smithi176.stdout:5/225: read d0/d10/d11/f21 [3993972,63375] 0 2024-09-21T12:46:53.652 INFO:tasks.workunit.client.1.smithi176.stdout:0/344: dwrite d9/d1a/d3f/d40/f72 [0,4194304] 0 2024-09-21T12:46:53.657 INFO:tasks.workunit.client.1.smithi176.stdout:7/341: dread d0/d2/db/d10/f1d [0,4194304] 0 2024-09-21T12:46:53.657 INFO:tasks.workunit.client.1.smithi176.stdout:0/345: rename d9/d1a/f30 to d9/d1b/d63/f76 0 2024-09-21T12:46:53.659 INFO:tasks.workunit.client.1.smithi176.stdout:7/342: dread - d0/d2f/f66 zero size 2024-09-21T12:46:53.659 INFO:tasks.workunit.client.1.smithi176.stdout:0/346: dread - d9/dc/d1e/f6b zero size 2024-09-21T12:46:53.660 INFO:tasks.workunit.client.1.smithi176.stdout:5/226: dwrite d0/d10/f38 [0,4194304] 0 2024-09-21T12:46:53.664 INFO:tasks.workunit.client.1.smithi176.stdout:0/347: unlink d9/d1a/d1d/d22/f2a 0 2024-09-21T12:46:53.667 INFO:tasks.workunit.client.1.smithi176.stdout:5/227: symlink d0/l44 0 2024-09-21T12:46:53.667 INFO:tasks.workunit.client.1.smithi176.stdout:7/343: unlink d0/d2/db/d10/d31/c53 0 2024-09-21T12:46:53.668 INFO:tasks.workunit.client.1.smithi176.stdout:0/348: mkdir d9/d1b/d63/d77 0 2024-09-21T12:46:53.670 INFO:tasks.workunit.client.1.smithi176.stdout:7/344: mknod d0/d2/c78 0 2024-09-21T12:46:53.673 INFO:tasks.workunit.client.1.smithi176.stdout:7/345: truncate d0/f17 312074 0 2024-09-21T12:46:53.673 INFO:tasks.workunit.client.1.smithi176.stdout:5/228: dread d0/d13/f3c [0,4194304] 0 2024-09-21T12:46:53.674 INFO:tasks.workunit.client.1.smithi176.stdout:7/346: write d0/d2/db/d10/f2c [3582946,128866] 0 2024-09-21T12:46:53.675 INFO:tasks.workunit.client.1.smithi176.stdout:5/229: readlink d0/d10/l22 0 2024-09-21T12:46:53.675 INFO:tasks.workunit.client.1.smithi176.stdout:5/230: chown d0/d10/d11/d2e/d39 47 1 2024-09-21T12:46:53.676 INFO:tasks.workunit.client.1.smithi176.stdout:7/347: mkdir d0/d2/db/d10/d3b/d79 0 2024-09-21T12:46:53.678 INFO:tasks.workunit.client.1.smithi176.stdout:5/231: creat d0/d10/d11/d2e/d39/d3b/f45 x:0 0 0 2024-09-21T12:46:53.680 INFO:tasks.workunit.client.1.smithi176.stdout:4/264: sync 2024-09-21T12:46:53.680 INFO:tasks.workunit.client.1.smithi176.stdout:2/271: sync 2024-09-21T12:46:53.681 INFO:tasks.workunit.client.1.smithi176.stdout:5/232: fsync d0/d10/f38 0 2024-09-21T12:46:53.682 INFO:tasks.workunit.client.1.smithi176.stdout:4/265: read d3/d21/d27/d2c/f35 [886813,88508] 0 2024-09-21T12:46:53.684 INFO:tasks.workunit.client.1.smithi176.stdout:7/348: dwrite d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:46:53.686 INFO:tasks.workunit.client.1.smithi176.stdout:2/272: rename d4/c24 to d4/c52 0 2024-09-21T12:46:53.689 INFO:tasks.workunit.client.1.smithi176.stdout:7/349: unlink d0/f33 0 2024-09-21T12:46:53.691 INFO:tasks.workunit.client.1.smithi176.stdout:4/266: creat d3/d42/d4d/f58 x:0 0 0 2024-09-21T12:46:53.692 INFO:tasks.workunit.client.1.smithi176.stdout:4/267: write d3/d42/d56/d4e/f52 [1378615,31558] 0 2024-09-21T12:46:53.692 INFO:tasks.workunit.client.1.smithi176.stdout:4/268: dread - d3/d42/f57 zero size 2024-09-21T12:46:53.693 INFO:tasks.workunit.client.1.smithi176.stdout:0/349: truncate d9/d1a/d1d/d23/d5f/f61 1073440 0 2024-09-21T12:46:53.695 INFO:tasks.workunit.client.1.smithi176.stdout:7/350: mkdir d0/d5d/d7a 0 2024-09-21T12:46:53.698 INFO:tasks.workunit.client.1.smithi176.stdout:4/269: rename d3/d5/f25 to d3/d42/d56/f59 0 2024-09-21T12:46:53.703 INFO:tasks.workunit.client.1.smithi176.stdout:4/270: fdatasync d3/d5/db/f50 0 2024-09-21T12:46:53.704 INFO:tasks.workunit.client.1.smithi176.stdout:2/273: getdents d4/d2b 0 2024-09-21T12:46:53.705 INFO:tasks.workunit.client.1.smithi176.stdout:4/271: chown d3/d5/db/f31 2027 1 2024-09-21T12:46:53.706 INFO:tasks.workunit.client.1.smithi176.stdout:0/350: truncate d9/dc/f13 1091750 0 2024-09-21T12:46:53.706 INFO:tasks.workunit.client.1.smithi176.stdout:2/274: stat d4/df/d4b/c50 0 2024-09-21T12:46:53.707 INFO:tasks.workunit.client.1.smithi176.stdout:7/351: dwrite d0/d2/db/d10/d31/d65/f47 [0,4194304] 0 2024-09-21T12:46:53.707 INFO:tasks.workunit.client.1.smithi176.stdout:2/275: read - d4/df/f1e zero size 2024-09-21T12:46:53.708 INFO:tasks.workunit.client.1.smithi176.stdout:0/351: dread - d9/d1a/d1d/d23/d5f/f73 zero size 2024-09-21T12:46:53.714 INFO:tasks.workunit.client.1.smithi176.stdout:7/352: mkdir d0/d2/d30/d7b 0 2024-09-21T12:46:53.716 INFO:tasks.workunit.client.1.smithi176.stdout:4/272: getdents d3/d21/d27 0 2024-09-21T12:46:53.718 INFO:tasks.workunit.client.1.smithi176.stdout:2/276: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:46:53.719 INFO:tasks.workunit.client.1.smithi176.stdout:7/353: mknod d0/d2/db/d10/c7c 0 2024-09-21T12:46:53.722 INFO:tasks.workunit.client.1.smithi176.stdout:2/277: write d4/d2b/f3e [52525,41835] 0 2024-09-21T12:46:53.722 INFO:tasks.workunit.client.1.smithi176.stdout:0/352: dwrite d9/dc/d1e/f6b [0,4194304] 0 2024-09-21T12:46:53.724 INFO:tasks.workunit.client.1.smithi176.stdout:7/354: write d0/d2/db/d10/d31/f50 [180914,22072] 0 2024-09-21T12:46:53.725 INFO:tasks.workunit.client.1.smithi176.stdout:4/273: dread d3/d21/f2a [0,4194304] 0 2024-09-21T12:46:53.728 INFO:tasks.workunit.client.1.smithi176.stdout:0/353: mkdir d9/d1b/d63/d77/d78 0 2024-09-21T12:46:53.729 INFO:tasks.workunit.client.1.smithi176.stdout:2/278: getdents d4/d2b 0 2024-09-21T12:46:53.730 INFO:tasks.workunit.client.1.smithi176.stdout:7/355: rename d0/f63 to d0/d2/d30/d7b/f7d 0 2024-09-21T12:46:53.733 INFO:tasks.workunit.client.1.smithi176.stdout:2/279: getdents d4/df/d3f 0 2024-09-21T12:46:53.733 INFO:tasks.workunit.client.1.smithi176.stdout:7/356: mkdir d0/d2/db/d10/d72/d7e 0 2024-09-21T12:46:53.736 INFO:tasks.workunit.client.1.smithi176.stdout:7/357: write d0/d2/f5c [563245,124359] 0 2024-09-21T12:46:53.736 INFO:tasks.workunit.client.1.smithi176.stdout:4/274: dwrite d3/d5/db/f33 [0,4194304] 0 2024-09-21T12:46:53.737 INFO:tasks.workunit.client.1.smithi176.stdout:0/354: dread d9/dc/f13 [0,4194304] 0 2024-09-21T12:46:53.738 INFO:tasks.workunit.client.1.smithi176.stdout:4/275: chown d3/d5/db/l30 0 1 2024-09-21T12:46:53.738 INFO:tasks.workunit.client.1.smithi176.stdout:2/280: rename d4/df/l4e to d4/d2b/l53 0 2024-09-21T12:46:53.739 INFO:tasks.workunit.client.1.smithi176.stdout:2/281: chown d4/df/l4a 21 1 2024-09-21T12:46:53.740 INFO:tasks.workunit.client.1.smithi176.stdout:7/358: fsync d0/d2f/f73 0 2024-09-21T12:46:53.740 INFO:tasks.workunit.client.1.smithi176.stdout:0/355: mkdir d9/d1a/d3f/d40/d79 0 2024-09-21T12:46:53.742 INFO:tasks.workunit.client.1.smithi176.stdout:2/282: fdatasync d4/d2b/f3e 0 2024-09-21T12:46:53.742 INFO:tasks.workunit.client.1.smithi176.stdout:0/356: read d9/d1a/d20/f2d [8224132,39545] 0 2024-09-21T12:46:53.742 INFO:tasks.workunit.client.1.smithi176.stdout:4/276: write d3/d21/d27/d2c/f35 [944315,70315] 0 2024-09-21T12:46:53.773 INFO:tasks.workunit.client.1.smithi176.stdout:6/256: sync 2024-09-21T12:46:53.774 INFO:tasks.workunit.client.1.smithi176.stdout:8/262: sync 2024-09-21T12:46:53.774 INFO:tasks.workunit.client.1.smithi176.stdout:9/257: sync 2024-09-21T12:46:53.775 INFO:tasks.workunit.client.1.smithi176.stdout:9/258: write d1/df/d1e/d38/f4b [67665,68593] 0 2024-09-21T12:46:53.781 INFO:tasks.workunit.client.1.smithi176.stdout:7/359: rename d0/d2/db/fd to d0/d2/d30/f7f 0 2024-09-21T12:46:53.785 INFO:tasks.workunit.client.1.smithi176.stdout:8/263: mkdir d6/d16/d52 0 2024-09-21T12:46:53.786 INFO:tasks.workunit.client.1.smithi176.stdout:6/257: write d2/dd/f11 [2919903,91784] 0 2024-09-21T12:46:53.787 INFO:tasks.workunit.client.1.smithi176.stdout:6/258: dread - d2/dd/d26/d2b/d10/d1b/d37/f4b zero size 2024-09-21T12:46:53.788 INFO:tasks.workunit.client.1.smithi176.stdout:7/360: unlink d0/d2/db/d10/d31/f50 0 2024-09-21T12:46:53.789 INFO:tasks.workunit.client.1.smithi176.stdout:6/259: truncate d2/dd/d26/d2b/d10/d1b/d37/f4b 532237 0 2024-09-21T12:46:53.791 INFO:tasks.workunit.client.1.smithi176.stdout:6/260: chown d2/dd/d26/d2b/d10/d1b/d37/f3c 1384989 1 2024-09-21T12:46:53.792 INFO:tasks.workunit.client.1.smithi176.stdout:8/264: creat d6/d8/d24/d35/d51/f53 x:0 0 0 2024-09-21T12:46:53.792 INFO:tasks.workunit.client.1.smithi176.stdout:6/261: chown d2/dd/d26/d2b/l28 22834455 1 2024-09-21T12:46:53.793 INFO:tasks.workunit.client.1.smithi176.stdout:8/265: write d6/d8/f2e [4384061,120060] 0 2024-09-21T12:46:53.793 INFO:tasks.workunit.client.1.smithi176.stdout:9/259: link d1/df/d1c/f3a d1/f5d 0 2024-09-21T12:46:53.794 INFO:tasks.workunit.client.1.smithi176.stdout:8/266: chown d6/l47 603 1 2024-09-21T12:46:53.794 INFO:tasks.workunit.client.1.smithi176.stdout:6/262: write d2/dd/d26/d2b/d10/f2f [1433558,102771] 0 2024-09-21T12:46:53.794 INFO:tasks.workunit.client.1.smithi176.stdout:0/357: getdents d9/d1b/d43 0 2024-09-21T12:46:53.795 INFO:tasks.workunit.client.1.smithi176.stdout:7/361: symlink d0/d5d/l80 0 2024-09-21T12:46:53.796 INFO:tasks.workunit.client.1.smithi176.stdout:8/267: chown d6/d8/d24/d35/d51 24250 1 2024-09-21T12:46:53.796 INFO:tasks.workunit.client.1.smithi176.stdout:7/362: readlink d0/d2/db/d10/d23/l4c 0 2024-09-21T12:46:53.796 INFO:tasks.workunit.client.1.smithi176.stdout:8/268: stat d6/d8/d24/d35/f4f 0 2024-09-21T12:46:53.797 INFO:tasks.workunit.client.1.smithi176.stdout:2/283: truncate d4/f37 3993764 0 2024-09-21T12:46:53.799 INFO:tasks.workunit.client.1.smithi176.stdout:4/277: truncate d3/d5/db/d36/f43 3426532 0 2024-09-21T12:46:53.802 INFO:tasks.workunit.client.1.smithi176.stdout:0/358: chown d9/d1a/d3f/l4a 0 1 2024-09-21T12:46:53.802 INFO:tasks.workunit.client.1.smithi176.stdout:7/363: rename d0/d2/db/d10/d72/f70 to d0/d5d/f81 0 2024-09-21T12:46:53.803 INFO:tasks.workunit.client.1.smithi176.stdout:8/269: mkdir d6/d8/d54 0 2024-09-21T12:46:53.803 INFO:tasks.workunit.client.1.smithi176.stdout:4/278: dread d3/d5/db/f31 [0,4194304] 0 2024-09-21T12:46:53.804 INFO:tasks.workunit.client.1.smithi176.stdout:7/364: readlink d0/d5d/l80 0 2024-09-21T12:46:53.804 INFO:tasks.workunit.client.1.smithi176.stdout:0/359: readlink d9/d1a/d1d/d22/l66 0 2024-09-21T12:46:53.805 INFO:tasks.workunit.client.1.smithi176.stdout:6/263: dwrite d2/dd/f48 [0,4194304] 0 2024-09-21T12:46:53.807 INFO:tasks.workunit.client.1.smithi176.stdout:7/365: mknod d0/d5d/d5e/c82 0 2024-09-21T12:46:53.810 INFO:tasks.workunit.client.1.smithi176.stdout:4/279: symlink d3/d21/d27/l5a 0 2024-09-21T12:46:53.812 INFO:tasks.workunit.client.1.smithi176.stdout:2/284: rename d4/l18 to d4/df/d4b/l54 0 2024-09-21T12:46:53.812 INFO:tasks.workunit.client.1.smithi176.stdout:4/280: write d3/f32 [912304,77463] 0 2024-09-21T12:46:53.812 INFO:tasks.workunit.client.1.smithi176.stdout:8/270: creat d6/d8/d24/d35/d51/f55 x:0 0 0 2024-09-21T12:46:53.814 INFO:tasks.workunit.client.1.smithi176.stdout:6/264: creat d2/dd/d26/d2b/d10/d39/f52 x:0 0 0 2024-09-21T12:46:53.815 INFO:tasks.workunit.client.1.smithi176.stdout:7/366: creat d0/d2/db/d10/d31/f83 x:0 0 0 2024-09-21T12:46:53.816 INFO:tasks.workunit.client.1.smithi176.stdout:4/281: readlink d3/d42/d56/l3e 0 2024-09-21T12:46:53.818 INFO:tasks.workunit.client.1.smithi176.stdout:0/360: dwrite d9/f17 [4194304,4194304] 0 2024-09-21T12:46:53.819 INFO:tasks.workunit.client.1.smithi176.stdout:2/285: mkdir d4/df/d2e/d39/d55 0 2024-09-21T12:46:53.820 INFO:tasks.workunit.client.1.smithi176.stdout:9/260: dwrite d1/df/f12 [0,4194304] 0 2024-09-21T12:46:53.820 INFO:tasks.workunit.client.1.smithi176.stdout:3/321: sync 2024-09-21T12:46:53.821 INFO:tasks.workunit.client.1.smithi176.stdout:1/270: sync 2024-09-21T12:46:53.822 INFO:tasks.workunit.client.1.smithi176.stdout:6/265: creat d2/dd/d26/d2b/d10/d1b/d50/f53 x:0 0 0 2024-09-21T12:46:53.822 INFO:tasks.workunit.client.1.smithi176.stdout:0/361: write d9/f16 [770377,122217] 0 2024-09-21T12:46:53.829 INFO:tasks.workunit.client.1.smithi176.stdout:0/362: fdatasync d9/d1b/f71 0 2024-09-21T12:46:53.830 INFO:tasks.workunit.client.1.smithi176.stdout:6/266: unlink d2/dd/d26/c41 0 2024-09-21T12:46:53.830 INFO:tasks.workunit.client.1.smithi176.stdout:4/282: link d3/d5/db/f31 d3/d42/d4d/f5b 0 2024-09-21T12:46:53.830 INFO:tasks.workunit.client.1.smithi176.stdout:9/261: symlink d1/df/d1e/d4f/l5e 0 2024-09-21T12:46:53.832 INFO:tasks.workunit.client.1.smithi176.stdout:2/286: rename d4/df/c29 to d4/df/d2e/d4d/c56 0 2024-09-21T12:46:53.832 INFO:tasks.workunit.client.1.smithi176.stdout:3/322: mknod d1/d5/d25/c7c 0 2024-09-21T12:46:53.833 INFO:tasks.workunit.client.1.smithi176.stdout:3/323: fsync d1/f1a 0 2024-09-21T12:46:53.834 INFO:tasks.workunit.client.1.smithi176.stdout:4/283: mkdir d3/d42/d47/d5c 0 2024-09-21T12:46:53.835 INFO:tasks.workunit.client.1.smithi176.stdout:0/363: mknod d9/d1b/d63/d75/c7a 0 2024-09-21T12:46:53.839 INFO:tasks.workunit.client.1.smithi176.stdout:8/271: dread d6/d8/d24/d35/f42 [0,4194304] 0 2024-09-21T12:46:53.839 INFO:tasks.workunit.client.1.smithi176.stdout:0/364: mknod d9/d1a/d1d/d4f/c7b 0 2024-09-21T12:46:53.841 INFO:tasks.workunit.client.1.smithi176.stdout:2/287: dread d4/f37 [0,4194304] 0 2024-09-21T12:46:53.842 INFO:tasks.workunit.client.1.smithi176.stdout:0/365: fsync d9/f52 0 2024-09-21T12:46:53.893 INFO:tasks.workunit.client.1.smithi176.stdout:4/284: rename d3/d5/l17 to d3/d42/d47/d5c/l5d 0 2024-09-21T12:46:53.894 INFO:tasks.workunit.client.1.smithi176.stdout:8/272: chown d6/db/d13/f4d 888 1 2024-09-21T12:46:53.895 INFO:tasks.workunit.client.1.smithi176.stdout:6/267: dwrite d2/dd/d26/d2b/d10/d1b/d37/f4f [0,4194304] 0 2024-09-21T12:46:53.895 INFO:tasks.workunit.client.1.smithi176.stdout:3/324: dwrite d1/f39 [0,4194304] 0 2024-09-21T12:46:53.898 INFO:tasks.workunit.client.1.smithi176.stdout:0/366: write d9/d1a/d3f/d40/f4c [1471832,84737] 0 2024-09-21T12:46:53.903 INFO:tasks.workunit.client.1.smithi176.stdout:2/288: truncate d4/f38 724934 0 2024-09-21T12:46:53.903 INFO:tasks.workunit.client.1.smithi176.stdout:8/273: write d6/d8/d24/d35/f4a [354245,40931] 0 2024-09-21T12:46:53.905 INFO:tasks.workunit.client.1.smithi176.stdout:3/325: mkdir d1/d5/d25/d5c/d7d 0 2024-09-21T12:46:53.905 INFO:tasks.workunit.client.1.smithi176.stdout:6/268: mknod d2/dd/d26/d2b/d10/d39/c54 0 2024-09-21T12:46:53.908 INFO:tasks.workunit.client.1.smithi176.stdout:8/274: symlink d6/l56 0 2024-09-21T12:46:53.910 INFO:tasks.workunit.client.1.smithi176.stdout:6/269: readlink d2/dd/d26/l44 0 2024-09-21T12:46:53.910 INFO:tasks.workunit.client.1.smithi176.stdout:4/285: dwrite d3/f32 [0,4194304] 0 2024-09-21T12:46:53.910 INFO:tasks.workunit.client.1.smithi176.stdout:1/271: dread d0/f27 [0,4194304] 0 2024-09-21T12:46:53.911 INFO:tasks.workunit.client.1.smithi176.stdout:0/367: rename d9/d1a/d3f/d40/f67 to d9/d1a/d1d/d23/f7c 0 2024-09-21T12:46:53.912 INFO:tasks.workunit.client.1.smithi176.stdout:2/289: getdents d4/d40 0 2024-09-21T12:46:53.913 INFO:tasks.workunit.client.1.smithi176.stdout:3/326: mknod d1/d5/d25/d61/c7e 0 2024-09-21T12:46:53.914 INFO:tasks.workunit.client.1.smithi176.stdout:3/327: fdatasync d1/d5/d25/d5c/f62 0 2024-09-21T12:46:53.916 INFO:tasks.workunit.client.1.smithi176.stdout:6/270: dread d2/dd/d26/d2b/d10/d1b/d50/f51 [0,4194304] 0 2024-09-21T12:46:53.918 INFO:tasks.workunit.client.1.smithi176.stdout:1/272: rmdir d0/d5b 39 2024-09-21T12:46:53.919 INFO:tasks.workunit.client.1.smithi176.stdout:1/273: chown d0/db/d25/d41/c47 155 1 2024-09-21T12:46:53.920 INFO:tasks.workunit.client.1.smithi176.stdout:8/275: symlink d6/l57 0 2024-09-21T12:46:53.921 INFO:tasks.workunit.client.1.smithi176.stdout:6/271: dread d2/dd/d26/d2b/d10/f2f [0,4194304] 0 2024-09-21T12:46:53.922 INFO:tasks.workunit.client.1.smithi176.stdout:6/272: chown d2/dd/d26/d2b/d10/d1b/d50/f51 3 1 2024-09-21T12:46:53.923 INFO:tasks.workunit.client.1.smithi176.stdout:6/273: write d2/dd/f11 [2545534,129793] 0 2024-09-21T12:46:53.924 INFO:tasks.workunit.client.1.smithi176.stdout:3/328: rename d1/d5/d25/d38/f63 to d1/d5/d25/d76/f7f 0 2024-09-21T12:46:53.925 INFO:tasks.workunit.client.1.smithi176.stdout:4/286: mkdir d3/d21/d5e 0 2024-09-21T12:46:53.928 INFO:tasks.workunit.client.1.smithi176.stdout:0/368: link d9/d1a/f58 d9/d35/f7d 0 2024-09-21T12:46:53.929 INFO:tasks.workunit.client.1.smithi176.stdout:2/290: truncate d4/df/f22 2622854 0 2024-09-21T12:46:53.931 INFO:tasks.workunit.client.1.smithi176.stdout:2/291: chown d4/ld 21046 1 2024-09-21T12:46:53.931 INFO:tasks.workunit.client.1.smithi176.stdout:1/274: mkdir d0/d63 0 2024-09-21T12:46:53.932 INFO:tasks.workunit.client.1.smithi176.stdout:3/329: dwrite d1/da/f2e [0,4194304] 0 2024-09-21T12:46:53.932 INFO:tasks.workunit.client.1.smithi176.stdout:4/287: unlink d3/d5/db/d36/c4f 0 2024-09-21T12:46:53.933 INFO:tasks.workunit.client.1.smithi176.stdout:6/274: dread d2/f34 [0,4194304] 0 2024-09-21T12:46:53.933 INFO:tasks.workunit.client.1.smithi176.stdout:8/276: truncate d6/db/f17 1951668 0 2024-09-21T12:46:53.934 INFO:tasks.workunit.client.1.smithi176.stdout:3/330: fdatasync d1/d3e/f58 0 2024-09-21T12:46:53.935 INFO:tasks.workunit.client.1.smithi176.stdout:2/292: rename d4/df/l20 to d4/d3d/l57 0 2024-09-21T12:46:53.935 INFO:tasks.workunit.client.1.smithi176.stdout:6/275: write d2/dd/d26/d2b/d10/d39/f45 [2282663,21064] 0 2024-09-21T12:46:53.939 INFO:tasks.workunit.client.1.smithi176.stdout:5/233: sync 2024-09-21T12:46:53.943 INFO:tasks.workunit.client.1.smithi176.stdout:2/293: dwrite d4/d2b/f3e [0,4194304] 0 2024-09-21T12:46:53.944 INFO:tasks.workunit.client.1.smithi176.stdout:2/294: write d4/f1a [1582778,97691] 0 2024-09-21T12:46:53.945 INFO:tasks.workunit.client.1.smithi176.stdout:5/234: read d0/d13/f29 [4074128,124883] 0 2024-09-21T12:46:53.945 INFO:tasks.workunit.client.1.smithi176.stdout:2/295: chown d4/d2b/f3e 0 1 2024-09-21T12:46:54.033 INFO:tasks.workunit.client.1.smithi176.stdout:7/367: sync 2024-09-21T12:46:54.033 INFO:tasks.workunit.client.1.smithi176.stdout:6/276: rename d2/dd/d26/d2b/d10/d39/f45 to d2/dd/d26/d2b/d10/d1b/f55 0 2024-09-21T12:46:54.034 INFO:tasks.workunit.client.1.smithi176.stdout:3/331: creat d1/d5/d25/d5c/d7d/f80 x:0 0 0 2024-09-21T12:46:54.035 INFO:tasks.workunit.client.1.smithi176.stdout:3/332: chown d1/d5/d25/d61/c7e 347 1 2024-09-21T12:46:54.036 INFO:tasks.workunit.client.1.smithi176.stdout:1/275: link d0/f28 d0/db/d1a/d2c/d48/d50/f64 0 2024-09-21T12:46:54.037 INFO:tasks.workunit.client.1.smithi176.stdout:7/368: dread d0/d2/f5c [0,4194304] 0 2024-09-21T12:46:54.038 INFO:tasks.workunit.client.1.smithi176.stdout:7/369: dread - d0/d5d/d5e/f5f zero size 2024-09-21T12:46:54.038 INFO:tasks.workunit.client.1.smithi176.stdout:7/370: readlink d0/d2/db/d10/d23/l4c 0 2024-09-21T12:46:54.043 INFO:tasks.workunit.client.1.smithi176.stdout:6/277: read d2/dd/d26/d2b/d10/d1b/d50/f51 [30770,3221] 0 2024-09-21T12:46:54.044 INFO:tasks.workunit.client.1.smithi176.stdout:3/333: mknod d1/da/c81 0 2024-09-21T12:46:54.046 INFO:tasks.workunit.client.1.smithi176.stdout:7/371: mknod d0/d5d/d5e/c84 0 2024-09-21T12:46:54.047 INFO:tasks.workunit.client.1.smithi176.stdout:7/372: fdatasync d0/d2/db/f26 0 2024-09-21T12:46:54.047 INFO:tasks.workunit.client.1.smithi176.stdout:3/334: dread d1/d5/d25/d38/f3f [0,4194304] 0 2024-09-21T12:46:54.048 INFO:tasks.workunit.client.1.smithi176.stdout:7/373: read d0/d2/db/d10/f2c [3653545,34507] 0 2024-09-21T12:46:54.049 INFO:tasks.workunit.client.1.smithi176.stdout:7/374: chown d0/d2/db/c19 10 1 2024-09-21T12:46:54.049 INFO:tasks.workunit.client.1.smithi176.stdout:7/375: chown d0/d2/db 25566 1 2024-09-21T12:46:54.050 INFO:tasks.workunit.client.1.smithi176.stdout:2/296: getdents d4/df/d2e/d39/d55 0 2024-09-21T12:46:54.052 INFO:tasks.workunit.client.1.smithi176.stdout:7/376: fsync d0/d5d/d5e/f5f 0 2024-09-21T12:46:54.052 INFO:tasks.workunit.client.1.smithi176.stdout:3/335: dread d1/f51 [0,4194304] 0 2024-09-21T12:46:54.054 INFO:tasks.workunit.client.1.smithi176.stdout:1/276: dread d0/db/f17 [0,4194304] 0 2024-09-21T12:46:54.056 INFO:tasks.workunit.client.1.smithi176.stdout:3/336: symlink d1/d34/d57/l82 0 2024-09-21T12:46:54.057 INFO:tasks.workunit.client.1.smithi176.stdout:8/277: dwrite d6/d16/f1e [0,4194304] 0 2024-09-21T12:46:54.057 INFO:tasks.workunit.client.1.smithi176.stdout:7/377: mkdir d0/d2/db/d10/d23/d85 0 2024-09-21T12:46:54.062 INFO:tasks.workunit.client.1.smithi176.stdout:6/278: creat d2/f56 x:0 0 0 2024-09-21T12:46:54.062 INFO:tasks.workunit.client.1.smithi176.stdout:1/277: mknod d0/db/d25/d2b/c65 0 2024-09-21T12:46:54.063 INFO:tasks.workunit.client.1.smithi176.stdout:3/337: creat d1/d5/f83 x:0 0 0 2024-09-21T12:46:54.068 INFO:tasks.workunit.client.1.smithi176.stdout:5/235: dwrite d0/f27 [0,4194304] 0 2024-09-21T12:46:54.068 INFO:tasks.workunit.client.1.smithi176.stdout:8/278: getdents d6/d8/d24 0 2024-09-21T12:46:54.068 INFO:tasks.workunit.client.1.smithi176.stdout:3/338: mkdir d1/d5/d25/d84 0 2024-09-21T12:46:54.069 INFO:tasks.workunit.client.1.smithi176.stdout:6/279: symlink d2/dd/d26/d2b/d10/d1b/l57 0 2024-09-21T12:46:54.070 INFO:tasks.workunit.client.1.smithi176.stdout:5/236: fsync d0/d10/d11/f3d 0 2024-09-21T12:46:54.071 INFO:tasks.workunit.client.1.smithi176.stdout:7/378: truncate d0/d2/d30/d7b/f7d 1372729 0 2024-09-21T12:46:54.074 INFO:tasks.workunit.client.1.smithi176.stdout:1/278: dwrite d0/f2 [4194304,4194304] 0 2024-09-21T12:46:54.076 INFO:tasks.workunit.client.1.smithi176.stdout:1/279: chown d0/db/d25/d2b/f3a 201065 1 2024-09-21T12:46:54.077 INFO:tasks.workunit.client.1.smithi176.stdout:5/237: write d0/d13/f32 [1684118,69298] 0 2024-09-21T12:46:54.081 INFO:tasks.workunit.client.1.smithi176.stdout:5/238: creat d0/d10/d11/d2e/f46 x:0 0 0 2024-09-21T12:46:54.083 INFO:tasks.workunit.client.1.smithi176.stdout:4/288: sync 2024-09-21T12:46:54.083 INFO:tasks.workunit.client.1.smithi176.stdout:0/369: sync 2024-09-21T12:46:54.083 INFO:tasks.workunit.client.1.smithi176.stdout:1/280: mkdir d0/db/d1a/d2c/d66 0 2024-09-21T12:46:54.084 INFO:tasks.workunit.client.1.smithi176.stdout:9/262: sync 2024-09-21T12:46:54.084 INFO:tasks.workunit.client.1.smithi176.stdout:5/239: creat d0/d10/d11/d2e/d39/d3b/f47 x:0 0 0 2024-09-21T12:46:54.085 INFO:tasks.workunit.client.1.smithi176.stdout:9/263: read d1/df/f12 [3030595,38408] 0 2024-09-21T12:46:54.086 INFO:tasks.workunit.client.1.smithi176.stdout:3/339: rename d1/d34/d42/l64 to d1/l85 0 2024-09-21T12:46:54.086 INFO:tasks.workunit.client.1.smithi176.stdout:4/289: symlink d3/d42/l5f 0 2024-09-21T12:46:54.090 INFO:tasks.workunit.client.1.smithi176.stdout:4/290: mknod d3/d42/c60 0 2024-09-21T12:46:54.090 INFO:tasks.workunit.client.1.smithi176.stdout:7/379: fsync d0/d2/d30/d7b/f7d 0 2024-09-21T12:46:54.091 INFO:tasks.workunit.client.1.smithi176.stdout:3/340: symlink d1/d5/d25/d5c/d7d/l86 0 2024-09-21T12:46:54.092 INFO:tasks.workunit.client.1.smithi176.stdout:6/280: dread d2/dd/d26/f38 [0,4194304] 0 2024-09-21T12:46:54.094 INFO:tasks.workunit.client.1.smithi176.stdout:1/281: dwrite d0/f13 [0,4194304] 0 2024-09-21T12:46:54.098 INFO:tasks.workunit.client.1.smithi176.stdout:3/341: readlink d1/d5/d25/d38/l45 0 2024-09-21T12:46:54.099 INFO:tasks.workunit.client.1.smithi176.stdout:1/282: mknod d0/db/c67 0 2024-09-21T12:46:54.100 INFO:tasks.workunit.client.1.smithi176.stdout:0/370: write d9/d1a/d20/f2d [5336021,129779] 0 2024-09-21T12:46:54.101 INFO:tasks.workunit.client.1.smithi176.stdout:7/380: rename d0/d2/db/d10/d23/f2e to d0/d2/db/d10/d31/d65/f86 0 2024-09-21T12:46:54.104 INFO:tasks.workunit.client.1.smithi176.stdout:8/279: dwrite d6/db/d32/f40 [0,4194304] 0 2024-09-21T12:46:54.106 INFO:tasks.workunit.client.1.smithi176.stdout:3/342: dread d1/f51 [0,4194304] 0 2024-09-21T12:46:54.107 INFO:tasks.workunit.client.1.smithi176.stdout:7/381: chown d0/d2/l39 12811981 1 2024-09-21T12:46:54.107 INFO:tasks.workunit.client.1.smithi176.stdout:9/264: dwrite d1/df/d23/f24 [0,4194304] 0 2024-09-21T12:46:54.107 INFO:tasks.workunit.client.1.smithi176.stdout:6/281: rename d2/dd/l21 to d2/dd/d26/d2b/d10/d1b/l58 0 2024-09-21T12:46:54.109 INFO:tasks.workunit.client.1.smithi176.stdout:8/280: symlink d6/db/l58 0 2024-09-21T12:46:54.111 INFO:tasks.workunit.client.1.smithi176.stdout:1/283: creat d0/db/d1a/d2c/d48/f68 x:0 0 0 2024-09-21T12:46:54.112 INFO:tasks.workunit.client.1.smithi176.stdout:9/265: write d1/df/f46 [4533850,40721] 0 2024-09-21T12:46:54.112 INFO:tasks.workunit.client.1.smithi176.stdout:7/382: mknod d0/d2f/c87 0 2024-09-21T12:46:54.113 INFO:tasks.workunit.client.1.smithi176.stdout:1/284: stat d0/db/d1a/f21 0 2024-09-21T12:46:54.115 INFO:tasks.workunit.client.1.smithi176.stdout:0/371: dwrite d9/dc/d1e/f6c [0,4194304] 0 2024-09-21T12:46:54.117 INFO:tasks.workunit.client.1.smithi176.stdout:6/282: write d2/dd/d26/d2b/d10/d1b/f55 [3137853,50219] 0 2024-09-21T12:46:54.118 INFO:tasks.workunit.client.1.smithi176.stdout:8/281: write d6/d8/d24/d35/f42 [3049980,102252] 0 2024-09-21T12:46:54.119 INFO:tasks.workunit.client.1.smithi176.stdout:9/266: mknod d1/df/d1e/d38/c5f 0 2024-09-21T12:46:54.120 INFO:tasks.workunit.client.1.smithi176.stdout:4/291: truncate d3/d21/d27/f40 426063 0 2024-09-21T12:46:54.121 INFO:tasks.workunit.client.1.smithi176.stdout:4/292: stat d3/d5/db 0 2024-09-21T12:46:54.122 INFO:tasks.workunit.client.1.smithi176.stdout:7/383: dread d0/d2/db/d10/d31/d65/f47 [0,4194304] 0 2024-09-21T12:46:54.122 INFO:tasks.workunit.client.1.smithi176.stdout:1/285: creat d0/db/d25/d2b/d43/f69 x:0 0 0 2024-09-21T12:46:54.124 INFO:tasks.workunit.client.1.smithi176.stdout:4/293: read d3/d5/f44 [388382,15408] 0 2024-09-21T12:46:54.125 INFO:tasks.workunit.client.1.smithi176.stdout:8/282: mknod d6/db/d13/c59 0 2024-09-21T12:46:54.126 INFO:tasks.workunit.client.1.smithi176.stdout:8/283: read d6/db/d32/f40 [2176085,62267] 0 2024-09-21T12:46:54.127 INFO:tasks.workunit.client.1.smithi176.stdout:0/372: mknod d9/c7e 0 2024-09-21T12:46:54.129 INFO:tasks.workunit.client.1.smithi176.stdout:1/286: mkdir d0/db/d6a 0 2024-09-21T12:46:54.130 INFO:tasks.workunit.client.1.smithi176.stdout:4/294: chown d3/d21/l46 279293 1 2024-09-21T12:46:54.131 INFO:tasks.workunit.client.1.smithi176.stdout:1/287: write d0/db/f22 [4381960,35067] 0 2024-09-21T12:46:54.132 INFO:tasks.workunit.client.1.smithi176.stdout:0/373: rmdir d9/d1a 39 2024-09-21T12:46:54.133 INFO:tasks.workunit.client.1.smithi176.stdout:9/267: creat d1/df/f60 x:0 0 0 2024-09-21T12:46:54.133 INFO:tasks.workunit.client.1.smithi176.stdout:9/268: chown d1/c4e 1451764706 1 2024-09-21T12:46:54.136 INFO:tasks.workunit.client.1.smithi176.stdout:8/284: fdatasync d6/db/f17 0 2024-09-21T12:46:54.137 INFO:tasks.workunit.client.1.smithi176.stdout:7/384: link d0/d2/db/d10/f2c d0/d2/db/d10/d3b/f88 0 2024-09-21T12:46:54.138 INFO:tasks.workunit.client.1.smithi176.stdout:1/288: mkdir d0/db/d1a/d2c/d6b 0 2024-09-21T12:46:54.140 INFO:tasks.workunit.client.1.smithi176.stdout:4/295: dread d3/d5/f44 [0,4194304] 0 2024-09-21T12:46:54.142 INFO:tasks.workunit.client.1.smithi176.stdout:7/385: mkdir d0/d2/db/d55/d89 0 2024-09-21T12:46:54.144 INFO:tasks.workunit.client.1.smithi176.stdout:1/289: creat d0/d63/f6c x:0 0 0 2024-09-21T12:46:54.144 INFO:tasks.workunit.client.1.smithi176.stdout:3/343: dread d1/d34/f52 [0,4194304] 0 2024-09-21T12:46:54.148 INFO:tasks.workunit.client.1.smithi176.stdout:1/290: chown d0/f58 33228419 1 2024-09-21T12:46:54.150 INFO:tasks.workunit.client.1.smithi176.stdout:7/386: read - d0/d2/db/d10/d31/d65/f4a zero size 2024-09-21T12:46:54.152 INFO:tasks.workunit.client.1.smithi176.stdout:4/296: truncate d3/d42/d4d/f58 886824 0 2024-09-21T12:46:54.152 INFO:tasks.workunit.client.1.smithi176.stdout:9/269: dwrite d1/df/f41 [0,4194304] 0 2024-09-21T12:46:54.155 INFO:tasks.workunit.client.1.smithi176.stdout:8/285: dread d6/d16/f1e [0,4194304] 0 2024-09-21T12:46:54.155 INFO:tasks.workunit.client.1.smithi176.stdout:0/374: dwrite d9/d1a/d1d/d23/f44 [0,4194304] 0 2024-09-21T12:46:54.156 INFO:tasks.workunit.client.1.smithi176.stdout:7/387: write d0/d2/db/d10/f2b [2551705,99194] 0 2024-09-21T12:46:54.160 INFO:tasks.workunit.client.1.smithi176.stdout:7/388: mkdir d0/d5d/d8a 0 2024-09-21T12:46:54.160 INFO:tasks.workunit.client.1.smithi176.stdout:3/344: dread d1/f39 [0,4194304] 0 2024-09-21T12:46:54.161 INFO:tasks.workunit.client.1.smithi176.stdout:8/286: write d6/d8/d24/d35/f4a [109358,124374] 0 2024-09-21T12:46:54.163 INFO:tasks.workunit.client.1.smithi176.stdout:0/375: creat d9/d1a/d3f/d40/d79/f7f x:0 0 0 2024-09-21T12:46:54.164 INFO:tasks.workunit.client.1.smithi176.stdout:8/287: dread - d6/d8/d24/d35/f4f zero size 2024-09-21T12:46:54.165 INFO:tasks.workunit.client.1.smithi176.stdout:1/291: dread d0/db/f15 [0,4194304] 0 2024-09-21T12:46:54.165 INFO:tasks.workunit.client.1.smithi176.stdout:7/389: symlink d0/d2/db/d55/l8b 0 2024-09-21T12:46:54.166 INFO:tasks.workunit.client.1.smithi176.stdout:2/297: sync 2024-09-21T12:46:54.167 INFO:tasks.workunit.client.1.smithi176.stdout:3/345: mkdir d1/d5/d25/d40/d87 0 2024-09-21T12:46:54.168 INFO:tasks.workunit.client.1.smithi176.stdout:8/288: chown d6/d8/f2e 109 1 2024-09-21T12:46:54.168 INFO:tasks.workunit.client.1.smithi176.stdout:9/270: write d1/df/d1e/d38/f43 [140477,36786] 0 2024-09-21T12:46:54.172 INFO:tasks.workunit.client.1.smithi176.stdout:8/289: creat d6/db/d13/f5a x:0 0 0 2024-09-21T12:46:54.172 INFO:tasks.workunit.client.1.smithi176.stdout:9/271: mkdir d1/d61 0 2024-09-21T12:46:54.174 INFO:tasks.workunit.client.1.smithi176.stdout:7/390: creat d0/d2f/d43/f8c x:0 0 0 2024-09-21T12:46:54.176 INFO:tasks.workunit.client.1.smithi176.stdout:0/376: link d9/d1a/d3f/d40/d79/f7f d9/d1a/d3f/f80 0 2024-09-21T12:46:54.177 INFO:tasks.workunit.client.1.smithi176.stdout:8/290: truncate d6/db/d13/f4d 912346 0 2024-09-21T12:46:54.177 INFO:tasks.workunit.client.1.smithi176.stdout:7/391: stat d0/d2/db/d10/d23/d85 0 2024-09-21T12:46:54.178 INFO:tasks.workunit.client.1.smithi176.stdout:9/272: creat d1/df/d1e/d4d/f62 x:0 0 0 2024-09-21T12:46:54.179 INFO:tasks.workunit.client.1.smithi176.stdout:2/298: dwrite d4/df/f21 [0,4194304] 0 2024-09-21T12:46:54.181 INFO:tasks.workunit.client.1.smithi176.stdout:9/273: mkdir d1/d63 0 2024-09-21T12:46:54.183 INFO:tasks.workunit.client.1.smithi176.stdout:8/291: unlink d6/l49 0 2024-09-21T12:46:54.184 INFO:tasks.workunit.client.1.smithi176.stdout:2/299: readlink d4/d3a/l49 0 2024-09-21T12:46:54.184 INFO:tasks.workunit.client.1.smithi176.stdout:9/274: stat d1/df/d23/l2c 0 2024-09-21T12:46:54.187 INFO:tasks.workunit.client.1.smithi176.stdout:3/346: getdents d1/d5/d25/d40 0 2024-09-21T12:46:54.187 INFO:tasks.workunit.client.1.smithi176.stdout:8/292: fdatasync d6/d8/d24/d35/d51/f53 0 2024-09-21T12:46:54.188 INFO:tasks.workunit.client.1.smithi176.stdout:9/275: symlink d1/df/d48/l64 0 2024-09-21T12:46:54.188 INFO:tasks.workunit.client.1.smithi176.stdout:4/297: dread d3/d5/f13 [0,4194304] 0 2024-09-21T12:46:54.188 INFO:tasks.workunit.client.1.smithi176.stdout:1/292: truncate d0/f2 5349786 0 2024-09-21T12:46:54.189 INFO:tasks.workunit.client.1.smithi176.stdout:9/276: fdatasync d1/df/d23/f45 0 2024-09-21T12:46:54.190 INFO:tasks.workunit.client.1.smithi176.stdout:2/300: rename d4/df/c32 to d4/d3d/c58 0 2024-09-21T12:46:54.191 INFO:tasks.workunit.client.1.smithi176.stdout:1/293: write d0/db/d25/d2b/d43/f60 [691997,73558] 0 2024-09-21T12:46:54.191 INFO:tasks.workunit.client.1.smithi176.stdout:9/277: write d1/df/d1e/f37 [1064753,32199] 0 2024-09-21T12:46:54.192 INFO:tasks.workunit.client.1.smithi176.stdout:2/301: chown d4/df/f48 13 1 2024-09-21T12:46:54.194 INFO:tasks.workunit.client.1.smithi176.stdout:2/302: chown d4/l30 18 1 2024-09-21T12:46:54.196 INFO:tasks.workunit.client.1.smithi176.stdout:8/293: link d6/f15 d6/f5b 0 2024-09-21T12:46:54.196 INFO:tasks.workunit.client.1.smithi176.stdout:4/298: dread d3/d5/db/f33 [0,4194304] 0 2024-09-21T12:46:54.197 INFO:tasks.workunit.client.1.smithi176.stdout:9/278: mknod d1/df/d1e/c65 0 2024-09-21T12:46:54.198 INFO:tasks.workunit.client.1.smithi176.stdout:7/392: truncate d0/d2/f35 601513 0 2024-09-21T12:46:54.198 INFO:tasks.workunit.client.1.smithi176.stdout:4/299: chown d3/d5/db/f33 711952 1 2024-09-21T12:46:54.199 INFO:tasks.workunit.client.1.smithi176.stdout:0/377: truncate d9/d1a/d1d/d23/f5b 3298981 0 2024-09-21T12:46:54.199 INFO:tasks.workunit.client.1.smithi176.stdout:3/347: dread d1/f1a [0,4194304] 0 2024-09-21T12:46:54.199 INFO:tasks.workunit.client.1.smithi176.stdout:8/294: mknod d6/d16/d36/c5c 0 2024-09-21T12:46:54.200 INFO:tasks.workunit.client.1.smithi176.stdout:2/303: unlink d4/df/f26 0 2024-09-21T12:46:54.200 INFO:tasks.workunit.client.1.smithi176.stdout:9/279: chown d1/df/d1c/f3c 5501143 1 2024-09-21T12:46:54.201 INFO:tasks.workunit.client.1.smithi176.stdout:7/393: mknod d0/d2/db/d55/c8d 0 2024-09-21T12:46:54.202 INFO:tasks.workunit.client.1.smithi176.stdout:3/348: mknod d1/d35/c88 0 2024-09-21T12:46:54.202 INFO:tasks.workunit.client.1.smithi176.stdout:9/280: readlink d1/df/d23/l2c 0 2024-09-21T12:46:54.203 INFO:tasks.workunit.client.1.smithi176.stdout:1/294: dwrite d0/db/d1a/f20 [0,4194304] 0 2024-09-21T12:46:54.203 INFO:tasks.workunit.client.1.smithi176.stdout:2/304: fsync d4/d2b/f3e 0 2024-09-21T12:46:54.204 INFO:tasks.workunit.client.1.smithi176.stdout:0/378: truncate d9/dc/d1e/f6f 333196 0 2024-09-21T12:46:54.204 INFO:tasks.workunit.client.1.smithi176.stdout:3/349: chown d1/fe 843761 1 2024-09-21T12:46:54.206 INFO:tasks.workunit.client.1.smithi176.stdout:4/300: link d3/d5/c14 d3/d42/d56/c61 0 2024-09-21T12:46:54.209 INFO:tasks.workunit.client.1.smithi176.stdout:1/295: write d0/db/d1a/d2c/f4a [954018,99185] 0 2024-09-21T12:46:54.211 INFO:tasks.workunit.client.1.smithi176.stdout:0/379: write d9/d1b/f71 [276498,98852] 0 2024-09-21T12:46:54.212 INFO:tasks.workunit.client.1.smithi176.stdout:4/301: readlink d3/d5/db/l30 0 2024-09-21T12:46:54.215 INFO:tasks.workunit.client.1.smithi176.stdout:8/295: dwrite d6/db/f43 [0,4194304] 0 2024-09-21T12:46:54.216 INFO:tasks.workunit.client.1.smithi176.stdout:7/394: fsync d0/d2/f35 0 2024-09-21T12:46:54.219 INFO:tasks.workunit.client.1.smithi176.stdout:1/296: chown d0/db/d1a/d2c/d48/d50/l40 9859871 1 2024-09-21T12:46:54.219 INFO:tasks.workunit.client.1.smithi176.stdout:3/350: dread d1/da/f21 [0,4194304] 0 2024-09-21T12:46:54.221 INFO:tasks.workunit.client.1.smithi176.stdout:7/395: write d0/d2/db/d10/f29 [854325,121705] 0 2024-09-21T12:46:54.223 INFO:tasks.workunit.client.1.smithi176.stdout:4/302: mknod d3/d5/db/d36/c62 0 2024-09-21T12:46:54.223 INFO:tasks.workunit.client.1.smithi176.stdout:0/380: write d9/d1a/d1d/d23/f7c [864278,54517] 0 2024-09-21T12:46:54.224 INFO:tasks.workunit.client.1.smithi176.stdout:9/281: rename d1/df/d1e/d38/f4b to d1/f66 0 2024-09-21T12:46:54.225 INFO:tasks.workunit.client.1.smithi176.stdout:2/305: getdents d4/df/d2e 0 2024-09-21T12:46:54.226 INFO:tasks.workunit.client.1.smithi176.stdout:9/282: write d1/df/d1c/f3a [2103301,26869] 0 2024-09-21T12:46:54.229 INFO:tasks.workunit.client.1.smithi176.stdout:3/351: write d1/d5/d25/d38/f79 [778183,126510] 0 2024-09-21T12:46:54.229 INFO:tasks.workunit.client.1.smithi176.stdout:7/396: creat d0/d2/db/d10/d23/f8e x:0 0 0 2024-09-21T12:46:54.230 INFO:tasks.workunit.client.1.smithi176.stdout:8/296: rmdir d6/d16/d52 0 2024-09-21T12:46:54.232 INFO:tasks.workunit.client.1.smithi176.stdout:0/381: mkdir d9/d1a/d1d/d81 0 2024-09-21T12:46:54.232 INFO:tasks.workunit.client.1.smithi176.stdout:3/352: write d1/d34/d42/f67 [882563,79926] 0 2024-09-21T12:46:54.233 INFO:tasks.workunit.client.1.smithi176.stdout:9/283: mkdir d1/df/d23/d67 0 2024-09-21T12:46:54.234 INFO:tasks.workunit.client.1.smithi176.stdout:8/297: readlink d6/d8/d24/l41 0 2024-09-21T12:46:54.235 INFO:tasks.workunit.client.1.smithi176.stdout:4/303: dread d3/d5/fd [0,4194304] 0 2024-09-21T12:46:54.237 INFO:tasks.workunit.client.1.smithi176.stdout:3/353: chown d1/d34/d48/c4a 864 1 2024-09-21T12:46:54.239 INFO:tasks.workunit.client.1.smithi176.stdout:9/284: unlink d1/df/d1e/l28 0 2024-09-21T12:46:54.240 INFO:tasks.workunit.client.1.smithi176.stdout:8/298: symlink d6/d8/d24/l5d 0 2024-09-21T12:46:54.241 INFO:tasks.workunit.client.1.smithi176.stdout:2/306: dwrite d4/df/f1e [0,4194304] 0 2024-09-21T12:46:54.241 INFO:tasks.workunit.client.1.smithi176.stdout:0/382: rename d9/d1a/l33 to d9/d1a/d3f/d40/l82 0 2024-09-21T12:46:54.243 INFO:tasks.workunit.client.1.smithi176.stdout:1/297: dread d0/db/ff [0,4194304] 0 2024-09-21T12:46:54.244 INFO:tasks.workunit.client.1.smithi176.stdout:3/354: creat d1/da/f89 x:0 0 0 2024-09-21T12:46:54.244 INFO:tasks.workunit.client.1.smithi176.stdout:0/383: chown d9/d1b/c31 147151903 1 2024-09-21T12:46:54.245 INFO:tasks.workunit.client.1.smithi176.stdout:7/397: dwrite d0/d2f/d43/f8c [0,4194304] 0 2024-09-21T12:46:54.247 INFO:tasks.workunit.client.1.smithi176.stdout:2/307: creat d4/d2b/f59 x:0 0 0 2024-09-21T12:46:54.249 INFO:tasks.workunit.client.1.smithi176.stdout:0/384: write d9/d1a/d1d/d23/f44 [4162249,76732] 0 2024-09-21T12:46:54.249 INFO:tasks.workunit.client.1.smithi176.stdout:3/355: creat d1/d35/f8a x:0 0 0 2024-09-21T12:46:54.252 INFO:tasks.workunit.client.1.smithi176.stdout:3/356: write d1/d34/f52 [1138460,63948] 0 2024-09-21T12:46:54.252 INFO:tasks.workunit.client.1.smithi176.stdout:0/385: write d9/d1a/d1d/d23/f32 [6371648,37533] 0 2024-09-21T12:46:54.253 INFO:tasks.workunit.client.1.smithi176.stdout:0/386: chown d9/dc/d1e/f6e 1980 1 2024-09-21T12:46:54.254 INFO:tasks.workunit.client.1.smithi176.stdout:2/308: creat d4/df/f5a x:0 0 0 2024-09-21T12:46:54.255 INFO:tasks.workunit.client.1.smithi176.stdout:5/240: sync 2024-09-21T12:46:54.256 INFO:tasks.workunit.client.1.smithi176.stdout:4/304: rename d3/l24 to d3/d5/l63 0 2024-09-21T12:46:54.257 INFO:tasks.workunit.client.1.smithi176.stdout:1/298: mkdir d0/db/d1a/d2c/d66/d6d 0 2024-09-21T12:46:54.257 INFO:tasks.workunit.client.1.smithi176.stdout:5/241: truncate d0/d10/d11/d2e/f46 534634 0 2024-09-21T12:46:54.264 INFO:tasks.workunit.client.1.smithi176.stdout:1/299: dwrite d0/db/d2a/f4c [0,4194304] 0 2024-09-21T12:46:54.378 INFO:tasks.workunit.client.1.smithi176.stdout:6/283: sync 2024-09-21T12:46:54.378 INFO:tasks.workunit.client.1.smithi176.stdout:6/284: chown d2/dd/d26/d2b/l28 74 1 2024-09-21T12:46:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:54 smithi046 ceph-mon[27868]: pgmap v23: 65 pgs: 65 active+clean; 419 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 29 MiB/s wr, 238 op/s 2024-09-21T12:46:54.453 INFO:tasks.workunit.client.1.smithi176.stdout:9/285: sync 2024-09-21T12:46:54.454 INFO:tasks.workunit.client.1.smithi176.stdout:9/286: read - d1/df/d1e/d4d/f62 zero size 2024-09-21T12:46:54.471 INFO:tasks.workunit.client.1.smithi176.stdout:2/309: unlink d4/df/f1e 0 2024-09-21T12:46:54.473 INFO:tasks.workunit.client.1.smithi176.stdout:3/357: rename d1/l3 to d1/d34/d42/d5b/l8b 0 2024-09-21T12:46:54.473 INFO:tasks.workunit.client.1.smithi176.stdout:5/242: creat d0/d13/f48 x:0 0 0 2024-09-21T12:46:54.474 INFO:tasks.workunit.client.1.smithi176.stdout:3/358: write d1/d35/f8a [544026,84037] 0 2024-09-21T12:46:54.475 INFO:tasks.workunit.client.1.smithi176.stdout:3/359: stat d1/d5/c15 0 2024-09-21T12:46:54.476 INFO:tasks.workunit.client.1.smithi176.stdout:1/300: unlink d0/db/f19 0 2024-09-21T12:46:54.477 INFO:tasks.workunit.client.1.smithi176.stdout:1/301: write d0/db/d1a/f38 [685372,130459] 0 2024-09-21T12:46:54.478 INFO:tasks.workunit.client.1.smithi176.stdout:0/387: creat d9/d1a/d1d/d81/f83 x:0 0 0 2024-09-21T12:46:54.481 INFO:tasks.workunit.client.1.smithi176.stdout:1/302: dread d0/db/f17 [0,4194304] 0 2024-09-21T12:46:54.481 INFO:tasks.workunit.client.1.smithi176.stdout:3/360: write d1/d5/d25/d38/f3f [492993,72251] 0 2024-09-21T12:46:54.482 INFO:tasks.workunit.client.1.smithi176.stdout:9/287: symlink d1/d63/l68 0 2024-09-21T12:46:54.484 INFO:tasks.workunit.client.1.smithi176.stdout:5/243: creat d0/d10/d11/d2e/d39/d41/f49 x:0 0 0 2024-09-21T12:46:54.486 INFO:tasks.workunit.client.1.smithi176.stdout:0/388: mknod d9/d1b/d63/d77/d78/c84 0 2024-09-21T12:46:54.487 INFO:tasks.workunit.client.1.smithi176.stdout:9/288: rename d1/df/d1e to d1/df/d48/d69 0 2024-09-21T12:46:54.488 INFO:tasks.workunit.client.1.smithi176.stdout:9/289: read - d1/df/d48/f4a zero size 2024-09-21T12:46:54.488 INFO:tasks.workunit.client.1.smithi176.stdout:5/244: rmdir d0/d10/d11/d2e/d39/d41 39 2024-09-21T12:46:54.490 INFO:tasks.workunit.client.1.smithi176.stdout:3/361: link d1/d34/d42/f67 d1/d34/f8c 0 2024-09-21T12:46:54.492 INFO:tasks.workunit.client.1.smithi176.stdout:0/389: rename d9/d1a/d1d/d4f/f59 to d9/d1a/d3f/d40/f85 0 2024-09-21T12:46:54.493 INFO:tasks.workunit.client.1.smithi176.stdout:1/303: write d0/db/d25/d2b/f35 [733376,34831] 0 2024-09-21T12:46:54.493 INFO:tasks.workunit.client.1.smithi176.stdout:5/245: symlink d0/d10/d11/l4a 0 2024-09-21T12:46:54.494 INFO:tasks.workunit.client.1.smithi176.stdout:9/290: dwrite d1/df/d1c/f3a [0,4194304] 0 2024-09-21T12:46:54.501 INFO:tasks.workunit.client.1.smithi176.stdout:3/362: mkdir d1/d8d 0 2024-09-21T12:46:54.501 INFO:tasks.workunit.client.1.smithi176.stdout:9/291: unlink d1/c19 0 2024-09-21T12:46:54.502 INFO:tasks.workunit.client.1.smithi176.stdout:9/292: fdatasync d1/df/d48/d69/f21 0 2024-09-21T12:46:54.505 INFO:tasks.workunit.client.1.smithi176.stdout:1/304: truncate d0/db/d25/d2b/f3b 1990488 0 2024-09-21T12:46:54.506 INFO:tasks.workunit.client.1.smithi176.stdout:3/363: unlink d1/da/f21 0 2024-09-21T12:46:54.508 INFO:tasks.workunit.client.1.smithi176.stdout:5/246: creat d0/d10/d11/d2e/d39/f4b x:0 0 0 2024-09-21T12:46:54.509 INFO:tasks.workunit.client.1.smithi176.stdout:0/390: truncate d9/dc/d1e/f6c 1248925 0 2024-09-21T12:46:54.509 INFO:tasks.workunit.client.1.smithi176.stdout:9/293: dwrite d1/df/d1c/f3c [0,4194304] 0 2024-09-21T12:46:54.511 INFO:tasks.workunit.client.1.smithi176.stdout:0/391: stat f5 0 2024-09-21T12:46:54.512 INFO:tasks.workunit.client.1.smithi176.stdout:3/364: rename d1/d5/d25/c6a to d1/d35/d5e/c8e 0 2024-09-21T12:46:54.514 INFO:tasks.workunit.client.1.smithi176.stdout:9/294: truncate d1/df/d48/d69/d40/f53 293056 0 2024-09-21T12:46:54.518 INFO:tasks.workunit.client.1.smithi176.stdout:5/247: rename d0/d10/d11/f21 to d0/d10/f4c 0 2024-09-21T12:46:54.521 INFO:tasks.workunit.client.1.smithi176.stdout:1/305: rename d0/db/d25/d2b/d43/f52 to d0/db/d1a/d2c/d66/f6e 0 2024-09-21T12:46:54.522 INFO:tasks.workunit.client.1.smithi176.stdout:9/295: link d1/l22 d1/df/d23/l6a 0 2024-09-21T12:46:54.522 INFO:tasks.workunit.client.1.smithi176.stdout:0/392: dread d9/d35/f7d [0,4194304] 0 2024-09-21T12:46:54.523 INFO:tasks.workunit.client.1.smithi176.stdout:9/296: chown d1/df/d23/f24 166633 1 2024-09-21T12:46:54.524 INFO:tasks.workunit.client.1.smithi176.stdout:0/393: write d9/d1a/d1d/d22/f3b [5180793,5201] 0 2024-09-21T12:46:54.525 INFO:tasks.workunit.client.1.smithi176.stdout:1/306: dread d0/db/d1a/f38 [0,4194304] 0 2024-09-21T12:46:54.535 INFO:tasks.workunit.client.1.smithi176.stdout:7/398: sync 2024-09-21T12:46:54.535 INFO:tasks.workunit.client.1.smithi176.stdout:6/285: sync 2024-09-21T12:46:54.535 INFO:tasks.workunit.client.1.smithi176.stdout:8/299: sync 2024-09-21T12:46:54.535 INFO:tasks.workunit.client.1.smithi176.stdout:4/305: sync 2024-09-21T12:46:54.551 INFO:tasks.workunit.client.1.smithi176.stdout:3/365: truncate d1/da/f22 1970403 0 2024-09-21T12:46:54.552 INFO:tasks.workunit.client.1.smithi176.stdout:8/300: mkdir d6/d8/d24/d5e 0 2024-09-21T12:46:54.553 INFO:tasks.workunit.client.1.smithi176.stdout:6/286: chown d2/dd/d26/d2b/d10/d1b/d37/f4b 361 1 2024-09-21T12:46:54.553 INFO:tasks.workunit.client.1.smithi176.stdout:4/306: dread d3/d5/db/f31 [0,4194304] 0 2024-09-21T12:46:54.554 INFO:tasks.workunit.client.1.smithi176.stdout:9/297: dread d1/df/d1c/f49 [0,4194304] 0 2024-09-21T12:46:54.555 INFO:tasks.workunit.client.1.smithi176.stdout:0/394: dread d9/dc/f38 [0,4194304] 0 2024-09-21T12:46:54.555 INFO:tasks.workunit.client.1.smithi176.stdout:6/287: fdatasync d2/f20 0 2024-09-21T12:46:54.556 INFO:tasks.workunit.client.1.smithi176.stdout:3/366: rename d1/d5/l23 to d1/d5/d25/l8f 0 2024-09-21T12:46:54.556 INFO:tasks.workunit.client.1.smithi176.stdout:4/307: readlink d3/d5/db/l55 0 2024-09-21T12:46:54.559 INFO:tasks.workunit.client.1.smithi176.stdout:3/367: chown d1/d34/d5d/d78 114388229 1 2024-09-21T12:46:54.560 INFO:tasks.workunit.client.1.smithi176.stdout:0/395: write d9/d1a/d3f/d40/f72 [421003,13088] 0 2024-09-21T12:46:54.562 INFO:tasks.workunit.client.1.smithi176.stdout:9/298: mknod d1/df/d48/d69/d40/c6b 0 2024-09-21T12:46:54.566 INFO:tasks.workunit.client.1.smithi176.stdout:3/368: mkdir d1/d35/d5e/d90 0 2024-09-21T12:46:54.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:54 smithi176 ceph-mon[35476]: pgmap v23: 65 pgs: 65 active+clean; 419 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 29 MiB/s wr, 238 op/s 2024-09-21T12:46:54.566 INFO:tasks.workunit.client.1.smithi176.stdout:1/307: dread d0/db/f22 [0,4194304] 0 2024-09-21T12:46:54.567 INFO:tasks.workunit.client.1.smithi176.stdout:8/301: link d6/db/l3b d6/db/d32/l5f 0 2024-09-21T12:46:54.568 INFO:tasks.workunit.client.1.smithi176.stdout:9/299: creat d1/df/d48/f6c x:0 0 0 2024-09-21T12:46:54.569 INFO:tasks.workunit.client.1.smithi176.stdout:9/300: truncate d1/df/d23/f24 4238907 0 2024-09-21T12:46:54.570 INFO:tasks.workunit.client.1.smithi176.stdout:3/369: unlink d1/d34/d42/l4c 0 2024-09-21T12:46:54.571 INFO:tasks.workunit.client.1.smithi176.stdout:6/288: dread d2/f31 [0,4194304] 0 2024-09-21T12:46:54.572 INFO:tasks.workunit.client.1.smithi176.stdout:3/370: write d1/d5/d25/d5c/d7d/f80 [582258,62732] 0 2024-09-21T12:46:54.572 INFO:tasks.workunit.client.1.smithi176.stdout:6/289: chown d2/dd/d26/l44 22042 1 2024-09-21T12:46:54.572 INFO:tasks.workunit.client.1.smithi176.stdout:1/308: mkdir d0/db/d6f 0 2024-09-21T12:46:54.572 INFO:tasks.workunit.client.1.smithi176.stdout:4/308: write d3/d5/f44 [842619,17701] 0 2024-09-21T12:46:54.572 INFO:tasks.workunit.client.1.smithi176.stdout:3/371: fdatasync f0 0 2024-09-21T12:46:54.574 INFO:tasks.workunit.client.1.smithi176.stdout:8/302: symlink d6/d8/d24/l60 0 2024-09-21T12:46:54.581 INFO:tasks.workunit.client.1.smithi176.stdout:4/309: mknod d3/d5/db/d36/c64 0 2024-09-21T12:46:54.583 INFO:tasks.workunit.client.1.smithi176.stdout:0/396: link d9/d1a/d20/c21 d9/dc/d1e/c86 0 2024-09-21T12:46:54.584 INFO:tasks.workunit.client.1.smithi176.stdout:4/310: fsync d3/d5/db/f50 0 2024-09-21T12:46:54.584 INFO:tasks.workunit.client.1.smithi176.stdout:1/309: rename d0/db/d1a/l62 to d0/db/l70 0 2024-09-21T12:46:54.586 INFO:tasks.workunit.client.1.smithi176.stdout:1/310: stat d0/f5e 0 2024-09-21T12:46:54.587 INFO:tasks.workunit.client.1.smithi176.stdout:9/301: dwrite d1/df/d48/f4a [0,4194304] 0 2024-09-21T12:46:54.587 INFO:tasks.workunit.client.1.smithi176.stdout:3/372: dwrite d1/d3e/f58 [0,4194304] 0 2024-09-21T12:46:54.589 INFO:tasks.workunit.client.1.smithi176.stdout:6/290: dread d2/dd/d26/d2b/f14 [0,4194304] 0 2024-09-21T12:46:54.589 INFO:tasks.workunit.client.1.smithi176.stdout:0/397: mkdir d9/d1b/d63/d77/d87 0 2024-09-21T12:46:54.592 INFO:tasks.workunit.client.1.smithi176.stdout:3/373: mkdir d1/d34/d71/d91 0 2024-09-21T12:46:54.595 INFO:tasks.workunit.client.1.smithi176.stdout:6/291: mknod d2/dd/d26/d2b/d10/d1b/d50/c59 0 2024-09-21T12:46:54.599 INFO:tasks.workunit.client.1.smithi176.stdout:1/311: dwrite d0/f5e [0,4194304] 0 2024-09-21T12:46:54.600 INFO:tasks.workunit.client.1.smithi176.stdout:4/311: rename d3/d42/l5f to d3/l65 0 2024-09-21T12:46:54.601 INFO:tasks.workunit.client.1.smithi176.stdout:9/302: truncate d1/df/d48/d69/f27 784540 0 2024-09-21T12:46:54.607 INFO:tasks.workunit.client.1.smithi176.stdout:6/292: mkdir d2/dd/d26/d2b/d5a 0 2024-09-21T12:46:54.607 INFO:tasks.workunit.client.1.smithi176.stdout:4/312: dread d3/d5/f13 [0,4194304] 0 2024-09-21T12:46:54.608 INFO:tasks.workunit.client.1.smithi176.stdout:1/312: symlink d0/db/d1a/d2c/d48/d50/l71 0 2024-09-21T12:46:54.610 INFO:tasks.workunit.client.1.smithi176.stdout:0/398: rename d9/d1a/d1d/d53 to d9/d1b/d63/d77/d88 0 2024-09-21T12:46:54.613 INFO:tasks.workunit.client.1.smithi176.stdout:6/293: creat d2/dd/d26/d2b/d10/d39/f5b x:0 0 0 2024-09-21T12:46:54.613 INFO:tasks.workunit.client.1.smithi176.stdout:1/313: mkdir d0/db/d25/d2b/d72 0 2024-09-21T12:46:54.614 INFO:tasks.workunit.client.1.smithi176.stdout:4/313: mknod d3/d5/c66 0 2024-09-21T12:46:54.615 INFO:tasks.workunit.client.1.smithi176.stdout:6/294: fsync d2/f56 0 2024-09-21T12:46:54.617 INFO:tasks.workunit.client.1.smithi176.stdout:8/303: dwrite d6/d16/f2d [0,4194304] 0 2024-09-21T12:46:54.617 INFO:tasks.workunit.client.1.smithi176.stdout:6/295: chown d2/dd/d26/d2b/d5a 45 1 2024-09-21T12:46:54.618 INFO:tasks.workunit.client.1.smithi176.stdout:9/303: dwrite d1/f33 [0,4194304] 0 2024-09-21T12:46:54.619 INFO:tasks.workunit.client.1.smithi176.stdout:0/399: rename d9/d1a/d1d/d23/f7c to d9/d1a/d1d/d23/d5f/f89 0 2024-09-21T12:46:54.619 INFO:tasks.workunit.client.1.smithi176.stdout:6/296: chown d2/dd/d26/d2b/d10/d1b/d50 165762992 1 2024-09-21T12:46:54.620 INFO:tasks.workunit.client.1.smithi176.stdout:9/304: chown d1/l1d 82268 1 2024-09-21T12:46:54.628 INFO:tasks.workunit.client.1.smithi176.stdout:2/310: sync 2024-09-21T12:46:54.644 INFO:tasks.workunit.client.1.smithi176.stdout:1/314: mkdir d0/db/d1a/d73 0 2024-09-21T12:46:54.645 INFO:tasks.workunit.client.1.smithi176.stdout:8/304: creat d6/d8/d24/d35/f61 x:0 0 0 2024-09-21T12:46:54.647 INFO:tasks.workunit.client.1.smithi176.stdout:2/311: creat d4/d3d/f5b x:0 0 0 2024-09-21T12:46:54.648 INFO:tasks.workunit.client.1.smithi176.stdout:8/305: mknod d6/db/c62 0 2024-09-21T12:46:54.649 INFO:tasks.workunit.client.1.smithi176.stdout:1/315: getdents d0/db/d25/d2b/d72 0 2024-09-21T12:46:54.650 INFO:tasks.workunit.client.1.smithi176.stdout:3/374: dwrite d1/d5/d25/d38/f54 [4194304,4194304] 0 2024-09-21T12:46:54.651 INFO:tasks.workunit.client.1.smithi176.stdout:2/312: creat d4/d3a/f5c x:0 0 0 2024-09-21T12:46:54.652 INFO:tasks.workunit.client.1.smithi176.stdout:2/313: write d4/d2b/f59 [808560,114395] 0 2024-09-21T12:46:54.654 INFO:tasks.workunit.client.1.smithi176.stdout:9/305: getdents d1/df/d48 0 2024-09-21T12:46:54.656 INFO:tasks.workunit.client.1.smithi176.stdout:8/306: link d6/db/f43 d6/d16/f63 0 2024-09-21T12:46:54.658 INFO:tasks.workunit.client.1.smithi176.stdout:2/314: mkdir d4/d2b/d5d 0 2024-09-21T12:46:54.658 INFO:tasks.workunit.client.1.smithi176.stdout:0/400: write d9/d1a/d1d/d23/f5b [1542487,24328] 0 2024-09-21T12:46:54.659 INFO:tasks.workunit.client.1.smithi176.stdout:6/297: truncate d2/dd/d26/f38 1352276 0 2024-09-21T12:46:54.660 INFO:tasks.workunit.client.1.smithi176.stdout:3/375: creat d1/d34/d5d/d78/f92 x:0 0 0 2024-09-21T12:46:54.660 INFO:tasks.workunit.client.1.smithi176.stdout:6/298: fdatasync d2/f34 0 2024-09-21T12:46:54.665 INFO:tasks.workunit.client.1.smithi176.stdout:3/376: creat d1/d34/f93 x:0 0 0 2024-09-21T12:46:54.665 INFO:tasks.workunit.client.1.smithi176.stdout:9/306: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:54.671 INFO:tasks.workunit.client.1.smithi176.stdout:3/377: mknod d1/d5/d25/d76/c94 0 2024-09-21T12:46:54.672 INFO:tasks.workunit.client.1.smithi176.stdout:8/307: write d6/f15 [617625,19700] 0 2024-09-21T12:46:54.673 INFO:tasks.workunit.client.1.smithi176.stdout:9/307: mknod d1/df/d48/d69/d38/c6d 0 2024-09-21T12:46:54.683 INFO:tasks.workunit.client.1.smithi176.stdout:2/315: dread d4/d3a/f45 [0,4194304] 0 2024-09-21T12:46:54.686 INFO:tasks.workunit.client.1.smithi176.stdout:8/308: dwrite d6/d16/f4b [0,4194304] 0 2024-09-21T12:46:54.687 INFO:tasks.workunit.client.1.smithi176.stdout:3/378: dwrite d1/d5/f83 [0,4194304] 0 2024-09-21T12:46:54.688 INFO:tasks.workunit.client.1.smithi176.stdout:0/401: dwrite d9/dc/d1e/f6c [0,4194304] 0 2024-09-21T12:46:54.689 INFO:tasks.workunit.client.1.smithi176.stdout:8/309: chown d6/d8/d24/c46 156669 1 2024-09-21T12:46:54.689 INFO:tasks.workunit.client.1.smithi176.stdout:6/299: truncate d2/dd/d26/f38 1505157 0 2024-09-21T12:46:54.690 INFO:tasks.workunit.client.1.smithi176.stdout:9/308: dread d1/f2f [0,4194304] 0 2024-09-21T12:46:54.691 INFO:tasks.workunit.client.1.smithi176.stdout:3/379: readlink d1/d5/d25/d5c/d7d/l86 0 2024-09-21T12:46:54.692 INFO:tasks.workunit.client.1.smithi176.stdout:8/310: dread - d6/db/d37/f3a zero size 2024-09-21T12:46:54.694 INFO:tasks.workunit.client.1.smithi176.stdout:6/300: write d2/dd/d26/d2b/d10/d1b/f55 [1433927,117505] 0 2024-09-21T12:46:54.694 INFO:tasks.workunit.client.1.smithi176.stdout:9/309: creat d1/d63/f6e x:0 0 0 2024-09-21T12:46:54.695 INFO:tasks.workunit.client.1.smithi176.stdout:8/311: chown d6/d16/f22 0 1 2024-09-21T12:46:54.696 INFO:tasks.workunit.client.1.smithi176.stdout:0/402: getdents d9/dc 0 2024-09-21T12:46:54.696 INFO:tasks.workunit.client.1.smithi176.stdout:3/380: rename d1/l85 to d1/d5/d25/d38/l95 0 2024-09-21T12:46:54.699 INFO:tasks.workunit.client.1.smithi176.stdout:0/403: symlink d9/d1a/d1d/d22/l8a 0 2024-09-21T12:46:54.701 INFO:tasks.workunit.client.1.smithi176.stdout:8/312: unlink d6/db/d32/l5f 0 2024-09-21T12:46:54.701 INFO:tasks.workunit.client.1.smithi176.stdout:3/381: symlink d1/d34/d42/d5b/l96 0 2024-09-21T12:46:54.704 INFO:tasks.workunit.client.1.smithi176.stdout:0/404: rename d9/d1a/d1d/d22/l66 to d9/d35/l8b 0 2024-09-21T12:46:54.704 INFO:tasks.workunit.client.1.smithi176.stdout:6/301: dwrite d2/dd/d26/d2b/d10/d39/f5b [0,4194304] 0 2024-09-21T12:46:54.708 INFO:tasks.workunit.client.1.smithi176.stdout:8/313: dread d6/d16/f63 [0,4194304] 0 2024-09-21T12:46:54.708 INFO:tasks.workunit.client.1.smithi176.stdout:3/382: creat d1/d8d/f97 x:0 0 0 2024-09-21T12:46:54.709 INFO:tasks.workunit.client.1.smithi176.stdout:8/314: chown d6/d8/d24/d35/d51/f55 5 1 2024-09-21T12:46:54.710 INFO:tasks.workunit.client.1.smithi176.stdout:3/383: write d1/d5/d25/d38/f49 [1472795,70868] 0 2024-09-21T12:46:54.715 INFO:tasks.workunit.client.1.smithi176.stdout:3/384: unlink d1/d5/d25/d38/f49 0 2024-09-21T12:46:54.715 INFO:tasks.workunit.client.1.smithi176.stdout:0/405: getdents d9/d1b/d63/d77/d78 0 2024-09-21T12:46:54.716 INFO:tasks.workunit.client.1.smithi176.stdout:8/315: mknod d6/d8/d24/d5e/c64 0 2024-09-21T12:46:54.716 INFO:tasks.workunit.client.1.smithi176.stdout:2/316: dread d4/df/f15 [0,4194304] 0 2024-09-21T12:46:54.717 INFO:tasks.workunit.client.1.smithi176.stdout:8/316: fdatasync d6/d8/f33 0 2024-09-21T12:46:54.717 INFO:tasks.workunit.client.1.smithi176.stdout:0/406: fdatasync d9/d1a/d3f/d40/f85 0 2024-09-21T12:46:54.719 INFO:tasks.workunit.client.1.smithi176.stdout:3/385: rename d1/d34/l56 to d1/d34/d57/l98 0 2024-09-21T12:46:54.720 INFO:tasks.workunit.client.1.smithi176.stdout:0/407: mknod d9/d1b/c8c 0 2024-09-21T12:46:54.721 INFO:tasks.workunit.client.1.smithi176.stdout:8/317: symlink d6/d8/l65 0 2024-09-21T12:46:54.722 INFO:tasks.workunit.client.1.smithi176.stdout:3/386: symlink d1/d5/d25/d40/l99 0 2024-09-21T12:46:54.722 INFO:tasks.workunit.client.1.smithi176.stdout:8/318: fsync d6/fa 0 2024-09-21T12:46:54.722 INFO:tasks.workunit.client.1.smithi176.stdout:2/317: dread d4/d2b/f59 [0,4194304] 0 2024-09-21T12:46:54.724 INFO:tasks.workunit.client.1.smithi176.stdout:3/387: mknod d1/d34/c9a 0 2024-09-21T12:46:54.725 INFO:tasks.workunit.client.1.smithi176.stdout:8/319: symlink d6/d8/d24/d35/l66 0 2024-09-21T12:46:54.726 INFO:tasks.workunit.client.1.smithi176.stdout:0/408: dwrite d9/dc/d1e/f42 [0,4194304] 0 2024-09-21T12:46:54.767 INFO:tasks.workunit.client.1.smithi176.stdout:5/248: sync 2024-09-21T12:46:54.768 INFO:tasks.workunit.client.1.smithi176.stdout:2/318: rename d4/d3d/c58 to d4/d2b/c5e 0 2024-09-21T12:46:54.769 INFO:tasks.workunit.client.1.smithi176.stdout:3/388: write d1/f51 [526936,80838] 0 2024-09-21T12:46:54.773 INFO:tasks.workunit.client.1.smithi176.stdout:2/319: getdents d4/df/d4b 0 2024-09-21T12:46:54.774 INFO:tasks.workunit.client.1.smithi176.stdout:3/389: read d1/d34/d48/f4e [582745,41296] 0 2024-09-21T12:46:54.777 INFO:tasks.workunit.client.1.smithi176.stdout:8/320: dwrite d6/db/f43 [0,4194304] 0 2024-09-21T12:46:54.779 INFO:tasks.workunit.client.1.smithi176.stdout:5/249: dwrite d0/d10/f2b [0,4194304] 0 2024-09-21T12:46:54.781 INFO:tasks.workunit.client.1.smithi176.stdout:2/320: write d4/df/f22 [878309,73761] 0 2024-09-21T12:46:54.782 INFO:tasks.workunit.client.1.smithi176.stdout:8/321: unlink d6/l47 0 2024-09-21T12:46:54.784 INFO:tasks.workunit.client.1.smithi176.stdout:3/390: dread d1/da/f2e [0,4194304] 0 2024-09-21T12:46:54.785 INFO:tasks.workunit.client.1.smithi176.stdout:5/250: fsync d0/d10/f4c 0 2024-09-21T12:46:54.786 INFO:tasks.workunit.client.1.smithi176.stdout:0/409: dwrite d9/d1a/d20/f2d [0,4194304] 0 2024-09-21T12:46:54.787 INFO:tasks.workunit.client.1.smithi176.stdout:2/321: fdatasync d4/df/f1c 0 2024-09-21T12:46:54.789 INFO:tasks.workunit.client.1.smithi176.stdout:3/391: creat d1/d5/f9b x:0 0 0 2024-09-21T12:46:54.790 INFO:tasks.workunit.client.1.smithi176.stdout:0/410: write d9/d1a/d1d/f51 [761362,113543] 0 2024-09-21T12:46:54.790 INFO:tasks.workunit.client.1.smithi176.stdout:2/322: chown d4/d3d/f5b 97887 1 2024-09-21T12:46:54.791 INFO:tasks.workunit.client.1.smithi176.stdout:5/251: rename d0/d13/c20 to d0/d10/d11/d2e/c4d 0 2024-09-21T12:46:54.792 INFO:tasks.workunit.client.1.smithi176.stdout:8/322: dread d6/d16/f63 [0,4194304] 0 2024-09-21T12:46:54.792 INFO:tasks.workunit.client.1.smithi176.stdout:0/411: write d9/d1a/d1d/d23/f5b [2179231,125508] 0 2024-09-21T12:46:54.793 INFO:tasks.workunit.client.1.smithi176.stdout:2/323: mknod d4/d2b/c5f 0 2024-09-21T12:46:54.794 INFO:tasks.workunit.client.1.smithi176.stdout:2/324: write d4/df/f21 [1523554,32540] 0 2024-09-21T12:46:54.795 INFO:tasks.workunit.client.1.smithi176.stdout:5/252: mkdir d0/d13/d4e 0 2024-09-21T12:46:54.797 INFO:tasks.workunit.client.1.smithi176.stdout:8/323: mkdir d6/d16/d36/d67 0 2024-09-21T12:46:54.797 INFO:tasks.workunit.client.1.smithi176.stdout:5/253: truncate d0/d10/d11/d2e/d39/f4b 163504 0 2024-09-21T12:46:54.799 INFO:tasks.workunit.client.1.smithi176.stdout:3/392: creat d1/d35/d5e/d90/f9c x:0 0 0 2024-09-21T12:46:54.801 INFO:tasks.workunit.client.1.smithi176.stdout:0/412: rename d9/d1a/d20/l3d to d9/d1a/d1d/d23/l8d 0 2024-09-21T12:46:54.801 INFO:tasks.workunit.client.1.smithi176.stdout:2/325: symlink d4/d40/l60 0 2024-09-21T12:46:54.802 INFO:tasks.workunit.client.1.smithi176.stdout:0/413: chown d9/d35 7678284 1 2024-09-21T12:46:54.802 INFO:tasks.workunit.client.1.smithi176.stdout:8/324: creat d6/db/d13/f68 x:0 0 0 2024-09-21T12:46:54.803 INFO:tasks.workunit.client.1.smithi176.stdout:2/326: chown d4/d3a/l49 1167931 1 2024-09-21T12:46:54.804 INFO:tasks.workunit.client.1.smithi176.stdout:3/393: creat d1/d34/d71/d91/f9d x:0 0 0 2024-09-21T12:46:54.805 INFO:tasks.workunit.client.1.smithi176.stdout:2/327: write d4/f1a [4964160,124335] 0 2024-09-21T12:46:54.806 INFO:tasks.workunit.client.1.smithi176.stdout:5/254: dwrite d0/d10/f36 [0,4194304] 0 2024-09-21T12:46:54.808 INFO:tasks.workunit.client.1.smithi176.stdout:3/394: mkdir d1/d9e 0 2024-09-21T12:46:54.808 INFO:tasks.workunit.client.1.smithi176.stdout:5/255: fdatasync d0/d10/d11/d2e/d39/d3b/f45 0 2024-09-21T12:46:54.810 INFO:tasks.workunit.client.1.smithi176.stdout:2/328: mknod d4/c61 0 2024-09-21T12:46:54.811 INFO:tasks.workunit.client.1.smithi176.stdout:8/325: link d6/d8/d24/c3c d6/d8/d24/d5e/c69 0 2024-09-21T12:46:54.813 INFO:tasks.workunit.client.1.smithi176.stdout:0/414: dwrite d9/d1a/d20/f2d [4194304,4194304] 0 2024-09-21T12:46:54.814 INFO:tasks.workunit.client.1.smithi176.stdout:7/399: sync 2024-09-21T12:46:54.814 INFO:tasks.workunit.client.1.smithi176.stdout:4/314: sync 2024-09-21T12:46:54.814 INFO:tasks.workunit.client.1.smithi176.stdout:0/415: write d9/dc/d1e/f42 [2502386,51293] 0 2024-09-21T12:46:54.815 INFO:tasks.workunit.client.1.smithi176.stdout:0/416: chown d9 1350 1 2024-09-21T12:46:54.815 INFO:tasks.workunit.client.1.smithi176.stdout:7/400: write d0/d5d/d5e/f5f [80360,39509] 0 2024-09-21T12:46:54.816 INFO:tasks.workunit.client.1.smithi176.stdout:0/417: write d9/dc/f50 [146174,31935] 0 2024-09-21T12:46:54.818 INFO:tasks.workunit.client.1.smithi176.stdout:3/395: rename d1/d34/d5d/d78/f92 to d1/d5/d25/d5c/f9f 0 2024-09-21T12:46:54.822 INFO:tasks.workunit.client.1.smithi176.stdout:5/256: creat d0/d10/d11/d2e/d39/d41/f4f x:0 0 0 2024-09-21T12:46:54.828 INFO:tasks.workunit.client.1.smithi176.stdout:4/315: dwrite d3/d5/f13 [0,4194304] 0 2024-09-21T12:46:54.828 INFO:tasks.workunit.client.1.smithi176.stdout:8/326: symlink d6/d16/d36/d67/l6a 0 2024-09-21T12:46:54.829 INFO:tasks.workunit.client.1.smithi176.stdout:3/396: creat d1/d34/d42/fa0 x:0 0 0 2024-09-21T12:46:54.830 INFO:tasks.workunit.client.1.smithi176.stdout:5/257: rmdir d0/d10/d11/d2e/d39 39 2024-09-21T12:46:54.831 INFO:tasks.workunit.client.1.smithi176.stdout:8/327: read d6/db/d13/f29 [4167070,65936] 0 2024-09-21T12:46:54.833 INFO:tasks.workunit.client.1.smithi176.stdout:7/401: mkdir d0/d2/db/d8f 0 2024-09-21T12:46:54.835 INFO:tasks.workunit.client.1.smithi176.stdout:2/329: getdents d4/df/d2e 0 2024-09-21T12:46:54.837 INFO:tasks.workunit.client.1.smithi176.stdout:3/397: symlink d1/d5/d25/d61/la1 0 2024-09-21T12:46:54.838 INFO:tasks.workunit.client.1.smithi176.stdout:5/258: fsync d0/d10/d11/d2e/d39/f4b 0 2024-09-21T12:46:54.839 INFO:tasks.workunit.client.1.smithi176.stdout:8/328: fdatasync d6/db/f43 0 2024-09-21T12:46:54.840 INFO:tasks.workunit.client.1.smithi176.stdout:5/259: read d0/ff [1836267,38998] 0 2024-09-21T12:46:54.841 INFO:tasks.workunit.client.1.smithi176.stdout:5/260: fsync d0/ff 0 2024-09-21T12:46:54.841 INFO:tasks.workunit.client.1.smithi176.stdout:0/418: truncate d9/ff 5773673 0 2024-09-21T12:46:54.842 INFO:tasks.workunit.client.1.smithi176.stdout:3/398: rmdir d1/d5/d25 39 2024-09-21T12:46:54.844 INFO:tasks.workunit.client.1.smithi176.stdout:4/316: rename d3/d42/f53 to d3/d21/d27/d2c/f67 0 2024-09-21T12:46:54.844 INFO:tasks.workunit.client.1.smithi176.stdout:2/330: mkdir d4/d62 0 2024-09-21T12:46:54.845 INFO:tasks.workunit.client.1.smithi176.stdout:4/317: chown d3/d42/d56/d4e 1 1 2024-09-21T12:46:54.845 INFO:tasks.workunit.client.1.smithi176.stdout:8/329: symlink d6/d8/l6b 0 2024-09-21T12:46:54.845 INFO:tasks.workunit.client.1.smithi176.stdout:6/302: sync 2024-09-21T12:46:54.845 INFO:tasks.workunit.client.1.smithi176.stdout:9/310: sync 2024-09-21T12:46:54.846 INFO:tasks.workunit.client.1.smithi176.stdout:1/316: sync 2024-09-21T12:46:54.847 INFO:tasks.workunit.client.1.smithi176.stdout:1/317: stat d0/f58 0 2024-09-21T12:46:54.847 INFO:tasks.workunit.client.1.smithi176.stdout:3/399: creat d1/d34/d5d/fa2 x:0 0 0 2024-09-21T12:46:54.847 INFO:tasks.workunit.client.1.smithi176.stdout:5/261: dread d0/f18 [0,4194304] 0 2024-09-21T12:46:54.848 INFO:tasks.workunit.client.1.smithi176.stdout:1/318: chown d0/l11 3302 1 2024-09-21T12:46:54.848 INFO:tasks.workunit.client.1.smithi176.stdout:0/419: rename d9/d1a/d1d/d4f to d9/d1a/d1d/d81/d8e 0 2024-09-21T12:46:54.852 INFO:tasks.workunit.client.1.smithi176.stdout:8/330: write d6/d16/f1e [2437329,111746] 0 2024-09-21T12:46:54.853 INFO:tasks.workunit.client.1.smithi176.stdout:6/303: symlink d2/dd/d26/d2b/d10/d1b/d50/l5c 0 2024-09-21T12:46:54.854 INFO:tasks.workunit.client.1.smithi176.stdout:9/311: truncate d1/df/d48/d69/d38/f5c 191849 0 2024-09-21T12:46:54.854 INFO:tasks.workunit.client.1.smithi176.stdout:2/331: mkdir d4/d63 0 2024-09-21T12:46:54.855 INFO:tasks.workunit.client.1.smithi176.stdout:5/262: truncate d0/d10/d11/d2e/d37/f40 4859558 0 2024-09-21T12:46:54.855 INFO:tasks.workunit.client.1.smithi176.stdout:4/318: write d3/d21/d27/d2c/f67 [5074539,115192] 0 2024-09-21T12:46:54.856 INFO:tasks.workunit.client.1.smithi176.stdout:0/420: mkdir d9/dc/d8f 0 2024-09-21T12:46:54.857 INFO:tasks.workunit.client.1.smithi176.stdout:7/402: dread d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:46:54.859 INFO:tasks.workunit.client.1.smithi176.stdout:8/331: mknod d6/d16/d36/c6c 0 2024-09-21T12:46:54.860 INFO:tasks.workunit.client.1.smithi176.stdout:5/263: truncate d0/d10/d11/f3d 618232 0 2024-09-21T12:46:54.878 INFO:tasks.workunit.client.1.smithi176.stdout:1/319: dwrite d0/f3c [0,4194304] 0 2024-09-21T12:46:54.878 INFO:tasks.workunit.client.1.smithi176.stdout:6/304: mkdir d2/d5d 0 2024-09-21T12:46:54.878 INFO:tasks.workunit.client.1.smithi176.stdout:3/400: dwrite d1/da/f89 [0,4194304] 0 2024-09-21T12:46:54.878 INFO:tasks.workunit.client.1.smithi176.stdout:2/332: fdatasync d4/f38 0 2024-09-21T12:46:54.882 INFO:tasks.workunit.client.1.smithi176.stdout:0/421: rmdir d9/d1b/d63/d77 39 2024-09-21T12:46:54.882 INFO:tasks.workunit.client.1.smithi176.stdout:2/333: write d4/f1d [7832275,11546] 0 2024-09-21T12:46:54.885 INFO:tasks.workunit.client.1.smithi176.stdout:5/264: chown d0/d13/c2a 2932 1 2024-09-21T12:46:54.886 INFO:tasks.workunit.client.1.smithi176.stdout:2/334: fdatasync d4/d3a/f5c 0 2024-09-21T12:46:54.886 INFO:tasks.workunit.client.1.smithi176.stdout:9/312: creat d1/df/d48/d69/f6f x:0 0 0 2024-09-21T12:46:54.888 INFO:tasks.workunit.client.1.smithi176.stdout:1/320: getdents d0/db/d6a 0 2024-09-21T12:46:54.890 INFO:tasks.workunit.client.1.smithi176.stdout:7/403: truncate d0/d2/db/d10/d31/d65/f47 3977775 0 2024-09-21T12:46:54.891 INFO:tasks.workunit.client.1.smithi176.stdout:3/401: link d1/d3e/f5a d1/d34/d71/fa3 0 2024-09-21T12:46:54.893 INFO:tasks.workunit.client.1.smithi176.stdout:9/313: write d1/df/d48/d69/d38/f5c [1213284,41698] 0 2024-09-21T12:46:54.894 INFO:tasks.workunit.client.1.smithi176.stdout:6/305: link d2/dd/d26/l27 d2/l5e 0 2024-09-21T12:46:54.895 INFO:tasks.workunit.client.1.smithi176.stdout:7/404: chown d0/d2/db/l27 113508 1 2024-09-21T12:46:54.895 INFO:tasks.workunit.client.1.smithi176.stdout:8/332: dwrite d6/d8/d24/f2b [0,4194304] 0 2024-09-21T12:46:54.897 INFO:tasks.workunit.client.1.smithi176.stdout:5/265: dread d0/d10/d11/f3a [0,4194304] 0 2024-09-21T12:46:54.897 INFO:tasks.workunit.client.1.smithi176.stdout:2/335: dread d4/f38 [0,4194304] 0 2024-09-21T12:46:54.898 INFO:tasks.workunit.client.1.smithi176.stdout:0/422: dwrite d9/d1b/f71 [0,4194304] 0 2024-09-21T12:46:54.898 INFO:tasks.workunit.client.1.smithi176.stdout:3/402: chown d1/d5/d25/d5c 27873203 1 2024-09-21T12:46:54.904 INFO:tasks.workunit.client.1.smithi176.stdout:2/336: truncate d4/df/f5a 264368 0 2024-09-21T12:46:54.904 INFO:tasks.workunit.client.1.smithi176.stdout:9/314: symlink d1/df/d48/d69/d40/l70 0 2024-09-21T12:46:54.905 INFO:tasks.workunit.client.1.smithi176.stdout:1/321: link d0/db/f17 d0/db/d25/d2b/d43/f74 0 2024-09-21T12:46:54.906 INFO:tasks.workunit.client.1.smithi176.stdout:6/306: read d2/f8 [657322,4468] 0 2024-09-21T12:46:54.907 INFO:tasks.workunit.client.1.smithi176.stdout:5/266: creat d0/d13/f50 x:0 0 0 2024-09-21T12:46:54.909 INFO:tasks.workunit.client.1.smithi176.stdout:3/403: creat d1/d34/d48/fa4 x:0 0 0 2024-09-21T12:46:54.910 INFO:tasks.workunit.client.1.smithi176.stdout:9/315: read d1/df/d48/d69/f37 [667256,40842] 0 2024-09-21T12:46:54.911 INFO:tasks.workunit.client.1.smithi176.stdout:8/333: dwrite d6/f5b [0,4194304] 0 2024-09-21T12:46:54.912 INFO:tasks.workunit.client.1.smithi176.stdout:6/307: mkdir d2/dd/d26/d2b/d5f 0 2024-09-21T12:46:54.914 INFO:tasks.workunit.client.1.smithi176.stdout:0/423: mkdir d9/d1a/d1d/d90 0 2024-09-21T12:46:54.918 INFO:tasks.workunit.client.1.smithi176.stdout:9/316: chown d1/df/d23/c26 365 1 2024-09-21T12:46:54.920 INFO:tasks.workunit.client.1.smithi176.stdout:2/337: creat d4/f64 x:0 0 0 2024-09-21T12:46:54.922 INFO:tasks.workunit.client.1.smithi176.stdout:9/317: fsync d1/df/d48/f4a 0 2024-09-21T12:46:54.923 INFO:tasks.workunit.client.1.smithi176.stdout:1/322: dwrite d0/db/d25/d2b/f35 [0,4194304] 0 2024-09-21T12:46:54.923 INFO:tasks.workunit.client.1.smithi176.stdout:5/267: link d0/d10/d11/d2e/d39/d3b/f45 d0/d10/d11/f51 0 2024-09-21T12:46:54.924 INFO:tasks.workunit.client.1.smithi176.stdout:2/338: chown d4/df/d4b/c50 4207691 1 2024-09-21T12:46:54.928 INFO:tasks.workunit.client.1.smithi176.stdout:6/308: creat d2/dd/d26/d2b/d5a/f60 x:0 0 0 2024-09-21T12:46:54.929 INFO:tasks.workunit.client.1.smithi176.stdout:7/405: dwrite d0/d2/f5c [0,4194304] 0 2024-09-21T12:46:54.930 INFO:tasks.workunit.client.1.smithi176.stdout:9/318: rmdir d1/df/d48 39 2024-09-21T12:46:54.931 INFO:tasks.workunit.client.1.smithi176.stdout:8/334: dwrite d6/db/f2c [0,4194304] 0 2024-09-21T12:46:54.931 INFO:tasks.workunit.client.1.smithi176.stdout:0/424: mkdir d9/dc/d8f/d91 0 2024-09-21T12:46:54.934 INFO:tasks.workunit.client.1.smithi176.stdout:3/404: link d1/d34/d71/fa3 d1/d5/d25/d61/fa5 0 2024-09-21T12:46:54.934 INFO:tasks.workunit.client.1.smithi176.stdout:7/406: write d0/d2/db/d10/f2b [2145538,81902] 0 2024-09-21T12:46:54.935 INFO:tasks.workunit.client.1.smithi176.stdout:5/268: unlink d0/d10/d11/f2c 0 2024-09-21T12:46:54.936 INFO:tasks.workunit.client.1.smithi176.stdout:8/335: write d6/db/d13/f31 [904982,87330] 0 2024-09-21T12:46:54.937 INFO:tasks.workunit.client.1.smithi176.stdout:1/323: dwrite d0/f3c [0,4194304] 0 2024-09-21T12:46:54.938 INFO:tasks.workunit.client.1.smithi176.stdout:6/309: truncate d2/dd/d26/d2b/d10/d39/f46 1788636 0 2024-09-21T12:46:54.938 INFO:tasks.workunit.client.1.smithi176.stdout:2/339: mkdir d4/d3d/d65 0 2024-09-21T12:46:54.939 INFO:tasks.workunit.client.1.smithi176.stdout:4/319: sync 2024-09-21T12:46:54.939 INFO:tasks.workunit.client.1.smithi176.stdout:8/336: stat d6/d8/d24/d35/f4e 0 2024-09-21T12:46:54.940 INFO:tasks.workunit.client.1.smithi176.stdout:7/407: write d0/d2/d30/f44 [658632,41132] 0 2024-09-21T12:46:54.943 INFO:tasks.workunit.client.1.smithi176.stdout:4/320: chown d3/d21/d27/d2c/f67 103 1 2024-09-21T12:46:54.944 INFO:tasks.workunit.client.1.smithi176.stdout:3/405: write d1/fe [1736980,41602] 0 2024-09-21T12:46:54.947 INFO:tasks.workunit.client.1.smithi176.stdout:0/425: creat d9/d1b/d63/d77/f92 x:0 0 0 2024-09-21T12:46:54.947 INFO:tasks.workunit.client.1.smithi176.stdout:0/426: readlink d9/d1a/d1d/d23/l54 0 2024-09-21T12:46:54.949 INFO:tasks.workunit.client.1.smithi176.stdout:8/337: creat d6/d16/d36/d67/f6d x:0 0 0 2024-09-21T12:46:54.949 INFO:tasks.workunit.client.1.smithi176.stdout:6/310: rmdir d2/dd/d26/d2b/d10/d1b/d50 39 2024-09-21T12:46:54.949 INFO:tasks.workunit.client.1.smithi176.stdout:0/427: dread d9/dc/d1e/f6f [0,4194304] 0 2024-09-21T12:46:54.951 INFO:tasks.workunit.client.1.smithi176.stdout:0/428: chown d9/d1b/f1f 32 1 2024-09-21T12:46:54.951 INFO:tasks.workunit.client.1.smithi176.stdout:4/321: creat d3/d5/d37/f68 x:0 0 0 2024-09-21T12:46:54.951 INFO:tasks.workunit.client.1.smithi176.stdout:8/338: write d6/db/d13/f68 [669545,84314] 0 2024-09-21T12:46:54.952 INFO:tasks.workunit.client.1.smithi176.stdout:9/319: creat d1/f71 x:0 0 0 2024-09-21T12:46:54.954 INFO:tasks.workunit.client.1.smithi176.stdout:2/340: link d4/df/f21 d4/df/d2e/d39/f66 0 2024-09-21T12:46:54.961 INFO:tasks.workunit.client.1.smithi176.stdout:0/429: mkdir d9/dc/d93 0 2024-09-21T12:46:54.964 INFO:tasks.workunit.client.1.smithi176.stdout:2/341: write d4/f37 [665471,5567] 0 2024-09-21T12:46:54.964 INFO:tasks.workunit.client.1.smithi176.stdout:5/269: link d0/d10/d11/d2e/d39/d3b/f45 d0/f52 0 2024-09-21T12:46:54.967 INFO:tasks.workunit.client.1.smithi176.stdout:3/406: dwrite d1/d34/d48/f4e [0,4194304] 0 2024-09-21T12:46:54.968 INFO:tasks.workunit.client.1.smithi176.stdout:2/342: fdatasync d4/f19 0 2024-09-21T12:46:54.973 INFO:tasks.workunit.client.1.smithi176.stdout:9/320: dwrite d1/df/d23/f36 [0,4194304] 0 2024-09-21T12:46:54.975 INFO:tasks.workunit.client.1.smithi176.stdout:6/311: truncate d2/f8 1746737 0 2024-09-21T12:46:54.975 INFO:tasks.workunit.client.1.smithi176.stdout:4/322: dwrite d3/f3c [0,4194304] 0 2024-09-21T12:46:54.976 INFO:tasks.workunit.client.1.smithi176.stdout:5/270: dread - d0/d10/d11/d2e/d39/d41/f4f zero size 2024-09-21T12:46:54.979 INFO:tasks.workunit.client.1.smithi176.stdout:3/407: write d1/d5/d25/d5c/d7d/f80 [1450004,36822] 0 2024-09-21T12:46:54.979 INFO:tasks.workunit.client.1.smithi176.stdout:9/321: dread - d1/d63/f6e zero size 2024-09-21T12:46:54.980 INFO:tasks.workunit.client.1.smithi176.stdout:2/343: mkdir d4/d2b/d5d/d67 0 2024-09-21T12:46:54.982 INFO:tasks.workunit.client.1.smithi176.stdout:1/324: dwrite d0/db/f17 [0,4194304] 0 2024-09-21T12:46:54.983 INFO:tasks.workunit.client.1.smithi176.stdout:4/323: creat d3/d42/f69 x:0 0 0 2024-09-21T12:46:54.985 INFO:tasks.workunit.client.1.smithi176.stdout:2/344: chown d4/f38 119743560 1 2024-09-21T12:46:54.986 INFO:tasks.workunit.client.1.smithi176.stdout:7/408: dread d0/d2/db/d10/d31/d65/f47 [0,4194304] 0 2024-09-21T12:46:54.988 INFO:tasks.workunit.client.1.smithi176.stdout:9/322: write d1/df/d23/f59 [335618,67904] 0 2024-09-21T12:46:54.988 INFO:tasks.workunit.client.1.smithi176.stdout:1/325: unlink d0/f13 0 2024-09-21T12:46:54.989 INFO:tasks.workunit.client.1.smithi176.stdout:0/430: dwrite d9/d1a/d1d/d23/d5f/f89 [0,4194304] 0 2024-09-21T12:46:54.990 INFO:tasks.workunit.client.1.smithi176.stdout:5/271: rename d0/d13/c1a to d0/d10/d11/d2e/d39/d3b/c53 0 2024-09-21T12:46:54.991 INFO:tasks.workunit.client.1.smithi176.stdout:4/324: creat d3/d42/d56/d4e/f6a x:0 0 0 2024-09-21T12:46:54.995 INFO:tasks.workunit.client.1.smithi176.stdout:6/312: dwrite d2/dd/d26/d2b/d10/d39/f52 [0,4194304] 0 2024-09-21T12:46:54.996 INFO:tasks.workunit.client.1.smithi176.stdout:9/323: chown d1/df/d48/d69/d4f 55914 1 2024-09-21T12:46:54.997 INFO:tasks.workunit.client.1.smithi176.stdout:7/409: fsync d0/d2/db/d10/f1d 0 2024-09-21T12:46:54.998 INFO:tasks.workunit.client.1.smithi176.stdout:7/410: read d0/d2/db/d10/d31/d65/f47 [3354293,62969] 0 2024-09-21T12:46:54.999 INFO:tasks.workunit.client.1.smithi176.stdout:2/345: rename d4/f38 to d4/d63/f68 0 2024-09-21T12:46:55.001 INFO:tasks.workunit.client.1.smithi176.stdout:4/325: creat d3/d42/f6b x:0 0 0 2024-09-21T12:46:55.004 INFO:tasks.workunit.client.1.smithi176.stdout:7/411: dwrite d0/d2/f42 [0,4194304] 0 2024-09-21T12:46:55.007 INFO:tasks.workunit.client.1.smithi176.stdout:3/408: write d1/d5/d25/d61/fa5 [508225,2908] 0 2024-09-21T12:46:55.008 INFO:tasks.workunit.client.1.smithi176.stdout:9/324: creat d1/df/d48/d69/d4f/f72 x:0 0 0 2024-09-21T12:46:55.010 INFO:tasks.workunit.client.1.smithi176.stdout:1/326: rename d0/db/d1a/d2c/d37/l3f to d0/d63/l75 0 2024-09-21T12:46:55.015 INFO:tasks.workunit.client.1.smithi176.stdout:0/431: creat d9/d1a/d1d/d90/f94 x:0 0 0 2024-09-21T12:46:55.018 INFO:tasks.workunit.client.1.smithi176.stdout:2/346: mkdir d4/d2b/d5d/d67/d69 0 2024-09-21T12:46:55.019 INFO:tasks.workunit.client.1.smithi176.stdout:6/313: rename d2/l23 to d2/dd/d26/d2b/d5a/l61 0 2024-09-21T12:46:55.021 INFO:tasks.workunit.client.1.smithi176.stdout:4/326: truncate d3/d21/f2e 872293 0 2024-09-21T12:46:55.021 INFO:tasks.workunit.client.1.smithi176.stdout:4/327: fsync d3/d5/d37/f68 0 2024-09-21T12:46:55.022 INFO:tasks.workunit.client.1.smithi176.stdout:7/412: mknod d0/d2/db/d10/d72/d7e/c90 0 2024-09-21T12:46:55.022 INFO:tasks.workunit.client.1.smithi176.stdout:9/325: dread d1/df/d48/d69/f3d [0,4194304] 0 2024-09-21T12:46:55.023 INFO:tasks.workunit.client.1.smithi176.stdout:3/409: dread d1/da/f22 [0,4194304] 0 2024-09-21T12:46:55.023 INFO:tasks.workunit.client.1.smithi176.stdout:0/432: unlink d9/d1b/d43/c6a 0 2024-09-21T12:46:55.025 INFO:tasks.workunit.client.1.smithi176.stdout:5/272: getdents d0/d10/d11 0 2024-09-21T12:46:55.026 INFO:tasks.workunit.client.1.smithi176.stdout:5/273: chown d0/d13/d4e 0 1 2024-09-21T12:46:55.027 INFO:tasks.workunit.client.1.smithi176.stdout:1/327: rename d0/l8 to d0/db/d25/d2b/l76 0 2024-09-21T12:46:55.027 INFO:tasks.workunit.client.1.smithi176.stdout:1/328: fsync d0/db/d2a/f5d 0 2024-09-21T12:46:55.028 INFO:tasks.workunit.client.1.smithi176.stdout:1/329: fsync d0/db/d25/d2b/d43/f54 0 2024-09-21T12:46:55.028 INFO:tasks.workunit.client.1.smithi176.stdout:9/326: rmdir d1/df/d48 39 2024-09-21T12:46:55.029 INFO:tasks.workunit.client.1.smithi176.stdout:2/347: mknod d4/d2b/d5d/d67/d69/c6a 0 2024-09-21T12:46:55.031 INFO:tasks.workunit.client.1.smithi176.stdout:3/410: creat d1/d35/d5e/d90/fa6 x:0 0 0 2024-09-21T12:46:55.032 INFO:tasks.workunit.client.1.smithi176.stdout:0/433: mknod d9/d1b/d63/d77/d88/c95 0 2024-09-21T12:46:55.033 INFO:tasks.workunit.client.1.smithi176.stdout:0/434: readlink d9/dc/l19 0 2024-09-21T12:46:55.034 INFO:tasks.workunit.client.1.smithi176.stdout:6/314: dwrite d2/dd/d26/d2b/f14 [0,4194304] 0 2024-09-21T12:46:55.036 INFO:tasks.workunit.client.1.smithi176.stdout:2/348: creat d4/df/f6b x:0 0 0 2024-09-21T12:46:55.038 INFO:tasks.workunit.client.1.smithi176.stdout:2/349: write d4/d2b/f3e [4904562,79522] 0 2024-09-21T12:46:55.039 INFO:tasks.workunit.client.1.smithi176.stdout:2/350: chown d4/d63/f68 53747 1 2024-09-21T12:46:55.040 INFO:tasks.workunit.client.1.smithi176.stdout:3/411: creat d1/d8d/fa7 x:0 0 0 2024-09-21T12:46:55.040 INFO:tasks.workunit.client.1.smithi176.stdout:9/327: mkdir d1/d61/d73 0 2024-09-21T12:46:55.042 INFO:tasks.workunit.client.1.smithi176.stdout:0/435: creat d9/d1b/d63/d77/d88/f96 x:0 0 0 2024-09-21T12:46:55.042 INFO:tasks.workunit.client.1.smithi176.stdout:2/351: fsync d4/d3a/f5c 0 2024-09-21T12:46:55.042 INFO:tasks.workunit.client.1.smithi176.stdout:3/412: chown d1/da/f89 0 1 2024-09-21T12:46:55.042 INFO:tasks.workunit.client.1.smithi176.stdout:7/413: link d0/d2/db/d55/c8d d0/d2/db/d10/d3b/d79/c91 0 2024-09-21T12:46:55.042 INFO:tasks.workunit.client.1.smithi176.stdout:9/328: write d1/df/f41 [4351687,76758] 0 2024-09-21T12:46:55.044 INFO:tasks.workunit.client.1.smithi176.stdout:2/352: fsync d4/f1a 0 2024-09-21T12:46:55.044 INFO:tasks.workunit.client.1.smithi176.stdout:1/330: link d0/db/d1a/f38 d0/db/d1a/d2c/d6b/f77 0 2024-09-21T12:46:55.045 INFO:tasks.workunit.client.1.smithi176.stdout:4/328: dread d3/d42/d56/f59 [0,4194304] 0 2024-09-21T12:46:55.045 INFO:tasks.workunit.client.1.smithi176.stdout:5/274: rmdir d0/d13/d4e 0 2024-09-21T12:46:55.047 INFO:tasks.workunit.client.1.smithi176.stdout:6/315: rename d2/dd/d26/d2b/d10/d39/c54 to d2/dd/c62 0 2024-09-21T12:46:55.048 INFO:tasks.workunit.client.1.smithi176.stdout:3/413: mknod d1/d35/d5e/ca8 0 2024-09-21T12:46:55.049 INFO:tasks.workunit.client.1.smithi176.stdout:8/339: sync 2024-09-21T12:46:55.049 INFO:tasks.workunit.client.1.smithi176.stdout:2/353: symlink d4/d40/l6c 0 2024-09-21T12:46:55.050 INFO:tasks.workunit.client.1.smithi176.stdout:3/414: dread - d1/d8d/f97 zero size 2024-09-21T12:46:55.051 INFO:tasks.workunit.client.1.smithi176.stdout:5/275: fsync d0/f8 0 2024-09-21T12:46:55.052 INFO:tasks.workunit.client.1.smithi176.stdout:0/436: dwrite d9/d1a/d20/f2d [0,4194304] 0 2024-09-21T12:46:55.053 INFO:tasks.workunit.client.1.smithi176.stdout:7/414: write d0/d2/db/d10/d72/d51/f6e [756844,111440] 0 2024-09-21T12:46:55.055 INFO:tasks.workunit.client.1.smithi176.stdout:7/415: write d0/d2/db/d10/f22 [3898797,118607] 0 2024-09-21T12:46:55.057 INFO:tasks.workunit.client.1.smithi176.stdout:5/276: truncate d0/d10/d11/d2e/d39/d41/f4f 140707 0 2024-09-21T12:46:55.057 INFO:tasks.workunit.client.1.smithi176.stdout:8/340: stat d6/d8/d24/d5e/c69 0 2024-09-21T12:46:55.057 INFO:tasks.workunit.client.1.smithi176.stdout:6/316: dread d2/dd/d26/d2b/d10/d39/f5b [0,4194304] 0 2024-09-21T12:46:55.057 INFO:tasks.workunit.client.1.smithi176.stdout:4/329: mknod d3/d21/c6c 0 2024-09-21T12:46:55.058 INFO:tasks.workunit.client.1.smithi176.stdout:8/341: fdatasync d6/db/d37/f3a 0 2024-09-21T12:46:55.059 INFO:tasks.workunit.client.1.smithi176.stdout:8/342: dread - d6/d8/d24/d35/d51/f53 zero size 2024-09-21T12:46:55.059 INFO:tasks.workunit.client.1.smithi176.stdout:3/415: rmdir d1/d35 39 2024-09-21T12:46:55.064 INFO:tasks.workunit.client.1.smithi176.stdout:6/317: dwrite d2/dd/d26/d2b/f14 [0,4194304] 0 2024-09-21T12:46:55.064 INFO:tasks.workunit.client.1.smithi176.stdout:0/437: rename d9/dc/d1e/f6c to d9/dc/f97 0 2024-09-21T12:46:55.065 INFO:tasks.workunit.client.1.smithi176.stdout:7/416: rename d0/d2 to d0/d2/db/d10/d3b/d79/d92 22 2024-09-21T12:46:55.066 INFO:tasks.workunit.client.1.smithi176.stdout:5/277: symlink d0/d10/d11/l54 0 2024-09-21T12:46:55.066 INFO:tasks.workunit.client.1.smithi176.stdout:0/438: write d9/d1b/d63/d77/d88/f5a [124218,101339] 0 2024-09-21T12:46:55.069 INFO:tasks.workunit.client.1.smithi176.stdout:0/439: fsync d9/d1a/d1d/d23/d5f/f73 0 2024-09-21T12:46:55.069 INFO:tasks.workunit.client.1.smithi176.stdout:1/331: creat d0/db/d1a/d2c/d48/f78 x:0 0 0 2024-09-21T12:46:55.077 INFO:tasks.workunit.client.1.smithi176.stdout:9/329: dwrite d1/f2f [0,4194304] 0 2024-09-21T12:46:55.077 INFO:tasks.workunit.client.1.smithi176.stdout:9/330: stat d1/df/f41 0 2024-09-21T12:46:55.078 INFO:tasks.workunit.client.1.smithi176.stdout:9/331: chown d1/l1d 163855 1 2024-09-21T12:46:55.079 INFO:tasks.workunit.client.1.smithi176.stdout:0/440: mkdir d9/d1b/d43/d98 0 2024-09-21T12:46:55.080 INFO:tasks.workunit.client.1.smithi176.stdout:2/354: write d4/df/f21 [568978,72803] 0 2024-09-21T12:46:55.080 INFO:tasks.workunit.client.1.smithi176.stdout:0/441: read - d9/dc/d1e/f6e zero size 2024-09-21T12:46:55.083 INFO:tasks.workunit.client.1.smithi176.stdout:7/417: write d0/f16 [4507416,123161] 0 2024-09-21T12:46:55.083 INFO:tasks.workunit.client.1.smithi176.stdout:6/318: fdatasync d2/dd/d26/d2b/d10/d1b/d50/f51 0 2024-09-21T12:46:55.087 INFO:tasks.workunit.client.1.smithi176.stdout:3/416: write d1/d34/d48/f50 [285325,74218] 0 2024-09-21T12:46:55.090 INFO:tasks.workunit.client.1.smithi176.stdout:8/343: truncate d6/d8/f2e 3352932 0 2024-09-21T12:46:55.090 INFO:tasks.workunit.client.1.smithi176.stdout:2/355: stat d4/d2b/c5e 0 2024-09-21T12:46:55.092 INFO:tasks.workunit.client.1.smithi176.stdout:1/332: creat d0/db/d1a/d2c/f79 x:0 0 0 2024-09-21T12:46:55.097 INFO:tasks.workunit.client.1.smithi176.stdout:3/417: creat d1/da/fa9 x:0 0 0 2024-09-21T12:46:55.097 INFO:tasks.workunit.client.1.smithi176.stdout:9/332: dwrite d1/df/d23/f24 [4194304,4194304] 0 2024-09-21T12:46:55.097 INFO:tasks.workunit.client.1.smithi176.stdout:8/344: fdatasync d6/d8/f10 0 2024-09-21T12:46:55.102 INFO:tasks.workunit.client.1.smithi176.stdout:2/356: mkdir d4/d2b/d6d 0 2024-09-21T12:46:55.107 INFO:tasks.workunit.client.1.smithi176.stdout:4/330: dwrite d3/d5/db/f31 [0,4194304] 0 2024-09-21T12:46:55.107 INFO:tasks.workunit.client.1.smithi176.stdout:2/357: fdatasync d4/f64 0 2024-09-21T12:46:55.108 INFO:tasks.workunit.client.1.smithi176.stdout:1/333: readlink d0/db/d1a/d2c/d48/d50/l5c 0 2024-09-21T12:46:55.109 INFO:tasks.workunit.client.1.smithi176.stdout:3/418: chown d1/d34/f52 302150853 1 2024-09-21T12:46:55.111 INFO:tasks.workunit.client.1.smithi176.stdout:8/345: fsync d6/d8/d24/d35/f4e 0 2024-09-21T12:46:55.114 INFO:tasks.workunit.client.1.smithi176.stdout:0/442: dwrite d9/d1a/d3f/d40/f85 [0,4194304] 0 2024-09-21T12:46:55.115 INFO:tasks.workunit.client.1.smithi176.stdout:9/333: mknod d1/d63/c74 0 2024-09-21T12:46:55.115 INFO:tasks.workunit.client.1.smithi176.stdout:5/278: dwrite d0/f52 [0,4194304] 0 2024-09-21T12:46:55.118 INFO:tasks.workunit.client.1.smithi176.stdout:4/331: creat d3/d42/d47/f6d x:0 0 0 2024-09-21T12:46:55.120 INFO:tasks.workunit.client.1.smithi176.stdout:7/418: dwrite d0/d2/f4f [0,4194304] 0 2024-09-21T12:46:55.122 INFO:tasks.workunit.client.1.smithi176.stdout:0/443: fsync d9/f14 0 2024-09-21T12:46:55.123 INFO:tasks.workunit.client.1.smithi176.stdout:6/319: dwrite d2/f20 [4194304,4194304] 0 2024-09-21T12:46:55.124 INFO:tasks.workunit.client.1.smithi176.stdout:8/346: read d6/d16/f22 [3269554,24794] 0 2024-09-21T12:46:55.124 INFO:tasks.workunit.client.1.smithi176.stdout:5/279: read d0/d10/d11/d2e/f2f [461278,26920] 0 2024-09-21T12:46:55.125 INFO:tasks.workunit.client.1.smithi176.stdout:1/334: chown d0/db/d25/d2b/f44 238837 1 2024-09-21T12:46:55.126 INFO:tasks.workunit.client.1.smithi176.stdout:0/444: write d9/d1a/d3f/d40/f72 [1368703,115727] 0 2024-09-21T12:46:55.129 INFO:tasks.workunit.client.1.smithi176.stdout:7/419: chown d0/f17 78362949 1 2024-09-21T12:46:55.129 INFO:tasks.workunit.client.1.smithi176.stdout:2/358: creat d4/df/d2e/d39/d55/f6e x:0 0 0 2024-09-21T12:46:55.131 INFO:tasks.workunit.client.1.smithi176.stdout:6/320: write d2/dd/d26/d2b/d10/d1b/f2a [4061455,34899] 0 2024-09-21T12:46:55.132 INFO:tasks.workunit.client.1.smithi176.stdout:7/420: fsync d0/d5d/d5e/f5f 0 2024-09-21T12:46:55.133 INFO:tasks.workunit.client.1.smithi176.stdout:3/419: rmdir d1/d5/d25/d40/d87 0 2024-09-21T12:46:55.134 INFO:tasks.workunit.client.1.smithi176.stdout:7/421: write d0/d2/db/d10/d3b/f5b [940237,106804] 0 2024-09-21T12:46:55.134 INFO:tasks.workunit.client.1.smithi176.stdout:5/280: dread d0/d10/d11/f51 [0,4194304] 0 2024-09-21T12:46:55.135 INFO:tasks.workunit.client.1.smithi176.stdout:9/334: creat d1/df/d23/d67/f75 x:0 0 0 2024-09-21T12:46:55.136 INFO:tasks.workunit.client.1.smithi176.stdout:2/359: rename d4/d2b to d4/df/d2e/d6f 0 2024-09-21T12:46:55.136 INFO:tasks.workunit.client.1.smithi176.stdout:5/281: truncate d0/d13/f50 156643 0 2024-09-21T12:46:55.141 INFO:tasks.workunit.client.1.smithi176.stdout:3/420: write d1/da/f2e [832902,33961] 0 2024-09-21T12:46:55.141 INFO:tasks.workunit.client.1.smithi176.stdout:7/422: mkdir d0/d2/d30/d93 0 2024-09-21T12:46:55.143 INFO:tasks.workunit.client.1.smithi176.stdout:3/421: stat d1/d34/d71/d91 0 2024-09-21T12:46:55.144 INFO:tasks.workunit.client.1.smithi176.stdout:0/445: mkdir d9/d1b/d63/d77/d87/d99 0 2024-09-21T12:46:55.145 INFO:tasks.workunit.client.1.smithi176.stdout:5/282: dwrite d0/f27 [4194304,4194304] 0 2024-09-21T12:46:55.145 INFO:tasks.workunit.client.1.smithi176.stdout:1/335: link d0/l11 d0/db/d25/d2b/d43/l7a 0 2024-09-21T12:46:55.146 INFO:tasks.workunit.client.1.smithi176.stdout:1/336: readlink d0/l1d 0 2024-09-21T12:46:55.146 INFO:tasks.workunit.client.1.smithi176.stdout:7/423: dread - d0/d2/db/d10/d31/d65/f4a zero size 2024-09-21T12:46:55.150 INFO:tasks.workunit.client.1.smithi176.stdout:6/321: rename d2/dd/d26/d2b/d10/d1b/d50 to d2/d63 0 2024-09-21T12:46:55.151 INFO:tasks.workunit.client.1.smithi176.stdout:9/335: mkdir d1/df/d48/d69/d76 0 2024-09-21T12:46:55.152 INFO:tasks.workunit.client.1.smithi176.stdout:0/446: rmdir d9/d1b/d63/d77/d88 39 2024-09-21T12:46:55.155 INFO:tasks.workunit.client.1.smithi176.stdout:3/422: creat d1/d5/d25/d76/faa x:0 0 0 2024-09-21T12:46:55.156 INFO:tasks.workunit.client.1.smithi176.stdout:2/360: rename d4/df/d2e/d6f/d5d/d67/d69 to d4/df/d2e/d4d/d70 0 2024-09-21T12:46:55.157 INFO:tasks.workunit.client.1.smithi176.stdout:4/332: dwrite d3/d5/db/d36/f43 [0,4194304] 0 2024-09-21T12:46:55.157 INFO:tasks.workunit.client.1.smithi176.stdout:9/336: rmdir d1/df/d1c 39 2024-09-21T12:46:55.158 INFO:tasks.workunit.client.1.smithi176.stdout:6/322: read d2/dd/d26/d2b/d10/d1b/d37/f4b [325495,84016] 0 2024-09-21T12:46:55.158 INFO:tasks.workunit.client.1.smithi176.stdout:8/347: truncate d6/db/d13/f26 1287124 0 2024-09-21T12:46:55.163 INFO:tasks.workunit.client.1.smithi176.stdout:5/283: dwrite d0/d10/f36 [0,4194304] 0 2024-09-21T12:46:55.163 INFO:tasks.workunit.client.1.smithi176.stdout:3/423: mkdir d1/d34/d5d/dab 0 2024-09-21T12:46:55.164 INFO:tasks.workunit.client.1.smithi176.stdout:1/337: dwrite d0/f58 [0,4194304] 0 2024-09-21T12:46:55.164 INFO:tasks.workunit.client.1.smithi176.stdout:6/323: fsync d2/f31 0 2024-09-21T12:46:55.170 INFO:tasks.workunit.client.1.smithi176.stdout:6/324: fsync d2/dd/d26/d2b/d10/d1b/f2a 0 2024-09-21T12:46:55.171 INFO:tasks.workunit.client.1.smithi176.stdout:4/333: creat d3/d5/db/d36/f6e x:0 0 0 2024-09-21T12:46:55.172 INFO:tasks.workunit.client.1.smithi176.stdout:8/348: mknod d6/d8/d24/d5e/c6e 0 2024-09-21T12:46:55.174 INFO:tasks.workunit.client.1.smithi176.stdout:8/349: fsync d6/f5b 0 2024-09-21T12:46:55.174 INFO:tasks.workunit.client.1.smithi176.stdout:2/361: creat d4/df/d2e/d6f/d6d/f71 x:0 0 0 2024-09-21T12:46:55.174 INFO:tasks.workunit.client.1.smithi176.stdout:5/284: mkdir d0/d10/d11/d2e/d37/d55 0 2024-09-21T12:46:55.176 INFO:tasks.workunit.client.1.smithi176.stdout:3/424: dwrite d1/d34/d48/f68 [0,4194304] 0 2024-09-21T12:46:55.177 INFO:tasks.workunit.client.1.smithi176.stdout:1/338: creat d0/db/d25/d41/f7b x:0 0 0 2024-09-21T12:46:55.178 INFO:tasks.workunit.client.1.smithi176.stdout:4/334: readlink d3/l28 0 2024-09-21T12:46:55.179 INFO:tasks.workunit.client.1.smithi176.stdout:1/339: chown d0/d63 33049649 1 2024-09-21T12:46:55.181 INFO:tasks.workunit.client.1.smithi176.stdout:3/425: fsync d1/d5/d25/d76/faa 0 2024-09-21T12:46:55.183 INFO:tasks.workunit.client.1.smithi176.stdout:8/350: creat d6/d8/d24/d35/d51/f6f x:0 0 0 2024-09-21T12:46:55.184 INFO:tasks.workunit.client.1.smithi176.stdout:5/285: rename d0/d10/f38 to d0/d13/f56 0 2024-09-21T12:46:55.186 INFO:tasks.workunit.client.1.smithi176.stdout:5/286: chown d0/d10 5156 1 2024-09-21T12:46:55.187 INFO:tasks.workunit.client.1.smithi176.stdout:6/325: truncate d2/f34 636971 0 2024-09-21T12:46:55.188 INFO:tasks.workunit.client.1.smithi176.stdout:0/447: getdents d9/d1b/d63/d77/d88 0 2024-09-21T12:46:55.189 INFO:tasks.workunit.client.1.smithi176.stdout:2/362: dwrite d4/df/d2e/d39/f66 [0,4194304] 0 2024-09-21T12:46:55.189 INFO:tasks.workunit.client.1.smithi176.stdout:5/287: fsync d0/d13/f32 0 2024-09-21T12:46:55.190 INFO:tasks.workunit.client.1.smithi176.stdout:9/337: link d1/df/d48/d69/d4f/l5e d1/df/d48/d69/d40/l77 0 2024-09-21T12:46:55.191 INFO:tasks.workunit.client.1.smithi176.stdout:7/424: dread d0/d2/db/d10/d5a/f38 [0,4194304] 0 2024-09-21T12:46:55.192 INFO:tasks.workunit.client.1.smithi176.stdout:2/363: chown d4/f1a 0 1 2024-09-21T12:46:55.197 INFO:tasks.workunit.client.1.smithi176.stdout:7/425: fdatasync d0/d5d/d5e/f74 0 2024-09-21T12:46:55.199 INFO:tasks.workunit.client.1.smithi176.stdout:4/335: dwrite d3/d5/db/f50 [0,4194304] 0 2024-09-21T12:46:55.204 INFO:tasks.workunit.client.1.smithi176.stdout:9/338: dread d1/df/d23/f59 [0,4194304] 0 2024-09-21T12:46:55.206 INFO:tasks.workunit.client.1.smithi176.stdout:7/426: fdatasync d0/d2/db/d10/f2c 0 2024-09-21T12:46:55.207 INFO:tasks.workunit.client.1.smithi176.stdout:4/336: chown d3/d5/db/d36/f6e 1030774 1 2024-09-21T12:46:55.208 INFO:tasks.workunit.client.1.smithi176.stdout:6/326: write d2/dd/d26/d2b/d10/d1b/d37/f4b [531080,25248] 0 2024-09-21T12:46:55.210 INFO:tasks.workunit.client.1.smithi176.stdout:5/288: dread d0/d13/f32 [0,4194304] 0 2024-09-21T12:46:55.211 INFO:tasks.workunit.client.1.smithi176.stdout:3/426: dwrite d1/da/fb [4194304,4194304] 0 2024-09-21T12:46:55.212 INFO:tasks.workunit.client.1.smithi176.stdout:0/448: link d9/d35/l8b d9/dc/d1e/l9a 0 2024-09-21T12:46:55.213 INFO:tasks.workunit.client.1.smithi176.stdout:8/351: dwrite d6/f15 [4194304,4194304] 0 2024-09-21T12:46:55.215 INFO:tasks.workunit.client.1.smithi176.stdout:5/289: chown d0/c7 550 1 2024-09-21T12:46:55.216 INFO:tasks.workunit.client.1.smithi176.stdout:7/427: unlink d0/d2f/d43/f8c 0 2024-09-21T12:46:55.216 INFO:tasks.workunit.client.1.smithi176.stdout:6/327: write d2/d63/f53 [917122,42246] 0 2024-09-21T12:46:55.218 INFO:tasks.workunit.client.1.smithi176.stdout:1/340: dread d0/f27 [0,4194304] 0 2024-09-21T12:46:55.218 INFO:tasks.workunit.client.1.smithi176.stdout:2/364: getdents d4/df/d2e/d6f 0 2024-09-21T12:46:55.218 INFO:tasks.workunit.client.1.smithi176.stdout:8/352: truncate d6/d16/f4b 4578347 0 2024-09-21T12:46:55.219 INFO:tasks.workunit.client.1.smithi176.stdout:9/339: truncate d1/df/f12 567190 0 2024-09-21T12:46:55.222 INFO:tasks.workunit.client.1.smithi176.stdout:3/427: fsync d1/d5/d25/d5c/f9f 0 2024-09-21T12:46:55.222 INFO:tasks.workunit.client.1.smithi176.stdout:0/449: rmdir d9/d1b/d63/d77 39 2024-09-21T12:46:55.223 INFO:tasks.workunit.client.1.smithi176.stdout:0/450: write d9/d1a/d1d/f51 [311797,61535] 0 2024-09-21T12:46:55.226 INFO:tasks.workunit.client.1.smithi176.stdout:7/428: mkdir d0/d2/db/d10/d72/d94 0 2024-09-21T12:46:55.227 INFO:tasks.workunit.client.1.smithi176.stdout:7/429: read - d0/d2f/d43/f6b zero size 2024-09-21T12:46:55.228 INFO:tasks.workunit.client.1.smithi176.stdout:2/365: mknod d4/df/c72 0 2024-09-21T12:46:55.228 INFO:tasks.workunit.client.1.smithi176.stdout:1/341: dread d0/db/d25/d2b/d43/f60 [0,4194304] 0 2024-09-21T12:46:55.228 INFO:tasks.workunit.client.1.smithi176.stdout:7/430: dread - d0/d5d/d5e/f74 zero size 2024-09-21T12:46:55.232 INFO:tasks.workunit.client.1.smithi176.stdout:9/340: rename d1/df/d48/d69/f37 to d1/d63/f78 0 2024-09-21T12:46:55.233 INFO:tasks.workunit.client.1.smithi176.stdout:9/341: write d1/df/d23/d67/f75 [390933,42727] 0 2024-09-21T12:46:55.239 INFO:tasks.workunit.client.1.smithi176.stdout:0/451: read d9/f2b [434358,110789] 0 2024-09-21T12:46:55.243 INFO:tasks.workunit.client.1.smithi176.stdout:9/342: mknod d1/d61/c79 0 2024-09-21T12:46:55.244 INFO:tasks.workunit.client.1.smithi176.stdout:4/337: link d3/d21/d27/c34 d3/d5/db/c6f 0 2024-09-21T12:46:55.246 INFO:tasks.workunit.client.1.smithi176.stdout:8/353: write d6/db/d13/f26 [1045599,74452] 0 2024-09-21T12:46:55.249 INFO:tasks.workunit.client.1.smithi176.stdout:6/328: getdents d2/dd/d26/d2b/d5a 0 2024-09-21T12:46:55.249 INFO:tasks.workunit.client.1.smithi176.stdout:4/338: creat d3/d42/d4d/f70 x:0 0 0 2024-09-21T12:46:55.250 INFO:tasks.workunit.client.1.smithi176.stdout:9/343: dwrite d1/f2a [0,4194304] 0 2024-09-21T12:46:55.251 INFO:tasks.workunit.client.1.smithi176.stdout:6/329: write d2/dd/d26/d2b/d10/d1b/d37/f4f [2727858,1476] 0 2024-09-21T12:46:55.252 INFO:tasks.workunit.client.1.smithi176.stdout:1/342: rmdir d0/db/d25/d2b/d72 0 2024-09-21T12:46:55.252 INFO:tasks.workunit.client.1.smithi176.stdout:7/431: link d0/d2/db/l32 d0/d2/db/d8f/l95 0 2024-09-21T12:46:55.253 INFO:tasks.workunit.client.1.smithi176.stdout:3/428: getdents d1/d34/d71 0 2024-09-21T12:46:55.254 INFO:tasks.workunit.client.1.smithi176.stdout:7/432: read - d0/d2/db/d10/d31/f83 zero size 2024-09-21T12:46:55.255 INFO:tasks.workunit.client.1.smithi176.stdout:2/366: getdents d4/d3d 0 2024-09-21T12:46:55.257 INFO:tasks.workunit.client.1.smithi176.stdout:4/339: creat d3/d42/f71 x:0 0 0 2024-09-21T12:46:55.257 INFO:tasks.workunit.client.1.smithi176.stdout:0/452: truncate d9/d1a/d20/f2d 1862103 0 2024-09-21T12:46:55.259 INFO:tasks.workunit.client.1.smithi176.stdout:4/340: stat d3/d42/d4d/f5b 0 2024-09-21T12:46:55.260 INFO:tasks.workunit.client.1.smithi176.stdout:8/354: link d6/d8/d24/f2b d6/d16/d36/d67/f70 0 2024-09-21T12:46:55.261 INFO:tasks.workunit.client.1.smithi176.stdout:3/429: symlink d1/d5/d25/d5c/d7d/lac 0 2024-09-21T12:46:55.262 INFO:tasks.workunit.client.1.smithi176.stdout:7/433: rename d0/d2/db/d55 to d0/d2/d30/d93/d96 0 2024-09-21T12:46:55.263 INFO:tasks.workunit.client.1.smithi176.stdout:9/344: creat d1/df/d1c/f7a x:0 0 0 2024-09-21T12:46:55.266 INFO:tasks.workunit.client.1.smithi176.stdout:2/367: dwrite d4/df/f48 [0,4194304] 0 2024-09-21T12:46:55.267 INFO:tasks.workunit.client.1.smithi176.stdout:4/341: symlink d3/d42/d47/d5c/l72 0 2024-09-21T12:46:55.269 INFO:tasks.workunit.client.1.smithi176.stdout:0/453: dwrite d9/f27 [0,4194304] 0 2024-09-21T12:46:55.272 INFO:tasks.workunit.client.1.smithi176.stdout:3/430: creat d1/d34/d5d/fad x:0 0 0 2024-09-21T12:46:55.275 INFO:tasks.workunit.client.1.smithi176.stdout:0/454: dread - d9/dc/d1e/f6e zero size 2024-09-21T12:46:55.277 INFO:tasks.workunit.client.1.smithi176.stdout:2/368: chown d4/df/d4b/l54 163420026 1 2024-09-21T12:46:55.277 INFO:tasks.workunit.client.1.smithi176.stdout:7/434: write d0/d2/d30/f7f [421958,113866] 0 2024-09-21T12:46:55.279 INFO:tasks.workunit.client.1.smithi176.stdout:4/342: mknod d3/d42/d4d/c73 0 2024-09-21T12:46:55.281 INFO:tasks.workunit.client.1.smithi176.stdout:6/330: dwrite d2/dd/d26/d2b/d10/f2f [4194304,4194304] 0 2024-09-21T12:46:55.281 INFO:tasks.workunit.client.1.smithi176.stdout:2/369: chown d4/df/d2e/c35 52008803 1 2024-09-21T12:46:55.282 INFO:tasks.workunit.client.1.smithi176.stdout:7/435: readlink d0/d2/db/l32 0 2024-09-21T12:46:55.287 INFO:tasks.workunit.client.1.smithi176.stdout:6/331: truncate d2/f34 61919 0 2024-09-21T12:46:55.325 INFO:tasks.workunit.client.1.smithi176.stdout:7/436: creat d0/d2/d30/d93/d96/d89/f97 x:0 0 0 2024-09-21T12:46:55.326 INFO:tasks.workunit.client.1.smithi176.stdout:8/355: dwrite d6/d8/f2e [0,4194304] 0 2024-09-21T12:46:55.328 INFO:tasks.workunit.client.1.smithi176.stdout:9/345: dread d1/df/f41 [0,4194304] 0 2024-09-21T12:46:55.329 INFO:tasks.workunit.client.1.smithi176.stdout:7/437: write d0/d2/db/f6a [477086,2252] 0 2024-09-21T12:46:55.329 INFO:tasks.workunit.client.1.smithi176.stdout:6/332: creat d2/f64 x:0 0 0 2024-09-21T12:46:55.330 INFO:tasks.workunit.client.1.smithi176.stdout:9/346: read - d1/df/f60 zero size 2024-09-21T12:46:55.332 INFO:tasks.workunit.client.1.smithi176.stdout:7/438: mkdir d0/d98 0 2024-09-21T12:46:55.336 INFO:tasks.workunit.client.1.smithi176.stdout:9/347: symlink d1/df/d48/l7b 0 2024-09-21T12:46:55.339 INFO:tasks.workunit.client.1.smithi176.stdout:7/439: symlink d0/d5d/d8a/l99 0 2024-09-21T12:46:55.341 INFO:tasks.workunit.client.1.smithi176.stdout:2/370: dread d4/f1d [0,4194304] 0 2024-09-21T12:46:55.342 INFO:tasks.workunit.client.1.smithi176.stdout:3/431: dread d1/d5/f1b [0,4194304] 0 2024-09-21T12:46:55.343 INFO:tasks.workunit.client.1.smithi176.stdout:0/455: dread d9/f2b [0,4194304] 0 2024-09-21T12:46:55.347 INFO:tasks.workunit.client.1.smithi176.stdout:7/440: chown d0/d2f/f73 565 1 2024-09-21T12:46:55.349 INFO:tasks.workunit.client.1.smithi176.stdout:6/333: dwrite d2/dd/d26/d2b/d10/d1b/d37/f3c [0,4194304] 0 2024-09-21T12:46:55.351 INFO:tasks.workunit.client.1.smithi176.stdout:3/432: symlink d1/d34/d5d/d78/lae 0 2024-09-21T12:46:55.352 INFO:tasks.workunit.client.1.smithi176.stdout:2/371: symlink d4/d3d/d65/l73 0 2024-09-21T12:46:55.354 INFO:tasks.workunit.client.1.smithi176.stdout:8/356: dwrite d6/db/f17 [0,4194304] 0 2024-09-21T12:46:55.354 INFO:tasks.workunit.client.1.smithi176.stdout:9/348: dwrite d1/df/d1c/f3a [0,4194304] 0 2024-09-21T12:46:55.355 INFO:tasks.workunit.client.1.smithi176.stdout:8/357: chown d6/d8/d24/f2b 0 1 2024-09-21T12:46:55.357 INFO:tasks.workunit.client.1.smithi176.stdout:0/456: creat d9/d1a/f9b x:0 0 0 2024-09-21T12:46:55.360 INFO:tasks.workunit.client.1.smithi176.stdout:7/441: getdents d0/d2f/d43 0 2024-09-21T12:46:55.360 INFO:tasks.workunit.client.1.smithi176.stdout:9/349: write d1/f66 [1022684,67297] 0 2024-09-21T12:46:55.363 INFO:tasks.workunit.client.1.smithi176.stdout:9/350: stat d1/df/d1c/f7a 0 2024-09-21T12:46:55.364 INFO:tasks.workunit.client.1.smithi176.stdout:0/457: fsync f5 0 2024-09-21T12:46:55.365 INFO:tasks.workunit.client.1.smithi176.stdout:8/358: creat d6/d8/d24/d35/f71 x:0 0 0 2024-09-21T12:46:55.365 INFO:tasks.workunit.client.1.smithi176.stdout:5/290: sync 2024-09-21T12:46:55.365 INFO:tasks.workunit.client.1.smithi176.stdout:1/343: sync 2024-09-21T12:46:55.366 INFO:tasks.workunit.client.1.smithi176.stdout:6/334: link d2/dd/d26/d2b/d5a/l61 d2/d5d/l65 0 2024-09-21T12:46:55.366 INFO:tasks.workunit.client.1.smithi176.stdout:7/442: fdatasync d0/d2f/f73 0 2024-09-21T12:46:55.368 INFO:tasks.workunit.client.1.smithi176.stdout:3/433: dwrite d1/d5/d25/f5f [0,4194304] 0 2024-09-21T12:46:55.368 INFO:tasks.workunit.client.1.smithi176.stdout:9/351: mkdir d1/df/d48/d69/d76/d7c 0 2024-09-21T12:46:55.369 INFO:tasks.workunit.client.1.smithi176.stdout:0/458: mknod d9/d35/c9c 0 2024-09-21T12:46:55.369 INFO:tasks.workunit.client.1.smithi176.stdout:1/344: read d0/db/f17 [383482,84891] 0 2024-09-21T12:46:55.371 INFO:tasks.workunit.client.1.smithi176.stdout:1/345: readlink d0/db/d25/d41/l55 0 2024-09-21T12:46:55.372 INFO:tasks.workunit.client.1.smithi176.stdout:7/443: write d0/d2/db/d10/d23/f28 [3627083,93956] 0 2024-09-21T12:46:55.375 INFO:tasks.workunit.client.1.smithi176.stdout:3/434: creat d1/d5/d25/d5c/faf x:0 0 0 2024-09-21T12:46:55.376 INFO:tasks.workunit.client.1.smithi176.stdout:0/459: rmdir d9/d1b/d63/d77/d78 39 2024-09-21T12:46:55.378 INFO:tasks.workunit.client.1.smithi176.stdout:9/352: rename d1/df/d48/d69/d4f to d1/d61/d73/d7d 0 2024-09-21T12:46:55.380 INFO:tasks.workunit.client.1.smithi176.stdout:5/291: link d0/d10/d11/f3d d0/d10/d11/d2e/d37/f57 0 2024-09-21T12:46:55.380 INFO:tasks.workunit.client.1.smithi176.stdout:6/335: getdents d2/dd 0 2024-09-21T12:46:55.382 INFO:tasks.workunit.client.1.smithi176.stdout:1/346: creat d0/db/d6a/f7c x:0 0 0 2024-09-21T12:46:55.382 INFO:tasks.workunit.client.1.smithi176.stdout:0/460: stat d9/dc/d1e/l9a 0 2024-09-21T12:46:55.382 INFO:tasks.workunit.client.1.smithi176.stdout:7/444: creat d0/d2/db/d10/d72/d94/f9a x:0 0 0 2024-09-21T12:46:55.383 INFO:tasks.workunit.client.1.smithi176.stdout:9/353: unlink d1/df/d48/d69/d4d/f62 0 2024-09-21T12:46:55.435 INFO:tasks.workunit.client.1.smithi176.stdout:7/445: mknod d0/d5d/c9b 0 2024-09-21T12:46:55.436 INFO:tasks.workunit.client.1.smithi176.stdout:5/292: symlink d0/l58 0 2024-09-21T12:46:55.436 INFO:tasks.workunit.client.1.smithi176.stdout:3/435: rmdir d1/d34/d5d/dab 0 2024-09-21T12:46:55.437 INFO:tasks.workunit.client.1.smithi176.stdout:9/354: symlink d1/df/d48/d69/d4d/l7e 0 2024-09-21T12:46:55.438 INFO:tasks.workunit.client.1.smithi176.stdout:6/336: rename d2/dd/d26/d2b/d10/d1b/f55 to d2/dd/d26/d2b/d10/f66 0 2024-09-21T12:46:55.438 INFO:tasks.workunit.client.1.smithi176.stdout:1/347: creat d0/db/d6f/f7d x:0 0 0 2024-09-21T12:46:55.439 INFO:tasks.workunit.client.1.smithi176.stdout:5/293: read - d0/d10/d11/d2e/d39/d41/f49 zero size 2024-09-21T12:46:55.439 INFO:tasks.workunit.client.1.smithi176.stdout:7/446: symlink d0/d2/d30/d93/l9c 0 2024-09-21T12:46:55.442 INFO:tasks.workunit.client.1.smithi176.stdout:7/447: chown d0/d5d/d8a 260 1 2024-09-21T12:46:55.442 INFO:tasks.workunit.client.1.smithi176.stdout:0/461: dwrite d9/dc/f38 [0,4194304] 0 2024-09-21T12:46:55.443 INFO:tasks.workunit.client.1.smithi176.stdout:5/294: fdatasync d0/d10/d11/d2e/d39/d3b/f45 0 2024-09-21T12:46:55.445 INFO:tasks.workunit.client.1.smithi176.stdout:3/436: getdents d1/d35/d5e 0 2024-09-21T12:46:55.449 INFO:tasks.workunit.client.1.smithi176.stdout:3/437: write d1/d8d/f97 [923641,12101] 0 2024-09-21T12:46:55.450 INFO:tasks.workunit.client.1.smithi176.stdout:7/448: mknod d0/d2/d30/d93/c9d 0 2024-09-21T12:46:55.452 INFO:tasks.workunit.client.1.smithi176.stdout:5/295: symlink d0/d10/l59 0 2024-09-21T12:46:55.452 INFO:tasks.workunit.client.1.smithi176.stdout:1/348: dwrite d0/f3 [0,4194304] 0 2024-09-21T12:46:55.452 INFO:tasks.workunit.client.1.smithi176.stdout:9/355: dwrite d1/df/d1c/f49 [0,4194304] 0 2024-09-21T12:46:55.455 INFO:tasks.workunit.client.1.smithi176.stdout:3/438: write f0 [2528453,115094] 0 2024-09-21T12:46:55.459 INFO:tasks.workunit.client.1.smithi176.stdout:1/349: dread - d0/db/d2a/f5f zero size 2024-09-21T12:46:55.459 INFO:tasks.workunit.client.1.smithi176.stdout:9/356: write d1/df/d48/d69/f6f [1014887,50915] 0 2024-09-21T12:46:55.459 INFO:tasks.workunit.client.1.smithi176.stdout:7/449: unlink d0/d2/c78 0 2024-09-21T12:46:55.463 INFO:tasks.workunit.client.1.smithi176.stdout:5/296: mknod d0/d10/d11/d2e/d39/d3b/c5a 0 2024-09-21T12:46:55.465 INFO:tasks.workunit.client.1.smithi176.stdout:1/350: rename d0/db/d1a/d2c/f4a to d0/db/f7e 0 2024-09-21T12:46:55.467 INFO:tasks.workunit.client.1.smithi176.stdout:9/357: dwrite d1/df/d48/d69/d38/f43 [0,4194304] 0 2024-09-21T12:46:55.468 INFO:tasks.workunit.client.1.smithi176.stdout:0/462: dread d9/d1a/d3f/d40/f4c [0,4194304] 0 2024-09-21T12:46:55.474 INFO:tasks.workunit.client.1.smithi176.stdout:4/343: sync 2024-09-21T12:46:55.474 INFO:tasks.workunit.client.1.smithi176.stdout:6/337: truncate d2/dd/d26/d2b/d10/f12 2782681 0 2024-09-21T12:46:55.475 INFO:tasks.workunit.client.1.smithi176.stdout:0/463: dread d9/dc/f5d [0,4194304] 0 2024-09-21T12:46:55.475 INFO:tasks.workunit.client.1.smithi176.stdout:9/358: dread d1/df/d23/f24 [4194304,4194304] 0 2024-09-21T12:46:55.475 INFO:tasks.workunit.client.1.smithi176.stdout:3/439: link d1/d3e/c60 d1/d34/cb0 0 2024-09-21T12:46:55.477 INFO:tasks.workunit.client.1.smithi176.stdout:3/440: write d1/d5/f7b [209912,34076] 0 2024-09-21T12:46:55.478 INFO:tasks.workunit.client.1.smithi176.stdout:7/450: write d0/d2f/d43/f52 [4141094,67933] 0 2024-09-21T12:46:55.479 INFO:tasks.workunit.client.1.smithi176.stdout:6/338: mkdir d2/dd/d26/d2b/d10/d67 0 2024-09-21T12:46:55.480 INFO:tasks.workunit.client.1.smithi176.stdout:3/441: dread - d1/d34/d48/fa4 zero size 2024-09-21T12:46:55.481 INFO:tasks.workunit.client.1.smithi176.stdout:7/451: readlink d0/d2f/d43/l4e 0 2024-09-21T12:46:55.482 INFO:tasks.workunit.client.1.smithi176.stdout:6/339: chown d2/dd/d26/d2b/f3b 47 1 2024-09-21T12:46:55.484 INFO:tasks.workunit.client.1.smithi176.stdout:4/344: dwrite d3/d21/d27/d2c/f41 [0,4194304] 0 2024-09-21T12:46:55.485 INFO:tasks.workunit.client.1.smithi176.stdout:1/351: write d0/f6 [1407460,117056] 0 2024-09-21T12:46:55.486 INFO:tasks.workunit.client.1.smithi176.stdout:3/442: mknod d1/d34/d71/cb1 0 2024-09-21T12:46:55.488 INFO:tasks.workunit.client.1.smithi176.stdout:6/340: mkdir d2/dd/d26/d2b/d68 0 2024-09-21T12:46:55.490 INFO:tasks.workunit.client.1.smithi176.stdout:6/341: stat d2/d63/f53 0 2024-09-21T12:46:55.491 INFO:tasks.workunit.client.1.smithi176.stdout:1/352: rmdir d0/db 39 2024-09-21T12:46:55.492 INFO:tasks.workunit.client.1.smithi176.stdout:3/443: creat d1/da/fb2 x:0 0 0 2024-09-21T12:46:55.492 INFO:tasks.workunit.client.1.smithi176.stdout:7/452: symlink d0/d2/db/d10/d23/d85/l9e 0 2024-09-21T12:46:55.493 INFO:tasks.workunit.client.1.smithi176.stdout:0/464: getdents d9/d1b/d63/d75 0 2024-09-21T12:46:55.493 INFO:tasks.workunit.client.1.smithi176.stdout:3/444: fdatasync d1/d35/d5e/d90/f9c 0 2024-09-21T12:46:55.494 INFO:tasks.workunit.client.1.smithi176.stdout:4/345: creat d3/d21/d5e/f74 x:0 0 0 2024-09-21T12:46:55.494 INFO:tasks.workunit.client.1.smithi176.stdout:9/359: dwrite d1/f2a [4194304,4194304] 0 2024-09-21T12:46:55.499 INFO:tasks.workunit.client.1.smithi176.stdout:4/346: dread d3/f32 [0,4194304] 0 2024-09-21T12:46:55.500 INFO:tasks.workunit.client.1.smithi176.stdout:3/445: mkdir d1/d5/d25/d76/db3 0 2024-09-21T12:46:55.501 INFO:tasks.workunit.client.1.smithi176.stdout:7/453: mknod d0/d98/c9f 0 2024-09-21T12:46:55.501 INFO:tasks.workunit.client.1.smithi176.stdout:4/347: write d3/d42/d4d/f58 [855913,30256] 0 2024-09-21T12:46:55.502 INFO:tasks.workunit.client.1.smithi176.stdout:9/360: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:55.504 INFO:tasks.workunit.client.1.smithi176.stdout:3/446: fsync d1/d5/f1b 0 2024-09-21T12:46:55.507 INFO:tasks.workunit.client.1.smithi176.stdout:4/348: symlink d3/d21/d5e/l75 0 2024-09-21T12:46:55.510 INFO:tasks.workunit.client.1.smithi176.stdout:3/447: truncate d1/d5/d25/d38/f79 1630590 0 2024-09-21T12:46:55.511 INFO:tasks.workunit.client.1.smithi176.stdout:4/349: read d3/d5/f44 [489622,97973] 0 2024-09-21T12:46:55.512 INFO:tasks.workunit.client.1.smithi176.stdout:9/361: getdents d1/d61/d73 0 2024-09-21T12:46:55.513 INFO:tasks.workunit.client.1.smithi176.stdout:7/454: dwrite d0/d2/f5c [0,4194304] 0 2024-09-21T12:46:55.514 INFO:tasks.workunit.client.1.smithi176.stdout:1/353: dwrite d0/db/ff [0,4194304] 0 2024-09-21T12:46:55.516 INFO:tasks.workunit.client.1.smithi176.stdout:3/448: mkdir d1/d9e/db4 0 2024-09-21T12:46:55.518 INFO:tasks.workunit.client.1.smithi176.stdout:7/455: fsync d0/d2/db/d10/d3b/f5b 0 2024-09-21T12:46:55.519 INFO:tasks.workunit.client.1.smithi176.stdout:9/362: creat d1/d61/d73/f7f x:0 0 0 2024-09-21T12:46:55.519 INFO:tasks.workunit.client.1.smithi176.stdout:4/350: symlink d3/d42/d56/d4e/l76 0 2024-09-21T12:46:55.519 INFO:tasks.workunit.client.1.smithi176.stdout:1/354: write d0/d5b/f61 [866711,82960] 0 2024-09-21T12:46:55.522 INFO:tasks.workunit.client.1.smithi176.stdout:6/342: dwrite d2/f34 [0,4194304] 0 2024-09-21T12:46:55.524 INFO:tasks.workunit.client.1.smithi176.stdout:9/363: mkdir d1/df/d48/d69/d76/d80 0 2024-09-21T12:46:55.527 INFO:tasks.workunit.client.1.smithi176.stdout:6/343: truncate d2/dd/d26/d2b/d5a/f60 634607 0 2024-09-21T12:46:55.527 INFO:tasks.workunit.client.1.smithi176.stdout:3/449: dread d1/d5/d25/f26 [0,4194304] 0 2024-09-21T12:46:55.530 INFO:tasks.workunit.client.1.smithi176.stdout:6/344: chown d2/dd/d26/d2b/d10/d1b/l1e 1400002 1 2024-09-21T12:46:55.531 INFO:tasks.workunit.client.1.smithi176.stdout:7/456: unlink d0/d2/db/d10/d3b/d79/c91 0 2024-09-21T12:46:55.532 INFO:tasks.workunit.client.1.smithi176.stdout:9/364: dread d1/df/f39 [0,4194304] 0 2024-09-21T12:46:55.533 INFO:tasks.workunit.client.1.smithi176.stdout:7/457: chown d0/d5d/d5e 4411719 1 2024-09-21T12:46:55.533 INFO:tasks.workunit.client.1.smithi176.stdout:4/351: getdents d3/d21/d27 0 2024-09-21T12:46:55.534 INFO:tasks.workunit.client.1.smithi176.stdout:1/355: getdents d0/db/d1a/d2c/d6b 0 2024-09-21T12:46:55.534 INFO:tasks.workunit.client.1.smithi176.stdout:7/458: chown d0/d2/db/ff 4 1 2024-09-21T12:46:55.535 INFO:tasks.workunit.client.1.smithi176.stdout:9/365: symlink d1/d63/l81 0 2024-09-21T12:46:55.535 INFO:tasks.workunit.client.1.smithi176.stdout:6/345: write d2/dd/d26/d2b/d10/d39/f5b [1411381,80049] 0 2024-09-21T12:46:55.536 INFO:tasks.workunit.client.1.smithi176.stdout:3/450: link d1/d5/d25/d38/c72 d1/d5/d25/d61/cb5 0 2024-09-21T12:46:55.536 INFO:tasks.workunit.client.1.smithi176.stdout:4/352: chown d3/d5/db/d36/c49 879 1 2024-09-21T12:46:55.536 INFO:tasks.workunit.client.1.smithi176.stdout:1/356: dread - d0/db/d1a/f36 zero size 2024-09-21T12:46:55.537 INFO:tasks.workunit.client.1.smithi176.stdout:3/451: fsync d1/d34/d71/d91/f9d 0 2024-09-21T12:46:55.538 INFO:tasks.workunit.client.1.smithi176.stdout:7/459: truncate d0/d2/db/d10/d31/f83 539307 0 2024-09-21T12:46:55.538 INFO:tasks.workunit.client.1.smithi176.stdout:9/366: creat d1/d61/d73/d7d/f82 x:0 0 0 2024-09-21T12:46:55.538 INFO:tasks.workunit.client.1.smithi176.stdout:3/452: chown d1/d5/d25 3126 1 2024-09-21T12:46:55.539 INFO:tasks.workunit.client.1.smithi176.stdout:4/353: creat d3/d5/db/d36/f77 x:0 0 0 2024-09-21T12:46:55.540 INFO:tasks.workunit.client.1.smithi176.stdout:7/460: fdatasync d0/d2/db/d10/d31/d65/f47 0 2024-09-21T12:46:55.540 INFO:tasks.workunit.client.1.smithi176.stdout:1/357: mknod d0/db/d1a/d2c/c7f 0 2024-09-21T12:46:55.542 INFO:tasks.workunit.client.1.smithi176.stdout:6/346: link d2/dd/d26/l35 d2/d63/l69 0 2024-09-21T12:46:55.543 INFO:tasks.workunit.client.1.smithi176.stdout:3/453: rename d1/d5/fc to d1/d9e/fb6 0 2024-09-21T12:46:55.544 INFO:tasks.workunit.client.1.smithi176.stdout:4/354: mknod d3/d21/c78 0 2024-09-21T12:46:55.547 INFO:tasks.workunit.client.1.smithi176.stdout:4/355: dread d3/d5/f44 [0,4194304] 0 2024-09-21T12:46:55.549 INFO:tasks.workunit.client.1.smithi176.stdout:1/358: creat d0/db/d25/d41/d59/f80 x:0 0 0 2024-09-21T12:46:55.550 INFO:tasks.workunit.client.1.smithi176.stdout:1/359: chown d0/db/d1a/d2c/d48/d50/f64 31 1 2024-09-21T12:46:55.551 INFO:tasks.workunit.client.1.smithi176.stdout:9/367: getdents d1/df/d48/d69/d76 0 2024-09-21T12:46:55.551 INFO:tasks.workunit.client.1.smithi176.stdout:4/356: dread d3/d21/d27/f40 [0,4194304] 0 2024-09-21T12:46:55.552 INFO:tasks.workunit.client.1.smithi176.stdout:3/454: link d1/d5/d25/d38/f79 d1/d9e/fb7 0 2024-09-21T12:46:55.552 INFO:tasks.workunit.client.1.smithi176.stdout:1/360: read d0/fa [6709577,107968] 0 2024-09-21T12:46:55.553 INFO:tasks.workunit.client.1.smithi176.stdout:4/357: truncate d3/d42/f57 146674 0 2024-09-21T12:46:55.553 INFO:tasks.workunit.client.1.smithi176.stdout:6/347: rmdir d2/dd/d26/d2b/d10/d67 0 2024-09-21T12:46:55.554 INFO:tasks.workunit.client.1.smithi176.stdout:4/358: write d3/d5/f4a [4358681,26322] 0 2024-09-21T12:46:55.558 INFO:tasks.workunit.client.1.smithi176.stdout:9/368: rename d1/df/d48/d69/d38/l3b to d1/df/d48/d69/d4d/l83 0 2024-09-21T12:46:55.558 INFO:tasks.workunit.client.1.smithi176.stdout:9/369: chown d1/df/d48/f6c 156 1 2024-09-21T12:46:55.559 INFO:tasks.workunit.client.1.smithi176.stdout:4/359: creat d3/d42/d56/d4e/f79 x:0 0 0 2024-09-21T12:46:55.560 INFO:tasks.workunit.client.1.smithi176.stdout:4/360: truncate d3/d42/f71 63543 0 2024-09-21T12:46:55.562 INFO:tasks.workunit.client.1.smithi176.stdout:9/370: unlink d1/d61/c79 0 2024-09-21T12:46:55.563 INFO:tasks.workunit.client.1.smithi176.stdout:3/455: link d1/d5/d25/d38/l3d d1/d5/d25/d76/db3/lb8 0 2024-09-21T12:46:55.563 INFO:tasks.workunit.client.1.smithi176.stdout:4/361: dread d3/d5/fd [0,4194304] 0 2024-09-21T12:46:55.564 INFO:tasks.workunit.client.1.smithi176.stdout:1/361: rename d0/f27 to d0/db/d1a/d2c/f81 0 2024-09-21T12:46:55.564 INFO:tasks.workunit.client.1.smithi176.stdout:4/362: dread - d3/d5/db/d36/f77 zero size 2024-09-21T12:46:55.565 INFO:tasks.workunit.client.1.smithi176.stdout:3/456: unlink d1/da/fa9 0 2024-09-21T12:46:55.566 INFO:tasks.workunit.client.1.smithi176.stdout:1/362: fdatasync d0/db/f22 0 2024-09-21T12:46:55.566 INFO:tasks.workunit.client.1.smithi176.stdout:4/363: dread d3/d5/fd [0,4194304] 0 2024-09-21T12:46:55.568 INFO:tasks.workunit.client.1.smithi176.stdout:4/364: creat d3/d42/d47/f7a x:0 0 0 2024-09-21T12:46:55.568 INFO:tasks.workunit.client.1.smithi176.stdout:1/363: mknod d0/db/d1a/d2c/d37/c82 0 2024-09-21T12:46:55.571 INFO:tasks.workunit.client.1.smithi176.stdout:4/365: creat d3/d42/d56/d4e/f7b x:0 0 0 2024-09-21T12:46:55.571 INFO:tasks.workunit.client.1.smithi176.stdout:3/457: dwrite d1/d5/d25/d5c/faf [0,4194304] 0 2024-09-21T12:46:55.573 INFO:tasks.workunit.client.1.smithi176.stdout:1/364: mknod d0/db/d25/d41/c83 0 2024-09-21T12:46:55.575 INFO:tasks.workunit.client.1.smithi176.stdout:4/366: dread - d3/d21/d27/d2c/f4b zero size 2024-09-21T12:46:55.577 INFO:tasks.workunit.client.1.smithi176.stdout:2/372: sync 2024-09-21T12:46:55.579 INFO:tasks.workunit.client.1.smithi176.stdout:3/458: truncate d1/d34/f52 1974512 0 2024-09-21T12:46:55.582 INFO:tasks.workunit.client.1.smithi176.stdout:4/367: creat d3/d42/f7c x:0 0 0 2024-09-21T12:46:55.584 INFO:tasks.workunit.client.1.smithi176.stdout:1/365: mkdir d0/db/d1a/d2c/d84 0 2024-09-21T12:46:55.586 INFO:tasks.workunit.client.1.smithi176.stdout:2/373: creat d4/df/d2e/d6f/d6d/f74 x:0 0 0 2024-09-21T12:46:55.587 INFO:tasks.workunit.client.1.smithi176.stdout:4/368: dwrite d3/d42/d56/d4e/f79 [0,4194304] 0 2024-09-21T12:46:55.588 INFO:tasks.workunit.client.1.smithi176.stdout:3/459: symlink d1/d5/d25/d76/db3/lb9 0 2024-09-21T12:46:55.589 INFO:tasks.workunit.client.1.smithi176.stdout:2/374: read d4/df/d2e/d6f/f2c [3728896,33250] 0 2024-09-21T12:46:55.589 INFO:tasks.workunit.client.1.smithi176.stdout:1/366: creat d0/db/d1a/d73/f85 x:0 0 0 2024-09-21T12:46:55.658 INFO:tasks.workunit.client.1.smithi176.stdout:1/367: readlink d0/l5 0 2024-09-21T12:46:55.659 INFO:tasks.workunit.client.1.smithi176.stdout:4/369: creat d3/d21/d27/f7d x:0 0 0 2024-09-21T12:46:55.659 INFO:tasks.workunit.client.1.smithi176.stdout:1/368: chown d0/db 10 1 2024-09-21T12:46:55.660 INFO:tasks.workunit.client.1.smithi176.stdout:1/369: chown d0/db/d25/c53 1968 1 2024-09-21T12:46:55.661 INFO:tasks.workunit.client.1.smithi176.stdout:4/370: write d3/d5/f44 [138294,108634] 0 2024-09-21T12:46:55.662 INFO:tasks.workunit.client.1.smithi176.stdout:1/370: creat d0/db/d2a/f86 x:0 0 0 2024-09-21T12:46:55.663 INFO:tasks.workunit.client.1.smithi176.stdout:3/460: getdents d1/d5/d25/d76/db3 0 2024-09-21T12:46:55.664 INFO:tasks.workunit.client.1.smithi176.stdout:2/375: dwrite d4/f1a [0,4194304] 0 2024-09-21T12:46:55.665 INFO:tasks.workunit.client.1.smithi176.stdout:3/461: stat d1/d34/d71/d91/f9d 0 2024-09-21T12:46:55.665 INFO:tasks.workunit.client.1.smithi176.stdout:1/371: creat d0/d5b/f87 x:0 0 0 2024-09-21T12:46:55.666 INFO:tasks.workunit.client.1.smithi176.stdout:2/376: dread - d4/df/d2e/d39/d55/f6e zero size 2024-09-21T12:46:55.666 INFO:tasks.workunit.client.1.smithi176.stdout:3/462: write d1/d34/d5d/fad [18435,116622] 0 2024-09-21T12:46:55.667 INFO:tasks.workunit.client.1.smithi176.stdout:1/372: mknod d0/db/d1a/d2c/d66/c88 0 2024-09-21T12:46:55.668 INFO:tasks.workunit.client.1.smithi176.stdout:2/377: creat d4/df/d2e/d39/d55/f75 x:0 0 0 2024-09-21T12:46:55.670 INFO:tasks.workunit.client.1.smithi176.stdout:2/378: dread - d4/df/f6b zero size 2024-09-21T12:46:55.671 INFO:tasks.workunit.client.1.smithi176.stdout:2/379: chown d4/df/l13 195 1 2024-09-21T12:46:55.672 INFO:tasks.workunit.client.1.smithi176.stdout:1/373: dread d0/db/ff [0,4194304] 0 2024-09-21T12:46:55.673 INFO:tasks.workunit.client.1.smithi176.stdout:2/380: mkdir d4/d3d/d76 0 2024-09-21T12:46:55.674 INFO:tasks.workunit.client.1.smithi176.stdout:2/381: dread - d4/f64 zero size 2024-09-21T12:46:55.674 INFO:tasks.workunit.client.1.smithi176.stdout:1/374: write d0/db/d25/d2b/d43/f69 [40759,50248] 0 2024-09-21T12:46:55.677 INFO:tasks.workunit.client.1.smithi176.stdout:1/375: mkdir d0/db/d6a/d89 0 2024-09-21T12:46:55.680 INFO:tasks.workunit.client.1.smithi176.stdout:3/463: dread d1/da/f2e [0,4194304] 0 2024-09-21T12:46:55.681 INFO:tasks.workunit.client.1.smithi176.stdout:1/376: rename d0/db/d2a/f5d to d0/db/d1a/f8a 0 2024-09-21T12:46:55.682 INFO:tasks.workunit.client.1.smithi176.stdout:1/377: chown d0/db/f1f 2517303 1 2024-09-21T12:46:55.682 INFO:tasks.workunit.client.1.smithi176.stdout:3/464: mknod d1/d34/d42/cba 0 2024-09-21T12:46:55.684 INFO:tasks.workunit.client.1.smithi176.stdout:1/378: mknod d0/db/d1a/d2c/d48/d50/c8b 0 2024-09-21T12:46:55.685 INFO:tasks.workunit.client.1.smithi176.stdout:3/465: mkdir d1/d34/dbb 0 2024-09-21T12:46:55.688 INFO:tasks.workunit.client.1.smithi176.stdout:3/466: creat d1/d34/d5d/fbc x:0 0 0 2024-09-21T12:46:55.689 INFO:tasks.workunit.client.1.smithi176.stdout:1/379: dwrite d0/db/f1b [0,4194304] 0 2024-09-21T12:46:55.691 INFO:tasks.workunit.client.1.smithi176.stdout:1/380: truncate d0/db/f1b 4722019 0 2024-09-21T12:46:55.693 INFO:tasks.workunit.client.1.smithi176.stdout:2/382: dread d4/df/f2a [0,4194304] 0 2024-09-21T12:46:55.693 INFO:tasks.workunit.client.1.smithi176.stdout:8/359: sync 2024-09-21T12:46:55.694 INFO:tasks.workunit.client.1.smithi176.stdout:2/383: dread d4/df/f1c [0,4194304] 0 2024-09-21T12:46:55.696 INFO:tasks.workunit.client.1.smithi176.stdout:1/381: creat d0/db/d25/d2b/d43/f8c x:0 0 0 2024-09-21T12:46:55.697 INFO:tasks.workunit.client.1.smithi176.stdout:3/467: getdents d1/d5/d25/d40 0 2024-09-21T12:46:55.699 INFO:tasks.workunit.client.1.smithi176.stdout:8/360: symlink d6/db/d32/l72 0 2024-09-21T12:46:55.700 INFO:tasks.workunit.client.1.smithi176.stdout:8/361: fdatasync f4 0 2024-09-21T12:46:55.702 INFO:tasks.workunit.client.1.smithi176.stdout:8/362: fsync d6/db/d13/f5a 0 2024-09-21T12:46:55.706 INFO:tasks.workunit.client.1.smithi176.stdout:1/382: dwrite d0/db/d1a/d2c/f79 [0,4194304] 0 2024-09-21T12:46:55.706 INFO:tasks.workunit.client.1.smithi176.stdout:8/363: symlink d6/db/l73 0 2024-09-21T12:46:55.708 INFO:tasks.workunit.client.1.smithi176.stdout:2/384: dwrite d4/df/d2e/d6f/f59 [0,4194304] 0 2024-09-21T12:46:55.709 INFO:tasks.workunit.client.1.smithi176.stdout:1/383: fsync d0/db/f15 0 2024-09-21T12:46:55.709 INFO:tasks.workunit.client.1.smithi176.stdout:3/468: dread d1/da/f22 [0,4194304] 0 2024-09-21T12:46:55.710 INFO:tasks.workunit.client.1.smithi176.stdout:8/364: write d6/db/d13/f26 [1680266,90092] 0 2024-09-21T12:46:55.710 INFO:tasks.workunit.client.1.smithi176.stdout:3/469: stat d1/d34/d48 0 2024-09-21T12:46:55.710 INFO:tasks.workunit.client.1.smithi176.stdout:1/384: chown d0/f3c 3564697 1 2024-09-21T12:46:55.711 INFO:tasks.workunit.client.1.smithi176.stdout:1/385: dread - d0/d63/f6c zero size 2024-09-21T12:46:55.712 INFO:tasks.workunit.client.1.smithi176.stdout:8/365: symlink d6/db/d32/l74 0 2024-09-21T12:46:55.715 INFO:tasks.workunit.client.1.smithi176.stdout:3/470: creat d1/d35/fbd x:0 0 0 2024-09-21T12:46:55.717 INFO:tasks.workunit.client.1.smithi176.stdout:1/386: truncate d0/db/f15 497113 0 2024-09-21T12:46:55.718 INFO:tasks.workunit.client.1.smithi176.stdout:3/471: stat d1/d34/cb0 0 2024-09-21T12:46:55.719 INFO:tasks.workunit.client.1.smithi176.stdout:3/472: chown d1/d34/cb0 76978 1 2024-09-21T12:46:55.719 INFO:tasks.workunit.client.1.smithi176.stdout:3/473: chown d1/d5 126 1 2024-09-21T12:46:55.722 INFO:tasks.workunit.client.1.smithi176.stdout:3/474: creat d1/d3e/fbe x:0 0 0 2024-09-21T12:46:55.725 INFO:tasks.workunit.client.1.smithi176.stdout:1/387: link d0/db/d1a/d2c/f57 d0/db/d1a/d2c/d48/f8d 0 2024-09-21T12:46:55.728 INFO:tasks.workunit.client.1.smithi176.stdout:3/475: dwrite d1/d8d/f97 [0,4194304] 0 2024-09-21T12:46:55.729 INFO:tasks.workunit.client.1.smithi176.stdout:3/476: dread - d1/d5/f9b zero size 2024-09-21T12:46:55.729 INFO:tasks.workunit.client.1.smithi176.stdout:1/388: truncate d0/db/d1a/d2c/d6b/f77 623434 0 2024-09-21T12:46:55.731 INFO:tasks.workunit.client.1.smithi176.stdout:3/477: write d1/d5/d25/d76/f7f [359105,122846] 0 2024-09-21T12:46:55.732 INFO:tasks.workunit.client.1.smithi176.stdout:3/478: write d1/d5/f9b [726624,43958] 0 2024-09-21T12:46:55.740 INFO:tasks.workunit.client.1.smithi176.stdout:3/479: dread d1/d35/f8a [0,4194304] 0 2024-09-21T12:46:55.741 INFO:tasks.workunit.client.1.smithi176.stdout:1/389: truncate d0/db/d2a/f4c 2369856 0 2024-09-21T12:46:55.742 INFO:tasks.workunit.client.1.smithi176.stdout:1/390: rmdir d0/db/d1a/d2c/d48 39 2024-09-21T12:46:55.744 INFO:tasks.workunit.client.1.smithi176.stdout:1/391: write d0/db/d25/d41/d59/f80 [373137,19059] 0 2024-09-21T12:46:55.746 INFO:tasks.workunit.client.1.smithi176.stdout:1/392: creat d0/db/d25/d2b/d43/f8e x:0 0 0 2024-09-21T12:46:55.747 INFO:tasks.workunit.client.1.smithi176.stdout:1/393: write d0/f3 [2755753,97974] 0 2024-09-21T12:46:55.749 INFO:tasks.workunit.client.1.smithi176.stdout:1/394: symlink d0/db/d25/d2b/l8f 0 2024-09-21T12:46:55.753 INFO:tasks.workunit.client.1.smithi176.stdout:1/395: rename d0/db/d25/d41/f7b to d0/db/d1a/d2c/d48/d50/f90 0 2024-09-21T12:46:55.754 INFO:tasks.workunit.client.1.smithi176.stdout:1/396: truncate d0/db/d25/d2b/d43/f8c 911793 0 2024-09-21T12:46:55.756 INFO:tasks.workunit.client.1.smithi176.stdout:1/397: write d0/db/d1a/d2c/d48/d50/f90 [24827,97541] 0 2024-09-21T12:46:55.757 INFO:tasks.workunit.client.1.smithi176.stdout:1/398: mkdir d0/d91 0 2024-09-21T12:46:55.761 INFO:tasks.workunit.client.1.smithi176.stdout:1/399: fsync d0/db/d1a/d2c/d48/d50/f90 0 2024-09-21T12:46:55.762 INFO:tasks.workunit.client.1.smithi176.stdout:1/400: mkdir d0/db/d25/d2b/d43/d92 0 2024-09-21T12:46:55.767 INFO:tasks.workunit.client.1.smithi176.stdout:1/401: dwrite d0/db/d1a/f20 [0,4194304] 0 2024-09-21T12:46:55.769 INFO:tasks.workunit.client.1.smithi176.stdout:1/402: write d0/db/d25/d2b/f44 [537469,121252] 0 2024-09-21T12:46:55.769 INFO:tasks.workunit.client.1.smithi176.stdout:1/403: chown d0/db/d1a/d2c 0 1 2024-09-21T12:46:55.772 INFO:tasks.workunit.client.1.smithi176.stdout:1/404: fdatasync d0/db/d1a/d2c/d48/f8d 0 2024-09-21T12:46:55.773 INFO:tasks.workunit.client.1.smithi176.stdout:1/405: dread - d0/db/d6f/f7d zero size 2024-09-21T12:46:55.773 INFO:tasks.workunit.client.1.smithi176.stdout:1/406: chown d0/d5b/f61 342753098 1 2024-09-21T12:46:55.775 INFO:tasks.workunit.client.1.smithi176.stdout:1/407: rmdir d0 39 2024-09-21T12:46:55.780 INFO:tasks.workunit.client.1.smithi176.stdout:1/408: getdents d0/db/d1a/d73 0 2024-09-21T12:46:55.784 INFO:tasks.workunit.client.1.smithi176.stdout:1/409: link d0/l1d d0/db/d1a/d2c/d48/d50/l93 0 2024-09-21T12:46:55.786 INFO:tasks.workunit.client.1.smithi176.stdout:1/410: write d0/db/d1a/d2c/f57 [789831,69518] 0 2024-09-21T12:46:55.789 INFO:tasks.workunit.client.1.smithi176.stdout:1/411: symlink d0/db/d25/d41/l94 0 2024-09-21T12:46:55.792 INFO:tasks.workunit.client.1.smithi176.stdout:1/412: fdatasync d0/db/d1a/d2c/d6b/f77 0 2024-09-21T12:46:55.796 INFO:tasks.workunit.client.1.smithi176.stdout:1/413: link d0/db/d1a/d2c/d66/f6e d0/db/d1a/d73/f95 0 2024-09-21T12:46:55.801 INFO:tasks.workunit.client.1.smithi176.stdout:1/414: rename d0/db/d1a/d2c/d37/c49 to d0/db/d1a/d2c/d84/c96 0 2024-09-21T12:46:55.802 INFO:tasks.workunit.client.1.smithi176.stdout:1/415: chown d0/l11 6694 1 2024-09-21T12:46:55.804 INFO:tasks.workunit.client.1.smithi176.stdout:1/416: write d0/db/d1a/d2c/d6b/f77 [1329950,75966] 0 2024-09-21T12:46:55.807 INFO:tasks.workunit.client.1.smithi176.stdout:1/417: unlink d0/db/l70 0 2024-09-21T12:46:55.810 INFO:tasks.workunit.client.1.smithi176.stdout:1/418: dread d0/f58 [0,4194304] 0 2024-09-21T12:46:55.811 INFO:tasks.workunit.client.1.smithi176.stdout:1/419: chown d0/db/d25/c53 55839006 1 2024-09-21T12:46:55.811 INFO:tasks.workunit.client.1.smithi176.stdout:0/465: sync 2024-09-21T12:46:55.811 INFO:tasks.workunit.client.1.smithi176.stdout:7/461: sync 2024-09-21T12:46:55.811 INFO:tasks.workunit.client.1.smithi176.stdout:5/297: sync 2024-09-21T12:46:55.812 INFO:tasks.workunit.client.1.smithi176.stdout:0/466: readlink d9/d1a/d1d/d23/l54 0 2024-09-21T12:46:55.812 INFO:tasks.workunit.client.1.smithi176.stdout:5/298: write d0/d10/f36 [1237267,89106] 0 2024-09-21T12:46:55.813 INFO:tasks.workunit.client.1.smithi176.stdout:1/420: creat d0/db/d25/d2b/f97 x:0 0 0 2024-09-21T12:46:55.813 INFO:tasks.workunit.client.1.smithi176.stdout:5/299: write d0/d13/f26 [865491,92448] 0 2024-09-21T12:46:55.815 INFO:tasks.workunit.client.1.smithi176.stdout:7/462: mkdir d0/d2/db/d10/d31/da0 0 2024-09-21T12:46:55.815 INFO:tasks.workunit.client.1.smithi176.stdout:7/463: stat d0/d2/d30/d93 0 2024-09-21T12:46:55.816 INFO:tasks.workunit.client.1.smithi176.stdout:0/467: creat d9/dc/f9d x:0 0 0 2024-09-21T12:46:55.816 INFO:tasks.workunit.client.1.smithi176.stdout:7/464: truncate d0/d5d/d5e/f77 171860 0 2024-09-21T12:46:55.820 INFO:tasks.workunit.client.1.smithi176.stdout:1/421: fsync d0/db/d1a/f21 0 2024-09-21T12:46:55.823 INFO:tasks.workunit.client.1.smithi176.stdout:0/468: dwrite d9/dc/d1e/f6b [0,4194304] 0 2024-09-21T12:46:55.823 INFO:tasks.workunit.client.1.smithi176.stdout:1/422: unlink d0/f28 0 2024-09-21T12:46:55.823 INFO:tasks.workunit.client.1.smithi176.stdout:7/465: dwrite d0/d2f/d43/f52 [0,4194304] 0 2024-09-21T12:46:55.825 INFO:tasks.workunit.client.1.smithi176.stdout:7/466: fsync d0/d2/db/d10/f22 0 2024-09-21T12:46:55.826 INFO:tasks.workunit.client.1.smithi176.stdout:7/467: chown d0/d2/d30/f44 6862 1 2024-09-21T12:46:55.827 INFO:tasks.workunit.client.1.smithi176.stdout:7/468: fsync d0/d5d/d5e/f74 0 2024-09-21T12:46:55.828 INFO:tasks.workunit.client.1.smithi176.stdout:5/300: getdents d0/d10/d11/d2e/d39/d41 0 2024-09-21T12:46:55.829 INFO:tasks.workunit.client.1.smithi176.stdout:7/469: chown d0/d2/db/d10/d31 49188431 1 2024-09-21T12:46:55.830 INFO:tasks.workunit.client.1.smithi176.stdout:5/301: write d0/d10/f23 [3556294,74270] 0 2024-09-21T12:46:55.831 INFO:tasks.workunit.client.1.smithi176.stdout:7/470: fsync d0/d2/db/d10/f1d 0 2024-09-21T12:46:55.833 INFO:tasks.workunit.client.1.smithi176.stdout:1/423: rename d0/db/d25/d2b/l2e to d0/db/d25/d41/d59/l98 0 2024-09-21T12:46:55.834 INFO:tasks.workunit.client.1.smithi176.stdout:5/302: rmdir d0/d10/d11/d2e 39 2024-09-21T12:46:55.834 INFO:tasks.workunit.client.1.smithi176.stdout:7/471: dread d0/f17 [0,4194304] 0 2024-09-21T12:46:55.838 INFO:tasks.workunit.client.1.smithi176.stdout:1/424: getdents d0/d63 0 2024-09-21T12:46:55.839 INFO:tasks.workunit.client.1.smithi176.stdout:1/425: chown d0/d5b 392594563 1 2024-09-21T12:46:55.840 INFO:tasks.workunit.client.1.smithi176.stdout:1/426: dread - d0/d63/f6c zero size 2024-09-21T12:46:55.842 INFO:tasks.workunit.client.1.smithi176.stdout:5/303: dwrite d0/d13/f50 [0,4194304] 0 2024-09-21T12:46:55.842 INFO:tasks.workunit.client.1.smithi176.stdout:7/472: dread d0/d2/db/d10/d31/d65/f47 [0,4194304] 0 2024-09-21T12:46:55.843 INFO:tasks.workunit.client.1.smithi176.stdout:0/469: dread d9/d1a/d3f/d40/f85 [0,4194304] 0 2024-09-21T12:46:55.844 INFO:tasks.workunit.client.1.smithi176.stdout:7/473: readlink d0/d2/db/l27 0 2024-09-21T12:46:55.845 INFO:tasks.workunit.client.1.smithi176.stdout:5/304: fsync d0/d10/d11/f3a 0 2024-09-21T12:46:55.845 INFO:tasks.workunit.client.1.smithi176.stdout:0/470: read d9/d1a/d1d/d23/d5f/f89 [719545,57918] 0 2024-09-21T12:46:55.850 INFO:tasks.workunit.client.1.smithi176.stdout:7/474: mkdir d0/d2/db/d10/d31/da1 0 2024-09-21T12:46:55.851 INFO:tasks.workunit.client.1.smithi176.stdout:7/475: chown d0/d2f/d43/c49 420 1 2024-09-21T12:46:55.851 INFO:tasks.workunit.client.1.smithi176.stdout:7/476: readlink d0/d2/d30/d93/d96/l8b 0 2024-09-21T12:46:55.852 INFO:tasks.workunit.client.1.smithi176.stdout:0/471: stat d9/d1b/d63/d77/d78/c84 0 2024-09-21T12:46:55.853 INFO:tasks.workunit.client.1.smithi176.stdout:7/477: mkdir d0/d2/d30/d93/da2 0 2024-09-21T12:46:55.854 INFO:tasks.workunit.client.1.smithi176.stdout:1/427: getdents d0/db/d1a/d2c/d37 0 2024-09-21T12:46:55.855 INFO:tasks.workunit.client.1.smithi176.stdout:5/305: symlink d0/d10/d11/d2e/d39/l5b 0 2024-09-21T12:46:55.856 INFO:tasks.workunit.client.1.smithi176.stdout:7/478: unlink d0/d2/d30/f44 0 2024-09-21T12:46:55.857 INFO:tasks.workunit.client.1.smithi176.stdout:0/472: symlink d9/d1a/d20/d65/l9e 0 2024-09-21T12:46:55.859 INFO:tasks.workunit.client.1.smithi176.stdout:0/473: mkdir d9/dc/d93/d9f 0 2024-09-21T12:46:55.860 INFO:tasks.workunit.client.1.smithi176.stdout:7/479: rename d0/d2/db/d10/d5a/c56 to d0/d2f/ca3 0 2024-09-21T12:46:55.861 INFO:tasks.workunit.client.1.smithi176.stdout:1/428: dread d0/db/d1a/d2c/d37/f45 [0,4194304] 0 2024-09-21T12:46:55.862 INFO:tasks.workunit.client.1.smithi176.stdout:0/474: truncate d9/f2b 2459961 0 2024-09-21T12:46:55.865 INFO:tasks.workunit.client.1.smithi176.stdout:0/475: symlink d9/d1a/d1d/d81/la0 0 2024-09-21T12:46:55.865 INFO:tasks.workunit.client.1.smithi176.stdout:5/306: dwrite d0/d13/f56 [0,4194304] 0 2024-09-21T12:46:55.867 INFO:tasks.workunit.client.1.smithi176.stdout:1/429: mkdir d0/db/d25/d41/d59/d99 0 2024-09-21T12:46:55.869 INFO:tasks.workunit.client.1.smithi176.stdout:7/480: dwrite d0/d2/d30/f7f [0,4194304] 0 2024-09-21T12:46:55.869 INFO:tasks.workunit.client.1.smithi176.stdout:0/476: rename d9/d1b/d63/d77/d87 to d9/d1a/d1d/d23/da1 0 2024-09-21T12:46:55.871 INFO:tasks.workunit.client.1.smithi176.stdout:0/477: chown d9/d1b/f71 428 1 2024-09-21T12:46:55.871 INFO:tasks.workunit.client.1.smithi176.stdout:1/430: creat d0/db/d25/d41/f9a x:0 0 0 2024-09-21T12:46:55.872 INFO:tasks.workunit.client.1.smithi176.stdout:5/307: read d0/d10/d11/d2e/f2f [269564,125887] 0 2024-09-21T12:46:55.874 INFO:tasks.workunit.client.1.smithi176.stdout:7/481: rename d0/d2f/f73 to d0/d2/db/fa4 0 2024-09-21T12:46:55.876 INFO:tasks.workunit.client.1.smithi176.stdout:1/431: mkdir d0/db/d25/d41/d59/d9b 0 2024-09-21T12:46:55.876 INFO:tasks.workunit.client.1.smithi176.stdout:1/432: chown d0/db/d25 286 1 2024-09-21T12:46:55.878 INFO:tasks.workunit.client.1.smithi176.stdout:0/478: link d9/d1a/f9b d9/d1b/d43/d98/fa2 0 2024-09-21T12:46:55.879 INFO:tasks.workunit.client.1.smithi176.stdout:0/479: fsync d9/d1a/d1d/d90/f94 0 2024-09-21T12:46:55.879 INFO:tasks.workunit.client.1.smithi176.stdout:5/308: rename d0/d10/d11/d2e/f2f to d0/d13/f5c 0 2024-09-21T12:46:55.881 INFO:tasks.workunit.client.1.smithi176.stdout:5/309: fsync d0/f52 0 2024-09-21T12:46:55.881 INFO:tasks.workunit.client.1.smithi176.stdout:7/482: dwrite d0/d2f/d43/f76 [0,4194304] 0 2024-09-21T12:46:55.883 INFO:tasks.workunit.client.1.smithi176.stdout:6/348: sync 2024-09-21T12:46:55.883 INFO:tasks.workunit.client.1.smithi176.stdout:9/371: sync 2024-09-21T12:46:55.886 INFO:tasks.workunit.client.1.smithi176.stdout:1/433: creat d0/db/d1a/d2c/d48/d50/f9c x:0 0 0 2024-09-21T12:46:55.888 INFO:tasks.workunit.client.1.smithi176.stdout:5/310: truncate d0/d10/f4c 3377524 0 2024-09-21T12:46:55.889 INFO:tasks.workunit.client.1.smithi176.stdout:5/311: chown d0/d10/f4c 1660 1 2024-09-21T12:46:55.889 INFO:tasks.workunit.client.1.smithi176.stdout:0/480: dwrite d9/dc/f9d [0,4194304] 0 2024-09-21T12:46:55.890 INFO:tasks.workunit.client.1.smithi176.stdout:5/312: chown d0/ff 1023 1 2024-09-21T12:46:55.890 INFO:tasks.workunit.client.1.smithi176.stdout:9/372: mkdir d1/df/d48/d69/d40/d84 0 2024-09-21T12:46:55.891 INFO:tasks.workunit.client.1.smithi176.stdout:5/313: fdatasync d0/d13/f26 0 2024-09-21T12:46:55.892 INFO:tasks.workunit.client.1.smithi176.stdout:9/373: write d1/f2f [1342560,21060] 0 2024-09-21T12:46:55.894 INFO:tasks.workunit.client.1.smithi176.stdout:1/434: creat d0/db/d6a/f9d x:0 0 0 2024-09-21T12:46:55.895 INFO:tasks.workunit.client.1.smithi176.stdout:1/435: truncate d0/db/d1a/f8a 62751 0 2024-09-21T12:46:55.896 INFO:tasks.workunit.client.1.smithi176.stdout:6/349: creat d2/d5d/f6a x:0 0 0 2024-09-21T12:46:55.899 INFO:tasks.workunit.client.1.smithi176.stdout:0/481: rename d9/dc to d9/d1a/d1d/d23/da1/da3 0 2024-09-21T12:46:55.901 INFO:tasks.workunit.client.1.smithi176.stdout:0/482: fdatasync d9/d1a/d1d/d23/d5f/f73 0 2024-09-21T12:46:55.902 INFO:tasks.workunit.client.1.smithi176.stdout:1/436: dwrite d0/d5b/f61 [0,4194304] 0 2024-09-21T12:46:55.902 INFO:tasks.workunit.client.1.smithi176.stdout:5/314: unlink d0/d10/d11/d2e/d37/f40 0 2024-09-21T12:46:55.903 INFO:tasks.workunit.client.1.smithi176.stdout:0/483: fdatasync d9/d1a/d1d/d23/da1/da3/d1e/f42 0 2024-09-21T12:46:55.903 INFO:tasks.workunit.client.1.smithi176.stdout:9/374: mknod d1/d61/d73/c85 0 2024-09-21T12:46:55.904 INFO:tasks.workunit.client.1.smithi176.stdout:7/483: link d0/d98/c9f d0/d2/db/d10/d72/d51/ca5 0 2024-09-21T12:46:55.907 INFO:tasks.workunit.client.1.smithi176.stdout:5/315: dread d0/d10/d11/d2e/d39/f4b [0,4194304] 0 2024-09-21T12:46:55.907 INFO:tasks.workunit.client.1.smithi176.stdout:9/375: dread - d1/df/d48/d69/f21 zero size 2024-09-21T12:46:55.910 INFO:tasks.workunit.client.1.smithi176.stdout:3/480: sync 2024-09-21T12:46:55.910 INFO:tasks.workunit.client.1.smithi176.stdout:4/371: sync 2024-09-21T12:46:55.910 INFO:tasks.workunit.client.1.smithi176.stdout:2/385: sync 2024-09-21T12:46:55.910 INFO:tasks.workunit.client.1.smithi176.stdout:8/366: sync 2024-09-21T12:46:55.910 INFO:tasks.workunit.client.1.smithi176.stdout:1/437: readlink d0/db/d25/d41/d59/l98 0 2024-09-21T12:46:55.911 INFO:tasks.workunit.client.1.smithi176.stdout:9/376: write d1/df/d23/f45 [291273,130430] 0 2024-09-21T12:46:55.911 INFO:tasks.workunit.client.1.smithi176.stdout:7/484: rename d0/d2/db/d8f to d0/d2/db/d10/d23/da6 0 2024-09-21T12:46:55.912 INFO:tasks.workunit.client.1.smithi176.stdout:9/377: read d1/df/d48/d69/f3d [65485,39840] 0 2024-09-21T12:46:55.915 INFO:tasks.workunit.client.1.smithi176.stdout:9/378: write d1/df/d48/f4a [2543105,76772] 0 2024-09-21T12:46:55.916 INFO:tasks.workunit.client.1.smithi176.stdout:4/372: creat d3/d42/d47/f7e x:0 0 0 2024-09-21T12:46:55.917 INFO:tasks.workunit.client.1.smithi176.stdout:1/438: dread d0/d5b/f61 [0,4194304] 0 2024-09-21T12:46:55.917 INFO:tasks.workunit.client.1.smithi176.stdout:9/379: fsync d1/df/d48/d69/f6f 0 2024-09-21T12:46:55.917 INFO:tasks.workunit.client.1.smithi176.stdout:1/439: chown d0/db 12 1 2024-09-21T12:46:55.918 INFO:tasks.workunit.client.1.smithi176.stdout:1/440: truncate d0/f3 5014661 0 2024-09-21T12:46:55.919 INFO:tasks.workunit.client.1.smithi176.stdout:2/386: creat d4/df/d2e/d6f/d5d/f77 x:0 0 0 2024-09-21T12:46:55.921 INFO:tasks.workunit.client.1.smithi176.stdout:8/367: rename d6/d8/d24/d35/f4e to d6/d8/d24/d35/f75 0 2024-09-21T12:46:55.921 INFO:tasks.workunit.client.1.smithi176.stdout:8/368: fdatasync d6/d8/d24/d35/d51/f53 0 2024-09-21T12:46:55.922 INFO:tasks.workunit.client.1.smithi176.stdout:8/369: fdatasync d6/f15 0 2024-09-21T12:46:55.926 INFO:tasks.workunit.client.1.smithi176.stdout:7/485: rename d0/d2/db/ff to d0/d2/db/d10/d72/d51/fa7 0 2024-09-21T12:46:55.926 INFO:tasks.workunit.client.1.smithi176.stdout:7/486: chown d0/d2f/f66 132023258 1 2024-09-21T12:46:55.927 INFO:tasks.workunit.client.1.smithi176.stdout:0/484: creat d9/d1a/d3f/fa4 x:0 0 0 2024-09-21T12:46:55.928 INFO:tasks.workunit.client.1.smithi176.stdout:6/350: getdents d2 0 2024-09-21T12:46:55.930 INFO:tasks.workunit.client.1.smithi176.stdout:9/380: fsync d1/df/d23/f24 0 2024-09-21T12:46:55.931 INFO:tasks.workunit.client.1.smithi176.stdout:3/481: link d1/d5/d25/d61/fa5 d1/d34/d57/fbf 0 2024-09-21T12:46:55.933 INFO:tasks.workunit.client.1.smithi176.stdout:5/316: dwrite d0/fc [0,4194304] 0 2024-09-21T12:46:55.934 INFO:tasks.workunit.client.1.smithi176.stdout:5/317: write d0/d10/f23 [5101044,80397] 0 2024-09-21T12:46:55.937 INFO:tasks.workunit.client.1.smithi176.stdout:2/387: unlink d4/df/d2e/c2f 0 2024-09-21T12:46:55.937 INFO:tasks.workunit.client.1.smithi176.stdout:2/388: readlink d4/df/d4b/l54 0 2024-09-21T12:46:55.939 INFO:tasks.workunit.client.1.smithi176.stdout:0/485: symlink d9/d1a/d1d/d81/la5 0 2024-09-21T12:46:55.941 INFO:tasks.workunit.client.1.smithi176.stdout:9/381: mknod d1/d61/d73/c86 0 2024-09-21T12:46:55.943 INFO:tasks.workunit.client.1.smithi176.stdout:3/482: creat d1/d34/d42/d5b/fc0 x:0 0 0 2024-09-21T12:46:55.944 INFO:tasks.workunit.client.1.smithi176.stdout:3/483: dread - d1/d3e/fbe zero size 2024-09-21T12:46:55.945 INFO:tasks.workunit.client.1.smithi176.stdout:5/318: mkdir d0/d13/d5d 0 2024-09-21T12:46:55.945 INFO:tasks.workunit.client.1.smithi176.stdout:3/484: fsync d1/d34/d71/f73 0 2024-09-21T12:46:55.947 INFO:tasks.workunit.client.1.smithi176.stdout:8/370: creat d6/d8/d54/f76 x:0 0 0 2024-09-21T12:46:55.949 INFO:tasks.workunit.client.1.smithi176.stdout:7/487: mkdir d0/d2/da8 0 2024-09-21T12:46:55.951 INFO:tasks.workunit.client.1.smithi176.stdout:6/351: rename d2/dd/d26/l32 to d2/l6b 0 2024-09-21T12:46:55.957 INFO:tasks.workunit.client.1.smithi176.stdout:7/488: mknod d0/d98/ca9 0 2024-09-21T12:46:55.959 INFO:tasks.workunit.client.1.smithi176.stdout:1/441: fsync d0/db/d1a/f8a 0 2024-09-21T12:46:55.960 INFO:tasks.workunit.client.1.smithi176.stdout:4/373: getdents d3/d5 0 2024-09-21T12:46:55.961 INFO:tasks.workunit.client.1.smithi176.stdout:5/319: dread d0/d13/f26 [0,4194304] 0 2024-09-21T12:46:55.961 INFO:tasks.workunit.client.1.smithi176.stdout:3/485: dwrite d1/d5/d25/f26 [0,4194304] 0 2024-09-21T12:46:55.963 INFO:tasks.workunit.client.1.smithi176.stdout:2/389: link d4/df/l16 d4/df/d2e/d39/d55/l78 0 2024-09-21T12:46:55.966 INFO:tasks.workunit.client.1.smithi176.stdout:7/489: rename d0/d5d/d5e/c82 to d0/d2/db/d10/d3b/d79/caa 0 2024-09-21T12:46:55.968 INFO:tasks.workunit.client.1.smithi176.stdout:5/320: dread d0/d10/d11/f3a [0,4194304] 0 2024-09-21T12:46:55.968 INFO:tasks.workunit.client.1.smithi176.stdout:8/371: link d6/d8/d24/d35/f4f d6/d8/f77 0 2024-09-21T12:46:55.968 INFO:tasks.workunit.client.1.smithi176.stdout:1/442: dwrite d0/f5e [0,4194304] 0 2024-09-21T12:46:55.970 INFO:tasks.workunit.client.1.smithi176.stdout:4/374: symlink d3/d42/d47/d5c/l7f 0 2024-09-21T12:46:55.971 INFO:tasks.workunit.client.1.smithi176.stdout:4/375: stat d3/d21/d5e 0 2024-09-21T12:46:55.973 INFO:tasks.workunit.client.1.smithi176.stdout:1/443: rmdir d0/db/d1a/d2c/d37 39 2024-09-21T12:46:55.973 INFO:tasks.workunit.client.1.smithi176.stdout:4/376: truncate d3/d21/d27/d2c/f35 4470593 0 2024-09-21T12:46:55.977 INFO:tasks.workunit.client.1.smithi176.stdout:0/486: dwrite d9/d1a/d1d/d23/da1/da3/f13 [0,4194304] 0 2024-09-21T12:46:55.977 INFO:tasks.workunit.client.1.smithi176.stdout:3/486: symlink d1/d5/d25/d84/lc1 0 2024-09-21T12:46:55.980 INFO:tasks.workunit.client.1.smithi176.stdout:8/372: creat d6/d8/d24/d35/d51/f78 x:0 0 0 2024-09-21T12:46:55.980 INFO:tasks.workunit.client.1.smithi176.stdout:7/490: truncate d0/d2/db/d10/d5a/f38 4977186 0 2024-09-21T12:46:55.981 INFO:tasks.workunit.client.1.smithi176.stdout:5/321: mknod d0/d10/d11/d2e/d37/d55/c5e 0 2024-09-21T12:46:55.984 INFO:tasks.workunit.client.1.smithi176.stdout:6/352: creat d2/dd/d26/d2b/d10/d39/f6c x:0 0 0 2024-09-21T12:46:55.986 INFO:tasks.workunit.client.1.smithi176.stdout:8/373: mkdir d6/d16/d79 0 2024-09-21T12:46:55.987 INFO:tasks.workunit.client.1.smithi176.stdout:1/444: dwrite d0/db/d25/d2b/d43/f69 [0,4194304] 0 2024-09-21T12:46:55.987 INFO:tasks.workunit.client.1.smithi176.stdout:4/377: dwrite d3/d42/d56/d4e/f7b [0,4194304] 0 2024-09-21T12:46:55.989 INFO:tasks.workunit.client.1.smithi176.stdout:4/378: readlink d3/d5/db/l55 0 2024-09-21T12:46:55.990 INFO:tasks.workunit.client.1.smithi176.stdout:3/487: rename d1/d5/c47 to d1/d35/d5e/cc2 0 2024-09-21T12:46:55.993 INFO:tasks.workunit.client.1.smithi176.stdout:4/379: dread - d3/d42/d47/f6d zero size 2024-09-21T12:46:55.993 INFO:tasks.workunit.client.1.smithi176.stdout:2/390: getdents d4/df/d2e/d4d/d70 0 2024-09-21T12:46:55.994 INFO:tasks.workunit.client.1.smithi176.stdout:7/491: write d0/d2/db/d10/d31/d65/f47 [1578256,102137] 0 2024-09-21T12:46:55.996 INFO:tasks.workunit.client.1.smithi176.stdout:8/374: mkdir d6/db/d37/d7a 0 2024-09-21T12:46:55.996 INFO:tasks.workunit.client.1.smithi176.stdout:2/391: read - d4/df/d2e/d6f/d6d/f71 zero size 2024-09-21T12:46:55.998 INFO:tasks.workunit.client.1.smithi176.stdout:6/353: dwrite d2/dd/d26/d2b/f3b [4194304,4194304] 0 2024-09-21T12:46:55.999 INFO:tasks.workunit.client.1.smithi176.stdout:2/392: fdatasync d4/df/f48 0 2024-09-21T12:46:56.006 INFO:tasks.workunit.client.1.smithi176.stdout:7/492: stat d0/d2/db/d10/f2c 0 2024-09-21T12:46:56.009 INFO:tasks.workunit.client.1.smithi176.stdout:0/487: rename d9/d1a/d3f/l4e to d9/d1b/d63/d77/d88/la6 0 2024-09-21T12:46:56.010 INFO:tasks.workunit.client.1.smithi176.stdout:3/488: dwrite d1/d35/d5e/d90/f9c [0,4194304] 0 2024-09-21T12:46:56.012 INFO:tasks.workunit.client.1.smithi176.stdout:1/445: symlink d0/db/d1a/d2c/d48/d50/l9e 0 2024-09-21T12:46:56.013 INFO:tasks.workunit.client.1.smithi176.stdout:8/375: dwrite d6/d8/d24/d35/d51/f78 [0,4194304] 0 2024-09-21T12:46:56.015 INFO:tasks.workunit.client.1.smithi176.stdout:3/489: dread - d1/d34/d71/d91/f9d zero size 2024-09-21T12:46:56.015 INFO:tasks.workunit.client.1.smithi176.stdout:5/322: getdents d0 0 2024-09-21T12:46:56.016 INFO:tasks.workunit.client.1.smithi176.stdout:7/493: creat d0/d2/db/d10/d72/fab x:0 0 0 2024-09-21T12:46:56.019 INFO:tasks.workunit.client.1.smithi176.stdout:1/446: rmdir d0/db/d25/d41 39 2024-09-21T12:46:56.022 INFO:tasks.workunit.client.1.smithi176.stdout:3/490: mkdir d1/d5/d25/d61/dc3 0 2024-09-21T12:46:56.023 INFO:tasks.workunit.client.1.smithi176.stdout:2/393: dwrite d4/df/f2a [4194304,4194304] 0 2024-09-21T12:46:56.031 INFO:tasks.workunit.client.1.smithi176.stdout:0/488: link d9/d1b/d63/d77/d88/la6 d9/d35/la7 0 2024-09-21T12:46:56.034 INFO:tasks.workunit.client.1.smithi176.stdout:2/394: mknod d4/df/d2e/d6f/d5d/d67/c79 0 2024-09-21T12:46:56.035 INFO:tasks.workunit.client.1.smithi176.stdout:6/354: dread d2/dd/f11 [0,4194304] 0 2024-09-21T12:46:56.035 INFO:tasks.workunit.client.1.smithi176.stdout:5/323: truncate d0/d10/d11/d2e/d39/d3b/f3e 3355900 0 2024-09-21T12:46:56.035 INFO:tasks.workunit.client.1.smithi176.stdout:8/376: dwrite d6/d8/d24/d35/f61 [0,4194304] 0 2024-09-21T12:46:56.037 INFO:tasks.workunit.client.1.smithi176.stdout:0/489: creat d9/fa8 x:0 0 0 2024-09-21T12:46:56.037 INFO:tasks.workunit.client.1.smithi176.stdout:5/324: stat d0/d13/f48 0 2024-09-21T12:46:56.038 INFO:tasks.workunit.client.1.smithi176.stdout:3/491: dread d1/d5/d25/d38/f3f [0,4194304] 0 2024-09-21T12:46:56.039 INFO:tasks.workunit.client.1.smithi176.stdout:7/494: dwrite d0/d5d/d5e/f74 [0,4194304] 0 2024-09-21T12:46:56.040 INFO:tasks.workunit.client.1.smithi176.stdout:8/377: fsync d6/d16/f2d 0 2024-09-21T12:46:56.043 INFO:tasks.workunit.client.1.smithi176.stdout:7/495: chown d0/d5d/f81 81222175 1 2024-09-21T12:46:56.044 INFO:tasks.workunit.client.1.smithi176.stdout:6/355: unlink d2/d5d/f6a 0 2024-09-21T12:46:56.045 INFO:tasks.workunit.client.1.smithi176.stdout:3/492: rmdir d1/d5/d25/d61 39 2024-09-21T12:46:56.046 INFO:tasks.workunit.client.1.smithi176.stdout:0/490: symlink d9/d1a/d1d/la9 0 2024-09-21T12:46:56.046 INFO:tasks.workunit.client.1.smithi176.stdout:7/496: readlink d0/d2/db/d10/d31/d65/l64 0 2024-09-21T12:46:56.047 INFO:tasks.workunit.client.1.smithi176.stdout:6/356: write d2/dd/d26/f3d [1404871,85050] 0 2024-09-21T12:46:56.048 INFO:tasks.workunit.client.1.smithi176.stdout:3/493: write d1/d34/d5d/fbc [444396,69299] 0 2024-09-21T12:46:56.049 INFO:tasks.workunit.client.1.smithi176.stdout:7/497: write d0/f16 [7521,103215] 0 2024-09-21T12:46:56.049 INFO:tasks.workunit.client.1.smithi176.stdout:8/378: truncate d6/d8/d24/d35/d51/f6f 340422 0 2024-09-21T12:46:56.049 INFO:tasks.workunit.client.1.smithi176.stdout:3/494: stat d1/d9e 0 2024-09-21T12:46:56.051 INFO:tasks.workunit.client.1.smithi176.stdout:0/491: chown d9/d1b/d63/d77/d88/la6 9601551 1 2024-09-21T12:46:56.053 INFO:tasks.workunit.client.1.smithi176.stdout:6/357: symlink d2/dd/d26/d2b/d10/d1b/d37/l6d 0 2024-09-21T12:46:56.054 INFO:tasks.workunit.client.1.smithi176.stdout:3/495: fsync d1/d5/d25/d38/f79 0 2024-09-21T12:46:56.055 INFO:tasks.workunit.client.1.smithi176.stdout:7/498: rename d0/d2/db/c68 to d0/d2/db/d10/d23/d85/cac 0 2024-09-21T12:46:56.056 INFO:tasks.workunit.client.1.smithi176.stdout:9/382: sync 2024-09-21T12:46:56.057 INFO:tasks.workunit.client.1.smithi176.stdout:0/492: symlink d9/d1b/d63/d77/d88/laa 0 2024-09-21T12:46:56.057 INFO:tasks.workunit.client.1.smithi176.stdout:1/447: dread d0/db/d1a/f21 [0,4194304] 0 2024-09-21T12:46:56.060 INFO:tasks.workunit.client.1.smithi176.stdout:6/358: mknod d2/dd/d26/d2b/d10/c6e 0 2024-09-21T12:46:56.061 INFO:tasks.workunit.client.1.smithi176.stdout:9/383: dread d1/df/d23/f45 [0,4194304] 0 2024-09-21T12:46:56.063 INFO:tasks.workunit.client.1.smithi176.stdout:9/384: write d1/df/d1c/f7a [167696,51688] 0 2024-09-21T12:46:56.063 INFO:tasks.workunit.client.1.smithi176.stdout:6/359: write d2/dd/d26/d2b/d10/d39/f6c [497116,100575] 0 2024-09-21T12:46:56.064 INFO:tasks.workunit.client.1.smithi176.stdout:3/496: dwrite d1/f18 [0,4194304] 0 2024-09-21T12:46:56.065 INFO:tasks.workunit.client.1.smithi176.stdout:6/360: chown d2/dd/d26/d2b/l16 1088 1 2024-09-21T12:46:56.065 INFO:tasks.workunit.client.1.smithi176.stdout:9/385: chown d1/df/d48/d69/c65 1892 1 2024-09-21T12:46:56.066 INFO:tasks.workunit.client.1.smithi176.stdout:1/448: mknod d0/db/d25/d2b/d43/c9f 0 2024-09-21T12:46:56.066 INFO:tasks.workunit.client.1.smithi176.stdout:2/395: truncate d4/df/f2a 2045032 0 2024-09-21T12:46:56.067 INFO:tasks.workunit.client.1.smithi176.stdout:5/325: truncate d0/f18 655361 0 2024-09-21T12:46:56.068 INFO:tasks.workunit.client.1.smithi176.stdout:8/379: getdents d6/d8 0 2024-09-21T12:46:56.070 INFO:tasks.workunit.client.1.smithi176.stdout:7/499: link d0/d2/db/d10/d23/f8e d0/d2/db/d10/d23/d85/fad 0 2024-09-21T12:46:56.070 INFO:tasks.workunit.client.1.smithi176.stdout:8/380: dread - d6/d8/d24/d35/d51/f53 zero size 2024-09-21T12:46:56.072 INFO:tasks.workunit.client.1.smithi176.stdout:8/381: chown d6/d16/d36/d67/l6a 103145 1 2024-09-21T12:46:56.072 INFO:tasks.workunit.client.1.smithi176.stdout:5/326: symlink d0/d13/l5f 0 2024-09-21T12:46:56.073 INFO:tasks.workunit.client.1.smithi176.stdout:8/382: chown d6/d8/d24/d35/d51/f6f 144075 1 2024-09-21T12:46:56.073 INFO:tasks.workunit.client.1.smithi176.stdout:8/383: write d6/db/d37/f3a [351432,37598] 0 2024-09-21T12:46:56.074 INFO:tasks.workunit.client.1.smithi176.stdout:2/396: unlink d4/df/d2e/d6f/d5d/d67/c79 0 2024-09-21T12:46:56.078 INFO:tasks.workunit.client.1.smithi176.stdout:5/327: unlink d0/d10/d11/c35 0 2024-09-21T12:46:56.079 INFO:tasks.workunit.client.1.smithi176.stdout:8/384: rmdir d6/d8 39 2024-09-21T12:46:56.082 INFO:tasks.workunit.client.1.smithi176.stdout:6/361: rename d2/dd/d26/d2b/d5f to d2/d6f 0 2024-09-21T12:46:56.083 INFO:tasks.workunit.client.1.smithi176.stdout:9/386: rmdir d1/df/d48/d69/d76/d80 0 2024-09-21T12:46:56.084 INFO:tasks.workunit.client.1.smithi176.stdout:7/500: creat d0/d2/db/d10/d31/da0/fae x:0 0 0 2024-09-21T12:46:56.092 INFO:tasks.workunit.client.1.smithi176.stdout:1/449: rename d0/db/d1a/f36 to d0/db/d1a/d2c/d84/fa0 0 2024-09-21T12:46:56.092 INFO:tasks.workunit.client.1.smithi176.stdout:8/385: rmdir d6/d8/d24/d35/d51 39 2024-09-21T12:46:56.094 INFO:tasks.workunit.client.1.smithi176.stdout:8/386: write d6/d16/d36/d67/f6d [204834,108535] 0 2024-09-21T12:46:56.095 INFO:tasks.workunit.client.1.smithi176.stdout:6/362: dwrite d2/dd/d26/d2b/d10/d39/f6c [0,4194304] 0 2024-09-21T12:46:56.096 INFO:tasks.workunit.client.1.smithi176.stdout:9/387: rename d1/df/c13 to d1/df/d1c/c87 0 2024-09-21T12:46:56.097 INFO:tasks.workunit.client.1.smithi176.stdout:8/387: mknod d6/d8/d24/c7b 0 2024-09-21T12:46:56.099 INFO:tasks.workunit.client.1.smithi176.stdout:6/363: truncate d2/dd/d26/d2b/d10/d1b/d37/f4b 1551631 0 2024-09-21T12:46:56.101 INFO:tasks.workunit.client.1.smithi176.stdout:9/388: mkdir d1/df/d48/d69/d38/d88 0 2024-09-21T12:46:56.102 INFO:tasks.workunit.client.1.smithi176.stdout:2/397: dwrite d4/df/d2e/d6f/f2c [0,4194304] 0 2024-09-21T12:46:56.102 INFO:tasks.workunit.client.1.smithi176.stdout:8/388: mknod d6/d16/d36/d67/c7c 0 2024-09-21T12:46:56.103 INFO:tasks.workunit.client.1.smithi176.stdout:2/398: stat d4/df/l4a 0 2024-09-21T12:46:56.106 INFO:tasks.workunit.client.1.smithi176.stdout:9/389: creat d1/df/d48/f89 x:0 0 0 2024-09-21T12:46:56.109 INFO:tasks.workunit.client.1.smithi176.stdout:2/399: creat d4/df/d2e/f7a x:0 0 0 2024-09-21T12:46:56.110 INFO:tasks.workunit.client.1.smithi176.stdout:6/364: link d2/dd/d26/d2b/l28 d2/dd/l70 0 2024-09-21T12:46:56.110 INFO:tasks.workunit.client.1.smithi176.stdout:8/389: dwrite d6/f5b [4194304,4194304] 0 2024-09-21T12:46:56.111 INFO:tasks.workunit.client.1.smithi176.stdout:9/390: symlink d1/df/d48/d69/l8a 0 2024-09-21T12:46:56.112 INFO:tasks.workunit.client.1.smithi176.stdout:2/400: symlink d4/d3d/l7b 0 2024-09-21T12:46:56.115 INFO:tasks.workunit.client.1.smithi176.stdout:9/391: fsync d1/df/d48/d69/f3d 0 2024-09-21T12:46:56.116 INFO:tasks.workunit.client.1.smithi176.stdout:2/401: write d4/df/d2e/d6f/d6d/f71 [399625,71397] 0 2024-09-21T12:46:56.120 INFO:tasks.workunit.client.1.smithi176.stdout:2/402: fdatasync d4/df/d2e/d39/d55/f6e 0 2024-09-21T12:46:56.121 INFO:tasks.workunit.client.1.smithi176.stdout:8/390: dwrite d6/db/d37/f3a [0,4194304] 0 2024-09-21T12:46:56.123 INFO:tasks.workunit.client.1.smithi176.stdout:6/365: dwrite d2/f64 [0,4194304] 0 2024-09-21T12:46:56.124 INFO:tasks.workunit.client.1.smithi176.stdout:2/403: symlink d4/df/d2e/d6f/l7c 0 2024-09-21T12:46:56.126 INFO:tasks.workunit.client.1.smithi176.stdout:8/391: mkdir d6/d16/d36/d7d 0 2024-09-21T12:46:56.127 INFO:tasks.workunit.client.1.smithi176.stdout:6/366: stat d2/d63/f51 0 2024-09-21T12:46:56.129 INFO:tasks.workunit.client.1.smithi176.stdout:6/367: fsync d2/dd/d26/d2b/f3b 0 2024-09-21T12:46:56.130 INFO:tasks.workunit.client.1.smithi176.stdout:2/404: fsync d4/df/f48 0 2024-09-21T12:46:56.133 INFO:tasks.workunit.client.1.smithi176.stdout:2/405: write d4/df/f6b [206151,76556] 0 2024-09-21T12:46:56.134 INFO:tasks.workunit.client.1.smithi176.stdout:6/368: mknod d2/dd/c71 0 2024-09-21T12:46:56.137 INFO:tasks.workunit.client.1.smithi176.stdout:2/406: symlink d4/df/d2e/d4d/d70/l7d 0 2024-09-21T12:46:56.138 INFO:tasks.workunit.client.1.smithi176.stdout:8/392: dwrite d6/f1a [0,4194304] 0 2024-09-21T12:46:56.142 INFO:tasks.workunit.client.1.smithi176.stdout:9/392: dread d1/f2a [0,4194304] 0 2024-09-21T12:46:56.143 INFO:tasks.workunit.client.1.smithi176.stdout:2/407: truncate d4/df/f1c 1766281 0 2024-09-21T12:46:56.145 INFO:tasks.workunit.client.1.smithi176.stdout:2/408: fsync d4/df/f21 0 2024-09-21T12:46:56.145 INFO:tasks.workunit.client.1.smithi176.stdout:6/369: dread d2/dd/d26/d2b/d10/d39/f46 [0,4194304] 0 2024-09-21T12:46:56.147 INFO:tasks.workunit.client.1.smithi176.stdout:9/393: mkdir d1/d8b 0 2024-09-21T12:46:56.147 INFO:tasks.workunit.client.1.smithi176.stdout:2/409: fsync d4/d3a/f45 0 2024-09-21T12:46:56.148 INFO:tasks.workunit.client.1.smithi176.stdout:9/394: chown d1/df/d23 264 1 2024-09-21T12:46:56.150 INFO:tasks.workunit.client.1.smithi176.stdout:8/393: dwrite d6/d8/d24/d35/d51/f6f [0,4194304] 0 2024-09-21T12:46:56.157 INFO:tasks.workunit.client.1.smithi176.stdout:8/394: rename d6/d8/f77 to d6/db/d37/d7a/f7e 0 2024-09-21T12:46:56.158 INFO:tasks.workunit.client.1.smithi176.stdout:2/410: truncate d4/df/d2e/d6f/f2c 3391104 0 2024-09-21T12:46:56.160 INFO:tasks.workunit.client.1.smithi176.stdout:2/411: symlink d4/d63/l7e 0 2024-09-21T12:46:56.161 INFO:tasks.workunit.client.1.smithi176.stdout:2/412: stat d4/df/l25 0 2024-09-21T12:46:56.161 INFO:tasks.workunit.client.1.smithi176.stdout:6/370: dwrite d2/dd/d26/f38 [0,4194304] 0 2024-09-21T12:46:56.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:56 smithi046 ceph-mon[27868]: pgmap v24: 65 pgs: 65 active+clean; 946 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 111 MiB/s wr, 366 op/s 2024-09-21T12:46:56.165 INFO:tasks.workunit.client.1.smithi176.stdout:4/380: sync 2024-09-21T12:46:56.167 INFO:tasks.workunit.client.1.smithi176.stdout:6/371: getdents d2/d6f 0 2024-09-21T12:46:56.168 INFO:tasks.workunit.client.1.smithi176.stdout:6/372: write d2/dd/d26/d2b/d10/d1b/f2a [1257158,36615] 0 2024-09-21T12:46:56.169 INFO:tasks.workunit.client.1.smithi176.stdout:4/381: creat d3/d5/f80 x:0 0 0 2024-09-21T12:46:56.174 INFO:tasks.workunit.client.1.smithi176.stdout:8/395: dwrite d6/d8/d24/d35/f4f [0,4194304] 0 2024-09-21T12:46:56.177 INFO:tasks.workunit.client.1.smithi176.stdout:8/396: chown d6/d16/d36/d67/f70 3992 1 2024-09-21T12:46:56.177 INFO:tasks.workunit.client.1.smithi176.stdout:6/373: dwrite d2/dd/d26/d2b/d5a/f60 [0,4194304] 0 2024-09-21T12:46:56.181 INFO:tasks.workunit.client.1.smithi176.stdout:6/374: read d2/dd/f11 [2671739,54706] 0 2024-09-21T12:46:56.181 INFO:tasks.workunit.client.1.smithi176.stdout:4/382: rmdir d3/d5/db/d36 39 2024-09-21T12:46:56.183 INFO:tasks.workunit.client.1.smithi176.stdout:6/375: write d2/dd/d26/d2b/d10/d39/f6c [792735,33450] 0 2024-09-21T12:46:56.186 INFO:tasks.workunit.client.1.smithi176.stdout:4/383: rename d3/d21/l46 to d3/d42/d47/l81 0 2024-09-21T12:46:56.191 INFO:tasks.workunit.client.1.smithi176.stdout:2/413: dread d4/df/f48 [0,4194304] 0 2024-09-21T12:46:56.191 INFO:tasks.workunit.client.1.smithi176.stdout:6/376: rename d2/dd/d26/d2b/l30 to d2/dd/d26/d2b/d10/d1b/d37/l72 0 2024-09-21T12:46:56.192 INFO:tasks.workunit.client.1.smithi176.stdout:4/384: symlink d3/d5/l82 0 2024-09-21T12:46:56.193 INFO:tasks.workunit.client.1.smithi176.stdout:6/377: creat d2/dd/d26/d2b/d10/d39/f73 x:0 0 0 2024-09-21T12:46:56.194 INFO:tasks.workunit.client.1.smithi176.stdout:2/414: creat d4/f7f x:0 0 0 2024-09-21T12:46:56.195 INFO:tasks.workunit.client.1.smithi176.stdout:4/385: mknod d3/d42/d56/c83 0 2024-09-21T12:46:56.195 INFO:tasks.workunit.client.1.smithi176.stdout:2/415: write d4/f19 [656528,40478] 0 2024-09-21T12:46:56.200 INFO:tasks.workunit.client.1.smithi176.stdout:6/378: rename d2/l5e to d2/dd/d26/d2b/d5a/l74 0 2024-09-21T12:46:56.201 INFO:tasks.workunit.client.1.smithi176.stdout:6/379: write d2/d63/f53 [1839858,62830] 0 2024-09-21T12:46:56.203 INFO:tasks.workunit.client.1.smithi176.stdout:2/416: dwrite d4/f7f [0,4194304] 0 2024-09-21T12:46:56.204 INFO:tasks.workunit.client.1.smithi176.stdout:2/417: fdatasync d4/df/f21 0 2024-09-21T12:46:56.205 INFO:tasks.workunit.client.1.smithi176.stdout:8/397: dread d6/db/d32/f40 [0,4194304] 0 2024-09-21T12:46:56.207 INFO:tasks.workunit.client.1.smithi176.stdout:8/398: read d6/d8/d24/d35/f4a [134980,71075] 0 2024-09-21T12:46:56.208 INFO:tasks.workunit.client.1.smithi176.stdout:6/380: getdents d2/dd/d26/d2b/d10/d39 0 2024-09-21T12:46:56.209 INFO:tasks.workunit.client.1.smithi176.stdout:2/418: mkdir d4/d62/d80 0 2024-09-21T12:46:56.211 INFO:tasks.workunit.client.1.smithi176.stdout:8/399: rename d6/d16/f4b to d6/d16/f7f 0 2024-09-21T12:46:56.212 INFO:tasks.workunit.client.1.smithi176.stdout:4/386: dread d3/d21/d27/d2c/f41 [0,4194304] 0 2024-09-21T12:46:56.213 INFO:tasks.workunit.client.1.smithi176.stdout:8/400: write d6/f5b [2693541,92875] 0 2024-09-21T12:46:56.213 INFO:tasks.workunit.client.1.smithi176.stdout:2/419: rmdir d4/d62 39 2024-09-21T12:46:56.216 INFO:tasks.workunit.client.1.smithi176.stdout:4/387: chown d3/d5/f15 9177856 1 2024-09-21T12:46:56.216 INFO:tasks.workunit.client.1.smithi176.stdout:2/420: rmdir d4/df/d2e 39 2024-09-21T12:46:56.218 INFO:tasks.workunit.client.1.smithi176.stdout:8/401: dread d6/d8/d24/d35/d51/f78 [0,4194304] 0 2024-09-21T12:46:56.222 INFO:tasks.workunit.client.1.smithi176.stdout:8/402: mknod d6/d8/d24/d35/d51/c80 0 2024-09-21T12:46:56.223 INFO:tasks.workunit.client.1.smithi176.stdout:2/421: mkdir d4/df/d2e/d6f/d5d/d81 0 2024-09-21T12:46:56.224 INFO:tasks.workunit.client.1.smithi176.stdout:2/422: dread - d4/df/d2e/d6f/d6d/f74 zero size 2024-09-21T12:46:56.225 INFO:tasks.workunit.client.1.smithi176.stdout:6/381: truncate d2/dd/d26/d2b/d10/d1b/d37/f3c 1502603 0 2024-09-21T12:46:56.226 INFO:tasks.workunit.client.1.smithi176.stdout:2/423: unlink d4/df/l4a 0 2024-09-21T12:46:56.228 INFO:tasks.workunit.client.1.smithi176.stdout:6/382: truncate d2/dd/d26/d2b/d10/f12 454855 0 2024-09-21T12:46:56.242 INFO:tasks.workunit.client.1.smithi176.stdout:0/493: sync 2024-09-21T12:46:56.254 INFO:tasks.workunit.client.1.smithi176.stdout:6/383: mkdir d2/d63/d75 0 2024-09-21T12:46:56.255 INFO:tasks.workunit.client.1.smithi176.stdout:4/388: dread d3/f3c [0,4194304] 0 2024-09-21T12:46:56.257 INFO:tasks.workunit.client.1.smithi176.stdout:2/424: dwrite d4/d3a/f5c [0,4194304] 0 2024-09-21T12:46:56.258 INFO:tasks.workunit.client.1.smithi176.stdout:2/425: stat d4 0 2024-09-21T12:46:56.259 INFO:tasks.workunit.client.1.smithi176.stdout:4/389: mknod d3/d42/d47/c84 0 2024-09-21T12:46:56.262 INFO:tasks.workunit.client.1.smithi176.stdout:4/390: chown d3/d5/f80 40693 1 2024-09-21T12:46:56.264 INFO:tasks.workunit.client.1.smithi176.stdout:0/494: dwrite d9/f27 [4194304,4194304] 0 2024-09-21T12:46:56.267 INFO:tasks.workunit.client.1.smithi176.stdout:4/391: write d3/d42/f69 [575565,85017] 0 2024-09-21T12:46:56.267 INFO:tasks.workunit.client.1.smithi176.stdout:0/495: chown l4 3412 1 2024-09-21T12:46:56.268 INFO:tasks.workunit.client.1.smithi176.stdout:6/384: dwrite d2/dd/d26/d2b/d10/d1b/d37/f4b [0,4194304] 0 2024-09-21T12:46:56.272 INFO:tasks.workunit.client.1.smithi176.stdout:2/426: dwrite d4/f7f [4194304,4194304] 0 2024-09-21T12:46:56.276 INFO:tasks.workunit.client.1.smithi176.stdout:0/496: readlink d9/d1a/d1d/d23/l55 0 2024-09-21T12:46:56.277 INFO:tasks.workunit.client.1.smithi176.stdout:2/427: stat d4/df/d2e/d39 0 2024-09-21T12:46:56.277 INFO:tasks.workunit.client.1.smithi176.stdout:6/385: mkdir d2/d6f/d76 0 2024-09-21T12:46:56.279 INFO:tasks.workunit.client.1.smithi176.stdout:2/428: chown d4/df/d2e/d39/d55 21 1 2024-09-21T12:46:56.280 INFO:tasks.workunit.client.1.smithi176.stdout:0/497: mknod d9/d1a/d1d/d23/da1/da3/cab 0 2024-09-21T12:46:56.281 INFO:tasks.workunit.client.1.smithi176.stdout:4/392: dwrite d3/d42/d47/f6d [0,4194304] 0 2024-09-21T12:46:56.282 INFO:tasks.workunit.client.1.smithi176.stdout:4/393: chown d3/d21/d5e 52104 1 2024-09-21T12:46:56.284 INFO:tasks.workunit.client.1.smithi176.stdout:0/498: mknod d9/d1a/d1d/d81/cac 0 2024-09-21T12:46:56.286 INFO:tasks.workunit.client.1.smithi176.stdout:6/386: getdents d2/d63 0 2024-09-21T12:46:56.286 INFO:tasks.workunit.client.1.smithi176.stdout:4/394: symlink d3/d21/d5e/l85 0 2024-09-21T12:46:56.293 INFO:tasks.workunit.client.1.smithi176.stdout:6/387: rename d2/dd/d26/l35 to d2/dd/l77 0 2024-09-21T12:46:56.293 INFO:tasks.workunit.client.1.smithi176.stdout:4/395: dwrite d3/d42/d47/f6d [4194304,4194304] 0 2024-09-21T12:46:56.297 INFO:tasks.workunit.client.1.smithi176.stdout:6/388: rmdir d2/dd/d26/d2b 39 2024-09-21T12:46:56.297 INFO:tasks.workunit.client.1.smithi176.stdout:4/396: read d3/d5/f4a [4300208,16567] 0 2024-09-21T12:46:56.300 INFO:tasks.workunit.client.1.smithi176.stdout:6/389: creat d2/d6f/f78 x:0 0 0 2024-09-21T12:46:56.301 INFO:tasks.workunit.client.1.smithi176.stdout:2/429: truncate d4/df/d2e/d6f/f59 1809927 0 2024-09-21T12:46:56.303 INFO:tasks.workunit.client.1.smithi176.stdout:4/397: dread d3/d42/d47/f6d [0,4194304] 0 2024-09-21T12:46:56.304 INFO:tasks.workunit.client.1.smithi176.stdout:0/499: dread d9/f2b [0,4194304] 0 2024-09-21T12:46:56.304 INFO:tasks.workunit.client.1.smithi176.stdout:6/390: mkdir d2/dd/d79 0 2024-09-21T12:46:56.307 INFO:tasks.workunit.client.1.smithi176.stdout:2/430: creat d4/d62/f82 x:0 0 0 2024-09-21T12:46:56.309 INFO:tasks.workunit.client.1.smithi176.stdout:5/328: sync 2024-09-21T12:46:56.309 INFO:tasks.workunit.client.1.smithi176.stdout:1/450: sync 2024-09-21T12:46:56.309 INFO:tasks.workunit.client.1.smithi176.stdout:9/395: sync 2024-09-21T12:46:56.309 INFO:tasks.workunit.client.1.smithi176.stdout:7/501: sync 2024-09-21T12:46:56.309 INFO:tasks.workunit.client.1.smithi176.stdout:3/497: sync 2024-09-21T12:46:56.309 INFO:tasks.workunit.client.1.smithi176.stdout:4/398: dwrite d3/d21/f2a [0,4194304] 0 2024-09-21T12:46:56.310 INFO:tasks.workunit.client.1.smithi176.stdout:0/500: creat d9/d1b/d63/d75/fad x:0 0 0 2024-09-21T12:46:56.310 INFO:tasks.workunit.client.1.smithi176.stdout:6/391: read d2/dd/d26/d2b/f14 [2334917,54546] 0 2024-09-21T12:46:56.312 INFO:tasks.workunit.client.1.smithi176.stdout:1/451: write d0/f3c [3834806,7429] 0 2024-09-21T12:46:56.313 INFO:tasks.workunit.client.1.smithi176.stdout:3/498: write d1/d34/d71/f73 [546851,128197] 0 2024-09-21T12:46:56.315 INFO:tasks.workunit.client.1.smithi176.stdout:3/499: truncate d1/d3e/f41 448480 0 2024-09-21T12:46:56.317 INFO:tasks.workunit.client.1.smithi176.stdout:7/502: rmdir d0/d2/db/d10 39 2024-09-21T12:46:56.318 INFO:tasks.workunit.client.1.smithi176.stdout:4/399: dread d3/d21/d27/f40 [0,4194304] 0 2024-09-21T12:46:56.318 INFO:tasks.workunit.client.1.smithi176.stdout:6/392: creat d2/dd/f7a x:0 0 0 2024-09-21T12:46:56.320 INFO:tasks.workunit.client.1.smithi176.stdout:2/431: mkdir d4/df/d83 0 2024-09-21T12:46:56.321 INFO:tasks.workunit.client.1.smithi176.stdout:2/432: dread - d4/f64 zero size 2024-09-21T12:46:56.321 INFO:tasks.workunit.client.1.smithi176.stdout:2/433: stat d4/df/d2e/d6f/d5d/d67 0 2024-09-21T12:46:56.322 INFO:tasks.workunit.client.1.smithi176.stdout:3/500: rmdir d1/d35/d5e/d90 39 2024-09-21T12:46:56.323 INFO:tasks.workunit.client.1.smithi176.stdout:3/501: write d1/d3e/fbe [63532,54955] 0 2024-09-21T12:46:56.324 INFO:tasks.workunit.client.1.smithi176.stdout:7/503: creat d0/d2/d30/d7b/faf x:0 0 0 2024-09-21T12:46:56.326 INFO:tasks.workunit.client.1.smithi176.stdout:9/396: rename d1/f5 to d1/df/d1c/f8c 0 2024-09-21T12:46:56.327 INFO:tasks.workunit.client.1.smithi176.stdout:0/501: creat d9/d1b/d43/d98/fae x:0 0 0 2024-09-21T12:46:56.333 INFO:tasks.workunit.client.1.smithi176.stdout:9/397: chown d1/f7 174623 1 2024-09-21T12:46:56.334 INFO:tasks.workunit.client.1.smithi176.stdout:4/400: dwrite d3/d21/d27/d2c/f41 [0,4194304] 0 2024-09-21T12:46:56.335 INFO:tasks.workunit.client.1.smithi176.stdout:5/329: rename d0/d10/d11/d2e/d37/f3f to d0/d10/d11/d2e/d39/d41/f60 0 2024-09-21T12:46:56.335 INFO:tasks.workunit.client.1.smithi176.stdout:0/502: rmdir d9/d1a/d1d/d81/d8e 39 2024-09-21T12:46:56.337 INFO:tasks.workunit.client.1.smithi176.stdout:5/330: write d0/d13/f26 [2635383,58496] 0 2024-09-21T12:46:56.337 INFO:tasks.workunit.client.1.smithi176.stdout:6/393: stat d2/d5d/l65 0 2024-09-21T12:46:56.339 INFO:tasks.workunit.client.1.smithi176.stdout:0/503: readlink d9/d1b/d63/d77/d88/la6 0 2024-09-21T12:46:56.340 INFO:tasks.workunit.client.1.smithi176.stdout:3/502: creat d1/d5/d25/d61/fc4 x:0 0 0 2024-09-21T12:46:56.340 INFO:tasks.workunit.client.1.smithi176.stdout:7/504: mknod d0/d2/db/d10/d23/d85/cb0 0 2024-09-21T12:46:56.342 INFO:tasks.workunit.client.1.smithi176.stdout:0/504: write d9/d1b/d63/d75/fad [673578,69301] 0 2024-09-21T12:46:56.343 INFO:tasks.workunit.client.1.smithi176.stdout:3/503: read - d1/da/fb2 zero size 2024-09-21T12:46:56.344 INFO:tasks.workunit.client.1.smithi176.stdout:7/505: chown d0/d2/db/f6a 516911 1 2024-09-21T12:46:56.346 INFO:tasks.workunit.client.1.smithi176.stdout:3/504: fdatasync d1/d34/d42/d5b/fc0 0 2024-09-21T12:46:56.346 INFO:tasks.workunit.client.1.smithi176.stdout:6/394: getdents d2/d6f/d76 0 2024-09-21T12:46:56.351 INFO:tasks.workunit.client.1.smithi176.stdout:0/505: creat d9/d1b/d63/d77/d88/faf x:0 0 0 2024-09-21T12:46:56.353 INFO:tasks.workunit.client.1.smithi176.stdout:4/401: dwrite d3/d21/d27/d2c/f4b [0,4194304] 0 2024-09-21T12:46:56.354 INFO:tasks.workunit.client.1.smithi176.stdout:3/505: mkdir d1/d34/d71/dc5 0 2024-09-21T12:46:56.355 INFO:tasks.workunit.client.1.smithi176.stdout:6/395: chown d2/dd/d26/d2b/d10/c6e 3459011 1 2024-09-21T12:46:56.355 INFO:tasks.workunit.client.1.smithi176.stdout:7/506: symlink d0/d2/db/lb1 0 2024-09-21T12:46:56.356 INFO:tasks.workunit.client.1.smithi176.stdout:9/398: dread d1/df/f39 [0,4194304] 0 2024-09-21T12:46:56.356 INFO:tasks.workunit.client.1.smithi176.stdout:0/506: mkdir d9/d1a/d1d/d23/da1/db0 0 2024-09-21T12:46:56.357 INFO:tasks.workunit.client.1.smithi176.stdout:3/506: write d1/d3e/fbe [798317,5750] 0 2024-09-21T12:46:56.358 INFO:tasks.workunit.client.1.smithi176.stdout:4/402: rmdir d3/d21 39 2024-09-21T12:46:56.361 INFO:tasks.workunit.client.1.smithi176.stdout:3/507: read - d1/d5/d25/d5c/f9f zero size 2024-09-21T12:46:56.361 INFO:tasks.workunit.client.1.smithi176.stdout:5/331: dread d0/f18 [0,4194304] 0 2024-09-21T12:46:56.364 INFO:tasks.workunit.client.1.smithi176.stdout:9/399: creat d1/d61/d73/d7d/f8d x:0 0 0 2024-09-21T12:46:56.364 INFO:tasks.workunit.client.1.smithi176.stdout:3/508: chown d1/d3e/fbe 6 1 2024-09-21T12:46:56.364 INFO:tasks.workunit.client.1.smithi176.stdout:1/452: dwrite d0/db/d1a/d2c/d48/d50/f64 [0,4194304] 0 2024-09-21T12:46:56.367 INFO:tasks.workunit.client.1.smithi176.stdout:9/400: chown d1/df/d23/c52 20267598 1 2024-09-21T12:46:56.368 INFO:tasks.workunit.client.1.smithi176.stdout:3/509: chown d1/d34/cb0 59998344 1 2024-09-21T12:46:56.368 INFO:tasks.workunit.client.1.smithi176.stdout:9/401: chown d1/d61/d73/d7d 1 1 2024-09-21T12:46:56.368 INFO:tasks.workunit.client.1.smithi176.stdout:0/507: link l1 d9/d1a/d1d/d23/da1/d99/lb1 0 2024-09-21T12:46:56.371 INFO:tasks.workunit.client.1.smithi176.stdout:9/402: read d1/df/d1c/f49 [2956846,114101] 0 2024-09-21T12:46:56.371 INFO:tasks.workunit.client.1.smithi176.stdout:7/507: getdents d0/d2/db 0 2024-09-21T12:46:56.373 INFO:tasks.workunit.client.1.smithi176.stdout:3/510: mkdir d1/d5/d25/d76/dc6 0 2024-09-21T12:46:56.375 INFO:tasks.workunit.client.1.smithi176.stdout:3/511: truncate d1/d5/f7b 942783 0 2024-09-21T12:46:56.376 INFO:tasks.workunit.client.1.smithi176.stdout:3/512: write d1/d5/d25/d5c/f9f [505213,15924] 0 2024-09-21T12:46:56.378 INFO:tasks.workunit.client.1.smithi176.stdout:7/508: mknod d0/d2/d30/d93/d96/d89/cb2 0 2024-09-21T12:46:56.378 INFO:tasks.workunit.client.1.smithi176.stdout:1/453: link d0/db/d1a/d2c/d66/c88 d0/db/d6a/ca1 0 2024-09-21T12:46:56.380 INFO:tasks.workunit.client.1.smithi176.stdout:3/513: write d1/d9e/fb6 [3929622,10978] 0 2024-09-21T12:46:56.380 INFO:tasks.workunit.client.1.smithi176.stdout:4/403: dread d3/d5/db/f20 [0,4194304] 0 2024-09-21T12:46:56.383 INFO:tasks.workunit.client.1.smithi176.stdout:5/332: truncate d0/d13/f26 1998668 0 2024-09-21T12:46:56.383 INFO:tasks.workunit.client.1.smithi176.stdout:1/454: truncate d0/db/d1a/f8a 404583 0 2024-09-21T12:46:56.383 INFO:tasks.workunit.client.1.smithi176.stdout:7/509: symlink d0/d5d/d7a/lb3 0 2024-09-21T12:46:56.384 INFO:tasks.workunit.client.1.smithi176.stdout:9/403: dwrite d1/fd [4194304,4194304] 0 2024-09-21T12:46:56.384 INFO:tasks.workunit.client.1.smithi176.stdout:3/514: mkdir d1/d34/d57/dc7 0 2024-09-21T12:46:56.385 INFO:tasks.workunit.client.1.smithi176.stdout:4/404: truncate d3/d42/d47/f7a 371130 0 2024-09-21T12:46:56.387 INFO:tasks.workunit.client.1.smithi176.stdout:3/515: write d1/d35/f32 [2259317,65639] 0 2024-09-21T12:46:56.389 INFO:tasks.workunit.client.1.smithi176.stdout:8/403: sync 2024-09-21T12:46:56.392 INFO:tasks.workunit.client.1.smithi176.stdout:1/455: dread - d0/db/d1a/d2c/d37/f56 zero size 2024-09-21T12:46:56.393 INFO:tasks.workunit.client.1.smithi176.stdout:9/404: mknod d1/df/d23/d67/c8e 0 2024-09-21T12:46:56.395 INFO:tasks.workunit.client.1.smithi176.stdout:3/516: creat d1/d5/d25/d84/fc8 x:0 0 0 2024-09-21T12:46:56.396 INFO:tasks.workunit.client.1.smithi176.stdout:5/333: dwrite d0/d10/d11/f51 [0,4194304] 0 2024-09-21T12:46:56.396 INFO:tasks.workunit.client.1.smithi176.stdout:7/510: dwrite d0/d2f/d43/f52 [0,4194304] 0 2024-09-21T12:46:56.399 INFO:tasks.workunit.client.1.smithi176.stdout:8/404: mkdir d6/d16/d36/d7d/d81 0 2024-09-21T12:46:56.399 INFO:tasks.workunit.client.1.smithi176.stdout:4/405: rename d3/l51 to d3/d5/db/l86 0 2024-09-21T12:46:56.400 INFO:tasks.workunit.client.1.smithi176.stdout:8/405: stat d6/f1a 0 2024-09-21T12:46:56.401 INFO:tasks.workunit.client.1.smithi176.stdout:1/456: symlink d0/db/d1a/d2c/la2 0 2024-09-21T12:46:56.406 INFO:tasks.workunit.client.1.smithi176.stdout:8/406: stat d6/db/f43 0 2024-09-21T12:46:56.406 INFO:tasks.workunit.client.1.smithi176.stdout:3/517: rmdir d1/d35/d5e 39 2024-09-21T12:46:56.406 INFO:tasks.workunit.client.1.smithi176.stdout:5/334: symlink d0/d13/d5d/l61 0 2024-09-21T12:46:56.406 INFO:tasks.workunit.client.1.smithi176.stdout:8/407: creat d6/d8/d24/f82 x:0 0 0 2024-09-21T12:46:56.407 INFO:tasks.workunit.client.1.smithi176.stdout:9/405: getdents d1/d61/d73 0 2024-09-21T12:46:56.408 INFO:tasks.workunit.client.1.smithi176.stdout:7/511: dread d0/d2/db/d10/d72/d51/f6e [0,4194304] 0 2024-09-21T12:46:56.408 INFO:tasks.workunit.client.1.smithi176.stdout:3/518: creat d1/d35/fc9 x:0 0 0 2024-09-21T12:46:56.410 INFO:tasks.workunit.client.1.smithi176.stdout:8/408: creat d6/d16/d79/f83 x:0 0 0 2024-09-21T12:46:56.411 INFO:tasks.workunit.client.1.smithi176.stdout:5/335: symlink d0/d10/d11/d2e/l62 0 2024-09-21T12:46:56.413 INFO:tasks.workunit.client.1.smithi176.stdout:1/457: dread d0/db/d1a/f38 [0,4194304] 0 2024-09-21T12:46:56.414 INFO:tasks.workunit.client.1.smithi176.stdout:8/409: symlink d6/db/d32/l84 0 2024-09-21T12:46:56.415 INFO:tasks.workunit.client.1.smithi176.stdout:7/512: dread d0/d2/db/fa4 [0,4194304] 0 2024-09-21T12:46:56.417 INFO:tasks.workunit.client.1.smithi176.stdout:7/513: chown d0/d2/db/d10/d31/d65/f4a 92477229 1 2024-09-21T12:46:56.418 INFO:tasks.workunit.client.1.smithi176.stdout:9/406: link d1/d61/d73/d7d/l57 d1/df/d48/d69/d40/d84/l8f 0 2024-09-21T12:46:56.419 INFO:tasks.workunit.client.1.smithi176.stdout:7/514: read - d0/d2/db/d10/d31/d65/f4a zero size 2024-09-21T12:46:56.419 INFO:tasks.workunit.client.1.smithi176.stdout:1/458: creat d0/db/d25/d41/d59/d99/fa3 x:0 0 0 2024-09-21T12:46:56.421 INFO:tasks.workunit.client.1.smithi176.stdout:9/407: mknod d1/df/d1c/c90 0 2024-09-21T12:46:56.422 INFO:tasks.workunit.client.1.smithi176.stdout:7/515: dread - d0/d2f/d43/f6b zero size 2024-09-21T12:46:56.423 INFO:tasks.workunit.client.1.smithi176.stdout:8/410: dwrite d6/db/d13/f31 [0,4194304] 0 2024-09-21T12:46:56.423 INFO:tasks.workunit.client.1.smithi176.stdout:1/459: mknod d0/d91/ca4 0 2024-09-21T12:46:56.425 INFO:tasks.workunit.client.1.smithi176.stdout:3/519: write d1/d5/d25/d38/f79 [697976,26419] 0 2024-09-21T12:46:56.428 INFO:tasks.workunit.client.1.smithi176.stdout:1/460: unlink d0/db/d25/d2b/d43/f8c 0 2024-09-21T12:46:56.430 INFO:tasks.workunit.client.1.smithi176.stdout:9/408: rename d1/d63/f78 to d1/df/d48/d69/d38/f91 0 2024-09-21T12:46:56.431 INFO:tasks.workunit.client.1.smithi176.stdout:9/409: fdatasync d1/df/d48/f55 0 2024-09-21T12:46:56.431 INFO:tasks.workunit.client.1.smithi176.stdout:5/336: dread d0/d10/d11/d2e/d39/d3b/f3e [0,4194304] 0 2024-09-21T12:46:56.432 INFO:tasks.workunit.client.1.smithi176.stdout:3/520: dread d1/d5/d25/d61/fa5 [0,4194304] 0 2024-09-21T12:46:56.432 INFO:tasks.workunit.client.1.smithi176.stdout:7/516: creat d0/fb4 x:0 0 0 2024-09-21T12:46:56.433 INFO:tasks.workunit.client.1.smithi176.stdout:5/337: chown d0/d10/d11/d2e/d39/d41/f4f 47214 1 2024-09-21T12:46:56.434 INFO:tasks.workunit.client.1.smithi176.stdout:1/461: mknod d0/db/d1a/d2c/d66/ca5 0 2024-09-21T12:46:56.436 INFO:tasks.workunit.client.1.smithi176.stdout:5/338: read d0/d13/f50 [3067541,5110] 0 2024-09-21T12:46:56.436 INFO:tasks.workunit.client.1.smithi176.stdout:1/462: truncate d0/db/d1a/d2c/d66/f6e 520830 0 2024-09-21T12:46:56.438 INFO:tasks.workunit.client.1.smithi176.stdout:1/463: chown d0/db/d25/d2b/d43/d92 19932 1 2024-09-21T12:46:56.438 INFO:tasks.workunit.client.1.smithi176.stdout:9/410: creat d1/df/d48/d69/d38/f92 x:0 0 0 2024-09-21T12:46:56.439 INFO:tasks.workunit.client.1.smithi176.stdout:7/517: dwrite d0/d2f/d43/f76 [0,4194304] 0 2024-09-21T12:46:56.439 INFO:tasks.workunit.client.1.smithi176.stdout:9/411: read d1/df/f39 [1488152,5027] 0 2024-09-21T12:46:56.443 INFO:tasks.workunit.client.1.smithi176.stdout:5/339: rename d0/d10/d11 to d0/d13/d63 0 2024-09-21T12:46:56.444 INFO:tasks.workunit.client.1.smithi176.stdout:3/521: unlink d1/d5/d25/d38/l3d 0 2024-09-21T12:46:56.445 INFO:tasks.workunit.client.1.smithi176.stdout:3/522: write d1/d5/d25/d61/f77 [179304,26743] 0 2024-09-21T12:46:56.446 INFO:tasks.workunit.client.1.smithi176.stdout:3/523: fsync d1/fe 0 2024-09-21T12:46:56.450 INFO:tasks.workunit.client.1.smithi176.stdout:5/340: chown d0/l5 3735449 1 2024-09-21T12:46:56.452 INFO:tasks.workunit.client.1.smithi176.stdout:7/518: rename d0/d2/db/d10/d31/d65/f4a to d0/d2/d30/d7b/fb5 0 2024-09-21T12:46:56.453 INFO:tasks.workunit.client.1.smithi176.stdout:3/524: dwrite d1/d5/d25/d76/f7f [0,4194304] 0 2024-09-21T12:46:56.455 INFO:tasks.workunit.client.1.smithi176.stdout:1/464: mkdir d0/db/d1a/d2c/d48/d50/da6 0 2024-09-21T12:46:56.456 INFO:tasks.workunit.client.1.smithi176.stdout:9/412: mknod d1/df/d48/d69/d40/d84/c93 0 2024-09-21T12:46:56.457 INFO:tasks.workunit.client.1.smithi176.stdout:5/341: rmdir d0 39 2024-09-21T12:46:56.458 INFO:tasks.workunit.client.1.smithi176.stdout:1/465: creat d0/db/fa7 x:0 0 0 2024-09-21T12:46:56.459 INFO:tasks.workunit.client.1.smithi176.stdout:3/525: symlink d1/d5/d25/d61/dc3/lca 0 2024-09-21T12:46:56.460 INFO:tasks.workunit.client.1.smithi176.stdout:9/413: rmdir d1/df/d48/d69 39 2024-09-21T12:46:56.460 INFO:tasks.workunit.client.1.smithi176.stdout:1/466: stat d0/db/d25/d41/c83 0 2024-09-21T12:46:56.462 INFO:tasks.workunit.client.1.smithi176.stdout:7/519: dwrite d0/d2f/d43/f76 [4194304,4194304] 0 2024-09-21T12:46:56.463 INFO:tasks.workunit.client.1.smithi176.stdout:7/520: chown d0/d2/db/d10/d72/d51 395638 1 2024-09-21T12:46:56.464 INFO:tasks.workunit.client.1.smithi176.stdout:3/526: mkdir d1/d5/d25/d40/dcb 0 2024-09-21T12:46:56.464 INFO:tasks.workunit.client.1.smithi176.stdout:1/467: mknod d0/ca8 0 2024-09-21T12:46:56.466 INFO:tasks.workunit.client.1.smithi176.stdout:1/468: stat d0/db/d1a/f8a 0 2024-09-21T12:46:56.467 INFO:tasks.workunit.client.1.smithi176.stdout:7/521: truncate d0/d2/db/d10/d72/d94/f9a 709160 0 2024-09-21T12:46:56.469 INFO:tasks.workunit.client.1.smithi176.stdout:9/414: truncate d1/df/d23/f24 556356 0 2024-09-21T12:46:56.471 INFO:tasks.workunit.client.1.smithi176.stdout:3/527: mkdir d1/d5/d25/d5c/d7d/dcc 0 2024-09-21T12:46:56.472 INFO:tasks.workunit.client.1.smithi176.stdout:3/528: truncate d1/da/f55 1738865 0 2024-09-21T12:46:56.473 INFO:tasks.workunit.client.1.smithi176.stdout:3/529: truncate d1/d34/d48/f50 1411721 0 2024-09-21T12:46:56.476 INFO:tasks.workunit.client.1.smithi176.stdout:7/522: creat d0/d2/db/d10/d3b/d79/fb6 x:0 0 0 2024-09-21T12:46:56.477 INFO:tasks.workunit.client.1.smithi176.stdout:9/415: write d1/f2a [8221776,70140] 0 2024-09-21T12:46:56.479 INFO:tasks.workunit.client.1.smithi176.stdout:1/469: creat d0/db/d25/d41/d59/d9b/fa9 x:0 0 0 2024-09-21T12:46:56.479 INFO:tasks.workunit.client.1.smithi176.stdout:5/342: write d0/d10/f2b [731827,41591] 0 2024-09-21T12:46:56.481 INFO:tasks.workunit.client.1.smithi176.stdout:1/470: fsync d0/db/d6f/f7d 0 2024-09-21T12:46:56.483 INFO:tasks.workunit.client.1.smithi176.stdout:3/530: rename d1/d34/d42/d5b/l96 to d1/lcd 0 2024-09-21T12:46:56.484 INFO:tasks.workunit.client.1.smithi176.stdout:7/523: creat d0/d2/fb7 x:0 0 0 2024-09-21T12:46:56.484 INFO:tasks.workunit.client.1.smithi176.stdout:1/471: read d0/d5b/f61 [1739501,17433] 0 2024-09-21T12:46:56.485 INFO:tasks.workunit.client.1.smithi176.stdout:5/343: dread d0/d13/d63/f3d [0,4194304] 0 2024-09-21T12:46:56.486 INFO:tasks.workunit.client.1.smithi176.stdout:7/524: chown d0/d2/db/d10/d72 68 1 2024-09-21T12:46:56.486 INFO:tasks.workunit.client.1.smithi176.stdout:9/416: dwrite d1/f71 [0,4194304] 0 2024-09-21T12:46:56.487 INFO:tasks.workunit.client.1.smithi176.stdout:5/344: readlink d0/d13/d63/d2e/d39/l5b 0 2024-09-21T12:46:56.492 INFO:tasks.workunit.client.1.smithi176.stdout:9/417: creat d1/df/d48/f94 x:0 0 0 2024-09-21T12:46:56.493 INFO:tasks.workunit.client.1.smithi176.stdout:7/525: link d0/d2/db/d10/c7c d0/cb8 0 2024-09-21T12:46:56.494 INFO:tasks.workunit.client.1.smithi176.stdout:5/345: dwrite d0/d13/d63/d2e/d39/f4b [0,4194304] 0 2024-09-21T12:46:56.495 INFO:tasks.workunit.client.1.smithi176.stdout:3/531: dread d1/d34/f52 [0,4194304] 0 2024-09-21T12:46:56.496 INFO:tasks.workunit.client.1.smithi176.stdout:3/532: chown d1/d34/d57/dc7 3287 1 2024-09-21T12:46:56.498 INFO:tasks.workunit.client.1.smithi176.stdout:5/346: truncate d0/d13/d63/d2e/d39/f43 136111 0 2024-09-21T12:46:56.498 INFO:tasks.workunit.client.1.smithi176.stdout:7/526: mknod d0/d2/db/d10/d23/d85/cb9 0 2024-09-21T12:46:56.499 INFO:tasks.workunit.client.1.smithi176.stdout:9/418: creat d1/df/d48/d69/d40/d84/f95 x:0 0 0 2024-09-21T12:46:56.501 INFO:tasks.workunit.client.1.smithi176.stdout:2/434: sync 2024-09-21T12:46:56.503 INFO:tasks.workunit.client.1.smithi176.stdout:9/419: dread - d1/df/d48/d69/d40/d84/f95 zero size 2024-09-21T12:46:56.503 INFO:tasks.workunit.client.1.smithi176.stdout:7/527: mkdir d0/d2/db/d10/d72/d7e/dba 0 2024-09-21T12:46:56.506 INFO:tasks.workunit.client.1.smithi176.stdout:5/347: link d0/d13/f5c d0/f64 0 2024-09-21T12:46:56.506 INFO:tasks.workunit.client.1.smithi176.stdout:3/533: dwrite d1/d35/f36 [0,4194304] 0 2024-09-21T12:46:56.537 INFO:tasks.workunit.client.1.smithi176.stdout:9/420: creat d1/df/d48/d69/d4d/f96 x:0 0 0 2024-09-21T12:46:56.538 INFO:tasks.workunit.client.1.smithi176.stdout:5/348: symlink d0/d13/d5d/l65 0 2024-09-21T12:46:56.541 INFO:tasks.workunit.client.1.smithi176.stdout:3/534: readlink d1/d5/d25/l75 0 2024-09-21T12:46:56.543 INFO:tasks.workunit.client.1.smithi176.stdout:2/435: write d4/df/d2e/d6f/f33 [4348660,76083] 0 2024-09-21T12:46:56.546 INFO:tasks.workunit.client.1.smithi176.stdout:9/421: unlink d1/df/d1c/f8c 0 2024-09-21T12:46:56.547 INFO:tasks.workunit.client.1.smithi176.stdout:3/535: dwrite d1/f1a [0,4194304] 0 2024-09-21T12:46:56.553 INFO:tasks.workunit.client.1.smithi176.stdout:2/436: symlink d4/df/d2e/d4d/l84 0 2024-09-21T12:46:56.555 INFO:tasks.workunit.client.1.smithi176.stdout:5/349: mkdir d0/d13/d63/d66 0 2024-09-21T12:46:56.558 INFO:tasks.workunit.client.1.smithi176.stdout:3/536: unlink d1/d5/d25/d84/lc1 0 2024-09-21T12:46:56.558 INFO:tasks.workunit.client.1.smithi176.stdout:7/528: getdents d0/d5d/d8a 0 2024-09-21T12:46:56.561 INFO:tasks.workunit.client.1.smithi176.stdout:5/350: mknod d0/d13/d5d/c67 0 2024-09-21T12:46:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:56 smithi176 ceph-mon[35476]: pgmap v24: 65 pgs: 65 active+clean; 946 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 111 MiB/s wr, 366 op/s 2024-09-21T12:46:56.567 INFO:tasks.workunit.client.1.smithi176.stdout:5/351: dwrite d0/f18 [0,4194304] 0 2024-09-21T12:46:56.574 INFO:tasks.workunit.client.1.smithi176.stdout:5/352: dread d0/d13/f3c [0,4194304] 0 2024-09-21T12:46:56.579 INFO:tasks.workunit.client.1.smithi176.stdout:5/353: dwrite d0/d13/d63/f3a [0,4194304] 0 2024-09-21T12:46:56.589 INFO:tasks.workunit.client.1.smithi176.stdout:2/437: unlink d4/f1d 0 2024-09-21T12:46:56.592 INFO:tasks.workunit.client.1.smithi176.stdout:2/438: dread d4/d3a/f5c [0,4194304] 0 2024-09-21T12:46:56.596 INFO:tasks.workunit.client.1.smithi176.stdout:2/439: write d4/df/f15 [609270,60697] 0 2024-09-21T12:46:56.597 INFO:tasks.workunit.client.1.smithi176.stdout:5/354: dread d0/f27 [4194304,4194304] 0 2024-09-21T12:46:56.599 INFO:tasks.workunit.client.1.smithi176.stdout:5/355: dread d0/d13/d63/d2e/d39/d41/f4f [0,4194304] 0 2024-09-21T12:46:56.600 INFO:tasks.workunit.client.1.smithi176.stdout:2/440: mkdir d4/d40/d85 0 2024-09-21T12:46:56.601 INFO:tasks.workunit.client.1.smithi176.stdout:2/441: dread - d4/df/d2e/d39/d55/f75 zero size 2024-09-21T12:46:56.605 INFO:tasks.workunit.client.1.smithi176.stdout:2/442: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:46:56.610 INFO:tasks.workunit.client.1.smithi176.stdout:2/443: write d4/df/f2a [892927,40230] 0 2024-09-21T12:46:56.613 INFO:tasks.workunit.client.1.smithi176.stdout:2/444: mknod d4/df/d2e/d6f/c86 0 2024-09-21T12:46:56.617 INFO:tasks.workunit.client.1.smithi176.stdout:2/445: symlink d4/df/d2e/d6f/l87 0 2024-09-21T12:46:56.619 INFO:tasks.workunit.client.1.smithi176.stdout:3/537: truncate d1/d5/d25/d38/f54 825390 0 2024-09-21T12:46:56.620 INFO:tasks.workunit.client.1.smithi176.stdout:7/529: symlink d0/lbb 0 2024-09-21T12:46:56.621 INFO:tasks.workunit.client.1.smithi176.stdout:9/422: rmdir d1/df/d23 39 2024-09-21T12:46:56.623 INFO:tasks.workunit.client.1.smithi176.stdout:7/530: getdents d0/d2/db/d10/d31/da1 0 2024-09-21T12:46:56.624 INFO:tasks.workunit.client.1.smithi176.stdout:2/446: dwrite d4/df/d2e/d39/f66 [0,4194304] 0 2024-09-21T12:46:56.626 INFO:tasks.workunit.client.1.smithi176.stdout:6/396: sync 2024-09-21T12:46:56.626 INFO:tasks.workunit.client.1.smithi176.stdout:0/508: sync 2024-09-21T12:46:56.626 INFO:tasks.workunit.client.1.smithi176.stdout:2/447: chown d4/d40/l60 4742773 1 2024-09-21T12:46:56.627 INFO:tasks.workunit.client.1.smithi176.stdout:9/423: unlink d1/df/d23/l2c 0 2024-09-21T12:46:56.630 INFO:tasks.workunit.client.1.smithi176.stdout:3/538: dwrite d1/d5/f9b [0,4194304] 0 2024-09-21T12:46:56.632 INFO:tasks.workunit.client.1.smithi176.stdout:0/509: creat d9/d1a/d3f/d40/fb2 x:0 0 0 2024-09-21T12:46:56.635 INFO:tasks.workunit.client.1.smithi176.stdout:9/424: fdatasync d1/fd 0 2024-09-21T12:46:56.636 INFO:tasks.workunit.client.1.smithi176.stdout:7/531: dwrite d0/d2/f42 [0,4194304] 0 2024-09-21T12:46:56.636 INFO:tasks.workunit.client.1.smithi176.stdout:0/510: write d9/d1a/d1d/d23/da1/da3/d1e/f6e [178188,86550] 0 2024-09-21T12:46:56.636 INFO:tasks.workunit.client.1.smithi176.stdout:3/539: mkdir d1/d34/d5d/dce 0 2024-09-21T12:46:56.637 INFO:tasks.workunit.client.1.smithi176.stdout:9/425: fsync d1/df/d48/d69/f6f 0 2024-09-21T12:46:56.639 INFO:tasks.workunit.client.1.smithi176.stdout:3/540: write d1/d9e/fb6 [2351300,69701] 0 2024-09-21T12:46:56.639 INFO:tasks.workunit.client.1.smithi176.stdout:5/356: rename d0/l1d to d0/d13/d63/d2e/d39/d41/l68 0 2024-09-21T12:46:56.640 INFO:tasks.workunit.client.1.smithi176.stdout:6/397: mkdir d2/dd/d26/d2b/d10/d1b/d7b 0 2024-09-21T12:46:56.642 INFO:tasks.workunit.client.1.smithi176.stdout:3/541: readlink d1/d5/d25/d61/dc3/lca 0 2024-09-21T12:46:56.643 INFO:tasks.workunit.client.1.smithi176.stdout:7/532: unlink d0/d2/db/f6a 0 2024-09-21T12:46:56.646 INFO:tasks.workunit.client.1.smithi176.stdout:3/542: readlink d1/d3e/l4b 0 2024-09-21T12:46:56.648 INFO:tasks.workunit.client.1.smithi176.stdout:5/357: dread d0/f18 [0,4194304] 0 2024-09-21T12:46:56.649 INFO:tasks.workunit.client.1.smithi176.stdout:2/448: fdatasync d4/df/d2e/d39/f66 0 2024-09-21T12:46:56.651 INFO:tasks.workunit.client.1.smithi176.stdout:6/398: rename d2/dd/d26/d2b/d10/d39/f46 to d2/d6f/f7c 0 2024-09-21T12:46:56.653 INFO:tasks.workunit.client.1.smithi176.stdout:7/533: truncate d0/d2/d30/d93/d96/d89/f97 581672 0 2024-09-21T12:46:56.653 INFO:tasks.workunit.client.1.smithi176.stdout:0/511: link d9/d1b/d43/l49 d9/d1a/d1d/d23/da1/da3/lb3 0 2024-09-21T12:46:56.654 INFO:tasks.workunit.client.1.smithi176.stdout:9/426: dwrite d1/df/d48/d69/d38/f43 [0,4194304] 0 2024-09-21T12:46:56.657 INFO:tasks.workunit.client.1.smithi176.stdout:5/358: rename d0/f18 to d0/d13/d63/d66/f69 0 2024-09-21T12:46:56.660 INFO:tasks.workunit.client.1.smithi176.stdout:9/427: fdatasync d1/df/d23/d67/f75 0 2024-09-21T12:46:56.661 INFO:tasks.workunit.client.1.smithi176.stdout:0/512: creat d9/d1a/d1d/d23/fb4 x:0 0 0 2024-09-21T12:46:56.664 INFO:tasks.workunit.client.1.smithi176.stdout:5/359: readlink d0/d13/d63/d2e/d39/l5b 0 2024-09-21T12:46:56.664 INFO:tasks.workunit.client.1.smithi176.stdout:7/534: creat d0/d2/db/d10/d5a/fbc x:0 0 0 2024-09-21T12:46:56.665 INFO:tasks.workunit.client.1.smithi176.stdout:2/449: dwrite d4/d3d/f5b [0,4194304] 0 2024-09-21T12:46:56.668 INFO:tasks.workunit.client.1.smithi176.stdout:6/399: dwrite d2/dd/f7a [0,4194304] 0 2024-09-21T12:46:56.668 INFO:tasks.workunit.client.1.smithi176.stdout:7/535: write d0/d5d/d5e/f74 [4912634,47302] 0 2024-09-21T12:46:56.671 INFO:tasks.workunit.client.1.smithi176.stdout:7/536: stat d0/d2/d30/d93/d96/l8b 0 2024-09-21T12:46:56.672 INFO:tasks.workunit.client.1.smithi176.stdout:9/428: creat d1/f97 x:0 0 0 2024-09-21T12:46:56.673 INFO:tasks.workunit.client.1.smithi176.stdout:3/543: dread d1/d5/f83 [0,4194304] 0 2024-09-21T12:46:56.673 INFO:tasks.workunit.client.1.smithi176.stdout:7/537: chown d0/d2/db/d10/d23/f28 5 1 2024-09-21T12:46:56.675 INFO:tasks.workunit.client.1.smithi176.stdout:5/360: creat d0/d13/d63/d2e/d37/d55/f6a x:0 0 0 2024-09-21T12:46:56.676 INFO:tasks.workunit.client.1.smithi176.stdout:3/544: write d1/d5/d25/d5c/faf [4557951,35119] 0 2024-09-21T12:46:56.677 INFO:tasks.workunit.client.1.smithi176.stdout:3/545: dread - d1/d5/d25/d84/fc8 zero size 2024-09-21T12:46:56.678 INFO:tasks.workunit.client.1.smithi176.stdout:3/546: write d1/d5/d25/d84/fc8 [114818,87317] 0 2024-09-21T12:46:56.681 INFO:tasks.workunit.client.1.smithi176.stdout:6/400: read d2/f34 [1765141,112556] 0 2024-09-21T12:46:56.682 INFO:tasks.workunit.client.1.smithi176.stdout:7/538: rename d0/d2f/d43/f52 to d0/d5d/d7a/fbd 0 2024-09-21T12:46:56.683 INFO:tasks.workunit.client.1.smithi176.stdout:9/429: mknod d1/df/d48/c98 0 2024-09-21T12:46:56.684 INFO:tasks.workunit.client.1.smithi176.stdout:0/513: getdents d9/d1a/d1d/d23/da1/da3/d1e 0 2024-09-21T12:46:56.685 INFO:tasks.workunit.client.1.smithi176.stdout:5/361: creat d0/d13/d63/d2e/d39/d3b/f6b x:0 0 0 2024-09-21T12:46:56.685 INFO:tasks.workunit.client.1.smithi176.stdout:3/547: dwrite d1/f1a [0,4194304] 0 2024-09-21T12:46:56.687 INFO:tasks.workunit.client.1.smithi176.stdout:7/539: write d0/d5d/f81 [691124,122084] 0 2024-09-21T12:46:56.687 INFO:tasks.workunit.client.1.smithi176.stdout:6/401: mknod d2/dd/d79/c7d 0 2024-09-21T12:46:56.691 INFO:tasks.workunit.client.1.smithi176.stdout:9/430: unlink d1/df/d23/f24 0 2024-09-21T12:46:56.692 INFO:tasks.workunit.client.1.smithi176.stdout:9/431: dread - d1/d61/d73/d7d/f72 zero size 2024-09-21T12:46:56.693 INFO:tasks.workunit.client.1.smithi176.stdout:5/362: creat d0/d13/d63/d2e/d39/d41/f6c x:0 0 0 2024-09-21T12:46:56.693 INFO:tasks.workunit.client.1.smithi176.stdout:9/432: truncate d1/df/d48/f6c 207518 0 2024-09-21T12:46:56.694 INFO:tasks.workunit.client.1.smithi176.stdout:5/363: write d0/f8 [2200549,2549] 0 2024-09-21T12:46:56.695 INFO:tasks.workunit.client.1.smithi176.stdout:7/540: stat d0/cb8 0 2024-09-21T12:46:56.697 INFO:tasks.workunit.client.1.smithi176.stdout:0/514: rename d9/f17 to d9/d1a/d1d/d23/da1/da3/d1e/fb5 0 2024-09-21T12:46:56.699 INFO:tasks.workunit.client.1.smithi176.stdout:0/515: read d9/d1b/d63/d75/fad [682146,22610] 0 2024-09-21T12:46:56.700 INFO:tasks.workunit.client.1.smithi176.stdout:3/548: creat d1/d5/fcf x:0 0 0 2024-09-21T12:46:56.701 INFO:tasks.workunit.client.1.smithi176.stdout:9/433: mkdir d1/d8b/d99 0 2024-09-21T12:46:56.703 INFO:tasks.workunit.client.1.smithi176.stdout:9/434: write d1/f5d [1956982,33852] 0 2024-09-21T12:46:56.704 INFO:tasks.workunit.client.1.smithi176.stdout:6/402: dwrite d2/f56 [0,4194304] 0 2024-09-21T12:46:56.712 INFO:tasks.workunit.client.1.smithi176.stdout:5/364: write d0/d13/d63/d2e/d39/d41/f4f [525498,86554] 0 2024-09-21T12:46:56.714 INFO:tasks.workunit.client.1.smithi176.stdout:6/403: dwrite d2/d63/f53 [0,4194304] 0 2024-09-21T12:46:56.715 INFO:tasks.workunit.client.1.smithi176.stdout:9/435: rename d1/df/d48/d69/d38/d88 to d1/df/d9a 0 2024-09-21T12:46:56.715 INFO:tasks.workunit.client.1.smithi176.stdout:5/365: dread - d0/d13/d63/d2e/d39/d41/f6c zero size 2024-09-21T12:46:56.716 INFO:tasks.workunit.client.1.smithi176.stdout:7/541: dread d0/d2/db/d10/d3b/f5b [0,4194304] 0 2024-09-21T12:46:56.720 INFO:tasks.workunit.client.1.smithi176.stdout:0/516: dread d9/d1a/d1d/d23/d5f/f89 [0,4194304] 0 2024-09-21T12:46:56.722 INFO:tasks.workunit.client.1.smithi176.stdout:3/549: dwrite d1/d5/f1b [0,4194304] 0 2024-09-21T12:46:56.722 INFO:tasks.workunit.client.1.smithi176.stdout:6/404: rename d2/dd/d26/d2b/d10/f66 to d2/dd/d26/d2b/f7e 0 2024-09-21T12:46:56.725 INFO:tasks.workunit.client.1.smithi176.stdout:0/517: dread d9/d1b/d63/d77/d88/f5a [0,4194304] 0 2024-09-21T12:46:56.727 INFO:tasks.workunit.client.1.smithi176.stdout:6/405: truncate d2/dd/d26/d2b/d10/d39/f73 812435 0 2024-09-21T12:46:56.728 INFO:tasks.workunit.client.1.smithi176.stdout:3/550: rename d1/d5/d25/d5c to d1/d34/d57/dd0 0 2024-09-21T12:46:56.729 INFO:tasks.workunit.client.1.smithi176.stdout:5/366: getdents d0/d13/d63/d2e/d37/d55 0 2024-09-21T12:46:56.731 INFO:tasks.workunit.client.1.smithi176.stdout:7/542: getdents d0/d2/db/d10/d31/da0 0 2024-09-21T12:46:56.732 INFO:tasks.workunit.client.1.smithi176.stdout:0/518: dwrite d9/f27 [0,4194304] 0 2024-09-21T12:46:56.733 INFO:tasks.workunit.client.1.smithi176.stdout:7/543: dread - d0/d2/d30/d7b/faf zero size 2024-09-21T12:46:56.735 INFO:tasks.workunit.client.1.smithi176.stdout:3/551: unlink d1/da/c29 0 2024-09-21T12:46:56.736 INFO:tasks.workunit.client.1.smithi176.stdout:0/519: rmdir d9/d1b/d63 39 2024-09-21T12:46:56.736 INFO:tasks.workunit.client.1.smithi176.stdout:3/552: dread - d1/d34/f93 zero size 2024-09-21T12:46:56.740 INFO:tasks.workunit.client.1.smithi176.stdout:3/553: read d1/d34/d57/dd0/d7d/f80 [467145,64759] 0 2024-09-21T12:46:56.741 INFO:tasks.workunit.client.1.smithi176.stdout:7/544: mkdir d0/d2/da8/dbe 0 2024-09-21T12:46:56.742 INFO:tasks.workunit.client.1.smithi176.stdout:7/545: read d0/d2/db/d10/d5a/f38 [4118378,3271] 0 2024-09-21T12:46:56.745 INFO:tasks.workunit.client.1.smithi176.stdout:6/406: truncate d2/f34 3913723 0 2024-09-21T12:46:56.746 INFO:tasks.workunit.client.1.smithi176.stdout:7/546: truncate d0/d2/db/f26 1317117 0 2024-09-21T12:46:56.746 INFO:tasks.workunit.client.1.smithi176.stdout:5/367: link d0/d13/d63/d2e/l42 d0/d10/l6d 0 2024-09-21T12:46:56.747 INFO:tasks.workunit.client.1.smithi176.stdout:3/554: dwrite d1/d34/d5d/fa2 [0,4194304] 0 2024-09-21T12:46:56.747 INFO:tasks.workunit.client.1.smithi176.stdout:0/520: write d9/d1b/d43/d98/fa2 [109482,88521] 0 2024-09-21T12:46:56.748 INFO:tasks.workunit.client.1.smithi176.stdout:6/407: readlink d2/dd/d26/d2b/d10/d1b/l57 0 2024-09-21T12:46:56.751 INFO:tasks.workunit.client.1.smithi176.stdout:3/555: creat d1/d8d/fd1 x:0 0 0 2024-09-21T12:46:56.753 INFO:tasks.workunit.client.1.smithi176.stdout:5/368: creat d0/d13/d63/d2e/d37/d55/f6e x:0 0 0 2024-09-21T12:46:56.753 INFO:tasks.workunit.client.1.smithi176.stdout:3/556: chown d1/d34/d71/fa3 2698 1 2024-09-21T12:46:56.754 INFO:tasks.workunit.client.1.smithi176.stdout:6/408: mkdir d2/d6f/d7f 0 2024-09-21T12:46:56.756 INFO:tasks.workunit.client.1.smithi176.stdout:0/521: dwrite d9/d1a/d1d/d81/f83 [0,4194304] 0 2024-09-21T12:46:56.757 INFO:tasks.workunit.client.1.smithi176.stdout:7/547: creat d0/d2/db/d10/fbf x:0 0 0 2024-09-21T12:46:56.757 INFO:tasks.workunit.client.1.smithi176.stdout:1/472: sync 2024-09-21T12:46:56.757 INFO:tasks.workunit.client.1.smithi176.stdout:8/411: sync 2024-09-21T12:46:56.757 INFO:tasks.workunit.client.1.smithi176.stdout:4/406: sync 2024-09-21T12:46:56.759 INFO:tasks.workunit.client.1.smithi176.stdout:3/557: mkdir d1/d34/dbb/dd2 0 2024-09-21T12:46:56.765 INFO:tasks.workunit.client.1.smithi176.stdout:7/548: symlink d0/d2/db/d10/d72/lc0 0 2024-09-21T12:46:56.766 INFO:tasks.workunit.client.1.smithi176.stdout:6/409: dwrite d2/dd/d26/d2b/f7e [0,4194304] 0 2024-09-21T12:46:56.766 INFO:tasks.workunit.client.1.smithi176.stdout:8/412: creat d6/d16/d36/d67/f85 x:0 0 0 2024-09-21T12:46:56.766 INFO:tasks.workunit.client.1.smithi176.stdout:1/473: rename d0/db/d1a to d0/db/d1a/d2c/daa 22 2024-09-21T12:46:56.768 INFO:tasks.workunit.client.1.smithi176.stdout:7/549: fsync d0/d2/db/f26 0 2024-09-21T12:46:56.769 INFO:tasks.workunit.client.1.smithi176.stdout:4/407: mknod d3/d21/d27/c87 0 2024-09-21T12:46:56.770 INFO:tasks.workunit.client.1.smithi176.stdout:3/558: creat d1/d5/d25/d76/dc6/fd3 x:0 0 0 2024-09-21T12:46:56.771 INFO:tasks.workunit.client.1.smithi176.stdout:5/369: link d0/l44 d0/d13/d63/d2e/d39/d41/l6f 0 2024-09-21T12:46:56.771 INFO:tasks.workunit.client.1.smithi176.stdout:8/413: read - d6/d8/d24/d35/d51/f53 zero size 2024-09-21T12:46:56.772 INFO:tasks.workunit.client.1.smithi176.stdout:4/408: read - d3/d42/d47/f7e zero size 2024-09-21T12:46:56.774 INFO:tasks.workunit.client.1.smithi176.stdout:8/414: readlink d6/l57 0 2024-09-21T12:46:56.775 INFO:tasks.workunit.client.1.smithi176.stdout:0/522: creat d9/d1b/d63/d77/fb6 x:0 0 0 2024-09-21T12:46:56.777 INFO:tasks.workunit.client.1.smithi176.stdout:4/409: mkdir d3/d21/d88 0 2024-09-21T12:46:56.780 INFO:tasks.workunit.client.1.smithi176.stdout:6/410: dwrite d2/dd/f48 [0,4194304] 0 2024-09-21T12:46:56.780 INFO:tasks.workunit.client.1.smithi176.stdout:4/410: chown d3/d42/d56/d4e 3 1 2024-09-21T12:46:56.781 INFO:tasks.workunit.client.1.smithi176.stdout:3/559: getdents d1/d9e 0 2024-09-21T12:46:56.782 INFO:tasks.workunit.client.1.smithi176.stdout:0/523: rmdir d9/d1a/d3f/d40/d79 39 2024-09-21T12:46:56.785 INFO:tasks.workunit.client.1.smithi176.stdout:7/550: dwrite d0/d2/f5c [0,4194304] 0 2024-09-21T12:46:56.786 INFO:tasks.workunit.client.1.smithi176.stdout:4/411: unlink d3/d21/c6c 0 2024-09-21T12:46:56.788 INFO:tasks.workunit.client.1.smithi176.stdout:4/412: stat d3/d5/db/f20 0 2024-09-21T12:46:56.790 INFO:tasks.workunit.client.1.smithi176.stdout:4/413: dread - d3/d5/f80 zero size 2024-09-21T12:46:56.790 INFO:tasks.workunit.client.1.smithi176.stdout:8/415: dwrite d6/d8/d24/d35/d51/f6f [4194304,4194304] 0 2024-09-21T12:46:56.792 INFO:tasks.workunit.client.1.smithi176.stdout:0/524: creat d9/d1a/d1d/d22/fb7 x:0 0 0 2024-09-21T12:46:56.793 INFO:tasks.workunit.client.1.smithi176.stdout:1/474: dread d0/db/d1a/d2c/f79 [0,4194304] 0 2024-09-21T12:46:56.793 INFO:tasks.workunit.client.1.smithi176.stdout:1/475: readlink d0/db/d25/d41/l94 0 2024-09-21T12:46:56.794 INFO:tasks.workunit.client.1.smithi176.stdout:7/551: mknod d0/d2/d30/d7b/cc1 0 2024-09-21T12:46:56.796 INFO:tasks.workunit.client.1.smithi176.stdout:6/411: mknod d2/dd/d26/d2b/d10/d1b/c80 0 2024-09-21T12:46:56.797 INFO:tasks.workunit.client.1.smithi176.stdout:3/560: mknod d1/d5/cd4 0 2024-09-21T12:46:56.799 INFO:tasks.workunit.client.1.smithi176.stdout:4/414: unlink d3/d5/l82 0 2024-09-21T12:46:56.801 INFO:tasks.workunit.client.1.smithi176.stdout:8/416: fdatasync d6/d8/d54/f76 0 2024-09-21T12:46:56.802 INFO:tasks.workunit.client.1.smithi176.stdout:0/525: readlink l4 0 2024-09-21T12:46:56.805 INFO:tasks.workunit.client.1.smithi176.stdout:7/552: fsync d0/d2/db/d10/f2c 0 2024-09-21T12:46:56.807 INFO:tasks.workunit.client.1.smithi176.stdout:5/370: truncate d0/d13/d63/d66/f69 1700267 0 2024-09-21T12:46:56.808 INFO:tasks.workunit.client.1.smithi176.stdout:6/412: mkdir d2/d6f/d81 0 2024-09-21T12:46:56.808 INFO:tasks.workunit.client.1.smithi176.stdout:8/417: dwrite d6/d8/d54/f76 [0,4194304] 0 2024-09-21T12:46:56.809 INFO:tasks.workunit.client.1.smithi176.stdout:3/561: mkdir d1/d5/d25/d61/dd5 0 2024-09-21T12:46:56.812 INFO:tasks.workunit.client.1.smithi176.stdout:0/526: dwrite d9/d1a/d1d/f51 [0,4194304] 0 2024-09-21T12:46:56.815 INFO:tasks.workunit.client.1.smithi176.stdout:7/553: creat d0/d5d/fc2 x:0 0 0 2024-09-21T12:46:56.816 INFO:tasks.workunit.client.1.smithi176.stdout:7/554: stat d0/d5d/d5e 0 2024-09-21T12:46:56.817 INFO:tasks.workunit.client.1.smithi176.stdout:8/418: write d6/d8/f33 [2925482,1192] 0 2024-09-21T12:46:56.817 INFO:tasks.workunit.client.1.smithi176.stdout:8/419: fdatasync d6/db/f43 0 2024-09-21T12:46:56.818 INFO:tasks.workunit.client.1.smithi176.stdout:8/420: chown d6/db/d32/l74 7750486 1 2024-09-21T12:46:56.818 INFO:tasks.workunit.client.1.smithi176.stdout:5/371: readlink d0/d13/d63/d2e/d39/d41/l6f 0 2024-09-21T12:46:56.823 INFO:tasks.workunit.client.1.smithi176.stdout:1/476: write d0/db/d25/d2b/f3b [1302013,25785] 0 2024-09-21T12:46:56.824 INFO:tasks.workunit.client.1.smithi176.stdout:1/477: write d0/db/d6f/f7d [348651,26944] 0 2024-09-21T12:46:56.826 INFO:tasks.workunit.client.1.smithi176.stdout:0/527: write d9/d1a/d1d/d23/da1/da3/f5d [240577,118215] 0 2024-09-21T12:46:56.830 INFO:tasks.workunit.client.1.smithi176.stdout:8/421: creat d6/d16/f86 x:0 0 0 2024-09-21T12:46:56.831 INFO:tasks.workunit.client.1.smithi176.stdout:3/562: chown d1/d35/d5e/d90/fa6 917182 1 2024-09-21T12:46:56.832 INFO:tasks.workunit.client.1.smithi176.stdout:4/415: creat d3/d21/f89 x:0 0 0 2024-09-21T12:46:56.832 INFO:tasks.workunit.client.1.smithi176.stdout:8/422: read d6/d8/d24/d35/f42 [3978686,1221] 0 2024-09-21T12:46:56.834 INFO:tasks.workunit.client.1.smithi176.stdout:1/478: mknod d0/db/d25/d2b/cab 0 2024-09-21T12:46:56.836 INFO:tasks.workunit.client.1.smithi176.stdout:0/528: stat d9/d1a/d20/c21 0 2024-09-21T12:46:56.836 INFO:tasks.workunit.client.1.smithi176.stdout:2/450: sync 2024-09-21T12:46:56.838 INFO:tasks.workunit.client.1.smithi176.stdout:4/416: chown d3/d5/db/d36/f77 244 1 2024-09-21T12:46:56.839 INFO:tasks.workunit.client.1.smithi176.stdout:4/417: readlink d3/d5/db/l55 0 2024-09-21T12:46:56.840 INFO:tasks.workunit.client.1.smithi176.stdout:4/418: fdatasync d3/d5/db/d36/f6e 0 2024-09-21T12:46:56.842 INFO:tasks.workunit.client.1.smithi176.stdout:5/372: dread d0/fc [0,4194304] 0 2024-09-21T12:46:56.843 INFO:tasks.workunit.client.1.smithi176.stdout:6/413: truncate d2/dd/d26/d2b/d10/d1b/d37/f4b 2402487 0 2024-09-21T12:46:56.845 INFO:tasks.workunit.client.1.smithi176.stdout:2/451: symlink d4/df/d2e/l88 0 2024-09-21T12:46:56.845 INFO:tasks.workunit.client.1.smithi176.stdout:3/563: dread d1/d34/d48/f68 [0,4194304] 0 2024-09-21T12:46:56.846 INFO:tasks.workunit.client.1.smithi176.stdout:8/423: symlink d6/d8/l87 0 2024-09-21T12:46:56.847 INFO:tasks.workunit.client.1.smithi176.stdout:8/424: write d6/d16/f63 [381331,50112] 0 2024-09-21T12:46:56.850 INFO:tasks.workunit.client.1.smithi176.stdout:0/529: mkdir d9/d1a/db8 0 2024-09-21T12:46:56.851 INFO:tasks.workunit.client.1.smithi176.stdout:5/373: chown d0/d13/d63/d2e/d39/d41/l68 0 1 2024-09-21T12:46:56.852 INFO:tasks.workunit.client.1.smithi176.stdout:6/414: readlink d2/d63/l69 0 2024-09-21T12:46:56.853 INFO:tasks.workunit.client.1.smithi176.stdout:6/415: chown d2/d6f 1751 1 2024-09-21T12:46:56.853 INFO:tasks.workunit.client.1.smithi176.stdout:7/555: dwrite d0/d2f/d43/f6b [0,4194304] 0 2024-09-21T12:46:56.855 INFO:tasks.workunit.client.1.smithi176.stdout:1/479: link d0/db/d1a/f21 d0/db/d6a/fac 0 2024-09-21T12:46:56.859 INFO:tasks.workunit.client.1.smithi176.stdout:3/564: dwrite d1/d34/d48/f68 [4194304,4194304] 0 2024-09-21T12:46:56.861 INFO:tasks.workunit.client.1.smithi176.stdout:5/374: rmdir d0/d13/d63/d2e/d37/d55 39 2024-09-21T12:46:56.865 INFO:tasks.workunit.client.1.smithi176.stdout:8/425: truncate d6/d16/f1d 994999 0 2024-09-21T12:46:56.866 INFO:tasks.workunit.client.1.smithi176.stdout:1/480: rmdir d0/db/d25 39 2024-09-21T12:46:56.867 INFO:tasks.workunit.client.1.smithi176.stdout:1/481: chown d0/d5b/f87 13877 1 2024-09-21T12:46:56.870 INFO:tasks.workunit.client.1.smithi176.stdout:4/419: rename d3/d42/d47/l81 to d3/d5/d37/l8a 0 2024-09-21T12:46:56.871 INFO:tasks.workunit.client.1.smithi176.stdout:0/530: mknod d9/d1b/d63/cb9 0 2024-09-21T12:46:56.874 INFO:tasks.workunit.client.1.smithi176.stdout:2/452: rmdir d4/d40/d85 0 2024-09-21T12:46:56.879 INFO:tasks.workunit.client.1.smithi176.stdout:7/556: symlink d0/d2f/d43/lc3 0 2024-09-21T12:46:56.879 INFO:tasks.workunit.client.1.smithi176.stdout:7/557: read - d0/d2/db/d10/d23/f8e zero size 2024-09-21T12:46:56.880 INFO:tasks.workunit.client.1.smithi176.stdout:8/426: rmdir d6/d16/d36 39 2024-09-21T12:46:56.884 INFO:tasks.workunit.client.1.smithi176.stdout:4/420: dread d3/f3c [0,4194304] 0 2024-09-21T12:46:56.884 INFO:tasks.workunit.client.1.smithi176.stdout:2/453: creat d4/d3d/d65/f89 x:0 0 0 2024-09-21T12:46:56.893 INFO:tasks.workunit.client.1.smithi176.stdout:5/375: write d0/d10/f4c [35105,76542] 0 2024-09-21T12:46:56.893 INFO:tasks.workunit.client.1.smithi176.stdout:1/482: getdents d0/db/d1a/d2c/d6b 0 2024-09-21T12:46:56.894 INFO:tasks.workunit.client.1.smithi176.stdout:1/483: chown d0/d5b 741884 1 2024-09-21T12:46:56.896 INFO:tasks.workunit.client.1.smithi176.stdout:6/416: link d2/d6f/f7c d2/dd/d26/d2b/d10/f82 0 2024-09-21T12:46:56.898 INFO:tasks.workunit.client.1.smithi176.stdout:8/427: rename d6/d8/f2e to d6/db/d37/f88 0 2024-09-21T12:46:56.898 INFO:tasks.workunit.client.1.smithi176.stdout:0/531: link d9/d1b/l34 d9/d1b/d43/d98/lba 0 2024-09-21T12:46:56.900 INFO:tasks.workunit.client.1.smithi176.stdout:4/421: dread d3/d42/d47/f6d [0,4194304] 0 2024-09-21T12:46:56.900 INFO:tasks.workunit.client.1.smithi176.stdout:2/454: creat d4/df/d2e/d6f/d5d/d81/f8a x:0 0 0 2024-09-21T12:46:56.903 INFO:tasks.workunit.client.1.smithi176.stdout:8/428: write d6/d8/d24/d35/d51/f55 [1020830,4531] 0 2024-09-21T12:46:56.906 INFO:tasks.workunit.client.1.smithi176.stdout:8/429: fsync d6/d8/d24/d35/f71 0 2024-09-21T12:46:56.908 INFO:tasks.workunit.client.1.smithi176.stdout:1/484: mknod d0/db/d25/d2b/d43/d92/cad 0 2024-09-21T12:46:56.910 INFO:tasks.workunit.client.1.smithi176.stdout:8/430: mkdir d6/db/d37/d89 0 2024-09-21T12:46:56.911 INFO:tasks.workunit.client.1.smithi176.stdout:1/485: readlink d0/db/d2a/l32 0 2024-09-21T12:46:56.914 INFO:tasks.workunit.client.1.smithi176.stdout:4/422: dwrite d3/d5/db/d36/f43 [0,4194304] 0 2024-09-21T12:46:56.915 INFO:tasks.workunit.client.1.smithi176.stdout:2/455: dwrite d4/df/d2e/d39/f66 [0,4194304] 0 2024-09-21T12:46:56.915 INFO:tasks.workunit.client.1.smithi176.stdout:8/431: mkdir d6/db/d37/d89/d8a 0 2024-09-21T12:46:56.915 INFO:tasks.workunit.client.1.smithi176.stdout:1/486: write d0/db/fa7 [142110,73440] 0 2024-09-21T12:46:56.917 INFO:tasks.workunit.client.1.smithi176.stdout:5/376: dwrite d0/d13/d63/d2e/d37/f57 [0,4194304] 0 2024-09-21T12:46:56.920 INFO:tasks.workunit.client.1.smithi176.stdout:8/432: chown d6/d8/l12 4191 1 2024-09-21T12:46:56.921 INFO:tasks.workunit.client.1.smithi176.stdout:2/456: unlink d4/d63/l7e 0 2024-09-21T12:46:56.923 INFO:tasks.workunit.client.1.smithi176.stdout:0/532: dread d9/d1a/d1d/d22/f3b [0,4194304] 0 2024-09-21T12:46:56.923 INFO:tasks.workunit.client.1.smithi176.stdout:8/433: readlink d6/db/l20 0 2024-09-21T12:46:56.926 INFO:tasks.workunit.client.1.smithi176.stdout:5/377: mkdir d0/d10/d70 0 2024-09-21T12:46:56.926 INFO:tasks.workunit.client.1.smithi176.stdout:2/457: rmdir d4/d3d/d65 39 2024-09-21T12:46:56.929 INFO:tasks.workunit.client.1.smithi176.stdout:2/458: dread - d4/f64 zero size 2024-09-21T12:46:56.929 INFO:tasks.workunit.client.1.smithi176.stdout:8/434: creat d6/d8/d24/d5e/f8b x:0 0 0 2024-09-21T12:46:56.930 INFO:tasks.workunit.client.1.smithi176.stdout:4/423: dwrite d3/f32 [0,4194304] 0 2024-09-21T12:46:56.932 INFO:tasks.workunit.client.1.smithi176.stdout:4/424: chown d3/d5/f15 25005728 1 2024-09-21T12:46:56.932 INFO:tasks.workunit.client.1.smithi176.stdout:5/378: truncate d0/d13/d63/d2e/d39/d41/f4f 1470788 0 2024-09-21T12:46:56.933 INFO:tasks.workunit.client.1.smithi176.stdout:0/533: getdents d9/d1a/d1d/d23/da1 0 2024-09-21T12:46:56.934 INFO:tasks.workunit.client.1.smithi176.stdout:4/425: chown d3/d5/f4a 947 1 2024-09-21T12:46:56.935 INFO:tasks.workunit.client.1.smithi176.stdout:8/435: write d6/d8/d24/d35/f75 [554434,67037] 0 2024-09-21T12:46:56.936 INFO:tasks.workunit.client.1.smithi176.stdout:8/436: chown d6/db/c34 6002 1 2024-09-21T12:46:56.936 INFO:tasks.workunit.client.1.smithi176.stdout:9/436: sync 2024-09-21T12:46:56.937 INFO:tasks.workunit.client.1.smithi176.stdout:2/459: getdents d4/df 0 2024-09-21T12:46:56.938 INFO:tasks.workunit.client.1.smithi176.stdout:0/534: read d9/d1a/d1d/d23/da1/da3/d1e/f6f [332859,5025] 0 2024-09-21T12:46:56.941 INFO:tasks.workunit.client.1.smithi176.stdout:8/437: chown d6/d8/f33 234163 1 2024-09-21T12:46:56.944 INFO:tasks.workunit.client.1.smithi176.stdout:9/437: fsync d1/df/d48/d69/f27 0 2024-09-21T12:46:56.944 INFO:tasks.workunit.client.1.smithi176.stdout:2/460: write d4/df/d2e/d6f/d6d/f71 [605585,106089] 0 2024-09-21T12:46:56.946 INFO:tasks.workunit.client.1.smithi176.stdout:9/438: readlink d1/l1d 0 2024-09-21T12:46:56.947 INFO:tasks.workunit.client.1.smithi176.stdout:5/379: dwrite d0/fc [0,4194304] 0 2024-09-21T12:46:56.947 INFO:tasks.workunit.client.1.smithi176.stdout:8/438: rmdir d6/d16/d36/d67 39 2024-09-21T12:46:56.948 INFO:tasks.workunit.client.1.smithi176.stdout:4/426: dwrite d3/d42/d4d/f70 [0,4194304] 0 2024-09-21T12:46:56.948 INFO:tasks.workunit.client.1.smithi176.stdout:2/461: write d4/df/f15 [4007246,23226] 0 2024-09-21T12:46:56.949 INFO:tasks.workunit.client.1.smithi176.stdout:9/439: dread - d1/d61/d73/d7d/f8d zero size 2024-09-21T12:46:56.949 INFO:tasks.workunit.client.1.smithi176.stdout:8/439: stat d6/f5b 0 2024-09-21T12:46:56.949 INFO:tasks.workunit.client.1.smithi176.stdout:4/427: readlink d3/d42/d56/d4e/l76 0 2024-09-21T12:46:56.951 INFO:tasks.workunit.client.1.smithi176.stdout:0/535: rename d9/d1a/d3f/d40/f72 to d9/d1a/d1d/d81/d8e/fbb 0 2024-09-21T12:46:56.953 INFO:tasks.workunit.client.1.smithi176.stdout:2/462: mknod d4/df/d83/c8b 0 2024-09-21T12:46:57.004 INFO:tasks.workunit.client.1.smithi176.stdout:9/440: truncate d1/df/d48/d69/f27 1257684 0 2024-09-21T12:46:57.006 INFO:tasks.workunit.client.1.smithi176.stdout:2/463: symlink d4/df/d2e/d6f/d5d/d81/l8c 0 2024-09-21T12:46:57.006 INFO:tasks.workunit.client.1.smithi176.stdout:8/440: dread d6/d8/d24/d35/f75 [0,4194304] 0 2024-09-21T12:46:57.006 INFO:tasks.workunit.client.1.smithi176.stdout:4/428: getdents d3/d42/d4d 0 2024-09-21T12:46:57.008 INFO:tasks.workunit.client.1.smithi176.stdout:2/464: dread - d4/df/d2e/d6f/d5d/f77 zero size 2024-09-21T12:46:57.008 INFO:tasks.workunit.client.1.smithi176.stdout:0/536: dread d9/d1a/d1d/d22/f3b [0,4194304] 0 2024-09-21T12:46:57.009 INFO:tasks.workunit.client.1.smithi176.stdout:4/429: mknod d3/d42/d56/d4e/c8b 0 2024-09-21T12:46:57.010 INFO:tasks.workunit.client.1.smithi176.stdout:8/441: creat d6/d8/d54/f8c x:0 0 0 2024-09-21T12:46:57.010 INFO:tasks.workunit.client.1.smithi176.stdout:9/441: link d1/c17 d1/df/d48/d69/c9b 0 2024-09-21T12:46:57.011 INFO:tasks.workunit.client.1.smithi176.stdout:2/465: creat d4/df/d2e/d6f/d5d/f8d x:0 0 0 2024-09-21T12:46:57.011 INFO:tasks.workunit.client.1.smithi176.stdout:0/537: mknod d9/d1b/d43/cbc 0 2024-09-21T12:46:57.012 INFO:tasks.workunit.client.1.smithi176.stdout:4/430: creat d3/d42/d56/f8c x:0 0 0 2024-09-21T12:46:57.012 INFO:tasks.workunit.client.1.smithi176.stdout:2/466: read d4/df/d2e/d6f/f3e [4583549,113858] 0 2024-09-21T12:46:57.013 INFO:tasks.workunit.client.1.smithi176.stdout:4/431: write d3/d42/f69 [1061542,47237] 0 2024-09-21T12:46:57.013 INFO:tasks.workunit.client.1.smithi176.stdout:8/442: creat d6/db/d37/d89/f8d x:0 0 0 2024-09-21T12:46:57.015 INFO:tasks.workunit.client.1.smithi176.stdout:4/432: truncate d3/d42/d56/f8c 1031689 0 2024-09-21T12:46:57.016 INFO:tasks.workunit.client.1.smithi176.stdout:9/442: rmdir d1/d8b/d99 0 2024-09-21T12:46:57.018 INFO:tasks.workunit.client.1.smithi176.stdout:2/467: dread d4/df/f2a [0,4194304] 0 2024-09-21T12:46:57.019 INFO:tasks.workunit.client.1.smithi176.stdout:8/443: creat d6/d16/d36/d67/f8e x:0 0 0 2024-09-21T12:46:57.020 INFO:tasks.workunit.client.1.smithi176.stdout:2/468: write d4/df/d2e/f7a [272206,22378] 0 2024-09-21T12:46:57.020 INFO:tasks.workunit.client.1.smithi176.stdout:9/443: rename d1/df/f60 to d1/df/d23/f9c 0 2024-09-21T12:46:57.021 INFO:tasks.workunit.client.1.smithi176.stdout:4/433: creat d3/d5/f8d x:0 0 0 2024-09-21T12:46:57.022 INFO:tasks.workunit.client.1.smithi176.stdout:2/469: mkdir d4/df/d83/d8e 0 2024-09-21T12:46:57.023 INFO:tasks.workunit.client.1.smithi176.stdout:9/444: symlink d1/df/d48/d69/d40/d84/l9d 0 2024-09-21T12:46:57.025 INFO:tasks.workunit.client.1.smithi176.stdout:3/565: sync 2024-09-21T12:46:57.027 INFO:tasks.workunit.client.1.smithi176.stdout:9/445: mkdir d1/df/d48/d69/d76/d7c/d9e 0 2024-09-21T12:46:57.029 INFO:tasks.workunit.client.1.smithi176.stdout:3/566: write d1/d34/f52 [2731929,115593] 0 2024-09-21T12:46:57.030 INFO:tasks.workunit.client.1.smithi176.stdout:8/444: dwrite d6/d8/d24/d35/d51/f78 [0,4194304] 0 2024-09-21T12:46:57.031 INFO:tasks.workunit.client.1.smithi176.stdout:3/567: stat d1/da/f55 0 2024-09-21T12:46:57.032 INFO:tasks.workunit.client.1.smithi176.stdout:9/446: write d1/df/d1c/f3c [2578050,21472] 0 2024-09-21T12:46:57.033 INFO:tasks.workunit.client.1.smithi176.stdout:4/434: dwrite d3/d21/d5e/f74 [0,4194304] 0 2024-09-21T12:46:57.033 INFO:tasks.workunit.client.1.smithi176.stdout:2/470: dwrite d4/df/f21 [0,4194304] 0 2024-09-21T12:46:57.036 INFO:tasks.workunit.client.1.smithi176.stdout:4/435: dread - d3/d42/f7c zero size 2024-09-21T12:46:57.041 INFO:tasks.workunit.client.1.smithi176.stdout:8/445: creat d6/d16/d79/f8f x:0 0 0 2024-09-21T12:46:57.042 INFO:tasks.workunit.client.1.smithi176.stdout:2/471: rename d4/df/c14 to d4/df/d2e/d6f/c8f 0 2024-09-21T12:46:57.044 INFO:tasks.workunit.client.1.smithi176.stdout:4/436: creat d3/d42/f8e x:0 0 0 2024-09-21T12:46:57.044 INFO:tasks.workunit.client.1.smithi176.stdout:9/447: dread d1/df/d23/d67/f75 [0,4194304] 0 2024-09-21T12:46:57.047 INFO:tasks.workunit.client.1.smithi176.stdout:4/437: creat d3/d42/d47/f8f x:0 0 0 2024-09-21T12:46:57.055 INFO:tasks.workunit.client.1.smithi176.stdout:9/448: dread d1/df/d48/d69/f6f [0,4194304] 0 2024-09-21T12:46:57.055 INFO:tasks.workunit.client.1.smithi176.stdout:3/568: dread d1/d34/d48/f50 [0,4194304] 0 2024-09-21T12:46:57.057 INFO:tasks.workunit.client.1.smithi176.stdout:9/449: dread d1/df/d23/d67/f75 [0,4194304] 0 2024-09-21T12:46:57.059 INFO:tasks.workunit.client.1.smithi176.stdout:9/450: chown d1/l3f 318 1 2024-09-21T12:46:57.060 INFO:tasks.workunit.client.1.smithi176.stdout:9/451: readlink d1/df/d48/d69/l8a 0 2024-09-21T12:46:57.061 INFO:tasks.workunit.client.1.smithi176.stdout:9/452: write d1/df/f46 [5125915,55877] 0 2024-09-21T12:46:57.061 INFO:tasks.workunit.client.1.smithi176.stdout:9/453: chown d1/df/d23/f36 15 1 2024-09-21T12:46:57.063 INFO:tasks.workunit.client.1.smithi176.stdout:9/454: creat d1/d63/f9f x:0 0 0 2024-09-21T12:46:57.065 INFO:tasks.workunit.client.1.smithi176.stdout:9/455: symlink d1/df/d48/d69/d4d/la0 0 2024-09-21T12:46:57.066 INFO:tasks.workunit.client.1.smithi176.stdout:9/456: write d1/df/d1c/f3c [1049123,101636] 0 2024-09-21T12:46:57.067 INFO:tasks.workunit.client.1.smithi176.stdout:9/457: read d1/f2f [419039,64530] 0 2024-09-21T12:46:57.068 INFO:tasks.workunit.client.1.smithi176.stdout:9/458: dread - d1/d61/d73/d7d/f8d zero size 2024-09-21T12:46:57.070 INFO:tasks.workunit.client.1.smithi176.stdout:9/459: unlink d1/d61/d73/d7d/f82 0 2024-09-21T12:46:57.086 INFO:tasks.workunit.client.1.smithi176.stdout:7/558: sync 2024-09-21T12:46:57.086 INFO:tasks.workunit.client.1.smithi176.stdout:1/487: sync 2024-09-21T12:46:57.086 INFO:tasks.workunit.client.1.smithi176.stdout:6/417: sync 2024-09-21T12:46:57.087 INFO:tasks.workunit.client.1.smithi176.stdout:6/418: write d2/dd/f11 [51731,5001] 0 2024-09-21T12:46:57.089 INFO:tasks.workunit.client.1.smithi176.stdout:7/559: unlink d0/cb8 0 2024-09-21T12:46:57.091 INFO:tasks.workunit.client.1.smithi176.stdout:6/419: rename d2/d6f/d76 to d2/d6f/d83 0 2024-09-21T12:46:57.093 INFO:tasks.workunit.client.1.smithi176.stdout:7/560: creat d0/d2/db/d10/d31/da0/fc4 x:0 0 0 2024-09-21T12:46:57.094 INFO:tasks.workunit.client.1.smithi176.stdout:7/561: rmdir d0/d2/d30/d7b 39 2024-09-21T12:46:57.096 INFO:tasks.workunit.client.1.smithi176.stdout:7/562: creat d0/d2/db/d10/d5a/fc5 x:0 0 0 2024-09-21T12:46:57.099 INFO:tasks.workunit.client.1.smithi176.stdout:1/488: dread d0/db/d1a/d2c/f81 [0,4194304] 0 2024-09-21T12:46:57.101 INFO:tasks.workunit.client.1.smithi176.stdout:1/489: creat d0/db/d25/d41/fae x:0 0 0 2024-09-21T12:46:57.104 INFO:tasks.workunit.client.1.smithi176.stdout:6/420: dread d2/f64 [0,4194304] 0 2024-09-21T12:46:57.107 INFO:tasks.workunit.client.1.smithi176.stdout:6/421: symlink d2/d6f/d7f/l84 0 2024-09-21T12:46:57.107 INFO:tasks.workunit.client.1.smithi176.stdout:6/422: read - d2/d6f/f78 zero size 2024-09-21T12:46:57.110 INFO:tasks.workunit.client.1.smithi176.stdout:7/563: dread d0/d2/db/d10/d3b/f88 [0,4194304] 0 2024-09-21T12:46:57.112 INFO:tasks.workunit.client.1.smithi176.stdout:5/380: sync 2024-09-21T12:46:57.112 INFO:tasks.workunit.client.1.smithi176.stdout:0/538: sync 2024-09-21T12:46:57.113 INFO:tasks.workunit.client.1.smithi176.stdout:7/564: creat d0/d2/db/d10/fc6 x:0 0 0 2024-09-21T12:46:57.116 INFO:tasks.workunit.client.1.smithi176.stdout:7/565: symlink d0/d2/db/d10/d72/lc7 0 2024-09-21T12:46:57.116 INFO:tasks.workunit.client.1.smithi176.stdout:5/381: dread d0/d13/d63/f3a [0,4194304] 0 2024-09-21T12:46:57.117 INFO:tasks.workunit.client.1.smithi176.stdout:7/566: write d0/d2/db/f26 [1012903,40825] 0 2024-09-21T12:46:57.119 INFO:tasks.workunit.client.1.smithi176.stdout:0/539: dwrite d9/d1b/d63/f76 [0,4194304] 0 2024-09-21T12:46:57.123 INFO:tasks.workunit.client.1.smithi176.stdout:7/567: getdents d0/d2f 0 2024-09-21T12:46:57.127 INFO:tasks.workunit.client.1.smithi176.stdout:0/540: dwrite d9/d1a/d1d/d23/da1/da3/f50 [0,4194304] 0 2024-09-21T12:46:57.129 INFO:tasks.workunit.client.1.smithi176.stdout:7/568: rename d0/d2/db/d10/c7c to d0/cc8 0 2024-09-21T12:46:57.130 INFO:tasks.workunit.client.1.smithi176.stdout:7/569: dread - d0/d5d/d5e/f75 zero size 2024-09-21T12:46:57.131 INFO:tasks.workunit.client.1.smithi176.stdout:0/541: mkdir d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd 0 2024-09-21T12:46:57.132 INFO:tasks.workunit.client.1.smithi176.stdout:7/570: mkdir d0/d2/dc9 0 2024-09-21T12:46:57.133 INFO:tasks.workunit.client.1.smithi176.stdout:0/542: fsync d9/d1a/d3f/d40/f85 0 2024-09-21T12:46:57.134 INFO:tasks.workunit.client.1.smithi176.stdout:0/543: symlink d9/d1a/d1d/d23/lbe 0 2024-09-21T12:46:57.136 INFO:tasks.workunit.client.1.smithi176.stdout:0/544: rmdir d9/d1b/d63/d77/d78 39 2024-09-21T12:46:57.140 INFO:tasks.workunit.client.1.smithi176.stdout:0/545: truncate d9/f52 2487177 0 2024-09-21T12:46:57.140 INFO:tasks.workunit.client.1.smithi176.stdout:0/546: chown d9/d1a/d1d/d23/da1/da3/d93/d9f 109895207 1 2024-09-21T12:46:57.275 INFO:tasks.workunit.client.1.smithi176.stdout:0/547: dread d9/d1a/f9b [0,4194304] 0 2024-09-21T12:46:57.278 INFO:tasks.workunit.client.1.smithi176.stdout:0/548: mkdir d9/d1a/d1d/d23/da1/da3/d1e/dbf 0 2024-09-21T12:46:57.279 INFO:tasks.workunit.client.1.smithi176.stdout:6/423: dread d2/d6f/f7c [0,4194304] 0 2024-09-21T12:46:57.284 INFO:tasks.workunit.client.1.smithi176.stdout:6/424: readlink d2/dd/d26/d2b/l28 0 2024-09-21T12:46:57.284 INFO:tasks.workunit.client.1.smithi176.stdout:8/446: truncate d6/f1a 1936478 0 2024-09-21T12:46:57.286 INFO:tasks.workunit.client.1.smithi176.stdout:4/438: truncate d3/d5/f44 360014 0 2024-09-21T12:46:57.286 INFO:tasks.workunit.client.1.smithi176.stdout:4/439: chown d3/d21 612 1 2024-09-21T12:46:57.287 INFO:tasks.workunit.client.1.smithi176.stdout:3/569: truncate d1/d3e/f58 3021373 0 2024-09-21T12:46:57.288 INFO:tasks.workunit.client.1.smithi176.stdout:0/549: mkdir d9/d1a/d3f/d40/d79/dc0 0 2024-09-21T12:46:57.290 INFO:tasks.workunit.client.1.smithi176.stdout:1/490: dread d0/db/f1b [0,4194304] 0 2024-09-21T12:46:57.291 INFO:tasks.workunit.client.1.smithi176.stdout:2/472: symlink d4/df/d83/l90 0 2024-09-21T12:46:57.291 INFO:tasks.workunit.client.1.smithi176.stdout:2/473: stat d4/d3a/l49 0 2024-09-21T12:46:57.293 INFO:tasks.workunit.client.1.smithi176.stdout:1/491: truncate d0/db/d1a/d2c/d37/f56 533234 0 2024-09-21T12:46:57.293 INFO:tasks.workunit.client.1.smithi176.stdout:9/460: write d1/df/d48/d69/f27 [726778,123106] 0 2024-09-21T12:46:57.296 INFO:tasks.workunit.client.1.smithi176.stdout:4/440: unlink d3/c1b 0 2024-09-21T12:46:57.298 INFO:tasks.workunit.client.1.smithi176.stdout:4/441: write d3/d21/f2a [4029531,64867] 0 2024-09-21T12:46:57.299 INFO:tasks.workunit.client.1.smithi176.stdout:2/474: symlink d4/df/d83/l91 0 2024-09-21T12:46:57.301 INFO:tasks.workunit.client.1.smithi176.stdout:9/461: dwrite d1/df/d48/d69/d38/f92 [0,4194304] 0 2024-09-21T12:46:57.302 INFO:tasks.workunit.client.1.smithi176.stdout:6/425: link d2/dd/d26/d2b/d10/d1b/l57 d2/dd/l85 0 2024-09-21T12:46:57.304 INFO:tasks.workunit.client.1.smithi176.stdout:6/426: write d2/dd/f11 [2810305,104480] 0 2024-09-21T12:46:57.304 INFO:tasks.workunit.client.1.smithi176.stdout:6/427: readlink d2/dd/l77 0 2024-09-21T12:46:57.305 INFO:tasks.workunit.client.1.smithi176.stdout:4/442: creat d3/d42/d56/f90 x:0 0 0 2024-09-21T12:46:57.307 INFO:tasks.workunit.client.1.smithi176.stdout:0/550: creat d9/d1b/d63/fc1 x:0 0 0 2024-09-21T12:46:57.308 INFO:tasks.workunit.client.1.smithi176.stdout:4/443: write d3/d21/d27/d2c/f41 [2513915,43654] 0 2024-09-21T12:46:57.309 INFO:tasks.workunit.client.1.smithi176.stdout:1/492: dwrite d0/db/d1a/d2c/f81 [0,4194304] 0 2024-09-21T12:46:57.309 INFO:tasks.workunit.client.1.smithi176.stdout:5/382: write d0/d10/f2b [1445469,111074] 0 2024-09-21T12:46:57.310 INFO:tasks.workunit.client.1.smithi176.stdout:4/444: chown d3/d21 1432824 1 2024-09-21T12:46:57.313 INFO:tasks.workunit.client.1.smithi176.stdout:5/383: write d0/d13/d63/d2e/d39/d41/f4f [932640,9097] 0 2024-09-21T12:46:57.313 INFO:tasks.workunit.client.1.smithi176.stdout:7/571: write d0/f17 [796246,4393] 0 2024-09-21T12:46:57.320 INFO:tasks.workunit.client.1.smithi176.stdout:4/445: write d3/d5/f4a [1779116,39269] 0 2024-09-21T12:46:57.321 INFO:tasks.workunit.client.1.smithi176.stdout:6/428: symlink d2/dd/d26/d2b/d68/l86 0 2024-09-21T12:46:57.326 INFO:tasks.workunit.client.1.smithi176.stdout:3/570: rename d1/d3e/f58 to d1/d34/d57/dd0/d7d/fd6 0 2024-09-21T12:46:57.327 INFO:tasks.workunit.client.1.smithi176.stdout:5/384: dwrite d0/d13/d63/d66/f69 [0,4194304] 0 2024-09-21T12:46:57.328 INFO:tasks.workunit.client.1.smithi176.stdout:7/572: mkdir d0/d2/da8/dca 0 2024-09-21T12:46:57.329 INFO:tasks.workunit.client.1.smithi176.stdout:8/447: truncate d6/d16/f1e 3241218 0 2024-09-21T12:46:57.330 INFO:tasks.workunit.client.1.smithi176.stdout:3/571: read d1/d34/d71/fa3 [483746,80598] 0 2024-09-21T12:46:57.331 INFO:tasks.workunit.client.1.smithi176.stdout:9/462: link d1/df/d48/d69/c31 d1/d63/ca1 0 2024-09-21T12:46:57.332 INFO:tasks.workunit.client.1.smithi176.stdout:1/493: getdents d0/db/d1a/d2c/d48/d50/da6 0 2024-09-21T12:46:57.334 INFO:tasks.workunit.client.1.smithi176.stdout:9/463: dread d1/df/d48/f6c [0,4194304] 0 2024-09-21T12:46:57.335 INFO:tasks.workunit.client.1.smithi176.stdout:9/464: read - d1/df/d23/f9c zero size 2024-09-21T12:46:57.335 INFO:tasks.workunit.client.1.smithi176.stdout:4/446: creat d3/d21/d88/f91 x:0 0 0 2024-09-21T12:46:57.335 INFO:tasks.workunit.client.1.smithi176.stdout:9/465: stat d1/df/d48/d69/d76 0 2024-09-21T12:46:57.337 INFO:tasks.workunit.client.1.smithi176.stdout:4/447: dread - d3/d5/db/d36/f77 zero size 2024-09-21T12:46:57.338 INFO:tasks.workunit.client.1.smithi176.stdout:7/573: dread - d0/d2/d30/d7b/fb5 zero size 2024-09-21T12:46:57.339 INFO:tasks.workunit.client.1.smithi176.stdout:4/448: chown d3/d21/d27 1072501 1 2024-09-21T12:46:57.339 INFO:tasks.workunit.client.1.smithi176.stdout:2/475: truncate d4/d3d/f5b 2226802 0 2024-09-21T12:46:57.339 INFO:tasks.workunit.client.1.smithi176.stdout:7/574: stat d0/d2/f5c 0 2024-09-21T12:46:57.341 INFO:tasks.workunit.client.1.smithi176.stdout:4/449: write d3/d21/f89 [858455,41485] 0 2024-09-21T12:46:57.346 INFO:tasks.workunit.client.1.smithi176.stdout:8/448: getdents d6/d16/d36/d7d/d81 0 2024-09-21T12:46:57.346 INFO:tasks.workunit.client.1.smithi176.stdout:6/429: dread d2/dd/d26/d2b/d10/f1f [0,4194304] 0 2024-09-21T12:46:57.346 INFO:tasks.workunit.client.1.smithi176.stdout:0/551: truncate d9/d1a/d1d/d81/f83 711359 0 2024-09-21T12:46:57.346 INFO:tasks.workunit.client.1.smithi176.stdout:2/476: fsync d4/df/d2e/f7a 0 2024-09-21T12:46:57.346 INFO:tasks.workunit.client.1.smithi176.stdout:1/494: symlink d0/db/d25/laf 0 2024-09-21T12:46:57.347 INFO:tasks.workunit.client.1.smithi176.stdout:3/572: link d1/da/fb2 d1/d5/d25/d61/dc3/fd7 0 2024-09-21T12:46:57.348 INFO:tasks.workunit.client.1.smithi176.stdout:3/573: stat d1/d34/cb0 0 2024-09-21T12:46:57.349 INFO:tasks.workunit.client.1.smithi176.stdout:3/574: write d1/d35/f32 [21631,49463] 0 2024-09-21T12:46:57.350 INFO:tasks.workunit.client.1.smithi176.stdout:5/385: dread d0/d13/d63/d2e/d39/f4b [0,4194304] 0 2024-09-21T12:46:57.355 INFO:tasks.workunit.client.1.smithi176.stdout:0/552: rmdir d9/d1a/d1d/d22 39 2024-09-21T12:46:57.356 INFO:tasks.workunit.client.1.smithi176.stdout:2/477: mknod d4/df/d2e/d6f/d5d/d81/c92 0 2024-09-21T12:46:57.356 INFO:tasks.workunit.client.1.smithi176.stdout:0/553: dread - d9/d1a/d1d/d90/f94 zero size 2024-09-21T12:46:57.357 INFO:tasks.workunit.client.1.smithi176.stdout:2/478: chown d4/df/d2e/d6f/d5d/f8d 227605311 1 2024-09-21T12:46:57.357 INFO:tasks.workunit.client.1.smithi176.stdout:7/575: rename d0/d2/d30/d93/d96/c8d to d0/d2/db/d10/d72/d7e/dba/ccb 0 2024-09-21T12:46:57.365 INFO:tasks.workunit.client.1.smithi176.stdout:3/575: dwrite d1/d5/d25/d38/f3f [0,4194304] 0 2024-09-21T12:46:57.366 INFO:tasks.workunit.client.1.smithi176.stdout:9/466: truncate d1/f2f 1204465 0 2024-09-21T12:46:57.368 INFO:tasks.workunit.client.1.smithi176.stdout:4/450: rename d3/d21/d27/f40 to d3/d5/d37/f92 0 2024-09-21T12:46:57.369 INFO:tasks.workunit.client.1.smithi176.stdout:7/576: creat d0/d2/db/d10/d72/d7e/dba/fcc x:0 0 0 2024-09-21T12:46:57.370 INFO:tasks.workunit.client.1.smithi176.stdout:5/386: mkdir d0/d13/d63/d2e/d71 0 2024-09-21T12:46:57.370 INFO:tasks.workunit.client.1.smithi176.stdout:8/449: creat d6/f90 x:0 0 0 2024-09-21T12:46:57.371 INFO:tasks.workunit.client.1.smithi176.stdout:7/577: truncate d0/d2/db/d10/d5a/fc5 938761 0 2024-09-21T12:46:57.371 INFO:tasks.workunit.client.1.smithi176.stdout:7/578: stat d0/d5d/fc2 0 2024-09-21T12:46:57.373 INFO:tasks.workunit.client.1.smithi176.stdout:8/450: truncate d6/d8/d24/d35/d51/f53 160147 0 2024-09-21T12:46:57.374 INFO:tasks.workunit.client.1.smithi176.stdout:6/430: rmdir d2/d6f/d83 0 2024-09-21T12:46:57.377 INFO:tasks.workunit.client.1.smithi176.stdout:9/467: mknod d1/d61/d73/ca2 0 2024-09-21T12:46:57.379 INFO:tasks.workunit.client.1.smithi176.stdout:4/451: fsync d3/d5/f13 0 2024-09-21T12:46:57.380 INFO:tasks.workunit.client.1.smithi176.stdout:1/495: rename d0/db/d25/laf to d0/db/d25/d2b/d43/lb0 0 2024-09-21T12:46:57.383 INFO:tasks.workunit.client.1.smithi176.stdout:6/431: dwrite d2/dd/d26/d2b/d10/d1b/d37/f4f [4194304,4194304] 0 2024-09-21T12:46:57.390 INFO:tasks.workunit.client.1.smithi176.stdout:9/468: unlink d1/df/d48/f55 0 2024-09-21T12:46:57.392 INFO:tasks.workunit.client.1.smithi176.stdout:6/432: dwrite d2/dd/d26/d2b/d10/d39/f73 [0,4194304] 0 2024-09-21T12:46:57.395 INFO:tasks.workunit.client.1.smithi176.stdout:7/579: creat d0/d2/db/d10/d31/da1/fcd x:0 0 0 2024-09-21T12:46:57.395 INFO:tasks.workunit.client.1.smithi176.stdout:2/479: rename d4/d62 to d4/d63/d93 0 2024-09-21T12:46:57.398 INFO:tasks.workunit.client.1.smithi176.stdout:3/576: creat d1/fd8 x:0 0 0 2024-09-21T12:46:57.399 INFO:tasks.workunit.client.1.smithi176.stdout:0/554: getdents d9/d1b/d63 0 2024-09-21T12:46:57.401 INFO:tasks.workunit.client.1.smithi176.stdout:8/451: dread d6/d8/f2a [0,4194304] 0 2024-09-21T12:46:57.401 INFO:tasks.workunit.client.1.smithi176.stdout:8/452: fdatasync f4 0 2024-09-21T12:46:57.402 INFO:tasks.workunit.client.1.smithi176.stdout:9/469: rmdir d1/df/d23 39 2024-09-21T12:46:57.404 INFO:tasks.workunit.client.1.smithi176.stdout:6/433: mkdir d2/dd/d26/d2b/d10/d87 0 2024-09-21T12:46:57.404 INFO:tasks.workunit.client.1.smithi176.stdout:9/470: fdatasync d1/df/d48/d69/f6f 0 2024-09-21T12:46:57.407 INFO:tasks.workunit.client.1.smithi176.stdout:2/480: rename d4/f19 to d4/d63/f94 0 2024-09-21T12:46:57.408 INFO:tasks.workunit.client.1.smithi176.stdout:1/496: getdents d0/db/d1a/d2c/d37 0 2024-09-21T12:46:57.409 INFO:tasks.workunit.client.1.smithi176.stdout:7/580: fsync d0/d2/db/d10/d72/d51/fa7 0 2024-09-21T12:46:57.410 INFO:tasks.workunit.client.1.smithi176.stdout:3/577: dwrite d1/d35/fbd [0,4194304] 0 2024-09-21T12:46:57.411 INFO:tasks.workunit.client.1.smithi176.stdout:0/555: unlink d9/d1a/d1d/d23/da1/da3/f38 0 2024-09-21T12:46:57.413 INFO:tasks.workunit.client.1.smithi176.stdout:8/453: symlink d6/d8/d24/d5e/l91 0 2024-09-21T12:46:57.415 INFO:tasks.workunit.client.1.smithi176.stdout:4/452: dwrite d3/d5/fd [0,4194304] 0 2024-09-21T12:46:57.419 INFO:tasks.workunit.client.1.smithi176.stdout:0/556: dread - d9/d1a/d3f/d40/d79/f7f zero size 2024-09-21T12:46:57.419 INFO:tasks.workunit.client.1.smithi176.stdout:2/481: dread d4/df/d2e/f7a [0,4194304] 0 2024-09-21T12:46:57.420 INFO:tasks.workunit.client.1.smithi176.stdout:5/387: dwrite d0/d13/f5c [0,4194304] 0 2024-09-21T12:46:57.424 INFO:tasks.workunit.client.1.smithi176.stdout:7/581: dread d0/f17 [0,4194304] 0 2024-09-21T12:46:57.425 INFO:tasks.workunit.client.1.smithi176.stdout:1/497: mkdir d0/d91/db1 0 2024-09-21T12:46:57.430 INFO:tasks.workunit.client.1.smithi176.stdout:3/578: dread d1/d5/f7b [0,4194304] 0 2024-09-21T12:46:57.430 INFO:tasks.workunit.client.1.smithi176.stdout:9/471: dwrite d1/df/d48/d69/d38/f92 [4194304,4194304] 0 2024-09-21T12:46:57.434 INFO:tasks.workunit.client.1.smithi176.stdout:4/453: symlink d3/d42/d56/d4e/l93 0 2024-09-21T12:46:57.435 INFO:tasks.workunit.client.1.smithi176.stdout:3/579: stat d1/d5/d25/d40/l99 0 2024-09-21T12:46:57.436 INFO:tasks.workunit.client.1.smithi176.stdout:6/434: write d2/f8 [1656587,69522] 0 2024-09-21T12:46:57.436 INFO:tasks.workunit.client.1.smithi176.stdout:1/498: creat d0/db/d25/d41/d59/d9b/fb2 x:0 0 0 2024-09-21T12:46:57.436 INFO:tasks.workunit.client.1.smithi176.stdout:4/454: stat d3/d42/d4d 0 2024-09-21T12:46:57.441 INFO:tasks.workunit.client.1.smithi176.stdout:2/482: rename d4/df/d3f to d4/df/d2e/d6f/d5d/d81/d95 0 2024-09-21T12:46:57.441 INFO:tasks.workunit.client.1.smithi176.stdout:7/582: write d0/d2/db/d10/d31/da1/fcd [670139,47288] 0 2024-09-21T12:46:57.442 INFO:tasks.workunit.client.1.smithi176.stdout:8/454: dwrite d6/db/d13/f68 [0,4194304] 0 2024-09-21T12:46:57.445 INFO:tasks.workunit.client.1.smithi176.stdout:4/455: dread d3/d42/f71 [0,4194304] 0 2024-09-21T12:46:57.447 INFO:tasks.workunit.client.1.smithi176.stdout:9/472: creat d1/df/d23/fa3 x:0 0 0 2024-09-21T12:46:57.448 INFO:tasks.workunit.client.1.smithi176.stdout:7/583: rmdir d0/d2/db 39 2024-09-21T12:46:57.449 INFO:tasks.workunit.client.1.smithi176.stdout:0/557: dwrite d9/d1a/d1d/d23/f44 [4194304,4194304] 0 2024-09-21T12:46:57.450 INFO:tasks.workunit.client.1.smithi176.stdout:3/580: link d1/d35/f36 d1/d8d/fd9 0 2024-09-21T12:46:57.451 INFO:tasks.workunit.client.1.smithi176.stdout:2/483: fsync d4/d63/f68 0 2024-09-21T12:46:57.458 INFO:tasks.workunit.client.1.smithi176.stdout:9/473: write d1/df/d48/d69/d38/f92 [3993944,42062] 0 2024-09-21T12:46:57.458 INFO:tasks.workunit.client.1.smithi176.stdout:7/584: write d0/d2/d30/d7b/faf [793776,38392] 0 2024-09-21T12:46:57.462 INFO:tasks.workunit.client.1.smithi176.stdout:2/484: chown d4/df/f22 20935074 1 2024-09-21T12:46:57.462 INFO:tasks.workunit.client.1.smithi176.stdout:0/558: write d9/d1a/d1d/d23/da1/da3/d1e/f42 [265484,32017] 0 2024-09-21T12:46:57.464 INFO:tasks.workunit.client.1.smithi176.stdout:1/499: dwrite d0/db/d1a/d73/f95 [0,4194304] 0 2024-09-21T12:46:57.465 INFO:tasks.workunit.client.1.smithi176.stdout:9/474: read d1/f33 [2002659,79261] 0 2024-09-21T12:46:57.465 INFO:tasks.workunit.client.1.smithi176.stdout:7/585: chown d0/d2f/d43/lc3 1221 1 2024-09-21T12:46:57.467 INFO:tasks.workunit.client.1.smithi176.stdout:6/435: dread d2/f8 [0,4194304] 0 2024-09-21T12:46:57.471 INFO:tasks.workunit.client.1.smithi176.stdout:5/388: dread d0/d13/f56 [0,4194304] 0 2024-09-21T12:46:57.475 INFO:tasks.workunit.client.1.smithi176.stdout:6/436: mknod d2/dd/d26/d2b/d10/d1b/d37/c88 0 2024-09-21T12:46:57.475 INFO:tasks.workunit.client.1.smithi176.stdout:1/500: mkdir d0/db/d25/d41/d59/d99/db3 0 2024-09-21T12:46:57.475 INFO:tasks.workunit.client.1.smithi176.stdout:0/559: truncate d9/d1a/d3f/d40/fb2 209746 0 2024-09-21T12:46:57.476 INFO:tasks.workunit.client.1.smithi176.stdout:8/455: dwrite d6/d16/f7f [0,4194304] 0 2024-09-21T12:46:57.478 INFO:tasks.workunit.client.1.smithi176.stdout:3/581: dwrite d1/d5/d25/d84/fc8 [0,4194304] 0 2024-09-21T12:46:57.481 INFO:tasks.workunit.client.1.smithi176.stdout:0/560: chown d9/d1a/f58 2980 1 2024-09-21T12:46:57.482 INFO:tasks.workunit.client.1.smithi176.stdout:3/582: read d1/d34/d57/fbf [280222,83906] 0 2024-09-21T12:46:57.483 INFO:tasks.workunit.client.1.smithi176.stdout:0/561: chown d9/d1a/d1d/la9 11 1 2024-09-21T12:46:57.486 INFO:tasks.workunit.client.1.smithi176.stdout:2/485: truncate d4/df/f15 860224 0 2024-09-21T12:46:57.487 INFO:tasks.workunit.client.1.smithi176.stdout:7/586: truncate d0/d2/f4f 2501388 0 2024-09-21T12:46:57.487 INFO:tasks.workunit.client.1.smithi176.stdout:1/501: write d0/db/d1a/d2c/f79 [5218517,117792] 0 2024-09-21T12:46:57.489 INFO:tasks.workunit.client.1.smithi176.stdout:3/583: creat d1/d35/d5e/d90/fda x:0 0 0 2024-09-21T12:46:57.493 INFO:tasks.workunit.client.1.smithi176.stdout:8/456: dread d6/d8/d24/d35/d51/f78 [0,4194304] 0 2024-09-21T12:46:57.493 INFO:tasks.workunit.client.1.smithi176.stdout:3/584: mknod d1/d8d/cdb 0 2024-09-21T12:46:57.495 INFO:tasks.workunit.client.1.smithi176.stdout:1/502: write d0/db/d25/d2b/f97 [306463,114452] 0 2024-09-21T12:46:57.498 INFO:tasks.workunit.client.1.smithi176.stdout:6/437: dread d2/dd/d26/d2b/f7e [0,4194304] 0 2024-09-21T12:46:57.499 INFO:tasks.workunit.client.1.smithi176.stdout:0/562: dread d9/d1a/d1d/f51 [0,4194304] 0 2024-09-21T12:46:57.501 INFO:tasks.workunit.client.1.smithi176.stdout:8/457: symlink d6/d16/d79/l92 0 2024-09-21T12:46:57.502 INFO:tasks.workunit.client.1.smithi176.stdout:5/389: dwrite d0/d13/d63/d2e/d39/d3b/f3e [0,4194304] 0 2024-09-21T12:46:57.502 INFO:tasks.workunit.client.1.smithi176.stdout:2/486: link d4/df/d2e/c34 d4/d3a/c96 0 2024-09-21T12:46:57.502 INFO:tasks.workunit.client.1.smithi176.stdout:0/563: dread - d9/d1a/d3f/f80 zero size 2024-09-21T12:46:57.504 INFO:tasks.workunit.client.1.smithi176.stdout:6/438: write d2/dd/d26/d2b/d10/d39/f5b [1054305,96390] 0 2024-09-21T12:46:57.505 INFO:tasks.workunit.client.1.smithi176.stdout:9/475: dread d1/fd [0,4194304] 0 2024-09-21T12:46:57.505 INFO:tasks.workunit.client.1.smithi176.stdout:7/587: rename d0/d2/db/d10/d31/d65 to d0/d2/db/d10/d23/dce 0 2024-09-21T12:46:57.508 INFO:tasks.workunit.client.1.smithi176.stdout:5/390: chown d0/d13/d63/d2e/d39/d41 92 1 2024-09-21T12:46:57.509 INFO:tasks.workunit.client.1.smithi176.stdout:1/503: symlink d0/db/d1a/d2c/d66/lb4 0 2024-09-21T12:46:57.514 INFO:tasks.workunit.client.1.smithi176.stdout:6/439: chown d2/dd/d26/d2b/c22 3 1 2024-09-21T12:46:57.515 INFO:tasks.workunit.client.1.smithi176.stdout:0/564: mkdir d9/dc2 0 2024-09-21T12:46:57.517 INFO:tasks.workunit.client.1.smithi176.stdout:8/458: creat d6/d16/d36/d7d/d81/f93 x:0 0 0 2024-09-21T12:46:57.518 INFO:tasks.workunit.client.1.smithi176.stdout:3/585: dwrite d1/d5/d25/d38/f46 [0,4194304] 0 2024-09-21T12:46:57.520 INFO:tasks.workunit.client.1.smithi176.stdout:5/391: mkdir d0/d13/d63/d72 0 2024-09-21T12:46:57.520 INFO:tasks.workunit.client.1.smithi176.stdout:0/565: read d9/d1a/d1d/d23/d5f/f89 [2945832,66882] 0 2024-09-21T12:46:57.522 INFO:tasks.workunit.client.1.smithi176.stdout:3/586: mkdir d1/d3e/ddc 0 2024-09-21T12:46:57.525 INFO:tasks.workunit.client.1.smithi176.stdout:9/476: dwrite d1/f33 [0,4194304] 0 2024-09-21T12:46:57.525 INFO:tasks.workunit.client.1.smithi176.stdout:2/487: dread d4/f37 [0,4194304] 0 2024-09-21T12:46:57.525 INFO:tasks.workunit.client.1.smithi176.stdout:1/504: truncate d0/db/d25/d2b/f35 3919849 0 2024-09-21T12:46:57.528 INFO:tasks.workunit.client.1.smithi176.stdout:8/459: creat d6/d8/d24/d35/f94 x:0 0 0 2024-09-21T12:46:57.530 INFO:tasks.workunit.client.1.smithi176.stdout:0/566: rename d9/d1b/f1f to d9/d1a/d1d/d23/da1/da3/d1e/fc3 0 2024-09-21T12:46:57.532 INFO:tasks.workunit.client.1.smithi176.stdout:2/488: creat d4/df/d2e/d6f/d5d/d67/f97 x:0 0 0 2024-09-21T12:46:57.532 INFO:tasks.workunit.client.1.smithi176.stdout:5/392: dread d0/d13/d63/f3a [0,4194304] 0 2024-09-21T12:46:57.532 INFO:tasks.workunit.client.1.smithi176.stdout:0/567: write d9/f27 [6918989,71885] 0 2024-09-21T12:46:57.534 INFO:tasks.workunit.client.1.smithi176.stdout:2/489: write d4/df/d2e/d39/f66 [4194588,82445] 0 2024-09-21T12:46:57.535 INFO:tasks.workunit.client.1.smithi176.stdout:8/460: unlink d6/d16/f1d 0 2024-09-21T12:46:57.536 INFO:tasks.workunit.client.1.smithi176.stdout:8/461: readlink d6/db/l58 0 2024-09-21T12:46:57.540 INFO:tasks.workunit.client.1.smithi176.stdout:5/393: rename d0/fc to d0/d13/d5d/f73 0 2024-09-21T12:46:57.543 INFO:tasks.workunit.client.1.smithi176.stdout:2/490: mknod d4/df/d2e/d6f/d5d/c98 0 2024-09-21T12:46:57.544 INFO:tasks.workunit.client.1.smithi176.stdout:5/394: dread d0/d13/d63/d66/f69 [0,4194304] 0 2024-09-21T12:46:57.544 INFO:tasks.workunit.client.1.smithi176.stdout:2/491: dread - d4/df/d2e/d39/d55/f6e zero size 2024-09-21T12:46:57.545 INFO:tasks.workunit.client.1.smithi176.stdout:5/395: chown d0/d13/d5d/l61 9644762 1 2024-09-21T12:46:57.549 INFO:tasks.workunit.client.1.smithi176.stdout:1/505: truncate d0/db/d1a/d2c/d48/d50/f64 3285506 0 2024-09-21T12:46:57.550 INFO:tasks.workunit.client.1.smithi176.stdout:0/568: rename d9/d1b/l34 to d9/d1a/d1d/d23/da1/db0/lc4 0 2024-09-21T12:46:57.552 INFO:tasks.workunit.client.1.smithi176.stdout:2/492: dwrite d4/df/d2e/d6f/d5d/f8d [0,4194304] 0 2024-09-21T12:46:57.555 INFO:tasks.workunit.client.1.smithi176.stdout:5/396: mknod d0/d13/d63/d2e/d39/c74 0 2024-09-21T12:46:57.556 INFO:tasks.workunit.client.1.smithi176.stdout:8/462: getdents d6/db/d37/d7a 0 2024-09-21T12:46:57.557 INFO:tasks.workunit.client.1.smithi176.stdout:9/477: dread d1/df/d1c/f49 [0,4194304] 0 2024-09-21T12:46:57.559 INFO:tasks.workunit.client.1.smithi176.stdout:0/569: dwrite d9/d1a/d1d/d23/da1/da3/f9d [0,4194304] 0 2024-09-21T12:46:57.559 INFO:tasks.workunit.client.1.smithi176.stdout:2/493: mknod d4/df/d2e/d6f/d5d/d81/d95/c99 0 2024-09-21T12:46:57.560 INFO:tasks.workunit.client.1.smithi176.stdout:2/494: chown d4/df/d2e/d6f/d5d/c98 811 1 2024-09-21T12:46:57.563 INFO:tasks.workunit.client.1.smithi176.stdout:1/506: rename d0/db/d25/d2b/f97 to d0/db/d1a/fb5 0 2024-09-21T12:46:57.564 INFO:tasks.workunit.client.1.smithi176.stdout:8/463: unlink d6/d8/d24/f38 0 2024-09-21T12:46:57.565 INFO:tasks.workunit.client.1.smithi176.stdout:9/478: creat d1/d8b/fa4 x:0 0 0 2024-09-21T12:46:57.567 INFO:tasks.workunit.client.1.smithi176.stdout:9/479: dread - d1/f97 zero size 2024-09-21T12:46:57.567 INFO:tasks.workunit.client.1.smithi176.stdout:2/495: dwrite d4/df/d2e/d39/d55/f6e [0,4194304] 0 2024-09-21T12:46:57.568 INFO:tasks.workunit.client.1.smithi176.stdout:1/507: chown d0/db/d1a/d2c/d48/d50/c8b 196 1 2024-09-21T12:46:57.569 INFO:tasks.workunit.client.1.smithi176.stdout:5/397: creat d0/d10/f75 x:0 0 0 2024-09-21T12:46:57.569 INFO:tasks.workunit.client.1.smithi176.stdout:5/398: stat d0 0 2024-09-21T12:46:57.571 INFO:tasks.workunit.client.1.smithi176.stdout:5/399: dread d0/d13/d63/d2e/d39/f43 [0,4194304] 0 2024-09-21T12:46:57.571 INFO:tasks.workunit.client.1.smithi176.stdout:8/464: mknod d6/d16/c95 0 2024-09-21T12:46:57.571 INFO:tasks.workunit.client.1.smithi176.stdout:1/508: stat d0/db/d25/d2b/l76 0 2024-09-21T12:46:57.573 INFO:tasks.workunit.client.1.smithi176.stdout:2/496: mknod d4/d63/d93/c9a 0 2024-09-21T12:46:57.573 INFO:tasks.workunit.client.1.smithi176.stdout:0/570: getdents d9/d1b/d63 0 2024-09-21T12:46:57.574 INFO:tasks.workunit.client.1.smithi176.stdout:0/571: readlink d9/d1a/d1d/la9 0 2024-09-21T12:46:57.575 INFO:tasks.workunit.client.1.smithi176.stdout:0/572: write d9/d1a/d3f/d40/fb2 [1233803,124460] 0 2024-09-21T12:46:57.576 INFO:tasks.workunit.client.1.smithi176.stdout:8/465: unlink d6/d8/d24/d5e/l91 0 2024-09-21T12:46:57.577 INFO:tasks.workunit.client.1.smithi176.stdout:5/400: symlink d0/d13/d63/d2e/d39/d3b/l76 0 2024-09-21T12:46:57.577 INFO:tasks.workunit.client.1.smithi176.stdout:5/401: chown d0/d10/l59 26620 1 2024-09-21T12:46:57.578 INFO:tasks.workunit.client.1.smithi176.stdout:1/509: write d0/db/d1a/d2c/d84/fa0 [915655,29649] 0 2024-09-21T12:46:57.580 INFO:tasks.workunit.client.1.smithi176.stdout:0/573: write d9/d1a/d3f/d40/f4c [5133443,81250] 0 2024-09-21T12:46:57.580 INFO:tasks.workunit.client.1.smithi176.stdout:8/466: creat d6/db/d37/d7a/f96 x:0 0 0 2024-09-21T12:46:57.581 INFO:tasks.workunit.client.1.smithi176.stdout:0/574: chown d9/d1a/d1d/d23/da1/da3/f97 77417588 1 2024-09-21T12:46:57.581 INFO:tasks.workunit.client.1.smithi176.stdout:8/467: chown d6/d8/d24/d35/f75 432851 1 2024-09-21T12:46:57.584 INFO:tasks.workunit.client.1.smithi176.stdout:5/402: getdents d0/d13/d63/d72 0 2024-09-21T12:46:57.587 INFO:tasks.workunit.client.1.smithi176.stdout:9/480: truncate d1/df/f41 3916462 0 2024-09-21T12:46:57.588 INFO:tasks.workunit.client.1.smithi176.stdout:5/403: unlink d0/l17 0 2024-09-21T12:46:57.590 INFO:tasks.workunit.client.1.smithi176.stdout:1/510: creat d0/db/d25/fb6 x:0 0 0 2024-09-21T12:46:57.591 INFO:tasks.workunit.client.1.smithi176.stdout:9/481: mknod d1/d8b/ca5 0 2024-09-21T12:46:57.591 INFO:tasks.workunit.client.1.smithi176.stdout:2/497: truncate d4/d63/f94 1258522 0 2024-09-21T12:46:57.591 INFO:tasks.workunit.client.1.smithi176.stdout:5/404: rmdir d0/d13/d63/d66 39 2024-09-21T12:46:57.598 INFO:tasks.workunit.client.1.smithi176.stdout:5/405: write d0/f27 [6718309,38379] 0 2024-09-21T12:46:57.598 INFO:tasks.workunit.client.1.smithi176.stdout:1/511: creat d0/db/d1a/fb7 x:0 0 0 2024-09-21T12:46:57.598 INFO:tasks.workunit.client.1.smithi176.stdout:2/498: mkdir d4/d3d/d65/d9b 0 2024-09-21T12:46:57.604 INFO:tasks.workunit.client.1.smithi176.stdout:1/512: mknod d0/db/d1a/d2c/d37/cb8 0 2024-09-21T12:46:57.606 INFO:tasks.workunit.client.1.smithi176.stdout:1/513: readlink d0/db/l4e 0 2024-09-21T12:46:57.606 INFO:tasks.workunit.client.1.smithi176.stdout:0/575: dread d9/d1b/d63/d75/fad [0,4194304] 0 2024-09-21T12:46:57.608 INFO:tasks.workunit.client.1.smithi176.stdout:9/482: dwrite d1/d63/f9f [0,4194304] 0 2024-09-21T12:46:57.611 INFO:tasks.workunit.client.1.smithi176.stdout:5/406: rename d0/d13/d63/d2e/d37/d55/f6a to d0/d13/d63/d2e/d39/d41/f77 0 2024-09-21T12:46:57.611 INFO:tasks.workunit.client.1.smithi176.stdout:2/499: dwrite d4/d63/d93/f82 [0,4194304] 0 2024-09-21T12:46:57.614 INFO:tasks.workunit.client.1.smithi176.stdout:0/576: symlink d9/d1a/d1d/d23/da1/da3/lc5 0 2024-09-21T12:46:57.616 INFO:tasks.workunit.client.1.smithi176.stdout:9/483: creat d1/d8b/fa6 x:0 0 0 2024-09-21T12:46:57.619 INFO:tasks.workunit.client.1.smithi176.stdout:1/514: link d0/f3 d0/db/d1a/d2c/d84/fb9 0 2024-09-21T12:46:57.621 INFO:tasks.workunit.client.1.smithi176.stdout:2/500: rename d4/df/c72 to d4/df/d2e/d6f/d5d/d81/d95/c9c 0 2024-09-21T12:46:57.621 INFO:tasks.workunit.client.1.smithi176.stdout:9/484: symlink d1/df/d48/d69/d40/d84/la7 0 2024-09-21T12:46:57.622 INFO:tasks.workunit.client.1.smithi176.stdout:5/407: dwrite d0/f52 [0,4194304] 0 2024-09-21T12:46:57.625 INFO:tasks.workunit.client.1.smithi176.stdout:1/515: fdatasync d0/db/d1a/d2c/d84/fb9 0 2024-09-21T12:46:57.626 INFO:tasks.workunit.client.1.smithi176.stdout:5/408: truncate d0/d13/d63/d2e/d37/d55/f6e 412056 0 2024-09-21T12:46:57.627 INFO:tasks.workunit.client.1.smithi176.stdout:5/409: stat d0/d13/d63/d2e/d39/f43 0 2024-09-21T12:46:57.628 INFO:tasks.workunit.client.1.smithi176.stdout:2/501: creat d4/d3d/d65/f9d x:0 0 0 2024-09-21T12:46:57.630 INFO:tasks.workunit.client.1.smithi176.stdout:2/502: fdatasync d4/df/f5a 0 2024-09-21T12:46:57.631 INFO:tasks.workunit.client.1.smithi176.stdout:8/468: dread d6/d8/d54/f76 [0,4194304] 0 2024-09-21T12:46:57.631 INFO:tasks.workunit.client.1.smithi176.stdout:4/456: sync 2024-09-21T12:46:57.632 INFO:tasks.workunit.client.1.smithi176.stdout:4/457: chown d3/d42/d56/d4e/f52 987482535 1 2024-09-21T12:46:57.633 INFO:tasks.workunit.client.1.smithi176.stdout:4/458: readlink d3/d42/d56/l3e 0 2024-09-21T12:46:57.639 INFO:tasks.workunit.client.1.smithi176.stdout:5/410: link d0/d10/l22 d0/d13/d63/d66/l78 0 2024-09-21T12:46:57.643 INFO:tasks.workunit.client.1.smithi176.stdout:4/459: link d3/f3c d3/d42/d47/d5c/f94 0 2024-09-21T12:46:57.643 INFO:tasks.workunit.client.1.smithi176.stdout:9/485: dwrite d1/df/d1c/f49 [0,4194304] 0 2024-09-21T12:46:57.645 INFO:tasks.workunit.client.1.smithi176.stdout:9/486: fdatasync d1/df/d48/d69/d40/d84/f95 0 2024-09-21T12:46:57.645 INFO:tasks.workunit.client.1.smithi176.stdout:4/460: truncate d3/d42/d56/f8c 1586250 0 2024-09-21T12:46:57.645 INFO:tasks.workunit.client.1.smithi176.stdout:5/411: truncate d0/d13/d63/d66/f69 4202782 0 2024-09-21T12:46:57.646 INFO:tasks.workunit.client.1.smithi176.stdout:2/503: truncate d4/f7f 5432727 0 2024-09-21T12:46:57.646 INFO:tasks.workunit.client.1.smithi176.stdout:8/469: truncate d6/db/f43 1266171 0 2024-09-21T12:46:57.647 INFO:tasks.workunit.client.1.smithi176.stdout:9/487: unlink d1/df/d23/f9c 0 2024-09-21T12:46:57.647 INFO:tasks.workunit.client.1.smithi176.stdout:4/461: mknod d3/d21/d5e/c95 0 2024-09-21T12:46:57.649 INFO:tasks.workunit.client.1.smithi176.stdout:4/462: fdatasync d3/f32 0 2024-09-21T12:46:57.650 INFO:tasks.workunit.client.1.smithi176.stdout:8/470: creat d6/d16/d36/d7d/d81/f97 x:0 0 0 2024-09-21T12:46:57.651 INFO:tasks.workunit.client.1.smithi176.stdout:9/488: creat d1/df/d48/d69/d40/d84/fa8 x:0 0 0 2024-09-21T12:46:57.652 INFO:tasks.workunit.client.1.smithi176.stdout:4/463: chown d3/l65 3 1 2024-09-21T12:46:57.652 INFO:tasks.workunit.client.1.smithi176.stdout:9/489: chown d1/fd 3457 1 2024-09-21T12:46:57.653 INFO:tasks.workunit.client.1.smithi176.stdout:5/412: dread d0/d13/d5d/f73 [0,4194304] 0 2024-09-21T12:46:57.653 INFO:tasks.workunit.client.1.smithi176.stdout:2/504: truncate d4/d3a/f45 3439758 0 2024-09-21T12:46:57.654 INFO:tasks.workunit.client.1.smithi176.stdout:8/471: mkdir d6/db/d13/d98 0 2024-09-21T12:46:57.654 INFO:tasks.workunit.client.1.smithi176.stdout:2/505: truncate f2 4235882 0 2024-09-21T12:46:57.656 INFO:tasks.workunit.client.1.smithi176.stdout:4/464: mkdir d3/d5/db/d96 0 2024-09-21T12:46:57.656 INFO:tasks.workunit.client.1.smithi176.stdout:2/506: truncate d4/df/d2e/d39/d55/f75 267119 0 2024-09-21T12:46:57.657 INFO:tasks.workunit.client.1.smithi176.stdout:8/472: rmdir d6/d8 39 2024-09-21T12:46:57.658 INFO:tasks.workunit.client.1.smithi176.stdout:9/490: rename d1/d61/d73/d7d/l5e to d1/df/d23/d67/la9 0 2024-09-21T12:46:57.661 INFO:tasks.workunit.client.1.smithi176.stdout:5/413: creat d0/d10/f79 x:0 0 0 2024-09-21T12:46:57.665 INFO:tasks.workunit.client.1.smithi176.stdout:4/465: unlink d3/d5/db/l86 0 2024-09-21T12:46:57.666 INFO:tasks.workunit.client.1.smithi176.stdout:4/466: readlink d3/d42/d56/d4e/l93 0 2024-09-21T12:46:57.666 INFO:tasks.workunit.client.1.smithi176.stdout:9/491: creat d1/df/d48/d69/d4d/faa x:0 0 0 2024-09-21T12:46:57.667 INFO:tasks.workunit.client.1.smithi176.stdout:2/507: mkdir d4/d63/d93/d80/d9e 0 2024-09-21T12:46:57.670 INFO:tasks.workunit.client.1.smithi176.stdout:9/492: creat d1/d61/d73/d7d/fab x:0 0 0 2024-09-21T12:46:57.671 INFO:tasks.workunit.client.1.smithi176.stdout:9/493: write d1/df/d48/d69/d40/d84/f95 [574601,468] 0 2024-09-21T12:46:57.673 INFO:tasks.workunit.client.1.smithi176.stdout:4/467: mkdir d3/d21/d97 0 2024-09-21T12:46:57.673 INFO:tasks.workunit.client.1.smithi176.stdout:4/468: dread - d3/d42/d56/f90 zero size 2024-09-21T12:46:57.676 INFO:tasks.workunit.client.1.smithi176.stdout:9/494: creat d1/df/d48/d69/d76/fac x:0 0 0 2024-09-21T12:46:57.677 INFO:tasks.workunit.client.1.smithi176.stdout:4/469: readlink d3/d5/d37/l8a 0 2024-09-21T12:46:57.677 INFO:tasks.workunit.client.1.smithi176.stdout:5/414: link d0/d13/d63/d2e/c4d d0/c7a 0 2024-09-21T12:46:57.678 INFO:tasks.workunit.client.1.smithi176.stdout:5/415: truncate d0/f64 4319958 0 2024-09-21T12:46:57.679 INFO:tasks.workunit.client.1.smithi176.stdout:5/416: readlink d0/d13/d63/l54 0 2024-09-21T12:46:57.679 INFO:tasks.workunit.client.1.smithi176.stdout:5/417: write d0/d13/d63/f51 [1485030,102940] 0 2024-09-21T12:46:57.687 INFO:tasks.workunit.client.1.smithi176.stdout:9/495: truncate d1/df/d48/d69/f6f 440552 0 2024-09-21T12:46:57.690 INFO:tasks.workunit.client.1.smithi176.stdout:4/470: getdents d3 0 2024-09-21T12:46:57.693 INFO:tasks.workunit.client.1.smithi176.stdout:9/496: dread d1/df/f12 [0,4194304] 0 2024-09-21T12:46:57.693 INFO:tasks.workunit.client.1.smithi176.stdout:4/471: link d3/d42/d56/l3e d3/d42/d56/l98 0 2024-09-21T12:46:57.694 INFO:tasks.workunit.client.1.smithi176.stdout:9/497: chown d1/df/d48/d69/d4d/f96 3965974 1 2024-09-21T12:46:57.695 INFO:tasks.workunit.client.1.smithi176.stdout:4/472: write d3/d5/d37/f68 [589486,125340] 0 2024-09-21T12:46:57.696 INFO:tasks.workunit.client.1.smithi176.stdout:2/508: dwrite d4/f7f [4194304,4194304] 0 2024-09-21T12:46:57.697 INFO:tasks.workunit.client.1.smithi176.stdout:9/498: mknod d1/d61/d73/cad 0 2024-09-21T12:46:57.697 INFO:tasks.workunit.client.1.smithi176.stdout:4/473: truncate d3/d21/d27/f7d 774624 0 2024-09-21T12:46:57.698 INFO:tasks.workunit.client.1.smithi176.stdout:9/499: readlink d1/df/d23/l54 0 2024-09-21T12:46:57.705 INFO:tasks.workunit.client.1.smithi176.stdout:2/509: dwrite d4/df/f5a [0,4194304] 0 2024-09-21T12:46:57.707 INFO:tasks.workunit.client.1.smithi176.stdout:4/474: dwrite d3/d5/db/d36/f43 [0,4194304] 0 2024-09-21T12:46:57.707 INFO:tasks.workunit.client.1.smithi176.stdout:2/510: fsync d4/df/d2e/d39/d55/f6e 0 2024-09-21T12:46:57.710 INFO:tasks.workunit.client.1.smithi176.stdout:4/475: symlink d3/d5/d37/l99 0 2024-09-21T12:46:57.713 INFO:tasks.workunit.client.1.smithi176.stdout:4/476: creat d3/d21/d97/f9a x:0 0 0 2024-09-21T12:46:57.715 INFO:tasks.workunit.client.1.smithi176.stdout:2/511: dwrite d4/df/d2e/d39/f66 [0,4194304] 0 2024-09-21T12:46:57.716 INFO:tasks.workunit.client.1.smithi176.stdout:4/477: mkdir d3/d21/d27/d9b 0 2024-09-21T12:46:57.720 INFO:tasks.workunit.client.1.smithi176.stdout:4/478: mknod d3/d21/d97/c9c 0 2024-09-21T12:46:57.722 INFO:tasks.workunit.client.1.smithi176.stdout:4/479: creat d3/d5/db/d36/f9d x:0 0 0 2024-09-21T12:46:57.724 INFO:tasks.workunit.client.1.smithi176.stdout:9/500: dread d1/f2f [0,4194304] 0 2024-09-21T12:46:57.729 INFO:tasks.workunit.client.1.smithi176.stdout:4/480: dwrite d3/d21/d27/d2c/f67 [0,4194304] 0 2024-09-21T12:46:57.732 INFO:tasks.workunit.client.1.smithi176.stdout:4/481: creat d3/d42/d4d/f9e x:0 0 0 2024-09-21T12:46:57.732 INFO:tasks.workunit.client.1.smithi176.stdout:9/501: dwrite d1/df/d48/d69/d40/f53 [0,4194304] 0 2024-09-21T12:46:57.734 INFO:tasks.workunit.client.1.smithi176.stdout:9/502: fsync d1/d8b/fa4 0 2024-09-21T12:46:57.737 INFO:tasks.workunit.client.1.smithi176.stdout:9/503: creat d1/df/d48/d69/d76/fae x:0 0 0 2024-09-21T12:46:57.740 INFO:tasks.workunit.client.1.smithi176.stdout:4/482: dwrite d3/d5/db/f33 [0,4194304] 0 2024-09-21T12:46:57.742 INFO:tasks.workunit.client.1.smithi176.stdout:9/504: creat d1/d8b/faf x:0 0 0 2024-09-21T12:46:57.743 INFO:tasks.workunit.client.1.smithi176.stdout:9/505: fdatasync d1/df/d1c/f49 0 2024-09-21T12:46:57.747 INFO:tasks.workunit.client.1.smithi176.stdout:9/506: mknod d1/df/d48/d69/d4d/cb0 0 2024-09-21T12:46:57.750 INFO:tasks.workunit.client.1.smithi176.stdout:9/507: truncate d1/df/d48/d69/f6f 1239071 0 2024-09-21T12:46:57.752 INFO:tasks.workunit.client.1.smithi176.stdout:9/508: rmdir d1/df/d48/d69/d38 39 2024-09-21T12:46:57.754 INFO:tasks.workunit.client.1.smithi176.stdout:9/509: link d1/f33 d1/d8b/fb1 0 2024-09-21T12:46:57.769 INFO:tasks.workunit.client.1.smithi176.stdout:4/483: dread d3/d42/d4d/f5b [0,4194304] 0 2024-09-21T12:46:57.772 INFO:tasks.workunit.client.1.smithi176.stdout:4/484: link d3/d5/db/l30 d3/d21/d27/l9f 0 2024-09-21T12:46:57.772 INFO:tasks.workunit.client.1.smithi176.stdout:4/485: write d3/d5/db/f33 [3761983,24833] 0 2024-09-21T12:46:57.774 INFO:tasks.workunit.client.1.smithi176.stdout:4/486: creat d3/d42/d4d/fa0 x:0 0 0 2024-09-21T12:46:57.777 INFO:tasks.workunit.client.1.smithi176.stdout:4/487: mknod d3/d5/db/ca1 0 2024-09-21T12:46:57.777 INFO:tasks.workunit.client.1.smithi176.stdout:4/488: mkdir d3/d21/d27/d9b/da2 0 2024-09-21T12:46:57.778 INFO:tasks.workunit.client.1.smithi176.stdout:6/440: sync 2024-09-21T12:46:57.778 INFO:tasks.workunit.client.1.smithi176.stdout:7/588: sync 2024-09-21T12:46:57.779 INFO:tasks.workunit.client.1.smithi176.stdout:6/441: chown d2/dd/d26/d2b/d10/d1b/d37 115814 1 2024-09-21T12:46:57.779 INFO:tasks.workunit.client.1.smithi176.stdout:6/442: stat d2/dd/f48 0 2024-09-21T12:46:57.779 INFO:tasks.workunit.client.1.smithi176.stdout:7/589: mkdir d0/d2/d30/d93/d96/d89/dcf 0 2024-09-21T12:46:57.780 INFO:tasks.workunit.client.1.smithi176.stdout:4/489: mkdir d3/d5/db/d96/da3 0 2024-09-21T12:46:57.784 INFO:tasks.workunit.client.1.smithi176.stdout:6/443: link d2/dd/d26/d2b/d10/d1b/l57 d2/dd/d26/d2b/d10/l89 0 2024-09-21T12:46:57.787 INFO:tasks.workunit.client.1.smithi176.stdout:6/444: chown d2/dd/d26/d2b/d10/d1b/l58 1102 1 2024-09-21T12:46:57.789 INFO:tasks.workunit.client.1.smithi176.stdout:4/490: truncate d3/d21/f89 500660 0 2024-09-21T12:46:57.791 INFO:tasks.workunit.client.1.smithi176.stdout:4/491: write d3/d5/db/f31 [1541219,117934] 0 2024-09-21T12:46:57.792 INFO:tasks.workunit.client.1.smithi176.stdout:4/492: fdatasync d3/d5/f15 0 2024-09-21T12:46:57.792 INFO:tasks.workunit.client.1.smithi176.stdout:7/590: dread d0/f20 [0,4194304] 0 2024-09-21T12:46:57.794 INFO:tasks.workunit.client.1.smithi176.stdout:6/445: truncate d2/dd/d26/f38 517190 0 2024-09-21T12:46:57.795 INFO:tasks.workunit.client.1.smithi176.stdout:7/591: truncate d0/d5d/d5e/f5f 317420 0 2024-09-21T12:46:57.795 INFO:tasks.workunit.client.1.smithi176.stdout:6/446: chown d2/dd/d26/d2b/d10/f1f 26585 1 2024-09-21T12:46:57.796 INFO:tasks.workunit.client.1.smithi176.stdout:4/493: creat d3/d21/d97/fa4 x:0 0 0 2024-09-21T12:46:57.800 INFO:tasks.workunit.client.1.smithi176.stdout:6/447: creat d2/dd/d26/d2b/d10/d87/f8a x:0 0 0 2024-09-21T12:46:57.801 INFO:tasks.workunit.client.1.smithi176.stdout:7/592: creat d0/d2/db/fd0 x:0 0 0 2024-09-21T12:46:57.802 INFO:tasks.workunit.client.1.smithi176.stdout:4/494: creat d3/d5/db/d96/da3/fa5 x:0 0 0 2024-09-21T12:46:57.803 INFO:tasks.workunit.client.1.smithi176.stdout:6/448: creat d2/dd/d26/d2b/d10/d39/f8b x:0 0 0 2024-09-21T12:46:57.804 INFO:tasks.workunit.client.1.smithi176.stdout:7/593: symlink d0/d2/db/d10/d72/d7e/dba/ld1 0 2024-09-21T12:46:57.805 INFO:tasks.workunit.client.1.smithi176.stdout:6/449: mkdir d2/dd/d26/d2b/d10/d8c 0 2024-09-21T12:46:57.806 INFO:tasks.workunit.client.1.smithi176.stdout:6/450: readlink d2/dd/d26/l44 0 2024-09-21T12:46:57.807 INFO:tasks.workunit.client.1.smithi176.stdout:6/451: write d2/dd/d26/d2b/f2e [17154,88163] 0 2024-09-21T12:46:57.807 INFO:tasks.workunit.client.1.smithi176.stdout:7/594: creat d0/d2/da8/dbe/fd2 x:0 0 0 2024-09-21T12:46:57.811 INFO:tasks.workunit.client.1.smithi176.stdout:6/452: rmdir d2/d63/d75 0 2024-09-21T12:46:57.813 INFO:tasks.workunit.client.1.smithi176.stdout:7/595: dwrite d0/d2/db/fd0 [0,4194304] 0 2024-09-21T12:46:57.813 INFO:tasks.workunit.client.1.smithi176.stdout:6/453: symlink d2/dd/d79/l8d 0 2024-09-21T12:46:57.821 INFO:tasks.workunit.client.1.smithi176.stdout:7/596: dwrite d0/f20 [0,4194304] 0 2024-09-21T12:46:57.821 INFO:tasks.workunit.client.1.smithi176.stdout:6/454: dwrite d2/f64 [0,4194304] 0 2024-09-21T12:46:57.834 INFO:tasks.workunit.client.1.smithi176.stdout:7/597: dwrite d0/d2/db/fd0 [4194304,4194304] 0 2024-09-21T12:46:57.835 INFO:tasks.workunit.client.1.smithi176.stdout:7/598: dread - d0/d2/db/d10/fbf zero size 2024-09-21T12:46:57.838 INFO:tasks.workunit.client.1.smithi176.stdout:7/599: mknod d0/d2/db/d10/d72/d7e/cd3 0 2024-09-21T12:46:57.838 INFO:tasks.workunit.client.1.smithi176.stdout:7/600: chown d0/d5d 63164772 1 2024-09-21T12:46:57.839 INFO:tasks.workunit.client.1.smithi176.stdout:7/601: write d0/d2/db/d10/d72/d51/fa7 [980025,45381] 0 2024-09-21T12:46:57.842 INFO:tasks.workunit.client.1.smithi176.stdout:7/602: creat d0/d2/db/d10/d31/fd4 x:0 0 0 2024-09-21T12:46:57.844 INFO:tasks.workunit.client.1.smithi176.stdout:7/603: creat d0/d5d/fd5 x:0 0 0 2024-09-21T12:46:57.847 INFO:tasks.workunit.client.1.smithi176.stdout:7/604: creat d0/d2/db/d10/d23/d85/fd6 x:0 0 0 2024-09-21T12:46:57.847 INFO:tasks.workunit.client.1.smithi176.stdout:6/455: dread d2/dd/d26/d2b/d10/d1b/f2a [0,4194304] 0 2024-09-21T12:46:57.853 INFO:tasks.workunit.client.1.smithi176.stdout:6/456: dwrite d2/dd/d26/d2b/d10/d39/f73 [0,4194304] 0 2024-09-21T12:46:57.856 INFO:tasks.workunit.client.1.smithi176.stdout:3/587: sync 2024-09-21T12:46:57.858 INFO:tasks.workunit.client.1.smithi176.stdout:3/588: creat d1/d34/d42/fdd x:0 0 0 2024-09-21T12:46:57.861 INFO:tasks.workunit.client.1.smithi176.stdout:3/589: creat d1/d34/d57/dc7/fde x:0 0 0 2024-09-21T12:46:57.863 INFO:tasks.workunit.client.1.smithi176.stdout:3/590: creat d1/d5/d25/d84/fdf x:0 0 0 2024-09-21T12:46:57.864 INFO:tasks.workunit.client.1.smithi176.stdout:3/591: readlink d1/d5/l6b 0 2024-09-21T12:46:57.864 INFO:tasks.workunit.client.1.smithi176.stdout:3/592: readlink d1/d34/d57/l70 0 2024-09-21T12:46:57.866 INFO:tasks.workunit.client.1.smithi176.stdout:3/593: mknod d1/d5/ce0 0 2024-09-21T12:46:57.872 INFO:tasks.workunit.client.1.smithi176.stdout:3/594: truncate d1/f18 989334 0 2024-09-21T12:46:57.872 INFO:tasks.workunit.client.1.smithi176.stdout:3/595: truncate d1/d35/fc9 930488 0 2024-09-21T12:46:57.874 INFO:tasks.workunit.client.1.smithi176.stdout:3/596: creat d1/d5/d25/d61/fe1 x:0 0 0 2024-09-21T12:46:57.875 INFO:tasks.workunit.client.1.smithi176.stdout:3/597: fdatasync d1/d9e/fb6 0 2024-09-21T12:46:57.878 INFO:tasks.workunit.client.1.smithi176.stdout:3/598: dread d1/d3e/fbe [0,4194304] 0 2024-09-21T12:46:57.882 INFO:tasks.workunit.client.1.smithi176.stdout:3/599: creat d1/d5/d25/d76/db3/fe2 x:0 0 0 2024-09-21T12:46:57.882 INFO:tasks.workunit.client.1.smithi176.stdout:3/600: fdatasync d1/d5/d25/d38/f46 0 2024-09-21T12:46:57.884 INFO:tasks.workunit.client.1.smithi176.stdout:3/601: symlink d1/d34/dbb/dd2/le3 0 2024-09-21T12:46:57.885 INFO:tasks.workunit.client.1.smithi176.stdout:3/602: chown d1/d5/d25/d38/f3f 3 1 2024-09-21T12:46:57.887 INFO:tasks.workunit.client.1.smithi176.stdout:3/603: unlink d1/d34/d5d/fbc 0 2024-09-21T12:46:57.888 INFO:tasks.workunit.client.1.smithi176.stdout:3/604: creat d1/d5/d25/d61/dc3/fe4 x:0 0 0 2024-09-21T12:46:57.889 INFO:tasks.workunit.client.1.smithi176.stdout:3/605: fsync d1/f39 0 2024-09-21T12:46:57.949 INFO:tasks.workunit.client.1.smithi176.stdout:1/516: sync 2024-09-21T12:46:57.949 INFO:tasks.workunit.client.1.smithi176.stdout:0/577: sync 2024-09-21T12:46:57.950 INFO:tasks.workunit.client.1.smithi176.stdout:0/578: read d9/f45 [2435993,111989] 0 2024-09-21T12:46:57.951 INFO:tasks.workunit.client.1.smithi176.stdout:0/579: fdatasync d9/d1b/f71 0 2024-09-21T12:46:57.952 INFO:tasks.workunit.client.1.smithi176.stdout:1/517: rename d0/c16 to d0/d91/cba 0 2024-09-21T12:46:57.956 INFO:tasks.workunit.client.1.smithi176.stdout:0/580: chown d9/d1b/c4b 8067210 1 2024-09-21T12:46:57.957 INFO:tasks.workunit.client.1.smithi176.stdout:1/518: mknod d0/db/d25/d41/d59/d99/db3/cbb 0 2024-09-21T12:46:57.959 INFO:tasks.workunit.client.1.smithi176.stdout:0/581: readlink d9/d1b/d63/l68 0 2024-09-21T12:46:57.959 INFO:tasks.workunit.client.1.smithi176.stdout:0/582: stat d9/d1a/d1d/d81/cac 0 2024-09-21T12:46:57.961 INFO:tasks.workunit.client.1.smithi176.stdout:1/519: dread d0/db/d1a/d2c/f57 [0,4194304] 0 2024-09-21T12:46:57.963 INFO:tasks.workunit.client.1.smithi176.stdout:0/583: creat d9/d1a/d1d/d23/da1/da3/d1e/dbf/fc6 x:0 0 0 2024-09-21T12:46:57.964 INFO:tasks.workunit.client.1.smithi176.stdout:1/520: creat d0/db/d1a/d2c/d66/fbc x:0 0 0 2024-09-21T12:46:57.965 INFO:tasks.workunit.client.1.smithi176.stdout:1/521: dread - d0/db/d25/d41/fae zero size 2024-09-21T12:46:57.966 INFO:tasks.workunit.client.1.smithi176.stdout:1/522: chown d0/db/d6a/d89 421020605 1 2024-09-21T12:46:57.967 INFO:tasks.workunit.client.1.smithi176.stdout:0/584: dread d9/d35/f7d [0,4194304] 0 2024-09-21T12:46:57.968 INFO:tasks.workunit.client.1.smithi176.stdout:1/523: creat d0/db/d1a/d2c/d37/fbd x:0 0 0 2024-09-21T12:46:57.970 INFO:tasks.workunit.client.1.smithi176.stdout:1/524: truncate d0/db/d1a/d2c/f57 1858596 0 2024-09-21T12:46:57.970 INFO:tasks.workunit.client.1.smithi176.stdout:0/585: creat d9/d1b/d63/d75/fc7 x:0 0 0 2024-09-21T12:46:57.971 INFO:tasks.workunit.client.1.smithi176.stdout:0/586: rmdir d9/d1b 39 2024-09-21T12:46:57.972 INFO:tasks.workunit.client.1.smithi176.stdout:1/525: mknod d0/d91/db1/cbe 0 2024-09-21T12:46:57.974 INFO:tasks.workunit.client.1.smithi176.stdout:1/526: chown d0/db/d1a/d2c/d84/c96 6 1 2024-09-21T12:46:57.975 INFO:tasks.workunit.client.1.smithi176.stdout:0/587: dread d9/d1a/d1d/d23/da1/da3/f5d [0,4194304] 0 2024-09-21T12:46:57.977 INFO:tasks.workunit.client.1.smithi176.stdout:1/527: fdatasync d0/db/f15 0 2024-09-21T12:46:57.978 INFO:tasks.workunit.client.1.smithi176.stdout:0/588: symlink d9/d1a/d3f/d40/lc8 0 2024-09-21T12:46:57.982 INFO:tasks.workunit.client.1.smithi176.stdout:0/589: mkdir d9/d1a/d3f/d40/dc9 0 2024-09-21T12:46:57.983 INFO:tasks.workunit.client.1.smithi176.stdout:1/528: getdents d0/db/d1a/d73 0 2024-09-21T12:46:57.984 INFO:tasks.workunit.client.1.smithi176.stdout:0/590: creat d9/d1a/d1d/d23/da1/fca x:0 0 0 2024-09-21T12:46:57.986 INFO:tasks.workunit.client.1.smithi176.stdout:1/529: mknod d0/db/d6a/d89/cbf 0 2024-09-21T12:46:57.987 INFO:tasks.workunit.client.1.smithi176.stdout:1/530: chown d0/db/d1a/d2c/d48/f68 31758999 1 2024-09-21T12:46:57.987 INFO:tasks.workunit.client.1.smithi176.stdout:0/591: creat d9/d1a/d1d/d23/d5f/fcb x:0 0 0 2024-09-21T12:46:57.987 INFO:tasks.workunit.client.1.smithi176.stdout:1/531: readlink d0/db/l4e 0 2024-09-21T12:46:57.988 INFO:tasks.workunit.client.1.smithi176.stdout:1/532: rmdir d0/db/d1a/d2c 39 2024-09-21T12:46:57.989 INFO:tasks.workunit.client.1.smithi176.stdout:8/473: sync 2024-09-21T12:46:57.990 INFO:tasks.workunit.client.1.smithi176.stdout:0/592: mkdir d9/d1b/dcc 0 2024-09-21T12:46:57.991 INFO:tasks.workunit.client.1.smithi176.stdout:0/593: chown d9/d1a/d1d/d23/da1/da3/d1e/dbf/fc6 72836 1 2024-09-21T12:46:57.991 INFO:tasks.workunit.client.1.smithi176.stdout:8/474: chown d6/d8/d24/d35/l66 2103833227 1 2024-09-21T12:46:57.992 INFO:tasks.workunit.client.1.smithi176.stdout:0/594: stat d9/d1a/d1d/d23/l55 0 2024-09-21T12:46:57.992 INFO:tasks.workunit.client.1.smithi176.stdout:8/475: fsync d6/db/d37/d7a/f96 0 2024-09-21T12:46:57.993 INFO:tasks.workunit.client.1.smithi176.stdout:8/476: dread - d6/d16/d36/d7d/d81/f97 zero size 2024-09-21T12:46:57.994 INFO:tasks.workunit.client.1.smithi176.stdout:0/595: mknod d9/d1a/d1d/d81/d8e/ccd 0 2024-09-21T12:46:57.996 INFO:tasks.workunit.client.1.smithi176.stdout:0/596: creat d9/d1b/d63/fce x:0 0 0 2024-09-21T12:46:57.999 INFO:tasks.workunit.client.1.smithi176.stdout:8/477: link d6/db/d13/f5a d6/d16/f99 0 2024-09-21T12:46:58.002 INFO:tasks.workunit.client.1.smithi176.stdout:1/533: write d0/db/d1a/d2c/d48/d50/f64 [3905264,17100] 0 2024-09-21T12:46:58.005 INFO:tasks.workunit.client.1.smithi176.stdout:1/534: creat d0/db/d25/d41/d59/fc0 x:0 0 0 2024-09-21T12:46:58.005 INFO:tasks.workunit.client.1.smithi176.stdout:0/597: link d9/d1b/d63/d77/d88/la6 d9/d1a/d1d/d23/da1/da3/lcf 0 2024-09-21T12:46:58.007 INFO:tasks.workunit.client.1.smithi176.stdout:1/535: unlink d0/db/d1a/d2c/d84/c96 0 2024-09-21T12:46:58.008 INFO:tasks.workunit.client.1.smithi176.stdout:1/536: rmdir d0/d5b 39 2024-09-21T12:46:58.009 INFO:tasks.workunit.client.1.smithi176.stdout:0/598: creat d9/d1a/fd0 x:0 0 0 2024-09-21T12:46:58.010 INFO:tasks.workunit.client.1.smithi176.stdout:1/537: fsync d0/db/d1a/d2c/d66/f6e 0 2024-09-21T12:46:58.010 INFO:tasks.workunit.client.1.smithi176.stdout:0/599: chown d9/d1b/f71 12197 1 2024-09-21T12:46:58.011 INFO:tasks.workunit.client.1.smithi176.stdout:8/478: dwrite d6/d8/d24/d35/f42 [4194304,4194304] 0 2024-09-21T12:46:58.015 INFO:tasks.workunit.client.1.smithi176.stdout:0/600: creat d9/d1a/d1d/d23/da1/db0/fd1 x:0 0 0 2024-09-21T12:46:58.016 INFO:tasks.workunit.client.1.smithi176.stdout:1/538: getdents d0/db/d1a/d73 0 2024-09-21T12:46:58.021 INFO:tasks.workunit.client.1.smithi176.stdout:1/539: creat d0/fc1 x:0 0 0 2024-09-21T12:46:58.022 INFO:tasks.workunit.client.1.smithi176.stdout:0/601: dwrite d9/d1a/d1d/d23/da1/da3/f9d [0,4194304] 0 2024-09-21T12:46:58.023 INFO:tasks.workunit.client.1.smithi176.stdout:1/540: getdents d0/db/d1a/d73 0 2024-09-21T12:46:58.026 INFO:tasks.workunit.client.1.smithi176.stdout:0/602: truncate d9/f52 2914515 0 2024-09-21T12:46:58.026 INFO:tasks.workunit.client.1.smithi176.stdout:8/479: dread d6/d16/f22 [4194304,4194304] 0 2024-09-21T12:46:58.029 INFO:tasks.workunit.client.1.smithi176.stdout:0/603: mkdir d9/d1a/db8/dd2 0 2024-09-21T12:46:58.029 INFO:tasks.workunit.client.1.smithi176.stdout:1/541: dread d0/db/f1f [0,4194304] 0 2024-09-21T12:46:58.031 INFO:tasks.workunit.client.1.smithi176.stdout:0/604: chown d9/d1b/d63/d77/d78 451 1 2024-09-21T12:46:58.034 INFO:tasks.workunit.client.1.smithi176.stdout:8/480: dwrite d6/f15 [4194304,4194304] 0 2024-09-21T12:46:58.035 INFO:tasks.workunit.client.1.smithi176.stdout:0/605: mkdir d9/d1a/d1d/d23/dd3 0 2024-09-21T12:46:58.037 INFO:tasks.workunit.client.1.smithi176.stdout:1/542: truncate d0/db/d25/d2b/d43/f54 2610958 0 2024-09-21T12:46:58.038 INFO:tasks.workunit.client.1.smithi176.stdout:0/606: mknod d9/d1a/d3f/d40/d79/cd4 0 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:7/605: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:5/418: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:3/606: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:2/512: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:6/457: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:9/510: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:4/495: sync 2024-09-21T12:46:58.040 INFO:tasks.workunit.client.1.smithi176.stdout:1/543: truncate d0/db/d25/d41/fae 967272 0 2024-09-21T12:46:58.043 INFO:tasks.workunit.client.1.smithi176.stdout:5/419: chown d0/l58 260 1 2024-09-21T12:46:58.045 INFO:tasks.workunit.client.1.smithi176.stdout:4/496: dread - d3/d42/d47/f7e zero size 2024-09-21T12:46:58.045 INFO:tasks.workunit.client.1.smithi176.stdout:9/511: dread - d1/df/d48/d69/d4d/f96 zero size 2024-09-21T12:46:58.045 INFO:tasks.workunit.client.1.smithi176.stdout:8/481: dwrite d6/d16/d36/d67/f85 [0,4194304] 0 2024-09-21T12:46:58.046 INFO:tasks.workunit.client.1.smithi176.stdout:3/607: rmdir d1/d5 39 2024-09-21T12:46:58.048 INFO:tasks.workunit.client.1.smithi176.stdout:2/513: dread d4/d63/f68 [0,4194304] 0 2024-09-21T12:46:58.050 INFO:tasks.workunit.client.1.smithi176.stdout:1/544: creat d0/d5b/fc2 x:0 0 0 2024-09-21T12:46:58.054 INFO:tasks.workunit.client.1.smithi176.stdout:9/512: creat d1/d63/fb2 x:0 0 0 2024-09-21T12:46:58.057 INFO:tasks.workunit.client.1.smithi176.stdout:0/607: dwrite d9/f16 [0,4194304] 0 2024-09-21T12:46:58.057 INFO:tasks.workunit.client.1.smithi176.stdout:6/458: dread d2/d6f/f7c [0,4194304] 0 2024-09-21T12:46:58.058 INFO:tasks.workunit.client.1.smithi176.stdout:9/513: stat d1/d8b 0 2024-09-21T12:46:58.059 INFO:tasks.workunit.client.1.smithi176.stdout:1/545: mknod d0/db/d1a/d2c/d6b/cc3 0 2024-09-21T12:46:58.061 INFO:tasks.workunit.client.1.smithi176.stdout:7/606: link d0/d5d/d8a/l99 d0/d5d/d5e/ld7 0 2024-09-21T12:46:58.067 INFO:tasks.workunit.client.1.smithi176.stdout:0/608: creat d9/d1a/d1d/d23/da1/da3/fd5 x:0 0 0 2024-09-21T12:46:58.068 INFO:tasks.workunit.client.1.smithi176.stdout:3/608: dwrite f0 [12582912,4194304] 0 2024-09-21T12:46:58.069 INFO:tasks.workunit.client.1.smithi176.stdout:8/482: dwrite d6/db/d37/d89/f8d [0,4194304] 0 2024-09-21T12:46:58.071 INFO:tasks.workunit.client.1.smithi176.stdout:4/497: dwrite d3/d42/d56/d4e/f52 [0,4194304] 0 2024-09-21T12:46:58.071 INFO:tasks.workunit.client.1.smithi176.stdout:1/546: symlink d0/db/d25/d2b/d43/d92/lc4 0 2024-09-21T12:46:58.073 INFO:tasks.workunit.client.1.smithi176.stdout:2/514: dread d4/df/f21 [0,4194304] 0 2024-09-21T12:46:58.074 INFO:tasks.workunit.client.1.smithi176.stdout:3/609: fsync d1/d9e/fb7 0 2024-09-21T12:46:58.076 INFO:tasks.workunit.client.1.smithi176.stdout:7/607: creat d0/d2/d30/d93/da2/fd8 x:0 0 0 2024-09-21T12:46:58.077 INFO:tasks.workunit.client.1.smithi176.stdout:5/420: truncate d0/d13/d63/f3d 4162447 0 2024-09-21T12:46:58.078 INFO:tasks.workunit.client.1.smithi176.stdout:4/498: dread - d3/d5/db/d96/da3/fa5 zero size 2024-09-21T12:46:58.080 INFO:tasks.workunit.client.1.smithi176.stdout:4/499: chown d3/d21/d88 6002 1 2024-09-21T12:46:58.080 INFO:tasks.workunit.client.1.smithi176.stdout:8/483: write d6/d8/d24/d5e/f8b [931810,12163] 0 2024-09-21T12:46:58.081 INFO:tasks.workunit.client.1.smithi176.stdout:1/547: readlink d0/db/d25/d2b/d43/lb0 0 2024-09-21T12:46:58.081 INFO:tasks.workunit.client.1.smithi176.stdout:3/610: mknod d1/d8d/ce5 0 2024-09-21T12:46:58.083 INFO:tasks.workunit.client.1.smithi176.stdout:0/609: symlink d9/d1a/d1d/ld6 0 2024-09-21T12:46:58.083 INFO:tasks.workunit.client.1.smithi176.stdout:2/515: mkdir d4/df/d2e/d6f/d5d/d67/d9f 0 2024-09-21T12:46:58.084 INFO:tasks.workunit.client.1.smithi176.stdout:5/421: mknod d0/d13/c7b 0 2024-09-21T12:46:58.084 INFO:tasks.workunit.client.1.smithi176.stdout:7/608: chown d0/d2/db/d10/d23/f28 511 1 2024-09-21T12:46:58.084 INFO:tasks.workunit.client.1.smithi176.stdout:6/459: link d2/dd/d26/f38 d2/dd/d26/d2b/d10/f8e 0 2024-09-21T12:46:58.087 INFO:tasks.workunit.client.1.smithi176.stdout:3/611: write d1/d34/f52 [1996422,86258] 0 2024-09-21T12:46:58.087 INFO:tasks.workunit.client.1.smithi176.stdout:1/548: write d0/f3d [56927,70681] 0 2024-09-21T12:46:58.087 INFO:tasks.workunit.client.1.smithi176.stdout:9/514: dwrite d1/df/d48/d69/d38/f43 [0,4194304] 0 2024-09-21T12:46:58.094 INFO:tasks.workunit.client.1.smithi176.stdout:7/609: symlink d0/d2/db/d10/d3b/ld9 0 2024-09-21T12:46:58.094 INFO:tasks.workunit.client.1.smithi176.stdout:3/612: stat d1/d5/c1e 0 2024-09-21T12:46:58.096 INFO:tasks.workunit.client.1.smithi176.stdout:2/516: rename d4/df/d2e/d4d/d70/c6a to d4/d40/ca0 0 2024-09-21T12:46:58.097 INFO:tasks.workunit.client.1.smithi176.stdout:5/422: symlink d0/d13/d63/d2e/d37/d55/l7c 0 2024-09-21T12:46:58.098 INFO:tasks.workunit.client.1.smithi176.stdout:8/484: link d6/d16/f99 d6/d16/d36/f9a 0 2024-09-21T12:46:58.099 INFO:tasks.workunit.client.1.smithi176.stdout:4/500: dwrite d3/d5/db/d36/f43 [0,4194304] 0 2024-09-21T12:46:58.102 INFO:tasks.workunit.client.1.smithi176.stdout:5/423: write d0/d13/d63/d2e/d39/d41/f49 [903773,22698] 0 2024-09-21T12:46:58.104 INFO:tasks.workunit.client.1.smithi176.stdout:0/610: mknod d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd/cd7 0 2024-09-21T12:46:58.104 INFO:tasks.workunit.client.1.smithi176.stdout:9/515: dwrite d1/df/d48/d69/d40/d84/fa8 [0,4194304] 0 2024-09-21T12:46:58.105 INFO:tasks.workunit.client.1.smithi176.stdout:0/611: stat d9/d35/l8b 0 2024-09-21T12:46:58.107 INFO:tasks.workunit.client.1.smithi176.stdout:9/516: read - d1/df/d48/d69/d76/fae zero size 2024-09-21T12:46:58.108 INFO:tasks.workunit.client.1.smithi176.stdout:9/517: fdatasync d1/df/d23/d67/f75 0 2024-09-21T12:46:58.109 INFO:tasks.workunit.client.1.smithi176.stdout:6/460: truncate d2/dd/d26/d2b/d10/d1b/d37/f3c 371844 0 2024-09-21T12:46:58.110 INFO:tasks.workunit.client.1.smithi176.stdout:5/424: mknod d0/d13/d5d/c7d 0 2024-09-21T12:46:58.111 INFO:tasks.workunit.client.1.smithi176.stdout:5/425: fsync d0/d13/f48 0 2024-09-21T12:46:58.111 INFO:tasks.workunit.client.1.smithi176.stdout:4/501: mkdir d3/d21/da6 0 2024-09-21T12:46:58.112 INFO:tasks.workunit.client.1.smithi176.stdout:4/502: chown d3/d42/c60 94974549 1 2024-09-21T12:46:58.113 INFO:tasks.workunit.client.1.smithi176.stdout:0/612: mkdir d9/d1a/d1d/d23/da1/da3/d8f/dd8 0 2024-09-21T12:46:58.113 INFO:tasks.workunit.client.1.smithi176.stdout:4/503: chown d3/d42/d56/d4e/f52 6 1 2024-09-21T12:46:58.114 INFO:tasks.workunit.client.1.smithi176.stdout:4/504: readlink d3/l65 0 2024-09-21T12:46:58.114 INFO:tasks.workunit.client.1.smithi176.stdout:4/505: fsync d3/d21/d97/fa4 0 2024-09-21T12:46:58.115 INFO:tasks.workunit.client.1.smithi176.stdout:1/549: rename d0/db/d25 to d0/db/d1a/d2c/dc5 0 2024-09-21T12:46:58.115 INFO:tasks.workunit.client.1.smithi176.stdout:3/613: rename d1/d34/d71 to d1/d34/d71/d91/de6 22 2024-09-21T12:46:58.116 INFO:tasks.workunit.client.1.smithi176.stdout:9/518: symlink d1/d63/lb3 0 2024-09-21T12:46:58.117 INFO:tasks.workunit.client.1.smithi176.stdout:5/426: fdatasync d0/d13/d5d/f73 0 2024-09-21T12:46:58.117 INFO:tasks.workunit.client.1.smithi176.stdout:3/614: fsync d1/d5/d25/d76/faa 0 2024-09-21T12:46:58.119 INFO:tasks.workunit.client.1.smithi176.stdout:4/506: chown d3/d42/d56/l98 1403950 1 2024-09-21T12:46:58.120 INFO:tasks.workunit.client.1.smithi176.stdout:0/613: creat d9/d1a/d1d/d23/dd3/fd9 x:0 0 0 2024-09-21T12:46:58.121 INFO:tasks.workunit.client.1.smithi176.stdout:2/517: getdents d4/df/d83 0 2024-09-21T12:46:58.122 INFO:tasks.workunit.client.1.smithi176.stdout:4/507: mkdir d3/d21/d88/da7 0 2024-09-21T12:46:58.123 INFO:tasks.workunit.client.1.smithi176.stdout:3/615: mknod d1/d9e/db4/ce7 0 2024-09-21T12:46:58.124 INFO:tasks.workunit.client.1.smithi176.stdout:7/610: dwrite d0/d2/fa [0,4194304] 0 2024-09-21T12:46:58.127 INFO:tasks.workunit.client.1.smithi176.stdout:7/611: dread - d0/d2/db/d10/d31/da0/fc4 zero size 2024-09-21T12:46:58.127 INFO:tasks.workunit.client.1.smithi176.stdout:6/461: rename d2/dd/d26/d2b/d10/d1b/d37/c4c to d2/c8f 0 2024-09-21T12:46:58.128 INFO:tasks.workunit.client.1.smithi176.stdout:2/518: rename d4/df/d2e/d6f/d5d/d67/d9f to d4/df/d2e/d6f/d5d/d67/d9f/da1 22 2024-09-21T12:46:58.130 INFO:tasks.workunit.client.1.smithi176.stdout:4/508: mkdir d3/d5/db/d96/da8 0 2024-09-21T12:46:58.131 INFO:tasks.workunit.client.1.smithi176.stdout:3/616: unlink d1/d34/d48/f4e 0 2024-09-21T12:46:58.135 INFO:tasks.workunit.client.1.smithi176.stdout:1/550: link d0/fa d0/db/d1a/d2c/dc5/fc6 0 2024-09-21T12:46:58.137 INFO:tasks.workunit.client.1.smithi176.stdout:2/519: creat d4/df/d2e/d6f/d5d/d81/d95/fa2 x:0 0 0 2024-09-21T12:46:58.138 INFO:tasks.workunit.client.1.smithi176.stdout:0/614: dwrite d9/d1a/f9b [0,4194304] 0 2024-09-21T12:46:58.138 INFO:tasks.workunit.client.1.smithi176.stdout:4/509: creat d3/d42/d47/d5c/fa9 x:0 0 0 2024-09-21T12:46:58.140 INFO:tasks.workunit.client.1.smithi176.stdout:9/519: dwrite d1/f7 [0,4194304] 0 2024-09-21T12:46:58.153 INFO:tasks.workunit.client.1.smithi176.stdout:6/462: dread d2/dd/f7a [0,4194304] 0 2024-09-21T12:46:58.174 INFO:tasks.workunit.client.1.smithi176.stdout:5/427: dwrite d0/d13/f26 [0,4194304] 0 2024-09-21T12:46:58.182 INFO:tasks.workunit.client.1.smithi176.stdout:0/615: fdatasync d9/d1a/d1d/d23/da1/da3/d1e/fc3 0 2024-09-21T12:46:58.183 INFO:tasks.workunit.client.1.smithi176.stdout:6/463: rmdir d2/dd/d26/d2b/d10/d39 39 2024-09-21T12:46:58.184 INFO:tasks.workunit.client.1.smithi176.stdout:3/617: creat d1/d34/d71/dc5/fe8 x:0 0 0 2024-09-21T12:46:58.186 INFO:tasks.workunit.client.1.smithi176.stdout:1/551: mknod d0/db/d1a/d2c/d66/d6d/cc7 0 2024-09-21T12:46:58.186 INFO:tasks.workunit.client.1.smithi176.stdout:2/520: truncate d4/d3a/f45 1587461 0 2024-09-21T12:46:58.188 INFO:tasks.workunit.client.1.smithi176.stdout:4/510: mknod d3/d21/d27/d2c/caa 0 2024-09-21T12:46:58.189 INFO:tasks.workunit.client.1.smithi176.stdout:7/612: getdents d0/d2/db/d10/d72/d7e/dba 0 2024-09-21T12:46:58.190 INFO:tasks.workunit.client.1.smithi176.stdout:4/511: chown d3/d5/db/ca1 156193201 1 2024-09-21T12:46:58.191 INFO:tasks.workunit.client.1.smithi176.stdout:6/464: chown d2/dd/d26/d2b/d10/d1b/l57 178544757 1 2024-09-21T12:46:58.191 INFO:tasks.workunit.client.1.smithi176.stdout:5/428: creat d0/d13/d63/d72/f7e x:0 0 0 2024-09-21T12:46:58.193 INFO:tasks.workunit.client.1.smithi176.stdout:0/616: dwrite d9/d1b/d63/d77/fb6 [0,4194304] 0 2024-09-21T12:46:58.194 INFO:tasks.workunit.client.1.smithi176.stdout:5/429: chown d0/f8 13426 1 2024-09-21T12:46:58.195 INFO:tasks.workunit.client.1.smithi176.stdout:7/613: symlink d0/d5d/lda 0 2024-09-21T12:46:58.195 INFO:tasks.workunit.client.1.smithi176.stdout:1/552: fsync d0/db/d6a/fac 0 2024-09-21T12:46:58.197 INFO:tasks.workunit.client.1.smithi176.stdout:5/430: chown d0/d13/d63/l4a 0 1 2024-09-21T12:46:58.200 INFO:tasks.workunit.client.1.smithi176.stdout:1/553: write d0/db/d2a/f86 [993934,45437] 0 2024-09-21T12:46:58.201 INFO:tasks.workunit.client.1.smithi176.stdout:7/614: chown d0/d2/db/c71 15413919 1 2024-09-21T12:46:58.201 INFO:tasks.workunit.client.1.smithi176.stdout:2/521: dwrite d4/df/d2e/d6f/d5d/f77 [0,4194304] 0 2024-09-21T12:46:58.208 INFO:tasks.workunit.client.1.smithi176.stdout:2/522: chown d4/df/d2e/d39/f66 766915 1 2024-09-21T12:46:58.209 INFO:tasks.workunit.client.1.smithi176.stdout:0/617: truncate d9/d1a/d20/f2d 2818420 0 2024-09-21T12:46:58.214 INFO:tasks.workunit.client.1.smithi176.stdout:2/523: write d4/d63/d93/f82 [5131876,44786] 0 2024-09-21T12:46:58.215 INFO:tasks.workunit.client.1.smithi176.stdout:5/431: dread d0/d13/d63/d2e/d39/d3b/f45 [0,4194304] 0 2024-09-21T12:46:58.215 INFO:tasks.workunit.client.1.smithi176.stdout:6/465: dwrite d2/dd/d26/d2b/d10/d1b/f2a [4194304,4194304] 0 2024-09-21T12:46:58.215 INFO:tasks.workunit.client.1.smithi176.stdout:0/618: creat d9/d1a/db8/fda x:0 0 0 2024-09-21T12:46:58.218 INFO:tasks.workunit.client.1.smithi176.stdout:7/615: truncate d0/d2/db/d10/d31/da1/fcd 845913 0 2024-09-21T12:46:58.221 INFO:tasks.workunit.client.1.smithi176.stdout:6/466: unlink d2/dd/l77 0 2024-09-21T12:46:58.222 INFO:tasks.workunit.client.1.smithi176.stdout:0/619: dread - d9/d1a/d1d/d23/da1/da3/d1e/dbf/fc6 zero size 2024-09-21T12:46:58.223 INFO:tasks.workunit.client.1.smithi176.stdout:1/554: dwrite d0/db/f7e [0,4194304] 0 2024-09-21T12:46:58.223 INFO:tasks.workunit.client.1.smithi176.stdout:7/616: read d0/d2/db/f26 [86712,71864] 0 2024-09-21T12:46:58.224 INFO:tasks.workunit.client.1.smithi176.stdout:4/512: dread d3/d5/f13 [0,4194304] 0 2024-09-21T12:46:58.226 INFO:tasks.workunit.client.1.smithi176.stdout:5/432: write d0/d13/f50 [4144869,53892] 0 2024-09-21T12:46:58.227 INFO:tasks.workunit.client.1.smithi176.stdout:7/617: symlink d0/d5d/d7a/ldb 0 2024-09-21T12:46:58.228 INFO:tasks.workunit.client.1.smithi176.stdout:2/524: getdents d4/df/d2e/d4d/d70 0 2024-09-21T12:46:58.230 INFO:tasks.workunit.client.1.smithi176.stdout:6/467: dread d2/dd/d26/d2b/d10/f82 [0,4194304] 0 2024-09-21T12:46:58.232 INFO:tasks.workunit.client.1.smithi176.stdout:1/555: mknod d0/db/d1a/d2c/d66/d6d/cc8 0 2024-09-21T12:46:58.233 INFO:tasks.workunit.client.1.smithi176.stdout:5/433: symlink d0/d13/d63/d2e/d37/d55/l7f 0 2024-09-21T12:46:58.234 INFO:tasks.workunit.client.1.smithi176.stdout:0/620: dwrite d9/f27 [0,4194304] 0 2024-09-21T12:46:58.234 INFO:tasks.workunit.client.1.smithi176.stdout:2/525: write d4/df/d2e/d6f/d6d/f71 [875409,89925] 0 2024-09-21T12:46:58.237 INFO:tasks.workunit.client.1.smithi176.stdout:6/468: symlink d2/dd/d79/l90 0 2024-09-21T12:46:58.238 INFO:tasks.workunit.client.1.smithi176.stdout:1/556: creat d0/db/d6f/fc9 x:0 0 0 2024-09-21T12:46:58.238 INFO:tasks.workunit.client.1.smithi176.stdout:4/513: rmdir d3/d5/db/d96/da8 0 2024-09-21T12:46:58.242 INFO:tasks.workunit.client.1.smithi176.stdout:0/621: unlink d9/d1a/d1d/d23/da1/da3/d1e/l9a 0 2024-09-21T12:46:58.242 INFO:tasks.workunit.client.1.smithi176.stdout:6/469: creat d2/dd/d79/f91 x:0 0 0 2024-09-21T12:46:58.243 INFO:tasks.workunit.client.1.smithi176.stdout:2/526: rename d4/df/f48 to d4/df/d83/fa3 0 2024-09-21T12:46:58.244 INFO:tasks.workunit.client.1.smithi176.stdout:4/514: mkdir d3/d42/d47/dab 0 2024-09-21T12:46:58.245 INFO:tasks.workunit.client.1.smithi176.stdout:0/622: fdatasync d9/d1a/d1d/d23/da1/da3/f13 0 2024-09-21T12:46:58.245 INFO:tasks.workunit.client.1.smithi176.stdout:1/557: chown d0/db/d1a/d2c/d48/d50/l5c 20793687 1 2024-09-21T12:46:58.249 INFO:tasks.workunit.client.1.smithi176.stdout:1/558: rename d0/f3c to d0/db/d2a/fca 0 2024-09-21T12:46:58.251 INFO:tasks.workunit.client.1.smithi176.stdout:1/559: chown d0/d63/l75 33877 1 2024-09-21T12:46:58.251 INFO:tasks.workunit.client.1.smithi176.stdout:2/527: creat d4/fa4 x:0 0 0 2024-09-21T12:46:58.252 INFO:tasks.workunit.client.1.smithi176.stdout:0/623: symlink d9/d1a/d1d/d23/da1/d99/ldb 0 2024-09-21T12:46:58.252 INFO:tasks.workunit.client.1.smithi176.stdout:7/618: dread d0/d2/db/d10/f2c [0,4194304] 0 2024-09-21T12:46:58.255 INFO:tasks.workunit.client.1.smithi176.stdout:4/515: creat d3/d21/d27/d2c/fac x:0 0 0 2024-09-21T12:46:58.255 INFO:tasks.workunit.client.1.smithi176.stdout:7/619: mkdir d0/d2/db/d10/d31/ddc 0 2024-09-21T12:46:58.256 INFO:tasks.workunit.client.1.smithi176.stdout:5/434: dread d0/f8 [0,4194304] 0 2024-09-21T12:46:58.257 INFO:tasks.workunit.client.1.smithi176.stdout:0/624: rmdir d9/d1a/d1d/d23/da1/da3/d1e/dbf 39 2024-09-21T12:46:58.258 INFO:tasks.workunit.client.1.smithi176.stdout:4/516: write d3/d42/d56/d4e/f7b [1728899,56557] 0 2024-09-21T12:46:58.258 INFO:tasks.workunit.client.1.smithi176.stdout:1/560: truncate d0/db/d1a/d2c/dc5/d41/d59/f80 1394511 0 2024-09-21T12:46:58.259 INFO:tasks.workunit.client.1.smithi176.stdout:7/620: creat d0/d98/fdd x:0 0 0 2024-09-21T12:46:58.259 INFO:tasks.workunit.client.1.smithi176.stdout:5/435: chown d0/d13/d63/d2e/d39/l5b 1397885 1 2024-09-21T12:46:58.260 INFO:tasks.workunit.client.1.smithi176.stdout:8/485: sync 2024-09-21T12:46:58.261 INFO:tasks.workunit.client.1.smithi176.stdout:4/517: write d3/d21/d27/d2c/f4b [4781756,77654] 0 2024-09-21T12:46:58.261 INFO:tasks.workunit.client.1.smithi176.stdout:1/561: chown d0/db/d1a/d2c/dc5/d41/d59 21 1 2024-09-21T12:46:58.263 INFO:tasks.workunit.client.1.smithi176.stdout:5/436: write d0/d13/d63/d72/f7e [5954,47674] 0 2024-09-21T12:46:58.264 INFO:tasks.workunit.client.1.smithi176.stdout:2/528: truncate d4/df/d2e/f7a 182534 0 2024-09-21T12:46:58.266 INFO:tasks.workunit.client.1.smithi176.stdout:1/562: creat d0/db/d6f/fcb x:0 0 0 2024-09-21T12:46:58.266 INFO:tasks.workunit.client.1.smithi176.stdout:7/621: write d0/d2/db/d10/d72/d51/f6e [428793,69335] 0 2024-09-21T12:46:58.267 INFO:tasks.workunit.client.1.smithi176.stdout:6/470: dread d2/dd/d26/d2b/d10/d39/f5b [0,4194304] 0 2024-09-21T12:46:58.267 INFO:tasks.workunit.client.1.smithi176.stdout:8/486: unlink d6/d16/c30 0 2024-09-21T12:46:58.269 INFO:tasks.workunit.client.1.smithi176.stdout:5/437: fdatasync d0/d13/d63/d2e/d39/f4b 0 2024-09-21T12:46:58.270 INFO:tasks.workunit.client.1.smithi176.stdout:6/471: read d2/dd/d26/d2b/f7e [2123109,99119] 0 2024-09-21T12:46:58.271 INFO:tasks.workunit.client.1.smithi176.stdout:5/438: dread - d0/d13/f48 zero size 2024-09-21T12:46:58.272 INFO:tasks.workunit.client.1.smithi176.stdout:1/563: dread d0/db/d1a/d2c/d84/fa0 [0,4194304] 0 2024-09-21T12:46:58.273 INFO:tasks.workunit.client.1.smithi176.stdout:4/518: link d3/d5/db/f33 d3/d5/db/d96/da3/fad 0 2024-09-21T12:46:58.274 INFO:tasks.workunit.client.1.smithi176.stdout:2/529: dread d4/df/f6b [0,4194304] 0 2024-09-21T12:46:58.274 INFO:tasks.workunit.client.1.smithi176.stdout:1/564: write d0/db/d1a/d73/f95 [2442922,79438] 0 2024-09-21T12:46:58.275 INFO:tasks.workunit.client.1.smithi176.stdout:0/625: link d9/d1a/d1d/d81/cac d9/dc2/cdc 0 2024-09-21T12:46:58.276 INFO:tasks.workunit.client.1.smithi176.stdout:2/530: read d4/df/d2e/d39/d55/f75 [60843,67463] 0 2024-09-21T12:46:58.278 INFO:tasks.workunit.client.1.smithi176.stdout:2/531: fsync d4/fa4 0 2024-09-21T12:46:58.279 INFO:tasks.workunit.client.1.smithi176.stdout:4/519: mkdir d3/d42/dae 0 2024-09-21T12:46:58.280 INFO:tasks.workunit.client.1.smithi176.stdout:4/520: chown d3/d5/db/d36/c49 9320 1 2024-09-21T12:46:58.281 INFO:tasks.workunit.client.1.smithi176.stdout:1/565: mkdir d0/db/d6f/dcc 0 2024-09-21T12:46:58.283 INFO:tasks.workunit.client.1.smithi176.stdout:0/626: mkdir d9/d1a/d1d/d23/d5f/ddd 0 2024-09-21T12:46:58.284 INFO:tasks.workunit.client.1.smithi176.stdout:8/487: mkdir d6/d8/d24/d35/d9b 0 2024-09-21T12:46:58.287 INFO:tasks.workunit.client.1.smithi176.stdout:2/532: mkdir d4/df/d2e/d6f/d5d/d81/d95/da5 0 2024-09-21T12:46:58.288 INFO:tasks.workunit.client.1.smithi176.stdout:7/622: rename d0/d2/fa to d0/d2/db/d10/fde 0 2024-09-21T12:46:58.289 INFO:tasks.workunit.client.1.smithi176.stdout:9/520: sync 2024-09-21T12:46:58.290 INFO:tasks.workunit.client.1.smithi176.stdout:4/521: unlink d3/d42/d56/d4e/f52 0 2024-09-21T12:46:58.291 INFO:tasks.workunit.client.1.smithi176.stdout:1/566: creat d0/db/d6a/fcd x:0 0 0 2024-09-21T12:46:58.292 INFO:tasks.workunit.client.1.smithi176.stdout:0/627: symlink d9/d1a/db8/lde 0 2024-09-21T12:46:58.293 INFO:tasks.workunit.client.1.smithi176.stdout:5/439: dwrite d0/d13/d63/d2e/d39/f43 [0,4194304] 0 2024-09-21T12:46:58.295 INFO:tasks.workunit.client.1.smithi176.stdout:6/472: write d2/dd/d26/f38 [1025926,34453] 0 2024-09-21T12:46:58.297 INFO:tasks.workunit.client.1.smithi176.stdout:5/440: read d0/d13/f29 [358281,18207] 0 2024-09-21T12:46:58.298 INFO:tasks.workunit.client.1.smithi176.stdout:8/488: mkdir d6/d16/d9c 0 2024-09-21T12:46:58.299 INFO:tasks.workunit.client.1.smithi176.stdout:2/533: dwrite d4/df/d2e/d6f/d5d/f77 [0,4194304] 0 2024-09-21T12:46:58.299 INFO:tasks.workunit.client.1.smithi176.stdout:4/522: mknod d3/d21/d27/caf 0 2024-09-21T12:46:58.301 INFO:tasks.workunit.client.1.smithi176.stdout:4/523: dread - d3/d21/d97/f9a zero size 2024-09-21T12:46:58.302 INFO:tasks.workunit.client.1.smithi176.stdout:7/623: creat d0/d2/da8/dca/fdf x:0 0 0 2024-09-21T12:46:58.304 INFO:tasks.workunit.client.1.smithi176.stdout:0/628: unlink d9/d1b/d63/d77/d88/faf 0 2024-09-21T12:46:58.305 INFO:tasks.workunit.client.1.smithi176.stdout:7/624: write d0/d2/db/d10/f22 [906078,71655] 0 2024-09-21T12:46:58.308 INFO:tasks.workunit.client.1.smithi176.stdout:8/489: dwrite d6/d8/d24/f82 [0,4194304] 0 2024-09-21T12:46:58.308 INFO:tasks.workunit.client.1.smithi176.stdout:0/629: write d9/d1a/d1d/d23/da1/da3/f4d [5182930,26367] 0 2024-09-21T12:46:58.309 INFO:tasks.workunit.client.1.smithi176.stdout:1/567: mkdir d0/db/d1a/d2c/dc5/d41/d59/d9b/dce 0 2024-09-21T12:46:58.310 INFO:tasks.workunit.client.1.smithi176.stdout:1/568: chown d0/db/d1a/d2c/d48 0 1 2024-09-21T12:46:58.312 INFO:tasks.workunit.client.1.smithi176.stdout:6/473: creat d2/dd/d26/d2b/f92 x:0 0 0 2024-09-21T12:46:58.312 INFO:tasks.workunit.client.1.smithi176.stdout:5/441: mknod d0/d13/d63/d66/c80 0 2024-09-21T12:46:58.312 INFO:tasks.workunit.client.1.smithi176.stdout:1/569: stat d0/db/d1a/d2c/d48/d50 0 2024-09-21T12:46:58.312 INFO:tasks.workunit.client.1.smithi176.stdout:2/534: creat d4/df/d2e/d39/d55/fa6 x:0 0 0 2024-09-21T12:46:58.313 INFO:tasks.workunit.client.1.smithi176.stdout:4/524: creat d3/d42/d47/d5c/fb0 x:0 0 0 2024-09-21T12:46:58.313 INFO:tasks.workunit.client.1.smithi176.stdout:2/535: fdatasync d4/f7f 0 2024-09-21T12:46:58.321 INFO:tasks.workunit.client.1.smithi176.stdout:1/570: rename d0/d5b/f87 to d0/d63/fcf 0 2024-09-21T12:46:58.323 INFO:tasks.workunit.client.1.smithi176.stdout:9/521: truncate d1/f5d 1900921 0 2024-09-21T12:46:58.323 INFO:tasks.workunit.client.1.smithi176.stdout:8/490: symlink d6/db/d37/d89/d8a/l9d 0 2024-09-21T12:46:58.324 INFO:tasks.workunit.client.1.smithi176.stdout:9/522: stat d1/f2a 0 2024-09-21T12:46:58.324 INFO:tasks.workunit.client.1.smithi176.stdout:2/536: symlink d4/df/d2e/d6f/d5d/d81/la7 0 2024-09-21T12:46:58.326 INFO:tasks.workunit.client.1.smithi176.stdout:4/525: link d3/d21/d88/f91 d3/fb1 0 2024-09-21T12:46:58.327 INFO:tasks.workunit.client.1.smithi176.stdout:7/625: dread d0/d2/d30/d7b/f7d [0,4194304] 0 2024-09-21T12:46:58.327 INFO:tasks.workunit.client.1.smithi176.stdout:7/626: write d0/fb4 [922455,112948] 0 2024-09-21T12:46:58.328 INFO:tasks.workunit.client.1.smithi176.stdout:6/474: rename d2/dd/d26/d2b/d10/l1c to d2/dd/d79/l93 0 2024-09-21T12:46:58.329 INFO:tasks.workunit.client.1.smithi176.stdout:6/475: write d2/d6f/f78 [931912,108038] 0 2024-09-21T12:46:58.330 INFO:tasks.workunit.client.1.smithi176.stdout:9/523: creat d1/df/d48/d69/d40/fb4 x:0 0 0 2024-09-21T12:46:58.334 INFO:tasks.workunit.client.1.smithi176.stdout:2/537: rename d4/df/d2e/d6f/d5d/d81/f8a to d4/d3d/d65/d9b/fa8 0 2024-09-21T12:46:58.334 INFO:tasks.workunit.client.1.smithi176.stdout:0/630: write d9/d1a/d1d/d23/da1/da3/d1e/f6f [1321330,9656] 0 2024-09-21T12:46:58.335 INFO:tasks.workunit.client.1.smithi176.stdout:7/627: creat d0/d2/db/d10/d72/d7e/fe0 x:0 0 0 2024-09-21T12:46:58.336 INFO:tasks.workunit.client.1.smithi176.stdout:0/631: write d9/d1a/d1d/d23/da1/da3/f9d [2392655,2819] 0 2024-09-21T12:46:58.338 INFO:tasks.workunit.client.1.smithi176.stdout:6/476: mknod d2/dd/d26/d2b/c94 0 2024-09-21T12:46:58.338 INFO:tasks.workunit.client.1.smithi176.stdout:3/618: sync 2024-09-21T12:46:58.340 INFO:tasks.workunit.client.1.smithi176.stdout:9/524: unlink d1/d61/d73/c86 0 2024-09-21T12:46:58.342 INFO:tasks.workunit.client.1.smithi176.stdout:5/442: write d0/d13/d63/f3d [1881666,35506] 0 2024-09-21T12:46:58.346 INFO:tasks.workunit.client.1.smithi176.stdout:9/525: dwrite d1/f97 [0,4194304] 0 2024-09-21T12:46:58.347 INFO:tasks.workunit.client.1.smithi176.stdout:7/628: chown d0/d2/db/c19 77 1 2024-09-21T12:46:58.349 INFO:tasks.workunit.client.1.smithi176.stdout:0/632: creat d9/d1a/d1d/d23/da1/da3/fdf x:0 0 0 2024-09-21T12:46:58.350 INFO:tasks.workunit.client.1.smithi176.stdout:6/477: rmdir d2/dd/d26/d2b 39 2024-09-21T12:46:58.353 INFO:tasks.workunit.client.1.smithi176.stdout:1/571: getdents d0/db/d1a/d2c/d66 0 2024-09-21T12:46:58.359 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:58 smithi176 ceph-mon[35476]: pgmap v25: 65 pgs: 65 active+clean; 946 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 108 MiB/s wr, 223 op/s 2024-09-21T12:46:58.389 INFO:tasks.workunit.client.1.smithi176.stdout:2/538: write d4/df/d2e/d39/d55/f75 [446210,96433] 0 2024-09-21T12:46:58.389 INFO:tasks.workunit.client.1.smithi176.stdout:7/629: mkdir d0/d98/de1 0 2024-09-21T12:46:58.390 INFO:tasks.workunit.client.1.smithi176.stdout:8/491: dwrite d6/d16/f1e [0,4194304] 0 2024-09-21T12:46:58.391 INFO:tasks.workunit.client.1.smithi176.stdout:3/619: link d1/d8d/fa7 d1/d34/d5d/dce/fe9 0 2024-09-21T12:46:58.394 INFO:tasks.workunit.client.1.smithi176.stdout:4/526: truncate d3/d42/f8e 395024 0 2024-09-21T12:46:58.394 INFO:tasks.workunit.client.1.smithi176.stdout:0/633: creat d9/d1b/dcc/fe0 x:0 0 0 2024-09-21T12:46:58.395 INFO:tasks.workunit.client.1.smithi176.stdout:3/620: write d1/d5/d25/f26 [2617871,4635] 0 2024-09-21T12:46:58.396 INFO:tasks.workunit.client.1.smithi176.stdout:5/443: creat d0/d10/f81 x:0 0 0 2024-09-21T12:46:58.397 INFO:tasks.workunit.client.1.smithi176.stdout:1/572: unlink d0/db/d1a/d2c/d48/d50/l93 0 2024-09-21T12:46:58.399 INFO:tasks.workunit.client.1.smithi176.stdout:6/478: creat d2/dd/d26/f95 x:0 0 0 2024-09-21T12:46:58.400 INFO:tasks.workunit.client.1.smithi176.stdout:7/630: mkdir d0/d2/db/d10/d72/d7e/de2 0 2024-09-21T12:46:58.401 INFO:tasks.workunit.client.1.smithi176.stdout:2/539: dread d4/d63/d93/f82 [0,4194304] 0 2024-09-21T12:46:58.403 INFO:tasks.workunit.client.1.smithi176.stdout:5/444: symlink d0/d13/d63/d66/l82 0 2024-09-21T12:46:58.403 INFO:tasks.workunit.client.1.smithi176.stdout:4/527: write d3/d5/db/d36/f6e [352963,49910] 0 2024-09-21T12:46:58.404 INFO:tasks.workunit.client.1.smithi176.stdout:3/621: rename d1/d5/d25/d61/dc3/lca to d1/d9e/db4/lea 0 2024-09-21T12:46:58.405 INFO:tasks.workunit.client.1.smithi176.stdout:7/631: truncate d0/d2/db/d10/d72/fab 206960 0 2024-09-21T12:46:58.405 INFO:tasks.workunit.client.1.smithi176.stdout:5/445: fdatasync d0/d13/f48 0 2024-09-21T12:46:58.405 INFO:tasks.workunit.client.1.smithi176.stdout:4/528: dread - d3/d5/f8d zero size 2024-09-21T12:46:58.406 INFO:tasks.workunit.client.1.smithi176.stdout:1/573: mknod d0/db/d1a/d2c/dc5/d2b/cd0 0 2024-09-21T12:46:58.408 INFO:tasks.workunit.client.1.smithi176.stdout:8/492: creat d6/db/d13/d98/f9e x:0 0 0 2024-09-21T12:46:58.408 INFO:tasks.workunit.client.1.smithi176.stdout:3/622: read - d1/d35/d5e/d90/fa6 zero size 2024-09-21T12:46:58.408 INFO:tasks.workunit.client.1.smithi176.stdout:0/634: dwrite d9/d1a/d1d/d23/da1/db0/fd1 [0,4194304] 0 2024-09-21T12:46:58.409 INFO:tasks.workunit.client.1.smithi176.stdout:4/529: chown d3/d42/d56/d4e/l93 13 1 2024-09-21T12:46:58.411 INFO:tasks.workunit.client.1.smithi176.stdout:7/632: creat d0/d2/d30/d7b/fe3 x:0 0 0 2024-09-21T12:46:58.411 INFO:tasks.workunit.client.1.smithi176.stdout:8/493: write d6/db/f17 [2660407,91739] 0 2024-09-21T12:46:58.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:58 smithi046 ceph-mon[27868]: pgmap v25: 65 pgs: 65 active+clean; 946 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 13 MiB/s rd, 108 MiB/s wr, 223 op/s 2024-09-21T12:46:58.412 INFO:tasks.workunit.client.1.smithi176.stdout:1/574: mknod d0/db/d2a/cd1 0 2024-09-21T12:46:58.415 INFO:tasks.workunit.client.1.smithi176.stdout:4/530: readlink d3/d5/l26 0 2024-09-21T12:46:58.418 INFO:tasks.workunit.client.1.smithi176.stdout:5/446: dwrite d0/d13/d63/d72/f7e [0,4194304] 0 2024-09-21T12:46:58.419 INFO:tasks.workunit.client.1.smithi176.stdout:3/623: rename d1/d5/d25/d76 to d1/d34/d48/deb 0 2024-09-21T12:46:58.419 INFO:tasks.workunit.client.1.smithi176.stdout:2/540: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:46:58.420 INFO:tasks.workunit.client.1.smithi176.stdout:6/479: getdents d2/d5d 0 2024-09-21T12:46:58.421 INFO:tasks.workunit.client.1.smithi176.stdout:3/624: fdatasync d1/d34/d42/d5b/fc0 0 2024-09-21T12:46:58.421 INFO:tasks.workunit.client.1.smithi176.stdout:7/633: mknod d0/d5d/d5e/ce4 0 2024-09-21T12:46:58.426 INFO:tasks.workunit.client.1.smithi176.stdout:4/531: mkdir d3/d5/db/d96/db2 0 2024-09-21T12:46:58.426 INFO:tasks.workunit.client.1.smithi176.stdout:2/541: creat d4/d3a/fa9 x:0 0 0 2024-09-21T12:46:58.427 INFO:tasks.workunit.client.1.smithi176.stdout:5/447: creat d0/d13/d63/d2e/d37/d55/f83 x:0 0 0 2024-09-21T12:46:58.428 INFO:tasks.workunit.client.1.smithi176.stdout:4/532: write d3/d42/d47/d5c/fb0 [741392,24523] 0 2024-09-21T12:46:58.430 INFO:tasks.workunit.client.1.smithi176.stdout:0/635: rmdir d9/d1a/d3f/d40/dc9 0 2024-09-21T12:46:58.431 INFO:tasks.workunit.client.1.smithi176.stdout:7/634: creat d0/d5d/d8a/fe5 x:0 0 0 2024-09-21T12:46:58.431 INFO:tasks.workunit.client.1.smithi176.stdout:3/625: rmdir d1/d34/d57/dc7 39 2024-09-21T12:46:58.432 INFO:tasks.workunit.client.1.smithi176.stdout:7/635: chown d0/d2/d30/d7b/cc1 411 1 2024-09-21T12:46:58.434 INFO:tasks.workunit.client.1.smithi176.stdout:5/448: creat d0/d13/f84 x:0 0 0 2024-09-21T12:46:58.434 INFO:tasks.workunit.client.1.smithi176.stdout:7/636: chown d0/d2/dc9 15533685 1 2024-09-21T12:46:58.435 INFO:tasks.workunit.client.1.smithi176.stdout:4/533: dread d3/d5/db/f31 [0,4194304] 0 2024-09-21T12:46:58.435 INFO:tasks.workunit.client.1.smithi176.stdout:0/636: truncate d9/f2b 175789 0 2024-09-21T12:46:58.436 INFO:tasks.workunit.client.1.smithi176.stdout:8/494: getdents d6/d8 0 2024-09-21T12:46:58.436 INFO:tasks.workunit.client.1.smithi176.stdout:2/542: mknod d4/d63/d93/d80/d9e/caa 0 2024-09-21T12:46:58.436 INFO:tasks.workunit.client.1.smithi176.stdout:7/637: stat d0/d2/db/fd0 0 2024-09-21T12:46:58.439 INFO:tasks.workunit.client.1.smithi176.stdout:4/534: dread d3/d42/d56/f8c [0,4194304] 0 2024-09-21T12:46:58.440 INFO:tasks.workunit.client.1.smithi176.stdout:6/480: rename d2/dd/d26/d2b/d10/d1b/d37/f3c to d2/f96 0 2024-09-21T12:46:58.443 INFO:tasks.workunit.client.1.smithi176.stdout:8/495: mkdir d6/d16/d9f 0 2024-09-21T12:46:58.445 INFO:tasks.workunit.client.1.smithi176.stdout:7/638: creat d0/d2/db/d10/d72/fe6 x:0 0 0 2024-09-21T12:46:58.445 INFO:tasks.workunit.client.0.smithi046.stdout:0/0: sync 2024-09-21T12:46:58.446 INFO:tasks.workunit.client.1.smithi176.stdout:4/535: mknod d3/d42/d56/cb3 0 2024-09-21T12:46:58.446 INFO:tasks.workunit.client.1.smithi176.stdout:2/543: dwrite d4/df/d2e/d6f/d6d/f74 [0,4194304] 0 2024-09-21T12:46:58.447 INFO:tasks.workunit.client.1.smithi176.stdout:5/449: symlink d0/d13/d63/d2e/d71/l85 0 2024-09-21T12:46:58.447 INFO:tasks.workunit.client.1.smithi176.stdout:1/575: dwrite d0/fa [4194304,4194304] 0 2024-09-21T12:46:58.449 INFO:tasks.workunit.client.1.smithi176.stdout:2/544: write d4/df/d2e/d39/d55/fa6 [523158,27139] 0 2024-09-21T12:46:58.449 INFO:tasks.workunit.client.1.smithi176.stdout:5/450: chown d0/d13/d63/d2e/d39/d3b/c5a 1 1 2024-09-21T12:46:58.450 INFO:tasks.workunit.client.1.smithi176.stdout:3/626: rename d1/d5/d25/f5f to d1/d34/d42/d5b/fec 0 2024-09-21T12:46:58.452 INFO:tasks.workunit.client.0.smithi046.stdout:0/1: mknod c0 0 2024-09-21T12:46:58.454 INFO:tasks.workunit.client.1.smithi176.stdout:0/637: mkdir d9/d1a/d1d/d23/da1/da3/d1e/de1 0 2024-09-21T12:46:58.456 INFO:tasks.workunit.client.0.smithi046.stdout:0/2: creat f1 x:0 0 0 2024-09-21T12:46:58.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/3: write f1 [283779,68933] 0 2024-09-21T12:46:58.458 INFO:tasks.workunit.client.1.smithi176.stdout:9/526: sync 2024-09-21T12:46:58.458 INFO:tasks.workunit.client.1.smithi176.stdout:7/639: rmdir d0/d2/db/d10/d72 39 2024-09-21T12:46:58.462 INFO:tasks.workunit.client.1.smithi176.stdout:6/481: dread d2/f34 [0,4194304] 0 2024-09-21T12:46:58.465 INFO:tasks.workunit.client.1.smithi176.stdout:4/536: mknod d3/d42/dae/cb4 0 2024-09-21T12:46:58.466 INFO:tasks.workunit.client.1.smithi176.stdout:9/527: symlink d1/df/d48/d69/d40/d84/lb5 0 2024-09-21T12:46:58.472 INFO:tasks.workunit.client.1.smithi176.stdout:1/576: dread d0/db/d1a/f21 [0,4194304] 0 2024-09-21T12:46:58.472 INFO:tasks.workunit.client.1.smithi176.stdout:2/545: link d4/df/d2e/d6f/d5d/d81/d95/c47 d4/df/d83/d8e/cab 0 2024-09-21T12:46:58.475 INFO:tasks.workunit.client.1.smithi176.stdout:5/451: dwrite d0/d13/d63/d2e/d39/d41/f77 [0,4194304] 0 2024-09-21T12:46:58.476 INFO:tasks.workunit.client.1.smithi176.stdout:7/640: rename d0/d2/db/d10/f1d to d0/d2/db/d10/fe7 0 2024-09-21T12:46:58.476 INFO:tasks.workunit.client.1.smithi176.stdout:6/482: mknod d2/dd/d26/d2b/d10/d1b/d7b/c97 0 2024-09-21T12:46:58.482 INFO:tasks.workunit.client.1.smithi176.stdout:4/537: dwrite d3/d5/db/d36/f6e [0,4194304] 0 2024-09-21T12:46:58.482 INFO:tasks.workunit.client.1.smithi176.stdout:1/577: mknod d0/db/d1a/d2c/d84/cd2 0 2024-09-21T12:46:58.483 INFO:tasks.workunit.client.1.smithi176.stdout:5/452: rmdir d0/d13/d63/d2e/d39/d3b 39 2024-09-21T12:46:58.485 INFO:tasks.workunit.client.1.smithi176.stdout:5/453: read d0/d13/d63/d2e/f46 [251972,74472] 0 2024-09-21T12:46:58.487 INFO:tasks.workunit.client.1.smithi176.stdout:2/546: unlink d4/df/d2e/d6f/d5d/d81/d95/c9c 0 2024-09-21T12:46:58.488 INFO:tasks.workunit.client.1.smithi176.stdout:4/538: mknod d3/d42/cb5 0 2024-09-21T12:46:58.489 INFO:tasks.workunit.client.1.smithi176.stdout:3/627: write d1/d5/d25/d61/dc3/fd7 [546734,111942] 0 2024-09-21T12:46:58.489 INFO:tasks.workunit.client.1.smithi176.stdout:6/483: symlink d2/d63/l98 0 2024-09-21T12:46:58.490 INFO:tasks.workunit.client.1.smithi176.stdout:8/496: write d6/d16/f63 [410348,86664] 0 2024-09-21T12:46:58.494 INFO:tasks.workunit.client.1.smithi176.stdout:0/638: dread d9/f52 [0,4194304] 0 2024-09-21T12:46:58.494 INFO:tasks.workunit.client.1.smithi176.stdout:2/547: truncate d4/df/f6b 233937 0 2024-09-21T12:46:58.497 INFO:tasks.workunit.client.1.smithi176.stdout:1/578: fsync d0/db/d2a/f4c 0 2024-09-21T12:46:58.497 INFO:tasks.workunit.client.1.smithi176.stdout:2/548: chown d4/d3a/l49 30 1 2024-09-21T12:46:58.498 INFO:tasks.workunit.client.1.smithi176.stdout:8/497: dread d6/db/d13/f4d [0,4194304] 0 2024-09-21T12:46:58.498 INFO:tasks.workunit.client.1.smithi176.stdout:3/628: rmdir d1/d34/dbb 39 2024-09-21T12:46:58.500 INFO:tasks.workunit.client.1.smithi176.stdout:6/484: readlink d2/dd/d26/l27 0 2024-09-21T12:46:58.501 INFO:tasks.workunit.client.1.smithi176.stdout:6/485: readlink d2/dd/d26/d2b/l36 0 2024-09-21T12:46:58.502 INFO:tasks.workunit.client.1.smithi176.stdout:4/539: truncate d3/d5/f15 3147581 0 2024-09-21T12:46:58.503 INFO:tasks.workunit.client.1.smithi176.stdout:8/498: read d6/d8/d24/d35/f61 [3084623,15126] 0 2024-09-21T12:46:58.503 INFO:tasks.workunit.client.1.smithi176.stdout:5/454: dwrite d0/d13/d63/d2e/d39/d3b/f47 [0,4194304] 0 2024-09-21T12:46:58.505 INFO:tasks.workunit.client.1.smithi176.stdout:1/579: mkdir d0/d91/dd3 0 2024-09-21T12:46:58.506 INFO:tasks.workunit.client.1.smithi176.stdout:2/549: chown d4/d3d/f5b 7 1 2024-09-21T12:46:58.508 INFO:tasks.workunit.client.1.smithi176.stdout:5/455: write d0/d13/d63/d2e/d39/d41/f77 [89525,33139] 0 2024-09-21T12:46:58.508 INFO:tasks.workunit.client.1.smithi176.stdout:7/641: dread d0/d2/db/fa4 [0,4194304] 0 2024-09-21T12:46:58.508 INFO:tasks.workunit.client.1.smithi176.stdout:3/629: write d1/d35/f8a [101595,85570] 0 2024-09-21T12:46:58.511 INFO:tasks.workunit.client.1.smithi176.stdout:5/456: truncate d0/d13/f48 634224 0 2024-09-21T12:46:58.512 INFO:tasks.workunit.client.1.smithi176.stdout:4/540: chown d3/d21/d27/d2c/f67 1539958 1 2024-09-21T12:46:58.513 INFO:tasks.workunit.client.1.smithi176.stdout:2/550: dread d4/df/d2e/d39/f66 [0,4194304] 0 2024-09-21T12:46:58.513 INFO:tasks.workunit.client.1.smithi176.stdout:6/486: rename d2/dd/d26/d2b/d10/l43 to d2/dd/l99 0 2024-09-21T12:46:58.514 INFO:tasks.workunit.client.1.smithi176.stdout:4/541: write d3/d21/d97/f9a [207578,88670] 0 2024-09-21T12:46:58.516 INFO:tasks.workunit.client.1.smithi176.stdout:2/551: write d4/df/f22 [1954979,76074] 0 2024-09-21T12:46:58.516 INFO:tasks.workunit.client.1.smithi176.stdout:0/639: mkdir d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2 0 2024-09-21T12:46:58.518 INFO:tasks.workunit.client.1.smithi176.stdout:0/640: dread - d9/d1b/d63/d77/d88/f96 zero size 2024-09-21T12:46:58.518 INFO:tasks.workunit.client.1.smithi176.stdout:1/580: creat d0/db/d1a/d2c/d84/fd4 x:0 0 0 2024-09-21T12:46:58.521 INFO:tasks.workunit.client.1.smithi176.stdout:7/642: symlink d0/d2/d30/d93/d96/d89/le8 0 2024-09-21T12:46:58.521 INFO:tasks.workunit.client.1.smithi176.stdout:1/581: fsync d0/db/d1a/d2c/dc5/d41/f9a 0 2024-09-21T12:46:58.523 INFO:tasks.workunit.client.1.smithi176.stdout:8/499: symlink d6/d8/d24/d35/la0 0 2024-09-21T12:46:58.524 INFO:tasks.workunit.client.1.smithi176.stdout:4/542: rmdir d3/d42/d56 39 2024-09-21T12:46:58.524 INFO:tasks.workunit.client.1.smithi176.stdout:1/582: write d0/f3d [749013,2751] 0 2024-09-21T12:46:58.526 INFO:tasks.workunit.client.1.smithi176.stdout:3/630: write d1/d34/d48/f65 [239673,14890] 0 2024-09-21T12:46:58.526 INFO:tasks.workunit.client.1.smithi176.stdout:6/487: dwrite d2/dd/d26/f3d [0,4194304] 0 2024-09-21T12:46:58.529 INFO:tasks.workunit.client.1.smithi176.stdout:4/543: chown d3/d42/d47/d5c/l72 4575837 1 2024-09-21T12:46:58.529 INFO:tasks.workunit.client.1.smithi176.stdout:2/552: dwrite d4/df/d2e/d39/d55/f75 [0,4194304] 0 2024-09-21T12:46:58.530 INFO:tasks.workunit.client.1.smithi176.stdout:7/643: mknod d0/d2/da8/dca/ce9 0 2024-09-21T12:46:58.531 INFO:tasks.workunit.client.1.smithi176.stdout:7/644: read - d0/d5d/d8a/fe5 zero size 2024-09-21T12:46:58.533 INFO:tasks.workunit.client.1.smithi176.stdout:8/500: unlink f4 0 2024-09-21T12:46:58.534 INFO:tasks.workunit.client.1.smithi176.stdout:6/488: unlink d2/dd/d26/d2b/l16 0 2024-09-21T12:46:58.534 INFO:tasks.workunit.client.1.smithi176.stdout:1/583: write d0/db/d1a/d2c/d48/d50/f90 [287247,34187] 0 2024-09-21T12:46:58.535 INFO:tasks.workunit.client.1.smithi176.stdout:3/631: creat d1/d34/d48/deb/dc6/fed x:0 0 0 2024-09-21T12:46:58.536 INFO:tasks.workunit.client.1.smithi176.stdout:0/641: mkdir d9/d1a/d1d/d23/da1/da3/d1e/de1/de3 0 2024-09-21T12:46:58.537 INFO:tasks.workunit.client.1.smithi176.stdout:5/457: truncate d0/f52 1048492 0 2024-09-21T12:46:58.537 INFO:tasks.workunit.client.1.smithi176.stdout:7/645: mknod d0/d5d/d8a/cea 0 2024-09-21T12:46:58.539 INFO:tasks.workunit.client.1.smithi176.stdout:8/501: mkdir d6/db/d13/d98/da1 0 2024-09-21T12:46:58.539 INFO:tasks.workunit.client.1.smithi176.stdout:4/544: rename d3 to d3/d42/d56/d4e/db6 22 2024-09-21T12:46:58.540 INFO:tasks.workunit.client.1.smithi176.stdout:2/553: fdatasync d4/df/d2e/f7a 0 2024-09-21T12:46:58.541 INFO:tasks.workunit.client.1.smithi176.stdout:4/545: dread - d3/d42/d47/f8f zero size 2024-09-21T12:46:58.541 INFO:tasks.workunit.client.1.smithi176.stdout:1/584: rmdir d0/db/d1a/d2c/dc5/d41/d59 39 2024-09-21T12:46:58.542 INFO:tasks.workunit.client.1.smithi176.stdout:7/646: mknod d0/d2/da8/ceb 0 2024-09-21T12:46:58.543 INFO:tasks.workunit.client.1.smithi176.stdout:3/632: creat d1/d34/dbb/dd2/fee x:0 0 0 2024-09-21T12:46:58.543 INFO:tasks.workunit.client.1.smithi176.stdout:6/489: truncate d2/dd/d26/d2b/d10/f82 1886004 0 2024-09-21T12:46:58.545 INFO:tasks.workunit.client.1.smithi176.stdout:2/554: chown d4/df/d2e/c34 5 1 2024-09-21T12:46:58.546 INFO:tasks.workunit.client.1.smithi176.stdout:8/502: rename d6/d8/d24/d35/f4f to d6/d8/fa2 0 2024-09-21T12:46:58.547 INFO:tasks.workunit.client.1.smithi176.stdout:5/458: creat d0/d10/f86 x:0 0 0 2024-09-21T12:46:58.547 INFO:tasks.workunit.client.1.smithi176.stdout:8/503: stat d6/d16/d36/d67/f8e 0 2024-09-21T12:46:58.547 INFO:tasks.workunit.client.1.smithi176.stdout:1/585: creat d0/db/d1a/d2c/d6b/fd5 x:0 0 0 2024-09-21T12:46:58.551 INFO:tasks.workunit.client.1.smithi176.stdout:8/504: mkdir d6/db/da3 0 2024-09-21T12:46:58.551 INFO:tasks.workunit.client.1.smithi176.stdout:3/633: dread d1/d34/d71/f73 [0,4194304] 0 2024-09-21T12:46:58.551 INFO:tasks.workunit.client.1.smithi176.stdout:5/459: mkdir d0/d13/d63/d72/d87 0 2024-09-21T12:46:58.553 INFO:tasks.workunit.client.1.smithi176.stdout:4/546: creat d3/fb7 x:0 0 0 2024-09-21T12:46:58.555 INFO:tasks.workunit.client.1.smithi176.stdout:5/460: write d0/d13/d63/d2e/d39/d3b/f6b [550208,42513] 0 2024-09-21T12:46:58.556 INFO:tasks.workunit.client.1.smithi176.stdout:7/647: dwrite d0/d2/db/d10/fe7 [0,4194304] 0 2024-09-21T12:46:58.556 INFO:tasks.workunit.client.1.smithi176.stdout:2/555: write d4/df/f2a [1377178,65428] 0 2024-09-21T12:46:58.559 INFO:tasks.workunit.client.1.smithi176.stdout:8/505: creat d6/d16/d36/d7d/d81/fa4 x:0 0 0 2024-09-21T12:46:58.560 INFO:tasks.workunit.client.1.smithi176.stdout:0/642: link d9/d1a/d1d/d23/da1/da3/lb3 d9/d1a/d3f/d40/le4 0 2024-09-21T12:46:58.563 INFO:tasks.workunit.client.1.smithi176.stdout:3/634: rename d1/d35/f8a to d1/d34/d5d/d78/fef 0 2024-09-21T12:46:58.564 INFO:tasks.workunit.client.1.smithi176.stdout:5/461: symlink d0/d13/d5d/l88 0 2024-09-21T12:46:58.565 INFO:tasks.workunit.client.1.smithi176.stdout:5/462: chown d0/d13/d63/d2e/d39/d41/l6f 38092 1 2024-09-21T12:46:58.565 INFO:tasks.workunit.client.1.smithi176.stdout:1/586: link d0/db/d1a/d2c/dc5/fc6 d0/db/d1a/d2c/d37/fd6 0 2024-09-21T12:46:58.566 INFO:tasks.workunit.client.1.smithi176.stdout:7/648: mkdir d0/d5d/dec 0 2024-09-21T12:46:58.570 INFO:tasks.workunit.client.1.smithi176.stdout:0/643: mknod d9/d1a/db8/ce5 0 2024-09-21T12:46:58.573 INFO:tasks.workunit.client.1.smithi176.stdout:1/587: mkdir d0/db/d1a/d2c/d6b/dd7 0 2024-09-21T12:46:58.578 INFO:tasks.workunit.client.1.smithi176.stdout:4/547: truncate d3/f3c 2835978 0 2024-09-21T12:46:58.580 INFO:tasks.workunit.client.1.smithi176.stdout:8/506: write d6/d8/d24/d35/f94 [906212,84584] 0 2024-09-21T12:46:58.582 INFO:tasks.workunit.client.1.smithi176.stdout:1/588: mkdir d0/db/d1a/d2c/d66/d6d/dd8 0 2024-09-21T12:46:58.583 INFO:tasks.workunit.client.1.smithi176.stdout:7/649: dread d0/d2/db/fd0 [4194304,4194304] 0 2024-09-21T12:46:58.585 INFO:tasks.workunit.client.1.smithi176.stdout:4/548: write d3/d42/d4d/f58 [835748,100148] 0 2024-09-21T12:46:58.588 INFO:tasks.workunit.client.1.smithi176.stdout:8/507: dwrite d6/d8/d24/f82 [0,4194304] 0 2024-09-21T12:46:58.588 INFO:tasks.workunit.client.1.smithi176.stdout:5/463: dread d0/d13/d63/f3a [0,4194304] 0 2024-09-21T12:46:58.588 INFO:tasks.workunit.client.1.smithi176.stdout:3/635: link d1/d5/f1b d1/d35/ff0 0 2024-09-21T12:46:58.589 INFO:tasks.workunit.client.1.smithi176.stdout:8/508: chown d6/d8/d24/l5d 3456278 1 2024-09-21T12:46:58.591 INFO:tasks.workunit.client.1.smithi176.stdout:1/589: rmdir d0/db/d1a/d73 39 2024-09-21T12:46:58.593 INFO:tasks.workunit.client.1.smithi176.stdout:7/650: creat d0/d2/da8/dbe/fed x:0 0 0 2024-09-21T12:46:58.594 INFO:tasks.workunit.client.1.smithi176.stdout:2/556: truncate d4/f1a 1896674 0 2024-09-21T12:46:58.597 INFO:tasks.workunit.client.1.smithi176.stdout:4/549: chown d3/d5/f8d 1706 1 2024-09-21T12:46:58.597 INFO:tasks.workunit.client.1.smithi176.stdout:3/636: dread d1/d34/d5d/d78/fef [0,4194304] 0 2024-09-21T12:46:58.599 INFO:tasks.workunit.client.1.smithi176.stdout:2/557: creat d4/df/d2e/d39/d55/fac x:0 0 0 2024-09-21T12:46:58.601 INFO:tasks.workunit.client.1.smithi176.stdout:4/550: creat d3/d42/d56/fb8 x:0 0 0 2024-09-21T12:46:58.602 INFO:tasks.workunit.client.1.smithi176.stdout:2/558: unlink d4/fa4 0 2024-09-21T12:46:58.608 INFO:tasks.workunit.client.1.smithi176.stdout:4/551: unlink d3/d5/fd 0 2024-09-21T12:46:58.609 INFO:tasks.workunit.client.1.smithi176.stdout:5/464: getdents d0/d13/d63/d2e 0 2024-09-21T12:46:58.610 INFO:tasks.workunit.client.1.smithi176.stdout:7/651: dread d0/f17 [0,4194304] 0 2024-09-21T12:46:58.611 INFO:tasks.workunit.client.1.smithi176.stdout:3/637: link d1/d34/dbb/dd2/fee d1/d35/d5e/ff1 0 2024-09-21T12:46:58.611 INFO:tasks.workunit.client.1.smithi176.stdout:0/644: dwrite d9/d1a/d3f/f80 [0,4194304] 0 2024-09-21T12:46:58.616 INFO:tasks.workunit.client.1.smithi176.stdout:8/509: dread d6/d8/d24/d35/d51/f78 [0,4194304] 0 2024-09-21T12:46:58.622 INFO:tasks.workunit.client.1.smithi176.stdout:7/652: creat d0/d2/db/d10/d72/fee x:0 0 0 2024-09-21T12:46:58.625 INFO:tasks.workunit.client.1.smithi176.stdout:8/510: creat d6/db/d37/d7a/fa5 x:0 0 0 2024-09-21T12:46:58.627 INFO:tasks.workunit.client.1.smithi176.stdout:4/552: creat d3/d42/fb9 x:0 0 0 2024-09-21T12:46:58.630 INFO:tasks.workunit.client.1.smithi176.stdout:7/653: rename d0/d2/da8/dbe/fed to d0/d2/db/d10/d72/d94/fef 0 2024-09-21T12:46:58.631 INFO:tasks.workunit.client.1.smithi176.stdout:3/638: link d1/d5/c1e d1/d34/dbb/dd2/cf2 0 2024-09-21T12:46:58.632 INFO:tasks.workunit.client.1.smithi176.stdout:0/645: getdents d9/d1b/d63 0 2024-09-21T12:46:58.634 INFO:tasks.workunit.client.1.smithi176.stdout:7/654: unlink d0/d2/db/d10/fde 0 2024-09-21T12:46:58.635 INFO:tasks.workunit.client.1.smithi176.stdout:7/655: fdatasync d0/d2/f5c 0 2024-09-21T12:46:58.636 INFO:tasks.workunit.client.1.smithi176.stdout:5/465: write d0/f52 [974302,27295] 0 2024-09-21T12:46:58.638 INFO:tasks.workunit.client.1.smithi176.stdout:3/639: getdents d1/d3e/ddc 0 2024-09-21T12:46:58.639 INFO:tasks.workunit.client.1.smithi176.stdout:0/646: dread d9/d1a/d3f/d40/fb2 [0,4194304] 0 2024-09-21T12:46:58.639 INFO:tasks.workunit.client.1.smithi176.stdout:5/466: chown d0/d13/d63/d2e/d39/d41/f6c 74 1 2024-09-21T12:46:58.640 INFO:tasks.workunit.client.1.smithi176.stdout:4/553: symlink d3/d21/d88/da7/lba 0 2024-09-21T12:46:58.640 INFO:tasks.workunit.client.1.smithi176.stdout:8/511: getdents d6/d16/d36 0 2024-09-21T12:46:58.641 INFO:tasks.workunit.client.1.smithi176.stdout:0/647: dread - d9/d1a/db8/fda zero size 2024-09-21T12:46:58.647 INFO:tasks.workunit.client.1.smithi176.stdout:0/648: write d9/f14 [4556876,47033] 0 2024-09-21T12:46:58.647 INFO:tasks.workunit.client.1.smithi176.stdout:7/656: dwrite d0/d2/db/d10/d72/d51/f6e [0,4194304] 0 2024-09-21T12:46:58.647 INFO:tasks.workunit.client.1.smithi176.stdout:8/512: mkdir d6/db/d37/d89/d8a/da6 0 2024-09-21T12:46:58.648 INFO:tasks.workunit.client.1.smithi176.stdout:7/657: stat d0/d5d/d8a 0 2024-09-21T12:46:58.649 INFO:tasks.workunit.client.1.smithi176.stdout:5/467: fsync d0/d10/f2b 0 2024-09-21T12:46:58.651 INFO:tasks.workunit.client.1.smithi176.stdout:3/640: dwrite d1/d35/fc9 [0,4194304] 0 2024-09-21T12:46:58.653 INFO:tasks.workunit.client.1.smithi176.stdout:8/513: write d6/db/d37/d7a/fa5 [448696,107258] 0 2024-09-21T12:46:58.657 INFO:tasks.workunit.client.1.smithi176.stdout:7/658: creat d0/d2/db/d10/d31/ff0 x:0 0 0 2024-09-21T12:46:58.658 INFO:tasks.workunit.client.1.smithi176.stdout:4/554: dwrite d3/d21/d27/f7d [0,4194304] 0 2024-09-21T12:46:58.659 INFO:tasks.workunit.client.1.smithi176.stdout:3/641: chown d1/d5/d25/d61/dc3/fe4 1 1 2024-09-21T12:46:58.659 INFO:tasks.workunit.client.1.smithi176.stdout:0/649: rename d9/d1b/d63/d75/fad to d9/d1a/d1d/d23/da1/da3/d8f/dd8/fe6 0 2024-09-21T12:46:58.660 INFO:tasks.workunit.client.1.smithi176.stdout:7/659: stat d0/d2/d30/d7b 0 2024-09-21T12:46:58.661 INFO:tasks.workunit.client.1.smithi176.stdout:2/559: truncate d4/f1a 1077775 0 2024-09-21T12:46:58.663 INFO:tasks.workunit.client.1.smithi176.stdout:8/514: creat d6/d8/d24/d35/d9b/fa7 x:0 0 0 2024-09-21T12:46:58.668 INFO:tasks.workunit.client.1.smithi176.stdout:0/650: truncate d9/f27 9371917 0 2024-09-21T12:46:58.668 INFO:tasks.workunit.client.1.smithi176.stdout:3/642: creat d1/d5/d25/d84/ff3 x:0 0 0 2024-09-21T12:46:58.671 INFO:tasks.workunit.client.1.smithi176.stdout:2/560: creat d4/d3d/d65/fad x:0 0 0 2024-09-21T12:46:58.671 INFO:tasks.workunit.client.1.smithi176.stdout:0/651: mkdir d9/d35/de7 0 2024-09-21T12:46:58.671 INFO:tasks.workunit.client.1.smithi176.stdout:4/555: write d3/d5/db/f31 [46973,129243] 0 2024-09-21T12:46:58.672 INFO:tasks.workunit.client.1.smithi176.stdout:9/528: sync 2024-09-21T12:46:58.673 INFO:tasks.workunit.client.1.smithi176.stdout:5/468: dwrite d0/d13/d63/d2e/d39/d41/f6c [0,4194304] 0 2024-09-21T12:46:58.679 INFO:tasks.workunit.client.1.smithi176.stdout:4/556: creat d3/d5/d37/fbb x:0 0 0 2024-09-21T12:46:58.679 INFO:tasks.workunit.client.1.smithi176.stdout:9/529: mkdir d1/d61/d73/db6 0 2024-09-21T12:46:58.679 INFO:tasks.workunit.client.1.smithi176.stdout:5/469: chown d0/l5 0 1 2024-09-21T12:46:58.685 INFO:tasks.workunit.client.1.smithi176.stdout:7/660: dwrite d0/d2/db/d10/f22 [4194304,4194304] 0 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/2: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:5/42: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/35: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/3: unlink - no file 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/4: dwrite - no filename 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:4/96: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/5: dread - no filename 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/29: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:8/37: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/87: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/81: sync 2024-09-21T12:46:58.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/15: sync 2024-09-21T12:46:58.691 INFO:tasks.workunit.client.1.smithi176.stdout:8/515: dwrite d6/db/d13/f31 [0,4194304] 0 2024-09-21T12:46:58.691 INFO:tasks.workunit.client.0.smithi046.stdout:4/97: chown d1/l8 98822223 1 2024-09-21T12:46:58.695 INFO:tasks.workunit.client.1.smithi176.stdout:8/516: stat d6/db/d37/f3a 0 2024-09-21T12:46:58.697 INFO:tasks.workunit.client.1.smithi176.stdout:3/643: dwrite d1/d35/d5e/d90/f9c [0,4194304] 0 2024-09-21T12:46:58.698 INFO:tasks.workunit.client.1.smithi176.stdout:7/661: write d0/d2/db/d10/fc6 [22235,126614] 0 2024-09-21T12:46:58.698 INFO:tasks.workunit.client.0.smithi046.stdout:2/30: creat fc x:0 0 0 2024-09-21T12:46:58.700 INFO:tasks.workunit.client.1.smithi176.stdout:2/561: dwrite d4/d3a/fa9 [0,4194304] 0 2024-09-21T12:46:58.700 INFO:tasks.workunit.client.0.smithi046.stdout:7/16: dread f1 [0,4194304] 0 2024-09-21T12:46:58.701 INFO:tasks.workunit.client.1.smithi176.stdout:0/652: dwrite d9/d1a/f9b [0,4194304] 0 2024-09-21T12:46:58.702 INFO:tasks.workunit.client.1.smithi176.stdout:4/557: rename d3/l1f to d3/d42/d56/lbc 0 2024-09-21T12:46:58.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/36: creat fb x:0 0 0 2024-09-21T12:46:58.704 INFO:tasks.workunit.client.0.smithi046.stdout:9/37: readlink l8 0 2024-09-21T12:46:58.706 INFO:tasks.workunit.client.1.smithi176.stdout:9/530: mknod d1/df/d48/d69/cb7 0 2024-09-21T12:46:58.710 INFO:tasks.workunit.client.1.smithi176.stdout:7/662: dwrite d0/d2/db/d10/d5a/fbc [0,4194304] 0 2024-09-21T12:46:58.710 INFO:tasks.workunit.client.0.smithi046.stdout:3/88: dread d5/dc/ff [0,4194304] 0 2024-09-21T12:46:58.711 INFO:tasks.workunit.client.1.smithi176.stdout:3/644: read - d1/d34/d48/deb/db3/fe2 zero size 2024-09-21T12:46:58.715 INFO:tasks.workunit.client.1.smithi176.stdout:8/517: truncate d6/db/d13/f4d 716829 0 2024-09-21T12:46:58.716 INFO:tasks.workunit.client.1.smithi176.stdout:8/518: dread - d6/f90 zero size 2024-09-21T12:46:58.717 INFO:tasks.workunit.client.1.smithi176.stdout:8/519: dread - d6/d8/d24/d35/d9b/fa7 zero size 2024-09-21T12:46:58.718 INFO:tasks.workunit.client.0.smithi046.stdout:1/82: chown d4/c17 5835201 1 2024-09-21T12:46:58.718 INFO:tasks.workunit.client.1.smithi176.stdout:8/520: write d6/db/f43 [1815190,705] 0 2024-09-21T12:46:58.722 INFO:tasks.workunit.client.1.smithi176.stdout:0/653: dread d9/f27 [4194304,4194304] 0 2024-09-21T12:46:58.723 INFO:tasks.workunit.client.1.smithi176.stdout:4/558: rename d3/d5/d37/l99 to d3/d21/d27/lbd 0 2024-09-21T12:46:58.723 INFO:tasks.workunit.client.0.smithi046.stdout:6/6: getdents . 0 2024-09-21T12:46:58.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/17: mkdir d2 0 2024-09-21T12:46:58.727 INFO:tasks.workunit.client.1.smithi176.stdout:2/562: creat d4/df/d4b/fae x:0 0 0 2024-09-21T12:46:58.728 INFO:tasks.workunit.client.0.smithi046.stdout:9/38: fsync fa 0 2024-09-21T12:46:58.731 INFO:tasks.workunit.client.0.smithi046.stdout:7/18: dread f1 [4194304,4194304] 0 2024-09-21T12:46:58.731 INFO:tasks.workunit.client.1.smithi176.stdout:3/645: unlink d1/d34/d48/c4a 0 2024-09-21T12:46:58.734 INFO:tasks.workunit.client.0.smithi046.stdout:7/19: dread f1 [0,4194304] 0 2024-09-21T12:46:58.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/20: chown d2 386 1 2024-09-21T12:46:58.738 INFO:tasks.workunit.client.1.smithi176.stdout:8/521: symlink d6/d16/d36/d7d/la8 0 2024-09-21T12:46:58.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/83: readlink d4/l8 0 2024-09-21T12:46:58.740 INFO:tasks.workunit.client.1.smithi176.stdout:4/559: fdatasync d3/fb1 0 2024-09-21T12:46:58.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/31: write f0 [2027065,124527] 0 2024-09-21T12:46:58.745 INFO:tasks.workunit.client.0.smithi046.stdout:8/38: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:58.746 INFO:tasks.workunit.client.0.smithi046.stdout:5/43: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:46:58.749 INFO:tasks.workunit.client.0.smithi046.stdout:3/89: write d5/f6 [4805006,88959] 0 2024-09-21T12:46:58.749 INFO:tasks.workunit.client.1.smithi176.stdout:2/563: rmdir d4/df/d2e/d6f 39 2024-09-21T12:46:58.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/90: stat d5/dc/ff 0 2024-09-21T12:46:58.751 INFO:tasks.workunit.client.0.smithi046.stdout:9/39: symlink lc 0 2024-09-21T12:46:58.757 INFO:tasks.workunit.client.1.smithi176.stdout:4/560: creat d3/d5/db/d96/fbe x:0 0 0 2024-09-21T12:46:58.758 INFO:tasks.workunit.client.1.smithi176.stdout:0/654: symlink d9/d1a/d1d/d81/le8 0 2024-09-21T12:46:58.761 INFO:tasks.workunit.client.1.smithi176.stdout:8/522: dread d6/db/d37/f88 [0,4194304] 0 2024-09-21T12:46:58.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/98: link d1/l8 d1/d13/l21 0 2024-09-21T12:46:58.764 INFO:tasks.workunit.client.0.smithi046.stdout:6/7: symlink l0 0 2024-09-21T12:46:58.764 INFO:tasks.workunit.client.0.smithi046.stdout:6/8: truncate - no filename 2024-09-21T12:46:58.764 INFO:tasks.workunit.client.0.smithi046.stdout:6/9: dread - no filename 2024-09-21T12:46:58.765 INFO:tasks.workunit.client.0.smithi046.stdout:7/21: write f1 [999635,43202] 0 2024-09-21T12:46:58.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/10: stat l0 0 2024-09-21T12:46:58.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/11: write - no filename 2024-09-21T12:46:58.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/12: dread - no filename 2024-09-21T12:46:58.765 INFO:tasks.workunit.client.0.smithi046.stdout:6/13: dread - no filename 2024-09-21T12:46:58.767 INFO:tasks.workunit.client.0.smithi046.stdout:8/39: creat d1/fe x:0 0 0 2024-09-21T12:46:58.769 INFO:tasks.workunit.client.1.smithi176.stdout:3/646: rename d1/d34/d57/dd0/d7d/fd6 to d1/d34/d57/dd0/d7d/ff4 0 2024-09-21T12:46:58.773 INFO:tasks.workunit.client.1.smithi176.stdout:9/531: link d1/f5d d1/df/d23/d67/fb8 0 2024-09-21T12:46:58.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/40: read - f4 zero size 2024-09-21T12:46:58.774 INFO:tasks.workunit.client.1.smithi176.stdout:9/532: write d1/df/d48/d69/d38/f5c [595062,89770] 0 2024-09-21T12:46:58.775 INFO:tasks.workunit.client.1.smithi176.stdout:2/564: creat d4/df/d83/d8e/faf x:0 0 0 2024-09-21T12:46:58.777 INFO:tasks.workunit.client.1.smithi176.stdout:3/647: unlink d1/d5/d25/l30 0 2024-09-21T12:46:58.779 INFO:tasks.workunit.client.0.smithi046.stdout:6/14: creat f1 x:0 0 0 2024-09-21T12:46:58.780 INFO:tasks.workunit.client.1.smithi176.stdout:9/533: creat d1/d61/d73/fb9 x:0 0 0 2024-09-21T12:46:58.780 INFO:tasks.workunit.client.1.smithi176.stdout:2/565: dwrite d4/d63/f68 [0,4194304] 0 2024-09-21T12:46:58.781 INFO:tasks.workunit.client.0.smithi046.stdout:7/22: rename f1 to d2/f3 0 2024-09-21T12:46:58.782 INFO:tasks.workunit.client.1.smithi176.stdout:9/534: truncate d1/df/d1c/f3c 4544624 0 2024-09-21T12:46:58.782 INFO:tasks.workunit.client.1.smithi176.stdout:0/655: rename l1 to d9/d1a/d3f/d40/le9 0 2024-09-21T12:46:58.782 INFO:tasks.workunit.client.1.smithi176.stdout:9/535: dread - d1/d8b/fa6 zero size 2024-09-21T12:46:58.783 INFO:tasks.workunit.client.0.smithi046.stdout:8/40: rename d1/f3 to d1/ff 0 2024-09-21T12:46:58.783 INFO:tasks.workunit.client.1.smithi176.stdout:3/648: readlink d1/d5/d25/d38/l45 0 2024-09-21T12:46:58.785 INFO:tasks.workunit.client.1.smithi176.stdout:8/523: rename d6/db/d13/f68 to d6/db/d32/fa9 0 2024-09-21T12:46:58.786 INFO:tasks.workunit.client.1.smithi176.stdout:0/656: symlink d9/d1b/d63/d75/lea 0 2024-09-21T12:46:58.787 INFO:tasks.workunit.client.1.smithi176.stdout:0/657: chown d9/d1a/d1d/d81/d8e 93233 1 2024-09-21T12:46:58.788 INFO:tasks.workunit.client.1.smithi176.stdout:3/649: creat d1/d9e/ff5 x:0 0 0 2024-09-21T12:46:58.791 INFO:tasks.workunit.client.1.smithi176.stdout:8/524: rmdir d6/db/d13 39 2024-09-21T12:46:58.791 INFO:tasks.workunit.client.1.smithi176.stdout:8/525: chown d6/d16/f86 6 1 2024-09-21T12:46:58.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/41: dwrite fa [4194304,4194304] 0 2024-09-21T12:46:58.792 INFO:tasks.workunit.client.1.smithi176.stdout:8/526: readlink d6/d8/d24/d35/l66 0 2024-09-21T12:46:58.792 INFO:tasks.workunit.client.0.smithi046.stdout:7/23: mkdir d2/d4 0 2024-09-21T12:46:58.793 INFO:tasks.workunit.client.1.smithi176.stdout:0/658: chown d9/d1a/d1d/d23/d5f/f61 72 1 2024-09-21T12:46:58.794 INFO:tasks.workunit.client.1.smithi176.stdout:0/659: write d9/d1a/d1d/d23/da1/db0/fd1 [4813584,96509] 0 2024-09-21T12:46:58.796 INFO:tasks.workunit.client.0.smithi046.stdout:8/41: creat d1/f10 x:0 0 0 2024-09-21T12:46:58.796 INFO:tasks.workunit.client.1.smithi176.stdout:3/650: mkdir d1/d34/d71/d91/df6 0 2024-09-21T12:46:58.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/42: symlink ld 0 2024-09-21T12:46:58.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/43: rmdir - no directory 2024-09-21T12:46:58.806 INFO:tasks.workunit.client.1.smithi176.stdout:2/566: rename d4/df/f2a to d4/fb0 0 2024-09-21T12:46:58.806 INFO:tasks.workunit.client.1.smithi176.stdout:0/660: dwrite d9/d1a/d1d/f51 [0,4194304] 0 2024-09-21T12:46:58.807 INFO:tasks.workunit.client.0.smithi046.stdout:9/44: dwrite f1 [4194304,4194304] 0 2024-09-21T12:46:58.807 INFO:tasks.workunit.client.1.smithi176.stdout:8/527: symlink d6/db/d13/laa 0 2024-09-21T12:46:58.809 INFO:tasks.workunit.client.0.smithi046.stdout:7/24: link d2/f3 d2/f5 0 2024-09-21T12:46:58.812 INFO:tasks.workunit.client.1.smithi176.stdout:9/536: rename d1/d63/c74 to d1/df/d23/cba 0 2024-09-21T12:46:58.814 INFO:tasks.workunit.client.1.smithi176.stdout:2/567: readlink d4/df/l25 0 2024-09-21T12:46:58.816 INFO:tasks.workunit.client.1.smithi176.stdout:0/661: chown d9/d1a/d1d/d22/f3b 1259 1 2024-09-21T12:46:58.819 INFO:tasks.workunit.client.1.smithi176.stdout:8/528: stat d6/d8/l4c 0 2024-09-21T12:46:58.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/45: link f6 fe 0 2024-09-21T12:46:58.822 INFO:tasks.workunit.client.1.smithi176.stdout:2/568: rename d4/ld to d4/df/d2e/d4d/lb1 0 2024-09-21T12:46:58.823 INFO:tasks.workunit.client.1.smithi176.stdout:0/662: mknod d9/d1a/d1d/d23/da1/da3/d8f/ceb 0 2024-09-21T12:46:58.824 INFO:tasks.workunit.client.1.smithi176.stdout:8/529: mknod d6/db/d37/cab 0 2024-09-21T12:46:58.824 INFO:tasks.workunit.client.1.smithi176.stdout:0/663: write d9/d1a/d1d/d23/dd3/fd9 [456460,67743] 0 2024-09-21T12:46:58.825 INFO:tasks.workunit.client.1.smithi176.stdout:9/537: creat d1/df/d48/d69/fbb x:0 0 0 2024-09-21T12:46:58.826 INFO:tasks.workunit.client.1.smithi176.stdout:2/569: getdents d4/d3d/d76 0 2024-09-21T12:46:58.827 INFO:tasks.workunit.client.0.smithi046.stdout:9/46: dwrite fb [0,4194304] 0 2024-09-21T12:46:58.828 INFO:tasks.workunit.client.1.smithi176.stdout:6/490: sync 2024-09-21T12:46:58.829 INFO:tasks.workunit.client.1.smithi176.stdout:9/538: unlink d1/df/l11 0 2024-09-21T12:46:58.830 INFO:tasks.workunit.client.1.smithi176.stdout:6/491: stat d2/dd/l85 0 2024-09-21T12:46:58.831 INFO:tasks.workunit.client.1.smithi176.stdout:2/570: fsync d4/df/d2e/d6f/d5d/d67/f97 0 2024-09-21T12:46:58.832 INFO:tasks.workunit.client.1.smithi176.stdout:8/530: dwrite d6/f5b [0,4194304] 0 2024-09-21T12:46:58.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/47: truncate f6 1572756 0 2024-09-21T12:46:58.836 INFO:tasks.workunit.client.1.smithi176.stdout:0/664: dread d9/d1a/d1d/d23/dd3/fd9 [0,4194304] 0 2024-09-21T12:46:58.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/48: read f1 [623848,9515] 0 2024-09-21T12:46:58.838 INFO:tasks.workunit.client.1.smithi176.stdout:8/531: chown d6/d8/d54 341 1 2024-09-21T12:46:58.839 INFO:tasks.workunit.client.1.smithi176.stdout:2/571: rename d4/df/d2e/d6f/d5d/d81/d95 to d4/df/d2e/d6f/d5d/d81/db2 0 2024-09-21T12:46:58.842 INFO:tasks.workunit.client.0.smithi046.stdout:1/84: dwrite d4/d13/f1c [0,4194304] 0 2024-09-21T12:46:58.844 INFO:tasks.workunit.client.0.smithi046.stdout:5/44: write f1 [502774,7648] 0 2024-09-21T12:46:58.846 INFO:tasks.workunit.client.0.smithi046.stdout:3/91: write d5/dc/ff [2834590,51250] 0 2024-09-21T12:46:58.846 INFO:tasks.workunit.client.1.smithi176.stdout:8/532: mknod d6/d16/d36/cac 0 2024-09-21T12:46:58.849 INFO:tasks.workunit.client.1.smithi176.stdout:2/572: rmdir d4/df/d2e 39 2024-09-21T12:46:58.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/49: rename fe to ff 0 2024-09-21T12:46:58.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/15: getdents . 0 2024-09-21T12:46:58.851 INFO:tasks.workunit.client.0.smithi046.stdout:9/50: chown ld 1528 1 2024-09-21T12:46:58.852 INFO:tasks.workunit.client.0.smithi046.stdout:6/16: dread - f1 zero size 2024-09-21T12:46:58.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/51: stat l7 0 2024-09-21T12:46:58.854 INFO:tasks.workunit.client.0.smithi046.stdout:1/85: creat d4/d13/f23 x:0 0 0 2024-09-21T12:46:58.855 INFO:tasks.workunit.client.0.smithi046.stdout:6/17: write f1 [930841,106490] 0 2024-09-21T12:46:58.855 INFO:tasks.workunit.client.0.smithi046.stdout:6/18: rmdir - no directory 2024-09-21T12:46:58.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/99: dwrite d1/fd [0,4194304] 0 2024-09-21T12:46:58.856 INFO:tasks.workunit.client.1.smithi176.stdout:0/665: symlink d9/d1a/db8/dd2/lec 0 2024-09-21T12:46:58.856 INFO:tasks.workunit.client.1.smithi176.stdout:2/573: dwrite d4/d3d/d65/f89 [0,4194304] 0 2024-09-21T12:46:58.858 INFO:tasks.workunit.client.0.smithi046.stdout:4/100: chown d1/f1b 25303 1 2024-09-21T12:46:58.861 INFO:tasks.workunit.client.1.smithi176.stdout:6/492: getdents d2/dd/d26/d2b/d10/d39 0 2024-09-21T12:46:58.862 INFO:tasks.workunit.client.1.smithi176.stdout:6/493: chown d2 6850023 1 2024-09-21T12:46:58.862 INFO:tasks.workunit.client.1.smithi176.stdout:6/494: stat d2/dd/d26/d2b/f14 0 2024-09-21T12:46:58.864 INFO:tasks.workunit.client.0.smithi046.stdout:9/52: creat f10 x:0 0 0 2024-09-21T12:46:58.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/86: rmdir d4 39 2024-09-21T12:46:58.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/19: rename f1 to f2 0 2024-09-21T12:46:58.871 INFO:tasks.workunit.client.0.smithi046.stdout:8/42: getdents d1 0 2024-09-21T12:46:58.872 INFO:tasks.workunit.client.1.smithi176.stdout:6/495: chown d2/dd/d79/l93 73 1 2024-09-21T12:46:58.875 INFO:tasks.workunit.client.1.smithi176.stdout:3/651: write d1/da/f22 [1555969,119914] 0 2024-09-21T12:46:58.878 INFO:tasks.workunit.client.1.smithi176.stdout:6/496: mknod d2/dd/d79/c9a 0 2024-09-21T12:46:58.882 INFO:tasks.workunit.client.1.smithi176.stdout:0/666: rename d9/d1a/d1d/d23/d5f/f61 to d9/d1b/fed 0 2024-09-21T12:46:58.883 INFO:tasks.workunit.client.0.smithi046.stdout:9/53: dwrite fa [0,4194304] 0 2024-09-21T12:46:58.884 INFO:tasks.workunit.client.0.smithi046.stdout:6/20: creat f3 x:0 0 0 2024-09-21T12:46:58.885 INFO:tasks.workunit.client.1.smithi176.stdout:6/497: write d2/f8 [1449748,59877] 0 2024-09-21T12:46:58.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/43: fsync d1/fa 0 2024-09-21T12:46:58.889 INFO:tasks.workunit.client.1.smithi176.stdout:3/652: rename f0 to d1/d3e/ddc/ff7 0 2024-09-21T12:46:58.891 INFO:tasks.workunit.client.0.smithi046.stdout:3/92: rename d5/dc/ff to d5/f20 0 2024-09-21T12:46:58.893 INFO:tasks.workunit.client.0.smithi046.stdout:1/87: mknod d4/d13/c24 0 2024-09-21T12:46:58.897 INFO:tasks.workunit.client.1.smithi176.stdout:0/667: dwrite d9/d1b/d63/d77/d88/f5a [0,4194304] 0 2024-09-21T12:46:58.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/21: write f2 [1573716,60442] 0 2024-09-21T12:46:58.902 INFO:tasks.workunit.client.0.smithi046.stdout:5/45: write d4/f7 [54214,62841] 0 2024-09-21T12:46:58.902 INFO:tasks.workunit.client.1.smithi176.stdout:8/533: stat d6/d16/d36/d67/c7c 0 2024-09-21T12:46:58.904 INFO:tasks.workunit.client.1.smithi176.stdout:0/668: readlink d9/d1b/d43/d98/lba 0 2024-09-21T12:46:58.907 INFO:tasks.workunit.client.1.smithi176.stdout:6/498: creat d2/dd/d26/d2b/d10/d1b/f9b x:0 0 0 2024-09-21T12:46:58.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/88: fsync d4/d13/f21 0 2024-09-21T12:46:58.910 INFO:tasks.workunit.client.0.smithi046.stdout:4/101: dwrite d1/ff [0,4194304] 0 2024-09-21T12:46:58.911 INFO:tasks.workunit.client.1.smithi176.stdout:0/669: rmdir d9/d1a/db8 39 2024-09-21T12:46:58.914 INFO:tasks.workunit.client.1.smithi176.stdout:2/574: dwrite d4/df/f1c [0,4194304] 0 2024-09-21T12:46:58.918 INFO:tasks.workunit.client.1.smithi176.stdout:6/499: dwrite d2/dd/d26/d2b/d10/d39/f6c [0,4194304] 0 2024-09-21T12:46:58.919 INFO:tasks.workunit.client.0.smithi046.stdout:6/22: unlink l0 0 2024-09-21T12:46:58.920 INFO:tasks.workunit.client.1.smithi176.stdout:8/534: unlink d6/db/d13/f5a 0 2024-09-21T12:46:58.921 INFO:tasks.workunit.client.0.smithi046.stdout:8/44: link d1/f6 d1/f11 0 2024-09-21T12:46:58.922 INFO:tasks.workunit.client.0.smithi046.stdout:8/45: dread - d1/f7 zero size 2024-09-21T12:46:58.923 INFO:tasks.workunit.client.1.smithi176.stdout:0/670: mkdir d9/d1a/d1d/d23/dd3/dee 0 2024-09-21T12:46:58.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/93: write d5/f10 [312725,49698] 0 2024-09-21T12:46:58.930 INFO:tasks.workunit.client.1.smithi176.stdout:0/671: mkdir d9/d1a/d1d/d23/da1/da3/d8f/dd8/def 0 2024-09-21T12:46:58.931 INFO:tasks.workunit.client.1.smithi176.stdout:2/575: dwrite d4/d63/d93/f82 [0,4194304] 0 2024-09-21T12:46:58.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/54: truncate fb 860269 0 2024-09-21T12:46:58.933 INFO:tasks.workunit.client.1.smithi176.stdout:2/576: write d4/d3d/d65/f89 [1095068,96735] 0 2024-09-21T12:46:58.933 INFO:tasks.workunit.client.0.smithi046.stdout:6/23: symlink l4 0 2024-09-21T12:46:58.934 INFO:tasks.workunit.client.0.smithi046.stdout:6/24: truncate f3 94877 0 2024-09-21T12:46:58.937 INFO:tasks.workunit.client.1.smithi176.stdout:8/535: mkdir d6/d16/d9c/dad 0 2024-09-21T12:46:58.940 INFO:tasks.workunit.client.0.smithi046.stdout:8/46: write d1/fd [837455,70901] 0 2024-09-21T12:46:58.942 INFO:tasks.workunit.client.1.smithi176.stdout:0/672: symlink d9/d1a/d1d/d23/da1/da3/d1e/d47/lf0 0 2024-09-21T12:46:58.948 INFO:tasks.workunit.client.1.smithi176.stdout:6/500: dread d2/f20 [4194304,4194304] 0 2024-09-21T12:46:58.949 INFO:tasks.workunit.client.1.smithi176.stdout:6/501: chown d2/dd/d26/d2b/f7e 151560 1 2024-09-21T12:46:58.950 INFO:tasks.workunit.client.1.smithi176.stdout:0/673: fdatasync d9/d1a/d1d/d23/dd3/fd9 0 2024-09-21T12:46:58.951 INFO:tasks.workunit.client.1.smithi176.stdout:2/577: creat d4/df/d2e/d4d/d70/fb3 x:0 0 0 2024-09-21T12:46:58.952 INFO:tasks.workunit.client.1.smithi176.stdout:2/578: read d4/d63/d93/f82 [4003291,54890] 0 2024-09-21T12:46:58.953 INFO:tasks.workunit.client.0.smithi046.stdout:6/25: creat f5 x:0 0 0 2024-09-21T12:46:58.954 INFO:tasks.workunit.client.0.smithi046.stdout:8/47: mkdir d1/d12 0 2024-09-21T12:46:58.956 INFO:tasks.workunit.client.1.smithi176.stdout:8/536: dread d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:46:58.957 INFO:tasks.workunit.client.1.smithi176.stdout:0/674: creat d9/d1a/d1d/d23/da1/da3/d1e/d47/ff1 x:0 0 0 2024-09-21T12:46:58.958 INFO:tasks.workunit.client.1.smithi176.stdout:0/675: truncate d9/d1a/fd0 871621 0 2024-09-21T12:46:58.960 INFO:tasks.workunit.client.0.smithi046.stdout:4/102: dwrite d1/f6 [0,4194304] 0 2024-09-21T12:46:58.963 INFO:tasks.workunit.client.0.smithi046.stdout:6/26: creat f6 x:0 0 0 2024-09-21T12:46:58.963 INFO:tasks.workunit.client.0.smithi046.stdout:5/46: truncate d4/f8 2961557 0 2024-09-21T12:46:58.964 INFO:tasks.workunit.client.0.smithi046.stdout:6/27: read - f5 zero size 2024-09-21T12:46:58.964 INFO:tasks.workunit.client.0.smithi046.stdout:6/28: dread - f5 zero size 2024-09-21T12:46:58.966 INFO:tasks.workunit.client.1.smithi176.stdout:8/537: write d6/d8/d54/f76 [1272413,28104] 0 2024-09-21T12:46:58.968 INFO:tasks.workunit.client.1.smithi176.stdout:0/676: unlink d9/d1a/d1d/d81/la5 0 2024-09-21T12:46:58.968 INFO:tasks.workunit.client.1.smithi176.stdout:0/677: fsync d9/d1a/d1d/d23/fb4 0 2024-09-21T12:46:58.969 INFO:tasks.workunit.client.1.smithi176.stdout:0/678: chown d9/d1b/d63/d77/d88/laa 27 1 2024-09-21T12:46:58.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/89: write d4/f5 [378797,117639] 0 2024-09-21T12:46:58.971 INFO:tasks.workunit.client.1.smithi176.stdout:1/590: sync 2024-09-21T12:46:58.972 INFO:tasks.workunit.client.0.smithi046.stdout:6/29: dwrite f6 [0,4194304] 0 2024-09-21T12:46:58.976 INFO:tasks.workunit.client.1.smithi176.stdout:1/591: dread d0/db/fa7 [0,4194304] 0 2024-09-21T12:46:58.977 INFO:tasks.workunit.client.1.smithi176.stdout:1/592: read - d0/db/d6a/fcd zero size 2024-09-21T12:46:58.980 INFO:tasks.workunit.client.0.smithi046.stdout:8/48: creat d1/d12/f13 x:0 0 0 2024-09-21T12:46:58.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/30: dwrite f3 [0,4194304] 0 2024-09-21T12:46:58.984 INFO:tasks.workunit.client.0.smithi046.stdout:3/94: getdents d5/d16 0 2024-09-21T12:46:58.988 INFO:tasks.workunit.client.1.smithi176.stdout:0/679: creat d9/d1a/d1d/d23/da1/db0/ff2 x:0 0 0 2024-09-21T12:46:58.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/4: sync 2024-09-21T12:46:58.991 INFO:tasks.workunit.client.1.smithi176.stdout:2/579: write d4/df/f15 [1628171,105597] 0 2024-09-21T12:46:58.992 INFO:tasks.workunit.client.0.smithi046.stdout:9/55: getdents . 0 2024-09-21T12:46:58.992 INFO:tasks.workunit.client.0.smithi046.stdout:6/31: dwrite f3 [0,4194304] 0 2024-09-21T12:46:58.993 INFO:tasks.workunit.client.1.smithi176.stdout:2/580: write d4/df/f1c [681861,75656] 0 2024-09-21T12:46:58.997 INFO:tasks.workunit.client.1.smithi176.stdout:6/502: getdents d2/d6f 0 2024-09-21T12:46:58.997 INFO:tasks.workunit.client.1.smithi176.stdout:8/538: write d6/d8/d24/f3f [511583,3579] 0 2024-09-21T12:46:58.998 INFO:tasks.workunit.client.1.smithi176.stdout:8/539: write d6/d8/d24/d35/d51/f53 [437690,120065] 0 2024-09-21T12:46:58.999 INFO:tasks.workunit.client.1.smithi176.stdout:0/680: rmdir d9/d1a/d3f/d40 39 2024-09-21T12:46:59.000 INFO:tasks.workunit.client.1.smithi176.stdout:0/681: chown d9/d1b/d63/d77/d88/laa 7547 1 2024-09-21T12:46:59.005 INFO:tasks.workunit.client.0.smithi046.stdout:8/49: mknod d1/d12/c14 0 2024-09-21T12:46:59.006 INFO:tasks.workunit.client.1.smithi176.stdout:1/593: rename d0/db/d1a/d2c/dc5/c53 to d0/db/d1a/d2c/dc5/d41/d59/d99/cd9 0 2024-09-21T12:46:59.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/103: dwrite d1/d13/d14/f1e [0,4194304] 0 2024-09-21T12:46:59.007 INFO:tasks.workunit.client.0.smithi046.stdout:8/50: chown d1/f8 112102 1 2024-09-21T12:46:59.008 INFO:tasks.workunit.client.0.smithi046.stdout:6/32: dwrite f5 [0,4194304] 0 2024-09-21T12:46:59.010 INFO:tasks.workunit.client.0.smithi046.stdout:6/33: stat f6 0 2024-09-21T12:46:59.010 INFO:tasks.workunit.client.0.smithi046.stdout:3/95: mknod d5/d16/c21 0 2024-09-21T12:46:59.011 INFO:tasks.workunit.client.0.smithi046.stdout:3/96: chown d5/c14 7 1 2024-09-21T12:46:59.012 INFO:tasks.workunit.client.0.smithi046.stdout:8/51: dread d1/fa [0,4194304] 0 2024-09-21T12:46:59.012 INFO:tasks.workunit.client.0.smithi046.stdout:0/5: symlink l2 0 2024-09-21T12:46:59.013 INFO:tasks.workunit.client.1.smithi176.stdout:8/540: mknod d6/d16/d79/cae 0 2024-09-21T12:46:59.014 INFO:tasks.workunit.client.0.smithi046.stdout:1/90: mknod d4/c25 0 2024-09-21T12:46:59.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/91: chown d4/d13/f1c 77 1 2024-09-21T12:46:59.017 INFO:tasks.workunit.client.0.smithi046.stdout:9/56: unlink f9 0 2024-09-21T12:46:59.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/47: truncate d4/fa 4084010 0 2024-09-21T12:46:59.023 INFO:tasks.workunit.client.1.smithi176.stdout:6/503: symlink d2/l9c 0 2024-09-21T12:46:59.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/32: sync 2024-09-21T12:46:59.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/25: sync 2024-09-21T12:46:59.025 INFO:tasks.workunit.client.0.smithi046.stdout:5/48: dread f1 [0,4194304] 0 2024-09-21T12:46:59.027 INFO:tasks.workunit.client.0.smithi046.stdout:0/6: rename f1 to f3 0 2024-09-21T12:46:59.030 INFO:tasks.workunit.client.1.smithi176.stdout:0/682: rename d9/d1a/d1d/d23/da1/da3/d1e/dbf/fc6 to d9/d1a/d1d/d23/da1/da3/ff3 0 2024-09-21T12:46:59.030 INFO:tasks.workunit.client.0.smithi046.stdout:8/52: truncate d1/f7 252818 0 2024-09-21T12:46:59.032 INFO:tasks.workunit.client.0.smithi046.stdout:9/57: mkdir d11 0 2024-09-21T12:46:59.035 INFO:tasks.workunit.client.1.smithi176.stdout:0/683: dwrite d9/d1b/dcc/fe0 [0,4194304] 0 2024-09-21T12:46:59.041 INFO:tasks.workunit.client.1.smithi176.stdout:1/594: getdents d0/db/d6f 0 2024-09-21T12:46:59.042 INFO:tasks.workunit.client.0.smithi046.stdout:3/97: symlink d5/l22 0 2024-09-21T12:46:59.043 INFO:tasks.workunit.client.0.smithi046.stdout:3/98: stat d5/f7 0 2024-09-21T12:46:59.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/104: truncate d1/fd 109332 0 2024-09-21T12:46:59.045 INFO:tasks.workunit.client.1.smithi176.stdout:8/541: link d6/db/d32/l74 d6/db/d37/d89/d8a/da6/laf 0 2024-09-21T12:46:59.047 INFO:tasks.workunit.client.1.smithi176.stdout:1/595: dwrite d0/db/d1a/d2c/dc5/d2b/d43/f69 [0,4194304] 0 2024-09-21T12:46:59.048 INFO:tasks.workunit.client.1.smithi176.stdout:1/596: write d0/f5e [2195336,83481] 0 2024-09-21T12:46:59.049 INFO:tasks.workunit.client.0.smithi046.stdout:5/49: chown d4/f8 66969134 1 2024-09-21T12:46:59.050 INFO:tasks.workunit.client.0.smithi046.stdout:5/50: readlink d4/l6 0 2024-09-21T12:46:59.050 INFO:tasks.workunit.client.1.smithi176.stdout:6/504: truncate d2/dd/d26/d2b/d10/d39/f5b 1650277 0 2024-09-21T12:46:59.054 INFO:tasks.workunit.client.1.smithi176.stdout:8/542: write d6/db/d37/d7a/f7e [3631387,58642] 0 2024-09-21T12:46:59.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/7: creat f4 x:0 0 0 2024-09-21T12:46:59.057 INFO:tasks.workunit.client.1.smithi176.stdout:8/543: read d6/db/f43 [975837,100233] 0 2024-09-21T12:46:59.061 INFO:tasks.workunit.client.0.smithi046.stdout:8/53: mknod d1/c15 0 2024-09-21T12:46:59.062 INFO:tasks.workunit.client.1.smithi176.stdout:5/470: sync 2024-09-21T12:46:59.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/8: dwrite f4 [0,4194304] 0 2024-09-21T12:46:59.063 INFO:tasks.workunit.client.1.smithi176.stdout:1/597: creat d0/db/d1a/d2c/dc5/d41/d59/fda x:0 0 0 2024-09-21T12:46:59.064 INFO:tasks.workunit.client.1.smithi176.stdout:8/544: dwrite d6/d8/d24/d35/d51/f55 [0,4194304] 0 2024-09-21T12:46:59.064 INFO:tasks.workunit.client.0.smithi046.stdout:0/9: chown f3 403 1 2024-09-21T12:46:59.066 INFO:tasks.workunit.client.1.smithi176.stdout:6/505: symlink d2/dd/d26/d2b/d10/d87/l9d 0 2024-09-21T12:46:59.070 INFO:tasks.workunit.client.0.smithi046.stdout:6/34: link l4 l7 0 2024-09-21T12:46:59.071 INFO:tasks.workunit.client.0.smithi046.stdout:6/35: readlink l7 0 2024-09-21T12:46:59.071 INFO:tasks.workunit.client.1.smithi176.stdout:0/684: link d9/d1a/d1d/d23/da1/da3/lc5 d9/d1a/d1d/d23/da1/db0/lf4 0 2024-09-21T12:46:59.072 INFO:tasks.workunit.client.0.smithi046.stdout:8/54: dwrite d1/d12/f13 [0,4194304] 0 2024-09-21T12:46:59.072 INFO:tasks.workunit.client.0.smithi046.stdout:6/36: chown f6 18918981 1 2024-09-21T12:46:59.074 INFO:tasks.workunit.client.1.smithi176.stdout:5/471: unlink d0/d13/d63/d2e/d39/d41/l6f 0 2024-09-21T12:46:59.076 INFO:tasks.workunit.client.1.smithi176.stdout:5/472: readlink d0/d13/d63/d2e/d71/l85 0 2024-09-21T12:46:59.078 INFO:tasks.workunit.client.1.smithi176.stdout:1/598: rename d0/db/l4f to d0/db/d1a/d2c/d37/ldb 0 2024-09-21T12:46:59.078 INFO:tasks.workunit.client.1.smithi176.stdout:5/473: stat d0/d13/d63/d2e/d37/f57 0 2024-09-21T12:46:59.078 INFO:tasks.workunit.client.0.smithi046.stdout:4/105: symlink d1/d13/l22 0 2024-09-21T12:46:59.079 INFO:tasks.workunit.client.1.smithi176.stdout:0/685: dwrite d9/d1a/d1d/d23/da1/da3/d1e/f6f [0,4194304] 0 2024-09-21T12:46:59.080 INFO:tasks.workunit.client.0.smithi046.stdout:5/51: unlink f1 0 2024-09-21T12:46:59.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/26: mknod d2/d4/c6 0 2024-09-21T12:46:59.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/92: creat d4/f26 x:0 0 0 2024-09-21T12:46:59.084 INFO:tasks.workunit.client.1.smithi176.stdout:0/686: truncate d9/d1a/d1d/d23/d5f/fcb 107131 0 2024-09-21T12:46:59.084 INFO:tasks.workunit.client.0.smithi046.stdout:9/58: creat d11/f12 x:0 0 0 2024-09-21T12:46:59.086 INFO:tasks.workunit.client.0.smithi046.stdout:0/10: unlink f3 0 2024-09-21T12:46:59.086 INFO:tasks.workunit.client.1.smithi176.stdout:1/599: creat d0/db/d1a/d2c/d6b/fdc x:0 0 0 2024-09-21T12:46:59.088 INFO:tasks.workunit.client.1.smithi176.stdout:5/474: dwrite d0/d13/d63/f51 [0,4194304] 0 2024-09-21T12:46:59.090 INFO:tasks.workunit.client.0.smithi046.stdout:0/11: dread f4 [0,4194304] 0 2024-09-21T12:46:59.090 INFO:tasks.workunit.client.1.smithi176.stdout:5/475: read d0/d13/d63/f3d [2727266,13719] 0 2024-09-21T12:46:59.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/12: read f4 [1033341,14136] 0 2024-09-21T12:46:59.091 INFO:tasks.workunit.client.1.smithi176.stdout:0/687: creat d9/d1b/d63/d77/d88/ff5 x:0 0 0 2024-09-21T12:46:59.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/37: symlink l8 0 2024-09-21T12:46:59.093 INFO:tasks.workunit.client.1.smithi176.stdout:0/688: write d9/d1b/d63/d77/d88/f96 [328789,52373] 0 2024-09-21T12:46:59.100 INFO:tasks.workunit.client.1.smithi176.stdout:0/689: dwrite d9/d1a/d1d/d23/da1/db0/fd1 [4194304,4194304] 0 2024-09-21T12:46:59.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/13: dwrite f4 [0,4194304] 0 2024-09-21T12:46:59.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/33: link l8 ld 0 2024-09-21T12:46:59.104 INFO:tasks.workunit.client.1.smithi176.stdout:1/600: mkdir d0/db/d1a/d2c/dc5/ddd 0 2024-09-21T12:46:59.105 INFO:tasks.workunit.client.1.smithi176.stdout:1/601: write d0/db/d6a/fcd [962401,59165] 0 2024-09-21T12:46:59.109 INFO:tasks.workunit.client.1.smithi176.stdout:6/506: chown d2/dd/d26/d2b/d10/d39/f5b 1 1 2024-09-21T12:46:59.111 INFO:tasks.workunit.client.0.smithi046.stdout:1/93: creat d4/d13/f27 x:0 0 0 2024-09-21T12:46:59.113 INFO:tasks.workunit.client.1.smithi176.stdout:5/476: creat d0/d13/d63/d72/d87/f89 x:0 0 0 2024-09-21T12:46:59.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/59: truncate f4 210824 0 2024-09-21T12:46:59.114 INFO:tasks.workunit.client.1.smithi176.stdout:5/477: write d0/d13/f50 [4691137,23229] 0 2024-09-21T12:46:59.117 INFO:tasks.workunit.client.1.smithi176.stdout:1/602: mkdir d0/db/d6a/d89/dde 0 2024-09-21T12:46:59.119 INFO:tasks.workunit.client.0.smithi046.stdout:6/38: unlink l8 0 2024-09-21T12:46:59.120 INFO:tasks.workunit.client.1.smithi176.stdout:6/507: symlink d2/dd/d26/d2b/d10/d87/l9e 0 2024-09-21T12:46:59.123 INFO:tasks.workunit.client.0.smithi046.stdout:3/99: rename d5/d16/c21 to d5/c23 0 2024-09-21T12:46:59.123 INFO:tasks.workunit.client.0.smithi046.stdout:7/27: rename d2 to d2/d7 22 2024-09-21T12:46:59.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/34: creat fe x:0 0 0 2024-09-21T12:46:59.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/52: getdents d4/d9 0 2024-09-21T12:46:59.130 INFO:tasks.workunit.client.0.smithi046.stdout:8/55: dwrite d1/ff [0,4194304] 0 2024-09-21T12:46:59.133 INFO:tasks.workunit.client.1.smithi176.stdout:0/690: link d9/d1a/d3f/d40/d79/cd4 d9/d1a/d1d/d23/da1/da3/d1e/d47/cf6 0 2024-09-21T12:46:59.135 INFO:tasks.workunit.client.1.smithi176.stdout:0/691: write d9/d1a/d1d/d23/da1/da3/d1e/fc3 [4746040,67182] 0 2024-09-21T12:46:59.135 INFO:tasks.workunit.client.1.smithi176.stdout:1/603: rmdir d0/db/d6a/d89/dde 0 2024-09-21T12:46:59.137 INFO:tasks.workunit.client.0.smithi046.stdout:4/106: truncate d1/fd 507755 0 2024-09-21T12:46:59.139 INFO:tasks.workunit.client.1.smithi176.stdout:1/604: creat d0/db/d2a/fdf x:0 0 0 2024-09-21T12:46:59.141 INFO:tasks.workunit.client.0.smithi046.stdout:7/28: unlink d2/d4/c6 0 2024-09-21T12:46:59.141 INFO:tasks.workunit.client.0.smithi046.stdout:4/107: dread d1/f6 [0,4194304] 0 2024-09-21T12:46:59.144 INFO:tasks.workunit.client.1.smithi176.stdout:0/692: mknod d9/d1a/d1d/d23/dd3/dee/cf7 0 2024-09-21T12:46:59.146 INFO:tasks.workunit.client.0.smithi046.stdout:5/53: rmdir d4 39 2024-09-21T12:46:59.147 INFO:tasks.workunit.client.1.smithi176.stdout:0/693: mkdir d9/d1b/d63/d75/df8 0 2024-09-21T12:46:59.149 INFO:tasks.workunit.client.0.smithi046.stdout:8/56: creat d1/d12/f16 x:0 0 0 2024-09-21T12:46:59.150 INFO:tasks.workunit.client.0.smithi046.stdout:8/57: dread - d1/fb zero size 2024-09-21T12:46:59.150 INFO:tasks.workunit.client.0.smithi046.stdout:9/60: dwrite f3 [0,4194304] 0 2024-09-21T12:46:59.151 INFO:tasks.workunit.client.0.smithi046.stdout:9/61: chown d11/f12 9 1 2024-09-21T12:46:59.158 INFO:tasks.workunit.client.1.smithi176.stdout:0/694: rename d9/d1b/d63 to d9/d1a/d1d/d23/da1/da3/d93/df9 0 2024-09-21T12:46:59.159 INFO:tasks.workunit.client.0.smithi046.stdout:1/94: write d4/f18 [307374,78746] 0 2024-09-21T12:46:59.159 INFO:tasks.workunit.client.1.smithi176.stdout:0/695: dread - d9/d1a/d1d/d23/da1/da3/d93/df9/fce zero size 2024-09-21T12:46:59.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/29: creat d2/d4/f8 x:0 0 0 2024-09-21T12:46:59.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/62: dwrite f10 [0,4194304] 0 2024-09-21T12:46:59.161 INFO:tasks.workunit.client.0.smithi046.stdout:6/39: truncate f5 2988356 0 2024-09-21T12:46:59.163 INFO:tasks.workunit.client.1.smithi176.stdout:0/696: mkdir d9/d1a/d1d/d81/d8e/dfa 0 2024-09-21T12:46:59.164 INFO:tasks.workunit.client.1.smithi176.stdout:4/561: sync 2024-09-21T12:46:59.165 INFO:tasks.workunit.client.1.smithi176.stdout:7/663: sync 2024-09-21T12:46:59.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/54: write d4/f7 [300469,26827] 0 2024-09-21T12:46:59.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/55: stat d4/l5 0 2024-09-21T12:46:59.170 INFO:tasks.workunit.client.0.smithi046.stdout:7/30: dwrite d2/d4/f8 [0,4194304] 0 2024-09-21T12:46:59.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/31: readlink l0 0 2024-09-21T12:46:59.173 INFO:tasks.workunit.client.1.smithi176.stdout:4/562: dwrite d3/d42/f69 [0,4194304] 0 2024-09-21T12:46:59.173 INFO:tasks.workunit.client.1.smithi176.stdout:0/697: symlink d9/d1a/db8/dd2/lfb 0 2024-09-21T12:46:59.174 INFO:tasks.workunit.client.0.smithi046.stdout:2/35: truncate f0 886930 0 2024-09-21T12:46:59.174 INFO:tasks.workunit.client.0.smithi046.stdout:8/58: mknod d1/c17 0 2024-09-21T12:46:59.175 INFO:tasks.workunit.client.1.smithi176.stdout:0/698: stat d9/d1a/d1d/d23/da1/da3/d8f/dd8 0 2024-09-21T12:46:59.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/59: dread - d1/d12/f16 zero size 2024-09-21T12:46:59.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/60: read - d1/f8 zero size 2024-09-21T12:46:59.178 INFO:tasks.workunit.client.1.smithi176.stdout:4/563: creat d3/d42/d47/d5c/fbf x:0 0 0 2024-09-21T12:46:59.179 INFO:tasks.workunit.client.0.smithi046.stdout:3/100: creat d5/f24 x:0 0 0 2024-09-21T12:46:59.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/61: dread d1/f6 [0,4194304] 0 2024-09-21T12:46:59.183 INFO:tasks.workunit.client.1.smithi176.stdout:0/699: rename d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/ff5 to d9/d35/ffc 0 2024-09-21T12:46:59.187 INFO:tasks.workunit.client.1.smithi176.stdout:4/564: symlink d3/d5/db/d36/lc0 0 2024-09-21T12:46:59.188 INFO:tasks.workunit.client.1.smithi176.stdout:7/664: dread d0/d2/db/d10/d23/dce/f86 [4194304,4194304] 0 2024-09-21T12:46:59.189 INFO:tasks.workunit.client.0.smithi046.stdout:9/63: mkdir d11/d13 0 2024-09-21T12:46:59.190 INFO:tasks.workunit.client.1.smithi176.stdout:0/700: mknod d9/d1a/d1d/d23/da1/da3/d8f/dd8/cfd 0 2024-09-21T12:46:59.191 INFO:tasks.workunit.client.0.smithi046.stdout:1/95: rename d4/d13/f15 to d4/d13/f28 0 2024-09-21T12:46:59.191 INFO:tasks.workunit.client.1.smithi176.stdout:0/701: truncate d9/d1b/d43/d98/fae 243053 0 2024-09-21T12:46:59.192 INFO:tasks.workunit.client.1.smithi176.stdout:4/565: creat d3/d21/d27/fc1 x:0 0 0 2024-09-21T12:46:59.193 INFO:tasks.workunit.client.0.smithi046.stdout:0/14: getdents . 0 2024-09-21T12:46:59.195 INFO:tasks.workunit.client.1.smithi176.stdout:0/702: rmdir d9/d1a/db8/dd2 39 2024-09-21T12:46:59.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/108: write d1/fd [1425602,14271] 0 2024-09-21T12:46:59.197 INFO:tasks.workunit.client.1.smithi176.stdout:4/566: rmdir d3/d21/d27/d2c 39 2024-09-21T12:46:59.198 INFO:tasks.workunit.client.1.smithi176.stdout:4/567: dread - d3/d42/d56/d4e/f6a zero size 2024-09-21T12:46:59.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/32: fdatasync d2/f3 0 2024-09-21T12:46:59.200 INFO:tasks.workunit.client.1.smithi176.stdout:4/568: chown d3/d5/db/d96/da3/fad 16034127 1 2024-09-21T12:46:59.200 INFO:tasks.workunit.client.1.smithi176.stdout:0/703: rmdir d9/d1a/d1d/d23/dd3 39 2024-09-21T12:46:59.201 INFO:tasks.workunit.client.0.smithi046.stdout:7/33: chown d2/d4/f8 1 1 2024-09-21T12:46:59.202 INFO:tasks.workunit.client.0.smithi046.stdout:5/56: dread d4/fa [0,4194304] 0 2024-09-21T12:46:59.205 INFO:tasks.workunit.client.1.smithi176.stdout:4/569: dwrite d3/d21/d27/fc1 [0,4194304] 0 2024-09-21T12:46:59.207 INFO:tasks.workunit.client.1.smithi176.stdout:0/704: creat d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/ffe x:0 0 0 2024-09-21T12:46:59.211 INFO:tasks.workunit.client.1.smithi176.stdout:7/665: dread d0/d2f/d43/f76 [4194304,4194304] 0 2024-09-21T12:46:59.212 INFO:tasks.workunit.client.1.smithi176.stdout:7/666: write d0/d2/d30/d93/da2/fd8 [579925,89643] 0 2024-09-21T12:46:59.213 INFO:tasks.workunit.client.1.smithi176.stdout:7/667: fsync d0/d2/fb7 0 2024-09-21T12:46:59.216 INFO:tasks.workunit.client.1.smithi176.stdout:0/705: symlink d9/d1a/d1d/d23/dd3/dee/lff 0 2024-09-21T12:46:59.216 INFO:tasks.workunit.client.1.smithi176.stdout:4/570: link d3/d5/db/ca1 d3/d21/da6/cc2 0 2024-09-21T12:46:59.218 INFO:tasks.workunit.client.0.smithi046.stdout:0/15: creat f5 x:0 0 0 2024-09-21T12:46:59.218 INFO:tasks.workunit.client.1.smithi176.stdout:7/668: mkdir d0/d2/da8/dca/df1 0 2024-09-21T12:46:59.220 INFO:tasks.workunit.client.0.smithi046.stdout:4/109: fdatasync d1/d13/d14/f19 0 2024-09-21T12:46:59.222 INFO:tasks.workunit.client.1.smithi176.stdout:4/571: read d3/f3c [2529474,120021] 0 2024-09-21T12:46:59.223 INFO:tasks.workunit.client.1.smithi176.stdout:4/572: truncate d3/d42/d4d/f58 1122169 0 2024-09-21T12:46:59.224 INFO:tasks.workunit.client.1.smithi176.stdout:4/573: dread d3/d42/d47/f7a [0,4194304] 0 2024-09-21T12:46:59.225 INFO:tasks.workunit.client.1.smithi176.stdout:4/574: fdatasync d3/d42/d56/fb8 0 2024-09-21T12:46:59.225 INFO:tasks.workunit.client.1.smithi176.stdout:4/575: dread - d3/d5/db/d36/f9d zero size 2024-09-21T12:46:59.230 INFO:tasks.workunit.client.0.smithi046.stdout:3/101: truncate d5/f10 308083 0 2024-09-21T12:46:59.231 INFO:tasks.workunit.client.1.smithi176.stdout:4/576: creat d3/d42/dae/fc3 x:0 0 0 2024-09-21T12:46:59.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/40: truncate f5 2508557 0 2024-09-21T12:46:59.232 INFO:tasks.workunit.client.1.smithi176.stdout:0/706: link d9/la d9/d1a/d1d/d23/d5f/ddd/l100 0 2024-09-21T12:46:59.233 INFO:tasks.workunit.client.1.smithi176.stdout:2/581: sync 2024-09-21T12:46:59.233 INFO:tasks.workunit.client.1.smithi176.stdout:3/653: sync 2024-09-21T12:46:59.233 INFO:tasks.workunit.client.1.smithi176.stdout:9/539: sync 2024-09-21T12:46:59.234 INFO:tasks.workunit.client.0.smithi046.stdout:1/96: mkdir d4/d29 0 2024-09-21T12:46:59.234 INFO:tasks.workunit.client.1.smithi176.stdout:7/669: link d0/d2/db/fe d0/d2/db/d10/d5a/ff2 0 2024-09-21T12:46:59.235 INFO:tasks.workunit.client.1.smithi176.stdout:3/654: dread - d1/d8d/fa7 zero size 2024-09-21T12:46:59.235 INFO:tasks.workunit.client.1.smithi176.stdout:0/707: truncate d9/d1a/d1d/d23/da1/da3/ff3 342665 0 2024-09-21T12:46:59.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/97: truncate d4/f26 844441 0 2024-09-21T12:46:59.236 INFO:tasks.workunit.client.0.smithi046.stdout:0/16: mkdir d6 0 2024-09-21T12:46:59.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/110: mknod d1/c23 0 2024-09-21T12:46:59.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/36: write f0 [459911,37623] 0 2024-09-21T12:46:59.238 INFO:tasks.workunit.client.0.smithi046.stdout:5/57: symlink d4/d9/lb 0 2024-09-21T12:46:59.239 INFO:tasks.workunit.client.1.smithi176.stdout:9/540: dwrite d1/df/f39 [0,4194304] 0 2024-09-21T12:46:59.240 INFO:tasks.workunit.client.1.smithi176.stdout:2/582: creat d4/df/d2e/d6f/d5d/d67/fb4 x:0 0 0 2024-09-21T12:46:59.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/62: link d1/fa d1/d12/f18 0 2024-09-21T12:46:59.241 INFO:tasks.workunit.client.1.smithi176.stdout:7/670: dread d0/d2/db/d10/d23/dce/f86 [4194304,4194304] 0 2024-09-21T12:46:59.243 INFO:tasks.workunit.client.1.smithi176.stdout:3/655: dread - d1/d34/d57/dc7/fde zero size 2024-09-21T12:46:59.244 INFO:tasks.workunit.client.0.smithi046.stdout:0/17: dwrite f5 [0,4194304] 0 2024-09-21T12:46:59.245 INFO:tasks.workunit.client.1.smithi176.stdout:7/671: dread d0/d5d/d7a/fbd [0,4194304] 0 2024-09-21T12:46:59.245 INFO:tasks.workunit.client.0.smithi046.stdout:0/18: chown l2 2971 1 2024-09-21T12:46:59.251 INFO:tasks.workunit.client.1.smithi176.stdout:3/656: dwrite d1/d35/d5e/d90/fa6 [0,4194304] 0 2024-09-21T12:46:59.253 INFO:tasks.workunit.client.1.smithi176.stdout:0/708: mknod d9/d1a/d1d/d23/da1/db0/c101 0 2024-09-21T12:46:59.255 INFO:tasks.workunit.client.0.smithi046.stdout:9/64: rmdir d11/d13 0 2024-09-21T12:46:59.257 INFO:tasks.workunit.client.1.smithi176.stdout:9/541: mkdir d1/df/d9a/dbc 0 2024-09-21T12:46:59.260 INFO:tasks.workunit.client.1.smithi176.stdout:2/583: creat d4/d63/d93/d80/fb5 x:0 0 0 2024-09-21T12:46:59.261 INFO:tasks.workunit.client.1.smithi176.stdout:4/577: rename d3/d42/d47/d5c/fbf to d3/d5/db/fc4 0 2024-09-21T12:46:59.263 INFO:tasks.workunit.client.0.smithi046.stdout:4/111: unlink d1/f6 0 2024-09-21T12:46:59.265 INFO:tasks.workunit.client.1.smithi176.stdout:9/542: dwrite d1/d8b/fa4 [0,4194304] 0 2024-09-21T12:46:59.266 INFO:tasks.workunit.client.0.smithi046.stdout:5/58: rmdir d4/d9 39 2024-09-21T12:46:59.267 INFO:tasks.workunit.client.1.smithi176.stdout:6/508: sync 2024-09-21T12:46:59.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/59: dread d4/f7 [0,4194304] 0 2024-09-21T12:46:59.271 INFO:tasks.workunit.client.0.smithi046.stdout:8/63: creat d1/d12/f19 x:0 0 0 2024-09-21T12:46:59.273 INFO:tasks.workunit.client.1.smithi176.stdout:7/672: rename d0/d2/da8/dca/df1 to d0/d2/db/d10/d72/d7e/de2/df3 0 2024-09-21T12:46:59.274 INFO:tasks.workunit.client.1.smithi176.stdout:4/578: rmdir d3/d21/d27/d9b 39 2024-09-21T12:46:59.275 INFO:tasks.workunit.client.1.smithi176.stdout:9/543: mknod d1/d61/d73/d7d/cbd 0 2024-09-21T12:46:59.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/102: dwrite d5/dc/f15 [0,4194304] 0 2024-09-21T12:46:59.277 INFO:tasks.workunit.client.0.smithi046.stdout:6/41: link f6 f9 0 2024-09-21T12:46:59.278 INFO:tasks.workunit.client.0.smithi046.stdout:1/98: mknod d4/c2a 0 2024-09-21T12:46:59.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/65: dread fb [0,4194304] 0 2024-09-21T12:46:59.283 INFO:tasks.workunit.client.1.smithi176.stdout:6/509: symlink d2/dd/d26/d2b/d10/l9f 0 2024-09-21T12:46:59.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/19: dwrite f4 [4194304,4194304] 0 2024-09-21T12:46:59.285 INFO:tasks.workunit.client.1.smithi176.stdout:7/673: mkdir d0/d2/d30/df4 0 2024-09-21T12:46:59.286 INFO:tasks.workunit.client.0.smithi046.stdout:0/20: chown f4 29214455 1 2024-09-21T12:46:59.287 INFO:tasks.workunit.client.0.smithi046.stdout:6/42: creat fa x:0 0 0 2024-09-21T12:46:59.290 INFO:tasks.workunit.client.1.smithi176.stdout:8/545: sync 2024-09-21T12:46:59.290 INFO:tasks.workunit.client.1.smithi176.stdout:1/605: sync 2024-09-21T12:46:59.290 INFO:tasks.workunit.client.1.smithi176.stdout:5/478: sync 2024-09-21T12:46:59.290 INFO:tasks.workunit.client.1.smithi176.stdout:6/510: rename d2/dd/d26/d2b/d10/d1b/d37/c88 to d2/d6f/ca0 0 2024-09-21T12:46:59.292 INFO:tasks.workunit.client.1.smithi176.stdout:2/584: dread d4/df/d83/fa3 [0,4194304] 0 2024-09-21T12:46:59.293 INFO:tasks.workunit.client.1.smithi176.stdout:6/511: stat d2/dd/d26/d2b/d5a/f60 0 2024-09-21T12:46:59.293 INFO:tasks.workunit.client.0.smithi046.stdout:5/60: mkdir d4/dc 0 2024-09-21T12:46:59.294 INFO:tasks.workunit.client.1.smithi176.stdout:8/546: fsync d6/db/d13/f26 0 2024-09-21T12:46:59.294 INFO:tasks.workunit.client.0.smithi046.stdout:0/21: dwrite f4 [0,4194304] 0 2024-09-21T12:46:59.296 INFO:tasks.workunit.client.0.smithi046.stdout:9/66: unlink f1 0 2024-09-21T12:46:59.297 INFO:tasks.workunit.client.1.smithi176.stdout:7/674: creat d0/d2/db/d10/d31/ddc/ff5 x:0 0 0 2024-09-21T12:46:59.299 INFO:tasks.workunit.client.1.smithi176.stdout:5/479: dwrite d0/d13/d63/d2e/d39/d41/f6c [0,4194304] 0 2024-09-21T12:46:59.311 INFO:tasks.workunit.client.1.smithi176.stdout:2/585: truncate d4/d3a/f5c 1075899 0 2024-09-21T12:46:59.312 INFO:tasks.workunit.client.1.smithi176.stdout:2/586: dread - d4/d3d/d65/d9b/fa8 zero size 2024-09-21T12:46:59.314 INFO:tasks.workunit.client.1.smithi176.stdout:2/587: truncate d4/df/d2e/d6f/d5d/d67/fb4 376940 0 2024-09-21T12:46:59.314 INFO:tasks.workunit.client.1.smithi176.stdout:8/547: stat d6/d8/l12 0 2024-09-21T12:46:59.315 INFO:tasks.workunit.client.1.smithi176.stdout:3/657: write d1/d35/ff0 [4119488,16061] 0 2024-09-21T12:46:59.315 INFO:tasks.workunit.client.0.smithi046.stdout:2/37: getdents . 0 2024-09-21T12:46:59.316 INFO:tasks.workunit.client.1.smithi176.stdout:3/658: chown d1/d8d/ce5 167684 1 2024-09-21T12:46:59.316 INFO:tasks.workunit.client.1.smithi176.stdout:7/675: mkdir d0/d2/db/d10/d72/d7e/df6 0 2024-09-21T12:46:59.318 INFO:tasks.workunit.client.1.smithi176.stdout:7/676: chown d0/d2/db/d10/d23/d85 548 1 2024-09-21T12:46:59.320 INFO:tasks.workunit.client.1.smithi176.stdout:7/677: write d0/d2/db/d10/d3b/f5b [891773,74510] 0 2024-09-21T12:46:59.322 INFO:tasks.workunit.client.1.smithi176.stdout:2/588: dwrite d4/df/d2e/d6f/d5d/d67/fb4 [0,4194304] 0 2024-09-21T12:46:59.322 INFO:tasks.workunit.client.0.smithi046.stdout:5/61: truncate d4/fa 3707820 0 2024-09-21T12:46:59.326 INFO:tasks.workunit.client.1.smithi176.stdout:9/544: truncate d1/df/d48/d69/d38/f5c 1110490 0 2024-09-21T12:46:59.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/103: write d5/dc/f1d [513760,93738] 0 2024-09-21T12:46:59.334 INFO:tasks.workunit.client.0.smithi046.stdout:8/64: write d1/f7 [1006065,10876] 0 2024-09-21T12:46:59.336 INFO:tasks.workunit.client.0.smithi046.stdout:4/112: getdents d1 0 2024-09-21T12:46:59.337 INFO:tasks.workunit.client.0.smithi046.stdout:2/38: fsync fa 0 2024-09-21T12:46:59.338 INFO:tasks.workunit.client.0.smithi046.stdout:2/39: dread f0 [0,4194304] 0 2024-09-21T12:46:59.339 INFO:tasks.workunit.client.1.smithi176.stdout:1/606: dwrite d0/db/f17 [0,4194304] 0 2024-09-21T12:46:59.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/22: mkdir d6/d7 0 2024-09-21T12:46:59.342 INFO:tasks.workunit.client.1.smithi176.stdout:2/589: rename d4/df/d83/fa3 to d4/d3d/d65/d9b/fb6 0 2024-09-21T12:46:59.343 INFO:tasks.workunit.client.0.smithi046.stdout:5/62: fdatasync d4/f8 0 2024-09-21T12:46:59.345 INFO:tasks.workunit.client.1.smithi176.stdout:9/545: mknod d1/d61/d73/d7d/cbe 0 2024-09-21T12:46:59.345 INFO:tasks.workunit.client.1.smithi176.stdout:0/709: sync 2024-09-21T12:46:59.349 INFO:tasks.workunit.client.1.smithi176.stdout:6/512: dwrite d2/dd/d26/d2b/d10/f82 [0,4194304] 0 2024-09-21T12:46:59.349 INFO:tasks.workunit.client.1.smithi176.stdout:5/480: link d0/cb d0/d13/d63/d72/d87/c8a 0 2024-09-21T12:46:59.349 INFO:tasks.workunit.client.1.smithi176.stdout:0/710: write d9/d1a/d1d/d23/da1/da3/d93/df9/d75/fc7 [604959,85984] 0 2024-09-21T12:46:59.353 INFO:tasks.workunit.client.1.smithi176.stdout:7/678: link d0/d5d/d8a/fe5 d0/d2/db/d10/d72/ff7 0 2024-09-21T12:46:59.357 INFO:tasks.workunit.client.1.smithi176.stdout:3/659: dwrite d1/d34/dbb/dd2/fee [0,4194304] 0 2024-09-21T12:46:59.357 INFO:tasks.workunit.client.1.smithi176.stdout:8/548: mknod d6/d16/d36/d7d/cb0 0 2024-09-21T12:46:59.358 INFO:tasks.workunit.client.0.smithi046.stdout:8/65: mkdir d1/d12/d1a 0 2024-09-21T12:46:59.360 INFO:tasks.workunit.client.1.smithi176.stdout:1/607: mknod d0/db/d1a/d2c/dc5/d41/d59/ce0 0 2024-09-21T12:46:59.361 INFO:tasks.workunit.client.1.smithi176.stdout:1/608: chown d0/db/d1a/f38 3905 1 2024-09-21T12:46:59.363 INFO:tasks.workunit.client.1.smithi176.stdout:2/590: write d4/d3d/d65/d9b/fb6 [1828538,56092] 0 2024-09-21T12:46:59.363 INFO:tasks.workunit.client.1.smithi176.stdout:2/591: read d4/df/d2e/d39/d55/f75 [3245401,30792] 0 2024-09-21T12:46:59.366 INFO:tasks.workunit.client.1.smithi176.stdout:2/592: dread d4/df/d2e/f7a [0,4194304] 0 2024-09-21T12:46:59.367 INFO:tasks.workunit.client.1.smithi176.stdout:9/546: symlink d1/df/d48/d69/d4d/lbf 0 2024-09-21T12:46:59.368 INFO:tasks.workunit.client.0.smithi046.stdout:2/40: write f2 [945371,72205] 0 2024-09-21T12:46:59.372 INFO:tasks.workunit.client.1.smithi176.stdout:4/579: sync 2024-09-21T12:46:59.373 INFO:tasks.workunit.client.1.smithi176.stdout:9/547: dwrite d1/df/d48/d69/d40/d84/fa8 [0,4194304] 0 2024-09-21T12:46:59.374 INFO:tasks.workunit.client.1.smithi176.stdout:0/711: unlink d9/d1a/d1d/d23/da1/da3/d93/df9/d75/fc7 0 2024-09-21T12:46:59.378 INFO:tasks.workunit.client.0.smithi046.stdout:3/104: symlink d5/l25 0 2024-09-21T12:46:59.380 INFO:tasks.workunit.client.1.smithi176.stdout:8/549: dread - d6/d16/d36/f9a zero size 2024-09-21T12:46:59.381 INFO:tasks.workunit.client.0.smithi046.stdout:6/43: getdents . 0 2024-09-21T12:46:59.381 INFO:tasks.workunit.client.0.smithi046.stdout:6/44: chown f5 0 1 2024-09-21T12:46:59.381 INFO:tasks.workunit.client.1.smithi176.stdout:4/580: dwrite d3/d42/d4d/f9e [0,4194304] 0 2024-09-21T12:46:59.382 INFO:tasks.workunit.client.1.smithi176.stdout:3/660: creat d1/d34/d48/deb/dc6/ff8 x:0 0 0 2024-09-21T12:46:59.383 INFO:tasks.workunit.client.1.smithi176.stdout:6/513: write d2/f34 [1092824,8542] 0 2024-09-21T12:46:59.385 INFO:tasks.workunit.client.1.smithi176.stdout:3/661: chown d1/d34/d48/deb/dc6/ff8 68678 1 2024-09-21T12:46:59.386 INFO:tasks.workunit.client.1.smithi176.stdout:6/514: truncate d2/dd/d26/f38 1880684 0 2024-09-21T12:46:59.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/41: mkdir df 0 2024-09-21T12:46:59.388 INFO:tasks.workunit.client.1.smithi176.stdout:7/679: dwrite d0/d2/db/d10/d23/dce/f86 [0,4194304] 0 2024-09-21T12:46:59.388 INFO:tasks.workunit.client.0.smithi046.stdout:2/42: chown fc 1278 1 2024-09-21T12:46:59.389 INFO:tasks.workunit.client.1.smithi176.stdout:6/515: chown d2/d6f/d81 3003 1 2024-09-21T12:46:59.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/63: mknod d4/d9/cd 0 2024-09-21T12:46:59.394 INFO:tasks.workunit.client.0.smithi046.stdout:9/67: getdents d11 0 2024-09-21T12:46:59.394 INFO:tasks.workunit.client.1.smithi176.stdout:5/481: creat d0/d10/d70/f8b x:0 0 0 2024-09-21T12:46:59.394 INFO:tasks.workunit.client.1.smithi176.stdout:6/516: fsync d2/f8 0 2024-09-21T12:46:59.396 INFO:tasks.workunit.client.1.smithi176.stdout:9/548: rename d1/df/d1c/l50 to d1/d63/lc0 0 2024-09-21T12:46:59.396 INFO:tasks.workunit.client.0.smithi046.stdout:3/105: mkdir d5/dc/d26 0 2024-09-21T12:46:59.398 INFO:tasks.workunit.client.1.smithi176.stdout:6/517: read d2/dd/f48 [4042239,12604] 0 2024-09-21T12:46:59.398 INFO:tasks.workunit.client.1.smithi176.stdout:0/712: readlink d9/d35/l8b 0 2024-09-21T12:46:59.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/66: creat d1/d12/d1a/f1b x:0 0 0 2024-09-21T12:46:59.400 INFO:tasks.workunit.client.1.smithi176.stdout:9/549: write d1/df/d48/d69/f21 [197799,72953] 0 2024-09-21T12:46:59.400 INFO:tasks.workunit.client.1.smithi176.stdout:3/662: dwrite d1/d34/d48/deb/dc6/fed [0,4194304] 0 2024-09-21T12:46:59.401 INFO:tasks.workunit.client.0.smithi046.stdout:4/113: getdents d1 0 2024-09-21T12:46:59.401 INFO:tasks.workunit.client.1.smithi176.stdout:6/518: chown d2/dd/d26/l3a 904658 1 2024-09-21T12:46:59.402 INFO:tasks.workunit.client.1.smithi176.stdout:7/680: dread d0/d2/db/fa4 [0,4194304] 0 2024-09-21T12:46:59.402 INFO:tasks.workunit.client.1.smithi176.stdout:8/550: symlink d6/db/d37/lb1 0 2024-09-21T12:46:59.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/43: unlink ld 0 2024-09-21T12:46:59.404 INFO:tasks.workunit.client.1.smithi176.stdout:8/551: write d6/d8/d24/d35/f42 [3302257,17258] 0 2024-09-21T12:46:59.404 INFO:tasks.workunit.client.0.smithi046.stdout:3/106: dwrite d5/dc/f15 [0,4194304] 0 2024-09-21T12:46:59.405 INFO:tasks.workunit.client.1.smithi176.stdout:1/609: getdents d0/db/d1a/d2c/dc5/d41/d59/d9b/dce 0 2024-09-21T12:46:59.408 INFO:tasks.workunit.client.0.smithi046.stdout:0/23: truncate f4 7535939 0 2024-09-21T12:46:59.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/24: write f5 [898291,84726] 0 2024-09-21T12:46:59.411 INFO:tasks.workunit.client.0.smithi046.stdout:9/68: read f3 [428691,116937] 0 2024-09-21T12:46:59.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:46:59 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:59.412 INFO:tasks.workunit.client.1.smithi176.stdout:8/552: dwrite d6/f90 [0,4194304] 0 2024-09-21T12:46:59.414 INFO:tasks.workunit.client.1.smithi176.stdout:1/610: dwrite d0/db/f7e [0,4194304] 0 2024-09-21T12:46:59.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/67: creat d1/f1c x:0 0 0 2024-09-21T12:46:59.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/114: mknod d1/d13/d14/c24 0 2024-09-21T12:46:59.423 INFO:tasks.workunit.client.1.smithi176.stdout:1/611: dread d0/db/f1f [0,4194304] 0 2024-09-21T12:46:59.424 INFO:tasks.workunit.client.1.smithi176.stdout:1/612: chown d0/db/d1a/d2c/d48/d50/l5c 54454153 1 2024-09-21T12:46:59.428 INFO:tasks.workunit.client.1.smithi176.stdout:6/519: dread d2/dd/d26/d2b/d10/d39/f4a [0,4194304] 0 2024-09-21T12:46:59.429 INFO:tasks.workunit.client.1.smithi176.stdout:5/482: mknod d0/d13/d63/d2e/d71/c8c 0 2024-09-21T12:46:59.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/68: mknod d1/c1d 0 2024-09-21T12:46:59.435 INFO:tasks.workunit.client.0.smithi046.stdout:4/115: unlink d1/f1b 0 2024-09-21T12:46:59.442 INFO:tasks.workunit.client.0.smithi046.stdout:8/69: dwrite d1/fe [0,4194304] 0 2024-09-21T12:46:59.442 INFO:tasks.workunit.client.0.smithi046.stdout:4/116: dread d1/fd [0,4194304] 0 2024-09-21T12:46:59.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/64: rename d4/l5 to d4/le 0 2024-09-21T12:46:59.446 INFO:tasks.workunit.client.1.smithi176.stdout:8/553: creat d6/db/d13/d98/fb2 x:0 0 0 2024-09-21T12:46:59.452 INFO:tasks.workunit.client.1.smithi176.stdout:1/613: mkdir d0/db/d6f/de1 0 2024-09-21T12:46:59.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/107: dwrite f2 [0,4194304] 0 2024-09-21T12:46:59.454 INFO:tasks.workunit.client.1.smithi176.stdout:6/520: creat d2/dd/d26/d2b/fa1 x:0 0 0 2024-09-21T12:46:59.461 INFO:tasks.workunit.client.0.smithi046.stdout:2/44: rmdir df 0 2024-09-21T12:46:59.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/45: stat c9 0 2024-09-21T12:46:59.463 INFO:tasks.workunit.client.1.smithi176.stdout:3/663: dwrite d1/d3e/f5a [0,4194304] 0 2024-09-21T12:46:59.469 INFO:tasks.workunit.client.1.smithi176.stdout:8/554: creat d6/d16/d9c/fb3 x:0 0 0 2024-09-21T12:46:59.469 INFO:tasks.workunit.client.0.smithi046.stdout:4/117: rename d1/d13/d14 to d1/d13/d25 0 2024-09-21T12:46:59.470 INFO:tasks.workunit.client.1.smithi176.stdout:8/555: write d6/d8/d54/f76 [1201119,31485] 0 2024-09-21T12:46:59.470 INFO:tasks.workunit.client.1.smithi176.stdout:8/556: stat d6/f90 0 2024-09-21T12:46:59.471 INFO:tasks.workunit.client.1.smithi176.stdout:1/614: rmdir d0/db/d1a/d2c/dc5/d41/d59/d99/db3 39 2024-09-21T12:46:59.472 INFO:tasks.workunit.client.1.smithi176.stdout:1/615: write d0/db/d1a/d2c/d48/d50/f9c [526493,23272] 0 2024-09-21T12:46:59.474 INFO:tasks.workunit.client.1.smithi176.stdout:2/593: sync 2024-09-21T12:46:59.478 INFO:tasks.workunit.client.0.smithi046.stdout:9/69: dwrite f6 [0,4194304] 0 2024-09-21T12:46:59.479 INFO:tasks.workunit.client.1.smithi176.stdout:0/713: creat d9/d1a/d1d/d23/f102 x:0 0 0 2024-09-21T12:46:59.479 INFO:tasks.workunit.client.1.smithi176.stdout:5/483: dwrite d0/d13/d63/f3d [0,4194304] 0 2024-09-21T12:46:59.481 INFO:tasks.workunit.client.1.smithi176.stdout:0/714: fsync d9/d1a/d1d/d23/da1/da3/d93/df9/fc1 0 2024-09-21T12:46:59.482 INFO:tasks.workunit.client.1.smithi176.stdout:0/715: fdatasync d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/ffe 0 2024-09-21T12:46:59.491 INFO:tasks.workunit.client.1.smithi176.stdout:7/681: dwrite d0/d2/f4f [0,4194304] 0 2024-09-21T12:46:59.492 INFO:tasks.workunit.client.1.smithi176.stdout:0/716: dwrite d9/d1a/d3f/d40/d79/f7f [0,4194304] 0 2024-09-21T12:46:59.494 INFO:tasks.workunit.client.1.smithi176.stdout:8/557: read d6/d8/d24/d35/f61 [808349,106368] 0 2024-09-21T12:46:59.494 INFO:tasks.workunit.client.0.smithi046.stdout:3/108: creat d5/dc/d26/f27 x:0 0 0 2024-09-21T12:46:59.497 INFO:tasks.workunit.client.1.smithi176.stdout:1/616: creat d0/db/d1a/d2c/dc5/d2b/d43/d92/fe2 x:0 0 0 2024-09-21T12:46:59.498 INFO:tasks.workunit.client.0.smithi046.stdout:0/25: dread f4 [4194304,4194304] 0 2024-09-21T12:46:59.500 INFO:tasks.workunit.client.1.smithi176.stdout:2/594: rename d4/d63/d93 to d4/df/d2e/d39/db7 0 2024-09-21T12:46:59.508 INFO:tasks.workunit.client.1.smithi176.stdout:6/521: creat d2/dd/d26/d2b/d10/d1b/fa2 x:0 0 0 2024-09-21T12:46:59.509 INFO:tasks.workunit.client.1.smithi176.stdout:7/682: rmdir d0/d2/db/d10/d72/d7e 39 2024-09-21T12:46:59.509 INFO:tasks.workunit.client.1.smithi176.stdout:6/522: chown d2/d6f/f78 90598 1 2024-09-21T12:46:59.511 INFO:tasks.workunit.client.1.smithi176.stdout:8/558: mknod d6/db/d37/d89/cb4 0 2024-09-21T12:46:59.511 INFO:tasks.workunit.client.0.smithi046.stdout:8/70: dwrite d1/d12/f18 [0,4194304] 0 2024-09-21T12:46:59.512 INFO:tasks.workunit.client.0.smithi046.stdout:3/109: fsync d5/d16/f19 0 2024-09-21T12:46:59.512 INFO:tasks.workunit.client.1.smithi176.stdout:4/581: sync 2024-09-21T12:46:59.512 INFO:tasks.workunit.client.1.smithi176.stdout:8/559: chown d6/d8/d24/c7b 805749 1 2024-09-21T12:46:59.512 INFO:tasks.workunit.client.1.smithi176.stdout:8/560: readlink d6/db/d37/d89/d8a/l9d 0 2024-09-21T12:46:59.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/26: creat d6/f8 x:0 0 0 2024-09-21T12:46:59.513 INFO:tasks.workunit.client.1.smithi176.stdout:0/717: mknod d9/d1a/d1d/d23/da1/da3/d1e/dbf/c103 0 2024-09-21T12:46:59.514 INFO:tasks.workunit.client.1.smithi176.stdout:0/718: write d9/d1a/d1d/d23/da1/da3/d1e/f42 [1124549,28080] 0 2024-09-21T12:46:59.515 INFO:tasks.workunit.client.1.smithi176.stdout:1/617: rmdir d0/db/d1a/d2c/dc5/d2b/d43 39 2024-09-21T12:46:59.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/71: write d1/d12/f18 [2957231,51950] 0 2024-09-21T12:46:59.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/46: link f0 f10 0 2024-09-21T12:46:59.518 INFO:tasks.workunit.client.0.smithi046.stdout:5/65: dwrite d4/fa [0,4194304] 0 2024-09-21T12:46:59.519 INFO:tasks.workunit.client.1.smithi176.stdout:2/595: chown d4/ca 1407084 1 2024-09-21T12:46:59.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/47: dread - fe zero size 2024-09-21T12:46:59.521 INFO:tasks.workunit.client.0.smithi046.stdout:4/118: dwrite d1/d13/d25/f19 [0,4194304] 0 2024-09-21T12:46:59.521 INFO:tasks.workunit.client.0.smithi046.stdout:9/70: mknod d11/c14 0 2024-09-21T12:46:59.524 INFO:tasks.workunit.client.1.smithi176.stdout:5/484: mkdir d0/d13/d63/d8d 0 2024-09-21T12:46:59.525 INFO:tasks.workunit.client.1.smithi176.stdout:5/485: readlink d0/d13/d63/d2e/d39/l5b 0 2024-09-21T12:46:59.526 INFO:tasks.workunit.client.1.smithi176.stdout:5/486: fdatasync d0/d13/d63/d2e/d39/d3b/f47 0 2024-09-21T12:46:59.526 INFO:tasks.workunit.client.0.smithi046.stdout:0/27: dread f5 [0,4194304] 0 2024-09-21T12:46:59.529 INFO:tasks.workunit.client.0.smithi046.stdout:0/28: readlink l2 0 2024-09-21T12:46:59.529 INFO:tasks.workunit.client.1.smithi176.stdout:3/664: creat d1/d34/d57/ff9 x:0 0 0 2024-09-21T12:46:59.531 INFO:tasks.workunit.client.1.smithi176.stdout:2/596: dread d4/df/d2e/d39/d55/fa6 [0,4194304] 0 2024-09-21T12:46:59.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/110: mkdir d5/dc/d28 0 2024-09-21T12:46:59.534 INFO:tasks.workunit.client.1.smithi176.stdout:8/561: chown d6/d8/fa2 94896 1 2024-09-21T12:46:59.535 INFO:tasks.workunit.client.1.smithi176.stdout:5/487: dwrite d0/d10/f86 [0,4194304] 0 2024-09-21T12:46:59.535 INFO:tasks.workunit.client.0.smithi046.stdout:2/48: rename f2 to f11 0 2024-09-21T12:46:59.536 INFO:tasks.workunit.client.1.smithi176.stdout:0/719: readlink d9/d1a/d3f/d40/l82 0 2024-09-21T12:46:59.537 INFO:tasks.workunit.client.1.smithi176.stdout:8/562: read d6/d8/d24/f2b [938127,45592] 0 2024-09-21T12:46:59.538 INFO:tasks.workunit.client.0.smithi046.stdout:8/72: mknod d1/d12/d1a/c1e 0 2024-09-21T12:46:59.538 INFO:tasks.workunit.client.1.smithi176.stdout:8/563: chown d6/d8/d24/d5e/c69 132763628 1 2024-09-21T12:46:59.538 INFO:tasks.workunit.client.0.smithi046.stdout:8/73: readlink d1/lc 0 2024-09-21T12:46:59.539 INFO:tasks.workunit.client.1.smithi176.stdout:8/564: dread - d6/d16/f86 zero size 2024-09-21T12:46:59.545 INFO:tasks.workunit.client.1.smithi176.stdout:3/665: mknod d1/d34/d48/cfa 0 2024-09-21T12:46:59.547 INFO:tasks.workunit.client.0.smithi046.stdout:3/111: symlink d5/d16/l29 0 2024-09-21T12:46:59.548 INFO:tasks.workunit.client.0.smithi046.stdout:4/119: dread d1/fd [0,4194304] 0 2024-09-21T12:46:59.548 INFO:tasks.workunit.client.1.smithi176.stdout:7/683: unlink d0/d2/db/l69 0 2024-09-21T12:46:59.549 INFO:tasks.workunit.client.1.smithi176.stdout:7/684: write d0/d2/d30/d7b/fe3 [547405,44620] 0 2024-09-21T12:46:59.550 INFO:tasks.workunit.client.1.smithi176.stdout:6/523: mknod d2/dd/d26/d2b/d10/d1b/ca3 0 2024-09-21T12:46:59.551 INFO:tasks.workunit.client.0.smithi046.stdout:8/74: dwrite d1/d12/f19 [0,4194304] 0 2024-09-21T12:46:59.552 INFO:tasks.workunit.client.0.smithi046.stdout:8/75: stat d1/c9 0 2024-09-21T12:46:59.553 INFO:tasks.workunit.client.0.smithi046.stdout:5/66: symlink d4/lf 0 2024-09-21T12:46:59.555 INFO:tasks.workunit.client.1.smithi176.stdout:7/685: dwrite d0/d5d/d5e/f77 [0,4194304] 0 2024-09-21T12:46:59.558 INFO:tasks.workunit.client.0.smithi046.stdout:2/49: write f11 [1910144,18862] 0 2024-09-21T12:46:59.560 INFO:tasks.workunit.client.0.smithi046.stdout:0/29: mkdir d6/d7/d9 0 2024-09-21T12:46:59.562 INFO:tasks.workunit.client.1.smithi176.stdout:0/720: rmdir d9/d1a/d1d/d23/da1/da3/d93/df9/d75 39 2024-09-21T12:46:59.563 INFO:tasks.workunit.client.0.smithi046.stdout:3/112: fdatasync d5/f7 0 2024-09-21T12:46:59.565 INFO:tasks.workunit.client.1.smithi176.stdout:1/618: fsync d0/db/d1a/d2c/dc5/d2b/f35 0 2024-09-21T12:46:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:46:59 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:46:59.567 INFO:tasks.workunit.client.1.smithi176.stdout:2/597: dread d4/f28 [0,4194304] 0 2024-09-21T12:46:59.569 INFO:tasks.workunit.client.1.smithi176.stdout:4/582: write d3/d21/f2e [1415437,112484] 0 2024-09-21T12:46:59.570 INFO:tasks.workunit.client.0.smithi046.stdout:8/76: rename d1/d12/f16 to d1/f1f 0 2024-09-21T12:46:59.571 INFO:tasks.workunit.client.0.smithi046.stdout:5/67: mkdir d4/d9/d10 0 2024-09-21T12:46:59.572 INFO:tasks.workunit.client.1.smithi176.stdout:9/550: sync 2024-09-21T12:46:59.573 INFO:tasks.workunit.client.1.smithi176.stdout:4/583: fsync d3/d21/f2e 0 2024-09-21T12:46:59.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/50: dread f0 [0,4194304] 0 2024-09-21T12:46:59.577 INFO:tasks.workunit.client.0.smithi046.stdout:3/113: chown d5/f10 1540381 1 2024-09-21T12:46:59.585 INFO:tasks.workunit.client.1.smithi176.stdout:9/551: dread d1/df/f39 [4194304,4194304] 0 2024-09-21T12:46:59.586 INFO:tasks.workunit.client.0.smithi046.stdout:0/30: rename d6/f8 to d6/d7/fa 0 2024-09-21T12:46:59.586 INFO:tasks.workunit.client.0.smithi046.stdout:4/120: truncate d1/d13/d25/f19 770672 0 2024-09-21T12:46:59.587 INFO:tasks.workunit.client.0.smithi046.stdout:8/77: dread d1/f6 [0,4194304] 0 2024-09-21T12:46:59.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/121: chown d1/d13 445 1 2024-09-21T12:46:59.587 INFO:tasks.workunit.client.0.smithi046.stdout:0/31: chown l2 43193 1 2024-09-21T12:46:59.590 INFO:tasks.workunit.client.0.smithi046.stdout:5/68: chown d4/le 85014651 1 2024-09-21T12:46:59.593 INFO:tasks.workunit.client.1.smithi176.stdout:1/619: dwrite d0/db/d2a/f4c [0,4194304] 0 2024-09-21T12:46:59.594 INFO:tasks.workunit.client.0.smithi046.stdout:9/71: link l8 d11/l15 0 2024-09-21T12:46:59.595 INFO:tasks.workunit.client.1.smithi176.stdout:8/565: truncate d6/db/d37/f3a 1894949 0 2024-09-21T12:46:59.602 INFO:tasks.workunit.client.1.smithi176.stdout:2/598: write d4/df/d2e/f7a [962587,109394] 0 2024-09-21T12:46:59.604 INFO:tasks.workunit.client.1.smithi176.stdout:6/524: readlink d2/d63/l69 0 2024-09-21T12:46:59.604 INFO:tasks.workunit.client.0.smithi046.stdout:8/78: fsync d1/fd 0 2024-09-21T12:46:59.604 INFO:tasks.workunit.client.1.smithi176.stdout:6/525: chown d2/dd/d26/d2b/c2c 1474935 1 2024-09-21T12:46:59.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/51: dwrite f10 [0,4194304] 0 2024-09-21T12:46:59.607 INFO:tasks.workunit.client.0.smithi046.stdout:2/52: chown l6 5323 1 2024-09-21T12:46:59.608 INFO:tasks.workunit.client.0.smithi046.stdout:2/53: write fc [260101,95955] 0 2024-09-21T12:46:59.608 INFO:tasks.workunit.client.1.smithi176.stdout:6/526: read d2/dd/d26/d2b/d10/d1b/d37/f4f [8187819,118982] 0 2024-09-21T12:46:59.609 INFO:tasks.workunit.client.1.smithi176.stdout:7/686: rename d0/d2/db/d10/d5a/ff2 to d0/d2/da8/dbe/ff8 0 2024-09-21T12:46:59.613 INFO:tasks.workunit.client.1.smithi176.stdout:5/488: creat d0/d13/d63/d2e/d39/f8e x:0 0 0 2024-09-21T12:46:59.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/72: readlink l7 0 2024-09-21T12:46:59.620 INFO:tasks.workunit.client.0.smithi046.stdout:8/79: rmdir d1 39 2024-09-21T12:46:59.622 INFO:tasks.workunit.client.1.smithi176.stdout:9/552: read d1/df/d1c/f3a [702630,128479] 0 2024-09-21T12:46:59.623 INFO:tasks.workunit.client.1.smithi176.stdout:9/553: fdatasync d1/df/d1c/f7a 0 2024-09-21T12:46:59.625 INFO:tasks.workunit.client.0.smithi046.stdout:2/54: symlink l12 0 2024-09-21T12:46:59.627 INFO:tasks.workunit.client.0.smithi046.stdout:3/114: dwrite d5/f8 [4194304,4194304] 0 2024-09-21T12:46:59.627 INFO:tasks.workunit.client.1.smithi176.stdout:4/584: mkdir d3/d5/dc5 0 2024-09-21T12:46:59.627 INFO:tasks.workunit.client.1.smithi176.stdout:1/620: dwrite d0/db/d1a/d2c/f57 [0,4194304] 0 2024-09-21T12:46:59.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/73: dwrite d11/f12 [0,4194304] 0 2024-09-21T12:46:59.637 INFO:tasks.workunit.client.1.smithi176.stdout:9/554: dread d1/df/d48/d69/d40/d84/fa8 [0,4194304] 0 2024-09-21T12:46:59.637 INFO:tasks.workunit.client.1.smithi176.stdout:7/687: unlink d0/d2/db/d10/d72/lc0 0 2024-09-21T12:46:59.638 INFO:tasks.workunit.client.0.smithi046.stdout:0/32: dwrite f5 [0,4194304] 0 2024-09-21T12:46:59.638 INFO:tasks.workunit.client.1.smithi176.stdout:2/599: dwrite d4/fb0 [0,4194304] 0 2024-09-21T12:46:59.641 INFO:tasks.workunit.client.1.smithi176.stdout:5/489: rename d0/d10/f86 to d0/d13/d63/d72/f8f 0 2024-09-21T12:46:59.644 INFO:tasks.workunit.client.1.smithi176.stdout:5/490: fdatasync d0/d10/f81 0 2024-09-21T12:46:59.646 INFO:tasks.workunit.client.1.smithi176.stdout:0/721: creat d9/d1a/d1d/d23/da1/da3/d93/df9/d75/df8/f104 x:0 0 0 2024-09-21T12:46:59.647 INFO:tasks.workunit.client.0.smithi046.stdout:8/80: dwrite d1/f7 [0,4194304] 0 2024-09-21T12:46:59.648 INFO:tasks.workunit.client.1.smithi176.stdout:3/666: getdents d1/d8d 0 2024-09-21T12:46:59.649 INFO:tasks.workunit.client.0.smithi046.stdout:3/115: rmdir d5 39 2024-09-21T12:46:59.650 INFO:tasks.workunit.client.1.smithi176.stdout:5/491: fdatasync d0/d13/d63/d2e/d39/d3b/f6b 0 2024-09-21T12:46:59.652 INFO:tasks.workunit.client.1.smithi176.stdout:7/688: dwrite d0/d2/db/d10/d31/da1/fcd [0,4194304] 0 2024-09-21T12:46:59.652 INFO:tasks.workunit.client.0.smithi046.stdout:9/74: chown lc 5815 1 2024-09-21T12:46:59.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/33: rename f4 to d6/d7/d9/fb 0 2024-09-21T12:46:59.655 INFO:tasks.workunit.client.0.smithi046.stdout:5/69: link d4/le d4/l11 0 2024-09-21T12:46:59.656 INFO:tasks.workunit.client.1.smithi176.stdout:7/689: fsync d0/d2/db/d10/d72/fe6 0 2024-09-21T12:46:59.658 INFO:tasks.workunit.client.1.smithi176.stdout:0/722: read d9/d1a/d1d/d23/d5f/f89 [3970347,67541] 0 2024-09-21T12:46:59.663 INFO:tasks.workunit.client.1.smithi176.stdout:8/566: sync 2024-09-21T12:46:59.665 INFO:tasks.workunit.client.1.smithi176.stdout:3/667: dwrite d1/d5/d25/d61/f77 [0,4194304] 0 2024-09-21T12:46:59.666 INFO:tasks.workunit.client.1.smithi176.stdout:8/567: dread - d6/d8/d24/d35/f71 zero size 2024-09-21T12:46:59.666 INFO:tasks.workunit.client.1.smithi176.stdout:1/621: dread d0/db/d1a/d2c/f79 [0,4194304] 0 2024-09-21T12:46:59.666 INFO:tasks.workunit.client.0.smithi046.stdout:5/70: mknod d4/d9/c12 0 2024-09-21T12:46:59.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/75: dread ff [0,4194304] 0 2024-09-21T12:46:59.670 INFO:tasks.workunit.client.1.smithi176.stdout:5/492: unlink d0/d13/d63/d2e/d39/d41/l68 0 2024-09-21T12:46:59.671 INFO:tasks.workunit.client.0.smithi046.stdout:3/116: truncate d5/fb 1911722 0 2024-09-21T12:46:59.672 INFO:tasks.workunit.client.0.smithi046.stdout:3/117: truncate f2 5661586 0 2024-09-21T12:46:59.672 INFO:tasks.workunit.client.0.smithi046.stdout:3/118: readlink d5/dc/l13 0 2024-09-21T12:46:59.674 INFO:tasks.workunit.client.1.smithi176.stdout:6/527: creat d2/d63/fa4 x:0 0 0 2024-09-21T12:46:59.675 INFO:tasks.workunit.client.0.smithi046.stdout:8/81: link d1/f6 d1/f20 0 2024-09-21T12:46:59.675 INFO:tasks.workunit.client.0.smithi046.stdout:5/71: read d4/f7 [56417,123903] 0 2024-09-21T12:46:59.676 INFO:tasks.workunit.client.1.smithi176.stdout:0/723: fdatasync d9/f45 0 2024-09-21T12:46:59.677 INFO:tasks.workunit.client.0.smithi046.stdout:3/119: truncate d5/d16/f1e 2691158 0 2024-09-21T12:46:59.679 INFO:tasks.workunit.client.0.smithi046.stdout:9/76: truncate fa 6162584 0 2024-09-21T12:46:59.681 INFO:tasks.workunit.client.0.smithi046.stdout:8/82: symlink d1/d12/l21 0 2024-09-21T12:46:59.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/83: write d1/f10 [66689,114692] 0 2024-09-21T12:46:59.683 INFO:tasks.workunit.client.0.smithi046.stdout:5/72: fdatasync d4/f8 0 2024-09-21T12:46:59.685 INFO:tasks.workunit.client.1.smithi176.stdout:5/493: rename d0/d13/d63/d2e/d39/d3b/c5a to d0/d13/d63/d2e/d71/c90 0 2024-09-21T12:46:59.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/120: symlink d5/d16/l2a 0 2024-09-21T12:46:59.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/77: creat d11/f16 x:0 0 0 2024-09-21T12:46:59.690 INFO:tasks.workunit.client.0.smithi046.stdout:8/84: symlink d1/l22 0 2024-09-21T12:46:59.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/73: unlink d4/lf 0 2024-09-21T12:46:59.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/34: read d6/d7/d9/fb [3803286,99000] 0 2024-09-21T12:46:59.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/35: readlink l2 0 2024-09-21T12:46:59.697 INFO:tasks.workunit.client.0.smithi046.stdout:2/55: truncate f11 845356 0 2024-09-21T12:46:59.698 INFO:tasks.workunit.client.0.smithi046.stdout:4/122: write d1/d13/d25/f19 [1669095,5982] 0 2024-09-21T12:46:59.702 INFO:tasks.workunit.client.1.smithi176.stdout:5/494: truncate d0/d13/f29 4311718 0 2024-09-21T12:46:59.702 INFO:tasks.workunit.client.1.smithi176.stdout:9/555: dwrite d1/d8b/fb1 [0,4194304] 0 2024-09-21T12:46:59.703 INFO:tasks.workunit.client.1.smithi176.stdout:5/495: write d0/d13/f50 [1831168,50477] 0 2024-09-21T12:46:59.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/36: dwrite f5 [0,4194304] 0 2024-09-21T12:46:59.704 INFO:tasks.workunit.client.1.smithi176.stdout:5/496: truncate d0/d10/f79 1040275 0 2024-09-21T12:46:59.706 INFO:tasks.workunit.client.1.smithi176.stdout:6/528: unlink d2/dd/d26/c4d 0 2024-09-21T12:46:59.708 INFO:tasks.workunit.client.1.smithi176.stdout:6/529: write d2/dd/d26/d2b/d5a/f60 [4584978,33031] 0 2024-09-21T12:46:59.711 INFO:tasks.workunit.client.1.smithi176.stdout:2/600: getdents d4/df/d83 0 2024-09-21T12:46:59.714 INFO:tasks.workunit.client.0.smithi046.stdout:2/56: rename f10 to f13 0 2024-09-21T12:46:59.715 INFO:tasks.workunit.client.0.smithi046.stdout:2/57: dread - fe zero size 2024-09-21T12:46:59.715 INFO:tasks.workunit.client.0.smithi046.stdout:2/58: fsync fe 0 2024-09-21T12:46:59.716 INFO:tasks.workunit.client.1.smithi176.stdout:1/622: link d0/db/d1a/d2c/d37/f56 d0/db/d1a/d2c/dc5/d2b/d43/fe3 0 2024-09-21T12:46:59.718 INFO:tasks.workunit.client.1.smithi176.stdout:1/623: write d0/db/d1a/d2c/dc5/d41/d59/fc0 [853949,45066] 0 2024-09-21T12:46:59.718 INFO:tasks.workunit.client.1.smithi176.stdout:4/585: truncate d3/d21/f2a 501967 0 2024-09-21T12:46:59.719 INFO:tasks.workunit.client.0.smithi046.stdout:9/78: fdatasync fb 0 2024-09-21T12:46:59.722 INFO:tasks.workunit.client.1.smithi176.stdout:9/556: mknod d1/df/d48/d69/d76/cc1 0 2024-09-21T12:46:59.729 INFO:tasks.workunit.client.1.smithi176.stdout:7/690: dwrite d0/d2/db/d10/d23/d85/fad [0,4194304] 0 2024-09-21T12:46:59.729 INFO:tasks.workunit.client.0.smithi046.stdout:0/37: mknod d6/d7/cc 0 2024-09-21T12:46:59.730 INFO:tasks.workunit.client.0.smithi046.stdout:5/74: write d4/f8 [1448227,62139] 0 2024-09-21T12:46:59.731 INFO:tasks.workunit.client.1.smithi176.stdout:6/530: creat d2/dd/d26/d2b/fa5 x:0 0 0 2024-09-21T12:46:59.732 INFO:tasks.workunit.client.0.smithi046.stdout:3/121: creat d5/f2b x:0 0 0 2024-09-21T12:46:59.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/75: dread d4/f8 [0,4194304] 0 2024-09-21T12:46:59.734 INFO:tasks.workunit.client.1.smithi176.stdout:3/668: dwrite d1/d5/f7b [0,4194304] 0 2024-09-21T12:46:59.734 INFO:tasks.workunit.client.1.smithi176.stdout:2/601: symlink d4/df/d2e/d6f/d6d/lb8 0 2024-09-21T12:46:59.735 INFO:tasks.workunit.client.1.smithi176.stdout:3/669: write d1/d34/d48/f68 [1528149,20341] 0 2024-09-21T12:46:59.737 INFO:tasks.workunit.client.0.smithi046.stdout:2/59: readlink l8 0 2024-09-21T12:46:59.738 INFO:tasks.workunit.client.1.smithi176.stdout:0/724: write d9/d1a/d1d/d23/f32 [8210560,104368] 0 2024-09-21T12:46:59.739 INFO:tasks.workunit.client.1.smithi176.stdout:3/670: read d1/da/f2e [3930245,90035] 0 2024-09-21T12:46:59.741 INFO:tasks.workunit.client.1.smithi176.stdout:9/557: fsync d1/df/d48/d69/d38/f43 0 2024-09-21T12:46:59.743 INFO:tasks.workunit.client.1.smithi176.stdout:5/497: stat d0/d13/f29 0 2024-09-21T12:46:59.745 INFO:tasks.workunit.client.1.smithi176.stdout:3/671: dwrite d1/d35/fc9 [0,4194304] 0 2024-09-21T12:46:59.747 INFO:tasks.workunit.client.0.smithi046.stdout:9/79: dread f3 [0,4194304] 0 2024-09-21T12:46:59.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/38: mkdir d6/d7/d9/dd 0 2024-09-21T12:46:59.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/80: dwrite d11/f12 [0,4194304] 0 2024-09-21T12:46:59.754 INFO:tasks.workunit.client.0.smithi046.stdout:0/39: truncate d6/d7/fa 942237 0 2024-09-21T12:46:59.756 INFO:tasks.workunit.client.1.smithi176.stdout:6/531: symlink d2/dd/d26/d2b/la6 0 2024-09-21T12:46:59.756 INFO:tasks.workunit.client.1.smithi176.stdout:7/691: dwrite d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:46:59.764 INFO:tasks.workunit.client.1.smithi176.stdout:2/602: symlink d4/df/d2e/d4d/d70/lb9 0 2024-09-21T12:46:59.764 INFO:tasks.workunit.client.1.smithi176.stdout:8/568: sync 2024-09-21T12:46:59.766 INFO:tasks.workunit.client.1.smithi176.stdout:1/624: symlink d0/db/d6f/de1/le4 0 2024-09-21T12:46:59.766 INFO:tasks.workunit.client.1.smithi176.stdout:8/569: chown d6/d16/d36/d7d/la8 17433350 1 2024-09-21T12:46:59.768 INFO:tasks.workunit.client.1.smithi176.stdout:7/692: dread d0/d2/db/f26 [0,4194304] 0 2024-09-21T12:46:59.769 INFO:tasks.workunit.client.0.smithi046.stdout:8/85: getdents d1 0 2024-09-21T12:46:59.769 INFO:tasks.workunit.client.1.smithi176.stdout:0/725: write d9/d35/ffc [924471,75646] 0 2024-09-21T12:46:59.770 INFO:tasks.workunit.client.1.smithi176.stdout:0/726: fsync d9/d1a/d1d/d23/da1/da3/d93/df9/f76 0 2024-09-21T12:46:59.776 INFO:tasks.workunit.client.1.smithi176.stdout:0/727: dwrite d9/d1a/d1d/d23/da1/da3/d93/df9/d77/fb6 [4194304,4194304] 0 2024-09-21T12:46:59.777 INFO:tasks.workunit.client.0.smithi046.stdout:0/40: fsync d6/d7/d9/fb 0 2024-09-21T12:46:59.779 INFO:tasks.workunit.client.1.smithi176.stdout:5/498: rename d0/d10/f23 to d0/d13/d63/d72/f91 0 2024-09-21T12:46:59.781 INFO:tasks.workunit.client.1.smithi176.stdout:3/672: rmdir d1/d5/d25/d38 39 2024-09-21T12:46:59.781 INFO:tasks.workunit.client.0.smithi046.stdout:4/123: write d1/ff [1084501,92674] 0 2024-09-21T12:46:59.782 INFO:tasks.workunit.client.1.smithi176.stdout:3/673: truncate d1/d35/d5e/d90/fda 301481 0 2024-09-21T12:46:59.782 INFO:tasks.workunit.client.0.smithi046.stdout:4/124: readlink d1/l7 0 2024-09-21T12:46:59.783 INFO:tasks.workunit.client.0.smithi046.stdout:0/41: dread f5 [0,4194304] 0 2024-09-21T12:46:59.784 INFO:tasks.workunit.client.0.smithi046.stdout:4/125: chown d1/l7 9339042 1 2024-09-21T12:46:59.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/126: write d1/d13/d25/f1e [1942958,69804] 0 2024-09-21T12:46:59.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/127: read d1/ff [4882995,77366] 0 2024-09-21T12:46:59.788 INFO:tasks.workunit.client.1.smithi176.stdout:4/586: creat d3/d21/d27/fc6 x:0 0 0 2024-09-21T12:46:59.789 INFO:tasks.workunit.client.0.smithi046.stdout:8/86: rename d1/d12/l21 to d1/d12/l23 0 2024-09-21T12:46:59.791 INFO:tasks.workunit.client.1.smithi176.stdout:2/603: creat d4/df/d2e/d4d/fba x:0 0 0 2024-09-21T12:46:59.795 INFO:tasks.workunit.client.1.smithi176.stdout:4/587: dwrite d3/d5/f13 [0,4194304] 0 2024-09-21T12:46:59.797 INFO:tasks.workunit.client.0.smithi046.stdout:5/76: dwrite d4/f7 [0,4194304] 0 2024-09-21T12:46:59.798 INFO:tasks.workunit.client.1.smithi176.stdout:7/693: creat d0/d2/db/d10/d23/ff9 x:0 0 0 2024-09-21T12:46:59.806 INFO:tasks.workunit.client.1.smithi176.stdout:9/558: symlink d1/d61/d73/db6/lc2 0 2024-09-21T12:46:59.811 INFO:tasks.workunit.client.0.smithi046.stdout:0/42: dwrite d6/d7/d9/fb [0,4194304] 0 2024-09-21T12:46:59.816 INFO:tasks.workunit.client.0.smithi046.stdout:4/128: creat d1/f26 x:0 0 0 2024-09-21T12:46:59.817 INFO:tasks.workunit.client.1.smithi176.stdout:5/499: write d0/d13/f3c [1763050,62652] 0 2024-09-21T12:46:59.819 INFO:tasks.workunit.client.0.smithi046.stdout:4/129: dread d1/fd [0,4194304] 0 2024-09-21T12:46:59.819 INFO:tasks.workunit.client.0.smithi046.stdout:8/87: fdatasync d1/f1f 0 2024-09-21T12:46:59.821 INFO:tasks.workunit.client.1.smithi176.stdout:2/604: chown d4/d63/f94 26102890 1 2024-09-21T12:46:59.821 INFO:tasks.workunit.client.1.smithi176.stdout:2/605: fsync d4/f7f 0 2024-09-21T12:46:59.826 INFO:tasks.workunit.client.1.smithi176.stdout:1/625: symlink d0/db/le5 0 2024-09-21T12:46:59.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/81: dwrite f2 [0,4194304] 0 2024-09-21T12:46:59.832 INFO:tasks.workunit.client.0.smithi046.stdout:4/130: dwrite d1/f26 [0,4194304] 0 2024-09-21T12:46:59.832 INFO:tasks.workunit.client.1.smithi176.stdout:7/694: creat d0/d5d/ffa x:0 0 0 2024-09-21T12:46:59.834 INFO:tasks.workunit.client.0.smithi046.stdout:0/43: mknod d6/d7/ce 0 2024-09-21T12:46:59.834 INFO:tasks.workunit.client.1.smithi176.stdout:9/559: read d1/f7 [449428,7653] 0 2024-09-21T12:46:59.835 INFO:tasks.workunit.client.1.smithi176.stdout:0/728: fdatasync d9/d1a/d1d/d23/da1/da3/d8f/dd8/fe6 0 2024-09-21T12:46:59.837 INFO:tasks.workunit.client.1.smithi176.stdout:0/729: write d9/d1a/d1d/d23/fb4 [26357,1222] 0 2024-09-21T12:46:59.837 INFO:tasks.workunit.client.1.smithi176.stdout:6/532: sync 2024-09-21T12:46:59.838 INFO:tasks.workunit.client.1.smithi176.stdout:5/500: mkdir d0/d13/d63/d72/d87/d92 0 2024-09-21T12:46:59.839 INFO:tasks.workunit.client.1.smithi176.stdout:0/730: readlink d9/d1a/d3f/d40/l82 0 2024-09-21T12:46:59.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.838+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1059798356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d01011e0 msgr2=0x7fb1d0101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.838+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1059798356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d01011e0 0x7fb1d0101660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb1c0009880 tx=0x7fb1c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:46:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.838+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1059798356 shutdown_connections 2024-09-21T12:46:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.838+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1059798356 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d01011e0 0x7fb1d0101660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.838+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1059798356 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d00fffe0 0x7fb1d01003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:59.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.838+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1059798356 >> 172.21.15.46:0/1059798356 conn(0x7fb1d00fb770 msgr2=0x7fb1d00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:46:59.840 INFO:tasks.workunit.client.1.smithi176.stdout:3/674: creat d1/d5/d25/d40/dcb/ffb x:0 0 0 2024-09-21T12:46:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.839+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1059798356 shutdown_connections 2024-09-21T12:46:59.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.839+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1059798356 wait complete. 2024-09-21T12:46:59.842 INFO:tasks.workunit.client.0.smithi046.stdout:2/60: dwrite fa [0,4194304] 0 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.840+0000 7fb1d7f1d640 1 Processor -- start 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.840+0000 7fb1d7f1d640 1 -- start start 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.840+0000 7fb1d7f1d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d00fffe0 0x7fb1d019dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.840+0000 7fb1d7f1d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d01011e0 0x7fb1d019e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.840+0000 7fb1d7f1d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d0108130 con 0x7fb1d01011e0 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.840+0000 7fb1d7f1d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb1d0107fb0 con 0x7fb1d00fffe0 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d54b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d01011e0 0x7fb1d019e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d54b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d01011e0 0x7fb1d019e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49030/0 (socket says 172.21.15.46:49030) 2024-09-21T12:46:59.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d54b8640 1 -- 172.21.15.46:0/1532260933 learned_addr learned my addr 172.21.15.46:0/1532260933 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:46:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d5cb9640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d00fffe0 0x7fb1d019dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d5cb9640 1 -- 172.21.15.46:0/1532260933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d01011e0 msgr2=0x7fb1d019e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:46:59.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d5cb9640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d01011e0 0x7fb1d019e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:46:59.844 INFO:tasks.workunit.client.0.smithi046.stdout:2/61: chown fa 1386373447 1 2024-09-21T12:46:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.841+0000 7fb1d5cb9640 1 -- 172.21.15.46:0/1532260933 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1d019e800 con 0x7fb1d00fffe0 2024-09-21T12:46:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.842+0000 7fb1d5cb9640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d00fffe0 0x7fb1d019dc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00d6a0 tx=0x7fb1cc00db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.842+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc017070 con 0x7fb1d00fffe0 2024-09-21T12:46:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.842+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1cc0097a0 con 0x7fb1d00fffe0 2024-09-21T12:46:59.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.843+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1cc003a50 con 0x7fb1d00fffe0 2024-09-21T12:46:59.845 INFO:tasks.workunit.client.0.smithi046.stdout:5/77: mkdir d4/dc/d13 0 2024-09-21T12:46:59.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.843+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1d010cf40 con 0x7fb1d00fffe0 2024-09-21T12:46:59.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.844+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1d010d4d0 con 0x7fb1d00fffe0 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:3/675: read d1/d34/d57/dd0/d7d/f80 [1197850,54009] 0 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:2/606: rmdir d4/d3d/d65 39 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:0/731: read d9/f16 [2499985,45532] 0 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:1/626: unlink d0/db/d2a/f4c 0 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:1/627: readlink d0/db/d2a/l32 0 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:0/732: write d9/f16 [611601,22304] 0 2024-09-21T12:46:59.847 INFO:tasks.workunit.client.1.smithi176.stdout:8/570: creat d6/d8/fb5 x:0 0 0 2024-09-21T12:46:59.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.845+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1d01003e0 con 0x7fb1d00fffe0 2024-09-21T12:46:59.848 INFO:tasks.workunit.client.0.smithi046.stdout:5/78: chown d4/fa 17198 1 2024-09-21T12:46:59.848 INFO:tasks.workunit.client.0.smithi046.stdout:5/79: stat d4/fa 0 2024-09-21T12:46:59.848 INFO:tasks.workunit.client.1.smithi176.stdout:4/588: creat d3/d5/db/d96/db2/fc7 x:0 0 0 2024-09-21T12:46:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.847+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fb1cc009950 con 0x7fb1d00fffe0 2024-09-21T12:46:59.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.848+0000 7fb1c6ffd640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fb1bc074ad0 0x7fb1bc076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:46:59.849 INFO:tasks.workunit.client.0.smithi046.stdout:4/131: mkdir d1/d27 0 2024-09-21T12:46:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.849+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fb1cc0967f0 con 0x7fb1d00fffe0 2024-09-21T12:46:59.850 INFO:tasks.workunit.client.0.smithi046.stdout:9/82: write f10 [2029544,29374] 0 2024-09-21T12:46:59.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.849+0000 7fb1d54b8640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fb1bc074ad0 0x7fb1bc076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:46:59.851 INFO:tasks.workunit.client.0.smithi046.stdout:0/44: unlink d6/d7/ce 0 2024-09-21T12:46:59.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.850+0000 7fb1d54b8640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fb1bc074ad0 0x7fb1bc076f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00096c0 tx=0x7fb1c0004f00 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:46:59.854 INFO:tasks.workunit.client.1.smithi176.stdout:6/533: mknod d2/dd/d26/d2b/d5a/ca7 0 2024-09-21T12:46:59.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:46:59.854+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb1cc020030 con 0x7fb1d00fffe0 2024-09-21T12:46:59.866 INFO:tasks.workunit.client.0.smithi046.stdout:4/132: mknod d1/d13/c28 0 2024-09-21T12:46:59.867 INFO:tasks.workunit.client.0.smithi046.stdout:0/45: creat d6/d7/d9/ff x:0 0 0 2024-09-21T12:46:59.868 INFO:tasks.workunit.client.1.smithi176.stdout:4/589: rmdir d3/d42/d4d 39 2024-09-21T12:46:59.868 INFO:tasks.workunit.client.1.smithi176.stdout:4/590: readlink d3/d42/d56/d4e/l76 0 2024-09-21T12:46:59.869 INFO:tasks.workunit.client.1.smithi176.stdout:7/695: mknod d0/d2/db/d10/d72/d7e/de2/df3/cfb 0 2024-09-21T12:46:59.870 INFO:tasks.workunit.client.1.smithi176.stdout:9/560: mkdir d1/df/dc3 0 2024-09-21T12:46:59.871 INFO:tasks.workunit.client.0.smithi046.stdout:2/62: write f11 [4531457,31608] 0 2024-09-21T12:46:59.873 INFO:tasks.workunit.client.1.smithi176.stdout:6/534: creat d2/d6f/d7f/fa8 x:0 0 0 2024-09-21T12:46:59.874 INFO:tasks.workunit.client.0.smithi046.stdout:4/133: mkdir d1/d13/d25/d29 0 2024-09-21T12:46:59.875 INFO:tasks.workunit.client.1.smithi176.stdout:5/501: symlink d0/d13/d63/d72/d87/d92/l93 0 2024-09-21T12:46:59.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/88: getdents d1/d12/d1a 0 2024-09-21T12:46:59.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/80: rename d4/l6 to d4/l14 0 2024-09-21T12:46:59.878 INFO:tasks.workunit.client.1.smithi176.stdout:0/733: symlink d9/d1b/l105 0 2024-09-21T12:46:59.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/83: write f4 [581003,32867] 0 2024-09-21T12:46:59.879 INFO:tasks.workunit.client.0.smithi046.stdout:2/63: mknod c14 0 2024-09-21T12:46:59.880 INFO:tasks.workunit.client.0.smithi046.stdout:0/46: symlink d6/d7/d9/dd/l10 0 2024-09-21T12:46:59.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/64: fsync fe 0 2024-09-21T12:46:59.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/134: creat d1/f2a x:0 0 0 2024-09-21T12:46:59.882 INFO:tasks.workunit.client.0.smithi046.stdout:2/65: write fe [718190,1040] 0 2024-09-21T12:46:59.882 INFO:tasks.workunit.client.0.smithi046.stdout:8/89: mkdir d1/d24 0 2024-09-21T12:46:59.883 INFO:tasks.workunit.client.1.smithi176.stdout:7/696: rename d0/d2/dc9 to d0/d2/db/d10/d31/da1/dfc 0 2024-09-21T12:46:59.883 INFO:tasks.workunit.client.0.smithi046.stdout:8/90: dread - d1/d12/d1a/f1b zero size 2024-09-21T12:46:59.885 INFO:tasks.workunit.client.0.smithi046.stdout:8/91: truncate d1/d12/f18 4752488 0 2024-09-21T12:46:59.885 INFO:tasks.workunit.client.0.smithi046.stdout:9/84: symlink d11/l17 0 2024-09-21T12:46:59.886 INFO:tasks.workunit.client.1.smithi176.stdout:6/535: symlink d2/d6f/d7f/la9 0 2024-09-21T12:46:59.888 INFO:tasks.workunit.client.0.smithi046.stdout:0/47: unlink d6/d7/d9/dd/l10 0 2024-09-21T12:46:59.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/66: rename fe to f15 0 2024-09-21T12:46:59.892 INFO:tasks.workunit.client.1.smithi176.stdout:2/607: link d4/l17 d4/df/d2e/d6f/lbb 0 2024-09-21T12:46:59.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/92: dwrite d1/fa [0,4194304] 0 2024-09-21T12:46:59.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/93: truncate d1/f1f 245147 0 2024-09-21T12:46:59.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/94: read d1/f1f [123840,21764] 0 2024-09-21T12:46:59.895 INFO:tasks.workunit.client.1.smithi176.stdout:1/628: rmdir d0/db/d6f/dcc 0 2024-09-21T12:46:59.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/67: dread f15 [0,4194304] 0 2024-09-21T12:46:59.901 INFO:tasks.workunit.client.1.smithi176.stdout:4/591: creat d3/d5/dc5/fc8 x:0 0 0 2024-09-21T12:46:59.902 INFO:tasks.workunit.client.0.smithi046.stdout:0/48: creat d6/d7/f11 x:0 0 0 2024-09-21T12:46:59.903 INFO:tasks.workunit.client.0.smithi046.stdout:0/49: dread - d6/d7/f11 zero size 2024-09-21T12:46:59.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/81: write d4/f8 [2201248,23080] 0 2024-09-21T12:46:59.908 INFO:tasks.workunit.client.0.smithi046.stdout:2/68: mkdir d16 0 2024-09-21T12:46:59.910 INFO:tasks.workunit.client.0.smithi046.stdout:9/85: rename fa to d11/f18 0 2024-09-21T12:46:59.911 INFO:tasks.workunit.client.1.smithi176.stdout:9/561: dwrite d1/f5d [0,4194304] 0 2024-09-21T12:46:59.911 INFO:tasks.workunit.client.0.smithi046.stdout:9/86: write f4 [371694,70978] 0 2024-09-21T12:46:59.915 INFO:tasks.workunit.client.1.smithi176.stdout:4/592: stat d3/d21/da6/cc2 0 2024-09-21T12:46:59.917 INFO:tasks.workunit.client.1.smithi176.stdout:7/697: symlink d0/d98/de1/lfd 0 2024-09-21T12:46:59.917 INFO:tasks.workunit.client.1.smithi176.stdout:7/698: rename d0 to d0/d2/db/d10/d3b/dfe 22 2024-09-21T12:46:59.920 INFO:tasks.workunit.client.0.smithi046.stdout:5/82: mkdir d4/dc/d13/d15 0 2024-09-21T12:46:59.925 INFO:tasks.workunit.client.1.smithi176.stdout:6/536: dread d2/d63/f53 [0,4194304] 0 2024-09-21T12:46:59.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/50: dwrite d6/d7/fa [0,4194304] 0 2024-09-21T12:46:59.926 INFO:tasks.workunit.client.0.smithi046.stdout:9/87: mkdir d11/d19 0 2024-09-21T12:46:59.927 INFO:tasks.workunit.client.0.smithi046.stdout:5/83: write d4/f7 [4347707,108446] 0 2024-09-21T12:46:59.930 INFO:tasks.workunit.client.0.smithi046.stdout:5/84: write d4/f7 [2888222,99342] 0 2024-09-21T12:46:59.932 INFO:tasks.workunit.client.0.smithi046.stdout:2/69: dwrite f15 [0,4194304] 0 2024-09-21T12:46:59.932 INFO:tasks.workunit.client.1.smithi176.stdout:1/629: creat d0/db/d1a/d2c/dc5/d41/d59/d99/db3/fe6 x:0 0 0 2024-09-21T12:46:59.934 INFO:tasks.workunit.client.1.smithi176.stdout:8/571: link d6/d8/d24/d35/f61 d6/d8/fb6 0 2024-09-21T12:46:59.939 INFO:tasks.workunit.client.1.smithi176.stdout:1/630: dwrite d0/db/d1a/d2c/d84/fb9 [0,4194304] 0 2024-09-21T12:46:59.940 INFO:tasks.workunit.client.1.smithi176.stdout:7/699: symlink d0/d2f/lff 0 2024-09-21T12:46:59.941 INFO:tasks.workunit.client.1.smithi176.stdout:1/631: stat d0/db/d1a/d2c/dc5/d2b/d43/f69 0 2024-09-21T12:46:59.943 INFO:tasks.workunit.client.0.smithi046.stdout:8/95: write d1/f6 [4759350,75861] 0 2024-09-21T12:46:59.943 INFO:tasks.workunit.client.1.smithi176.stdout:5/502: getdents d0/d13/d63/d72/d87 0 2024-09-21T12:46:59.948 INFO:tasks.workunit.client.1.smithi176.stdout:6/537: creat d2/d6f/d7f/faa x:0 0 0 2024-09-21T12:46:59.949 INFO:tasks.workunit.client.0.smithi046.stdout:9/88: getdents d11/d19 0 2024-09-21T12:46:59.950 INFO:tasks.workunit.client.0.smithi046.stdout:9/89: readlink d11/l15 0 2024-09-21T12:46:59.951 INFO:tasks.workunit.client.0.smithi046.stdout:5/85: mkdir d4/d16 0 2024-09-21T12:46:59.953 INFO:tasks.workunit.client.1.smithi176.stdout:8/572: write d6/d8/d24/d35/f75 [291135,99472] 0 2024-09-21T12:46:59.954 INFO:tasks.workunit.client.0.smithi046.stdout:8/96: mknod d1/d12/d1a/c25 0 2024-09-21T12:46:59.954 INFO:tasks.workunit.client.1.smithi176.stdout:8/573: stat d6/d8/d24/d5e 0 2024-09-21T12:46:59.955 INFO:tasks.workunit.client.0.smithi046.stdout:0/51: write f5 [3852421,15961] 0 2024-09-21T12:46:59.957 INFO:tasks.workunit.client.1.smithi176.stdout:5/503: creat d0/d13/d5d/f94 x:0 0 0 2024-09-21T12:46:59.957 INFO:tasks.workunit.client.1.smithi176.stdout:9/562: dwrite d1/df/f12 [0,4194304] 0 2024-09-21T12:46:59.958 INFO:tasks.workunit.client.1.smithi176.stdout:3/676: sync 2024-09-21T12:46:59.959 INFO:tasks.workunit.client.0.smithi046.stdout:9/90: unlink l8 0 2024-09-21T12:46:59.960 INFO:tasks.workunit.client.1.smithi176.stdout:2/608: getdents d4/d3a 0 2024-09-21T12:46:59.960 INFO:tasks.workunit.client.0.smithi046.stdout:5/86: stat d4/l14 0 2024-09-21T12:46:59.962 INFO:tasks.workunit.client.0.smithi046.stdout:8/97: creat d1/f26 x:0 0 0 2024-09-21T12:46:59.963 INFO:tasks.workunit.client.0.smithi046.stdout:8/98: fdatasync d1/ff 0 2024-09-21T12:46:59.964 INFO:tasks.workunit.client.0.smithi046.stdout:2/70: link l1 d16/l17 0 2024-09-21T12:46:59.964 INFO:tasks.workunit.client.0.smithi046.stdout:0/52: creat d6/d7/f12 x:0 0 0 2024-09-21T12:46:59.965 INFO:tasks.workunit.client.0.smithi046.stdout:9/91: dread f2 [0,4194304] 0 2024-09-21T12:46:59.965 INFO:tasks.workunit.client.0.smithi046.stdout:8/99: chown d1/f8 15 1 2024-09-21T12:46:59.967 INFO:tasks.workunit.client.1.smithi176.stdout:9/563: dwrite d1/d63/f9f [0,4194304] 0 2024-09-21T12:46:59.968 INFO:tasks.workunit.client.0.smithi046.stdout:2/71: write fc [1059592,94222] 0 2024-09-21T12:46:59.969 INFO:tasks.workunit.client.1.smithi176.stdout:6/538: dwrite d2/f31 [4194304,4194304] 0 2024-09-21T12:46:59.969 INFO:tasks.workunit.client.1.smithi176.stdout:6/539: stat d2/dd/d26/l27 0 2024-09-21T12:46:59.969 INFO:tasks.workunit.client.0.smithi046.stdout:8/100: write d1/d12/f19 [1251958,30717] 0 2024-09-21T12:46:59.970 INFO:tasks.workunit.client.0.smithi046.stdout:2/72: write fc [815083,101878] 0 2024-09-21T12:46:59.970 INFO:tasks.workunit.client.1.smithi176.stdout:5/504: creat d0/d13/d63/d2e/d71/f95 x:0 0 0 2024-09-21T12:46:59.972 INFO:tasks.workunit.client.0.smithi046.stdout:0/53: dread f5 [0,4194304] 0 2024-09-21T12:46:59.973 INFO:tasks.workunit.client.1.smithi176.stdout:4/593: rename d3/d42/d4d/f5b to d3/d21/fc9 0 2024-09-21T12:46:59.974 INFO:tasks.workunit.client.1.smithi176.stdout:2/609: symlink d4/df/d2e/d6f/d5d/d81/lbc 0 2024-09-21T12:46:59.975 INFO:tasks.workunit.client.0.smithi046.stdout:0/54: write d6/d7/fa [29826,42957] 0 2024-09-21T12:46:59.975 INFO:tasks.workunit.client.1.smithi176.stdout:2/610: truncate d4/f37 4425231 0 2024-09-21T12:46:59.976 INFO:tasks.workunit.client.0.smithi046.stdout:8/101: dread d1/f20 [0,4194304] 0 2024-09-21T12:46:59.979 INFO:tasks.workunit.client.1.smithi176.stdout:9/564: creat d1/df/d48/d69/d76/d7c/fc4 x:0 0 0 2024-09-21T12:46:59.980 INFO:tasks.workunit.client.1.smithi176.stdout:9/565: write d1/d63/f6e [518470,32743] 0 2024-09-21T12:46:59.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/102: dwrite d1/f6 [0,4194304] 0 2024-09-21T12:46:59.987 INFO:tasks.workunit.client.1.smithi176.stdout:9/566: dwrite d1/d8b/faf [0,4194304] 0 2024-09-21T12:46:59.989 INFO:tasks.workunit.client.1.smithi176.stdout:5/505: symlink d0/d13/d63/d72/l96 0 2024-09-21T12:46:59.995 INFO:tasks.workunit.client.1.smithi176.stdout:7/700: rename d0/d2/db/d10/d23/dce/c57 to d0/d2/db/d10/d72/d7e/de2/df3/c100 0 2024-09-21T12:46:59.999 INFO:tasks.workunit.client.1.smithi176.stdout:4/594: creat d3/d5/db/d96/da3/fca x:0 0 0 2024-09-21T12:47:00.001 INFO:tasks.workunit.client.1.smithi176.stdout:8/574: creat d6/d8/fb7 x:0 0 0 2024-09-21T12:47:00.005 INFO:tasks.workunit.client.0.smithi046.stdout:7/34: sync 2024-09-21T12:47:00.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/35: write d2/d4/f8 [2698880,76000] 0 2024-09-21T12:47:00.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/55: mkdir d6/d7/d13 0 2024-09-21T12:47:00.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/56: write d6/d7/f11 [368879,126136] 0 2024-09-21T12:47:00.010 INFO:tasks.workunit.client.0.smithi046.stdout:9/92: creat d11/d19/f1a x:0 0 0 2024-09-21T12:47:00.010 INFO:tasks.workunit.client.0.smithi046.stdout:0/57: write d6/d7/d9/ff [276583,48178] 0 2024-09-21T12:47:00.011 INFO:tasks.workunit.client.1.smithi176.stdout:9/567: creat d1/df/d48/d69/d38/fc5 x:0 0 0 2024-09-21T12:47:00.012 INFO:tasks.workunit.client.1.smithi176.stdout:9/568: write d1/d63/fb2 [902863,91426] 0 2024-09-21T12:47:00.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/73: mknod d16/c18 0 2024-09-21T12:47:00.017 INFO:tasks.workunit.client.1.smithi176.stdout:4/595: rmdir d3/d21/d97 39 2024-09-21T12:47:00.018 INFO:tasks.workunit.client.1.smithi176.stdout:0/734: sync 2024-09-21T12:47:00.020 INFO:tasks.workunit.client.0.smithi046.stdout:2/74: dread f13 [0,4194304] 0 2024-09-21T12:47:00.020 INFO:tasks.workunit.client.0.smithi046.stdout:7/36: rmdir d2/d4 39 2024-09-21T12:47:00.023 INFO:tasks.workunit.client.0.smithi046.stdout:8/103: symlink d1/d24/l27 0 2024-09-21T12:47:00.023 INFO:tasks.workunit.client.0.smithi046.stdout:8/104: write d1/ff [1946886,55996] 0 2024-09-21T12:47:00.024 INFO:tasks.workunit.client.1.smithi176.stdout:5/506: symlink d0/d13/d63/d2e/d37/l97 0 2024-09-21T12:47:00.024 INFO:tasks.workunit.client.1.smithi176.stdout:4/596: dwrite d3/d5/db/d96/fbe [0,4194304] 0 2024-09-21T12:47:00.029 INFO:tasks.workunit.client.0.smithi046.stdout:9/93: dread f6 [0,4194304] 0 2024-09-21T12:47:00.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/87: getdents d4/dc 0 2024-09-21T12:47:00.031 INFO:tasks.workunit.client.1.smithi176.stdout:5/507: dwrite d0/d13/d63/d2e/d39/d3b/f3e [0,4194304] 0 2024-09-21T12:47:00.031 INFO:tasks.workunit.client.1.smithi176.stdout:8/575: dread d6/f1a [0,4194304] 0 2024-09-21T12:47:00.032 INFO:tasks.workunit.client.1.smithi176.stdout:7/701: symlink d0/d2/l101 0 2024-09-21T12:47:00.034 INFO:tasks.workunit.client.1.smithi176.stdout:7/702: truncate d0/d2/d30/d7b/fe3 861622 0 2024-09-21T12:47:00.036 INFO:tasks.workunit.client.1.smithi176.stdout:1/632: sync 2024-09-21T12:47:00.040 INFO:tasks.workunit.client.1.smithi176.stdout:6/540: truncate d2/dd/d26/f3d 3297467 0 2024-09-21T12:47:00.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/105: symlink d1/d12/d1a/l28 0 2024-09-21T12:47:00.043 INFO:tasks.workunit.client.0.smithi046.stdout:8/106: fsync d1/d12/f18 0 2024-09-21T12:47:00.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/75: dwrite f0 [0,4194304] 0 2024-09-21T12:47:00.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/88: mknod d4/dc/d13/c17 0 2024-09-21T12:47:00.049 INFO:tasks.workunit.client.1.smithi176.stdout:9/569: truncate d1/df/f41 3622758 0 2024-09-21T12:47:00.050 INFO:tasks.workunit.client.0.smithi046.stdout:5/89: write d4/f7 [5090642,33182] 0 2024-09-21T12:47:00.052 INFO:tasks.workunit.client.1.smithi176.stdout:5/508: mkdir d0/d13/d5d/d98 0 2024-09-21T12:47:00.056 INFO:tasks.workunit.client.1.smithi176.stdout:3/677: rename d1/d5/d25/d61/fc4 to d1/d34/ffc 0 2024-09-21T12:47:00.058 INFO:tasks.workunit.client.1.smithi176.stdout:2/611: dwrite d4/df/d2e/d6f/f59 [0,4194304] 0 2024-09-21T12:47:00.060 INFO:tasks.workunit.client.1.smithi176.stdout:3/678: write d1/d5/fcf [750360,84864] 0 2024-09-21T12:47:00.061 INFO:tasks.workunit.client.1.smithi176.stdout:7/703: unlink d0/d2/db/d10/d72/fe6 0 2024-09-21T12:47:00.062 INFO:tasks.workunit.client.1.smithi176.stdout:5/509: dwrite d0/d13/d5d/f94 [0,4194304] 0 2024-09-21T12:47:00.063 INFO:tasks.workunit.client.0.smithi046.stdout:8/107: rename d1/f7 to d1/d24/f29 0 2024-09-21T12:47:00.066 INFO:tasks.workunit.client.0.smithi046.stdout:2/76: fdatasync f13 0 2024-09-21T12:47:00.067 INFO:tasks.workunit.client.0.smithi046.stdout:2/77: readlink lb 0 2024-09-21T12:47:00.068 INFO:tasks.workunit.client.1.smithi176.stdout:1/633: creat d0/db/d6a/d89/fe7 x:0 0 0 2024-09-21T12:47:00.069 INFO:tasks.workunit.client.1.smithi176.stdout:7/704: dread d0/d2/d30/d93/da2/fd8 [0,4194304] 0 2024-09-21T12:47:00.069 INFO:tasks.workunit.client.1.smithi176.stdout:3/679: dwrite d1/d5/d25/d61/fe1 [0,4194304] 0 2024-09-21T12:47:00.070 INFO:tasks.workunit.client.1.smithi176.stdout:7/705: chown d0/d2/db/d10/d72/d94/fef 9186858 1 2024-09-21T12:47:00.073 INFO:tasks.workunit.client.0.smithi046.stdout:0/58: truncate d6/d7/f11 293132 0 2024-09-21T12:47:00.074 INFO:tasks.workunit.client.1.smithi176.stdout:6/541: creat d2/dd/d79/fab x:0 0 0 2024-09-21T12:47:00.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/108: dwrite d1/f1c [0,4194304] 0 2024-09-21T12:47:00.076 INFO:tasks.workunit.client.1.smithi176.stdout:6/542: read d2/dd/d26/d2b/d10/d39/f4a [422900,27583] 0 2024-09-21T12:47:00.079 INFO:tasks.workunit.client.1.smithi176.stdout:4/597: symlink d3/d5/lcb 0 2024-09-21T12:47:00.080 INFO:tasks.workunit.client.1.smithi176.stdout:7/706: dwrite d0/d2/f5c [0,4194304] 0 2024-09-21T12:47:00.081 INFO:tasks.workunit.client.1.smithi176.stdout:9/570: write d1/df/d23/f59 [891830,23757] 0 2024-09-21T12:47:00.081 INFO:tasks.workunit.client.1.smithi176.stdout:9/571: stat d1/d8b/fa4 0 2024-09-21T12:47:00.082 INFO:tasks.workunit.client.1.smithi176.stdout:8/576: mknod d6/d16/d36/d67/cb8 0 2024-09-21T12:47:00.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/37: creat d2/f9 x:0 0 0 2024-09-21T12:47:00.095 INFO:tasks.workunit.client.0.smithi046.stdout:7/38: dwrite d2/f9 [0,4194304] 0 2024-09-21T12:47:00.097 INFO:tasks.workunit.client.0.smithi046.stdout:2/78: symlink d16/l19 0 2024-09-21T12:47:00.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/79: write fc [245045,17595] 0 2024-09-21T12:47:00.100 INFO:tasks.workunit.client.1.smithi176.stdout:0/735: rename d9/d1a/d1d/d23/da1/da3/d1e/f6e to d9/d1a/d1d/d23/da1/da3/d8f/d91/f106 0 2024-09-21T12:47:00.103 INFO:tasks.workunit.client.0.smithi046.stdout:9/94: mkdir d11/d19/d1b 0 2024-09-21T12:47:00.104 INFO:tasks.workunit.client.0.smithi046.stdout:0/59: mknod d6/c14 0 2024-09-21T12:47:00.104 INFO:tasks.workunit.client.1.smithi176.stdout:2/612: symlink d4/df/d2e/d6f/d5d/d81/db2/lbd 0 2024-09-21T12:47:00.106 INFO:tasks.workunit.client.1.smithi176.stdout:2/613: fsync d4/df/d2e/d6f/d5d/f8d 0 2024-09-21T12:47:00.107 INFO:tasks.workunit.client.0.smithi046.stdout:8/109: creat d1/d12/f2a x:0 0 0 2024-09-21T12:47:00.108 INFO:tasks.workunit.client.0.smithi046.stdout:5/90: symlink d4/l18 0 2024-09-21T12:47:00.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/80: dwrite f15 [0,4194304] 0 2024-09-21T12:47:00.109 INFO:tasks.workunit.client.0.smithi046.stdout:2/81: readlink l6 0 2024-09-21T12:47:00.109 INFO:tasks.workunit.client.1.smithi176.stdout:5/510: fsync d0/d13/d63/d2e/d39/d41/f60 0 2024-09-21T12:47:00.110 INFO:tasks.workunit.client.1.smithi176.stdout:5/511: stat d0/d13/d63/c1f 0 2024-09-21T12:47:00.110 INFO:tasks.workunit.client.0.smithi046.stdout:5/91: rename d4 to d4/d16/d19 22 2024-09-21T12:47:00.111 INFO:tasks.workunit.client.1.smithi176.stdout:5/512: chown d0/d13/c2a 0 1 2024-09-21T12:47:00.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/92: write d4/f7 [1028774,73621] 0 2024-09-21T12:47:00.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/110: dread d1/fa [4194304,4194304] 0 2024-09-21T12:47:00.114 INFO:tasks.workunit.client.0.smithi046.stdout:5/93: read d4/f7 [423880,79810] 0 2024-09-21T12:47:00.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/111: write d1/d12/d1a/f1b [645302,121837] 0 2024-09-21T12:47:00.117 INFO:tasks.workunit.client.1.smithi176.stdout:5/513: dread d0/d13/d63/d2e/d39/d41/f49 [0,4194304] 0 2024-09-21T12:47:00.119 INFO:tasks.workunit.client.1.smithi176.stdout:5/514: chown d0/d13/d63/d2e/d39/d41/f49 404834106 1 2024-09-21T12:47:00.119 INFO:tasks.workunit.client.1.smithi176.stdout:6/543: unlink d2/dd/d26/d2b/d10/l9f 0 2024-09-21T12:47:00.122 INFO:tasks.workunit.client.1.smithi176.stdout:4/598: mknod d3/d42/d47/ccc 0 2024-09-21T12:47:00.123 INFO:tasks.workunit.client.0.smithi046.stdout:2/82: dread fc [0,4194304] 0 2024-09-21T12:47:00.125 INFO:tasks.workunit.client.0.smithi046.stdout:9/95: rmdir d11/d19 39 2024-09-21T12:47:00.127 INFO:tasks.workunit.client.1.smithi176.stdout:7/707: creat d0/d2/da8/f102 x:0 0 0 2024-09-21T12:47:00.130 INFO:tasks.workunit.client.1.smithi176.stdout:9/572: readlink d1/df/d23/d67/la9 0 2024-09-21T12:47:00.130 INFO:tasks.workunit.client.0.smithi046.stdout:0/60: creat d6/d7/d9/dd/f15 x:0 0 0 2024-09-21T12:47:00.130 INFO:tasks.workunit.client.0.smithi046.stdout:7/39: dwrite d2/d4/f8 [4194304,4194304] 0 2024-09-21T12:47:00.131 INFO:tasks.workunit.client.1.smithi176.stdout:9/573: fdatasync d1/df/d48/d69/d40/d84/f95 0 2024-09-21T12:47:00.133 INFO:tasks.workunit.client.1.smithi176.stdout:8/577: mknod d6/db/d37/d89/d8a/cb9 0 2024-09-21T12:47:00.133 INFO:tasks.workunit.client.1.smithi176.stdout:8/578: stat d6/db/l58 0 2024-09-21T12:47:00.136 INFO:tasks.workunit.client.0.smithi046.stdout:2/83: dwrite f15 [0,4194304] 0 2024-09-21T12:47:00.137 INFO:tasks.workunit.client.0.smithi046.stdout:9/96: dread f3 [0,4194304] 0 2024-09-21T12:47:00.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/84: fsync f0 0 2024-09-21T12:47:00.144 INFO:tasks.workunit.client.0.smithi046.stdout:1/99: sync 2024-09-21T12:47:00.144 INFO:tasks.workunit.client.1.smithi176.stdout:0/736: stat d9/dc2/cdc 0 2024-09-21T12:47:00.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/112: unlink d1/f26 0 2024-09-21T12:47:00.146 INFO:tasks.workunit.client.1.smithi176.stdout:0/737: fsync d9/d1a/d1d/d23/da1/da3/f50 0 2024-09-21T12:47:00.146 INFO:tasks.workunit.client.0.smithi046.stdout:8/113: fdatasync d1/f10 0 2024-09-21T12:47:00.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/114: stat d1/l22 0 2024-09-21T12:47:00.147 INFO:tasks.workunit.client.1.smithi176.stdout:3/680: rename d1/d5/d25/d61/dd5 to d1/d8d/dfd 0 2024-09-21T12:47:00.149 INFO:tasks.workunit.client.1.smithi176.stdout:2/614: fsync d4/d3d/f5b 0 2024-09-21T12:47:00.150 INFO:tasks.workunit.client.1.smithi176.stdout:9/574: dread d1/df/d48/d69/f27 [0,4194304] 0 2024-09-21T12:47:00.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/61: mknod d6/d7/d9/c16 0 2024-09-21T12:47:00.152 INFO:tasks.workunit.client.1.smithi176.stdout:9/575: chown d1/f71 606751462 1 2024-09-21T12:47:00.154 INFO:tasks.workunit.client.1.smithi176.stdout:6/544: mkdir d2/dd/d26/d2b/dac 0 2024-09-21T12:47:00.154 INFO:tasks.workunit.client.1.smithi176.stdout:9/576: stat d1/df/d48/d69/d38/fc5 0 2024-09-21T12:47:00.155 INFO:tasks.workunit.client.1.smithi176.stdout:6/545: chown d2/dd/l70 384509 1 2024-09-21T12:47:00.156 INFO:tasks.workunit.client.0.smithi046.stdout:2/85: creat d16/f1a x:0 0 0 2024-09-21T12:47:00.156 INFO:tasks.workunit.client.1.smithi176.stdout:3/681: dwrite d1/d3e/f5a [4194304,4194304] 0 2024-09-21T12:47:00.156 INFO:tasks.workunit.client.0.smithi046.stdout:2/86: chown c9 0 1 2024-09-21T12:47:00.158 INFO:tasks.workunit.client.0.smithi046.stdout:1/100: stat d4/c12 0 2024-09-21T12:47:00.158 INFO:tasks.workunit.client.1.smithi176.stdout:6/546: write d2/dd/d26/d2b/d10/f8e [78797,44087] 0 2024-09-21T12:47:00.159 INFO:tasks.workunit.client.0.smithi046.stdout:1/101: dread - d4/f1f zero size 2024-09-21T12:47:00.162 INFO:tasks.workunit.client.0.smithi046.stdout:2/87: dread f15 [0,4194304] 0 2024-09-21T12:47:00.164 INFO:tasks.workunit.client.1.smithi176.stdout:0/738: dread d9/d1a/d1d/d23/da1/da3/f13 [0,4194304] 0 2024-09-21T12:47:00.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/115: write d1/f11 [2875456,42158] 0 2024-09-21T12:47:00.166 INFO:tasks.workunit.client.0.smithi046.stdout:8/116: dread - d1/f8 zero size 2024-09-21T12:47:00.168 INFO:tasks.workunit.client.0.smithi046.stdout:0/62: mknod d6/d7/c17 0 2024-09-21T12:47:00.168 INFO:tasks.workunit.client.0.smithi046.stdout:0/63: stat d6/d7 0 2024-09-21T12:47:00.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/739: dwrite d9/d1a/d1d/d23/f5b [0,4194304] 0 2024-09-21T12:47:00.173 INFO:tasks.workunit.client.1.smithi176.stdout:2/615: mknod d4/df/d2e/d39/db7/d80/cbe 0 2024-09-21T12:47:00.176 INFO:tasks.workunit.client.0.smithi046.stdout:0/64: dwrite d6/d7/f12 [0,4194304] 0 2024-09-21T12:47:00.178 INFO:tasks.workunit.client.1.smithi176.stdout:3/682: dread d1/d5/f14 [0,4194304] 0 2024-09-21T12:47:00.180 INFO:tasks.workunit.client.0.smithi046.stdout:1/102: symlink d4/d13/l2b 0 2024-09-21T12:47:00.182 INFO:tasks.workunit.client.0.smithi046.stdout:2/88: symlink d16/l1b 0 2024-09-21T12:47:00.184 INFO:tasks.workunit.client.1.smithi176.stdout:9/577: creat d1/df/d48/d69/d76/d7c/fc6 x:0 0 0 2024-09-21T12:47:00.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/40: creat d2/fa x:0 0 0 2024-09-21T12:47:00.188 INFO:tasks.workunit.client.1.smithi176.stdout:7/708: write d0/d2/db/d10/d31/da1/fcd [5034740,24193] 0 2024-09-21T12:47:00.188 INFO:tasks.workunit.client.0.smithi046.stdout:5/94: truncate d4/f8 2508414 0 2024-09-21T12:47:00.189 INFO:tasks.workunit.client.1.smithi176.stdout:5/515: sync 2024-09-21T12:47:00.189 INFO:tasks.workunit.client.1.smithi176.stdout:7/709: fsync d0/fb4 0 2024-09-21T12:47:00.191 INFO:tasks.workunit.client.1.smithi176.stdout:6/547: creat d2/dd/d26/d2b/d68/fad x:0 0 0 2024-09-21T12:47:00.191 INFO:tasks.workunit.client.1.smithi176.stdout:7/710: fsync d0/d2/da8/f102 0 2024-09-21T12:47:00.195 INFO:tasks.workunit.client.1.smithi176.stdout:9/578: dwrite d1/df/d48/d69/d4d/f96 [0,4194304] 0 2024-09-21T12:47:00.196 INFO:tasks.workunit.client.1.smithi176.stdout:6/548: write d2/dd/d26/d2b/d10/d39/f52 [2852568,75126] 0 2024-09-21T12:47:00.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/89: symlink d16/l1c 0 2024-09-21T12:47:00.197 INFO:tasks.workunit.client.1.smithi176.stdout:2/616: write d4/df/d2e/d39/f66 [5182736,41583] 0 2024-09-21T12:47:00.199 INFO:tasks.workunit.client.1.smithi176.stdout:1/634: getdents d0/db/d1a/d2c/d48 0 2024-09-21T12:47:00.199 INFO:tasks.workunit.client.1.smithi176.stdout:9/579: fdatasync d1/df/d48/f4a 0 2024-09-21T12:47:00.199 INFO:tasks.workunit.client.0.smithi046.stdout:7/41: rmdir d2 39 2024-09-21T12:47:00.200 INFO:tasks.workunit.client.1.smithi176.stdout:3/683: dread d1/da/f2e [0,4194304] 0 2024-09-21T12:47:00.201 INFO:tasks.workunit.client.1.smithi176.stdout:4/599: truncate d3/d5/db/d96/fbe 4022780 0 2024-09-21T12:47:00.201 INFO:tasks.workunit.client.1.smithi176.stdout:8/579: dwrite d6/d8/d24/d35/f4a [0,4194304] 0 2024-09-21T12:47:00.203 INFO:tasks.workunit.client.1.smithi176.stdout:9/580: write d1/d61/d73/d7d/fab [878011,86914] 0 2024-09-21T12:47:00.204 INFO:tasks.workunit.client.1.smithi176.stdout:2/617: dread d4/d3a/f45 [0,4194304] 0 2024-09-21T12:47:00.205 INFO:tasks.workunit.client.1.smithi176.stdout:5/516: symlink d0/d13/d63/d2e/d39/d3b/l99 0 2024-09-21T12:47:00.206 INFO:tasks.workunit.client.1.smithi176.stdout:9/581: read d1/df/d1c/f3c [3532122,128188] 0 2024-09-21T12:47:00.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/97: mkdir d11/d19/d1b/d1c 0 2024-09-21T12:47:00.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/117: write d1/f8 [435237,64975] 0 2024-09-21T12:47:00.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/118: stat d1/c1d 0 2024-09-21T12:47:00.211 INFO:tasks.workunit.client.1.smithi176.stdout:3/684: read d1/d34/d5d/d78/fef [120760,85155] 0 2024-09-21T12:47:00.211 INFO:tasks.workunit.client.0.smithi046.stdout:0/65: rename d6/d7/f11 to d6/f18 0 2024-09-21T12:47:00.213 INFO:tasks.workunit.client.1.smithi176.stdout:2/618: dwrite d4/df/d2e/d39/d55/fac [0,4194304] 0 2024-09-21T12:47:00.214 INFO:tasks.workunit.client.1.smithi176.stdout:2/619: chown d4/df/d2e/d6f/d6d 5 1 2024-09-21T12:47:00.216 INFO:tasks.workunit.client.0.smithi046.stdout:6/45: sync 2024-09-21T12:47:00.216 INFO:tasks.workunit.client.0.smithi046.stdout:2/90: creat d16/f1d x:0 0 0 2024-09-21T12:47:00.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/46: truncate fa 504744 0 2024-09-21T12:47:00.218 INFO:tasks.workunit.client.0.smithi046.stdout:6/47: read f5 [511826,123380] 0 2024-09-21T12:47:00.218 INFO:tasks.workunit.client.1.smithi176.stdout:7/711: rename d0/d2/d30/d93/l9c to d0/d2/db/d10/d72/d7e/l103 0 2024-09-21T12:47:00.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/95: mkdir d4/d9/d10/d1a 0 2024-09-21T12:47:00.220 INFO:tasks.workunit.client.0.smithi046.stdout:2/91: dread f0 [0,4194304] 0 2024-09-21T12:47:00.220 INFO:tasks.workunit.client.1.smithi176.stdout:2/620: read d4/df/f21 [3458910,29951] 0 2024-09-21T12:47:00.225 INFO:tasks.workunit.client.0.smithi046.stdout:2/92: dwrite f11 [0,4194304] 0 2024-09-21T12:47:00.226 INFO:tasks.workunit.client.1.smithi176.stdout:2/621: dwrite d4/df/d83/d8e/faf [0,4194304] 0 2024-09-21T12:47:00.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.250+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb1d0062630 con 0x7fb1bc074ad0 2024-09-21T12:47:00.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.251+0000 7fb1c6ffd640 1 -- 172.21.15.46:0/1532260933 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fb1d0062630 con 0x7fb1bc074ad0 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.253+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fb1bc074ad0 msgr2=0x7fb1bc076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.253+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fb1bc074ad0 0x7fb1bc076f90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb1c00096c0 tx=0x7fb1c0004f00 comp rx=0 tx=0).stop 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d00fffe0 msgr2=0x7fb1d019dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d00fffe0 0x7fb1d019dc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc00d6a0 tx=0x7fb1cc00db60 comp rx=0 tx=0).stop 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 shutdown_connections 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fb1bc074ad0 0x7fb1bc076f90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb1d01011e0 0x7fb1d019e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 --2- 172.21.15.46:0/1532260933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb1d00fffe0 0x7fb1d019dc40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 >> 172.21.15.46:0/1532260933 conn(0x7fb1d00fb770 msgr2=0x7fb1d010b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:00.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 shutdown_connections 2024-09-21T12:47:00.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.254+0000 7fb1d7f1d640 1 -- 172.21.15.46:0/1532260933 wait complete. 2024-09-21T12:47:00.263 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:47:00.332 INFO:tasks.workunit.client.0.smithi046.stdout:2/93: dread - d16/f1d zero size 2024-09-21T12:47:00.333 INFO:tasks.workunit.client.1.smithi176.stdout:6/549: creat d2/d5d/fae x:0 0 0 2024-09-21T12:47:00.333 INFO:tasks.workunit.client.0.smithi046.stdout:2/94: stat d16/l19 0 2024-09-21T12:47:00.333 INFO:tasks.workunit.client.0.smithi046.stdout:9/98: mknod d11/d19/c1d 0 2024-09-21T12:47:00.333 INFO:tasks.workunit.client.1.smithi176.stdout:6/550: dread - d2/d63/fa4 zero size 2024-09-21T12:47:00.334 INFO:tasks.workunit.client.0.smithi046.stdout:8/119: mknod d1/d12/c2b 0 2024-09-21T12:47:00.336 INFO:tasks.workunit.client.0.smithi046.stdout:1/103: creat d4/f2c x:0 0 0 2024-09-21T12:47:00.337 INFO:tasks.workunit.client.0.smithi046.stdout:1/104: dread - d4/d13/f19 zero size 2024-09-21T12:47:00.339 INFO:tasks.workunit.client.1.smithi176.stdout:8/580: creat d6/d16/d79/fba x:0 0 0 2024-09-21T12:47:00.340 INFO:tasks.workunit.client.0.smithi046.stdout:1/105: chown d4/d13/f1d 0 1 2024-09-21T12:47:00.342 INFO:tasks.workunit.client.0.smithi046.stdout:6/48: truncate f5 162483 0 2024-09-21T12:47:00.343 INFO:tasks.workunit.client.0.smithi046.stdout:6/49: rmdir - no directory 2024-09-21T12:47:00.343 INFO:tasks.workunit.client.0.smithi046.stdout:6/50: read fa [116442,25383] 0 2024-09-21T12:47:00.344 INFO:tasks.workunit.client.1.smithi176.stdout:5/517: mknod d0/d13/d63/d72/d87/d92/c9a 0 2024-09-21T12:47:00.345 INFO:tasks.workunit.client.1.smithi176.stdout:8/581: dwrite d6/d8/d24/d5e/f8b [0,4194304] 0 2024-09-21T12:47:00.345 INFO:tasks.workunit.client.1.smithi176.stdout:8/582: chown d6/db/d37/lb1 3011 1 2024-09-21T12:47:00.346 INFO:tasks.workunit.client.1.smithi176.stdout:8/583: write d6/d8/fb5 [599532,121016] 0 2024-09-21T12:47:00.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 -- 172.21.15.46:0/3793800262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 msgr2=0x7fc6f0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/3793800262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0101d60 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009880 tx=0x7fc6e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 -- 172.21.15.46:0/3793800262 shutdown_connections 2024-09-21T12:47:00.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/3793800262 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f0102b60 0x7fc6f0102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/3793800262 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0101d60 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 -- 172.21.15.46:0/3793800262 >> 172.21.15.46:0/3793800262 conn(0x7fc6f00fd0d0 msgr2=0x7fc6f00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 -- 172.21.15.46:0/3793800262 shutdown_connections 2024-09-21T12:47:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.347+0000 7fc6f67b8640 1 -- 172.21.15.46:0/3793800262 wait complete. 2024-09-21T12:47:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.348+0000 7fc6f67b8640 1 Processor -- start 2024-09-21T12:47:00.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.348+0000 7fc6f67b8640 1 -- start start 2024-09-21T12:47:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.348+0000 7fc6f67b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6f67b8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f0102b60 0x7fc6f00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6f67b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f010a780 con 0x7fc6f0101960 2024-09-21T12:47:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6f67b8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f010a600 con 0x7fc6f0102b60 2024-09-21T12:47:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:00.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49058/0 (socket says 172.21.15.46:49058) 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 -- 172.21.15.46:0/972658 learned_addr learned my addr 172.21.15.46:0/972658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 -- 172.21.15.46:0/972658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f0102b60 msgr2=0x7fc6f00745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f0102b60 0x7fc6f00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 -- 172.21.15.46:0/972658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f0074b20 con 0x7fc6f0101960 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.349+0000 7fc6effff640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0075f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009230 tx=0x7fc6e40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.350+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6e403f070 con 0x7fc6f0101960 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.350+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f0074db0 con 0x7fc6f0101960 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.350+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc6e40049d0 con 0x7fc6f0101960 2024-09-21T12:47:00.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.350+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f00752e0 con 0x7fc6f0101960 2024-09-21T12:47:00.353 INFO:tasks.workunit.client.1.smithi176.stdout:0/740: link d9/d1a/d1d/d23/da1/da3/lc5 d9/d1a/d1d/d23/da1/da3/d93/df9/d75/l107 0 2024-09-21T12:47:00.353 INFO:tasks.workunit.client.1.smithi176.stdout:0/741: dread d9/d1a/d1d/d23/fb4 [0,4194304] 0 2024-09-21T12:47:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.350+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc6e4035030 con 0x7fc6f0101960 2024-09-21T12:47:00.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.351+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f0101d60 con 0x7fc6f0101960 2024-09-21T12:47:00.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.352+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fc6e4042070 con 0x7fc6f0101960 2024-09-21T12:47:00.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/95: creat d16/f1e x:0 0 0 2024-09-21T12:47:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.354+0000 7fc6ed7fa640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc6d8074a20 0x7fc6d8076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.354+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fc6e40b6eb0 con 0x7fc6f0101960 2024-09-21T12:47:00.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.354+0000 7fc6ef7fe640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc6d8074a20 0x7fc6d8076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:00.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.355+0000 7fc6ef7fe640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc6d8074a20 0x7fc6d8076ee0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00058c0 tx=0x7fc6e0005850 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:00.356 INFO:tasks.workunit.client.0.smithi046.stdout:9/99: write d11/f16 [384926,4084] 0 2024-09-21T12:47:00.357 INFO:tasks.workunit.client.1.smithi176.stdout:3/685: rmdir d1/d5/d25/d61 39 2024-09-21T12:47:00.360 INFO:tasks.workunit.client.0.smithi046.stdout:7/42: mknod d2/cb 0 2024-09-21T12:47:00.361 INFO:tasks.workunit.client.0.smithi046.stdout:7/43: write d2/d4/f8 [7713170,21280] 0 2024-09-21T12:47:00.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.360+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc6e40823e0 con 0x7fc6f0101960 2024-09-21T12:47:00.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/44: dread - d2/fa zero size 2024-09-21T12:47:00.363 INFO:tasks.workunit.client.0.smithi046.stdout:7/45: write d2/f9 [2871044,80063] 0 2024-09-21T12:47:00.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/46: dread d2/f5 [4194304,4194304] 0 2024-09-21T12:47:00.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/47: chown d2/cb 196748342 1 2024-09-21T12:47:00.368 INFO:tasks.workunit.client.0.smithi046.stdout:6/51: rename f6 to fb 0 2024-09-21T12:47:00.370 INFO:tasks.workunit.client.1.smithi176.stdout:1/635: mkdir d0/db/d1a/d2c/dc5/d41/d59/d99/de8 0 2024-09-21T12:47:00.372 INFO:tasks.workunit.client.1.smithi176.stdout:6/551: mkdir d2/dd/d26/d2b/d10/d39/daf 0 2024-09-21T12:47:00.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/96: dread f15 [0,4194304] 0 2024-09-21T12:47:00.381 INFO:tasks.workunit.client.0.smithi046.stdout:1/106: symlink d4/d29/l2d 0 2024-09-21T12:47:00.385 INFO:tasks.workunit.client.1.smithi176.stdout:0/742: rename d9/d1b/l105 to d9/dc2/l108 0 2024-09-21T12:47:00.388 INFO:tasks.workunit.client.1.smithi176.stdout:3/686: mkdir d1/d34/d5d/dfe 0 2024-09-21T12:47:00.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/48: mknod d2/d4/cc 0 2024-09-21T12:47:00.391 INFO:tasks.workunit.client.0.smithi046.stdout:8/120: truncate d1/f11 2608612 0 2024-09-21T12:47:00.392 INFO:tasks.workunit.client.1.smithi176.stdout:7/712: unlink d0/l1f 0 2024-09-21T12:47:00.393 INFO:tasks.workunit.client.1.smithi176.stdout:7/713: fdatasync d0/d2/da8/dca/fdf 0 2024-09-21T12:47:00.395 INFO:tasks.workunit.client.0.smithi046.stdout:5/96: fdatasync d4/f8 0 2024-09-21T12:47:00.396 INFO:tasks.workunit.client.0.smithi046.stdout:9/100: symlink d11/d19/d1b/d1c/l1e 0 2024-09-21T12:47:00.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/97: creat d16/f1f x:0 0 0 2024-09-21T12:47:00.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/101: dread d11/f16 [0,4194304] 0 2024-09-21T12:47:00.399 INFO:tasks.workunit.client.1.smithi176.stdout:6/552: creat d2/dd/d26/d2b/fb0 x:0 0 0 2024-09-21T12:47:00.400 INFO:tasks.workunit.client.0.smithi046.stdout:9/102: write d11/d19/f1a [1044994,91545] 0 2024-09-21T12:47:00.400 INFO:tasks.workunit.client.0.smithi046.stdout:1/107: creat d4/d13/f2e x:0 0 0 2024-09-21T12:47:00.401 INFO:tasks.workunit.client.1.smithi176.stdout:4/600: mknod d3/d21/d27/d9b/da2/ccd 0 2024-09-21T12:47:00.406 INFO:tasks.workunit.client.1.smithi176.stdout:5/518: mkdir d0/d13/d5d/d98/d9b 0 2024-09-21T12:47:00.409 INFO:tasks.workunit.client.0.smithi046.stdout:6/52: truncate fb 1834238 0 2024-09-21T12:47:00.411 INFO:tasks.workunit.client.0.smithi046.stdout:8/121: creat d1/d12/d1a/f2c x:0 0 0 2024-09-21T12:47:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:00 smithi046 ceph-mon[27868]: pgmap v26: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 27 MiB/s rd, 154 MiB/s wr, 328 op/s 2024-09-21T12:47:00.412 INFO:tasks.workunit.client.0.smithi046.stdout:8/122: fsync d1/d12/d1a/f1b 0 2024-09-21T12:47:00.417 INFO:tasks.workunit.client.0.smithi046.stdout:2/98: creat d16/f20 x:0 0 0 2024-09-21T12:47:00.418 INFO:tasks.workunit.client.0.smithi046.stdout:9/103: chown d11/f18 1 1 2024-09-21T12:47:00.420 INFO:tasks.workunit.client.0.smithi046.stdout:1/108: creat d4/d13/f2f x:0 0 0 2024-09-21T12:47:00.424 INFO:tasks.workunit.client.0.smithi046.stdout:7/49: mkdir d2/dd 0 2024-09-21T12:47:00.426 INFO:tasks.workunit.client.1.smithi176.stdout:0/743: write d9/f27 [7546344,90282] 0 2024-09-21T12:47:00.431 INFO:tasks.workunit.client.1.smithi176.stdout:0/744: dwrite d9/d1a/d1d/d23/da1/db0/fd1 [4194304,4194304] 0 2024-09-21T12:47:00.433 INFO:tasks.workunit.client.0.smithi046.stdout:6/53: write fa [466795,105395] 0 2024-09-21T12:47:00.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/99: rename d16/f1f to d16/f21 0 2024-09-21T12:47:00.436 INFO:tasks.workunit.client.0.smithi046.stdout:9/104: write d11/f12 [4058936,111443] 0 2024-09-21T12:47:00.437 INFO:tasks.workunit.client.0.smithi046.stdout:1/109: dread - d4/d13/f28 zero size 2024-09-21T12:47:00.446 INFO:tasks.workunit.client.1.smithi176.stdout:7/714: unlink d0/d5d/d7a/fbd 0 2024-09-21T12:47:00.447 INFO:tasks.workunit.client.0.smithi046.stdout:6/54: mknod cc 0 2024-09-21T12:47:00.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/55: truncate f3 4312548 0 2024-09-21T12:47:00.449 INFO:tasks.workunit.client.0.smithi046.stdout:2/100: write d16/f21 [291630,100934] 0 2024-09-21T12:47:00.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/56: chown f3 33295 1 2024-09-21T12:47:00.451 INFO:tasks.workunit.client.1.smithi176.stdout:4/601: creat d3/d21/d5e/fce x:0 0 0 2024-09-21T12:47:00.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/105: readlink d11/l17 0 2024-09-21T12:47:00.453 INFO:tasks.workunit.client.1.smithi176.stdout:5/519: write d0/d13/d63/d72/f8f [2996010,60733] 0 2024-09-21T12:47:00.454 INFO:tasks.workunit.client.1.smithi176.stdout:5/520: readlink d0/d13/d63/d2e/l62 0 2024-09-21T12:47:00.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/106: dread fb [0,4194304] 0 2024-09-21T12:47:00.455 INFO:tasks.workunit.client.1.smithi176.stdout:5/521: write d0/f27 [3839977,89594] 0 2024-09-21T12:47:00.455 INFO:tasks.workunit.client.1.smithi176.stdout:9/582: link d1/df/d48/d69/f3d d1/df/d48/d69/fc7 0 2024-09-21T12:47:00.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/122: sync 2024-09-21T12:47:00.456 INFO:tasks.workunit.client.0.smithi046.stdout:4/135: sync 2024-09-21T12:47:00.456 INFO:tasks.workunit.client.0.smithi046.stdout:9/107: stat d11/d19/c1d 0 2024-09-21T12:47:00.456 INFO:tasks.workunit.client.0.smithi046.stdout:9/108: fsync d11/d19/f1a 0 2024-09-21T12:47:00.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/136: fdatasync d1/d13/d25/f19 0 2024-09-21T12:47:00.457 INFO:tasks.workunit.client.1.smithi176.stdout:8/584: sync 2024-09-21T12:47:00.458 INFO:tasks.workunit.client.0.smithi046.stdout:8/123: link d1/d12/d1a/c1e d1/d12/d1a/c2d 0 2024-09-21T12:47:00.458 INFO:tasks.workunit.client.1.smithi176.stdout:8/585: dread d6/d8/fb5 [0,4194304] 0 2024-09-21T12:47:00.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/57: unlink f2 0 2024-09-21T12:47:00.460 INFO:tasks.workunit.client.1.smithi176.stdout:8/586: read d6/f5b [8293643,18877] 0 2024-09-21T12:47:00.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/123: dread d5/f20 [0,4194304] 0 2024-09-21T12:47:00.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/101: mkdir d16/d22 0 2024-09-21T12:47:00.463 INFO:tasks.workunit.client.0.smithi046.stdout:2/102: fdatasync d16/f20 0 2024-09-21T12:47:00.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/50: rename d2/f5 to d2/fe 0 2024-09-21T12:47:00.466 INFO:tasks.workunit.client.1.smithi176.stdout:2/622: getdents d4/d3d 0 2024-09-21T12:47:00.466 INFO:tasks.workunit.client.0.smithi046.stdout:5/97: truncate d4/f8 2225178 0 2024-09-21T12:47:00.469 INFO:tasks.workunit.client.1.smithi176.stdout:1/636: rename d0/db/d1a/d2c/dc5/d2b/cd0 to d0/db/d1a/d2c/dc5/d2b/ce9 0 2024-09-21T12:47:00.470 INFO:tasks.workunit.client.1.smithi176.stdout:1/637: read d0/db/f7e [1327140,10533] 0 2024-09-21T12:47:00.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/51: dwrite d2/d4/f8 [4194304,4194304] 0 2024-09-21T12:47:00.472 INFO:tasks.workunit.client.1.smithi176.stdout:6/553: unlink d2/d6f/ca0 0 2024-09-21T12:47:00.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/124: mknod d1/d24/c2e 0 2024-09-21T12:47:00.477 INFO:tasks.workunit.client.1.smithi176.stdout:4/602: creat d3/d5/db/d96/da3/fcf x:0 0 0 2024-09-21T12:47:00.478 INFO:tasks.workunit.client.0.smithi046.stdout:9/109: chown d11/c14 717665071 1 2024-09-21T12:47:00.483 INFO:tasks.workunit.client.1.smithi176.stdout:2/623: mknod d4/df/d2e/d6f/d5d/d81/cbf 0 2024-09-21T12:47:00.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/110: link d4/c2a d4/d13/c30 0 2024-09-21T12:47:00.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/111: chown d4/d13/f19 1840 1 2024-09-21T12:47:00.486 INFO:tasks.workunit.client.0.smithi046.stdout:7/52: unlink d2/cb 0 2024-09-21T12:47:00.488 INFO:tasks.workunit.client.0.smithi046.stdout:8/125: mkdir d1/d12/d1a/d2f 0 2024-09-21T12:47:00.492 INFO:tasks.workunit.client.0.smithi046.stdout:8/126: dread d1/f1c [0,4194304] 0 2024-09-21T12:47:00.492 INFO:tasks.workunit.client.1.smithi176.stdout:6/554: truncate d2/dd/d26/d2b/d10/d39/f4a 391360 0 2024-09-21T12:47:00.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/58: fdatasync f5 0 2024-09-21T12:47:00.495 INFO:tasks.workunit.client.1.smithi176.stdout:4/603: symlink d3/d5/d37/ld0 0 2024-09-21T12:47:00.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/124: creat d5/dc/d28/f2c x:0 0 0 2024-09-21T12:47:00.498 INFO:tasks.workunit.client.1.smithi176.stdout:9/583: unlink d1/df/d48/d69/d38/f91 0 2024-09-21T12:47:00.498 INFO:tasks.workunit.client.1.smithi176.stdout:9/584: stat d1/df/d48 0 2024-09-21T12:47:00.502 INFO:tasks.workunit.client.1.smithi176.stdout:3/687: getdents d1 0 2024-09-21T12:47:00.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/98: creat d4/d16/f1b x:0 0 0 2024-09-21T12:47:00.504 INFO:tasks.workunit.client.0.smithi046.stdout:5/99: write d4/fa [4880298,75242] 0 2024-09-21T12:47:00.504 INFO:tasks.workunit.client.0.smithi046.stdout:1/112: symlink d4/d29/l31 0 2024-09-21T12:47:00.505 INFO:tasks.workunit.client.0.smithi046.stdout:5/100: dread - d4/d16/f1b zero size 2024-09-21T12:47:00.506 INFO:tasks.workunit.client.0.smithi046.stdout:5/101: write d4/d16/f1b [355708,67881] 0 2024-09-21T12:47:00.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/53: mkdir d2/d4/df 0 2024-09-21T12:47:00.509 INFO:tasks.workunit.client.1.smithi176.stdout:7/715: dwrite d0/d2/db/f14 [4194304,4194304] 0 2024-09-21T12:47:00.510 INFO:tasks.workunit.client.1.smithi176.stdout:7/716: read - d0/d2/db/d10/fbf zero size 2024-09-21T12:47:00.511 INFO:tasks.workunit.client.1.smithi176.stdout:0/745: creat d9/d1a/d1d/d23/da1/da3/d93/df9/f109 x:0 0 0 2024-09-21T12:47:00.512 INFO:tasks.workunit.client.1.smithi176.stdout:0/746: write d9/d1a/d1d/d23/da1/da3/d93/df9/d77/fb6 [9184469,211] 0 2024-09-21T12:47:00.513 INFO:tasks.workunit.client.1.smithi176.stdout:2/624: rename d4/df/d2e/c35 to d4/df/d2e/d6f/d5d/d81/db2/da5/cc0 0 2024-09-21T12:47:00.513 INFO:tasks.workunit.client.0.smithi046.stdout:8/127: readlink d1/d12/l23 0 2024-09-21T12:47:00.519 INFO:tasks.workunit.client.0.smithi046.stdout:9/110: dwrite f3 [0,4194304] 0 2024-09-21T12:47:00.519 INFO:tasks.workunit.client.0.smithi046.stdout:6/59: symlink ld 0 2024-09-21T12:47:00.521 INFO:tasks.workunit.client.0.smithi046.stdout:2/103: truncate f11 3164799 0 2024-09-21T12:47:00.522 INFO:tasks.workunit.client.0.smithi046.stdout:2/104: chown c14 3 1 2024-09-21T12:47:00.524 INFO:tasks.workunit.client.1.smithi176.stdout:0/747: dread d9/d1b/f71 [0,4194304] 0 2024-09-21T12:47:00.526 INFO:tasks.workunit.client.0.smithi046.stdout:1/113: mkdir d4/d29/d32 0 2024-09-21T12:47:00.527 INFO:tasks.workunit.client.0.smithi046.stdout:1/114: truncate d4/d13/f23 152850 0 2024-09-21T12:47:00.528 INFO:tasks.workunit.client.0.smithi046.stdout:1/115: write d4/f18 [894957,30454] 0 2024-09-21T12:47:00.530 INFO:tasks.workunit.client.0.smithi046.stdout:1/116: write d4/d13/f1c [5031697,84383] 0 2024-09-21T12:47:00.532 INFO:tasks.workunit.client.1.smithi176.stdout:8/587: rmdir d6/d16/d9f 0 2024-09-21T12:47:00.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/128: rmdir d1 39 2024-09-21T12:47:00.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/60: mkdir de 0 2024-09-21T12:47:00.543 INFO:tasks.workunit.client.1.smithi176.stdout:1/638: creat d0/fea x:0 0 0 2024-09-21T12:47:00.544 INFO:tasks.workunit.client.1.smithi176.stdout:6/555: truncate d2/d63/f51 206134 0 2024-09-21T12:47:00.545 INFO:tasks.workunit.client.0.smithi046.stdout:9/111: mkdir d11/d19/d1b/d1c/d1f 0 2024-09-21T12:47:00.545 INFO:tasks.workunit.client.1.smithi176.stdout:6/556: truncate d2/dd/d26/d2b/fa5 297185 0 2024-09-21T12:47:00.548 INFO:tasks.workunit.client.1.smithi176.stdout:0/748: mknod d9/d1a/d1d/d22/c10a 0 2024-09-21T12:47:00.549 INFO:tasks.workunit.client.0.smithi046.stdout:7/54: creat d2/d4/df/f10 x:0 0 0 2024-09-21T12:47:00.550 INFO:tasks.workunit.client.1.smithi176.stdout:6/557: dwrite d2/f64 [0,4194304] 0 2024-09-21T12:47:00.550 INFO:tasks.workunit.client.1.smithi176.stdout:9/585: mkdir d1/df/d48/d69/dc8 0 2024-09-21T12:47:00.554 INFO:tasks.workunit.client.1.smithi176.stdout:3/688: creat d1/d34/d71/d91/df6/fff x:0 0 0 2024-09-21T12:47:00.555 INFO:tasks.workunit.client.1.smithi176.stdout:3/689: write d1/d34/d48/fa4 [908834,91562] 0 2024-09-21T12:47:00.556 INFO:tasks.workunit.client.1.smithi176.stdout:8/588: chown d6/db/l48 173 1 2024-09-21T12:47:00.557 INFO:tasks.workunit.client.1.smithi176.stdout:8/589: chown d6/f5b 436861970 1 2024-09-21T12:47:00.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/102: creat d4/d9/d10/d1a/f1c x:0 0 0 2024-09-21T12:47:00.558 INFO:tasks.workunit.client.0.smithi046.stdout:2/105: write f15 [371967,58612] 0 2024-09-21T12:47:00.562 INFO:tasks.workunit.client.0.smithi046.stdout:6/61: truncate f5 479893 0 2024-09-21T12:47:00.565 INFO:tasks.workunit.client.1.smithi176.stdout:1/639: rename d0/db/d1a/d2c/d48/f8d to d0/db/d1a/d2c/d66/feb 0 2024-09-21T12:47:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:00 smithi176 ceph-mon[35476]: pgmap v26: 65 pgs: 65 active+clean; 1.2 GiB data, 3.4 GiB used, 533 GiB / 536 GiB avail; 27 MiB/s rd, 154 MiB/s wr, 328 op/s 2024-09-21T12:47:00.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/112: mkdir d11/d19/d20 0 2024-09-21T12:47:00.570 INFO:tasks.workunit.client.1.smithi176.stdout:0/749: mkdir d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd/d10b 0 2024-09-21T12:47:00.573 INFO:tasks.workunit.client.0.smithi046.stdout:7/55: write d2/f3 [7417092,107042] 0 2024-09-21T12:47:00.574 INFO:tasks.workunit.client.1.smithi176.stdout:5/522: sync 2024-09-21T12:47:00.574 INFO:tasks.workunit.client.1.smithi176.stdout:9/586: creat d1/d8b/fc9 x:0 0 0 2024-09-21T12:47:00.575 INFO:tasks.workunit.client.1.smithi176.stdout:2/625: truncate d4/df/f5a 1884923 0 2024-09-21T12:47:00.575 INFO:tasks.workunit.client.1.smithi176.stdout:3/690: symlink d1/d8d/l100 0 2024-09-21T12:47:00.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/103: symlink d4/d9/d10/l1d 0 2024-09-21T12:47:00.576 INFO:tasks.workunit.client.1.smithi176.stdout:8/590: mknod d6/d8/d24/d35/d9b/cbb 0 2024-09-21T12:47:00.576 INFO:tasks.workunit.client.1.smithi176.stdout:3/691: chown d1/d34/d57/l82 27994 1 2024-09-21T12:47:00.581 INFO:tasks.workunit.client.0.smithi046.stdout:8/129: truncate d1/f1f 773115 0 2024-09-21T12:47:00.582 INFO:tasks.workunit.client.1.smithi176.stdout:4/604: getdents d3/d5/db/d36 0 2024-09-21T12:47:00.583 INFO:tasks.workunit.client.1.smithi176.stdout:4/605: write d3/d42/d4d/f70 [2065974,11225] 0 2024-09-21T12:47:00.583 INFO:tasks.workunit.client.0.smithi046.stdout:5/104: dwrite d4/d16/f1b [0,4194304] 0 2024-09-21T12:47:00.585 INFO:tasks.workunit.client.0.smithi046.stdout:3/125: getdents d5/d16 0 2024-09-21T12:47:00.589 INFO:tasks.workunit.client.1.smithi176.stdout:0/750: rename d9/d1a/d1d/d23/da1/da3/ld to d9/d1a/d1d/d23/da1/da3/d1e/d47/l10c 0 2024-09-21T12:47:00.593 INFO:tasks.workunit.client.1.smithi176.stdout:5/523: unlink d0/d13/f48 0 2024-09-21T12:47:00.594 INFO:tasks.workunit.client.1.smithi176.stdout:5/524: write d0/d13/d5d/f73 [176766,107949] 0 2024-09-21T12:47:00.597 INFO:tasks.workunit.client.1.smithi176.stdout:9/587: creat d1/d61/d73/d7d/fca x:0 0 0 2024-09-21T12:47:00.598 INFO:tasks.workunit.client.1.smithi176.stdout:9/588: truncate d1/df/d48/d69/d76/fae 132313 0 2024-09-21T12:47:00.600 INFO:tasks.workunit.client.1.smithi176.stdout:8/591: unlink d6/db/ld 0 2024-09-21T12:47:00.601 INFO:tasks.workunit.client.1.smithi176.stdout:3/692: rmdir d1/d34/d42/d5b 39 2024-09-21T12:47:00.608 INFO:tasks.workunit.client.1.smithi176.stdout:1/640: dwrite d0/db/f1f [0,4194304] 0 2024-09-21T12:47:00.608 INFO:tasks.workunit.client.0.smithi046.stdout:3/126: rmdir d5 39 2024-09-21T12:47:00.609 INFO:tasks.workunit.client.1.smithi176.stdout:1/641: stat d0/db/d1a/fb7 0 2024-09-21T12:47:00.611 INFO:tasks.workunit.client.0.smithi046.stdout:9/113: mknod d11/d19/d20/c21 0 2024-09-21T12:47:00.613 INFO:tasks.workunit.client.0.smithi046.stdout:7/56: mknod d2/c11 0 2024-09-21T12:47:00.614 INFO:tasks.workunit.client.1.smithi176.stdout:5/525: dread d0/f64 [0,4194304] 0 2024-09-21T12:47:00.614 INFO:tasks.workunit.client.1.smithi176.stdout:2/626: truncate d4/f7f 5739178 0 2024-09-21T12:47:00.617 INFO:tasks.workunit.client.1.smithi176.stdout:9/589: creat d1/d61/d73/d7d/fcb x:0 0 0 2024-09-21T12:47:00.617 INFO:tasks.workunit.client.1.smithi176.stdout:8/592: dread d6/db/d32/fa9 [0,4194304] 0 2024-09-21T12:47:00.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/117: getdents d4 0 2024-09-21T12:47:00.619 INFO:tasks.workunit.client.0.smithi046.stdout:8/130: fdatasync d1/f1f 0 2024-09-21T12:47:00.620 INFO:tasks.workunit.client.1.smithi176.stdout:3/693: chown d1/d5/d25/d61/fe1 10929413 1 2024-09-21T12:47:00.620 INFO:tasks.workunit.client.0.smithi046.stdout:1/118: write d4/d13/f23 [160906,8326] 0 2024-09-21T12:47:00.624 INFO:tasks.workunit.client.0.smithi046.stdout:8/131: dread d1/f10 [0,4194304] 0 2024-09-21T12:47:00.624 INFO:tasks.workunit.client.0.smithi046.stdout:7/57: dwrite d2/d4/df/f10 [0,4194304] 0 2024-09-21T12:47:00.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/58: chown d2/f9 173 1 2024-09-21T12:47:00.626 INFO:tasks.workunit.client.0.smithi046.stdout:8/132: dread d1/f10 [0,4194304] 0 2024-09-21T12:47:00.627 INFO:tasks.workunit.client.0.smithi046.stdout:8/133: readlink d1/d24/l27 0 2024-09-21T12:47:00.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/119: symlink d4/d13/l33 0 2024-09-21T12:47:00.635 INFO:tasks.workunit.client.1.smithi176.stdout:5/526: mknod d0/d13/d5d/d98/c9c 0 2024-09-21T12:47:00.637 INFO:tasks.workunit.client.0.smithi046.stdout:8/134: creat d1/d24/f30 x:0 0 0 2024-09-21T12:47:00.638 INFO:tasks.workunit.client.0.smithi046.stdout:6/62: dwrite f5 [0,4194304] 0 2024-09-21T12:47:00.639 INFO:tasks.workunit.client.1.smithi176.stdout:9/590: mknod d1/df/d23/d67/ccc 0 2024-09-21T12:47:00.643 INFO:tasks.workunit.client.0.smithi046.stdout:2/106: dwrite f11 [0,4194304] 0 2024-09-21T12:47:00.645 INFO:tasks.workunit.client.1.smithi176.stdout:3/694: dread d1/d35/fbd [0,4194304] 0 2024-09-21T12:47:00.646 INFO:tasks.workunit.client.1.smithi176.stdout:7/717: sync 2024-09-21T12:47:00.647 INFO:tasks.workunit.client.1.smithi176.stdout:9/591: dwrite d1/d61/d73/d7d/fcb [0,4194304] 0 2024-09-21T12:47:00.651 INFO:tasks.workunit.client.0.smithi046.stdout:1/120: truncate d4/d13/f21 157109 0 2024-09-21T12:47:00.651 INFO:tasks.workunit.client.1.smithi176.stdout:4/606: rename d3/d42/d56/d4e/f7b to d3/fd1 0 2024-09-21T12:47:00.652 INFO:tasks.workunit.client.0.smithi046.stdout:2/107: dwrite f11 [0,4194304] 0 2024-09-21T12:47:00.654 INFO:tasks.workunit.client.1.smithi176.stdout:1/642: mkdir d0/dec 0 2024-09-21T12:47:00.655 INFO:tasks.workunit.client.0.smithi046.stdout:8/135: rename d1/fb to d1/d24/f31 0 2024-09-21T12:47:00.658 INFO:tasks.workunit.client.1.smithi176.stdout:4/607: dread d3/d5/f4a [4194304,4194304] 0 2024-09-21T12:47:00.658 INFO:tasks.workunit.client.0.smithi046.stdout:5/105: link d4/l11 d4/d16/l1e 0 2024-09-21T12:47:00.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/121: dwrite d4/f2c [0,4194304] 0 2024-09-21T12:47:00.663 INFO:tasks.workunit.client.0.smithi046.stdout:7/59: link d2/f9 d2/f12 0 2024-09-21T12:47:00.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/122: write d4/d13/f14 [5662495,88893] 0 2024-09-21T12:47:00.670 INFO:tasks.workunit.client.0.smithi046.stdout:2/108: symlink d16/l23 0 2024-09-21T12:47:00.672 INFO:tasks.workunit.client.0.smithi046.stdout:6/63: rename ld to de/lf 0 2024-09-21T12:47:00.672 INFO:tasks.workunit.client.0.smithi046.stdout:2/109: write f13 [2073077,115107] 0 2024-09-21T12:47:00.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/136: symlink d1/d12/l32 0 2024-09-21T12:47:00.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/110: stat d16/l23 0 2024-09-21T12:47:00.673 INFO:tasks.workunit.client.0.smithi046.stdout:2/111: stat fa 0 2024-09-21T12:47:00.676 INFO:tasks.workunit.client.0.smithi046.stdout:5/106: chown d4/d16/l1e 2096586 1 2024-09-21T12:47:00.679 INFO:tasks.workunit.client.1.smithi176.stdout:7/718: creat d0/d2/db/d10/d23/d85/f104 x:0 0 0 2024-09-21T12:47:00.679 INFO:tasks.workunit.client.0.smithi046.stdout:2/112: dread f13 [0,4194304] 0 2024-09-21T12:47:00.681 INFO:tasks.workunit.client.1.smithi176.stdout:6/558: sync 2024-09-21T12:47:00.684 INFO:tasks.workunit.client.0.smithi046.stdout:6/64: dread f9 [0,4194304] 0 2024-09-21T12:47:00.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/137: mkdir d1/d12/d1a/d33 0 2024-09-21T12:47:00.687 INFO:tasks.workunit.client.0.smithi046.stdout:5/107: symlink d4/d9/l1f 0 2024-09-21T12:47:00.693 INFO:tasks.workunit.client.0.smithi046.stdout:2/113: symlink d16/l24 0 2024-09-21T12:47:00.696 INFO:tasks.workunit.client.0.smithi046.stdout:5/108: dwrite d4/d9/d10/d1a/f1c [0,4194304] 0 2024-09-21T12:47:00.697 INFO:tasks.workunit.client.1.smithi176.stdout:8/593: truncate d6/f90 3945036 0 2024-09-21T12:47:00.698 INFO:tasks.workunit.client.1.smithi176.stdout:1/643: dread d0/db/d1a/d2c/dc5/d2b/d43/f54 [0,4194304] 0 2024-09-21T12:47:00.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/114: dread f15 [0,4194304] 0 2024-09-21T12:47:00.699 INFO:tasks.workunit.client.0.smithi046.stdout:6/65: mknod de/c10 0 2024-09-21T12:47:00.700 INFO:tasks.workunit.client.0.smithi046.stdout:2/115: truncate d16/f1d 176022 0 2024-09-21T12:47:00.700 INFO:tasks.workunit.client.0.smithi046.stdout:6/66: write fa [1085770,89569] 0 2024-09-21T12:47:00.701 INFO:tasks.workunit.client.1.smithi176.stdout:3/695: creat d1/d34/d42/d5b/f101 x:0 0 0 2024-09-21T12:47:00.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/138: rename d1/d24/c2e to d1/d12/d1a/d2f/c34 0 2024-09-21T12:47:00.706 INFO:tasks.workunit.client.1.smithi176.stdout:7/719: unlink d0/d2/f35 0 2024-09-21T12:47:00.713 INFO:tasks.workunit.client.1.smithi176.stdout:2/627: getdents d4/d63 0 2024-09-21T12:47:00.713 INFO:tasks.workunit.client.1.smithi176.stdout:8/594: dread d6/db/d37/d89/f8d [0,4194304] 0 2024-09-21T12:47:00.714 INFO:tasks.workunit.client.1.smithi176.stdout:5/527: truncate d0/d13/d63/f51 4062889 0 2024-09-21T12:47:00.715 INFO:tasks.workunit.client.0.smithi046.stdout:5/109: read d4/f8 [706048,106983] 0 2024-09-21T12:47:00.716 INFO:tasks.workunit.client.0.smithi046.stdout:5/110: write d4/d9/d10/d1a/f1c [3731449,30683] 0 2024-09-21T12:47:00.723 INFO:tasks.workunit.client.1.smithi176.stdout:3/696: rename d1/d5/d25/d84/ff3 to d1/d5/d25/d84/f102 0 2024-09-21T12:47:00.723 INFO:tasks.workunit.client.0.smithi046.stdout:5/111: dwrite d4/d16/f1b [0,4194304] 0 2024-09-21T12:47:00.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.722+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc6f0062630 con 0x7fc6d8074a20 2024-09-21T12:47:00.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.724+0000 7fc6ed7fa640 1 -- 172.21.15.46:0/972658 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fc6f0062630 con 0x7fc6d8074a20 2024-09-21T12:47:00.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/116: rename f0 to d16/f25 0 2024-09-21T12:47:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc6d8074a20 msgr2=0x7fc6d8076ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc6d8074a20 0x7fc6d8076ee0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc6e00058c0 tx=0x7fc6e0005850 comp rx=0 tx=0).stop 2024-09-21T12:47:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 msgr2=0x7fc6f0075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0075f20 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc6e4009230 tx=0x7fc6e40045e0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 shutdown_connections 2024-09-21T12:47:00.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc6d8074a20 0x7fc6d8076ee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc6f0102b60 0x7fc6f00745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 --2- 172.21.15.46:0/972658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc6f0101960 0x7fc6f0075f20 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 >> 172.21.15.46:0/972658 conn(0x7fc6f00fd0d0 msgr2=0x7fc6f0106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 shutdown_connections 2024-09-21T12:47:00.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.728+0000 7fc6f67b8640 1 -- 172.21.15.46:0/972658 wait complete. 2024-09-21T12:47:00.731 INFO:tasks.workunit.client.0.smithi046.stdout:8/139: mkdir d1/d12/d1a/d2f/d35 0 2024-09-21T12:47:00.731 INFO:tasks.workunit.client.1.smithi176.stdout:0/751: rename d9/d1b to d9/d1a/d3f/d10d 0 2024-09-21T12:47:00.731 INFO:tasks.workunit.client.1.smithi176.stdout:0/752: write d9/d1a/d1d/d23/da1/fca [861409,116083] 0 2024-09-21T12:47:00.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/123: getdents d4/d13 0 2024-09-21T12:47:00.737 INFO:tasks.workunit.client.1.smithi176.stdout:8/595: write d6/d8/f10 [5044962,7376] 0 2024-09-21T12:47:00.737 INFO:tasks.workunit.client.0.smithi046.stdout:6/67: write f9 [2705156,51070] 0 2024-09-21T12:47:00.740 INFO:tasks.workunit.client.1.smithi176.stdout:5/528: creat d0/d13/d63/d2e/d39/d41/f9d x:0 0 0 2024-09-21T12:47:00.743 INFO:tasks.workunit.client.1.smithi176.stdout:4/608: creat d3/d5/db/fd2 x:0 0 0 2024-09-21T12:47:00.746 INFO:tasks.workunit.client.1.smithi176.stdout:1/644: mkdir d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/ded 0 2024-09-21T12:47:00.747 INFO:tasks.workunit.client.1.smithi176.stdout:0/753: dread d9/f16 [0,4194304] 0 2024-09-21T12:47:00.747 INFO:tasks.workunit.client.0.smithi046.stdout:2/117: rename l6 to d16/d22/l26 0 2024-09-21T12:47:00.748 INFO:tasks.workunit.client.1.smithi176.stdout:0/754: read d9/f16 [1769582,102070] 0 2024-09-21T12:47:00.748 INFO:tasks.workunit.client.1.smithi176.stdout:0/755: chown d9/d1a/d1d/d23/c69 2136082367 1 2024-09-21T12:47:00.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/118: write d16/f1d [328356,93316] 0 2024-09-21T12:47:00.752 INFO:tasks.workunit.client.0.smithi046.stdout:1/124: chown d4/c2a 8 1 2024-09-21T12:47:00.753 INFO:tasks.workunit.client.0.smithi046.stdout:6/68: mknod de/c11 0 2024-09-21T12:47:00.754 INFO:tasks.workunit.client.0.smithi046.stdout:6/69: chown f9 119 1 2024-09-21T12:47:00.756 INFO:tasks.workunit.client.0.smithi046.stdout:6/70: write f9 [1480547,15384] 0 2024-09-21T12:47:00.758 INFO:tasks.workunit.client.0.smithi046.stdout:2/119: dwrite d16/f1a [0,4194304] 0 2024-09-21T12:47:00.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/140: mkdir d1/d12/d1a/d2f/d35/d36 0 2024-09-21T12:47:00.761 INFO:tasks.workunit.client.0.smithi046.stdout:1/125: symlink d4/d13/l34 0 2024-09-21T12:47:00.767 INFO:tasks.workunit.client.0.smithi046.stdout:5/112: link d4/d9/d10/l1d d4/d9/d10/l20 0 2024-09-21T12:47:00.770 INFO:tasks.workunit.client.1.smithi176.stdout:9/592: rename d1/df/d23/l6a to d1/df/d48/d69/d38/lcd 0 2024-09-21T12:47:00.770 INFO:tasks.workunit.client.1.smithi176.stdout:0/756: dwrite d9/d1a/d1d/d23/da1/da3/f97 [0,4194304] 0 2024-09-21T12:47:00.771 INFO:tasks.workunit.client.1.smithi176.stdout:2/628: dwrite d4/f1a [0,4194304] 0 2024-09-21T12:47:00.772 INFO:tasks.workunit.client.0.smithi046.stdout:6/71: rename de/c11 to de/c12 0 2024-09-21T12:47:00.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/72: readlink l4 0 2024-09-21T12:47:00.773 INFO:tasks.workunit.client.1.smithi176.stdout:2/629: chown d4/df/d4b/fae 512908220 1 2024-09-21T12:47:00.777 INFO:tasks.workunit.client.0.smithi046.stdout:8/141: rename d1/f10 to d1/d12/d1a/d2f/f37 0 2024-09-21T12:47:00.778 INFO:tasks.workunit.client.0.smithi046.stdout:8/142: readlink d1/d12/l23 0 2024-09-21T12:47:00.779 INFO:tasks.workunit.client.0.smithi046.stdout:0/66: sync 2024-09-21T12:47:00.780 INFO:tasks.workunit.client.1.smithi176.stdout:2/630: dwrite d4/df/d2e/d6f/d5d/f8d [4194304,4194304] 0 2024-09-21T12:47:00.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/113: mknod d4/d9/c21 0 2024-09-21T12:47:00.780 INFO:tasks.workunit.client.1.smithi176.stdout:2/631: chown d4/d3d/d65 37765 1 2024-09-21T12:47:00.781 INFO:tasks.workunit.client.1.smithi176.stdout:2/632: chown d4/df/d2e/d6f/f3e 117315 1 2024-09-21T12:47:00.781 INFO:tasks.workunit.client.0.smithi046.stdout:5/114: fdatasync d4/d9/d10/d1a/f1c 0 2024-09-21T12:47:00.782 INFO:tasks.workunit.client.1.smithi176.stdout:5/529: mknod d0/d13/d63/d2e/d39/c9e 0 2024-09-21T12:47:00.783 INFO:tasks.workunit.client.1.smithi176.stdout:2/633: write d4/df/d83/d8e/faf [2658164,46076] 0 2024-09-21T12:47:00.783 INFO:tasks.workunit.client.1.smithi176.stdout:3/697: write d1/d34/d57/dd0/d7d/ff4 [3226984,66844] 0 2024-09-21T12:47:00.784 INFO:tasks.workunit.client.1.smithi176.stdout:5/530: truncate d0/d10/d70/f8b 306561 0 2024-09-21T12:47:00.785 INFO:tasks.workunit.client.1.smithi176.stdout:2/634: write d4/d3d/d65/fad [500512,47426] 0 2024-09-21T12:47:00.787 INFO:tasks.workunit.client.1.smithi176.stdout:5/531: write d0/d10/d70/f8b [774688,52177] 0 2024-09-21T12:47:00.787 INFO:tasks.workunit.client.0.smithi046.stdout:6/73: creat de/f13 x:0 0 0 2024-09-21T12:47:00.788 INFO:tasks.workunit.client.0.smithi046.stdout:1/126: rename d4/c25 to d4/d29/c35 0 2024-09-21T12:47:00.788 INFO:tasks.workunit.client.0.smithi046.stdout:6/74: truncate de/f13 1002238 0 2024-09-21T12:47:00.789 INFO:tasks.workunit.client.0.smithi046.stdout:1/127: chown d4/c17 1683776 1 2024-09-21T12:47:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 -- 172.21.15.46:0/4110590955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 msgr2=0x7f1abc103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/4110590955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc103140 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009880 tx=0x7f1aac02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 -- 172.21.15.46:0/4110590955 shutdown_connections 2024-09-21T12:47:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/4110590955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc103140 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/4110590955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc0ffc40 0x7f1abc100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 -- 172.21.15.46:0/4110590955 >> 172.21.15.46:0/4110590955 conn(0x7f1abc0fb770 msgr2=0x7f1abc0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 -- 172.21.15.46:0/4110590955 shutdown_connections 2024-09-21T12:47:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.848+0000 7f1ac3e39640 1 -- 172.21.15.46:0/4110590955 wait complete. 2024-09-21T12:47:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac3e39640 1 Processor -- start 2024-09-21T12:47:00.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac3e39640 1 -- start start 2024-09-21T12:47:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac3e39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc0ffc40 0x7f1abc1025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac3e39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac3e39640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10a780 con 0x7f1abc102cc0 2024-09-21T12:47:00.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac3e39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1abc10a600 con 0x7f1abc0ffc40 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac13d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.849+0000 7f1ac13d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49082/0 (socket says 172.21.15.46:49082) 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac13d4640 1 -- 172.21.15.46:0/1927367574 learned_addr learned my addr 172.21.15.46:0/1927367574 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac1bd5640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc0ffc40 0x7f1abc1025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac13d4640 1 -- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc0ffc40 msgr2=0x7f1abc1025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac13d4640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc0ffc40 0x7f1abc1025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac13d4640 1 -- 172.21.15.46:0/1927367574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1abc1011b0 con 0x7f1abc102cc0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac13d4640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc100c70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1aac006010 tx=0x7f1aac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1aac03f070 con 0x7f1abc102cc0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1aac0044d0 con 0x7f1abc102cc0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1aac035030 con 0x7f1abc102cc0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1abc101440 con 0x7f1abc102cc0 2024-09-21T12:47:00.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.850+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1abc101970 con 0x7f1abc102cc0 2024-09-21T12:47:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.852+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1abc10af60 con 0x7f1abc102cc0 2024-09-21T12:47:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.852+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f1aac042070 con 0x7f1abc102cc0 2024-09-21T12:47:00.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.853+0000 7f1ab2ffd640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f1aa8074a30 0x7f1aa8076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.853+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f1aac0b7050 con 0x7f1abc102cc0 2024-09-21T12:47:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.853+0000 7f1ac1bd5640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f1aa8074a30 0x7f1aa8076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:00.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.854+0000 7f1ac1bd5640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f1aa8074a30 0x7f1aa8076ef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1abc069ef0 tx=0x7f1ab8005f90 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:00.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:00.857+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1aac082580 con 0x7f1abc102cc0 2024-09-21T12:47:00.891 INFO:tasks.workunit.client.1.smithi176.stdout:7/720: rename d0/d2/d30/d7b to d0/d2/db/d10/d23/da6/d105 0 2024-09-21T12:47:00.891 INFO:tasks.workunit.client.1.smithi176.stdout:7/721: chown d0/d2/db/d10/d23 228 1 2024-09-21T12:47:00.892 INFO:tasks.workunit.client.0.smithi046.stdout:0/67: rmdir d6 39 2024-09-21T12:47:00.894 INFO:tasks.workunit.client.1.smithi176.stdout:9/593: unlink d1/df/d48/c98 0 2024-09-21T12:47:00.896 INFO:tasks.workunit.client.1.smithi176.stdout:6/559: link d2/dd/d26/d2b/d10/f12 d2/d63/fb1 0 2024-09-21T12:47:00.897 INFO:tasks.workunit.client.0.smithi046.stdout:5/115: fdatasync d4/f8 0 2024-09-21T12:47:00.900 INFO:tasks.workunit.client.0.smithi046.stdout:4/137: sync 2024-09-21T12:47:00.900 INFO:tasks.workunit.client.0.smithi046.stdout:8/143: creat d1/d12/d1a/d33/f38 x:0 0 0 2024-09-21T12:47:00.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/75: unlink cc 0 2024-09-21T12:47:00.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/76: chown fa 0 1 2024-09-21T12:47:00.909 INFO:tasks.workunit.client.1.smithi176.stdout:2/635: rmdir d4/d3d/d65 39 2024-09-21T12:47:00.911 INFO:tasks.workunit.client.1.smithi176.stdout:5/532: mknod d0/d13/d63/d66/c9f 0 2024-09-21T12:47:00.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/68: dwrite d6/d7/fa [4194304,4194304] 0 2024-09-21T12:47:00.912 INFO:tasks.workunit.client.0.smithi046.stdout:4/138: mknod d1/d13/c2b 0 2024-09-21T12:47:00.914 INFO:tasks.workunit.client.0.smithi046.stdout:0/69: write d6/d7/f12 [4635396,25689] 0 2024-09-21T12:47:00.915 INFO:tasks.workunit.client.1.smithi176.stdout:8/596: rename d6/db/d37/l45 to d6/d16/d36/d7d/d81/lbc 0 2024-09-21T12:47:00.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/139: dread d1/fd [0,4194304] 0 2024-09-21T12:47:00.916 INFO:tasks.workunit.client.1.smithi176.stdout:8/597: stat d6/d16/d36/d7d/d81/fa4 0 2024-09-21T12:47:00.916 INFO:tasks.workunit.client.1.smithi176.stdout:8/598: dread - d6/db/d13/d98/f9e zero size 2024-09-21T12:47:00.917 INFO:tasks.workunit.client.0.smithi046.stdout:8/144: creat d1/d12/f39 x:0 0 0 2024-09-21T12:47:00.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/128: getdents d4/d29/d32 0 2024-09-21T12:47:00.919 INFO:tasks.workunit.client.0.smithi046.stdout:6/77: chown de/c12 3842 1 2024-09-21T12:47:00.920 INFO:tasks.workunit.client.1.smithi176.stdout:1/645: getdents d0/db/d1a/d2c/d6b 0 2024-09-21T12:47:00.921 INFO:tasks.workunit.client.1.smithi176.stdout:5/533: dread d0/d13/f3c [0,4194304] 0 2024-09-21T12:47:00.922 INFO:tasks.workunit.client.0.smithi046.stdout:1/129: write d4/f26 [338440,125472] 0 2024-09-21T12:47:00.925 INFO:tasks.workunit.client.1.smithi176.stdout:1/646: dread d0/db/f15 [0,4194304] 0 2024-09-21T12:47:00.930 INFO:tasks.workunit.client.1.smithi176.stdout:4/609: rename d3/d5/db/l23 to d3/d5/db/d96/da3/ld3 0 2024-09-21T12:47:00.933 INFO:tasks.workunit.client.1.smithi176.stdout:7/722: dwrite d0/d5d/d8a/fe5 [0,4194304] 0 2024-09-21T12:47:00.933 INFO:tasks.workunit.client.1.smithi176.stdout:9/594: truncate d1/df/f41 2962586 0 2024-09-21T12:47:00.934 INFO:tasks.workunit.client.0.smithi046.stdout:6/78: rmdir de 39 2024-09-21T12:47:00.934 INFO:tasks.workunit.client.1.smithi176.stdout:5/534: symlink d0/d10/d70/la0 0 2024-09-21T12:47:00.936 INFO:tasks.workunit.client.1.smithi176.stdout:6/560: truncate d2/d63/f53 2047669 0 2024-09-21T12:47:00.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/130: rmdir d4 39 2024-09-21T12:47:00.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/116: rename d4/d9 to d4/d22 0 2024-09-21T12:47:00.939 INFO:tasks.workunit.client.0.smithi046.stdout:4/140: symlink d1/d27/l2c 0 2024-09-21T12:47:00.942 INFO:tasks.workunit.client.1.smithi176.stdout:0/757: rename d9/d1a/d1d/d81/d8e to d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2/d10e 0 2024-09-21T12:47:00.942 INFO:tasks.workunit.client.1.smithi176.stdout:9/595: dread d1/d61/d73/d7d/fcb [0,4194304] 0 2024-09-21T12:47:00.943 INFO:tasks.workunit.client.1.smithi176.stdout:7/723: dwrite d0/d2/db/d10/d31/fd4 [0,4194304] 0 2024-09-21T12:47:00.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/79: write de/f13 [1997958,19249] 0 2024-09-21T12:47:00.944 INFO:tasks.workunit.client.1.smithi176.stdout:0/758: chown d9/d1a/d1d/d23/f44 201877 1 2024-09-21T12:47:00.945 INFO:tasks.workunit.client.1.smithi176.stdout:7/724: read - d0/d2/db/d10/d72/d7e/dba/fcc zero size 2024-09-21T12:47:00.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/70: link l2 d6/d7/d9/l19 0 2024-09-21T12:47:00.946 INFO:tasks.workunit.client.1.smithi176.stdout:8/599: dread d6/db/d37/f3a [0,4194304] 0 2024-09-21T12:47:00.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/71: stat d6/d7 0 2024-09-21T12:47:00.947 INFO:tasks.workunit.client.0.smithi046.stdout:5/117: rename d4/f7 to d4/dc/d13/f23 0 2024-09-21T12:47:00.949 INFO:tasks.workunit.client.0.smithi046.stdout:5/118: write d4/d22/d10/d1a/f1c [3099161,68285] 0 2024-09-21T12:47:00.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/119: write d4/d22/d10/d1a/f1c [1517835,25557] 0 2024-09-21T12:47:00.952 INFO:tasks.workunit.client.1.smithi176.stdout:3/698: getdents d1/d34/d5d 0 2024-09-21T12:47:00.953 INFO:tasks.workunit.client.1.smithi176.stdout:3/699: fsync d1/da/fb2 0 2024-09-21T12:47:00.955 INFO:tasks.workunit.client.1.smithi176.stdout:6/561: write d2/f20 [1290970,99348] 0 2024-09-21T12:47:00.959 INFO:tasks.workunit.client.0.smithi046.stdout:6/80: symlink de/l14 0 2024-09-21T12:47:00.962 INFO:tasks.workunit.client.0.smithi046.stdout:1/131: rename d4/d13/f21 to d4/d13/f36 0 2024-09-21T12:47:00.966 INFO:tasks.workunit.client.0.smithi046.stdout:0/72: rename d6/d7/d9/dd/f15 to d6/f1a 0 2024-09-21T12:47:00.969 INFO:tasks.workunit.client.0.smithi046.stdout:4/141: write d1/fd [1727125,44460] 0 2024-09-21T12:47:00.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/145: getdents d1/d12 0 2024-09-21T12:47:00.972 INFO:tasks.workunit.client.0.smithi046.stdout:8/146: chown d1/d12/l23 314009861 1 2024-09-21T12:47:00.973 INFO:tasks.workunit.client.1.smithi176.stdout:4/610: creat d3/d21/d97/fd4 x:0 0 0 2024-09-21T12:47:00.974 INFO:tasks.workunit.client.1.smithi176.stdout:1/647: truncate d0/db/d1a/d2c/f79 1766954 0 2024-09-21T12:47:00.976 INFO:tasks.workunit.client.1.smithi176.stdout:0/759: symlink d9/d1a/d1d/d22/l10f 0 2024-09-21T12:47:00.977 INFO:tasks.workunit.client.0.smithi046.stdout:6/81: creat de/f15 x:0 0 0 2024-09-21T12:47:00.981 INFO:tasks.workunit.client.1.smithi176.stdout:8/600: unlink d6/d8/d24/d5e/f8b 0 2024-09-21T12:47:00.983 INFO:tasks.workunit.client.1.smithi176.stdout:9/596: write d1/f66 [1856272,104295] 0 2024-09-21T12:47:00.983 INFO:tasks.workunit.client.1.smithi176.stdout:9/597: dread - d1/d61/d73/fb9 zero size 2024-09-21T12:47:00.984 INFO:tasks.workunit.client.1.smithi176.stdout:9/598: fdatasync d1/d61/d73/f7f 0 2024-09-21T12:47:00.985 INFO:tasks.workunit.client.0.smithi046.stdout:6/82: dwrite f3 [0,4194304] 0 2024-09-21T12:47:00.987 INFO:tasks.workunit.client.1.smithi176.stdout:3/700: creat d1/d8d/f103 x:0 0 0 2024-09-21T12:47:00.988 INFO:tasks.workunit.client.1.smithi176.stdout:6/562: rmdir d2/d5d 39 2024-09-21T12:47:00.988 INFO:tasks.workunit.client.1.smithi176.stdout:3/701: write d1/fd8 [746627,53372] 0 2024-09-21T12:47:00.989 INFO:tasks.workunit.client.1.smithi176.stdout:6/563: write d2/dd/d26/d2b/d10/d1b/fa2 [706157,34084] 0 2024-09-21T12:47:00.993 INFO:tasks.workunit.client.0.smithi046.stdout:0/73: dwrite d6/f1a [0,4194304] 0 2024-09-21T12:47:00.996 INFO:tasks.workunit.client.0.smithi046.stdout:0/74: write d6/f1a [1768070,22702] 0 2024-09-21T12:47:00.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/83: dwrite de/f13 [0,4194304] 0 2024-09-21T12:47:01.000 INFO:tasks.workunit.client.0.smithi046.stdout:6/84: write f3 [3466981,13693] 0 2024-09-21T12:47:01.002 INFO:tasks.workunit.client.0.smithi046.stdout:5/120: truncate d4/d22/d10/d1a/f1c 3453999 0 2024-09-21T12:47:01.002 INFO:tasks.workunit.client.0.smithi046.stdout:5/121: chown d4/d16 58 1 2024-09-21T12:47:01.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/75: rmdir d6/d7/d9 39 2024-09-21T12:47:01.008 INFO:tasks.workunit.client.1.smithi176.stdout:4/611: creat d3/d42/d47/fd5 x:0 0 0 2024-09-21T12:47:01.010 INFO:tasks.workunit.client.1.smithi176.stdout:0/760: mknod d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d78/c110 0 2024-09-21T12:47:01.011 INFO:tasks.workunit.client.0.smithi046.stdout:6/85: rmdir de 39 2024-09-21T12:47:01.014 INFO:tasks.workunit.client.0.smithi046.stdout:0/76: dwrite d6/f1a [0,4194304] 0 2024-09-21T12:47:01.015 INFO:tasks.workunit.client.1.smithi176.stdout:8/601: fdatasync d6/db/d37/d89/f8d 0 2024-09-21T12:47:01.017 INFO:tasks.workunit.client.0.smithi046.stdout:8/147: dwrite d1/f6 [0,4194304] 0 2024-09-21T12:47:01.021 INFO:tasks.workunit.client.0.smithi046.stdout:6/86: dread - de/f15 zero size 2024-09-21T12:47:01.022 INFO:tasks.workunit.client.0.smithi046.stdout:6/87: chown fb 60 1 2024-09-21T12:47:01.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/77: symlink d6/l1b 0 2024-09-21T12:47:01.025 INFO:tasks.workunit.client.1.smithi176.stdout:3/702: read d1/d5/d25/d38/f3f [3129190,42693] 0 2024-09-21T12:47:01.026 INFO:tasks.workunit.client.1.smithi176.stdout:6/564: creat d2/dd/d26/d2b/d68/fb2 x:0 0 0 2024-09-21T12:47:01.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/148: unlink d1/c9 0 2024-09-21T12:47:01.028 INFO:tasks.workunit.client.1.smithi176.stdout:6/565: fdatasync d2/dd/d26/d2b/d10/d1b/fa2 0 2024-09-21T12:47:01.030 INFO:tasks.workunit.client.1.smithi176.stdout:2/636: rename d4/d3d/d65/d9b/fb6 to d4/df/fc1 0 2024-09-21T12:47:01.031 INFO:tasks.workunit.client.1.smithi176.stdout:4/612: mkdir d3/d5/dc5/dd6 0 2024-09-21T12:47:01.031 INFO:tasks.workunit.client.1.smithi176.stdout:2/637: read - d4/df/d2e/d4d/fba zero size 2024-09-21T12:47:01.033 INFO:tasks.workunit.client.0.smithi046.stdout:8/149: mknod d1/d12/d1a/c3a 0 2024-09-21T12:47:01.034 INFO:tasks.workunit.client.1.smithi176.stdout:8/602: chown d6/db/d37/d89/d8a/da6/laf 4766667 1 2024-09-21T12:47:01.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/88: link de/f13 de/f16 0 2024-09-21T12:47:01.035 INFO:tasks.workunit.client.0.smithi046.stdout:0/78: stat d6/d7/d9/l19 0 2024-09-21T12:47:01.036 INFO:tasks.workunit.client.1.smithi176.stdout:9/599: mkdir d1/df/d48/dce 0 2024-09-21T12:47:01.037 INFO:tasks.workunit.client.1.smithi176.stdout:9/600: write d1/df/f12 [2846235,28451] 0 2024-09-21T12:47:01.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/150: creat d1/d12/f3b x:0 0 0 2024-09-21T12:47:01.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/151: read - d1/d24/f30 zero size 2024-09-21T12:47:01.039 INFO:tasks.workunit.client.0.smithi046.stdout:6/89: dread fb [0,4194304] 0 2024-09-21T12:47:01.041 INFO:tasks.workunit.client.1.smithi176.stdout:3/703: symlink d1/d9e/db4/l104 0 2024-09-21T12:47:01.044 INFO:tasks.workunit.client.0.smithi046.stdout:6/90: creat de/f17 x:0 0 0 2024-09-21T12:47:01.044 INFO:tasks.workunit.client.1.smithi176.stdout:5/535: link d0/d13/d63/d66/l82 d0/d10/la1 0 2024-09-21T12:47:01.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/79: fsync d6/f1a 0 2024-09-21T12:47:01.046 INFO:tasks.workunit.client.0.smithi046.stdout:8/152: creat d1/d12/d1a/d2f/d35/f3c x:0 0 0 2024-09-21T12:47:01.047 INFO:tasks.workunit.client.0.smithi046.stdout:0/80: write d6/d7/d9/fb [7856894,24946] 0 2024-09-21T12:47:01.052 INFO:tasks.workunit.client.1.smithi176.stdout:1/648: rename d0/db/c33 to d0/db/d1a/d2c/d37/cee 0 2024-09-21T12:47:01.054 INFO:tasks.workunit.client.0.smithi046.stdout:6/91: dwrite de/f16 [0,4194304] 0 2024-09-21T12:47:01.055 INFO:tasks.workunit.client.1.smithi176.stdout:4/613: symlink d3/d5/db/d96/ld7 0 2024-09-21T12:47:01.057 INFO:tasks.workunit.client.1.smithi176.stdout:1/649: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:47:01.057 INFO:tasks.workunit.client.0.smithi046.stdout:8/153: creat d1/d12/d1a/d2f/f3d x:0 0 0 2024-09-21T12:47:01.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/81: rmdir d6 39 2024-09-21T12:47:01.060 INFO:tasks.workunit.client.1.smithi176.stdout:1/650: write d0/db/d1a/d2c/d66/fbc [496388,51275] 0 2024-09-21T12:47:01.060 INFO:tasks.workunit.client.1.smithi176.stdout:7/725: getdents d0/d2/db/d10/d23/da6 0 2024-09-21T12:47:01.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/92: readlink de/lf 0 2024-09-21T12:47:01.069 INFO:tasks.workunit.client.0.smithi046.stdout:6/93: creat de/f18 x:0 0 0 2024-09-21T12:47:01.072 INFO:tasks.workunit.client.0.smithi046.stdout:8/154: rename d1/d12/d1a/c1e to d1/d24/c3e 0 2024-09-21T12:47:01.073 INFO:tasks.workunit.client.0.smithi046.stdout:6/94: dread f3 [0,4194304] 0 2024-09-21T12:47:01.074 INFO:tasks.workunit.client.1.smithi176.stdout:6/566: creat d2/d6f/d81/fb3 x:0 0 0 2024-09-21T12:47:01.075 INFO:tasks.workunit.client.1.smithi176.stdout:6/567: dread - d2/dd/d26/d2b/fa1 zero size 2024-09-21T12:47:01.078 INFO:tasks.workunit.client.0.smithi046.stdout:0/82: mkdir d6/d7/d1c 0 2024-09-21T12:47:01.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/122: dread d4/d22/d10/d1a/f1c [0,4194304] 0 2024-09-21T12:47:01.081 INFO:tasks.workunit.client.0.smithi046.stdout:8/155: mknod d1/d12/d1a/d2f/c3f 0 2024-09-21T12:47:01.083 INFO:tasks.workunit.client.0.smithi046.stdout:8/156: write d1/fa [746849,106821] 0 2024-09-21T12:47:01.084 INFO:tasks.workunit.client.0.smithi046.stdout:6/95: fdatasync f9 0 2024-09-21T12:47:01.086 INFO:tasks.workunit.client.1.smithi176.stdout:8/603: dwrite d6/db/d32/f40 [0,4194304] 0 2024-09-21T12:47:01.086 INFO:tasks.workunit.client.1.smithi176.stdout:1/651: mkdir d0/db/d2a/def 0 2024-09-21T12:47:01.089 INFO:tasks.workunit.client.1.smithi176.stdout:7/726: mkdir d0/d2/db/d10/d3b/d106 0 2024-09-21T12:47:01.091 INFO:tasks.workunit.client.1.smithi176.stdout:9/601: dwrite d1/f7 [0,4194304] 0 2024-09-21T12:47:01.093 INFO:tasks.workunit.client.1.smithi176.stdout:6/568: dread d2/dd/d26/d2b/f7e [0,4194304] 0 2024-09-21T12:47:01.093 INFO:tasks.workunit.client.1.smithi176.stdout:9/602: write d1/d8b/fb1 [4180739,107886] 0 2024-09-21T12:47:01.094 INFO:tasks.workunit.client.1.smithi176.stdout:9/603: readlink d1/df/d48/d69/d40/d84/la7 0 2024-09-21T12:47:01.095 INFO:tasks.workunit.client.1.smithi176.stdout:5/536: getdents d0/d13/d63/d8d 0 2024-09-21T12:47:01.096 INFO:tasks.workunit.client.0.smithi046.stdout:6/96: mknod de/c19 0 2024-09-21T12:47:01.097 INFO:tasks.workunit.client.1.smithi176.stdout:0/761: link d9/dc2/l108 d9/d1a/d20/l111 0 2024-09-21T12:47:01.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/97: write de/f13 [4608693,42507] 0 2024-09-21T12:47:01.098 INFO:tasks.workunit.client.0.smithi046.stdout:6/98: dread - de/f17 zero size 2024-09-21T12:47:01.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/83: creat d6/d7/d13/f1d x:0 0 0 2024-09-21T12:47:01.100 INFO:tasks.workunit.client.1.smithi176.stdout:6/569: dwrite d2/dd/d26/d2b/fa5 [0,4194304] 0 2024-09-21T12:47:01.101 INFO:tasks.workunit.client.1.smithi176.stdout:4/614: link d3/d21/d5e/f74 d3/d5/db/d96/da3/fd8 0 2024-09-21T12:47:01.102 INFO:tasks.workunit.client.1.smithi176.stdout:8/604: rmdir d6/d16/d9c 39 2024-09-21T12:47:01.103 INFO:tasks.workunit.client.1.smithi176.stdout:1/652: write d0/db/d1a/d2c/d66/feb [2941507,73252] 0 2024-09-21T12:47:01.105 INFO:tasks.workunit.client.1.smithi176.stdout:7/727: mknod d0/d2/db/d10/d72/d7e/dba/c107 0 2024-09-21T12:47:01.105 INFO:tasks.workunit.client.0.smithi046.stdout:6/99: rmdir de 39 2024-09-21T12:47:01.107 INFO:tasks.workunit.client.1.smithi176.stdout:3/704: link d1/d35/f36 d1/d34/d48/deb/dc6/f105 0 2024-09-21T12:47:01.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/84: rmdir d6 39 2024-09-21T12:47:01.109 INFO:tasks.workunit.client.0.smithi046.stdout:5/123: creat d4/f24 x:0 0 0 2024-09-21T12:47:01.110 INFO:tasks.workunit.client.0.smithi046.stdout:6/100: dread fa [0,4194304] 0 2024-09-21T12:47:01.114 INFO:tasks.workunit.client.0.smithi046.stdout:8/157: getdents d1/d12 0 2024-09-21T12:47:01.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/158: write d1/d12/f13 [3254701,50962] 0 2024-09-21T12:47:01.116 INFO:tasks.workunit.client.1.smithi176.stdout:0/762: unlink d9/d1a/d1d/d23/d5f/f73 0 2024-09-21T12:47:01.118 INFO:tasks.workunit.client.1.smithi176.stdout:6/570: unlink d2/l9c 0 2024-09-21T12:47:01.118 INFO:tasks.workunit.client.1.smithi176.stdout:6/571: fdatasync d2/f64 0 2024-09-21T12:47:01.126 INFO:tasks.workunit.client.0.smithi046.stdout:6/101: dwrite de/f17 [0,4194304] 0 2024-09-21T12:47:01.129 INFO:tasks.workunit.client.1.smithi176.stdout:7/728: rmdir d0/d2/db/d10/d3b/d79 39 2024-09-21T12:47:01.131 INFO:tasks.workunit.client.0.smithi046.stdout:8/159: mknod d1/d12/d1a/c40 0 2024-09-21T12:47:01.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/160: truncate d1/d24/f29 5014545 0 2024-09-21T12:47:01.134 INFO:tasks.workunit.client.1.smithi176.stdout:3/705: rename d1/d5/d25/d61/f77 to d1/d34/d5d/d78/f106 0 2024-09-21T12:47:01.136 INFO:tasks.workunit.client.1.smithi176.stdout:3/706: write d1/d35/d5e/d90/fda [1053174,44978] 0 2024-09-21T12:47:01.138 INFO:tasks.workunit.client.1.smithi176.stdout:3/707: fdatasync d1/d35/d5e/d90/f9c 0 2024-09-21T12:47:01.138 INFO:tasks.workunit.client.1.smithi176.stdout:8/605: dread d6/db/d13/f31 [0,4194304] 0 2024-09-21T12:47:01.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/161: dread d1/d12/f19 [0,4194304] 0 2024-09-21T12:47:01.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/85: fsync d6/f18 0 2024-09-21T12:47:01.145 INFO:tasks.workunit.client.0.smithi046.stdout:6/102: rmdir de 39 2024-09-21T12:47:01.146 INFO:tasks.workunit.client.1.smithi176.stdout:1/653: dread d0/db/f1b [0,4194304] 0 2024-09-21T12:47:01.149 INFO:tasks.workunit.client.1.smithi176.stdout:2/638: sync 2024-09-21T12:47:01.152 INFO:tasks.workunit.client.0.smithi046.stdout:5/124: rename d4/d22/c12 to d4/c25 0 2024-09-21T12:47:01.154 INFO:tasks.workunit.client.0.smithi046.stdout:8/162: creat d1/f41 x:0 0 0 2024-09-21T12:47:01.155 INFO:tasks.workunit.client.0.smithi046.stdout:8/163: readlink d1/lc 0 2024-09-21T12:47:01.156 INFO:tasks.workunit.client.1.smithi176.stdout:4/615: truncate d3/d5/f15 1322983 0 2024-09-21T12:47:01.159 INFO:tasks.workunit.client.1.smithi176.stdout:9/604: truncate d1/df/d48/d69/d4d/f96 2154032 0 2024-09-21T12:47:01.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/164: dwrite d1/f1f [0,4194304] 0 2024-09-21T12:47:01.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/86: mknod d6/c1e 0 2024-09-21T12:47:01.170 INFO:tasks.workunit.client.0.smithi046.stdout:8/165: dwrite d1/f1f [0,4194304] 0 2024-09-21T12:47:01.172 INFO:tasks.workunit.client.0.smithi046.stdout:0/87: rmdir d6/d7 39 2024-09-21T12:47:01.173 INFO:tasks.workunit.client.1.smithi176.stdout:8/606: rmdir d6/d8/d24/d35 39 2024-09-21T12:47:01.176 INFO:tasks.workunit.client.1.smithi176.stdout:5/537: link d0/d13/d63/d2e/d39/d3b/f3e d0/d13/d63/d2e/d37/fa2 0 2024-09-21T12:47:01.176 INFO:tasks.workunit.client.0.smithi046.stdout:6/103: mknod de/c1a 0 2024-09-21T12:47:01.181 INFO:tasks.workunit.client.0.smithi046.stdout:6/104: rmdir de 39 2024-09-21T12:47:01.182 INFO:tasks.workunit.client.0.smithi046.stdout:0/88: creat d6/d7/d9/f1f x:0 0 0 2024-09-21T12:47:01.183 INFO:tasks.workunit.client.1.smithi176.stdout:1/654: dwrite d0/db/d1a/f38 [0,4194304] 0 2024-09-21T12:47:01.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/89: chown d6/f1a 433617 1 2024-09-21T12:47:01.184 INFO:tasks.workunit.client.1.smithi176.stdout:9/605: mkdir d1/df/d23/dcf 0 2024-09-21T12:47:01.185 INFO:tasks.workunit.client.1.smithi176.stdout:1/655: write d0/db/d1a/d2c/d6b/f77 [2220521,7803] 0 2024-09-21T12:47:01.185 INFO:tasks.workunit.client.1.smithi176.stdout:1/656: dread - d0/d63/f6c zero size 2024-09-21T12:47:01.187 INFO:tasks.workunit.client.0.smithi046.stdout:0/90: mknod d6/d7/d9/dd/c20 0 2024-09-21T12:47:01.191 INFO:tasks.workunit.client.1.smithi176.stdout:6/572: rename d2/dd/d26/d2b/fa5 to d2/dd/d26/d2b/dac/fb4 0 2024-09-21T12:47:01.191 INFO:tasks.workunit.client.0.smithi046.stdout:0/91: dread d6/d7/d9/ff [0,4194304] 0 2024-09-21T12:47:01.191 INFO:tasks.workunit.client.1.smithi176.stdout:6/573: stat d2/dd/d26/d2b/fb0 0 2024-09-21T12:47:01.193 INFO:tasks.workunit.client.1.smithi176.stdout:8/607: fsync d6/d8/d24/d35/d51/f53 0 2024-09-21T12:47:01.200 INFO:tasks.workunit.client.1.smithi176.stdout:8/608: dread d6/d8/d24/d35/d51/f53 [0,4194304] 0 2024-09-21T12:47:01.204 INFO:tasks.workunit.client.1.smithi176.stdout:5/538: dwrite d0/d13/f56 [4194304,4194304] 0 2024-09-21T12:47:01.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/125: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:47:01.206 INFO:tasks.workunit.client.1.smithi176.stdout:0/763: creat d9/d1a/d3f/d10d/f112 x:0 0 0 2024-09-21T12:47:01.208 INFO:tasks.workunit.client.0.smithi046.stdout:0/92: creat d6/f21 x:0 0 0 2024-09-21T12:47:01.210 INFO:tasks.workunit.client.1.smithi176.stdout:4/616: creat d3/d42/d47/dab/fd9 x:0 0 0 2024-09-21T12:47:01.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/126: mknod d4/d16/c26 0 2024-09-21T12:47:01.212 INFO:tasks.workunit.client.0.smithi046.stdout:5/127: fsync d4/fa 0 2024-09-21T12:47:01.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.215+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f1abc02db00 con 0x7f1aa8074a30 2024-09-21T12:47:01.217 INFO:tasks.workunit.client.1.smithi176.stdout:1/657: truncate d0/db/d1a/d2c/dc5/d2b/d43/f60 1259141 0 2024-09-21T12:47:01.218 INFO:tasks.workunit.client.0.smithi046.stdout:6/105: write f9 [1290710,32040] 0 2024-09-21T12:47:01.219 INFO:tasks.workunit.client.1.smithi176.stdout:1/658: fdatasync d0/db/d1a/d2c/d84/fd4 0 2024-09-21T12:47:01.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/128: dwrite d4/fa [0,4194304] 0 2024-09-21T12:47:01.220 INFO:tasks.workunit.client.1.smithi176.stdout:2/639: dwrite d4/d63/f94 [0,4194304] 0 2024-09-21T12:47:01.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/129: truncate d4/f24 525851 0 2024-09-21T12:47:01.221 INFO:tasks.workunit.client.1.smithi176.stdout:6/574: unlink d2/dd/lf 0 2024-09-21T12:47:01.223 INFO:tasks.workunit.client.0.smithi046.stdout:6/106: truncate f3 1054593 0 2024-09-21T12:47:01.223 INFO:tasks.workunit.client.1.smithi176.stdout:6/575: truncate d2/dd/d79/fab 635787 0 2024-09-21T12:47:01.226 INFO:tasks.workunit.client.0.smithi046.stdout:5/130: creat d4/d22/d10/d1a/f27 x:0 0 0 2024-09-21T12:47:01.228 INFO:tasks.workunit.client.0.smithi046.stdout:5/131: stat d4/dc/d13/d15 0 2024-09-21T12:47:01.228 INFO:tasks.workunit.client.0.smithi046.stdout:5/132: readlink d4/l11 0 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.228+0000 7f1ab2ffd640 1 -- 172.21.15.46:0/1927367574 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f1abc02db00 con 0x7f1aa8074a30 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 39s ago 7m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 starting - - - - 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 starting - - - - 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 39s ago 8m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:47:01.230 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (7m) 37s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 39s ago 7m 79.9M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (2m) 39s ago 2m 106M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (2m) 39s ago 2m 131M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (2m) 37s ago 2m 20.6M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (2m) 37s ago 2m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:9283,8765,8443 running (9m) 39s ago 9m 211M - 19.1.1-373-g4e45e6b4 164465d2334a a9438678095d 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (59s) 37s ago 7m 497M - 19.3.0-5104-g44178494 b415816db8b4 95f2eac0602f 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 39s ago 9m 51.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (7m) 37s ago 7m 45.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 39s ago 8m 15.1M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (7m) 37s ago 7m 17.4M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 39s ago 6m 77.2M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 39s ago 5m 78.0M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:47:01.231 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 39s ago 5m 65.1M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:47:01.232 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (4m) 37s ago 4m 74.2M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:47:01.232 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (4m) 37s ago 4m 69.7M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:47:01.232 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (3m) 37s ago 3m 67.7M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:47:01.232 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 starting - - - - 2024-09-21T12:47:01.232 INFO:tasks.workunit.client.0.smithi046.stdout:5/133: fsync d4/d22/d10/d1a/f1c 0 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f1aa8074a30 msgr2=0x7f1aa8076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f1aa8074a30 0x7f1aa8076ef0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1abc069ef0 tx=0x7f1ab8005f90 comp rx=0 tx=0).stop 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 msgr2=0x7f1abc100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc100c70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1aac006010 tx=0x7f1aac0048f0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 shutdown_connections 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f1aa8074a30 0x7f1aa8076ef0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1abc102cc0 0x7f1abc100c70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 --2- 172.21.15.46:0/1927367574 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1abc0ffc40 0x7f1abc1025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 >> 172.21.15.46:0/1927367574 conn(0x7f1abc0fb770 msgr2=0x7f1abc106170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 shutdown_connections 2024-09-21T12:47:01.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.232+0000 7f1ac3e39640 1 -- 172.21.15.46:0/1927367574 wait complete. 2024-09-21T12:47:01.235 INFO:tasks.workunit.client.0.smithi046.stdout:6/107: symlink de/l1b 0 2024-09-21T12:47:01.235 INFO:tasks.workunit.client.1.smithi176.stdout:5/539: creat d0/d13/d63/d2e/d39/d41/fa3 x:0 0 0 2024-09-21T12:47:01.235 INFO:tasks.workunit.client.1.smithi176.stdout:5/540: write d0/d13/f84 [737478,59787] 0 2024-09-21T12:47:01.236 INFO:tasks.workunit.client.1.smithi176.stdout:0/764: unlink d9/d35/ffc 0 2024-09-21T12:47:01.237 INFO:tasks.workunit.client.1.smithi176.stdout:0/765: chown d9/d1a/d1d/d23/dd3/dee/lff 0 1 2024-09-21T12:47:01.241 INFO:tasks.workunit.client.0.smithi046.stdout:5/134: mkdir d4/dc/d28 0 2024-09-21T12:47:01.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/108: unlink de/lf 0 2024-09-21T12:47:01.245 INFO:tasks.workunit.client.0.smithi046.stdout:6/109: write f5 [514058,83150] 0 2024-09-21T12:47:01.246 INFO:tasks.workunit.client.1.smithi176.stdout:7/729: rename d0/d2/db/f21 to d0/d5d/dec/f108 0 2024-09-21T12:47:01.247 INFO:tasks.workunit.client.0.smithi046.stdout:6/110: read - de/f18 zero size 2024-09-21T12:47:01.249 INFO:tasks.workunit.client.0.smithi046.stdout:0/93: dwrite d6/f18 [0,4194304] 0 2024-09-21T12:47:01.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/135: dwrite d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:01.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/94: rename d6/d7/d9/dd to d6/d7/d9/dd/d22 22 2024-09-21T12:47:01.255 INFO:tasks.workunit.client.1.smithi176.stdout:2/640: creat d4/df/d2e/d39/db7/d80/fc2 x:0 0 0 2024-09-21T12:47:01.256 INFO:tasks.workunit.client.0.smithi046.stdout:0/95: fdatasync d6/d7/d13/f1d 0 2024-09-21T12:47:01.256 INFO:tasks.workunit.client.1.smithi176.stdout:2/641: write d4/d3d/d65/f9d [927975,54326] 0 2024-09-21T12:47:01.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/96: write d6/d7/d9/f1f [617113,70067] 0 2024-09-21T12:47:01.267 INFO:tasks.workunit.client.0.smithi046.stdout:6/111: mknod de/c1c 0 2024-09-21T12:47:01.268 INFO:tasks.workunit.client.0.smithi046.stdout:6/112: chown de/c1c 234579890 1 2024-09-21T12:47:01.271 INFO:tasks.workunit.client.0.smithi046.stdout:5/136: creat d4/d22/d10/d1a/f29 x:0 0 0 2024-09-21T12:47:01.272 INFO:tasks.workunit.client.1.smithi176.stdout:3/708: link d1/d34/d48/deb/db3/lb8 d1/d5/d25/d61/dc3/l107 0 2024-09-21T12:47:01.272 INFO:tasks.workunit.client.1.smithi176.stdout:4/617: write d3/fb1 [646452,61421] 0 2024-09-21T12:47:01.272 INFO:tasks.workunit.client.1.smithi176.stdout:4/618: stat d3/d42/d47/d5c 0 2024-09-21T12:47:01.273 INFO:tasks.workunit.client.1.smithi176.stdout:4/619: read - d3/d42/f7c zero size 2024-09-21T12:47:01.274 INFO:tasks.workunit.client.1.smithi176.stdout:4/620: fsync d3/d21/d88/f91 0 2024-09-21T12:47:01.274 INFO:tasks.workunit.client.1.smithi176.stdout:8/609: creat d6/d16/d9c/fbd x:0 0 0 2024-09-21T12:47:01.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/113: dwrite de/f17 [0,4194304] 0 2024-09-21T12:47:01.280 INFO:tasks.workunit.client.1.smithi176.stdout:0/766: fdatasync d9/d1a/d1d/d23/da1/da3/ff3 0 2024-09-21T12:47:01.282 INFO:tasks.workunit.client.0.smithi046.stdout:0/97: creat d6/f23 x:0 0 0 2024-09-21T12:47:01.286 INFO:tasks.workunit.client.1.smithi176.stdout:1/659: creat d0/db/d2a/def/ff0 x:0 0 0 2024-09-21T12:47:01.287 INFO:tasks.workunit.client.0.smithi046.stdout:0/98: mknod d6/d7/d9/dd/c24 0 2024-09-21T12:47:01.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/99: fsync d6/d7/d9/fb 0 2024-09-21T12:47:01.293 INFO:tasks.workunit.client.1.smithi176.stdout:6/576: symlink d2/d63/lb5 0 2024-09-21T12:47:01.294 INFO:tasks.workunit.client.1.smithi176.stdout:3/709: mknod d1/d34/d71/dc5/c108 0 2024-09-21T12:47:01.295 INFO:tasks.workunit.client.0.smithi046.stdout:5/137: link d4/dc/d13/c17 d4/c2a 0 2024-09-21T12:47:01.297 INFO:tasks.workunit.client.1.smithi176.stdout:5/541: dread d0/d13/d63/f51 [0,4194304] 0 2024-09-21T12:47:01.298 INFO:tasks.workunit.client.1.smithi176.stdout:9/606: sync 2024-09-21T12:47:01.299 INFO:tasks.workunit.client.1.smithi176.stdout:5/542: write d0/d13/d63/d72/f8f [2908699,79582] 0 2024-09-21T12:47:01.299 INFO:tasks.workunit.client.1.smithi176.stdout:9/607: dread - d1/df/d48/d69/d40/fb4 zero size 2024-09-21T12:47:01.300 INFO:tasks.workunit.client.0.smithi046.stdout:5/138: unlink d4/f24 0 2024-09-21T12:47:01.301 INFO:tasks.workunit.client.1.smithi176.stdout:9/608: truncate d1/df/d48/d69/d38/f92 8801944 0 2024-09-21T12:47:01.302 INFO:tasks.workunit.client.1.smithi176.stdout:9/609: write d1/df/d48/f4a [3942066,45365] 0 2024-09-21T12:47:01.306 INFO:tasks.workunit.client.1.smithi176.stdout:1/660: creat d0/db/d2a/ff1 x:0 0 0 2024-09-21T12:47:01.306 INFO:tasks.workunit.client.1.smithi176.stdout:1/661: chown d0/db/d2a/fca 16 1 2024-09-21T12:47:01.307 INFO:tasks.workunit.client.0.smithi046.stdout:5/139: symlink d4/d22/d10/l2b 0 2024-09-21T12:47:01.308 INFO:tasks.workunit.client.1.smithi176.stdout:6/577: dread d2/dd/d26/d2b/d10/f1f [0,4194304] 0 2024-09-21T12:47:01.308 INFO:tasks.workunit.client.0.smithi046.stdout:6/114: dwrite f3 [0,4194304] 0 2024-09-21T12:47:01.309 INFO:tasks.workunit.client.0.smithi046.stdout:0/100: rmdir d6/d7/d1c 0 2024-09-21T12:47:01.310 INFO:tasks.workunit.client.0.smithi046.stdout:5/140: write d4/d16/f1b [3336083,84687] 0 2024-09-21T12:47:01.313 INFO:tasks.workunit.client.1.smithi176.stdout:2/642: truncate d4/df/d2e/d39/d55/f6e 570274 0 2024-09-21T12:47:01.315 INFO:tasks.workunit.client.0.smithi046.stdout:6/115: creat de/f1d x:0 0 0 2024-09-21T12:47:01.318 INFO:tasks.workunit.client.1.smithi176.stdout:3/710: unlink d1/d5/f1b 0 2024-09-21T12:47:01.323 INFO:tasks.workunit.client.0.smithi046.stdout:6/116: symlink de/l1e 0 2024-09-21T12:47:01.324 INFO:tasks.workunit.client.0.smithi046.stdout:0/101: mknod d6/c25 0 2024-09-21T12:47:01.325 INFO:tasks.workunit.client.0.smithi046.stdout:0/102: read - d6/d7/d13/f1d zero size 2024-09-21T12:47:01.326 INFO:tasks.workunit.client.0.smithi046.stdout:6/117: mknod de/c1f 0 2024-09-21T12:47:01.327 INFO:tasks.workunit.client.1.smithi176.stdout:8/610: creat d6/db/da3/fbe x:0 0 0 2024-09-21T12:47:01.328 INFO:tasks.workunit.client.0.smithi046.stdout:0/103: creat d6/d7/d9/dd/f26 x:0 0 0 2024-09-21T12:47:01.330 INFO:tasks.workunit.client.0.smithi046.stdout:0/104: write d6/d7/d9/dd/f26 [978538,17517] 0 2024-09-21T12:47:01.330 INFO:tasks.workunit.client.1.smithi176.stdout:7/730: rename d0/d2/db/d10/d72/d7e/c90 to d0/d2/db/d10/d3b/c109 0 2024-09-21T12:47:01.331 INFO:tasks.workunit.client.0.smithi046.stdout:0/105: fsync d6/d7/f12 0 2024-09-21T12:47:01.332 INFO:tasks.workunit.client.0.smithi046.stdout:6/118: creat de/f20 x:0 0 0 2024-09-21T12:47:01.335 INFO:tasks.workunit.client.0.smithi046.stdout:0/106: dread d6/d7/d9/fb [0,4194304] 0 2024-09-21T12:47:01.336 INFO:tasks.workunit.client.1.smithi176.stdout:6/578: unlink d2/dd/d26/d2b/d68/fad 0 2024-09-21T12:47:01.336 INFO:tasks.workunit.client.1.smithi176.stdout:6/579: chown d2/d6f/d7f/faa 3 1 2024-09-21T12:47:01.337 INFO:tasks.workunit.client.0.smithi046.stdout:6/119: dread f5 [0,4194304] 0 2024-09-21T12:47:01.339 INFO:tasks.workunit.client.0.smithi046.stdout:0/107: creat d6/d7/d9/dd/f27 x:0 0 0 2024-09-21T12:47:01.341 INFO:tasks.workunit.client.1.smithi176.stdout:5/543: dwrite d0/d13/f32 [0,4194304] 0 2024-09-21T12:47:01.341 INFO:tasks.workunit.client.0.smithi046.stdout:6/120: dread de/f16 [0,4194304] 0 2024-09-21T12:47:01.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/108: chown d6/d7/d9/dd/f27 14769165 1 2024-09-21T12:47:01.342 INFO:tasks.workunit.client.0.smithi046.stdout:0/109: chown f5 2101631 1 2024-09-21T12:47:01.343 INFO:tasks.workunit.client.1.smithi176.stdout:4/621: mknod d3/d21/d27/d2c/cda 0 2024-09-21T12:47:01.344 INFO:tasks.workunit.client.1.smithi176.stdout:4/622: chown d3/d42/d56/f8c 9023 1 2024-09-21T12:47:01.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/110: symlink d6/d7/d9/l28 0 2024-09-21T12:47:01.346 INFO:tasks.workunit.client.1.smithi176.stdout:7/731: mknod d0/d2/d30/d93/da2/c10a 0 2024-09-21T12:47:01.347 INFO:tasks.workunit.client.0.smithi046.stdout:0/111: creat d6/d7/d13/f29 x:0 0 0 2024-09-21T12:47:01.348 INFO:tasks.workunit.client.1.smithi176.stdout:6/580: rmdir d2/dd/d26/d2b/d10/d1b 39 2024-09-21T12:47:01.349 INFO:tasks.workunit.client.1.smithi176.stdout:6/581: stat d2/dd/d26/d2b/d10/f2f 0 2024-09-21T12:47:01.349 INFO:tasks.workunit.client.0.smithi046.stdout:0/112: mkdir d6/d7/d13/d2a 0 2024-09-21T12:47:01.351 INFO:tasks.workunit.client.1.smithi176.stdout:2/643: link d4/df/fc1 d4/df/d2e/d6f/d5d/d67/fc3 0 2024-09-21T12:47:01.352 INFO:tasks.workunit.client.1.smithi176.stdout:5/544: mknod d0/d13/d63/d2e/d39/d41/ca4 0 2024-09-21T12:47:01.354 INFO:tasks.workunit.client.0.smithi046.stdout:0/113: dread d6/d7/fa [4194304,4194304] 0 2024-09-21T12:47:01.356 INFO:tasks.workunit.client.1.smithi176.stdout:3/711: creat d1/d34/d5d/dfe/f109 x:0 0 0 2024-09-21T12:47:01.356 INFO:tasks.workunit.client.1.smithi176.stdout:0/767: getdents d9/d1a/d1d/d23/da1/da3/d93/df9/d75/df8 0 2024-09-21T12:47:01.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/114: mknod d6/d7/d9/c2b 0 2024-09-21T12:47:01.359 INFO:tasks.workunit.client.1.smithi176.stdout:8/611: unlink d6/d16/d36/c5c 0 2024-09-21T12:47:01.361 INFO:tasks.workunit.client.1.smithi176.stdout:8/612: dread - d6/d16/d79/fba zero size 2024-09-21T12:47:01.362 INFO:tasks.workunit.client.1.smithi176.stdout:3/712: dwrite d1/da/f55 [0,4194304] 0 2024-09-21T12:47:01.363 INFO:tasks.workunit.client.1.smithi176.stdout:7/732: creat d0/d2/da8/f10b x:0 0 0 2024-09-21T12:47:01.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 -- 172.21.15.46:0/2997204300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 msgr2=0x7f249c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 --2- 172.21.15.46:0/2997204300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c1047e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f24980098b0 tx=0x7f249802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 -- 172.21.15.46:0/2997204300 shutdown_connections 2024-09-21T12:47:01.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 --2- 172.21.15.46:0/2997204300 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249c104d20 0x7f249c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 --2- 172.21.15.46:0/2997204300 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c1047e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 -- 172.21.15.46:0/2997204300 >> 172.21.15.46:0/2997204300 conn(0x7f249c0fc010 msgr2=0x7f249c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:01.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 -- 172.21.15.46:0/2997204300 shutdown_connections 2024-09-21T12:47:01.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.362+0000 7f24a3547640 1 -- 172.21.15.46:0/2997204300 wait complete. 2024-09-21T12:47:01.365 INFO:tasks.workunit.client.0.smithi046.stdout:0/115: mknod d6/c2c 0 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.363+0000 7f24a3547640 1 Processor -- start 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.363+0000 7f24a3547640 1 -- start start 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a3547640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a3547640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249c104d20 0x7f249c199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a3547640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f249c10a7e0 con 0x7f249c1023f0 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a3547640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f249c10a660 con 0x7f249c104d20 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a12e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a12e3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49110/0 (socket says 172.21.15.46:49110) 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a12e3640 1 -- 172.21.15.46:0/2737243610 learned_addr learned my addr 172.21.15.46:0/2737243610 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:01.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a0ae2640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249c104d20 0x7f249c199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a12e3640 1 -- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249c104d20 msgr2=0x7f249c199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a12e3640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249c104d20 0x7f249c199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.364+0000 7f24a12e3640 1 -- 172.21.15.46:0/2737243610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f249c19a300 con 0x7f249c1023f0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.365+0000 7f24a12e3640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c199740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f24980099d0 tx=0x7f24980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.365+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f249803f070 con 0x7f249c1023f0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.365+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24980049d0 con 0x7f249c1023f0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.365+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f249c19ece0 con 0x7f249c1023f0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.365+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2498035030 con 0x7f249c1023f0 2024-09-21T12:47:01.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.365+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f249c19f1b0 con 0x7f249c1023f0 2024-09-21T12:47:01.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.367+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f249c1027d0 con 0x7f249c1023f0 2024-09-21T12:47:01.369 INFO:tasks.workunit.client.0.smithi046.stdout:0/116: mknod d6/d7/d13/d2a/c2d 0 2024-09-21T12:47:01.370 INFO:tasks.workunit.client.1.smithi176.stdout:1/662: link d0/db/f7e d0/db/d1a/d2c/d66/d6d/dd8/ff2 0 2024-09-21T12:47:01.370 INFO:tasks.workunit.client.1.smithi176.stdout:6/582: symlink d2/d6f/d81/lb6 0 2024-09-21T12:47:01.370 INFO:tasks.workunit.client.1.smithi176.stdout:8/613: dread d6/db/d37/d89/f8d [0,4194304] 0 2024-09-21T12:47:01.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.368+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f2498042070 con 0x7f249c1023f0 2024-09-21T12:47:01.370 INFO:tasks.workunit.client.0.smithi046.stdout:0/117: dread - d6/d7/d9/dd/f27 zero size 2024-09-21T12:47:01.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.369+0000 7f24927fc640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f2488074a80 0x7f2488076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:01.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.369+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f24980b7470 con 0x7f249c1023f0 2024-09-21T12:47:01.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.370+0000 7f24a0ae2640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f2488074a80 0x7f2488076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:01.372 INFO:tasks.workunit.client.1.smithi176.stdout:5/545: dread d0/f27 [4194304,4194304] 0 2024-09-21T12:47:01.372 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.370+0000 7f24a0ae2640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f2488074a80 0x7f2488076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f249c19abf0 tx=0x7f248c005f90 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:01.372 INFO:tasks.workunit.client.1.smithi176.stdout:9/610: rename d1/d63/lb3 to d1/df/d48/d69/ld0 0 2024-09-21T12:47:01.378 INFO:tasks.workunit.client.0.smithi046.stdout:0/118: dwrite d6/d7/d9/fb [0,4194304] 0 2024-09-21T12:47:01.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.377+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2498082ac0 con 0x7f249c1023f0 2024-09-21T12:47:01.379 INFO:tasks.workunit.client.0.smithi046.stdout:0/119: chown d6/d7/d13/d2a 184954529 1 2024-09-21T12:47:01.379 INFO:tasks.workunit.client.1.smithi176.stdout:1/663: mkdir d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3 0 2024-09-21T12:47:01.380 INFO:tasks.workunit.client.1.smithi176.stdout:1/664: truncate d0/db/d6a/fcd 1957913 0 2024-09-21T12:47:01.380 INFO:tasks.workunit.client.0.smithi046.stdout:0/120: chown d6/d7/d9/dd/c24 2112712596 1 2024-09-21T12:47:01.381 INFO:tasks.workunit.client.0.smithi046.stdout:0/121: readlink d6/l1b 0 2024-09-21T12:47:01.381 INFO:tasks.workunit.client.0.smithi046.stdout:0/122: write d6/f21 [764708,13402] 0 2024-09-21T12:47:01.382 INFO:tasks.workunit.client.1.smithi176.stdout:1/665: fdatasync d0/db/d1a/d2c/dc5/d41/d59/d99/db3/fe6 0 2024-09-21T12:47:01.383 INFO:tasks.workunit.client.1.smithi176.stdout:8/614: rename d6/d8/d24/d35/f75 to d6/d16/d9c/fbf 0 2024-09-21T12:47:01.387 INFO:tasks.workunit.client.0.smithi046.stdout:0/123: dread d6/d7/d9/ff [0,4194304] 0 2024-09-21T12:47:01.388 INFO:tasks.workunit.client.1.smithi176.stdout:2/644: dread d4/f7f [0,4194304] 0 2024-09-21T12:47:01.390 INFO:tasks.workunit.client.1.smithi176.stdout:4/623: link d3/d21/d27/c87 d3/d21/d27/d9b/cdb 0 2024-09-21T12:47:01.391 INFO:tasks.workunit.client.1.smithi176.stdout:0/768: dread d9/d1a/d1d/d23/da1/da3/d1e/fb5 [0,4194304] 0 2024-09-21T12:47:01.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/124: unlink d6/d7/d9/c2b 0 2024-09-21T12:47:01.392 INFO:tasks.workunit.client.0.smithi046.stdout:0/125: chown d6/d7/f12 46944520 1 2024-09-21T12:47:01.393 INFO:tasks.workunit.client.1.smithi176.stdout:6/583: fsync d2/d63/f49 0 2024-09-21T12:47:01.396 INFO:tasks.workunit.client.0.smithi046.stdout:0/126: rmdir d6/d7 39 2024-09-21T12:47:01.400 INFO:tasks.workunit.client.0.smithi046.stdout:0/127: fdatasync d6/d7/d13/f1d 0 2024-09-21T12:47:01.401 INFO:tasks.workunit.client.1.smithi176.stdout:7/733: write d0/d2/db/d10/d3b/f88 [286723,26098] 0 2024-09-21T12:47:01.401 INFO:tasks.workunit.client.1.smithi176.stdout:9/611: creat d1/df/d48/d69/dc8/fd1 x:0 0 0 2024-09-21T12:47:01.401 INFO:tasks.workunit.client.0.smithi046.stdout:0/128: readlink d6/d7/d9/l28 0 2024-09-21T12:47:01.402 INFO:tasks.workunit.client.1.smithi176.stdout:8/615: unlink d6/d16/f99 0 2024-09-21T12:47:01.402 INFO:tasks.workunit.client.1.smithi176.stdout:8/616: dread - d6/d16/f86 zero size 2024-09-21T12:47:01.404 INFO:tasks.workunit.client.1.smithi176.stdout:4/624: mkdir d3/d5/db/d96/db2/ddc 0 2024-09-21T12:47:01.404 INFO:tasks.workunit.client.0.smithi046.stdout:0/129: symlink d6/d7/d13/d2a/l2e 0 2024-09-21T12:47:01.405 INFO:tasks.workunit.client.1.smithi176.stdout:8/617: write d6/d8/d24/d35/f42 [4894472,121733] 0 2024-09-21T12:47:01.406 INFO:tasks.workunit.client.1.smithi176.stdout:1/666: mkdir d0/df4 0 2024-09-21T12:47:01.406 INFO:tasks.workunit.client.1.smithi176.stdout:6/584: write d2/dd/f7a [2246334,26415] 0 2024-09-21T12:47:01.407 INFO:tasks.workunit.client.1.smithi176.stdout:3/713: dwrite d1/d34/d48/deb/dc6/f105 [0,4194304] 0 2024-09-21T12:47:01.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/130: mkdir d6/d2f 0 2024-09-21T12:47:01.410 INFO:tasks.workunit.client.1.smithi176.stdout:2/645: dread d4/d3d/d65/f89 [0,4194304] 0 2024-09-21T12:47:01.412 INFO:tasks.workunit.client.0.smithi046.stdout:0/131: symlink d6/d7/d9/dd/l30 0 2024-09-21T12:47:01.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/132: fsync d6/d7/d9/dd/f27 0 2024-09-21T12:47:01.431 INFO:tasks.workunit.client.0.smithi046.stdout:0/133: rename d6/d7/d9/dd to d6/d7/d13/d2a/d31 0 2024-09-21T12:47:01.433 INFO:tasks.workunit.client.1.smithi176.stdout:0/769: symlink d9/d1a/d1d/l113 0 2024-09-21T12:47:01.437 INFO:tasks.workunit.client.1.smithi176.stdout:3/714: truncate d1/da/fb 7689918 0 2024-09-21T12:47:01.438 INFO:tasks.workunit.client.1.smithi176.stdout:2/646: write d4/df/d2e/d39/d55/f75 [1904494,71685] 0 2024-09-21T12:47:01.441 INFO:tasks.workunit.client.1.smithi176.stdout:1/667: mkdir d0/d91/dd3/df5 0 2024-09-21T12:47:01.442 INFO:tasks.workunit.client.1.smithi176.stdout:0/770: symlink d9/d35/l114 0 2024-09-21T12:47:01.442 INFO:tasks.workunit.client.1.smithi176.stdout:6/585: truncate d2/d63/f51 499989 0 2024-09-21T12:47:01.444 INFO:tasks.workunit.client.1.smithi176.stdout:0/771: chown d9/d1a/d1d/d23/da1/da3/d1e/de1 1873 1 2024-09-21T12:47:01.447 INFO:tasks.workunit.client.1.smithi176.stdout:7/734: rename d0/d2/db/d10/d23/da6/d105/faf to d0/d2/db/d10/d72/f10c 0 2024-09-21T12:47:01.447 INFO:tasks.workunit.client.1.smithi176.stdout:3/715: dwrite d1/d5/d25/d40/dcb/ffb [0,4194304] 0 2024-09-21T12:47:01.447 INFO:tasks.workunit.client.1.smithi176.stdout:7/735: fdatasync d0/d2/da8/dbe/fd2 0 2024-09-21T12:47:01.449 INFO:tasks.workunit.client.1.smithi176.stdout:2/647: mkdir d4/df/dc4 0 2024-09-21T12:47:01.450 INFO:tasks.workunit.client.1.smithi176.stdout:5/546: sync 2024-09-21T12:47:01.452 INFO:tasks.workunit.client.1.smithi176.stdout:6/586: mknod d2/d6f/d81/cb7 0 2024-09-21T12:47:01.453 INFO:tasks.workunit.client.1.smithi176.stdout:4/625: rename d3/d21/d5e/c95 to d3/d5/db/d96/db2/ddc/cdd 0 2024-09-21T12:47:01.454 INFO:tasks.workunit.client.1.smithi176.stdout:2/648: write d4/f37 [1228826,121416] 0 2024-09-21T12:47:01.455 INFO:tasks.workunit.client.1.smithi176.stdout:8/618: getdents d6/d8/d24/d35/d9b 0 2024-09-21T12:47:01.456 INFO:tasks.workunit.client.1.smithi176.stdout:3/716: dwrite d1/f1a [0,4194304] 0 2024-09-21T12:47:01.457 INFO:tasks.workunit.client.1.smithi176.stdout:8/619: write d6/d16/f86 [610681,75845] 0 2024-09-21T12:47:01.458 INFO:tasks.workunit.client.1.smithi176.stdout:7/736: fdatasync d0/f17 0 2024-09-21T12:47:01.459 INFO:tasks.workunit.client.1.smithi176.stdout:8/620: fdatasync d6/db/d32/f40 0 2024-09-21T12:47:01.459 INFO:tasks.workunit.client.0.smithi046.stdout:0/134: truncate d6/d7/d9/fb 5774200 0 2024-09-21T12:47:01.460 INFO:tasks.workunit.client.1.smithi176.stdout:8/621: fdatasync d6/d16/d79/f8f 0 2024-09-21T12:47:01.460 INFO:tasks.workunit.client.1.smithi176.stdout:0/772: truncate d9/d1a/d1d/d23/da1/da3/d93/df9/d77/f92 579347 0 2024-09-21T12:47:01.462 INFO:tasks.workunit.client.1.smithi176.stdout:1/668: dread d0/db/d1a/d2c/d84/fb9 [0,4194304] 0 2024-09-21T12:47:01.462 INFO:tasks.workunit.client.1.smithi176.stdout:8/622: chown d6/l57 45827 1 2024-09-21T12:47:01.463 INFO:tasks.workunit.client.1.smithi176.stdout:9/612: write d1/df/f41 [3127184,18813] 0 2024-09-21T12:47:01.463 INFO:tasks.workunit.client.1.smithi176.stdout:5/547: fsync d0/d10/f2b 0 2024-09-21T12:47:01.465 INFO:tasks.workunit.client.1.smithi176.stdout:6/587: mknod d2/d6f/d7f/cb8 0 2024-09-21T12:47:01.466 INFO:tasks.workunit.client.1.smithi176.stdout:6/588: chown d2/d6f/d81/lb6 289852 1 2024-09-21T12:47:01.468 INFO:tasks.workunit.client.1.smithi176.stdout:4/626: mkdir d3/d42/dae/dde 0 2024-09-21T12:47:01.468 INFO:tasks.workunit.client.1.smithi176.stdout:0/773: dread d9/d1a/d1d/d23/da1/da3/d8f/d91/f106 [0,4194304] 0 2024-09-21T12:47:01.469 INFO:tasks.workunit.client.0.smithi046.stdout:0/135: dwrite d6/f21 [0,4194304] 0 2024-09-21T12:47:01.469 INFO:tasks.workunit.client.1.smithi176.stdout:3/717: symlink d1/d3e/ddc/l10a 0 2024-09-21T12:47:01.473 INFO:tasks.workunit.client.1.smithi176.stdout:2/649: dread d4/d3a/f5c [0,4194304] 0 2024-09-21T12:47:01.474 INFO:tasks.workunit.client.0.smithi046.stdout:0/136: fsync d6/d7/d9/ff 0 2024-09-21T12:47:01.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/137: write d6/f1a [4862428,119396] 0 2024-09-21T12:47:01.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/127: sync 2024-09-21T12:47:01.485 INFO:tasks.workunit.client.0.smithi046.stdout:0/138: mkdir d6/d2f/d32 0 2024-09-21T12:47:01.487 INFO:tasks.workunit.client.1.smithi176.stdout:5/548: dread d0/d13/d63/d2e/d37/f57 [0,4194304] 0 2024-09-21T12:47:01.488 INFO:tasks.workunit.client.1.smithi176.stdout:5/549: chown d0/d13/d63/d72/d87/f89 80128 1 2024-09-21T12:47:01.488 INFO:tasks.workunit.client.1.smithi176.stdout:4/627: creat d3/d42/d56/fdf x:0 0 0 2024-09-21T12:47:01.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/139: creat d6/d7/d13/d2a/d31/f33 x:0 0 0 2024-09-21T12:47:01.491 INFO:tasks.workunit.client.0.smithi046.stdout:3/128: dread d5/dc/f15 [0,4194304] 0 2024-09-21T12:47:01.491 INFO:tasks.workunit.client.0.smithi046.stdout:3/129: chown d5/f10 124505 1 2024-09-21T12:47:01.494 INFO:tasks.workunit.client.1.smithi176.stdout:4/628: dwrite d3/d5/db/fd2 [0,4194304] 0 2024-09-21T12:47:01.497 INFO:tasks.workunit.client.1.smithi176.stdout:2/650: fsync d4/d3d/d65/d9b/fa8 0 2024-09-21T12:47:01.499 INFO:tasks.workunit.client.1.smithi176.stdout:2/651: write d4/df/d2e/d6f/d5d/f77 [4474325,71386] 0 2024-09-21T12:47:01.500 INFO:tasks.workunit.client.1.smithi176.stdout:6/589: mknod d2/d63/cb9 0 2024-09-21T12:47:01.501 INFO:tasks.workunit.client.1.smithi176.stdout:1/669: dread d0/db/d1a/d2c/dc5/d41/f2f [0,4194304] 0 2024-09-21T12:47:01.502 INFO:tasks.workunit.client.1.smithi176.stdout:6/590: dread - d2/dd/d26/d2b/fa1 zero size 2024-09-21T12:47:01.506 INFO:tasks.workunit.client.1.smithi176.stdout:7/737: truncate d0/d2/db/d10/d5a/f38 4240954 0 2024-09-21T12:47:01.507 INFO:tasks.workunit.client.1.smithi176.stdout:5/550: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:47:01.508 INFO:tasks.workunit.client.1.smithi176.stdout:7/738: stat d0/d2/db/d10/d72/d51 0 2024-09-21T12:47:01.508 INFO:tasks.workunit.client.1.smithi176.stdout:8/623: creat d6/d8/d24/d35/fc0 x:0 0 0 2024-09-21T12:47:01.509 INFO:tasks.workunit.client.1.smithi176.stdout:7/739: write d0/d5d/fd5 [315592,39606] 0 2024-09-21T12:47:01.515 INFO:tasks.workunit.client.1.smithi176.stdout:4/629: dread d3/d21/f2a [0,4194304] 0 2024-09-21T12:47:01.519 INFO:tasks.workunit.client.0.smithi046.stdout:0/140: dwrite d6/d7/d13/d2a/d31/f27 [0,4194304] 0 2024-09-21T12:47:01.543 INFO:tasks.workunit.client.1.smithi176.stdout:9/613: write d1/df/d48/d69/d38/f5c [1416382,79873] 0 2024-09-21T12:47:01.550 INFO:tasks.workunit.client.1.smithi176.stdout:6/591: creat d2/dd/fba x:0 0 0 2024-09-21T12:47:01.551 INFO:tasks.workunit.client.0.smithi046.stdout:0/141: rmdir d6/d7/d13/d2a/d31 39 2024-09-21T12:47:01.552 INFO:tasks.workunit.client.0.smithi046.stdout:0/142: write d6/f23 [447082,49919] 0 2024-09-21T12:47:01.554 INFO:tasks.workunit.client.0.smithi046.stdout:0/143: truncate d6/d7/d9/f1f 992451 0 2024-09-21T12:47:01.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/130: link d5/dc/ld d5/dc/d26/l2d 0 2024-09-21T12:47:01.558 INFO:tasks.workunit.client.1.smithi176.stdout:8/624: read d6/d16/d36/d67/f6d [29551,18183] 0 2024-09-21T12:47:01.559 INFO:tasks.workunit.client.1.smithi176.stdout:8/625: read - d6/db/d37/d7a/f96 zero size 2024-09-21T12:47:01.563 INFO:tasks.workunit.client.1.smithi176.stdout:9/614: rmdir d1/d61 39 2024-09-21T12:47:01.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/131: getdents d5/d16 0 2024-09-21T12:47:01.569 INFO:tasks.workunit.client.1.smithi176.stdout:6/592: creat d2/d6f/fbb x:0 0 0 2024-09-21T12:47:01.569 INFO:tasks.workunit.client.1.smithi176.stdout:6/593: fsync d2/f34 0 2024-09-21T12:47:01.574 INFO:tasks.workunit.client.1.smithi176.stdout:8/626: chown d6/db/d13/c27 20305 1 2024-09-21T12:47:01.576 INFO:tasks.workunit.client.0.smithi046.stdout:3/132: fdatasync d5/fb 0 2024-09-21T12:47:01.583 INFO:tasks.workunit.client.1.smithi176.stdout:9/615: unlink d1/df/c32 0 2024-09-21T12:47:01.583 INFO:tasks.workunit.client.1.smithi176.stdout:2/652: link d4/df/d2e/d6f/l87 d4/d40/lc5 0 2024-09-21T12:47:01.589 INFO:tasks.workunit.client.1.smithi176.stdout:4/630: creat d3/fe0 x:0 0 0 2024-09-21T12:47:01.603 INFO:tasks.workunit.client.1.smithi176.stdout:4/631: mknod d3/d5/dc5/dd6/ce1 0 2024-09-21T12:47:01.603 INFO:tasks.workunit.client.1.smithi176.stdout:4/632: write d3/d21/f2e [171849,105541] 0 2024-09-21T12:47:01.607 INFO:tasks.workunit.client.1.smithi176.stdout:4/633: mknod d3/d21/d27/d9b/ce2 0 2024-09-21T12:47:01.607 INFO:tasks.workunit.client.1.smithi176.stdout:4/634: write d3/d42/f69 [934631,22955] 0 2024-09-21T12:47:01.609 INFO:tasks.workunit.client.1.smithi176.stdout:7/740: symlink d0/d2/db/d10/d72/l10d 0 2024-09-21T12:47:01.610 INFO:tasks.workunit.client.1.smithi176.stdout:4/635: truncate d3/d42/f71 388967 0 2024-09-21T12:47:01.613 INFO:tasks.workunit.client.1.smithi176.stdout:7/741: symlink d0/d2/db/d10/d31/da0/l10e 0 2024-09-21T12:47:01.614 INFO:tasks.workunit.client.1.smithi176.stdout:7/742: readlink d0/d2/db/d10/d23/dce/l64 0 2024-09-21T12:47:01.627 INFO:tasks.workunit.client.1.smithi176.stdout:9/616: rmdir d1/d61/d73/d7d 39 2024-09-21T12:47:01.628 INFO:tasks.workunit.client.1.smithi176.stdout:9/617: truncate d1/d8b/fa6 177591 0 2024-09-21T12:47:01.633 INFO:tasks.workunit.client.1.smithi176.stdout:7/743: dread d0/d2/db/fe [0,4194304] 0 2024-09-21T12:47:01.635 INFO:tasks.workunit.client.1.smithi176.stdout:9/618: creat d1/df/d23/dcf/fd2 x:0 0 0 2024-09-21T12:47:01.640 INFO:tasks.workunit.client.1.smithi176.stdout:9/619: chown d1/df/d48/d69/c31 206478691 1 2024-09-21T12:47:01.642 INFO:tasks.workunit.client.0.smithi046.stdout:0/144: truncate d6/d7/fa 6130482 0 2024-09-21T12:47:01.654 INFO:tasks.workunit.client.0.smithi046.stdout:0/145: mknod d6/d7/d13/d2a/d31/c34 0 2024-09-21T12:47:01.655 INFO:tasks.workunit.client.1.smithi176.stdout:6/594: write d2/dd/f48 [5097405,37381] 0 2024-09-21T12:47:01.656 INFO:tasks.workunit.client.1.smithi176.stdout:6/595: write d2/dd/d26/d2b/d10/d39/f6c [2055532,56773] 0 2024-09-21T12:47:01.656 INFO:tasks.workunit.client.0.smithi046.stdout:0/146: mknod d6/d7/c35 0 2024-09-21T12:47:01.659 INFO:tasks.workunit.client.1.smithi176.stdout:0/774: rename d9/d1a/d3f/d10d/d43 to d9/d1a/d1d/d81/d115 0 2024-09-21T12:47:01.663 INFO:tasks.workunit.client.0.smithi046.stdout:0/147: rename d6/d7/d9/f1f to d6/d7/d13/f36 0 2024-09-21T12:47:01.663 INFO:tasks.workunit.client.1.smithi176.stdout:8/627: truncate d6/d8/d24/d35/d51/f78 4050096 0 2024-09-21T12:47:01.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/148: write d6/d7/d13/f1d [262828,107721] 0 2024-09-21T12:47:01.664 INFO:tasks.workunit.client.1.smithi176.stdout:6/596: readlink d2/dd/d26/d2b/d10/d1b/l57 0 2024-09-21T12:47:01.667 INFO:tasks.workunit.client.1.smithi176.stdout:3/718: rename d1/d34/dbb to d1/d34/d5d/d78/d10b 0 2024-09-21T12:47:01.672 INFO:tasks.workunit.client.0.smithi046.stdout:0/149: mkdir d6/d7/d37 0 2024-09-21T12:47:01.673 INFO:tasks.workunit.client.1.smithi176.stdout:3/719: truncate d1/d34/d42/fa0 36764 0 2024-09-21T12:47:01.674 INFO:tasks.workunit.client.1.smithi176.stdout:2/653: dwrite d4/d3d/f5b [0,4194304] 0 2024-09-21T12:47:01.675 INFO:tasks.workunit.client.1.smithi176.stdout:3/720: chown d1/d5/d25/d40/l99 8 1 2024-09-21T12:47:01.677 INFO:tasks.workunit.client.1.smithi176.stdout:0/775: symlink d9/d1a/db8/dd2/l116 0 2024-09-21T12:47:01.679 INFO:tasks.workunit.client.0.smithi046.stdout:0/150: dwrite d6/f18 [4194304,4194304] 0 2024-09-21T12:47:01.682 INFO:tasks.workunit.client.1.smithi176.stdout:3/721: creat d1/d35/d5e/d90/f10c x:0 0 0 2024-09-21T12:47:01.684 INFO:tasks.workunit.client.1.smithi176.stdout:6/597: creat d2/fbc x:0 0 0 2024-09-21T12:47:01.687 INFO:tasks.workunit.client.1.smithi176.stdout:1/670: rename d0/d5b/f61 to d0/db/d1a/d2c/dc5/ff6 0 2024-09-21T12:47:01.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/151: mkdir d6/d7/d13/d2a/d38 0 2024-09-21T12:47:01.689 INFO:tasks.workunit.client.1.smithi176.stdout:3/722: dwrite d1/d5/d25/d84/fc8 [0,4194304] 0 2024-09-21T12:47:01.689 INFO:tasks.workunit.client.1.smithi176.stdout:1/671: truncate d0/db/d2a/f86 1862576 0 2024-09-21T12:47:01.690 INFO:tasks.workunit.client.1.smithi176.stdout:3/723: chown d1/d34/d48 1 1 2024-09-21T12:47:01.692 INFO:tasks.workunit.client.0.smithi046.stdout:0/152: symlink d6/d7/d13/l39 0 2024-09-21T12:47:01.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/153: read d6/d7/d13/f36 [514128,117277] 0 2024-09-21T12:47:01.701 INFO:tasks.workunit.client.1.smithi176.stdout:6/598: creat d2/fbd x:0 0 0 2024-09-21T12:47:01.702 INFO:tasks.workunit.client.1.smithi176.stdout:6/599: fdatasync d2/dd/d26/d2b/d10/f82 0 2024-09-21T12:47:01.702 INFO:tasks.workunit.client.0.smithi046.stdout:0/154: symlink d6/l3a 0 2024-09-21T12:47:01.704 INFO:tasks.workunit.client.1.smithi176.stdout:4/636: rename d3/d42/d47/ccc to d3/d5/ce3 0 2024-09-21T12:47:01.704 INFO:tasks.workunit.client.1.smithi176.stdout:4/637: chown d3/d42/dae/cb4 1656 1 2024-09-21T12:47:01.706 INFO:tasks.workunit.client.0.smithi046.stdout:0/155: mknod d6/d7/d13/d2a/d31/c3b 0 2024-09-21T12:47:01.708 INFO:tasks.workunit.client.1.smithi176.stdout:4/638: mknod d3/d42/dae/ce4 0 2024-09-21T12:47:01.710 INFO:tasks.workunit.client.1.smithi176.stdout:2/654: rename d4/df/d2e/d6f/lbb to d4/df/d2e/d39/db7/lc6 0 2024-09-21T12:47:01.710 INFO:tasks.workunit.client.1.smithi176.stdout:7/744: mkdir d0/d2/d30/d93/d10f 0 2024-09-21T12:47:01.711 INFO:tasks.workunit.client.1.smithi176.stdout:4/639: symlink d3/d42/d47/d5c/le5 0 2024-09-21T12:47:01.711 INFO:tasks.workunit.client.1.smithi176.stdout:7/745: chown d0/d2/da8/dca/ce9 1405 1 2024-09-21T12:47:01.712 INFO:tasks.workunit.client.1.smithi176.stdout:4/640: write d3/d5/f8d [833633,69085] 0 2024-09-21T12:47:01.713 INFO:tasks.workunit.client.0.smithi046.stdout:0/156: dwrite d6/d7/d13/f29 [0,4194304] 0 2024-09-21T12:47:01.715 INFO:tasks.workunit.client.0.smithi046.stdout:0/157: read d6/d7/d13/d2a/d31/f26 [281459,81665] 0 2024-09-21T12:47:01.716 INFO:tasks.workunit.client.1.smithi176.stdout:7/746: mknod d0/d2/d30/d93/d96/c110 0 2024-09-21T12:47:01.717 INFO:tasks.workunit.client.1.smithi176.stdout:7/747: stat d0/d2/db/d10/d23/d85 0 2024-09-21T12:47:01.720 INFO:tasks.workunit.client.0.smithi046.stdout:0/158: dread d6/d7/d13/d2a/d31/f26 [0,4194304] 0 2024-09-21T12:47:01.721 INFO:tasks.workunit.client.1.smithi176.stdout:4/641: dread d3/d5/f44 [0,4194304] 0 2024-09-21T12:47:01.721 INFO:tasks.workunit.client.0.smithi046.stdout:0/159: fdatasync d6/f23 0 2024-09-21T12:47:01.722 INFO:tasks.workunit.client.1.smithi176.stdout:4/642: dread - d3/d21/d5e/fce zero size 2024-09-21T12:47:01.723 INFO:tasks.workunit.client.1.smithi176.stdout:7/748: creat d0/d2/da8/dbe/f111 x:0 0 0 2024-09-21T12:47:01.725 INFO:tasks.workunit.client.1.smithi176.stdout:3/724: rename d1/d34/d48/deb/db3/fe2 to d1/d5/d25/f10d 0 2024-09-21T12:47:01.727 INFO:tasks.workunit.client.1.smithi176.stdout:2/655: link d4/df/d2e/d6f/d5d/d67/fc3 d4/df/d4b/fc7 0 2024-09-21T12:47:01.728 INFO:tasks.workunit.client.1.smithi176.stdout:9/620: truncate d1/f7 4228806 0 2024-09-21T12:47:01.729 INFO:tasks.workunit.client.1.smithi176.stdout:4/643: creat d3/d21/d27/d9b/fe6 x:0 0 0 2024-09-21T12:47:01.731 INFO:tasks.workunit.client.1.smithi176.stdout:3/725: mknod d1/d34/d57/dd0/c10e 0 2024-09-21T12:47:01.732 INFO:tasks.workunit.client.1.smithi176.stdout:2/656: dwrite d4/df/f1c [0,4194304] 0 2024-09-21T12:47:01.732 INFO:tasks.workunit.client.1.smithi176.stdout:3/726: readlink d1/d34/d5d/d78/lae 0 2024-09-21T12:47:01.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/160: creat d6/f3c x:0 0 0 2024-09-21T12:47:01.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/161: chown f5 6 1 2024-09-21T12:47:01.737 INFO:tasks.workunit.client.1.smithi176.stdout:7/749: chown d0/d2f/d43/f76 45716 1 2024-09-21T12:47:01.738 INFO:tasks.workunit.client.1.smithi176.stdout:7/750: dread - d0/d2/db/d10/d31/ff0 zero size 2024-09-21T12:47:01.738 INFO:tasks.workunit.client.1.smithi176.stdout:7/751: fdatasync d0/d2/da8/dbe/f111 0 2024-09-21T12:47:01.739 INFO:tasks.workunit.client.0.smithi046.stdout:0/162: write d6/d7/d13/f36 [1551724,59593] 0 2024-09-21T12:47:01.739 INFO:tasks.workunit.client.1.smithi176.stdout:5/551: unlink d0/d13/c7b 0 2024-09-21T12:47:01.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/163: write d6/d7/d13/f1d [515751,45118] 0 2024-09-21T12:47:01.741 INFO:tasks.workunit.client.1.smithi176.stdout:4/644: mknod d3/d42/d4d/ce7 0 2024-09-21T12:47:01.741 INFO:tasks.workunit.client.1.smithi176.stdout:4/645: stat d3/d5/f44 0 2024-09-21T12:47:01.742 INFO:tasks.workunit.client.0.smithi046.stdout:0/164: chown d6/d7/f12 460862657 1 2024-09-21T12:47:01.742 INFO:tasks.workunit.client.1.smithi176.stdout:4/646: fdatasync d3/d5/f13 0 2024-09-21T12:47:01.744 INFO:tasks.workunit.client.1.smithi176.stdout:4/647: dread - d3/d5/db/d96/da3/fa5 zero size 2024-09-21T12:47:01.745 INFO:tasks.workunit.client.0.smithi046.stdout:0/165: creat d6/d7/d13/f3d x:0 0 0 2024-09-21T12:47:01.746 INFO:tasks.workunit.client.1.smithi176.stdout:8/628: dwrite d6/d16/d36/d67/f6d [0,4194304] 0 2024-09-21T12:47:01.747 INFO:tasks.workunit.client.1.smithi176.stdout:7/752: mknod d0/d2/db/d10/d31/da1/dfc/c112 0 2024-09-21T12:47:01.749 INFO:tasks.workunit.client.1.smithi176.stdout:5/552: mkdir d0/d13/d5d/d98/da5 0 2024-09-21T12:47:01.753 INFO:tasks.workunit.client.1.smithi176.stdout:2/657: dread d4/df/f5a [0,4194304] 0 2024-09-21T12:47:01.753 INFO:tasks.workunit.client.0.smithi046.stdout:7/60: sync 2024-09-21T12:47:01.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/120: sync 2024-09-21T12:47:01.754 INFO:tasks.workunit.client.0.smithi046.stdout:9/114: sync 2024-09-21T12:47:01.754 INFO:tasks.workunit.client.1.smithi176.stdout:2/658: chown d4/d3a 749602 1 2024-09-21T12:47:01.754 INFO:tasks.workunit.client.1.smithi176.stdout:9/621: dread d1/df/d48/d69/d4d/f96 [0,4194304] 0 2024-09-21T12:47:01.756 INFO:tasks.workunit.client.0.smithi046.stdout:0/166: creat d6/d7/d37/f3e x:0 0 0 2024-09-21T12:47:01.757 INFO:tasks.workunit.client.1.smithi176.stdout:0/776: truncate d9/d1a/d1d/d23/da1/da3/d1e/f6f 246395 0 2024-09-21T12:47:01.758 INFO:tasks.workunit.client.1.smithi176.stdout:0/777: chown d9/d1a/d1d/d23/da1/da3/d93/df9/fce 3 1 2024-09-21T12:47:01.761 INFO:tasks.workunit.client.1.smithi176.stdout:8/629: rename d6/db/d32/f40 to d6/db/da3/fc1 0 2024-09-21T12:47:01.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/115: dread d11/d19/f1a [0,4194304] 0 2024-09-21T12:47:01.763 INFO:tasks.workunit.client.0.smithi046.stdout:7/61: dwrite d2/fe [0,4194304] 0 2024-09-21T12:47:01.764 INFO:tasks.workunit.client.1.smithi176.stdout:7/753: rmdir d0/d2/d30/d93/d96/d89 39 2024-09-21T12:47:01.766 INFO:tasks.workunit.client.1.smithi176.stdout:1/672: dwrite d0/db/d1a/d2c/dc5/d2b/f44 [0,4194304] 0 2024-09-21T12:47:01.767 INFO:tasks.workunit.client.0.smithi046.stdout:2/121: dwrite d16/f21 [0,4194304] 0 2024-09-21T12:47:01.770 INFO:tasks.workunit.client.1.smithi176.stdout:5/553: dread d0/d13/f56 [0,4194304] 0 2024-09-21T12:47:01.772 INFO:tasks.workunit.client.1.smithi176.stdout:9/622: creat d1/df/d48/d69/d76/d7c/fd3 x:0 0 0 2024-09-21T12:47:01.773 INFO:tasks.workunit.client.1.smithi176.stdout:9/623: stat d1/d61/d73/c85 0 2024-09-21T12:47:01.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/116: symlink d11/d19/d1b/l22 0 2024-09-21T12:47:01.774 INFO:tasks.workunit.client.0.smithi046.stdout:0/167: dread d6/d7/d9/fb [0,4194304] 0 2024-09-21T12:47:01.775 INFO:tasks.workunit.client.1.smithi176.stdout:9/624: chown d1/d61/d73/c85 144091 1 2024-09-21T12:47:01.776 INFO:tasks.workunit.client.1.smithi176.stdout:3/727: creat d1/d5/f10f x:0 0 0 2024-09-21T12:47:01.776 INFO:tasks.workunit.client.1.smithi176.stdout:9/625: write d1/d8b/faf [2342382,110929] 0 2024-09-21T12:47:01.777 INFO:tasks.workunit.client.1.smithi176.stdout:3/728: stat d1/d9e/db4/l104 0 2024-09-21T12:47:01.778 INFO:tasks.workunit.client.1.smithi176.stdout:9/626: write d1/df/f12 [2094951,127674] 0 2024-09-21T12:47:01.784 INFO:tasks.workunit.client.1.smithi176.stdout:3/729: dread d1/d34/d48/deb/dc6/f105 [0,4194304] 0 2024-09-21T12:47:01.795 INFO:tasks.workunit.client.1.smithi176.stdout:1/673: mknod d0/db/d1a/d2c/dc5/d41/d59/d99/db3/cf7 0 2024-09-21T12:47:01.795 INFO:tasks.workunit.client.1.smithi176.stdout:6/600: sync 2024-09-21T12:47:01.796 INFO:tasks.workunit.client.1.smithi176.stdout:6/601: fdatasync d2/dd/d26/d2b/f2e 0 2024-09-21T12:47:01.798 INFO:tasks.workunit.client.1.smithi176.stdout:5/554: rmdir d0/d13/d63/d72 39 2024-09-21T12:47:01.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/168: getdents d6/d7 0 2024-09-21T12:47:01.803 INFO:tasks.workunit.client.0.smithi046.stdout:0/169: creat d6/d7/d9/f3f x:0 0 0 2024-09-21T12:47:01.804 INFO:tasks.workunit.client.1.smithi176.stdout:9/627: mknod d1/df/d48/d69/d38/cd4 0 2024-09-21T12:47:01.811 INFO:tasks.workunit.client.1.smithi176.stdout:8/630: symlink d6/db/d37/d89/d8a/da6/lc2 0 2024-09-21T12:47:01.813 INFO:tasks.workunit.client.1.smithi176.stdout:7/754: mkdir d0/d2/db/d10/d3b/d106/d113 0 2024-09-21T12:47:01.814 INFO:tasks.workunit.client.1.smithi176.stdout:1/674: symlink d0/db/d1a/d2c/d6b/lf8 0 2024-09-21T12:47:01.815 INFO:tasks.workunit.client.0.smithi046.stdout:7/62: truncate d2/d4/f8 7993703 0 2024-09-21T12:47:01.816 INFO:tasks.workunit.client.0.smithi046.stdout:2/122: truncate d16/f21 3941850 0 2024-09-21T12:47:01.817 INFO:tasks.workunit.client.1.smithi176.stdout:4/648: getdents d3/d21/da6 0 2024-09-21T12:47:01.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/123: creat d16/f27 x:0 0 0 2024-09-21T12:47:01.821 INFO:tasks.workunit.client.0.smithi046.stdout:7/63: dwrite d2/fe [4194304,4194304] 0 2024-09-21T12:47:01.822 INFO:tasks.workunit.client.1.smithi176.stdout:2/659: rename d4/df/d4b/c50 to d4/df/cc8 0 2024-09-21T12:47:01.824 INFO:tasks.workunit.client.1.smithi176.stdout:7/755: write d0/d2/d30/d93/d96/d89/f97 [1286308,99965] 0 2024-09-21T12:47:01.826 INFO:tasks.workunit.client.0.smithi046.stdout:2/124: rename d16/c18 to d16/d22/c28 0 2024-09-21T12:47:01.828 INFO:tasks.workunit.client.1.smithi176.stdout:0/778: chown d9/d1a/d1d/d23/da1/da3/d1e/f6f 1277 1 2024-09-21T12:47:01.830 INFO:tasks.workunit.client.0.smithi046.stdout:0/170: write f5 [4527134,85266] 0 2024-09-21T12:47:01.832 INFO:tasks.workunit.client.1.smithi176.stdout:5/555: mknod d0/d13/d63/d8d/ca6 0 2024-09-21T12:47:01.832 INFO:tasks.workunit.client.0.smithi046.stdout:0/171: write d6/d7/d13/f29 [1770360,71914] 0 2024-09-21T12:47:01.833 INFO:tasks.workunit.client.1.smithi176.stdout:3/730: write d1/d34/d5d/fad [1098649,70498] 0 2024-09-21T12:47:01.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.832+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f249c02d7c0 con 0x7f249c1023f0 2024-09-21T12:47:01.833 INFO:tasks.workunit.client.0.smithi046.stdout:2/125: creat d16/d22/f29 x:0 0 0 2024-09-21T12:47:01.834 INFO:tasks.workunit.client.1.smithi176.stdout:0/779: dwrite d9/d1a/d1d/d23/da1/da3/f13 [0,4194304] 0 2024-09-21T12:47:01.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.833+0000 7f24927fc640 1 -- 172.21.15.46:0/2737243610 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f2498087970 con 0x7f249c1023f0 2024-09-21T12:47:01.834 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:47:01.834 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:47:01.835 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T12:47:01.836 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:47:01.836 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:47:01.836 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:47:01.836 INFO:tasks.workunit.client.1.smithi176.stdout:3/731: write d1/d34/d48/deb/faa [875847,83297] 0 2024-09-21T12:47:01.836 INFO:tasks.workunit.client.1.smithi176.stdout:4/649: creat d3/d5/dc5/dd6/fe8 x:0 0 0 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.836+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f2488074a80 msgr2=0x7f2488076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.836+0000 7f24a3547640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f2488074a80 0x7f2488076f40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f249c19abf0 tx=0x7f248c005f90 comp rx=0 tx=0).stop 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.836+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 msgr2=0x7f249c199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.836+0000 7f24a3547640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c199740 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f24980099d0 tx=0x7f24980045e0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 shutdown_connections 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f2488074a80 0x7f2488076f40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f249c104d20 0x7f249c199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 --2- 172.21.15.46:0/2737243610 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f249c1023f0 0x7f249c199740 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 >> 172.21.15.46:0/2737243610 conn(0x7f249c0fc010 msgr2=0x7f249c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 shutdown_connections 2024-09-21T12:47:01.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.837+0000 7f24a3547640 1 -- 172.21.15.46:0/2737243610 wait complete. 2024-09-21T12:47:01.840 INFO:tasks.workunit.client.1.smithi176.stdout:9/628: mknod d1/df/d9a/dbc/cd5 0 2024-09-21T12:47:01.845 INFO:tasks.workunit.client.1.smithi176.stdout:9/629: dwrite d1/d8b/fc9 [0,4194304] 0 2024-09-21T12:47:01.846 INFO:tasks.workunit.client.0.smithi046.stdout:2/126: creat d16/d22/f2a x:0 0 0 2024-09-21T12:47:01.846 INFO:tasks.workunit.client.1.smithi176.stdout:0/780: dread d9/d1a/d3f/d40/fb2 [0,4194304] 0 2024-09-21T12:47:01.847 INFO:tasks.workunit.client.1.smithi176.stdout:0/781: dread - d9/d1a/d1d/d23/da1/da3/d93/df9/fce zero size 2024-09-21T12:47:01.850 INFO:tasks.workunit.client.0.smithi046.stdout:2/127: mkdir d16/d22/d2b 0 2024-09-21T12:47:01.855 INFO:tasks.workunit.client.0.smithi046.stdout:0/172: link f5 d6/f40 0 2024-09-21T12:47:01.857 INFO:tasks.workunit.client.0.smithi046.stdout:2/128: mknod d16/c2c 0 2024-09-21T12:47:01.858 INFO:tasks.workunit.client.0.smithi046.stdout:2/129: dread - d16/f20 zero size 2024-09-21T12:47:01.858 INFO:tasks.workunit.client.1.smithi176.stdout:1/675: chown d0/db/d1a/d2c/d48/d50/da6 81 1 2024-09-21T12:47:01.860 INFO:tasks.workunit.client.0.smithi046.stdout:0/173: creat d6/d7/d13/d2a/d31/f41 x:0 0 0 2024-09-21T12:47:01.860 INFO:tasks.workunit.client.0.smithi046.stdout:2/130: write d16/f1a [3755468,111980] 0 2024-09-21T12:47:01.863 INFO:tasks.workunit.client.1.smithi176.stdout:5/556: creat d0/d13/d63/d2e/d37/d55/fa7 x:0 0 0 2024-09-21T12:47:01.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/64: dwrite d2/f9 [4194304,4194304] 0 2024-09-21T12:47:01.864 INFO:tasks.workunit.client.1.smithi176.stdout:3/732: fdatasync d1/d3e/ddc/ff7 0 2024-09-21T12:47:01.864 INFO:tasks.workunit.client.1.smithi176.stdout:3/733: chown d1/lcd 724124306 1 2024-09-21T12:47:01.865 INFO:tasks.workunit.client.1.smithi176.stdout:3/734: write d1/d5/f10f [924630,74413] 0 2024-09-21T12:47:01.866 INFO:tasks.workunit.client.0.smithi046.stdout:7/65: fdatasync d2/d4/df/f10 0 2024-09-21T12:47:01.873 INFO:tasks.workunit.client.1.smithi176.stdout:9/630: creat d1/df/d23/dcf/fd6 x:0 0 0 2024-09-21T12:47:01.873 INFO:tasks.workunit.client.0.smithi046.stdout:2/131: dwrite d16/f1e [0,4194304] 0 2024-09-21T12:47:01.873 INFO:tasks.workunit.client.1.smithi176.stdout:9/631: fsync d1/df/d48/d69/d40/d84/f95 0 2024-09-21T12:47:01.877 INFO:tasks.workunit.client.1.smithi176.stdout:8/631: creat d6/d16/d36/fc3 x:0 0 0 2024-09-21T12:47:01.878 INFO:tasks.workunit.client.1.smithi176.stdout:8/632: fdatasync d6/d8/d24/d35/d51/f6f 0 2024-09-21T12:47:01.879 INFO:tasks.workunit.client.1.smithi176.stdout:7/756: symlink d0/d2/d30/d93/d10f/l114 0 2024-09-21T12:47:01.883 INFO:tasks.workunit.client.1.smithi176.stdout:5/557: creat d0/fa8 x:0 0 0 2024-09-21T12:47:01.883 INFO:tasks.workunit.client.1.smithi176.stdout:5/558: stat d0/d10/d70/f8b 0 2024-09-21T12:47:01.884 INFO:tasks.workunit.client.0.smithi046.stdout:2/132: creat d16/d22/f2d x:0 0 0 2024-09-21T12:47:01.885 INFO:tasks.workunit.client.0.smithi046.stdout:2/133: write d16/f1d [987899,33369] 0 2024-09-21T12:47:01.886 INFO:tasks.workunit.client.0.smithi046.stdout:7/66: link l0 d2/d4/l13 0 2024-09-21T12:47:01.889 INFO:tasks.workunit.client.1.smithi176.stdout:3/735: chown d1/d9e/db4/lea 5204346 1 2024-09-21T12:47:01.890 INFO:tasks.workunit.client.0.smithi046.stdout:2/134: creat d16/d22/f2e x:0 0 0 2024-09-21T12:47:01.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/135: rename d16/d22 to d16/d22/d2f 22 2024-09-21T12:47:01.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/136: truncate d16/f27 274488 0 2024-09-21T12:47:01.892 INFO:tasks.workunit.client.1.smithi176.stdout:6/602: rename d2/dd/d26/d2b/d10/f82 to d2/fbe 0 2024-09-21T12:47:01.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/67: mkdir d2/d4/df/d14 0 2024-09-21T12:47:01.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/68: dread - d2/fa zero size 2024-09-21T12:47:01.896 INFO:tasks.workunit.client.1.smithi176.stdout:2/660: creat d4/d3d/d76/fc9 x:0 0 0 2024-09-21T12:47:01.897 INFO:tasks.workunit.client.0.smithi046.stdout:7/69: write d2/fe [4109828,82403] 0 2024-09-21T12:47:01.899 INFO:tasks.workunit.client.0.smithi046.stdout:0/174: dwrite d6/d7/d9/ff [0,4194304] 0 2024-09-21T12:47:01.899 INFO:tasks.workunit.client.1.smithi176.stdout:2/661: dread d4/f1a [0,4194304] 0 2024-09-21T12:47:01.899 INFO:tasks.workunit.client.1.smithi176.stdout:2/662: chown d4/df/f15 1 1 2024-09-21T12:47:01.901 INFO:tasks.workunit.client.1.smithi176.stdout:0/782: symlink d9/d1a/d1d/d23/da1/da3/d93/df9/l117 0 2024-09-21T12:47:01.901 INFO:tasks.workunit.client.1.smithi176.stdout:0/783: fsync d9/d1a/d3f/d40/f85 0 2024-09-21T12:47:01.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/137: mkdir d16/d22/d2b/d30 0 2024-09-21T12:47:01.906 INFO:tasks.workunit.client.1.smithi176.stdout:8/633: creat d6/db/d37/d7a/fc4 x:0 0 0 2024-09-21T12:47:01.908 INFO:tasks.workunit.client.1.smithi176.stdout:4/650: truncate d3/d5/db/fd2 326573 0 2024-09-21T12:47:01.910 INFO:tasks.workunit.client.0.smithi046.stdout:2/138: rmdir d16 39 2024-09-21T12:47:01.912 INFO:tasks.workunit.client.0.smithi046.stdout:7/70: symlink d2/dd/l15 0 2024-09-21T12:47:01.913 INFO:tasks.workunit.client.1.smithi176.stdout:6/603: mkdir d2/d6f/d7f/dbf 0 2024-09-21T12:47:01.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/139: write d16/f27 [359792,86393] 0 2024-09-21T12:47:01.918 INFO:tasks.workunit.client.0.smithi046.stdout:7/71: mknod d2/d4/df/c16 0 2024-09-21T12:47:01.919 INFO:tasks.workunit.client.1.smithi176.stdout:6/604: dwrite d2/d6f/d7f/fa8 [0,4194304] 0 2024-09-21T12:47:01.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/72: write d2/fe [96267,87116] 0 2024-09-21T12:47:01.921 INFO:tasks.workunit.client.0.smithi046.stdout:0/175: creat d6/f42 x:0 0 0 2024-09-21T12:47:01.923 INFO:tasks.workunit.client.1.smithi176.stdout:0/784: readlink d9/d1a/d1d/d23/da1/da3/lc5 0 2024-09-21T12:47:01.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/140: creat d16/d22/f31 x:0 0 0 2024-09-21T12:47:01.932 INFO:tasks.workunit.client.0.smithi046.stdout:0/176: dwrite d6/d7/d9/ff [0,4194304] 0 2024-09-21T12:47:01.932 INFO:tasks.workunit.client.1.smithi176.stdout:4/651: creat d3/d5/db/d36/fe9 x:0 0 0 2024-09-21T12:47:01.932 INFO:tasks.workunit.client.0.smithi046.stdout:7/73: mkdir d2/d4/df/d17 0 2024-09-21T12:47:01.934 INFO:tasks.workunit.client.1.smithi176.stdout:1/676: rename d0/db/d1a/d2c/dc5/d41/d59/d99/cd9 to d0/db/d1a/d2c/dc5/d2b/d43/d92/cf9 0 2024-09-21T12:47:01.935 INFO:tasks.workunit.client.1.smithi176.stdout:1/677: stat d0/db/d1a/d2c/d6b 0 2024-09-21T12:47:01.935 INFO:tasks.workunit.client.1.smithi176.stdout:1/678: dread - d0/db/d6a/d89/fe7 zero size 2024-09-21T12:47:01.936 INFO:tasks.workunit.client.1.smithi176.stdout:1/679: write d0/f6 [900956,26505] 0 2024-09-21T12:47:01.937 INFO:tasks.workunit.client.0.smithi046.stdout:0/177: mkdir d6/d7/d13/d43 0 2024-09-21T12:47:01.939 INFO:tasks.workunit.client.1.smithi176.stdout:9/632: creat d1/df/d48/d69/fd7 x:0 0 0 2024-09-21T12:47:01.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/74: symlink d2/dd/l18 0 2024-09-21T12:47:01.943 INFO:tasks.workunit.client.1.smithi176.stdout:6/605: dread d2/dd/d26/d2b/d10/d1b/f2a [0,4194304] 0 2024-09-21T12:47:01.944 INFO:tasks.workunit.client.0.smithi046.stdout:2/141: link d16/d22/f29 d16/d22/d2b/d30/f32 0 2024-09-21T12:47:01.946 INFO:tasks.workunit.client.1.smithi176.stdout:0/785: write d9/d1a/d3f/d40/fb2 [2219417,1937] 0 2024-09-21T12:47:01.947 INFO:tasks.workunit.client.1.smithi176.stdout:3/736: truncate d1/d5/d25/f26 1829603 0 2024-09-21T12:47:01.947 INFO:tasks.workunit.client.1.smithi176.stdout:8/634: mknod d6/d16/d36/cc5 0 2024-09-21T12:47:01.948 INFO:tasks.workunit.client.0.smithi046.stdout:2/142: read f13 [657284,3386] 0 2024-09-21T12:47:01.949 INFO:tasks.workunit.client.1.smithi176.stdout:3/737: fdatasync d1/d5/d25/d61/fe1 0 2024-09-21T12:47:01.949 INFO:tasks.workunit.client.1.smithi176.stdout:4/652: creat d3/d5/db/d96/fea x:0 0 0 2024-09-21T12:47:01.950 INFO:tasks.workunit.client.1.smithi176.stdout:6/606: dwrite d2/d6f/f78 [0,4194304] 0 2024-09-21T12:47:01.951 INFO:tasks.workunit.client.0.smithi046.stdout:7/75: symlink d2/l19 0 2024-09-21T12:47:01.952 INFO:tasks.workunit.client.0.smithi046.stdout:7/76: chown d2/d4/cc 10918 1 2024-09-21T12:47:01.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/143: symlink d16/l33 0 2024-09-21T12:47:01.956 INFO:tasks.workunit.client.1.smithi176.stdout:1/680: mkdir d0/db/d1a/d2c/dc5/d2b/d43/dfa 0 2024-09-21T12:47:01.956 INFO:tasks.workunit.client.1.smithi176.stdout:1/681: fdatasync d0/db/d2a/f86 0 2024-09-21T12:47:01.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/178: rename d6/d7/d9/f3f to d6/d7/d13/d2a/f44 0 2024-09-21T12:47:01.958 INFO:tasks.workunit.client.1.smithi176.stdout:2/663: write d4/df/fc1 [4835889,119748] 0 2024-09-21T12:47:01.958 INFO:tasks.workunit.client.1.smithi176.stdout:1/682: dread - d0/db/d1a/d2c/dc5/d41/d59/d9b/fb2 zero size 2024-09-21T12:47:01.959 INFO:tasks.workunit.client.0.smithi046.stdout:7/77: symlink d2/d4/df/l1a 0 2024-09-21T12:47:01.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/179: creat d6/d7/f45 x:0 0 0 2024-09-21T12:47:01.967 INFO:tasks.workunit.client.0.smithi046.stdout:7/78: dwrite d2/fe [4194304,4194304] 0 2024-09-21T12:47:01.972 INFO:tasks.workunit.client.0.smithi046.stdout:2/144: unlink l1 0 2024-09-21T12:47:01.972 INFO:tasks.workunit.client.0.smithi046.stdout:2/145: readlink d16/l33 0 2024-09-21T12:47:01.976 INFO:tasks.workunit.client.1.smithi176.stdout:3/738: symlink d1/d34/d71/l110 0 2024-09-21T12:47:01.977 INFO:tasks.workunit.client.1.smithi176.stdout:3/739: chown d1/d34/f93 62525 1 2024-09-21T12:47:01.977 INFO:tasks.workunit.client.1.smithi176.stdout:3/740: read - d1/d8d/f103 zero size 2024-09-21T12:47:01.978 INFO:tasks.workunit.client.0.smithi046.stdout:7/79: creat d2/dd/f1b x:0 0 0 2024-09-21T12:47:01.980 INFO:tasks.workunit.client.0.smithi046.stdout:2/146: mkdir d16/d22/d34 0 2024-09-21T12:47:01.980 INFO:tasks.workunit.client.0.smithi046.stdout:2/147: dread - d16/d22/f2d zero size 2024-09-21T12:47:01.983 INFO:tasks.workunit.client.1.smithi176.stdout:7/757: rename d0/d2f/ca3 to d0/d2/db/d10/d72/d7e/c115 0 2024-09-21T12:47:01.984 INFO:tasks.workunit.client.1.smithi176.stdout:7/758: dread - d0/d2/fb7 zero size 2024-09-21T12:47:01.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/148: dread d16/f27 [0,4194304] 0 2024-09-21T12:47:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.983+0000 7f934b7d5640 1 -- 172.21.15.46:0/1002438297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344100860 msgr2=0x7f9344100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.983+0000 7f934b7d5640 1 --2- 172.21.15.46:0/1002438297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344100860 0x7f9344100c60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f93400097e0 tx=0x7f934002a3f0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.983+0000 7f934b7d5640 1 -- 172.21.15.46:0/1002438297 shutdown_connections 2024-09-21T12:47:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.983+0000 7f934b7d5640 1 --2- 172.21.15.46:0/1002438297 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9344101a60 0x7f9344101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.983+0000 7f934b7d5640 1 --2- 172.21.15.46:0/1002438297 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344100860 0x7f9344100c60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.983+0000 7f934b7d5640 1 -- 172.21.15.46:0/1002438297 >> 172.21.15.46:0/1002438297 conn(0x7f93440fc010 msgr2=0x7f93440fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:01.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/180: fdatasync d6/d7/d13/f36 0 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.984+0000 7f934b7d5640 1 -- 172.21.15.46:0/1002438297 shutdown_connections 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.984+0000 7f934b7d5640 1 -- 172.21.15.46:0/1002438297 wait complete. 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f934b7d5640 1 Processor -- start 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f934b7d5640 1 -- start start 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f934b7d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9344100860 0x7f93441994f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f934b7d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 0x7f9344199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f934b7d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9344108570 con 0x7f9344101a60 2024-09-21T12:47:01.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f934b7d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f93441083f0 con 0x7f9344100860 2024-09-21T12:47:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.985+0000 7f9348d70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 0x7f9344199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9348d70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 0x7f9344199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49132/0 (socket says 172.21.15.46:49132) 2024-09-21T12:47:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9348d70640 1 -- 172.21.15.46:0/3499797253 learned_addr learned my addr 172.21.15.46:0/3499797253 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:01.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9349571640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9344100860 0x7f93441994f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:01.988 INFO:tasks.workunit.client.1.smithi176.stdout:0/786: dwrite d9/d1a/f58 [0,4194304] 0 2024-09-21T12:47:01.989 INFO:tasks.workunit.client.1.smithi176.stdout:0/787: fsync d9/d1a/d3f/d10d/f71 0 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9348d70640 1 -- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9344100860 msgr2=0x7f93441994f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9348d70640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9344100860 0x7f93441994f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9348d70640 1 -- 172.21.15.46:0/3499797253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f934419a0b0 con 0x7f9344101a60 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.986+0000 7f9348d70640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 0x7f9344199a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f93340058c0 tx=0x7f9334009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.987+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9334009e30 con 0x7f9344101a60 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.987+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9334005020 con 0x7f9344101a60 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.987+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9334004cc0 con 0x7f9344101a60 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.987+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f934419eaf0 con 0x7f9344101a60 2024-09-21T12:47:01.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.987+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f934419f020 con 0x7f9344101a60 2024-09-21T12:47:01.990 INFO:tasks.workunit.client.1.smithi176.stdout:1/683: mknod d0/d91/dd3/cfb 0 2024-09-21T12:47:01.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.989+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f934418f380 con 0x7f9344101a60 2024-09-21T12:47:01.990 INFO:tasks.workunit.client.0.smithi046.stdout:0/181: chown d6/d7/d9/l28 570826488 1 2024-09-21T12:47:01.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/182: stat d6 0 2024-09-21T12:47:01.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.989+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f93340051d0 con 0x7f9344101a60 2024-09-21T12:47:01.992 INFO:tasks.workunit.client.1.smithi176.stdout:7/759: dwrite d0/d2f/d43/f6b [0,4194304] 0 2024-09-21T12:47:01.992 INFO:tasks.workunit.client.1.smithi176.stdout:1/684: fdatasync d0/db/d1a/d2c/dc5/d41/d59/d99/fa3 0 2024-09-21T12:47:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.990+0000 7f933a7fc640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9330074ad0 0x7f9330076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.990+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f9334013070 con 0x7f9344101a60 2024-09-21T12:47:01.992 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.991+0000 7f9349571640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9330074ad0 0x7f9330076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:01.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.992+0000 7f9349571640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9330074ad0 0x7f9330076f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93400095f0 tx=0x7f934000b190 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:01.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:01.997+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9334061220 con 0x7f9344101a60 2024-09-21T12:47:02.000 INFO:tasks.workunit.client.1.smithi176.stdout:4/653: link d3/d42/d4d/f58 d3/d5/db/d96/feb 0 2024-09-21T12:47:02.001 INFO:tasks.workunit.client.1.smithi176.stdout:7/760: dwrite d0/d5d/f81 [0,4194304] 0 2024-09-21T12:47:02.003 INFO:tasks.workunit.client.1.smithi176.stdout:9/633: dwrite d1/df/f39 [0,4194304] 0 2024-09-21T12:47:02.004 INFO:tasks.workunit.client.1.smithi176.stdout:9/634: readlink d1/df/d48/d69/d40/l70 0 2024-09-21T12:47:02.008 INFO:tasks.workunit.client.1.smithi176.stdout:5/559: rename d0/le to d0/d13/d63/d2e/d39/d41/la9 0 2024-09-21T12:47:02.009 INFO:tasks.workunit.client.0.smithi046.stdout:0/183: creat d6/d7/d13/d2a/d31/f46 x:0 0 0 2024-09-21T12:47:02.010 INFO:tasks.workunit.client.0.smithi046.stdout:7/80: link d2/d4/f8 d2/d4/f1c 0 2024-09-21T12:47:02.014 INFO:tasks.workunit.client.1.smithi176.stdout:2/664: getdents d4/d3a 0 2024-09-21T12:47:02.015 INFO:tasks.workunit.client.0.smithi046.stdout:0/184: read d6/d7/fa [3673395,92088] 0 2024-09-21T12:47:02.017 INFO:tasks.workunit.client.1.smithi176.stdout:0/788: creat d9/d1a/d1d/d23/dd3/f118 x:0 0 0 2024-09-21T12:47:02.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/149: getdents d16/d22/d2b 0 2024-09-21T12:47:02.019 INFO:tasks.workunit.client.1.smithi176.stdout:0/789: write d9/d1a/d3f/d40/d79/f7f [4543981,115156] 0 2024-09-21T12:47:02.021 INFO:tasks.workunit.client.0.smithi046.stdout:7/81: truncate d2/d4/df/f10 1926148 0 2024-09-21T12:47:02.022 INFO:tasks.workunit.client.1.smithi176.stdout:8/635: rename d6/d8/d24/d35/l66 to d6/d8/d24/d35/lc6 0 2024-09-21T12:47:02.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/185: write d6/d7/f12 [1033476,113886] 0 2024-09-21T12:47:02.025 INFO:tasks.workunit.client.0.smithi046.stdout:0/186: truncate d6/f23 607929 0 2024-09-21T12:47:02.025 INFO:tasks.workunit.client.1.smithi176.stdout:3/741: unlink d1/d35/d5e/cc2 0 2024-09-21T12:47:02.030 INFO:tasks.workunit.client.1.smithi176.stdout:4/654: unlink d3/d5/db/d36/f9d 0 2024-09-21T12:47:02.030 INFO:tasks.workunit.client.1.smithi176.stdout:4/655: stat d3/d42/d47/d5c/fa9 0 2024-09-21T12:47:02.031 INFO:tasks.workunit.client.0.smithi046.stdout:7/82: creat d2/d4/df/f1d x:0 0 0 2024-09-21T12:47:02.033 INFO:tasks.workunit.client.1.smithi176.stdout:7/761: mknod d0/d2/db/d10/d72/d7e/de2/c116 0 2024-09-21T12:47:02.035 INFO:tasks.workunit.client.1.smithi176.stdout:9/635: mkdir d1/df/d48/d69/d76/dd8 0 2024-09-21T12:47:02.035 INFO:tasks.workunit.client.1.smithi176.stdout:9/636: readlink d1/df/d48/d69/d4d/la0 0 2024-09-21T12:47:02.037 INFO:tasks.workunit.client.0.smithi046.stdout:0/187: creat d6/d2f/d32/f47 x:0 0 0 2024-09-21T12:47:02.039 INFO:tasks.workunit.client.0.smithi046.stdout:7/83: symlink d2/d4/df/d17/l1e 0 2024-09-21T12:47:02.040 INFO:tasks.workunit.client.1.smithi176.stdout:1/685: symlink d0/db/d1a/d2c/d66/d6d/dd8/lfc 0 2024-09-21T12:47:02.040 INFO:tasks.workunit.client.0.smithi046.stdout:2/150: creat d16/d22/d34/f35 x:0 0 0 2024-09-21T12:47:02.041 INFO:tasks.workunit.client.1.smithi176.stdout:0/790: creat d9/d1a/d1d/d23/da1/db0/f119 x:0 0 0 2024-09-21T12:47:02.042 INFO:tasks.workunit.client.1.smithi176.stdout:8/636: rmdir d6/d16 39 2024-09-21T12:47:02.043 INFO:tasks.workunit.client.0.smithi046.stdout:7/84: unlink d2/f9 0 2024-09-21T12:47:02.044 INFO:tasks.workunit.client.0.smithi046.stdout:0/188: truncate f5 2475218 0 2024-09-21T12:47:02.046 INFO:tasks.workunit.client.0.smithi046.stdout:0/189: truncate d6/d7/d13/d2a/f44 769884 0 2024-09-21T12:47:02.046 INFO:tasks.workunit.client.0.smithi046.stdout:2/151: mknod d16/d22/d2b/d30/c36 0 2024-09-21T12:47:02.047 INFO:tasks.workunit.client.0.smithi046.stdout:0/190: chown d6/d7/d13/d2a/c2d 22359130 1 2024-09-21T12:47:02.049 INFO:tasks.workunit.client.0.smithi046.stdout:0/191: truncate d6/d7/d13/f36 2322590 0 2024-09-21T12:47:02.049 INFO:tasks.workunit.client.1.smithi176.stdout:2/665: creat d4/df/dc4/fca x:0 0 0 2024-09-21T12:47:02.049 INFO:tasks.workunit.client.1.smithi176.stdout:1/686: fsync d0/db/d1a/d2c/dc5/d2b/f3a 0 2024-09-21T12:47:02.052 INFO:tasks.workunit.client.1.smithi176.stdout:3/742: link d1/d35/d5e/d90/f9c d1/d34/d57/dc7/f111 0 2024-09-21T12:47:02.062 INFO:tasks.workunit.client.1.smithi176.stdout:6/607: rename d2/dd/d26/d2b/d10/d39/f52 to d2/d63/fc0 0 2024-09-21T12:47:02.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/192: creat d6/d7/d37/f48 x:0 0 0 2024-09-21T12:47:02.064 INFO:tasks.workunit.client.1.smithi176.stdout:8/637: dread d6/d8/f33 [0,4194304] 0 2024-09-21T12:47:02.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/85: getdents d2/d4/df/d17 0 2024-09-21T12:47:02.065 INFO:tasks.workunit.client.0.smithi046.stdout:7/86: read - d2/d4/df/f1d zero size 2024-09-21T12:47:02.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/193: mkdir d6/d7/d13/d49 0 2024-09-21T12:47:02.068 INFO:tasks.workunit.client.0.smithi046.stdout:8/166: sync 2024-09-21T12:47:02.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/121: sync 2024-09-21T12:47:02.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/142: sync 2024-09-21T12:47:02.069 INFO:tasks.workunit.client.0.smithi046.stdout:9/117: sync 2024-09-21T12:47:02.069 INFO:tasks.workunit.client.0.smithi046.stdout:5/141: sync 2024-09-21T12:47:02.069 INFO:tasks.workunit.client.0.smithi046.stdout:1/132: sync 2024-09-21T12:47:02.069 INFO:tasks.workunit.client.0.smithi046.stdout:3/133: sync 2024-09-21T12:47:02.072 INFO:tasks.workunit.client.0.smithi046.stdout:0/194: truncate d6/d7/f45 659031 0 2024-09-21T12:47:02.074 INFO:tasks.workunit.client.0.smithi046.stdout:9/118: rmdir d11/d19 39 2024-09-21T12:47:02.077 INFO:tasks.workunit.client.1.smithi176.stdout:7/762: rename d0/d2/db/d10/d31/da0/fae to d0/d2/da8/dca/f117 0 2024-09-21T12:47:02.078 INFO:tasks.workunit.client.0.smithi046.stdout:5/142: symlink d4/d16/l2c 0 2024-09-21T12:47:02.078 INFO:tasks.workunit.client.0.smithi046.stdout:0/195: write d6/d7/d9/ff [620648,28469] 0 2024-09-21T12:47:02.079 INFO:tasks.workunit.client.1.smithi176.stdout:9/637: write d1/df/d48/d69/f6f [2045068,8439] 0 2024-09-21T12:47:02.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/167: creat d1/d24/f42 x:0 0 0 2024-09-21T12:47:02.084 INFO:tasks.workunit.client.0.smithi046.stdout:2/152: truncate d16/f21 3467499 0 2024-09-21T12:47:02.084 INFO:tasks.workunit.client.0.smithi046.stdout:7/87: dread d2/d4/f8 [4194304,4194304] 0 2024-09-21T12:47:02.085 INFO:tasks.workunit.client.0.smithi046.stdout:6/122: dwrite de/f17 [0,4194304] 0 2024-09-21T12:47:02.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/143: fsync d4/d22/d10/d1a/f27 0 2024-09-21T12:47:02.087 INFO:tasks.workunit.client.0.smithi046.stdout:9/119: dwrite f10 [0,4194304] 0 2024-09-21T12:47:02.090 INFO:tasks.workunit.client.1.smithi176.stdout:1/687: unlink d0/db/d6a/ca1 0 2024-09-21T12:47:02.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/120: chown d11/c14 295 1 2024-09-21T12:47:02.093 INFO:tasks.workunit.client.0.smithi046.stdout:9/121: write d11/f12 [1420059,63775] 0 2024-09-21T12:47:02.096 INFO:tasks.workunit.client.0.smithi046.stdout:0/196: dwrite d6/d7/d37/f48 [0,4194304] 0 2024-09-21T12:47:02.096 INFO:tasks.workunit.client.1.smithi176.stdout:0/791: rename d9/d1a/f9b to d9/d1a/d1d/d23/dd3/dee/f11a 0 2024-09-21T12:47:02.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/134: symlink d5/dc/d26/l2e 0 2024-09-21T12:47:02.101 INFO:tasks.workunit.client.0.smithi046.stdout:5/144: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:47:02.104 INFO:tasks.workunit.client.1.smithi176.stdout:6/608: symlink d2/d6f/d7f/dbf/lc1 0 2024-09-21T12:47:02.108 INFO:tasks.workunit.client.0.smithi046.stdout:1/133: write d4/f1b [481432,79420] 0 2024-09-21T12:47:02.110 INFO:tasks.workunit.client.0.smithi046.stdout:5/145: dread d4/fa [0,4194304] 0 2024-09-21T12:47:02.112 INFO:tasks.workunit.client.1.smithi176.stdout:5/560: getdents d0/d13/d63/d72/d87/d92 0 2024-09-21T12:47:02.113 INFO:tasks.workunit.client.1.smithi176.stdout:5/561: read d0/d13/f32 [2041783,126411] 0 2024-09-21T12:47:02.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/153: readlink d16/l19 0 2024-09-21T12:47:02.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/168: dwrite d1/f1c [0,4194304] 0 2024-09-21T12:47:02.119 INFO:tasks.workunit.client.1.smithi176.stdout:3/743: creat d1/d34/f112 x:0 0 0 2024-09-21T12:47:02.125 INFO:tasks.workunit.client.1.smithi176.stdout:8/638: truncate d6/db/d32/fa9 272589 0 2024-09-21T12:47:02.132 INFO:tasks.workunit.client.0.smithi046.stdout:4/143: mkdir d1/d13/d25/d29/d2d 0 2024-09-21T12:47:02.134 INFO:tasks.workunit.client.1.smithi176.stdout:6/609: mknod d2/dd/cc2 0 2024-09-21T12:47:02.134 INFO:tasks.workunit.client.0.smithi046.stdout:9/122: write d11/d19/f1a [1402335,66534] 0 2024-09-21T12:47:02.135 INFO:tasks.workunit.client.1.smithi176.stdout:8/639: write d6/db/d13/d98/f9e [249721,38070] 0 2024-09-21T12:47:02.137 INFO:tasks.workunit.client.0.smithi046.stdout:0/197: rename d6/d7/d13/d2a/d31/f41 to d6/d7/d9/f4a 0 2024-09-21T12:47:02.138 INFO:tasks.workunit.client.1.smithi176.stdout:3/744: write d1/da/f2e [4113770,73708] 0 2024-09-21T12:47:02.139 INFO:tasks.workunit.client.0.smithi046.stdout:3/135: write d5/f20 [1953991,120449] 0 2024-09-21T12:47:02.143 INFO:tasks.workunit.client.1.smithi176.stdout:2/666: rename d4/df/d2e/d39/d55/f6e to d4/d3d/d65/fcb 0 2024-09-21T12:47:02.145 INFO:tasks.workunit.client.1.smithi176.stdout:0/792: creat d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd/d10b/f11b x:0 0 0 2024-09-21T12:47:02.148 INFO:tasks.workunit.client.0.smithi046.stdout:1/134: creat d4/f37 x:0 0 0 2024-09-21T12:47:02.148 INFO:tasks.workunit.client.1.smithi176.stdout:2/667: dwrite d4/d63/f94 [0,4194304] 0 2024-09-21T12:47:02.150 INFO:tasks.workunit.client.0.smithi046.stdout:2/154: creat d16/d22/d2b/f37 x:0 0 0 2024-09-21T12:47:02.153 INFO:tasks.workunit.client.1.smithi176.stdout:6/610: symlink d2/dd/d26/d2b/lc3 0 2024-09-21T12:47:02.155 INFO:tasks.workunit.client.1.smithi176.stdout:5/562: creat d0/d13/d5d/d98/d9b/faa x:0 0 0 2024-09-21T12:47:02.160 INFO:tasks.workunit.client.1.smithi176.stdout:3/745: rename d1/d34/d5d/fad to d1/d5/d25/d40/f113 0 2024-09-21T12:47:02.161 INFO:tasks.workunit.client.1.smithi176.stdout:3/746: truncate d1/d34/f93 143524 0 2024-09-21T12:47:02.163 INFO:tasks.workunit.client.1.smithi176.stdout:7/763: getdents d0/d5d/d8a 0 2024-09-21T12:47:02.163 INFO:tasks.workunit.client.0.smithi046.stdout:0/198: creat d6/d7/d13/f4b x:0 0 0 2024-09-21T12:47:02.163 INFO:tasks.workunit.client.0.smithi046.stdout:0/199: chown d6/c1e 1407 1 2024-09-21T12:47:02.164 INFO:tasks.workunit.client.1.smithi176.stdout:7/764: write d0/d2/da8/dca/fdf [1006547,103568] 0 2024-09-21T12:47:02.165 INFO:tasks.workunit.client.1.smithi176.stdout:7/765: stat d0/d5d/c9b 0 2024-09-21T12:47:02.166 INFO:tasks.workunit.client.1.smithi176.stdout:9/638: getdents d1/d61/d73 0 2024-09-21T12:47:02.167 INFO:tasks.workunit.client.1.smithi176.stdout:2/668: dread f2 [0,4194304] 0 2024-09-21T12:47:02.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/146: mkdir d4/dc/d28/d2d 0 2024-09-21T12:47:02.169 INFO:tasks.workunit.client.0.smithi046.stdout:4/144: dread d1/fe [0,4194304] 0 2024-09-21T12:47:02.169 INFO:tasks.workunit.client.0.smithi046.stdout:4/145: readlink d1/d27/l2c 0 2024-09-21T12:47:02.173 INFO:tasks.workunit.client.1.smithi176.stdout:6/611: creat d2/dd/fc4 x:0 0 0 2024-09-21T12:47:02.176 INFO:tasks.workunit.client.0.smithi046.stdout:6/123: truncate fb 1604808 0 2024-09-21T12:47:02.179 INFO:tasks.workunit.client.1.smithi176.stdout:5/563: creat d0/d13/d5d/fab x:0 0 0 2024-09-21T12:47:02.181 INFO:tasks.workunit.client.0.smithi046.stdout:0/200: creat d6/d7/d13/f4c x:0 0 0 2024-09-21T12:47:02.182 INFO:tasks.workunit.client.0.smithi046.stdout:0/201: fdatasync d6/d7/d37/f3e 0 2024-09-21T12:47:02.183 INFO:tasks.workunit.client.0.smithi046.stdout:7/88: getdents d2/d4/df/d17 0 2024-09-21T12:47:02.184 INFO:tasks.workunit.client.0.smithi046.stdout:4/146: dread d1/d13/d25/f1e [0,4194304] 0 2024-09-21T12:47:02.184 INFO:tasks.workunit.client.1.smithi176.stdout:5/564: dwrite d0/d13/d63/d2e/d39/f4b [0,4194304] 0 2024-09-21T12:47:02.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/202: chown d6/d7/d13/l39 26281115 1 2024-09-21T12:47:02.185 INFO:tasks.workunit.client.1.smithi176.stdout:4/656: sync 2024-09-21T12:47:02.186 INFO:tasks.workunit.client.1.smithi176.stdout:0/793: symlink d9/d1a/d1d/d23/da1/da3/d93/df9/l11c 0 2024-09-21T12:47:02.186 INFO:tasks.workunit.client.1.smithi176.stdout:0/794: fdatasync d9/d1a/db8/fda 0 2024-09-21T12:47:02.188 INFO:tasks.workunit.client.0.smithi046.stdout:1/135: write d4/d13/f16 [873850,77736] 0 2024-09-21T12:47:02.189 INFO:tasks.workunit.client.1.smithi176.stdout:9/639: rmdir d1/df/d48/d69/d40/d84 39 2024-09-21T12:47:02.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/136: chown d4/d29/d32 1619 1 2024-09-21T12:47:02.198 INFO:tasks.workunit.client.0.smithi046.stdout:9/123: link d11/d19/c1d d11/d19/d1b/c23 0 2024-09-21T12:47:02.200 INFO:tasks.workunit.client.1.smithi176.stdout:8/640: creat d6/d8/d24/d35/fc7 x:0 0 0 2024-09-21T12:47:02.202 INFO:tasks.workunit.client.1.smithi176.stdout:9/640: dread d1/f2f [0,4194304] 0 2024-09-21T12:47:02.203 INFO:tasks.workunit.client.1.smithi176.stdout:9/641: chown d1/df/d48/d69/dc8 27915154 1 2024-09-21T12:47:02.204 INFO:tasks.workunit.client.0.smithi046.stdout:3/136: creat d5/f2f x:0 0 0 2024-09-21T12:47:02.205 INFO:tasks.workunit.client.1.smithi176.stdout:7/766: dwrite d0/d2/db/d10/d23/da6/d105/f7d [0,4194304] 0 2024-09-21T12:47:02.206 INFO:tasks.workunit.client.0.smithi046.stdout:2/155: write d16/f27 [547676,123622] 0 2024-09-21T12:47:02.207 INFO:tasks.workunit.client.1.smithi176.stdout:4/657: mkdir d3/d42/d47/d5c/dec 0 2024-09-21T12:47:02.208 INFO:tasks.workunit.client.1.smithi176.stdout:7/767: read d0/f20 [1620813,21402] 0 2024-09-21T12:47:02.210 INFO:tasks.workunit.client.1.smithi176.stdout:7/768: truncate d0/d2/d30/d93/d96/d89/f97 2157535 0 2024-09-21T12:47:02.211 INFO:tasks.workunit.client.1.smithi176.stdout:2/669: unlink d4/df/c10 0 2024-09-21T12:47:02.213 INFO:tasks.workunit.client.1.smithi176.stdout:6/612: rename d2/dd/d26/d2b/c22 to d2/dd/cc5 0 2024-09-21T12:47:02.215 INFO:tasks.workunit.client.1.smithi176.stdout:8/641: rmdir d6/db/da3 39 2024-09-21T12:47:02.215 INFO:tasks.workunit.client.1.smithi176.stdout:3/747: dwrite d1/d5/d25/d38/f54 [0,4194304] 0 2024-09-21T12:47:02.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/137: mkdir d4/d13/d38 0 2024-09-21T12:47:02.216 INFO:tasks.workunit.client.1.smithi176.stdout:6/613: stat d2/dd/d26/d2b/c94 0 2024-09-21T12:47:02.218 INFO:tasks.workunit.client.0.smithi046.stdout:1/138: truncate d4/d13/f16 988561 0 2024-09-21T12:47:02.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/124: creat d11/d19/f24 x:0 0 0 2024-09-21T12:47:02.220 INFO:tasks.workunit.client.1.smithi176.stdout:5/565: symlink d0/d13/d63/lac 0 2024-09-21T12:47:02.221 INFO:tasks.workunit.client.1.smithi176.stdout:4/658: mknod d3/d42/d56/ced 0 2024-09-21T12:47:02.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/89: unlink d2/f12 0 2024-09-21T12:47:02.226 INFO:tasks.workunit.client.0.smithi046.stdout:3/137: dread d5/d16/f1e [0,4194304] 0 2024-09-21T12:47:02.229 INFO:tasks.workunit.client.0.smithi046.stdout:2/156: fsync d16/f1e 0 2024-09-21T12:47:02.231 INFO:tasks.workunit.client.0.smithi046.stdout:2/157: write d16/d22/f2a [99127,67186] 0 2024-09-21T12:47:02.231 INFO:tasks.workunit.client.1.smithi176.stdout:7/769: mkdir d0/d2/db/d10/d31/d118 0 2024-09-21T12:47:02.232 INFO:tasks.workunit.client.0.smithi046.stdout:2/158: dread - d16/d22/d34/f35 zero size 2024-09-21T12:47:02.235 INFO:tasks.workunit.client.1.smithi176.stdout:0/795: rename d9/d1a/d1d/d23/da1/da3/d8f/dd8/def to d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/d11d 0 2024-09-21T12:47:02.236 INFO:tasks.workunit.client.1.smithi176.stdout:0/796: readlink d9/d1a/d1d/d23/da1/da3/d93/df9/l68 0 2024-09-21T12:47:02.237 INFO:tasks.workunit.client.0.smithi046.stdout:4/147: symlink d1/d13/d25/d29/d2d/l2e 0 2024-09-21T12:47:02.238 INFO:tasks.workunit.client.1.smithi176.stdout:8/642: truncate d6/d16/f7f 4613193 0 2024-09-21T12:47:02.239 INFO:tasks.workunit.client.1.smithi176.stdout:1/688: sync 2024-09-21T12:47:02.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/139: dread d4/d13/f14 [0,4194304] 0 2024-09-21T12:47:02.243 INFO:tasks.workunit.client.1.smithi176.stdout:3/748: dread d1/d35/d5e/ff1 [0,4194304] 0 2024-09-21T12:47:02.244 INFO:tasks.workunit.client.0.smithi046.stdout:9/125: creat d11/d19/d1b/f25 x:0 0 0 2024-09-21T12:47:02.244 INFO:tasks.workunit.client.1.smithi176.stdout:3/749: chown d1/d34/d42/fdd 10128456 1 2024-09-21T12:47:02.247 INFO:tasks.workunit.client.1.smithi176.stdout:5/566: chown d0/d13/d63/d2e/l42 241 1 2024-09-21T12:47:02.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/159: rename d16/d22/d34 to d16/d22/d38 0 2024-09-21T12:47:02.251 INFO:tasks.workunit.client.0.smithi046.stdout:0/203: creat d6/d7/f4d x:0 0 0 2024-09-21T12:47:02.251 INFO:tasks.workunit.client.1.smithi176.stdout:6/614: dread d2/dd/d26/f3d [0,4194304] 0 2024-09-21T12:47:02.252 INFO:tasks.workunit.client.1.smithi176.stdout:6/615: write d2/f31 [8144783,44301] 0 2024-09-21T12:47:02.255 INFO:tasks.workunit.client.0.smithi046.stdout:4/148: creat d1/d13/d25/d29/f2f x:0 0 0 2024-09-21T12:47:02.256 INFO:tasks.workunit.client.0.smithi046.stdout:5/147: getdents d4/dc/d28 0 2024-09-21T12:47:02.257 INFO:tasks.workunit.client.1.smithi176.stdout:6/616: dwrite d2/dd/d26/d2b/d10/d39/f6c [0,4194304] 0 2024-09-21T12:47:02.259 INFO:tasks.workunit.client.1.smithi176.stdout:8/643: creat d6/d8/d24/d35/d9b/fc8 x:0 0 0 2024-09-21T12:47:02.260 INFO:tasks.workunit.client.1.smithi176.stdout:8/644: chown d6/d8/d24/d35 2982 1 2024-09-21T12:47:02.261 INFO:tasks.workunit.client.0.smithi046.stdout:6/124: getdents de 0 2024-09-21T12:47:02.265 INFO:tasks.workunit.client.0.smithi046.stdout:7/90: symlink d2/l1f 0 2024-09-21T12:47:02.266 INFO:tasks.workunit.client.1.smithi176.stdout:3/750: unlink d1/da/f55 0 2024-09-21T12:47:02.266 INFO:tasks.workunit.client.1.smithi176.stdout:3/751: stat d1/d34/d48/f50 0 2024-09-21T12:47:02.267 INFO:tasks.workunit.client.0.smithi046.stdout:4/149: creat d1/d13/f30 x:0 0 0 2024-09-21T12:47:02.268 INFO:tasks.workunit.client.1.smithi176.stdout:8/645: dread d6/d16/f86 [0,4194304] 0 2024-09-21T12:47:02.269 INFO:tasks.workunit.client.1.smithi176.stdout:9/642: rmdir d1/df/d48/dce 0 2024-09-21T12:47:02.273 INFO:tasks.workunit.client.1.smithi176.stdout:2/670: truncate d4/df/d2e/d6f/d6d/f74 2649918 0 2024-09-21T12:47:02.275 INFO:tasks.workunit.client.1.smithi176.stdout:9/643: dwrite d1/f7 [4194304,4194304] 0 2024-09-21T12:47:02.277 INFO:tasks.workunit.client.0.smithi046.stdout:7/91: readlink d2/dd/l18 0 2024-09-21T12:47:02.281 INFO:tasks.workunit.client.0.smithi046.stdout:1/140: dwrite d4/fe [0,4194304] 0 2024-09-21T12:47:02.282 INFO:tasks.workunit.client.1.smithi176.stdout:6/617: rmdir d2 39 2024-09-21T12:47:02.284 INFO:tasks.workunit.client.1.smithi176.stdout:1/689: mkdir d0/db/d1a/d2c/d6b/dd7/dfd 0 2024-09-21T12:47:02.286 INFO:tasks.workunit.client.0.smithi046.stdout:9/126: dwrite ff [0,4194304] 0 2024-09-21T12:47:02.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/204: dread d6/f40 [0,4194304] 0 2024-09-21T12:47:02.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/148: creat d4/f2e x:0 0 0 2024-09-21T12:47:02.293 INFO:tasks.workunit.client.1.smithi176.stdout:3/752: unlink d1/d35/d5e/d90/fa6 0 2024-09-21T12:47:02.296 INFO:tasks.workunit.client.1.smithi176.stdout:8/646: creat d6/d8/d24/d35/d51/fc9 x:0 0 0 2024-09-21T12:47:02.298 INFO:tasks.workunit.client.0.smithi046.stdout:6/125: link de/c12 de/c21 0 2024-09-21T12:47:02.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/126: write de/f1d [923347,15574] 0 2024-09-21T12:47:02.302 INFO:tasks.workunit.client.1.smithi176.stdout:8/647: dwrite d6/db/d13/f26 [0,4194304] 0 2024-09-21T12:47:02.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/141: rename d4/c6 to d4/d13/c39 0 2024-09-21T12:47:02.305 INFO:tasks.workunit.client.0.smithi046.stdout:9/127: fsync d11/f18 0 2024-09-21T12:47:02.306 INFO:tasks.workunit.client.1.smithi176.stdout:0/797: dwrite d9/d1a/d1d/d23/da1/da3/d1e/f6f [0,4194304] 0 2024-09-21T12:47:02.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/150: link d1/ff d1/d13/f31 0 2024-09-21T12:47:02.309 INFO:tasks.workunit.client.1.smithi176.stdout:4/659: creat d3/d21/d27/fee x:0 0 0 2024-09-21T12:47:02.309 INFO:tasks.workunit.client.0.smithi046.stdout:4/151: fsync d1/fd 0 2024-09-21T12:47:02.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/128: dwrite f10 [0,4194304] 0 2024-09-21T12:47:02.315 INFO:tasks.workunit.client.0.smithi046.stdout:9/129: readlink d11/d19/d1b/d1c/l1e 0 2024-09-21T12:47:02.316 INFO:tasks.workunit.client.1.smithi176.stdout:4/660: dwrite d3/d5/d37/f68 [0,4194304] 0 2024-09-21T12:47:02.316 INFO:tasks.workunit.client.0.smithi046.stdout:9/130: truncate f6 4688917 0 2024-09-21T12:47:02.317 INFO:tasks.workunit.client.1.smithi176.stdout:4/661: read - d3/d42/dae/fc3 zero size 2024-09-21T12:47:02.319 INFO:tasks.workunit.client.1.smithi176.stdout:9/644: unlink d1/df/d23/c52 0 2024-09-21T12:47:02.321 INFO:tasks.workunit.client.0.smithi046.stdout:7/92: symlink d2/d4/l20 0 2024-09-21T12:47:02.325 INFO:tasks.workunit.client.0.smithi046.stdout:5/149: write d4/fa [4693160,59008] 0 2024-09-21T12:47:02.327 INFO:tasks.workunit.client.0.smithi046.stdout:5/150: write d4/f2e [104211,112415] 0 2024-09-21T12:47:02.327 INFO:tasks.workunit.client.0.smithi046.stdout:6/127: mknod de/c22 0 2024-09-21T12:47:02.328 INFO:tasks.workunit.client.1.smithi176.stdout:5/567: dwrite d0/d13/f29 [4194304,4194304] 0 2024-09-21T12:47:02.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/128: write f3 [1138628,92385] 0 2024-09-21T12:47:02.330 INFO:tasks.workunit.client.0.smithi046.stdout:1/142: symlink d4/d29/l3a 0 2024-09-21T12:47:02.336 INFO:tasks.workunit.client.1.smithi176.stdout:3/753: symlink d1/d34/d57/dd0/l114 0 2024-09-21T12:47:02.337 INFO:tasks.workunit.client.0.smithi046.stdout:0/205: rmdir d6/d7/d13/d2a 39 2024-09-21T12:47:02.340 INFO:tasks.workunit.client.1.smithi176.stdout:5/568: dwrite d0/d13/d63/d2e/d71/f95 [0,4194304] 0 2024-09-21T12:47:02.341 INFO:tasks.workunit.client.1.smithi176.stdout:2/671: dread d4/df/d2e/d6f/f2c [0,4194304] 0 2024-09-21T12:47:02.343 INFO:tasks.workunit.client.1.smithi176.stdout:2/672: read d4/df/d2e/d6f/d5d/d67/fb4 [2000708,21176] 0 2024-09-21T12:47:02.344 INFO:tasks.workunit.client.1.smithi176.stdout:8/648: read d6/d8/d24/d35/d51/f78 [2788612,39325] 0 2024-09-21T12:47:02.344 INFO:tasks.workunit.client.1.smithi176.stdout:2/673: write d4/df/fc1 [749288,3605] 0 2024-09-21T12:47:02.344 INFO:tasks.workunit.client.0.smithi046.stdout:9/131: mkdir d11/d19/d20/d26 0 2024-09-21T12:47:02.345 INFO:tasks.workunit.client.1.smithi176.stdout:8/649: fsync d6/db/d37/d7a/fc4 0 2024-09-21T12:47:02.346 INFO:tasks.workunit.client.1.smithi176.stdout:2/674: write d4/df/d2e/d39/d55/fac [4880334,61704] 0 2024-09-21T12:47:02.346 INFO:tasks.workunit.client.1.smithi176.stdout:0/798: unlink d9/d1a/d1d/d23/dd3/dee/cf7 0 2024-09-21T12:47:02.351 INFO:tasks.workunit.client.1.smithi176.stdout:7/770: getdents d0/d2/db/d10/d31/da0 0 2024-09-21T12:47:02.352 INFO:tasks.workunit.client.1.smithi176.stdout:7/771: stat d0/d2/d30/d93/d96/l8b 0 2024-09-21T12:47:02.353 INFO:tasks.workunit.client.1.smithi176.stdout:7/772: write d0/d5d/fc2 [308211,127786] 0 2024-09-21T12:47:02.353 INFO:tasks.workunit.client.0.smithi046.stdout:6/129: mkdir de/d23 0 2024-09-21T12:47:02.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/143: fdatasync d4/d13/f14 0 2024-09-21T12:47:02.357 INFO:tasks.workunit.client.1.smithi176.stdout:9/645: creat d1/df/d48/d69/d76/d7c/fd9 x:0 0 0 2024-09-21T12:47:02.358 INFO:tasks.workunit.client.1.smithi176.stdout:9/646: write d1/df/d48/d69/f6f [2162969,66928] 0 2024-09-21T12:47:02.365 INFO:tasks.workunit.client.1.smithi176.stdout:3/754: creat d1/d5/d25/d61/f115 x:0 0 0 2024-09-21T12:47:02.366 INFO:tasks.workunit.client.1.smithi176.stdout:3/755: write d1/d5/d25/d84/fc8 [1867119,37234] 0 2024-09-21T12:47:02.366 INFO:tasks.workunit.client.1.smithi176.stdout:5/569: mkdir d0/d13/d5d/d98/d9b/dad 0 2024-09-21T12:47:02.367 INFO:tasks.workunit.client.1.smithi176.stdout:3/756: chown d1/d34/d57/l70 1186782 1 2024-09-21T12:47:02.367 INFO:tasks.workunit.client.1.smithi176.stdout:5/570: chown d0/d13/d5d/c67 28898 1 2024-09-21T12:47:02.370 INFO:tasks.workunit.client.1.smithi176.stdout:6/618: write d2/dd/d26/d2b/d10/f12 [193967,121412] 0 2024-09-21T12:47:02.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/144: rmdir d4/d13 39 2024-09-21T12:47:02.372 INFO:tasks.workunit.client.1.smithi176.stdout:1/690: write d0/db/d1a/d73/f85 [553244,119164] 0 2024-09-21T12:47:02.375 INFO:tasks.workunit.client.0.smithi046.stdout:4/152: link d1/l12 d1/d13/d25/d29/d2d/l32 0 2024-09-21T12:47:02.377 INFO:tasks.workunit.client.0.smithi046.stdout:4/153: write d1/fd [2195194,8769] 0 2024-09-21T12:47:02.377 INFO:tasks.workunit.client.1.smithi176.stdout:2/675: mkdir d4/df/d2e/d6f/d5d/d81/db2/da5/dcc 0 2024-09-21T12:47:02.378 INFO:tasks.workunit.client.0.smithi046.stdout:4/154: write d1/d13/d25/d29/f2f [481000,3078] 0 2024-09-21T12:47:02.379 INFO:tasks.workunit.client.0.smithi046.stdout:7/93: rmdir d2/d4/df/d14 0 2024-09-21T12:47:02.380 INFO:tasks.workunit.client.1.smithi176.stdout:0/799: rmdir d9/d1a/d3f/d10d/dcc 39 2024-09-21T12:47:02.382 INFO:tasks.workunit.client.1.smithi176.stdout:2/676: dread d4/df/d2e/d6f/d6d/f71 [0,4194304] 0 2024-09-21T12:47:02.382 INFO:tasks.workunit.client.0.smithi046.stdout:9/132: creat d11/d19/d20/d26/f27 x:0 0 0 2024-09-21T12:47:02.383 INFO:tasks.workunit.client.1.smithi176.stdout:4/662: symlink d3/d5/lef 0 2024-09-21T12:47:02.383 INFO:tasks.workunit.client.1.smithi176.stdout:4/663: chown d3/d42/dae/dde 2717 1 2024-09-21T12:47:02.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/151: link d4/l11 d4/d16/l2f 0 2024-09-21T12:47:02.384 INFO:tasks.workunit.client.1.smithi176.stdout:4/664: write d3/d5/db/f50 [3994584,24892] 0 2024-09-21T12:47:02.385 INFO:tasks.workunit.client.1.smithi176.stdout:7/773: rename d0/d5d/fd5 to d0/d2/db/d10/d23/da6/d105/f119 0 2024-09-21T12:47:02.387 INFO:tasks.workunit.client.1.smithi176.stdout:9/647: unlink d1/df/d48/d69/d76/cc1 0 2024-09-21T12:47:02.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/155: mkdir d1/d13/d25/d29/d33 0 2024-09-21T12:47:02.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.388+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9344062630 con 0x7f9330074ad0 2024-09-21T12:47:02.390 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:02 smithi046 ceph-mon[27868]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:02.390 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:02 smithi046 ceph-mon[27868]: pgmap v27: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 44 MiB/s rd, 194 MiB/s wr, 358 op/s 2024-09-21T12:47:02.390 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:02 smithi046 ceph-mon[27868]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:02.390 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:02 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2737243610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.390+0000 7f933a7fc640 1 -- 172.21.15.46:0/3499797253 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f9344062630 con 0x7f9330074ad0 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:47:02.391 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:47:02.392 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:47:02.392 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:02 smithi176 ceph-mon[35476]: from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:02.392 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:02 smithi176 ceph-mon[35476]: pgmap v27: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 44 MiB/s rd, 194 MiB/s wr, 358 op/s 2024-09-21T12:47:02.392 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:02 smithi176 ceph-mon[35476]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:02.392 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:02 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2737243610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9330074ad0 msgr2=0x7f9330076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9330074ad0 0x7f9330076f90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f93400095f0 tx=0x7f934000b190 comp rx=0 tx=0).stop 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 msgr2=0x7f9344199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 0x7f9344199a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f93340058c0 tx=0x7f9334009be0 comp rx=0 tx=0).stop 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 shutdown_connections 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f9330074ad0 0x7f9330076f90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9344101a60 0x7f9344199a30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 --2- 172.21.15.46:0/3499797253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9344100860 0x7f93441994f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 >> 172.21.15.46:0/3499797253 conn(0x7f93440fc010 msgr2=0x7f9344104e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 shutdown_connections 2024-09-21T12:47:02.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:02.392+0000 7f934b7d5640 1 -- 172.21.15.46:0/3499797253 wait complete. 2024-09-21T12:47:02.395 INFO:tasks.workunit.client.1.smithi176.stdout:0/800: dread d9/d1a/d1d/d23/da1/da3/d93/df9/d77/fb6 [4194304,4194304] 0 2024-09-21T12:47:02.405 INFO:tasks.workunit.client.1.smithi176.stdout:9/648: dread d1/d61/d73/d7d/fcb [0,4194304] 0 2024-09-21T12:47:02.416 INFO:tasks.workunit.client.1.smithi176.stdout:9/649: dread d1/df/d23/d67/fb8 [0,4194304] 0 2024-09-21T12:47:02.417 INFO:tasks.workunit.client.1.smithi176.stdout:9/650: truncate d1/f5d 4570655 0 2024-09-21T12:47:02.535 INFO:tasks.workunit.client.0.smithi046.stdout:7/94: symlink d2/d4/df/d17/l21 0 2024-09-21T12:47:02.536 INFO:tasks.workunit.client.0.smithi046.stdout:5/152: unlink d4/d16/l1e 0 2024-09-21T12:47:02.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/130: rmdir de/d23 0 2024-09-21T12:47:02.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/131: chown de/l1b 2027 1 2024-09-21T12:47:02.539 INFO:tasks.workunit.client.0.smithi046.stdout:0/206: link l2 d6/d7/d13/d2a/d38/l4e 0 2024-09-21T12:47:02.539 INFO:tasks.workunit.client.1.smithi176.stdout:3/757: dwrite d1/d35/fbd [0,4194304] 0 2024-09-21T12:47:02.540 INFO:tasks.workunit.client.1.smithi176.stdout:3/758: write d1/d5/d25/d61/fa5 [6655982,111856] 0 2024-09-21T12:47:02.545 INFO:tasks.workunit.client.0.smithi046.stdout:7/95: mknod d2/d4/c22 0 2024-09-21T12:47:02.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/207: dwrite d6/f42 [0,4194304] 0 2024-09-21T12:47:02.549 INFO:tasks.workunit.client.0.smithi046.stdout:0/208: chown d6/d7/d13/l39 208638 1 2024-09-21T12:47:02.553 INFO:tasks.workunit.client.0.smithi046.stdout:1/145: creat d4/d13/d38/f3b x:0 0 0 2024-09-21T12:47:02.553 INFO:tasks.workunit.client.0.smithi046.stdout:1/146: chown d4/l8 246 1 2024-09-21T12:47:02.554 INFO:tasks.workunit.client.1.smithi176.stdout:8/650: rename d6/d8/d24/d35/d9b to d6/d8/d54/dca 0 2024-09-21T12:47:02.556 INFO:tasks.workunit.client.0.smithi046.stdout:6/132: truncate de/f16 1165265 0 2024-09-21T12:47:02.556 INFO:tasks.workunit.client.1.smithi176.stdout:8/651: read d6/db/d37/d89/f8d [3979899,77415] 0 2024-09-21T12:47:02.557 INFO:tasks.workunit.client.0.smithi046.stdout:6/133: dread - de/f18 zero size 2024-09-21T12:47:02.557 INFO:tasks.workunit.client.1.smithi176.stdout:7/774: creat d0/d5d/d7a/f11a x:0 0 0 2024-09-21T12:47:02.558 INFO:tasks.workunit.client.1.smithi176.stdout:8/652: chown d6/db/d37/d89/d8a 6668 1 2024-09-21T12:47:02.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/96: mknod d2/d4/df/c23 0 2024-09-21T12:47:02.566 INFO:tasks.workunit.client.0.smithi046.stdout:5/153: chown d4/l11 219 1 2024-09-21T12:47:02.567 INFO:tasks.workunit.client.0.smithi046.stdout:5/154: stat d4/dc/d13/d15 0 2024-09-21T12:47:02.569 INFO:tasks.workunit.client.1.smithi176.stdout:4/665: write d3/f3c [371112,110756] 0 2024-09-21T12:47:02.570 INFO:tasks.workunit.client.0.smithi046.stdout:4/156: dwrite d1/d13/f16 [0,4194304] 0 2024-09-21T12:47:02.571 INFO:tasks.workunit.client.0.smithi046.stdout:5/155: truncate d4/d22/d10/d1a/f29 643117 0 2024-09-21T12:47:02.574 INFO:tasks.workunit.client.0.smithi046.stdout:6/134: symlink de/l24 0 2024-09-21T12:47:02.577 INFO:tasks.workunit.client.0.smithi046.stdout:9/133: getdents d11/d19/d1b/d1c 0 2024-09-21T12:47:02.578 INFO:tasks.workunit.client.0.smithi046.stdout:0/209: dwrite d6/d7/d37/f48 [0,4194304] 0 2024-09-21T12:47:02.579 INFO:tasks.workunit.client.0.smithi046.stdout:9/134: write d11/d19/d20/d26/f27 [660174,50396] 0 2024-09-21T12:47:02.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/135: write d11/d19/f24 [331140,23320] 0 2024-09-21T12:47:02.585 INFO:tasks.workunit.client.0.smithi046.stdout:7/97: rename d2/d4/df/c16 to d2/dd/c24 0 2024-09-21T12:47:02.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/157: symlink d1/d13/d25/l34 0 2024-09-21T12:47:02.590 INFO:tasks.workunit.client.0.smithi046.stdout:6/135: rmdir de 39 2024-09-21T12:47:02.593 INFO:tasks.workunit.client.0.smithi046.stdout:0/210: readlink l2 0 2024-09-21T12:47:02.597 INFO:tasks.workunit.client.0.smithi046.stdout:9/136: rmdir d11/d19 39 2024-09-21T12:47:02.599 INFO:tasks.workunit.client.0.smithi046.stdout:5/156: rename d4/d16/l2c to d4/dc/l30 0 2024-09-21T12:47:02.610 INFO:tasks.workunit.client.0.smithi046.stdout:6/136: dread de/f17 [0,4194304] 0 2024-09-21T12:47:02.613 INFO:tasks.workunit.client.0.smithi046.stdout:5/157: mknod d4/dc/d28/c31 0 2024-09-21T12:47:02.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/147: link d4/d29/c35 d4/d29/c3c 0 2024-09-21T12:47:02.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/158: link d1/f26 d1/f35 0 2024-09-21T12:47:02.620 INFO:tasks.workunit.client.0.smithi046.stdout:7/98: dwrite d2/d4/f8 [0,4194304] 0 2024-09-21T12:47:02.622 INFO:tasks.workunit.client.0.smithi046.stdout:6/137: dwrite de/f15 [0,4194304] 0 2024-09-21T12:47:02.622 INFO:tasks.workunit.client.0.smithi046.stdout:0/211: mkdir d6/d4f 0 2024-09-21T12:47:02.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/212: write d6/f21 [3007068,82302] 0 2024-09-21T12:47:02.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/148: dread d4/d13/f1c [4194304,4194304] 0 2024-09-21T12:47:02.628 INFO:tasks.workunit.client.0.smithi046.stdout:1/149: dread - d4/d13/f2e zero size 2024-09-21T12:47:02.630 INFO:tasks.workunit.client.0.smithi046.stdout:9/137: mknod d11/d19/d1b/d1c/d1f/c28 0 2024-09-21T12:47:02.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/138: rename d11/d19/d1b/d1c/d1f to d11/d19/d1b/d1c/d1f/d29 22 2024-09-21T12:47:02.632 INFO:tasks.workunit.client.0.smithi046.stdout:9/139: chown d11/d19/d1b 1688445 1 2024-09-21T12:47:02.634 INFO:tasks.workunit.client.0.smithi046.stdout:9/140: write d11/d19/d1b/f25 [533904,28834] 0 2024-09-21T12:47:02.635 INFO:tasks.workunit.client.0.smithi046.stdout:7/99: symlink d2/d4/l25 0 2024-09-21T12:47:02.647 INFO:tasks.workunit.client.0.smithi046.stdout:7/100: truncate d2/fa 793134 0 2024-09-21T12:47:02.647 INFO:tasks.workunit.client.1.smithi176.stdout:9/651: rmdir d1/d8b 39 2024-09-21T12:47:02.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/101: readlink d2/d4/df/d17/l1e 0 2024-09-21T12:47:02.649 INFO:tasks.workunit.client.1.smithi176.stdout:5/571: mknod d0/d13/d5d/d98/da5/cae 0 2024-09-21T12:47:02.649 INFO:tasks.workunit.client.0.smithi046.stdout:7/102: write d2/d4/df/f1d [47200,42444] 0 2024-09-21T12:47:02.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/103: fdatasync d2/d4/f1c 0 2024-09-21T12:47:02.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/141: symlink d11/l2a 0 2024-09-21T12:47:02.656 INFO:tasks.workunit.client.0.smithi046.stdout:9/142: write d11/d19/f1a [238564,129729] 0 2024-09-21T12:47:02.656 INFO:tasks.workunit.client.1.smithi176.stdout:3/759: creat d1/d8d/dfd/f116 x:0 0 0 2024-09-21T12:47:02.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/150: dread d4/f1b [0,4194304] 0 2024-09-21T12:47:02.660 INFO:tasks.workunit.client.0.smithi046.stdout:0/213: link d6/f1a d6/d7/d9/f50 0 2024-09-21T12:47:02.663 INFO:tasks.workunit.client.1.smithi176.stdout:7/775: mkdir d0/d2/d30/d93/d96/d89/d11b 0 2024-09-21T12:47:02.664 INFO:tasks.workunit.client.1.smithi176.stdout:7/776: write d0/d2/da8/dbe/fd2 [518829,113443] 0 2024-09-21T12:47:02.666 INFO:tasks.workunit.client.1.smithi176.stdout:7/777: write d0/d2/db/d10/d72/d51/fa7 [4284613,1346] 0 2024-09-21T12:47:02.666 INFO:tasks.workunit.client.0.smithi046.stdout:5/158: write d4/d22/d10/d1a/f1c [3268724,56855] 0 2024-09-21T12:47:02.667 INFO:tasks.workunit.client.0.smithi046.stdout:5/159: stat d4/d22/d10/l1d 0 2024-09-21T12:47:02.667 INFO:tasks.workunit.client.1.smithi176.stdout:0/801: symlink d9/d1a/d3f/d10d/dcc/l11e 0 2024-09-21T12:47:02.668 INFO:tasks.workunit.client.1.smithi176.stdout:0/802: truncate d9/d1a/fd0 1608615 0 2024-09-21T12:47:02.669 INFO:tasks.workunit.client.1.smithi176.stdout:0/803: chown d9/d1a/d1d/d22/c10a 81105652 1 2024-09-21T12:47:02.670 INFO:tasks.workunit.client.0.smithi046.stdout:0/214: unlink d6/d7/d9/f4a 0 2024-09-21T12:47:02.674 INFO:tasks.workunit.client.0.smithi046.stdout:5/160: dwrite d4/d22/d10/d1a/f1c [4194304,4194304] 0 2024-09-21T12:47:02.675 INFO:tasks.workunit.client.1.smithi176.stdout:5/572: mkdir d0/d13/d63/d8d/daf 0 2024-09-21T12:47:02.676 INFO:tasks.workunit.client.0.smithi046.stdout:5/161: dread d4/d22/d10/d1a/f29 [0,4194304] 0 2024-09-21T12:47:02.679 INFO:tasks.workunit.client.1.smithi176.stdout:3/760: mknod d1/d34/d48/deb/c117 0 2024-09-21T12:47:02.682 INFO:tasks.workunit.client.0.smithi046.stdout:1/151: rename d4/cc to d4/c3d 0 2024-09-21T12:47:02.683 INFO:tasks.workunit.client.0.smithi046.stdout:4/159: write d1/d13/f31 [1590154,123698] 0 2024-09-21T12:47:02.683 INFO:tasks.workunit.client.0.smithi046.stdout:1/152: dread - d4/d13/f1d zero size 2024-09-21T12:47:02.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/153: readlink d4/d13/l2b 0 2024-09-21T12:47:02.685 INFO:tasks.workunit.client.0.smithi046.stdout:0/215: mkdir d6/d7/d13/d49/d51 0 2024-09-21T12:47:02.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/138: truncate de/f15 1043901 0 2024-09-21T12:47:02.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/154: dread d4/f1f [0,4194304] 0 2024-09-21T12:47:02.688 INFO:tasks.workunit.client.1.smithi176.stdout:1/691: truncate d0/db/d2a/fca 3947132 0 2024-09-21T12:47:02.689 INFO:tasks.workunit.client.1.smithi176.stdout:7/778: read d0/d2/f42 [1544920,124110] 0 2024-09-21T12:47:02.689 INFO:tasks.workunit.client.1.smithi176.stdout:0/804: fsync d9/d1a/d1d/d23/da1/da3/f5d 0 2024-09-21T12:47:02.690 INFO:tasks.workunit.client.1.smithi176.stdout:4/666: mkdir d3/d5/db/df0 0 2024-09-21T12:47:02.690 INFO:tasks.workunit.client.1.smithi176.stdout:7/779: write d0/d2/da8/dbe/f111 [38870,101978] 0 2024-09-21T12:47:02.692 INFO:tasks.workunit.client.1.smithi176.stdout:9/652: symlink d1/df/d48/d69/d76/dd8/lda 0 2024-09-21T12:47:02.693 INFO:tasks.workunit.client.1.smithi176.stdout:0/805: dread d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/f96 [0,4194304] 0 2024-09-21T12:47:02.694 INFO:tasks.workunit.client.0.smithi046.stdout:0/216: write d6/d7/f12 [610029,130423] 0 2024-09-21T12:47:02.694 INFO:tasks.workunit.client.1.smithi176.stdout:5/573: fdatasync d0/d13/f32 0 2024-09-21T12:47:02.697 INFO:tasks.workunit.client.1.smithi176.stdout:6/619: getdents d2 0 2024-09-21T12:47:02.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/155: chown d4/d13/c39 515367 1 2024-09-21T12:47:02.698 INFO:tasks.workunit.client.0.smithi046.stdout:0/217: dread d6/d7/f12 [4194304,4194304] 0 2024-09-21T12:47:02.699 INFO:tasks.workunit.client.1.smithi176.stdout:3/761: write d1/d5/d25/d40/f113 [969616,16056] 0 2024-09-21T12:47:02.700 INFO:tasks.workunit.client.1.smithi176.stdout:2/677: link d4/d40/ca0 d4/df/d2e/d39/d55/ccd 0 2024-09-21T12:47:02.701 INFO:tasks.workunit.client.1.smithi176.stdout:2/678: chown d4/df/d4b/fae 372 1 2024-09-21T12:47:02.704 INFO:tasks.workunit.client.0.smithi046.stdout:7/104: write d2/d4/df/f10 [324514,104857] 0 2024-09-21T12:47:02.705 INFO:tasks.workunit.client.1.smithi176.stdout:8/653: rename d6/db/d32/l84 to d6/lcb 0 2024-09-21T12:47:02.706 INFO:tasks.workunit.client.0.smithi046.stdout:9/143: dwrite f2 [0,4194304] 0 2024-09-21T12:47:02.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/156: dwrite d4/d13/f23 [0,4194304] 0 2024-09-21T12:47:02.708 INFO:tasks.workunit.client.1.smithi176.stdout:0/806: dread d9/d1a/d1d/d23/f5b [0,4194304] 0 2024-09-21T12:47:02.708 INFO:tasks.workunit.client.0.smithi046.stdout:1/157: readlink d4/l8 0 2024-09-21T12:47:02.708 INFO:tasks.workunit.client.1.smithi176.stdout:0/807: chown d9/d35/f7d 10175 1 2024-09-21T12:47:02.709 INFO:tasks.workunit.client.1.smithi176.stdout:0/808: readlink d9/d1a/d1d/la9 0 2024-09-21T12:47:02.712 INFO:tasks.workunit.client.1.smithi176.stdout:7/780: mknod d0/d2/d30/d93/d96/d89/c11c 0 2024-09-21T12:47:02.722 INFO:tasks.workunit.client.1.smithi176.stdout:8/654: creat d6/db/d37/d89/d8a/fcc x:0 0 0 2024-09-21T12:47:02.722 INFO:tasks.workunit.client.0.smithi046.stdout:0/218: mkdir d6/d7/d13/d43/d52 0 2024-09-21T12:47:02.724 INFO:tasks.workunit.client.1.smithi176.stdout:1/692: creat d0/dec/ffe x:0 0 0 2024-09-21T12:47:02.725 INFO:tasks.workunit.client.0.smithi046.stdout:4/160: getdents d1 0 2024-09-21T12:47:02.733 INFO:tasks.workunit.client.1.smithi176.stdout:7/781: dread - d0/f6f zero size 2024-09-21T12:47:02.733 INFO:tasks.workunit.client.1.smithi176.stdout:7/782: fdatasync d0/d5d/d5e/f77 0 2024-09-21T12:47:02.733 INFO:tasks.workunit.client.0.smithi046.stdout:1/158: truncate d4/d13/f36 991682 0 2024-09-21T12:47:02.734 INFO:tasks.workunit.client.1.smithi176.stdout:7/783: write d0/d2/db/d10/fbf [804298,11535] 0 2024-09-21T12:47:02.735 INFO:tasks.workunit.client.1.smithi176.stdout:7/784: chown d0/d2/db/d10/d72/d51/f6e 19949 1 2024-09-21T12:47:02.735 INFO:tasks.workunit.client.0.smithi046.stdout:0/219: mkdir d6/d7/d37/d53 0 2024-09-21T12:47:02.736 INFO:tasks.workunit.client.1.smithi176.stdout:7/785: dread - d0/d2/db/d10/d31/ddc/ff5 zero size 2024-09-21T12:47:02.737 INFO:tasks.workunit.client.1.smithi176.stdout:7/786: dread - d0/d5d/ffa zero size 2024-09-21T12:47:02.737 INFO:tasks.workunit.client.0.smithi046.stdout:7/105: dread d2/d4/df/f10 [0,4194304] 0 2024-09-21T12:47:02.737 INFO:tasks.workunit.client.0.smithi046.stdout:6/139: write de/f13 [1566119,2133] 0 2024-09-21T12:47:02.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/161: rmdir d1/d13/d25/d29/d2d 39 2024-09-21T12:47:02.738 INFO:tasks.workunit.client.0.smithi046.stdout:0/220: write d6/d7/d13/d2a/d31/f27 [4075208,72280] 0 2024-09-21T12:47:02.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/159: mknod d4/d13/d38/c3e 0 2024-09-21T12:47:02.741 INFO:tasks.workunit.client.1.smithi176.stdout:7/787: dread d0/f17 [0,4194304] 0 2024-09-21T12:47:02.741 INFO:tasks.workunit.client.0.smithi046.stdout:1/160: read d4/f2c [3588016,86065] 0 2024-09-21T12:47:02.743 INFO:tasks.workunit.client.0.smithi046.stdout:1/161: truncate d4/d13/f27 923923 0 2024-09-21T12:47:02.745 INFO:tasks.workunit.client.0.smithi046.stdout:6/140: symlink de/l25 0 2024-09-21T12:47:02.748 INFO:tasks.workunit.client.1.smithi176.stdout:5/574: dwrite d0/d13/f3c [0,4194304] 0 2024-09-21T12:47:02.750 INFO:tasks.workunit.client.0.smithi046.stdout:4/162: symlink d1/l36 0 2024-09-21T12:47:02.750 INFO:tasks.workunit.client.1.smithi176.stdout:5/575: fdatasync d0/d13/d63/d2e/d39/d3b/f47 0 2024-09-21T12:47:02.750 INFO:tasks.workunit.client.1.smithi176.stdout:5/576: write d0/d13/d63/d2e/d39/d41/f6c [3096000,122029] 0 2024-09-21T12:47:02.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/163: chown d1/f26 7933796 1 2024-09-21T12:47:02.751 INFO:tasks.workunit.client.0.smithi046.stdout:7/106: dwrite d2/fe [0,4194304] 0 2024-09-21T12:47:02.752 INFO:tasks.workunit.client.1.smithi176.stdout:8/655: rename d6/db/d37/d89/d8a/da6/lc2 to d6/db/d13/lcd 0 2024-09-21T12:47:02.752 INFO:tasks.workunit.client.1.smithi176.stdout:8/656: chown d6/db/d37/d89 369939 1 2024-09-21T12:47:02.752 INFO:tasks.workunit.client.0.smithi046.stdout:4/164: write d1/d13/f30 [160540,81815] 0 2024-09-21T12:47:02.757 INFO:tasks.workunit.client.0.smithi046.stdout:9/144: truncate f2 656096 0 2024-09-21T12:47:02.760 INFO:tasks.workunit.client.1.smithi176.stdout:4/667: creat d3/d5/ff1 x:0 0 0 2024-09-21T12:47:02.762 INFO:tasks.workunit.client.0.smithi046.stdout:6/141: creat de/f26 x:0 0 0 2024-09-21T12:47:02.762 INFO:tasks.workunit.client.0.smithi046.stdout:6/142: stat de/f20 0 2024-09-21T12:47:02.765 INFO:tasks.workunit.client.1.smithi176.stdout:2/679: truncate d4/df/f1c 1207471 0 2024-09-21T12:47:02.766 INFO:tasks.workunit.client.1.smithi176.stdout:8/657: dread d6/d16/f1e [0,4194304] 0 2024-09-21T12:47:02.769 INFO:tasks.workunit.client.0.smithi046.stdout:4/165: dread d1/f26 [0,4194304] 0 2024-09-21T12:47:02.771 INFO:tasks.workunit.client.1.smithi176.stdout:6/620: rmdir d2/dd/d26/d2b/d10/d8c 0 2024-09-21T12:47:02.772 INFO:tasks.workunit.client.1.smithi176.stdout:3/762: creat d1/d35/d5e/f118 x:0 0 0 2024-09-21T12:47:02.774 INFO:tasks.workunit.client.0.smithi046.stdout:9/145: symlink d11/d19/d20/l2b 0 2024-09-21T12:47:02.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/146: write d11/f12 [1802084,130700] 0 2024-09-21T12:47:02.776 INFO:tasks.workunit.client.0.smithi046.stdout:1/162: creat d4/d29/d32/f3f x:0 0 0 2024-09-21T12:47:02.781 INFO:tasks.workunit.client.1.smithi176.stdout:5/577: truncate d0/f52 1109037 0 2024-09-21T12:47:02.783 INFO:tasks.workunit.client.1.smithi176.stdout:7/788: dwrite d0/d2/d30/d93/da2/fd8 [0,4194304] 0 2024-09-21T12:47:02.786 INFO:tasks.workunit.client.0.smithi046.stdout:6/143: dwrite de/f15 [0,4194304] 0 2024-09-21T12:47:02.786 INFO:tasks.workunit.client.0.smithi046.stdout:4/166: mkdir d1/d27/d37 0 2024-09-21T12:47:02.791 INFO:tasks.workunit.client.0.smithi046.stdout:9/147: mknod d11/d19/d1b/d1c/d1f/c2c 0 2024-09-21T12:47:02.795 INFO:tasks.workunit.client.0.smithi046.stdout:1/163: creat d4/d29/d32/f40 x:0 0 0 2024-09-21T12:47:02.797 INFO:tasks.workunit.client.0.smithi046.stdout:0/221: getdents d6/d2f 0 2024-09-21T12:47:02.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/148: dwrite d11/d19/d20/d26/f27 [0,4194304] 0 2024-09-21T12:47:02.801 INFO:tasks.workunit.client.0.smithi046.stdout:6/144: rename de/l25 to de/l27 0 2024-09-21T12:47:02.809 INFO:tasks.workunit.client.0.smithi046.stdout:1/164: creat d4/d29/f41 x:0 0 0 2024-09-21T12:47:02.813 INFO:tasks.workunit.client.0.smithi046.stdout:6/145: creat de/f28 x:0 0 0 2024-09-21T12:47:02.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/149: symlink d11/d19/d1b/d1c/d1f/l2d 0 2024-09-21T12:47:02.817 INFO:tasks.workunit.client.0.smithi046.stdout:4/167: dread d1/d13/f31 [0,4194304] 0 2024-09-21T12:47:02.818 INFO:tasks.workunit.client.0.smithi046.stdout:1/165: dwrite d4/d13/f2f [0,4194304] 0 2024-09-21T12:47:02.821 INFO:tasks.workunit.client.0.smithi046.stdout:0/222: getdents d6/d7/d13/d2a/d38 0 2024-09-21T12:47:02.821 INFO:tasks.workunit.client.0.smithi046.stdout:6/146: mknod de/c29 0 2024-09-21T12:47:02.824 INFO:tasks.workunit.client.0.smithi046.stdout:9/150: rename ff to d11/d19/d1b/d1c/f2e 0 2024-09-21T12:47:02.826 INFO:tasks.workunit.client.0.smithi046.stdout:4/168: mkdir d1/d13/d25/d38 0 2024-09-21T12:47:02.831 INFO:tasks.workunit.client.0.smithi046.stdout:6/147: mkdir de/d2a 0 2024-09-21T12:47:02.833 INFO:tasks.workunit.client.0.smithi046.stdout:4/169: creat d1/f39 x:0 0 0 2024-09-21T12:47:02.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/170: mkdir d1/d13/d25/d3a 0 2024-09-21T12:47:02.839 INFO:tasks.workunit.client.0.smithi046.stdout:1/166: getdents d4/d13/d38 0 2024-09-21T12:47:02.840 INFO:tasks.workunit.client.0.smithi046.stdout:1/167: fsync d4/d13/f1c 0 2024-09-21T12:47:02.841 INFO:tasks.workunit.client.0.smithi046.stdout:9/151: truncate f3 664271 0 2024-09-21T12:47:02.841 INFO:tasks.workunit.client.0.smithi046.stdout:0/223: dwrite f5 [0,4194304] 0 2024-09-21T12:47:02.841 INFO:tasks.workunit.client.0.smithi046.stdout:1/168: readlink d4/d13/l34 0 2024-09-21T12:47:02.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/152: chown l7 418 1 2024-09-21T12:47:02.843 INFO:tasks.workunit.client.1.smithi176.stdout:1/693: creat d0/db/d1a/d2c/dc5/d2b/d43/dfa/fff x:0 0 0 2024-09-21T12:47:02.843 INFO:tasks.workunit.client.1.smithi176.stdout:4/668: rmdir d3/d5/db/d96/da3 39 2024-09-21T12:47:02.843 INFO:tasks.workunit.client.1.smithi176.stdout:9/653: getdents d1/d61/d73/db6 0 2024-09-21T12:47:02.843 INFO:tasks.workunit.client.1.smithi176.stdout:2/680: creat d4/df/d2e/d39/db7/d80/fce x:0 0 0 2024-09-21T12:47:02.843 INFO:tasks.workunit.client.1.smithi176.stdout:3/763: creat d1/d34/d5d/d78/d10b/dd2/f119 x:0 0 0 2024-09-21T12:47:02.844 INFO:tasks.workunit.client.0.smithi046.stdout:4/171: mknod d1/d13/d25/c3b 0 2024-09-21T12:47:02.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/148: link de/l24 de/l2b 0 2024-09-21T12:47:02.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/153: write f4 [612222,18562] 0 2024-09-21T12:47:02.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/224: mkdir d6/d7/d9/d54 0 2024-09-21T12:47:02.845 INFO:tasks.workunit.client.1.smithi176.stdout:7/789: chown d0/d5d/d8a/l99 3858 1 2024-09-21T12:47:02.846 INFO:tasks.workunit.client.1.smithi176.stdout:0/809: link d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd/cd7 d9/d1a/d1d/d81/c11f 0 2024-09-21T12:47:02.848 INFO:tasks.workunit.client.0.smithi046.stdout:1/169: rename d4/d13/f14 to d4/d13/d38/f42 0 2024-09-21T12:47:02.849 INFO:tasks.workunit.client.0.smithi046.stdout:1/170: write d4/d13/f27 [1281827,28309] 0 2024-09-21T12:47:02.851 INFO:tasks.workunit.client.1.smithi176.stdout:1/694: creat d0/db/d6a/f100 x:0 0 0 2024-09-21T12:47:02.853 INFO:tasks.workunit.client.1.smithi176.stdout:9/654: chown d1/c17 331 1 2024-09-21T12:47:02.853 INFO:tasks.workunit.client.1.smithi176.stdout:6/621: symlink d2/dd/d26/lc6 0 2024-09-21T12:47:02.855 INFO:tasks.workunit.client.0.smithi046.stdout:6/149: unlink de/c21 0 2024-09-21T12:47:02.856 INFO:tasks.workunit.client.1.smithi176.stdout:5/578: symlink d0/d13/d63/d2e/d37/lb0 0 2024-09-21T12:47:02.857 INFO:tasks.workunit.client.0.smithi046.stdout:1/171: mknod d4/d29/d32/c43 0 2024-09-21T12:47:02.858 INFO:tasks.workunit.client.1.smithi176.stdout:3/764: unlink d1/d3e/c66 0 2024-09-21T12:47:02.859 INFO:tasks.workunit.client.1.smithi176.stdout:3/765: write d1/d9e/fb7 [45268,62360] 0 2024-09-21T12:47:02.859 INFO:tasks.workunit.client.1.smithi176.stdout:3/766: chown d1/d9e/db4/l104 0 1 2024-09-21T12:47:02.860 INFO:tasks.workunit.client.1.smithi176.stdout:5/579: dread d0/d13/f3c [0,4194304] 0 2024-09-21T12:47:02.860 INFO:tasks.workunit.client.1.smithi176.stdout:2/681: rename d4/d40/c51 to d4/df/d2e/d39/ccf 0 2024-09-21T12:47:02.861 INFO:tasks.workunit.client.1.smithi176.stdout:5/580: chown d0/d13/d5d/d98/d9b/dad 0 1 2024-09-21T12:47:02.866 INFO:tasks.workunit.client.0.smithi046.stdout:9/154: rename f3 to d11/d19/d1b/d1c/f2f 0 2024-09-21T12:47:02.866 INFO:tasks.workunit.client.0.smithi046.stdout:9/155: readlink d11/l2a 0 2024-09-21T12:47:02.867 INFO:tasks.workunit.client.1.smithi176.stdout:0/810: mkdir d9/d1a/d1d/d23/da1/da3/d1e/dbf/d120 0 2024-09-21T12:47:02.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/156: dread f10 [0,4194304] 0 2024-09-21T12:47:02.870 INFO:tasks.workunit.client.1.smithi176.stdout:4/669: unlink d3/d5/ce3 0 2024-09-21T12:47:02.871 INFO:tasks.workunit.client.1.smithi176.stdout:4/670: chown d3/d5/f8d 216597024 1 2024-09-21T12:47:02.873 INFO:tasks.workunit.client.1.smithi176.stdout:6/622: mkdir d2/dd/dc7 0 2024-09-21T12:47:02.874 INFO:tasks.workunit.client.1.smithi176.stdout:6/623: chown d2/dd/d26/d2b/d68/fb2 4364222 1 2024-09-21T12:47:02.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/157: dwrite f2 [0,4194304] 0 2024-09-21T12:47:02.879 INFO:tasks.workunit.client.1.smithi176.stdout:6/624: dread d2/f8 [0,4194304] 0 2024-09-21T12:47:02.880 INFO:tasks.workunit.client.1.smithi176.stdout:6/625: truncate d2/d63/fb1 1220179 0 2024-09-21T12:47:02.881 INFO:tasks.workunit.client.1.smithi176.stdout:6/626: dread - d2/dd/d26/d2b/d10/d39/f8b zero size 2024-09-21T12:47:02.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/172: truncate d1/d13/f31 6363285 0 2024-09-21T12:47:02.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/173: readlink d1/d13/l20 0 2024-09-21T12:47:02.883 INFO:tasks.workunit.client.1.smithi176.stdout:5/581: rename d0/d13/d63/d72/d87/d92/l93 to d0/d13/d63/d2e/d39/d3b/lb1 0 2024-09-21T12:47:02.885 INFO:tasks.workunit.client.1.smithi176.stdout:5/582: write d0/d13/d63/d2e/d37/d55/f83 [987881,77009] 0 2024-09-21T12:47:02.886 INFO:tasks.workunit.client.0.smithi046.stdout:9/158: mkdir d11/d19/d1b/d1c/d1f/d30 0 2024-09-21T12:47:02.887 INFO:tasks.workunit.client.1.smithi176.stdout:0/811: truncate d9/d1a/d1d/d23/da1/da3/d1e/f6b 2790731 0 2024-09-21T12:47:02.888 INFO:tasks.workunit.client.1.smithi176.stdout:5/583: truncate d0/d13/d63/d72/d87/f89 137183 0 2024-09-21T12:47:02.888 INFO:tasks.workunit.client.0.smithi046.stdout:9/159: write d11/d19/d1b/f25 [1595474,24447] 0 2024-09-21T12:47:02.891 INFO:tasks.workunit.client.1.smithi176.stdout:4/671: mknod d3/d5/dc5/dd6/cf2 0 2024-09-21T12:47:02.891 INFO:tasks.workunit.client.1.smithi176.stdout:0/812: dread d9/d1a/f58 [0,4194304] 0 2024-09-21T12:47:02.891 INFO:tasks.workunit.client.0.smithi046.stdout:9/160: chown d11/d19/d20/d26/f27 52519200 1 2024-09-21T12:47:02.892 INFO:tasks.workunit.client.1.smithi176.stdout:1/695: write d0/fa [6284215,74425] 0 2024-09-21T12:47:02.893 INFO:tasks.workunit.client.0.smithi046.stdout:6/150: dwrite fa [0,4194304] 0 2024-09-21T12:47:02.895 INFO:tasks.workunit.client.0.smithi046.stdout:6/151: write f3 [1858320,79158] 0 2024-09-21T12:47:02.899 INFO:tasks.workunit.client.0.smithi046.stdout:4/174: fdatasync d1/d13/f31 0 2024-09-21T12:47:02.900 INFO:tasks.workunit.client.0.smithi046.stdout:9/161: dwrite f4 [0,4194304] 0 2024-09-21T12:47:02.904 INFO:tasks.workunit.client.1.smithi176.stdout:7/790: truncate d0/d2/db/d10/d23/f28 3687742 0 2024-09-21T12:47:02.904 INFO:tasks.workunit.client.1.smithi176.stdout:7/791: chown d0/d2/db/d10/d72/lc7 14322 1 2024-09-21T12:47:02.905 INFO:tasks.workunit.client.1.smithi176.stdout:6/627: stat d2/d63/l5c 0 2024-09-21T12:47:02.910 INFO:tasks.workunit.client.0.smithi046.stdout:6/152: rename f5 to de/f2c 0 2024-09-21T12:47:02.914 INFO:tasks.workunit.client.1.smithi176.stdout:0/813: rmdir d9 39 2024-09-21T12:47:02.914 INFO:tasks.workunit.client.0.smithi046.stdout:6/153: dread fa [0,4194304] 0 2024-09-21T12:47:02.918 INFO:tasks.workunit.client.1.smithi176.stdout:4/672: creat d3/d42/d56/d4e/ff3 x:0 0 0 2024-09-21T12:47:02.920 INFO:tasks.workunit.client.1.smithi176.stdout:9/655: creat d1/df/fdb x:0 0 0 2024-09-21T12:47:02.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/175: creat d1/d13/d25/d3a/f3c x:0 0 0 2024-09-21T12:47:02.923 INFO:tasks.workunit.client.0.smithi046.stdout:8/169: sync 2024-09-21T12:47:02.925 INFO:tasks.workunit.client.1.smithi176.stdout:7/792: mkdir d0/d5d/dec/d11d 0 2024-09-21T12:47:02.926 INFO:tasks.workunit.client.0.smithi046.stdout:8/170: dread - d1/d12/f39 zero size 2024-09-21T12:47:02.927 INFO:tasks.workunit.client.1.smithi176.stdout:8/658: sync 2024-09-21T12:47:02.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/176: dread d1/ff [0,4194304] 0 2024-09-21T12:47:02.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/171: write d1/f1f [664821,59959] 0 2024-09-21T12:47:02.928 INFO:tasks.workunit.client.1.smithi176.stdout:3/767: link d1/d34/d57/dd0/d7d/l86 d1/d34/d48/deb/l11a 0 2024-09-21T12:47:02.928 INFO:tasks.workunit.client.1.smithi176.stdout:7/793: write d0/d2/db/d10/d31/ddc/ff5 [509836,79809] 0 2024-09-21T12:47:02.928 INFO:tasks.workunit.client.1.smithi176.stdout:2/682: dwrite d4/df/f6b [0,4194304] 0 2024-09-21T12:47:02.929 INFO:tasks.workunit.client.0.smithi046.stdout:8/172: dread - d1/d12/f2a zero size 2024-09-21T12:47:02.930 INFO:tasks.workunit.client.1.smithi176.stdout:6/628: symlink d2/d6f/d7f/dbf/lc8 0 2024-09-21T12:47:02.930 INFO:tasks.workunit.client.1.smithi176.stdout:7/794: write d0/d5d/fc2 [1088239,18224] 0 2024-09-21T12:47:02.930 INFO:tasks.workunit.client.1.smithi176.stdout:2/683: fsync d4/df/d2e/d39/d55/f75 0 2024-09-21T12:47:02.931 INFO:tasks.workunit.client.0.smithi046.stdout:6/154: truncate f9 2179229 0 2024-09-21T12:47:02.936 INFO:tasks.workunit.client.0.smithi046.stdout:4/177: dread d1/d13/d25/f19 [0,4194304] 0 2024-09-21T12:47:02.937 INFO:tasks.workunit.client.1.smithi176.stdout:4/673: readlink d3/d5/l63 0 2024-09-21T12:47:02.937 INFO:tasks.workunit.client.1.smithi176.stdout:2/684: dwrite d4/d63/f68 [0,4194304] 0 2024-09-21T12:47:02.938 INFO:tasks.workunit.client.1.smithi176.stdout:2/685: chown d4/f37 12401 1 2024-09-21T12:47:02.938 INFO:tasks.workunit.client.0.smithi046.stdout:9/162: dwrite d11/f18 [0,4194304] 0 2024-09-21T12:47:02.940 INFO:tasks.workunit.client.1.smithi176.stdout:1/696: write d0/db/d6a/f7c [852631,87833] 0 2024-09-21T12:47:02.942 INFO:tasks.workunit.client.1.smithi176.stdout:1/697: write d0/db/d1a/d73/f95 [2037454,118519] 0 2024-09-21T12:47:02.943 INFO:tasks.workunit.client.1.smithi176.stdout:1/698: write d0/d5b/fc2 [174665,127264] 0 2024-09-21T12:47:02.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/163: write f6 [261043,95899] 0 2024-09-21T12:47:02.949 INFO:tasks.workunit.client.0.smithi046.stdout:9/164: fsync f2 0 2024-09-21T12:47:02.950 INFO:tasks.workunit.client.0.smithi046.stdout:9/165: chown d11/d19/d1b/d1c/d1f/c2c 502898 1 2024-09-21T12:47:02.951 INFO:tasks.workunit.client.0.smithi046.stdout:9/166: read d11/d19/d20/d26/f27 [1811777,2377] 0 2024-09-21T12:47:02.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/155: rename de/l2b to de/l2d 0 2024-09-21T12:47:02.954 INFO:tasks.workunit.client.1.smithi176.stdout:3/768: write d1/d34/d5d/dce/fe9 [853958,97710] 0 2024-09-21T12:47:02.954 INFO:tasks.workunit.client.0.smithi046.stdout:4/178: mkdir d1/d13/d25/d29/d2d/d3d 0 2024-09-21T12:47:02.955 INFO:tasks.workunit.client.1.smithi176.stdout:7/795: rmdir d0/d5d/d7a 39 2024-09-21T12:47:02.955 INFO:tasks.workunit.client.1.smithi176.stdout:1/699: dwrite d0/db/d1a/d2c/dc5/d41/d59/d99/fa3 [0,4194304] 0 2024-09-21T12:47:02.955 INFO:tasks.workunit.client.0.smithi046.stdout:4/179: write d1/d13/f30 [1276609,20758] 0 2024-09-21T12:47:02.957 INFO:tasks.workunit.client.0.smithi046.stdout:8/173: link d1/d12/l23 d1/l43 0 2024-09-21T12:47:02.957 INFO:tasks.workunit.client.1.smithi176.stdout:9/656: dwrite d1/df/d23/f36 [0,4194304] 0 2024-09-21T12:47:02.958 INFO:tasks.workunit.client.1.smithi176.stdout:7/796: fdatasync d0/d2/db/d10/d31/fd4 0 2024-09-21T12:47:02.959 INFO:tasks.workunit.client.1.smithi176.stdout:5/584: creat d0/d13/d63/d2e/d37/fb2 x:0 0 0 2024-09-21T12:47:02.960 INFO:tasks.workunit.client.1.smithi176.stdout:3/769: read d1/d34/d5d/d78/f106 [1998967,91479] 0 2024-09-21T12:47:02.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/167: mkdir d11/d19/d1b/d31 0 2024-09-21T12:47:02.962 INFO:tasks.workunit.client.1.smithi176.stdout:4/674: creat d3/d21/d97/ff4 x:0 0 0 2024-09-21T12:47:02.966 INFO:tasks.workunit.client.1.smithi176.stdout:2/686: creat d4/d3a/fd0 x:0 0 0 2024-09-21T12:47:02.968 INFO:tasks.workunit.client.1.smithi176.stdout:3/770: dwrite d1/d5/fcf [0,4194304] 0 2024-09-21T12:47:02.973 INFO:tasks.workunit.client.0.smithi046.stdout:6/156: symlink de/d2a/l2e 0 2024-09-21T12:47:02.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/180: creat d1/d13/d25/d38/f3e x:0 0 0 2024-09-21T12:47:02.977 INFO:tasks.workunit.client.1.smithi176.stdout:6/629: symlink d2/dd/d26/lc9 0 2024-09-21T12:47:02.978 INFO:tasks.workunit.client.0.smithi046.stdout:6/157: creat de/d2a/f2f x:0 0 0 2024-09-21T12:47:02.980 INFO:tasks.workunit.client.1.smithi176.stdout:8/659: dwrite d6/db/da3/fc1 [0,4194304] 0 2024-09-21T12:47:02.980 INFO:tasks.workunit.client.0.smithi046.stdout:9/168: fdatasync d11/d19/d1b/d1c/f2f 0 2024-09-21T12:47:02.982 INFO:tasks.workunit.client.1.smithi176.stdout:1/700: creat d0/d91/dd3/f101 x:0 0 0 2024-09-21T12:47:02.982 INFO:tasks.workunit.client.0.smithi046.stdout:4/181: rmdir d1/d13/d25/d3a 39 2024-09-21T12:47:02.984 INFO:tasks.workunit.client.1.smithi176.stdout:9/657: symlink d1/df/d9a/ldc 0 2024-09-21T12:47:02.985 INFO:tasks.workunit.client.1.smithi176.stdout:7/797: dread d0/d2/db/fd0 [4194304,4194304] 0 2024-09-21T12:47:02.988 INFO:tasks.workunit.client.1.smithi176.stdout:0/814: symlink d9/d1a/d1d/d23/da1/da3/d1e/de1/de3/l121 0 2024-09-21T12:47:02.989 INFO:tasks.workunit.client.1.smithi176.stdout:1/701: dwrite d0/db/f1f [0,4194304] 0 2024-09-21T12:47:02.989 INFO:tasks.workunit.client.0.smithi046.stdout:9/169: mknod d11/d19/d20/c32 0 2024-09-21T12:47:02.990 INFO:tasks.workunit.client.1.smithi176.stdout:0/815: chown d9/d1a/d1d/d23/da1/da3/d93/df9/fce 249598498 1 2024-09-21T12:47:02.990 INFO:tasks.workunit.client.0.smithi046.stdout:9/170: fdatasync d11/d19/d1b/d1c/f2e 0 2024-09-21T12:47:02.991 INFO:tasks.workunit.client.1.smithi176.stdout:1/702: dread - d0/db/d6a/d89/fe7 zero size 2024-09-21T12:47:02.993 INFO:tasks.workunit.client.0.smithi046.stdout:4/182: write d1/d13/d25/d3a/f3c [738067,108987] 0 2024-09-21T12:47:02.995 INFO:tasks.workunit.client.0.smithi046.stdout:4/183: write d1/d13/d25/d3a/f3c [455573,74390] 0 2024-09-21T12:47:02.996 INFO:tasks.workunit.client.0.smithi046.stdout:4/184: readlink d1/d13/l22 0 2024-09-21T12:47:02.998 INFO:tasks.workunit.client.1.smithi176.stdout:1/703: dread d0/db/d1a/d2c/d48/d50/f9c [0,4194304] 0 2024-09-21T12:47:02.998 INFO:tasks.workunit.client.1.smithi176.stdout:3/771: rename d1/da/l31 to d1/d34/d5d/d78/l11b 0 2024-09-21T12:47:02.999 INFO:tasks.workunit.client.1.smithi176.stdout:2/687: dread d4/df/d2e/d39/d55/f75 [0,4194304] 0 2024-09-21T12:47:03.001 INFO:tasks.workunit.client.1.smithi176.stdout:6/630: creat d2/d5d/fca x:0 0 0 2024-09-21T12:47:03.002 INFO:tasks.workunit.client.0.smithi046.stdout:8/174: dread d1/f11 [0,4194304] 0 2024-09-21T12:47:03.004 INFO:tasks.workunit.client.1.smithi176.stdout:8/660: symlink d6/db/d13/d98/lce 0 2024-09-21T12:47:03.004 INFO:tasks.workunit.client.0.smithi046.stdout:4/185: dwrite d1/d13/f16 [0,4194304] 0 2024-09-21T12:47:03.006 INFO:tasks.workunit.client.0.smithi046.stdout:4/186: write d1/d13/f16 [3617387,19060] 0 2024-09-21T12:47:03.007 INFO:tasks.workunit.client.1.smithi176.stdout:9/658: mkdir d1/df/d23/dcf/ddd 0 2024-09-21T12:47:03.009 INFO:tasks.workunit.client.1.smithi176.stdout:7/798: mkdir d0/d2/db/d10/d72/d7e/de2/df3/d11e 0 2024-09-21T12:47:03.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/175: creat d1/d12/d1a/d2f/f44 x:0 0 0 2024-09-21T12:47:03.010 INFO:tasks.workunit.client.1.smithi176.stdout:7/799: write d0/d2/db/d10/d23/dce/f86 [6671870,7033] 0 2024-09-21T12:47:03.012 INFO:tasks.workunit.client.1.smithi176.stdout:7/800: dread - d0/d2/db/d10/d72/d94/fef zero size 2024-09-21T12:47:03.015 INFO:tasks.workunit.client.1.smithi176.stdout:0/816: dread d9/f2b [0,4194304] 0 2024-09-21T12:47:03.017 INFO:tasks.workunit.client.1.smithi176.stdout:4/675: mkdir d3/d21/df5 0 2024-09-21T12:47:03.019 INFO:tasks.workunit.client.1.smithi176.stdout:7/801: dwrite d0/d2/db/d10/d72/fee [0,4194304] 0 2024-09-21T12:47:03.020 INFO:tasks.workunit.client.1.smithi176.stdout:3/772: creat d1/d34/d71/f11c x:0 0 0 2024-09-21T12:47:03.021 INFO:tasks.workunit.client.0.smithi046.stdout:8/176: rename d1/d12/d1a/d2f/c3f to d1/d12/d1a/c45 0 2024-09-21T12:47:03.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/158: dwrite f9 [0,4194304] 0 2024-09-21T12:47:03.025 INFO:tasks.workunit.client.1.smithi176.stdout:2/688: mknod d4/df/d2e/d4d/d70/cd1 0 2024-09-21T12:47:03.027 INFO:tasks.workunit.client.0.smithi046.stdout:9/171: getdents d11/d19/d1b/d1c/d1f 0 2024-09-21T12:47:03.029 INFO:tasks.workunit.client.1.smithi176.stdout:6/631: symlink d2/dd/d26/d2b/lcb 0 2024-09-21T12:47:03.030 INFO:tasks.workunit.client.1.smithi176.stdout:5/585: creat d0/d13/d63/d2e/d39/fb3 x:0 0 0 2024-09-21T12:47:03.030 INFO:tasks.workunit.client.0.smithi046.stdout:4/187: link d1/d13/c2b d1/c3f 0 2024-09-21T12:47:03.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/188: write d1/d13/f30 [1786880,46709] 0 2024-09-21T12:47:03.032 INFO:tasks.workunit.client.0.smithi046.stdout:6/159: mknod de/c30 0 2024-09-21T12:47:03.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/189: chown d1/d13/d25/l34 14 1 2024-09-21T12:47:03.033 INFO:tasks.workunit.client.1.smithi176.stdout:5/586: write d0/d13/d63/d2e/d39/d41/f9d [649738,108968] 0 2024-09-21T12:47:03.036 INFO:tasks.workunit.client.1.smithi176.stdout:0/817: rmdir d9/d1a/d1d/d81/d115 39 2024-09-21T12:47:03.037 INFO:tasks.workunit.client.0.smithi046.stdout:4/190: dread d1/d13/d25/d3a/f3c [0,4194304] 0 2024-09-21T12:47:03.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/172: dread f10 [0,4194304] 0 2024-09-21T12:47:03.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/173: read d11/d19/f24 [262296,67205] 0 2024-09-21T12:47:03.042 INFO:tasks.workunit.client.1.smithi176.stdout:7/802: mkdir d0/d2/db/d10/d72/d7e/d11f 0 2024-09-21T12:47:03.043 INFO:tasks.workunit.client.1.smithi176.stdout:1/704: link d0/f6 d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/f102 0 2024-09-21T12:47:03.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/191: rename d1/d13/d25 to d1/d13/d25/d40 22 2024-09-21T12:47:03.045 INFO:tasks.workunit.client.1.smithi176.stdout:2/689: creat d4/df/d2e/d6f/d5d/d81/db2/fd2 x:0 0 0 2024-09-21T12:47:03.048 INFO:tasks.workunit.client.1.smithi176.stdout:9/659: read d1/df/d48/d69/d40/d84/fa8 [2936375,37332] 0 2024-09-21T12:47:03.051 INFO:tasks.workunit.client.1.smithi176.stdout:5/587: chown d0/d13/d63/d2e/d39/d3b/c53 719 1 2024-09-21T12:47:03.054 INFO:tasks.workunit.client.1.smithi176.stdout:0/818: unlink d9/d1a/d1d/d23/l55 0 2024-09-21T12:47:03.058 INFO:tasks.workunit.client.0.smithi046.stdout:6/160: getdents de 0 2024-09-21T12:47:03.059 INFO:tasks.workunit.client.0.smithi046.stdout:6/161: dread - de/f18 zero size 2024-09-21T12:47:03.059 INFO:tasks.workunit.client.1.smithi176.stdout:3/773: mknod d1/d34/d48/deb/db3/c11d 0 2024-09-21T12:47:03.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/162: dread de/f13 [0,4194304] 0 2024-09-21T12:47:03.061 INFO:tasks.workunit.client.0.smithi046.stdout:8/177: truncate d1/d24/f29 4090857 0 2024-09-21T12:47:03.062 INFO:tasks.workunit.client.0.smithi046.stdout:8/178: readlink d1/d24/l27 0 2024-09-21T12:47:03.063 INFO:tasks.workunit.client.1.smithi176.stdout:1/705: creat d0/db/d1a/d2c/d6b/dd7/f103 x:0 0 0 2024-09-21T12:47:03.064 INFO:tasks.workunit.client.0.smithi046.stdout:4/192: creat d1/d13/d25/d29/d33/f41 x:0 0 0 2024-09-21T12:47:03.065 INFO:tasks.workunit.client.1.smithi176.stdout:2/690: rename d4/df/d2e/d6f/d5d/d81/db2/fa2 to d4/df/d2e/d39/fd3 0 2024-09-21T12:47:03.067 INFO:tasks.workunit.client.1.smithi176.stdout:9/660: mknod d1/df/d9a/cde 0 2024-09-21T12:47:03.068 INFO:tasks.workunit.client.1.smithi176.stdout:9/661: read - d1/df/d48/d69/d40/fb4 zero size 2024-09-21T12:47:03.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/179: rename d1/d12/d1a/d2f to d1/d12/d46 0 2024-09-21T12:47:03.075 INFO:tasks.workunit.client.1.smithi176.stdout:4/676: creat d3/d5/ff6 x:0 0 0 2024-09-21T12:47:03.076 INFO:tasks.workunit.client.0.smithi046.stdout:9/174: truncate d11/f18 1647349 0 2024-09-21T12:47:03.082 INFO:tasks.workunit.client.0.smithi046.stdout:8/180: write d1/f20 [4126691,19359] 0 2024-09-21T12:47:03.082 INFO:tasks.workunit.client.1.smithi176.stdout:7/803: getdents d0/d2/db/d10/d61 0 2024-09-21T12:47:03.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/175: dwrite f2 [0,4194304] 0 2024-09-21T12:47:03.084 INFO:tasks.workunit.client.1.smithi176.stdout:8/661: sync 2024-09-21T12:47:03.084 INFO:tasks.workunit.client.0.smithi046.stdout:8/181: fdatasync d1/f11 0 2024-09-21T12:47:03.085 INFO:tasks.workunit.client.0.smithi046.stdout:8/182: stat d1/d12/c14 0 2024-09-21T12:47:03.086 INFO:tasks.workunit.client.1.smithi176.stdout:1/706: chown d0/db/d1a/d2c/dc5/d2b/d43/f60 548 1 2024-09-21T12:47:03.086 INFO:tasks.workunit.client.0.smithi046.stdout:2/160: sync 2024-09-21T12:47:03.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/162: sync 2024-09-21T12:47:03.086 INFO:tasks.workunit.client.0.smithi046.stdout:3/138: sync 2024-09-21T12:47:03.086 INFO:tasks.workunit.client.0.smithi046.stdout:7/107: sync 2024-09-21T12:47:03.087 INFO:tasks.workunit.client.1.smithi176.stdout:6/632: truncate d2/dd/d26/d2b/f7e 683045 0 2024-09-21T12:47:03.089 INFO:tasks.workunit.client.0.smithi046.stdout:7/108: chown d2/d4/df/f1d 1 1 2024-09-21T12:47:03.090 INFO:tasks.workunit.client.0.smithi046.stdout:9/176: dread d11/d19/d1b/f25 [0,4194304] 0 2024-09-21T12:47:03.092 INFO:tasks.workunit.client.0.smithi046.stdout:9/177: chown d11/d19/f24 89 1 2024-09-21T12:47:03.095 INFO:tasks.workunit.client.1.smithi176.stdout:9/662: creat d1/df/d48/d69/d38/fdf x:0 0 0 2024-09-21T12:47:03.095 INFO:tasks.workunit.client.0.smithi046.stdout:8/183: dwrite d1/f11 [4194304,4194304] 0 2024-09-21T12:47:03.096 INFO:tasks.workunit.client.1.smithi176.stdout:9/663: write d1/df/d23/d67/f75 [893197,116657] 0 2024-09-21T12:47:03.098 INFO:tasks.workunit.client.0.smithi046.stdout:4/193: link d1/d13/d25/d29/d33/f41 d1/d13/d25/d29/f42 0 2024-09-21T12:47:03.098 INFO:tasks.workunit.client.1.smithi176.stdout:3/774: write d1/d8d/f97 [2862648,71180] 0 2024-09-21T12:47:03.101 INFO:tasks.workunit.client.1.smithi176.stdout:5/588: creat d0/d13/d63/d8d/daf/fb4 x:0 0 0 2024-09-21T12:47:03.102 INFO:tasks.workunit.client.0.smithi046.stdout:5/163: rmdir d4/d22/d10/d1a 39 2024-09-21T12:47:03.102 INFO:tasks.workunit.client.1.smithi176.stdout:5/589: chown d0/d10/c24 1572 1 2024-09-21T12:47:03.103 INFO:tasks.workunit.client.1.smithi176.stdout:4/677: creat d3/d21/d88/da7/ff7 x:0 0 0 2024-09-21T12:47:03.104 INFO:tasks.workunit.client.0.smithi046.stdout:3/139: mkdir d5/dc/d30 0 2024-09-21T12:47:03.106 INFO:tasks.workunit.client.1.smithi176.stdout:0/819: link d9/d1a/d1d/d23/da1/fca d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/d11d/f122 0 2024-09-21T12:47:03.106 INFO:tasks.workunit.client.0.smithi046.stdout:6/163: getdents de/d2a 0 2024-09-21T12:47:03.110 INFO:tasks.workunit.client.1.smithi176.stdout:7/804: rename d0/d2/db/d10/d23/da6/d105/fe3 to d0/d2/db/d10/d31/da1/f120 0 2024-09-21T12:47:03.110 INFO:tasks.workunit.client.1.smithi176.stdout:0/820: dwrite d9/d1a/d1d/d23/da1/da3/d1e/f42 [0,4194304] 0 2024-09-21T12:47:03.111 INFO:tasks.workunit.client.1.smithi176.stdout:7/805: chown d0/d2/db/d10/d72/d7e/df6 35085542 1 2024-09-21T12:47:03.112 INFO:tasks.workunit.client.1.smithi176.stdout:8/662: unlink d6/db/l1b 0 2024-09-21T12:47:03.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/178: symlink d11/d19/d1b/d1c/d1f/l33 0 2024-09-21T12:47:03.116 INFO:tasks.workunit.client.1.smithi176.stdout:9/664: mknod d1/d61/d73/db6/ce0 0 2024-09-21T12:47:03.117 INFO:tasks.workunit.client.1.smithi176.stdout:9/665: chown d1/df/d23/d67 334 1 2024-09-21T12:47:03.117 INFO:tasks.workunit.client.0.smithi046.stdout:5/164: creat d4/d22/f32 x:0 0 0 2024-09-21T12:47:03.117 INFO:tasks.workunit.client.1.smithi176.stdout:9/666: chown d1/df/d48/d69/d76/d7c/d9e 1813 1 2024-09-21T12:47:03.118 INFO:tasks.workunit.client.0.smithi046.stdout:5/165: fdatasync d4/f2e 0 2024-09-21T12:47:03.119 INFO:tasks.workunit.client.1.smithi176.stdout:4/678: mkdir d3/d42/d56/d4e/df8 0 2024-09-21T12:47:03.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/140: mknod d5/dc/d28/c31 0 2024-09-21T12:47:03.122 INFO:tasks.workunit.client.0.smithi046.stdout:3/141: chown d5/l17 104691577 1 2024-09-21T12:47:03.123 INFO:tasks.workunit.client.0.smithi046.stdout:3/142: write d5/dc/f1d [1028632,87649] 0 2024-09-21T12:47:03.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/164: fsync de/f17 0 2024-09-21T12:47:03.125 INFO:tasks.workunit.client.0.smithi046.stdout:3/143: read d5/d16/f1e [1847324,47280] 0 2024-09-21T12:47:03.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/161: rename d16/l24 to d16/d22/d38/l39 0 2024-09-21T12:47:03.129 INFO:tasks.workunit.client.1.smithi176.stdout:3/775: rename d1/d5/d25/d61/dc3/l107 to d1/d9e/l11e 0 2024-09-21T12:47:03.133 INFO:tasks.workunit.client.1.smithi176.stdout:2/691: truncate d4/df/d2e/d6f/d5d/d67/fb4 2691522 0 2024-09-21T12:47:03.134 INFO:tasks.workunit.client.1.smithi176.stdout:2/692: read d4/df/f6b [2468228,94858] 0 2024-09-21T12:47:03.134 INFO:tasks.workunit.client.1.smithi176.stdout:1/707: symlink d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3/l104 0 2024-09-21T12:47:03.136 INFO:tasks.workunit.client.1.smithi176.stdout:7/806: unlink d0/d2/d30/d93/da2/fd8 0 2024-09-21T12:47:03.137 INFO:tasks.workunit.client.0.smithi046.stdout:5/166: write d4/d22/d10/d1a/f1c [106273,15700] 0 2024-09-21T12:47:03.139 INFO:tasks.workunit.client.1.smithi176.stdout:7/807: dread d0/d5d/f81 [0,4194304] 0 2024-09-21T12:47:03.140 INFO:tasks.workunit.client.1.smithi176.stdout:5/590: mkdir d0/d13/d63/d2e/d37/db5 0 2024-09-21T12:47:03.140 INFO:tasks.workunit.client.0.smithi046.stdout:6/165: symlink de/l31 0 2024-09-21T12:47:03.140 INFO:tasks.workunit.client.1.smithi176.stdout:5/591: dread - d0/fa8 zero size 2024-09-21T12:47:03.141 INFO:tasks.workunit.client.1.smithi176.stdout:5/592: write d0/d13/d63/d72/d87/f89 [446372,48135] 0 2024-09-21T12:47:03.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/162: write d16/f1d [1871565,63645] 0 2024-09-21T12:47:03.144 INFO:tasks.workunit.client.1.smithi176.stdout:3/776: unlink d1/d5/cd4 0 2024-09-21T12:47:03.149 INFO:tasks.workunit.client.0.smithi046.stdout:4/194: rename d1/d13/d25/d29/d2d to d1/d13/d25/d29/d43 0 2024-09-21T12:47:03.152 INFO:tasks.workunit.client.0.smithi046.stdout:9/179: symlink d11/d19/d1b/d1c/d1f/d30/l34 0 2024-09-21T12:47:03.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/180: fsync f2 0 2024-09-21T12:47:03.153 INFO:tasks.workunit.client.0.smithi046.stdout:9/181: fsync f6 0 2024-09-21T12:47:03.157 INFO:tasks.workunit.client.0.smithi046.stdout:5/167: mknod d4/dc/c33 0 2024-09-21T12:47:03.158 INFO:tasks.workunit.client.0.smithi046.stdout:9/182: dread d11/d19/d1b/d1c/f2f [0,4194304] 0 2024-09-21T12:47:03.164 INFO:tasks.workunit.client.0.smithi046.stdout:6/166: creat de/f32 x:0 0 0 2024-09-21T12:47:03.164 INFO:tasks.workunit.client.0.smithi046.stdout:3/144: dwrite d5/dc/f1b [0,4194304] 0 2024-09-21T12:47:03.165 INFO:tasks.workunit.client.0.smithi046.stdout:3/145: write d5/f8 [4485108,16024] 0 2024-09-21T12:47:03.166 INFO:tasks.workunit.client.0.smithi046.stdout:3/146: chown d5/l1c 85593 1 2024-09-21T12:47:03.167 INFO:tasks.workunit.client.0.smithi046.stdout:3/147: readlink d5/d16/l2a 0 2024-09-21T12:47:03.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/148: dread d5/f7 [0,4194304] 0 2024-09-21T12:47:03.169 INFO:tasks.workunit.client.0.smithi046.stdout:2/163: rmdir d16/d22/d38 39 2024-09-21T12:47:03.172 INFO:tasks.workunit.client.1.smithi176.stdout:9/667: mkdir d1/d8b/de1 0 2024-09-21T12:47:03.172 INFO:tasks.workunit.client.1.smithi176.stdout:9/668: fdatasync d1/df/d23/d67/f75 0 2024-09-21T12:47:03.173 INFO:tasks.workunit.client.0.smithi046.stdout:7/109: getdents d2 0 2024-09-21T12:47:03.173 INFO:tasks.workunit.client.0.smithi046.stdout:7/110: rename d2 to d2/d4/d26 22 2024-09-21T12:47:03.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/195: dread d1/d13/d25/d3a/f3c [0,4194304] 0 2024-09-21T12:47:03.175 INFO:tasks.workunit.client.1.smithi176.stdout:5/593: creat d0/d13/d63/d2e/fb6 x:0 0 0 2024-09-21T12:47:03.176 INFO:tasks.workunit.client.0.smithi046.stdout:4/196: readlink d1/d27/l2c 0 2024-09-21T12:47:03.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/197: dread - d1/d13/d25/d29/f42 zero size 2024-09-21T12:47:03.178 INFO:tasks.workunit.client.1.smithi176.stdout:4/679: rename d3/d5/db/d36/f77 to d3/d5/db/d96/da3/ff9 0 2024-09-21T12:47:03.179 INFO:tasks.workunit.client.1.smithi176.stdout:4/680: write d3/d42/d4d/f70 [4542585,121816] 0 2024-09-21T12:47:03.180 INFO:tasks.workunit.client.0.smithi046.stdout:7/111: dwrite d2/d4/f8 [4194304,4194304] 0 2024-09-21T12:47:03.180 INFO:tasks.workunit.client.1.smithi176.stdout:0/821: link d9/f45 d9/d1a/d1d/d90/f123 0 2024-09-21T12:47:03.182 INFO:tasks.workunit.client.1.smithi176.stdout:0/822: dread - d9/d1a/d1d/d23/f102 zero size 2024-09-21T12:47:03.182 INFO:tasks.workunit.client.1.smithi176.stdout:5/594: dwrite d0/d13/d63/d2e/d39/f8e [0,4194304] 0 2024-09-21T12:47:03.183 INFO:tasks.workunit.client.1.smithi176.stdout:1/708: symlink d0/db/d1a/d2c/l105 0 2024-09-21T12:47:03.185 INFO:tasks.workunit.client.1.smithi176.stdout:2/693: truncate d4/df/d2e/d6f/d6d/f74 735767 0 2024-09-21T12:47:03.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/149: symlink d5/dc/l32 0 2024-09-21T12:47:03.187 INFO:tasks.workunit.client.1.smithi176.stdout:6/633: getdents d2/dd/d26/d2b/d10/d1b/d37 0 2024-09-21T12:47:03.188 INFO:tasks.workunit.client.0.smithi046.stdout:3/150: write d5/dc/f1d [2026633,53331] 0 2024-09-21T12:47:03.193 INFO:tasks.workunit.client.1.smithi176.stdout:8/663: link d6/d16/d36/cac d6/db/d37/d89/ccf 0 2024-09-21T12:47:03.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/168: mkdir d4/d22/d10/d34 0 2024-09-21T12:47:03.195 INFO:tasks.workunit.client.1.smithi176.stdout:7/808: mkdir d0/d2/d30/df4/d121 0 2024-09-21T12:47:03.196 INFO:tasks.workunit.client.1.smithi176.stdout:7/809: write d0/fb4 [1411050,43028] 0 2024-09-21T12:47:03.197 INFO:tasks.workunit.client.1.smithi176.stdout:7/810: fdatasync d0/d2/db/d10/d72/fab 0 2024-09-21T12:47:03.197 INFO:tasks.workunit.client.0.smithi046.stdout:9/183: write d11/d19/f24 [195635,750] 0 2024-09-21T12:47:03.198 INFO:tasks.workunit.client.1.smithi176.stdout:9/669: rmdir d1/df/d1c 39 2024-09-21T12:47:03.198 INFO:tasks.workunit.client.0.smithi046.stdout:9/184: chown d11/d19/d1b/d1c/d1f/d30 3 1 2024-09-21T12:47:03.199 INFO:tasks.workunit.client.0.smithi046.stdout:7/112: symlink d2/d4/l27 0 2024-09-21T12:47:03.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/185: chown d11/c14 171626 1 2024-09-21T12:47:03.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/113: readlink d2/d4/df/d17/l21 0 2024-09-21T12:47:03.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/114: readlink d2/l1f 0 2024-09-21T12:47:03.202 INFO:tasks.workunit.client.1.smithi176.stdout:3/777: dwrite d1/d34/d57/dd0/faf [0,4194304] 0 2024-09-21T12:47:03.203 INFO:tasks.workunit.client.1.smithi176.stdout:3/778: truncate d1/d34/d48/fa4 1811401 0 2024-09-21T12:47:03.205 INFO:tasks.workunit.client.0.smithi046.stdout:9/186: dread f6 [0,4194304] 0 2024-09-21T12:47:03.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/187: read d11/f12 [3226247,91926] 0 2024-09-21T12:47:03.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/151: creat d5/dc/d28/f33 x:0 0 0 2024-09-21T12:47:03.210 INFO:tasks.workunit.client.1.smithi176.stdout:4/681: unlink d3/d42/d47/f7e 0 2024-09-21T12:47:03.212 INFO:tasks.workunit.client.1.smithi176.stdout:4/682: dread - d3/d42/d47/d5c/fa9 zero size 2024-09-21T12:47:03.212 INFO:tasks.workunit.client.1.smithi176.stdout:7/811: dread d0/d2/db/d10/d72/d51/fa7 [0,4194304] 0 2024-09-21T12:47:03.212 INFO:tasks.workunit.client.0.smithi046.stdout:5/169: rmdir d4/dc/d28 39 2024-09-21T12:47:03.213 INFO:tasks.workunit.client.1.smithi176.stdout:4/683: dread - d3/d5/db/d96/fea zero size 2024-09-21T12:47:03.213 INFO:tasks.workunit.client.1.smithi176.stdout:7/812: dread - d0/d2/da8/f102 zero size 2024-09-21T12:47:03.216 INFO:tasks.workunit.client.1.smithi176.stdout:5/595: unlink d0/d13/d63/d2e/d37/fa2 0 2024-09-21T12:47:03.217 INFO:tasks.workunit.client.0.smithi046.stdout:6/167: link de/f2c de/d2a/f33 0 2024-09-21T12:47:03.218 INFO:tasks.workunit.client.0.smithi046.stdout:6/168: truncate f3 4204507 0 2024-09-21T12:47:03.218 INFO:tasks.workunit.client.1.smithi176.stdout:0/823: mkdir d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/d124 0 2024-09-21T12:47:03.220 INFO:tasks.workunit.client.1.smithi176.stdout:2/694: stat d4/df/d2e/d6f/l87 0 2024-09-21T12:47:03.222 INFO:tasks.workunit.client.1.smithi176.stdout:6/634: rmdir d2/dd/d26/d2b/d10/d87 39 2024-09-21T12:47:03.222 INFO:tasks.workunit.client.1.smithi176.stdout:6/635: write d2/f64 [792529,102348] 0 2024-09-21T12:47:03.226 INFO:tasks.workunit.client.0.smithi046.stdout:9/188: symlink d11/d19/d20/d26/l35 0 2024-09-21T12:47:03.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/189: write f6 [3067884,100887] 0 2024-09-21T12:47:03.228 INFO:tasks.workunit.client.0.smithi046.stdout:9/190: write d11/d19/f24 [123316,57132] 0 2024-09-21T12:47:03.230 INFO:tasks.workunit.client.0.smithi046.stdout:5/170: dread d4/d16/f1b [0,4194304] 0 2024-09-21T12:47:03.231 INFO:tasks.workunit.client.0.smithi046.stdout:7/115: link d2/d4/df/f10 d2/d4/df/d17/f28 0 2024-09-21T12:47:03.232 INFO:tasks.workunit.client.1.smithi176.stdout:1/709: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:47:03.232 INFO:tasks.workunit.client.1.smithi176.stdout:7/813: dread d0/d2/f4f [0,4194304] 0 2024-09-21T12:47:03.233 INFO:tasks.workunit.client.1.smithi176.stdout:3/779: write d1/d34/d5d/d78/fef [498710,52133] 0 2024-09-21T12:47:03.236 INFO:tasks.workunit.client.0.smithi046.stdout:3/152: unlink d5/dc/d26/l2d 0 2024-09-21T12:47:03.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/191: mkdir d11/d19/d36 0 2024-09-21T12:47:03.242 INFO:tasks.workunit.client.1.smithi176.stdout:5/596: rename d0/d13/d63/d2e/d39/d3b to d0/d13/d63/d2e/d37/db5/db7 0 2024-09-21T12:47:03.244 INFO:tasks.workunit.client.1.smithi176.stdout:4/684: dwrite d3/d5/db/f31 [0,4194304] 0 2024-09-21T12:47:03.244 INFO:tasks.workunit.client.0.smithi046.stdout:4/198: getdents d1/d13/d25/d29/d43 0 2024-09-21T12:47:03.244 INFO:tasks.workunit.client.0.smithi046.stdout:4/199: readlink d1/d13/d25/l15 0 2024-09-21T12:47:03.245 INFO:tasks.workunit.client.1.smithi176.stdout:4/685: readlink d3/d5/db/d36/lc0 0 2024-09-21T12:47:03.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/200: fdatasync d1/d13/f16 0 2024-09-21T12:47:03.246 INFO:tasks.workunit.client.1.smithi176.stdout:0/824: chown d9/d1a/d1d/d81/f83 354498777 1 2024-09-21T12:47:03.248 INFO:tasks.workunit.client.0.smithi046.stdout:3/153: truncate d5/d16/f1e 928166 0 2024-09-21T12:47:03.249 INFO:tasks.workunit.client.0.smithi046.stdout:3/154: dread - d5/d16/f19 zero size 2024-09-21T12:47:03.250 INFO:tasks.workunit.client.0.smithi046.stdout:3/155: chown f2 11 1 2024-09-21T12:47:03.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/171: fdatasync d4/dc/d13/f23 0 2024-09-21T12:47:03.252 INFO:tasks.workunit.client.0.smithi046.stdout:4/201: dwrite d1/d13/d25/d38/f3e [0,4194304] 0 2024-09-21T12:47:03.254 INFO:tasks.workunit.client.0.smithi046.stdout:5/172: chown d4/d16 6536 1 2024-09-21T12:47:03.255 INFO:tasks.workunit.client.1.smithi176.stdout:3/780: mkdir d1/d34/d71/d91/df6/d11f 0 2024-09-21T12:47:03.257 INFO:tasks.workunit.client.1.smithi176.stdout:1/710: dread d0/db/d6f/f7d [0,4194304] 0 2024-09-21T12:47:03.258 INFO:tasks.workunit.client.0.smithi046.stdout:9/192: link d11/d19/d1b/d1c/f2f d11/d19/f37 0 2024-09-21T12:47:03.258 INFO:tasks.workunit.client.1.smithi176.stdout:1/711: stat d0/db/d1a/d2c/dc5/d41/f9a 0 2024-09-21T12:47:03.262 INFO:tasks.workunit.client.1.smithi176.stdout:7/814: rename d0/d5d/f81 to d0/d2/db/d10/d72/d7e/de2/df3/d11e/f122 0 2024-09-21T12:47:03.263 INFO:tasks.workunit.client.0.smithi046.stdout:4/202: mknod d1/d13/d25/d29/d43/c44 0 2024-09-21T12:47:03.265 INFO:tasks.workunit.client.1.smithi176.stdout:5/597: symlink d0/d13/d63/d2e/d39/d41/lb8 0 2024-09-21T12:47:03.267 INFO:tasks.workunit.client.1.smithi176.stdout:8/664: dwrite d6/d16/d36/f9a [0,4194304] 0 2024-09-21T12:47:03.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/203: dread d1/fd [0,4194304] 0 2024-09-21T12:47:03.271 INFO:tasks.workunit.client.0.smithi046.stdout:3/156: mkdir d5/dc/d30/d34 0 2024-09-21T12:47:03.274 INFO:tasks.workunit.client.1.smithi176.stdout:6/636: dread d2/dd/d26/d2b/f14 [0,4194304] 0 2024-09-21T12:47:03.276 INFO:tasks.workunit.client.1.smithi176.stdout:3/781: mkdir d1/d34/d42/d5b/d120 0 2024-09-21T12:47:03.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/193: truncate d11/d19/d1b/d1c/f2f 899584 0 2024-09-21T12:47:03.280 INFO:tasks.workunit.client.1.smithi176.stdout:4/686: dwrite d3/d5/db/d96/da3/fd8 [0,4194304] 0 2024-09-21T12:47:03.286 INFO:tasks.workunit.client.0.smithi046.stdout:9/194: dwrite f6 [0,4194304] 0 2024-09-21T12:47:03.286 INFO:tasks.workunit.client.0.smithi046.stdout:4/204: mkdir d1/d13/d25/d29/d45 0 2024-09-21T12:47:03.286 INFO:tasks.workunit.client.0.smithi046.stdout:1/172: sync 2024-09-21T12:47:03.286 INFO:tasks.workunit.client.0.smithi046.stdout:0/225: sync 2024-09-21T12:47:03.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/173: write d4/d29/f41 [446162,38222] 0 2024-09-21T12:47:03.288 INFO:tasks.workunit.client.0.smithi046.stdout:1/174: stat d4 0 2024-09-21T12:47:03.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/173: getdents d4/d22 0 2024-09-21T12:47:03.291 INFO:tasks.workunit.client.1.smithi176.stdout:9/670: getdents d1/df/d48/d69/d40 0 2024-09-21T12:47:03.293 INFO:tasks.workunit.client.1.smithi176.stdout:6/637: symlink d2/d5d/lcc 0 2024-09-21T12:47:03.295 INFO:tasks.workunit.client.0.smithi046.stdout:9/195: rmdir d11/d19/d1b/d1c/d1f 39 2024-09-21T12:47:03.295 INFO:tasks.workunit.client.1.smithi176.stdout:6/638: dread - d2/dd/d26/d2b/d10/d1b/f9b zero size 2024-09-21T12:47:03.296 INFO:tasks.workunit.client.1.smithi176.stdout:3/782: creat d1/d5/d25/d61/dc3/f121 x:0 0 0 2024-09-21T12:47:03.297 INFO:tasks.workunit.client.1.smithi176.stdout:3/783: chown d1/d5/c13 5425 1 2024-09-21T12:47:03.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/174: dwrite d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:03.299 INFO:tasks.workunit.client.1.smithi176.stdout:3/784: chown d1/d34/d5d/d78/d10b/dd2 871 1 2024-09-21T12:47:03.300 INFO:tasks.workunit.client.1.smithi176.stdout:8/665: dwrite d6/db/d37/f3a [0,4194304] 0 2024-09-21T12:47:03.300 INFO:tasks.workunit.client.0.smithi046.stdout:4/205: truncate d1/d13/d25/d29/f42 914174 0 2024-09-21T12:47:03.301 INFO:tasks.workunit.client.1.smithi176.stdout:7/815: mknod d0/d2/db/d10/d72/c123 0 2024-09-21T12:47:03.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/175: write d4/d22/f32 [777160,33654] 0 2024-09-21T12:47:03.302 INFO:tasks.workunit.client.1.smithi176.stdout:3/785: dread - d1/d8d/dfd/f116 zero size 2024-09-21T12:47:03.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/175: unlink d4/d13/f23 0 2024-09-21T12:47:03.303 INFO:tasks.workunit.client.0.smithi046.stdout:5/176: chown d4/f2e 95146145 1 2024-09-21T12:47:03.304 INFO:tasks.workunit.client.0.smithi046.stdout:3/157: getdents d5/dc 0 2024-09-21T12:47:03.305 INFO:tasks.workunit.client.1.smithi176.stdout:6/639: dwrite d2/d6f/d7f/fa8 [4194304,4194304] 0 2024-09-21T12:47:03.305 INFO:tasks.workunit.client.0.smithi046.stdout:0/226: getdents d6/d7/d13/d49/d51 0 2024-09-21T12:47:03.306 INFO:tasks.workunit.client.1.smithi176.stdout:6/640: chown d2/dd/d26/d2b/c94 8707292 1 2024-09-21T12:47:03.306 INFO:tasks.workunit.client.1.smithi176.stdout:9/671: truncate d1/d61/d73/d7d/f8d 791634 0 2024-09-21T12:47:03.311 INFO:tasks.workunit.client.0.smithi046.stdout:4/206: rename d1/d13/d25/d38 to d1/d27/d46 0 2024-09-21T12:47:03.312 INFO:tasks.workunit.client.1.smithi176.stdout:1/712: link d0/db/d1a/d2c/d84/fb9 d0/db/d1a/d2c/d48/d50/f106 0 2024-09-21T12:47:03.316 INFO:tasks.workunit.client.0.smithi046.stdout:0/227: dwrite d6/d7/d13/f1d [0,4194304] 0 2024-09-21T12:47:03.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/196: symlink d11/d19/d1b/d1c/l38 0 2024-09-21T12:47:03.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/197: chown fb 64034 1 2024-09-21T12:47:03.320 INFO:tasks.workunit.client.0.smithi046.stdout:5/177: rmdir d4/d22/d10 39 2024-09-21T12:47:03.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/158: creat d5/dc/d26/f35 x:0 0 0 2024-09-21T12:47:03.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/178: creat d4/dc/d13/f35 x:0 0 0 2024-09-21T12:47:03.337 INFO:tasks.workunit.client.0.smithi046.stdout:5/179: stat d4/f2e 0 2024-09-21T12:47:03.339 INFO:tasks.workunit.client.1.smithi176.stdout:4/687: symlink d3/d21/d27/d2c/lfa 0 2024-09-21T12:47:03.339 INFO:tasks.workunit.client.1.smithi176.stdout:3/786: fdatasync d1/f2f 0 2024-09-21T12:47:03.339 INFO:tasks.workunit.client.1.smithi176.stdout:0/825: getdents d9/d1a/d1d/d23/da1/da3/d1e/dbf 0 2024-09-21T12:47:03.340 INFO:tasks.workunit.client.1.smithi176.stdout:3/787: readlink d1/d34/l69 0 2024-09-21T12:47:03.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/159: dread d5/dc/f15 [0,4194304] 0 2024-09-21T12:47:03.340 INFO:tasks.workunit.client.1.smithi176.stdout:4/688: chown d3/d5/dc5/dd6/ce1 79073825 1 2024-09-21T12:47:03.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/160: write d5/dc/d26/f27 [885373,106439] 0 2024-09-21T12:47:03.342 INFO:tasks.workunit.client.1.smithi176.stdout:4/689: write d3/d42/d56/fb8 [797130,126324] 0 2024-09-21T12:47:03.342 INFO:tasks.workunit.client.1.smithi176.stdout:4/690: truncate d3/d5/dc5/fc8 184888 0 2024-09-21T12:47:03.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/228: creat d6/d7/d37/d53/f55 x:0 0 0 2024-09-21T12:47:03.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/229: write d6/d7/f45 [830814,129514] 0 2024-09-21T12:47:03.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/176: dwrite d4/f1f [0,4194304] 0 2024-09-21T12:47:03.351 INFO:tasks.workunit.client.1.smithi176.stdout:5/598: getdents d0/d13/d5d 0 2024-09-21T12:47:03.352 INFO:tasks.workunit.client.1.smithi176.stdout:5/599: read d0/d10/f4c [1364861,34072] 0 2024-09-21T12:47:03.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/180: creat d4/d16/f36 x:0 0 0 2024-09-21T12:47:03.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/181: readlink d4/d22/l1f 0 2024-09-21T12:47:03.356 INFO:tasks.workunit.client.0.smithi046.stdout:5/182: fsync d4/fa 0 2024-09-21T12:47:03.357 INFO:tasks.workunit.client.0.smithi046.stdout:5/183: fdatasync d4/f2e 0 2024-09-21T12:47:03.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/207: write d1/d13/d25/d29/f42 [1024370,76361] 0 2024-09-21T12:47:03.358 INFO:tasks.workunit.client.0.smithi046.stdout:9/198: truncate d11/d19/f24 297166 0 2024-09-21T12:47:03.359 INFO:tasks.workunit.client.0.smithi046.stdout:3/161: mknod d5/dc/c36 0 2024-09-21T12:47:03.361 INFO:tasks.workunit.client.1.smithi176.stdout:6/641: symlink d2/dd/dc7/lcd 0 2024-09-21T12:47:03.361 INFO:tasks.workunit.client.1.smithi176.stdout:9/672: symlink d1/df/le2 0 2024-09-21T12:47:03.362 INFO:tasks.workunit.client.1.smithi176.stdout:6/642: write d2/d6f/f78 [625023,117054] 0 2024-09-21T12:47:03.365 INFO:tasks.workunit.client.1.smithi176.stdout:3/788: symlink d1/d5/d25/d40/l122 0 2024-09-21T12:47:03.366 INFO:tasks.workunit.client.0.smithi046.stdout:0/230: dread d6/d7/fa [0,4194304] 0 2024-09-21T12:47:03.366 INFO:tasks.workunit.client.1.smithi176.stdout:1/713: dread d0/db/d1a/d2c/d48/d50/f9c [0,4194304] 0 2024-09-21T12:47:03.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/177: rename d4/c2a to d4/d29/c44 0 2024-09-21T12:47:03.367 INFO:tasks.workunit.client.0.smithi046.stdout:0/231: readlink d6/d7/d9/l28 0 2024-09-21T12:47:03.367 INFO:tasks.workunit.client.1.smithi176.stdout:1/714: stat d0/db/d1a/d2c/dc5/d41/d59/d99/fa3 0 2024-09-21T12:47:03.372 INFO:tasks.workunit.client.1.smithi176.stdout:5/600: dread d0/d13/d63/d72/f8f [0,4194304] 0 2024-09-21T12:47:03.372 INFO:tasks.workunit.client.0.smithi046.stdout:5/184: chown d4/d22/d10/l1d 18 1 2024-09-21T12:47:03.376 INFO:tasks.workunit.client.0.smithi046.stdout:9/199: fsync d11/d19/d1b/f25 0 2024-09-21T12:47:03.376 INFO:tasks.workunit.client.0.smithi046.stdout:0/232: dwrite d6/d7/f45 [0,4194304] 0 2024-09-21T12:47:03.376 INFO:tasks.workunit.client.1.smithi176.stdout:2/695: sync 2024-09-21T12:47:03.379 INFO:tasks.workunit.client.1.smithi176.stdout:7/816: rmdir d0/d2/db/d10/d3b/d106/d113 0 2024-09-21T12:47:03.381 INFO:tasks.workunit.client.0.smithi046.stdout:3/162: creat d5/dc/d26/f37 x:0 0 0 2024-09-21T12:47:03.383 INFO:tasks.workunit.client.0.smithi046.stdout:3/163: write d5/dc/d28/f33 [911128,106956] 0 2024-09-21T12:47:03.385 INFO:tasks.workunit.client.0.smithi046.stdout:4/208: rename d1/d27/l2c to d1/d13/l47 0 2024-09-21T12:47:03.385 INFO:tasks.workunit.client.1.smithi176.stdout:7/817: dread d0/d2/db/d10/d72/d7e/de2/df3/d11e/f122 [0,4194304] 0 2024-09-21T12:47:03.386 INFO:tasks.workunit.client.1.smithi176.stdout:7/818: chown d0/d2/db/d10/d23/d85/f104 3598 1 2024-09-21T12:47:03.387 INFO:tasks.workunit.client.1.smithi176.stdout:9/673: truncate d1/df/d48/d69/d38/f43 1202524 0 2024-09-21T12:47:03.388 INFO:tasks.workunit.client.1.smithi176.stdout:9/674: fdatasync d1/df/d23/dcf/fd6 0 2024-09-21T12:47:03.392 INFO:tasks.workunit.client.1.smithi176.stdout:6/643: rename d2/dd/fc4 to d2/dd/d26/d2b/fce 0 2024-09-21T12:47:03.393 INFO:tasks.workunit.client.1.smithi176.stdout:6/644: fsync d2/d6f/d81/fb3 0 2024-09-21T12:47:03.393 INFO:tasks.workunit.client.1.smithi176.stdout:6/645: dread - d2/d6f/d7f/faa zero size 2024-09-21T12:47:03.394 INFO:tasks.workunit.client.1.smithi176.stdout:3/789: creat d1/d3e/f123 x:0 0 0 2024-09-21T12:47:03.398 INFO:tasks.workunit.client.0.smithi046.stdout:9/200: creat d11/d19/d20/d26/f39 x:0 0 0 2024-09-21T12:47:03.399 INFO:tasks.workunit.client.0.smithi046.stdout:0/233: creat d6/d7/d37/d53/f56 x:0 0 0 2024-09-21T12:47:03.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/178: write d4/d13/f1d [208199,87003] 0 2024-09-21T12:47:03.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/209: creat d1/d27/d46/f48 x:0 0 0 2024-09-21T12:47:03.408 INFO:tasks.workunit.client.1.smithi176.stdout:5/601: creat d0/d13/d63/d72/d87/d92/fb9 x:0 0 0 2024-09-21T12:47:03.409 INFO:tasks.workunit.client.1.smithi176.stdout:2/696: unlink d4/d63/f68 0 2024-09-21T12:47:03.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/179: dwrite d4/d29/d32/f3f [0,4194304] 0 2024-09-21T12:47:03.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/210: dread d1/d13/f31 [0,4194304] 0 2024-09-21T12:47:03.412 INFO:tasks.workunit.client.0.smithi046.stdout:5/185: rmdir d4/dc/d28 39 2024-09-21T12:47:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:03 smithi046 ceph-mon[27868]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:03.413 INFO:tasks.workunit.client.0.smithi046.stdout:5/186: truncate d4/d16/f36 684582 0 2024-09-21T12:47:03.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/201: symlink d11/d19/l3a 0 2024-09-21T12:47:03.415 INFO:tasks.workunit.client.0.smithi046.stdout:1/180: dread d4/d29/f41 [0,4194304] 0 2024-09-21T12:47:03.416 INFO:tasks.workunit.client.0.smithi046.stdout:0/234: write d6/d7/d13/d2a/d31/f26 [985758,5574] 0 2024-09-21T12:47:03.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/181: chown d4/d13/f27 238 1 2024-09-21T12:47:03.417 INFO:tasks.workunit.client.1.smithi176.stdout:3/790: rmdir d1/d5/d25/d38 39 2024-09-21T12:47:03.420 INFO:tasks.workunit.client.0.smithi046.stdout:5/187: dread d4/f8 [0,4194304] 0 2024-09-21T12:47:03.422 INFO:tasks.workunit.client.0.smithi046.stdout:5/188: chown d4/d22/d10/l1d 4431470 1 2024-09-21T12:47:03.425 INFO:tasks.workunit.client.1.smithi176.stdout:8/666: sync 2024-09-21T12:47:03.428 INFO:tasks.workunit.client.1.smithi176.stdout:9/675: write d1/df/d48/d69/d40/f53 [253020,97922] 0 2024-09-21T12:47:03.429 INFO:tasks.workunit.client.0.smithi046.stdout:0/235: creat d6/d7/d9/f57 x:0 0 0 2024-09-21T12:47:03.431 INFO:tasks.workunit.client.1.smithi176.stdout:6/646: write d2/dd/d26/d2b/dac/fb4 [5017360,36635] 0 2024-09-21T12:47:03.432 INFO:tasks.workunit.client.1.smithi176.stdout:6/647: write d2/dd/f48 [4499414,98540] 0 2024-09-21T12:47:03.434 INFO:tasks.workunit.client.0.smithi046.stdout:4/211: creat d1/d27/d37/f49 x:0 0 0 2024-09-21T12:47:03.437 INFO:tasks.workunit.client.0.smithi046.stdout:9/202: write d11/f12 [3585377,99074] 0 2024-09-21T12:47:03.438 INFO:tasks.workunit.client.0.smithi046.stdout:5/189: creat d4/d22/d10/d1a/f37 x:0 0 0 2024-09-21T12:47:03.439 INFO:tasks.workunit.client.0.smithi046.stdout:5/190: write d4/d16/f36 [1367339,67563] 0 2024-09-21T12:47:03.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/164: getdents d5 0 2024-09-21T12:47:03.442 INFO:tasks.workunit.client.0.smithi046.stdout:1/182: rename d4/d29/c35 to d4/d29/c45 0 2024-09-21T12:47:03.443 INFO:tasks.workunit.client.0.smithi046.stdout:4/212: rmdir d1/d13/d25/d29/d33 39 2024-09-21T12:47:03.444 INFO:tasks.workunit.client.0.smithi046.stdout:4/213: chown d1/f2a 298773324 1 2024-09-21T12:47:03.447 INFO:tasks.workunit.client.0.smithi046.stdout:4/214: dread d1/fe [0,4194304] 0 2024-09-21T12:47:03.447 INFO:tasks.workunit.client.0.smithi046.stdout:5/191: fdatasync d4/f8 0 2024-09-21T12:47:03.450 INFO:tasks.workunit.client.0.smithi046.stdout:0/236: link d6/d7/d13/d2a/d31/f26 d6/d7/d13/d2a/d31/f58 0 2024-09-21T12:47:03.452 INFO:tasks.workunit.client.0.smithi046.stdout:3/165: unlink d5/f2b 0 2024-09-21T12:47:03.454 INFO:tasks.workunit.client.0.smithi046.stdout:1/183: creat d4/d29/d32/f46 x:0 0 0 2024-09-21T12:47:03.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/237: dwrite d6/d7/f4d [0,4194304] 0 2024-09-21T12:47:03.457 INFO:tasks.workunit.client.0.smithi046.stdout:4/215: rmdir d1/d27/d46 39 2024-09-21T12:47:03.458 INFO:tasks.workunit.client.1.smithi176.stdout:4/691: sync 2024-09-21T12:47:03.459 INFO:tasks.workunit.client.0.smithi046.stdout:5/192: rmdir d4/dc/d13 39 2024-09-21T12:47:03.459 INFO:tasks.workunit.client.1.smithi176.stdout:4/692: read - d3/d5/db/d96/da3/fa5 zero size 2024-09-21T12:47:03.459 INFO:tasks.workunit.client.0.smithi046.stdout:0/238: dread d6/d7/d13/d2a/f44 [0,4194304] 0 2024-09-21T12:47:03.461 INFO:tasks.workunit.client.0.smithi046.stdout:5/193: truncate d4/d22/d10/d1a/f37 26595 0 2024-09-21T12:47:03.468 INFO:tasks.workunit.client.0.smithi046.stdout:5/194: dread d4/d16/f36 [0,4194304] 0 2024-09-21T12:47:03.473 INFO:tasks.workunit.client.0.smithi046.stdout:0/239: mkdir d6/d2f/d59 0 2024-09-21T12:47:03.481 INFO:tasks.workunit.client.0.smithi046.stdout:9/203: dwrite d11/d19/d1b/d1c/f2f [0,4194304] 0 2024-09-21T12:47:03.481 INFO:tasks.workunit.client.0.smithi046.stdout:9/204: chown d11/d19/d36 1928706334 1 2024-09-21T12:47:03.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/166: write d5/dc/f1b [537212,123719] 0 2024-09-21T12:47:03.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/167: write d5/dc/d26/f27 [1119889,37991] 0 2024-09-21T12:47:03.487 INFO:tasks.workunit.client.0.smithi046.stdout:4/216: rename d1/fd to d1/d13/d25/f4a 0 2024-09-21T12:47:03.491 INFO:tasks.workunit.client.0.smithi046.stdout:0/240: link d6/d7/d9/f57 d6/d7/d13/d2a/d31/f5a 0 2024-09-21T12:47:03.492 INFO:tasks.workunit.client.0.smithi046.stdout:9/205: mknod d11/d19/d1b/c3b 0 2024-09-21T12:47:03.494 INFO:tasks.workunit.client.0.smithi046.stdout:3/168: dwrite d5/dc/d28/f33 [0,4194304] 0 2024-09-21T12:47:03.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/169: readlink d5/dc/l12 0 2024-09-21T12:47:03.497 INFO:tasks.workunit.client.0.smithi046.stdout:3/170: chown d5/dc/f15 0 1 2024-09-21T12:47:03.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/184: getdents d4/d13/d38 0 2024-09-21T12:47:03.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/206: dread f2 [0,4194304] 0 2024-09-21T12:47:03.500 INFO:tasks.workunit.client.0.smithi046.stdout:9/207: chown d11/d19/d20/d26 216370669 1 2024-09-21T12:47:03.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/195: rename d4/d16/f1b to d4/dc/d13/f38 0 2024-09-21T12:47:03.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/185: mknod d4/d13/c47 0 2024-09-21T12:47:03.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/186: fdatasync d4/d13/f27 0 2024-09-21T12:47:03.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/217: rename d1/c9 to d1/d13/d25/d29/d43/c4b 0 2024-09-21T12:47:03.517 INFO:tasks.workunit.client.0.smithi046.stdout:4/218: dwrite d1/d13/d25/f19 [0,4194304] 0 2024-09-21T12:47:03.517 INFO:tasks.workunit.client.0.smithi046.stdout:1/187: fsync d4/d29/f41 0 2024-09-21T12:47:03.523 INFO:tasks.workunit.client.0.smithi046.stdout:0/241: creat d6/d7/f5b x:0 0 0 2024-09-21T12:47:03.524 INFO:tasks.workunit.client.1.smithi176.stdout:0/826: getdents d9/d1a/d1d/d23/d5f 0 2024-09-21T12:47:03.527 INFO:tasks.workunit.client.0.smithi046.stdout:1/188: dwrite d4/d29/d32/f40 [0,4194304] 0 2024-09-21T12:47:03.527 INFO:tasks.workunit.client.1.smithi176.stdout:3/791: symlink d1/d34/d5d/dfe/l124 0 2024-09-21T12:47:03.527 INFO:tasks.workunit.client.1.smithi176.stdout:3/792: chown d1/d34/d5d/d78 402 1 2024-09-21T12:47:03.528 INFO:tasks.workunit.client.1.smithi176.stdout:3/793: dread - d1/d8d/dfd/f116 zero size 2024-09-21T12:47:03.529 INFO:tasks.workunit.client.1.smithi176.stdout:1/715: link d0/db/d6f/de1/le4 d0/db/d2a/l107 0 2024-09-21T12:47:03.530 INFO:tasks.workunit.client.1.smithi176.stdout:1/716: write d0/db/d1a/d2c/d84/fd4 [640007,47522] 0 2024-09-21T12:47:03.531 INFO:tasks.workunit.client.0.smithi046.stdout:9/208: write d11/d19/d1b/f25 [1371188,95726] 0 2024-09-21T12:47:03.533 INFO:tasks.workunit.client.1.smithi176.stdout:1/717: chown d0/db/d1a/d2c/d84/fd4 859 1 2024-09-21T12:47:03.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/171: rename d5/l17 to d5/dc/d30/d34/l38 0 2024-09-21T12:47:03.536 INFO:tasks.workunit.client.0.smithi046.stdout:5/196: creat d4/dc/f39 x:0 0 0 2024-09-21T12:47:03.536 INFO:tasks.workunit.client.1.smithi176.stdout:3/794: dwrite d1/d34/d57/dd0/d7d/ff4 [0,4194304] 0 2024-09-21T12:47:03.541 INFO:tasks.workunit.client.0.smithi046.stdout:1/189: mkdir d4/d13/d38/d48 0 2024-09-21T12:47:03.544 INFO:tasks.workunit.client.0.smithi046.stdout:9/209: fdatasync fb 0 2024-09-21T12:47:03.545 INFO:tasks.workunit.client.1.smithi176.stdout:7/819: creat d0/d2/d30/d93/d96/f124 x:0 0 0 2024-09-21T12:47:03.547 INFO:tasks.workunit.client.1.smithi176.stdout:2/697: creat d4/df/d2e/d6f/d5d/d67/d9f/fd4 x:0 0 0 2024-09-21T12:47:03.548 INFO:tasks.workunit.client.1.smithi176.stdout:2/698: chown d4/df/d83 2 1 2024-09-21T12:47:03.550 INFO:tasks.workunit.client.1.smithi176.stdout:0/827: symlink d9/d1a/db8/dd2/l125 0 2024-09-21T12:47:03.552 INFO:tasks.workunit.client.0.smithi046.stdout:1/190: dwrite d4/d13/f19 [0,4194304] 0 2024-09-21T12:47:03.553 INFO:tasks.workunit.client.0.smithi046.stdout:4/219: dwrite d1/d13/d25/f1e [0,4194304] 0 2024-09-21T12:47:03.554 INFO:tasks.workunit.client.0.smithi046.stdout:1/191: chown d4/c1e 267833114 1 2024-09-21T12:47:03.555 INFO:tasks.workunit.client.0.smithi046.stdout:8/184: sync 2024-09-21T12:47:03.555 INFO:tasks.workunit.client.0.smithi046.stdout:1/192: readlink d4/d29/l31 0 2024-09-21T12:47:03.556 INFO:tasks.workunit.client.0.smithi046.stdout:0/242: rename d6/d7/d13/f4c to d6/d7/d13/d49/f5c 0 2024-09-21T12:47:03.560 INFO:tasks.workunit.client.1.smithi176.stdout:4/693: sync 2024-09-21T12:47:03.562 INFO:tasks.workunit.client.1.smithi176.stdout:9/676: link d1/df/f39 d1/d61/d73/db6/fe3 0 2024-09-21T12:47:03.563 INFO:tasks.workunit.client.1.smithi176.stdout:9/677: fdatasync d1/df/d23/f59 0 2024-09-21T12:47:03.564 INFO:tasks.workunit.client.1.smithi176.stdout:9/678: readlink d1/df/d48/d69/d40/l70 0 2024-09-21T12:47:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:03 smithi176 ceph-mon[35476]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:03.566 INFO:tasks.workunit.client.0.smithi046.stdout:0/243: dwrite d6/d7/f5b [0,4194304] 0 2024-09-21T12:47:03.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/244: write d6/d7/d13/d2a/d31/f46 [1022719,82756] 0 2024-09-21T12:47:03.570 INFO:tasks.workunit.client.1.smithi176.stdout:3/795: dwrite d1/d5/d25/d38/f79 [0,4194304] 0 2024-09-21T12:47:03.572 INFO:tasks.workunit.client.0.smithi046.stdout:3/172: write d5/dc/d26/f37 [571135,97207] 0 2024-09-21T12:47:03.573 INFO:tasks.workunit.client.1.smithi176.stdout:7/820: mkdir d0/d2/db/d10/d72/d7e/de2/df3/d11e/d125 0 2024-09-21T12:47:03.575 INFO:tasks.workunit.client.1.smithi176.stdout:7/821: write d0/d2/db/d10/d23/da6/d105/f7d [2869275,2255] 0 2024-09-21T12:47:03.576 INFO:tasks.workunit.client.1.smithi176.stdout:3/796: dwrite d1/d5/f7b [0,4194304] 0 2024-09-21T12:47:03.577 INFO:tasks.workunit.client.0.smithi046.stdout:8/185: mknod d1/c47 0 2024-09-21T12:47:03.579 INFO:tasks.workunit.client.1.smithi176.stdout:3/797: write d1/d3e/f5a [3221828,16385] 0 2024-09-21T12:47:03.582 INFO:tasks.workunit.client.1.smithi176.stdout:8/667: dwrite d6/d8/fb6 [0,4194304] 0 2024-09-21T12:47:03.584 INFO:tasks.workunit.client.1.smithi176.stdout:1/718: mkdir d0/db/d1a/d2c/d48/d108 0 2024-09-21T12:47:03.586 INFO:tasks.workunit.client.1.smithi176.stdout:6/648: dwrite d2/dd/d26/d2b/f7e [0,4194304] 0 2024-09-21T12:47:03.587 INFO:tasks.workunit.client.0.smithi046.stdout:3/173: dwrite d5/dc/f1b [0,4194304] 0 2024-09-21T12:47:03.588 INFO:tasks.workunit.client.0.smithi046.stdout:4/220: creat d1/d13/d25/d29/d43/d3d/f4c x:0 0 0 2024-09-21T12:47:03.590 INFO:tasks.workunit.client.1.smithi176.stdout:9/679: creat d1/df/d48/d69/d40/fe4 x:0 0 0 2024-09-21T12:47:03.592 INFO:tasks.workunit.client.1.smithi176.stdout:4/694: write d3/d21/d27/d2c/f4b [5409118,2314] 0 2024-09-21T12:47:03.596 INFO:tasks.workunit.client.0.smithi046.stdout:0/245: dwrite d6/f3c [0,4194304] 0 2024-09-21T12:47:03.597 INFO:tasks.workunit.client.1.smithi176.stdout:6/649: dwrite d2/dd/d26/d2b/fb0 [0,4194304] 0 2024-09-21T12:47:03.599 INFO:tasks.workunit.client.0.smithi046.stdout:1/193: rename d4/d29/c45 to d4/d13/d38/c49 0 2024-09-21T12:47:03.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/246: dread - d6/d2f/d32/f47 zero size 2024-09-21T12:47:03.604 INFO:tasks.workunit.client.1.smithi176.stdout:5/602: getdents d0/d13/d63/d2e/d39 0 2024-09-21T12:47:03.607 INFO:tasks.workunit.client.0.smithi046.stdout:8/186: mknod d1/d12/d46/c48 0 2024-09-21T12:47:03.609 INFO:tasks.workunit.client.1.smithi176.stdout:2/699: rename d4/df/cc8 to d4/d3d/d76/cd5 0 2024-09-21T12:47:03.610 INFO:tasks.workunit.client.1.smithi176.stdout:2/700: chown d4/df/d2e/d39/db7/f82 38171 1 2024-09-21T12:47:03.612 INFO:tasks.workunit.client.0.smithi046.stdout:4/221: dwrite d1/d13/d25/d29/f2f [0,4194304] 0 2024-09-21T12:47:03.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/174: creat d5/dc/d30/f39 x:0 0 0 2024-09-21T12:47:03.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/210: creat d11/f3c x:0 0 0 2024-09-21T12:47:03.621 INFO:tasks.workunit.client.1.smithi176.stdout:7/822: creat d0/d2/db/d10/d72/d7e/de2/df3/d11e/f126 x:0 0 0 2024-09-21T12:47:03.622 INFO:tasks.workunit.client.0.smithi046.stdout:0/247: dwrite d6/f40 [4194304,4194304] 0 2024-09-21T12:47:03.625 INFO:tasks.workunit.client.1.smithi176.stdout:3/798: creat d1/d34/d5d/d78/d10b/dd2/f125 x:0 0 0 2024-09-21T12:47:03.629 INFO:tasks.workunit.client.1.smithi176.stdout:8/668: symlink d6/d8/d24/d5e/ld0 0 2024-09-21T12:47:03.630 INFO:tasks.workunit.client.1.smithi176.stdout:1/719: truncate d0/db/d1a/f20 3650665 0 2024-09-21T12:47:03.632 INFO:tasks.workunit.client.0.smithi046.stdout:1/194: mknod d4/d13/d38/d48/c4a 0 2024-09-21T12:47:03.632 INFO:tasks.workunit.client.0.smithi046.stdout:5/197: getdents d4/dc/d28 0 2024-09-21T12:47:03.634 INFO:tasks.workunit.client.0.smithi046.stdout:3/175: dread d5/dc/f1b [0,4194304] 0 2024-09-21T12:47:03.634 INFO:tasks.workunit.client.1.smithi176.stdout:8/669: dread d6/d8/d24/d35/f61 [0,4194304] 0 2024-09-21T12:47:03.635 INFO:tasks.workunit.client.0.smithi046.stdout:8/187: dwrite d1/d12/d1a/d33/f38 [0,4194304] 0 2024-09-21T12:47:03.637 INFO:tasks.workunit.client.0.smithi046.stdout:4/222: dwrite d1/d13/f16 [4194304,4194304] 0 2024-09-21T12:47:03.639 INFO:tasks.workunit.client.0.smithi046.stdout:4/223: readlink d1/d13/l22 0 2024-09-21T12:47:03.645 INFO:tasks.workunit.client.0.smithi046.stdout:4/224: dread d1/d13/f31 [4194304,4194304] 0 2024-09-21T12:47:03.646 INFO:tasks.workunit.client.1.smithi176.stdout:2/701: chown d4/d3d/d65/fcb 993108 1 2024-09-21T12:47:03.647 INFO:tasks.workunit.client.0.smithi046.stdout:0/248: symlink d6/l5d 0 2024-09-21T12:47:03.648 INFO:tasks.workunit.client.0.smithi046.stdout:0/249: dread - d6/d7/d13/d2a/d31/f5a zero size 2024-09-21T12:47:03.649 INFO:tasks.workunit.client.1.smithi176.stdout:3/799: dread d1/d34/d48/deb/dc6/fed [0,4194304] 0 2024-09-21T12:47:03.655 INFO:tasks.workunit.client.1.smithi176.stdout:0/828: truncate d9/d1a/d1d/d23/f32 7736903 0 2024-09-21T12:47:03.656 INFO:tasks.workunit.client.1.smithi176.stdout:9/680: mkdir d1/df/d23/dcf/ddd/de5 0 2024-09-21T12:47:03.658 INFO:tasks.workunit.client.0.smithi046.stdout:5/198: symlink d4/d22/d10/d1a/l3a 0 2024-09-21T12:47:03.659 INFO:tasks.workunit.client.1.smithi176.stdout:1/720: truncate d0/db/d1a/f21 4870557 0 2024-09-21T12:47:03.659 INFO:tasks.workunit.client.1.smithi176.stdout:1/721: write d0/f3d [729874,26675] 0 2024-09-21T12:47:03.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/199: write d4/dc/f39 [571767,57760] 0 2024-09-21T12:47:03.661 INFO:tasks.workunit.client.0.smithi046.stdout:4/225: fdatasync d1/fe 0 2024-09-21T12:47:03.663 INFO:tasks.workunit.client.1.smithi176.stdout:4/695: mknod d3/d21/d27/cfb 0 2024-09-21T12:47:03.667 INFO:tasks.workunit.client.0.smithi046.stdout:9/211: write f4 [5219205,105197] 0 2024-09-21T12:47:03.672 INFO:tasks.workunit.client.0.smithi046.stdout:5/200: dwrite d4/dc/f39 [0,4194304] 0 2024-09-21T12:47:03.672 INFO:tasks.workunit.client.0.smithi046.stdout:8/188: dread d1/f1c [0,4194304] 0 2024-09-21T12:47:03.673 INFO:tasks.workunit.client.1.smithi176.stdout:2/702: mkdir d4/df/d2e/d6f/d5d/d67/dd6 0 2024-09-21T12:47:03.673 INFO:tasks.workunit.client.1.smithi176.stdout:2/703: chown d4/d40/l6c 35396 1 2024-09-21T12:47:03.674 INFO:tasks.workunit.client.0.smithi046.stdout:3/176: dread d5/fb [0,4194304] 0 2024-09-21T12:47:03.675 INFO:tasks.workunit.client.1.smithi176.stdout:7/823: symlink d0/d2/db/d10/d61/l127 0 2024-09-21T12:47:03.676 INFO:tasks.workunit.client.1.smithi176.stdout:3/800: truncate d1/d5/f14 4449110 0 2024-09-21T12:47:03.678 INFO:tasks.workunit.client.0.smithi046.stdout:4/226: rmdir d1/d13/d25 39 2024-09-21T12:47:03.680 INFO:tasks.workunit.client.1.smithi176.stdout:5/603: dwrite d0/d13/d63/d66/f69 [0,4194304] 0 2024-09-21T12:47:03.682 INFO:tasks.workunit.client.1.smithi176.stdout:0/829: creat d9/d1a/d1d/d23/da1/da3/d8f/d91/f126 x:0 0 0 2024-09-21T12:47:03.682 INFO:tasks.workunit.client.0.smithi046.stdout:0/250: creat d6/d7/d13/d43/d52/f5e x:0 0 0 2024-09-21T12:47:03.683 INFO:tasks.workunit.client.0.smithi046.stdout:9/212: dread d11/f16 [0,4194304] 0 2024-09-21T12:47:03.684 INFO:tasks.workunit.client.1.smithi176.stdout:0/830: read d9/ff [2521425,73766] 0 2024-09-21T12:47:03.685 INFO:tasks.workunit.client.0.smithi046.stdout:8/189: creat d1/d12/d46/f49 x:0 0 0 2024-09-21T12:47:03.687 INFO:tasks.workunit.client.0.smithi046.stdout:8/190: dread - d1/d24/f42 zero size 2024-09-21T12:47:03.688 INFO:tasks.workunit.client.0.smithi046.stdout:8/191: stat d1/d12/d46/f37 0 2024-09-21T12:47:03.688 INFO:tasks.workunit.client.0.smithi046.stdout:5/201: truncate d4/d16/f36 2101100 0 2024-09-21T12:47:03.689 INFO:tasks.workunit.client.0.smithi046.stdout:8/192: chown d1/fe 26 1 2024-09-21T12:47:03.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/202: dread d4/d22/f32 [0,4194304] 0 2024-09-21T12:47:03.694 INFO:tasks.workunit.client.1.smithi176.stdout:6/650: sync 2024-09-21T12:47:03.696 INFO:tasks.workunit.client.1.smithi176.stdout:7/824: creat d0/d5d/d5e/f128 x:0 0 0 2024-09-21T12:47:03.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/177: unlink d5/d16/f19 0 2024-09-21T12:47:03.699 INFO:tasks.workunit.client.0.smithi046.stdout:4/227: dwrite d1/f35 [0,4194304] 0 2024-09-21T12:47:03.700 INFO:tasks.workunit.client.1.smithi176.stdout:5/604: creat d0/d13/d63/d2e/d37/db5/fba x:0 0 0 2024-09-21T12:47:03.700 INFO:tasks.workunit.client.0.smithi046.stdout:4/228: truncate d1/f2a 1043790 0 2024-09-21T12:47:03.701 INFO:tasks.workunit.client.0.smithi046.stdout:8/193: rmdir d1 39 2024-09-21T12:47:03.703 INFO:tasks.workunit.client.1.smithi176.stdout:9/681: symlink d1/df/d48/le6 0 2024-09-21T12:47:03.704 INFO:tasks.workunit.client.1.smithi176.stdout:5/605: dread d0/d10/f2b [0,4194304] 0 2024-09-21T12:47:03.704 INFO:tasks.workunit.client.1.smithi176.stdout:9/682: dread - d1/df/d48/d69/d76/d7c/fc4 zero size 2024-09-21T12:47:03.705 INFO:tasks.workunit.client.1.smithi176.stdout:0/831: fdatasync d9/d1a/d1d/d23/d5f/f89 0 2024-09-21T12:47:03.710 INFO:tasks.workunit.client.1.smithi176.stdout:1/722: rename d0/db/d1a/d2c/d48/c4b to d0/db/d1a/d2c/d84/c109 0 2024-09-21T12:47:03.712 INFO:tasks.workunit.client.1.smithi176.stdout:4/696: symlink d3/d5/db/df0/lfc 0 2024-09-21T12:47:03.714 INFO:tasks.workunit.client.0.smithi046.stdout:4/229: readlink d1/d13/d25/d29/d43/l2e 0 2024-09-21T12:47:03.715 INFO:tasks.workunit.client.0.smithi046.stdout:4/230: write d1/f2a [1991502,128831] 0 2024-09-21T12:47:03.716 INFO:tasks.workunit.client.0.smithi046.stdout:4/231: readlink d1/l1d 0 2024-09-21T12:47:03.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/232: chown d1/d13/d25/c3b 3 1 2024-09-21T12:47:03.719 INFO:tasks.workunit.client.0.smithi046.stdout:0/251: rename d6/d7/d13/d2a/d31/f58 to d6/d7/d13/d2a/f5f 0 2024-09-21T12:47:03.719 INFO:tasks.workunit.client.1.smithi176.stdout:5/606: dread d0/d13/d63/d2e/d39/d41/f60 [0,4194304] 0 2024-09-21T12:47:03.720 INFO:tasks.workunit.client.1.smithi176.stdout:6/651: rmdir d2/d6f 39 2024-09-21T12:47:03.721 INFO:tasks.workunit.client.1.smithi176.stdout:5/607: write d0/d13/d63/d2e/d37/d55/f83 [188393,103863] 0 2024-09-21T12:47:03.721 INFO:tasks.workunit.client.0.smithi046.stdout:5/203: mkdir d4/dc/d28/d2d/d3b 0 2024-09-21T12:47:03.722 INFO:tasks.workunit.client.1.smithi176.stdout:5/608: write d0/d13/d63/d72/d87/f89 [163367,80330] 0 2024-09-21T12:47:03.724 INFO:tasks.workunit.client.0.smithi046.stdout:3/178: symlink d5/l3a 0 2024-09-21T12:47:03.724 INFO:tasks.workunit.client.1.smithi176.stdout:3/801: symlink d1/d34/d71/d91/df6/d11f/l126 0 2024-09-21T12:47:03.725 INFO:tasks.workunit.client.1.smithi176.stdout:3/802: write d1/d35/fc9 [5053633,27910] 0 2024-09-21T12:47:03.727 INFO:tasks.workunit.client.0.smithi046.stdout:8/194: creat d1/d24/f4a x:0 0 0 2024-09-21T12:47:03.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/233: creat d1/d13/d25/d3a/f4d x:0 0 0 2024-09-21T12:47:03.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/234: dread - d1/f39 zero size 2024-09-21T12:47:03.731 INFO:tasks.workunit.client.1.smithi176.stdout:1/723: creat d0/d63/f10a x:0 0 0 2024-09-21T12:47:03.731 INFO:tasks.workunit.client.0.smithi046.stdout:8/195: dread d1/fd [4194304,4194304] 0 2024-09-21T12:47:03.732 INFO:tasks.workunit.client.0.smithi046.stdout:5/204: rename d4/d22/d10/d1a/l3a to d4/d16/l3c 0 2024-09-21T12:47:03.733 INFO:tasks.workunit.client.1.smithi176.stdout:4/697: symlink d3/d42/d56/lfd 0 2024-09-21T12:47:03.733 INFO:tasks.workunit.client.0.smithi046.stdout:3/179: rmdir d5 39 2024-09-21T12:47:03.734 INFO:tasks.workunit.client.1.smithi176.stdout:8/670: getdents d6/d8/d54/dca 0 2024-09-21T12:47:03.735 INFO:tasks.workunit.client.1.smithi176.stdout:8/671: write d6/d8/d24/d35/d51/f55 [449451,15202] 0 2024-09-21T12:47:03.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/252: mkdir d6/d60 0 2024-09-21T12:47:03.742 INFO:tasks.workunit.client.1.smithi176.stdout:4/698: dread d3/f3c [0,4194304] 0 2024-09-21T12:47:03.744 INFO:tasks.workunit.client.0.smithi046.stdout:8/196: creat d1/d12/d46/d35/d36/f4b x:0 0 0 2024-09-21T12:47:03.748 INFO:tasks.workunit.client.0.smithi046.stdout:5/205: symlink d4/dc/d28/d2d/d3b/l3d 0 2024-09-21T12:47:03.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/180: symlink d5/dc/l3b 0 2024-09-21T12:47:03.752 INFO:tasks.workunit.client.0.smithi046.stdout:8/197: rename d1/d12/d46/f3d to d1/d12/d1a/d33/f4c 0 2024-09-21T12:47:03.756 INFO:tasks.workunit.client.0.smithi046.stdout:5/206: symlink d4/dc/d13/l3e 0 2024-09-21T12:47:03.757 INFO:tasks.workunit.client.0.smithi046.stdout:3/181: mkdir d5/dc/d26/d3c 0 2024-09-21T12:47:03.759 INFO:tasks.workunit.client.0.smithi046.stdout:8/198: read d1/f20 [3401860,1004] 0 2024-09-21T12:47:03.760 INFO:tasks.workunit.client.1.smithi176.stdout:5/609: write d0/d13/d63/d2e/d37/d55/f6e [291278,8721] 0 2024-09-21T12:47:03.762 INFO:tasks.workunit.client.1.smithi176.stdout:2/704: getdents d4/d3d/d76 0 2024-09-21T12:47:03.764 INFO:tasks.workunit.client.0.smithi046.stdout:3/182: creat d5/dc/d26/f3d x:0 0 0 2024-09-21T12:47:03.765 INFO:tasks.workunit.client.1.smithi176.stdout:3/803: write d1/d35/f36 [5049670,52766] 0 2024-09-21T12:47:03.766 INFO:tasks.workunit.client.0.smithi046.stdout:0/253: dwrite d6/d7/d9/f50 [0,4194304] 0 2024-09-21T12:47:03.771 INFO:tasks.workunit.client.1.smithi176.stdout:7/825: creat d0/d2/db/f129 x:0 0 0 2024-09-21T12:47:03.771 INFO:tasks.workunit.client.1.smithi176.stdout:3/804: dwrite d1/d5/d25/d61/f115 [0,4194304] 0 2024-09-21T12:47:03.772 INFO:tasks.workunit.client.1.smithi176.stdout:9/683: write d1/df/d1c/f3c [3454440,53589] 0 2024-09-21T12:47:03.773 INFO:tasks.workunit.client.0.smithi046.stdout:3/183: mknod d5/dc/d30/c3e 0 2024-09-21T12:47:03.774 INFO:tasks.workunit.client.1.smithi176.stdout:6/652: dread d2/dd/f11 [0,4194304] 0 2024-09-21T12:47:03.777 INFO:tasks.workunit.client.0.smithi046.stdout:5/207: truncate d4/dc/f39 3647405 0 2024-09-21T12:47:03.778 INFO:tasks.workunit.client.0.smithi046.stdout:0/254: write d6/d7/d13/d2a/f44 [969539,121505] 0 2024-09-21T12:47:03.781 INFO:tasks.workunit.client.0.smithi046.stdout:3/184: mknod d5/dc/d30/c3f 0 2024-09-21T12:47:03.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/199: truncate d1/fa 1063845 0 2024-09-21T12:47:03.782 INFO:tasks.workunit.client.1.smithi176.stdout:8/672: dwrite d6/d16/d79/f83 [0,4194304] 0 2024-09-21T12:47:03.784 INFO:tasks.workunit.client.0.smithi046.stdout:0/255: creat d6/d7/d37/f61 x:0 0 0 2024-09-21T12:47:03.785 INFO:tasks.workunit.client.0.smithi046.stdout:0/256: write d6/f3c [802595,120745] 0 2024-09-21T12:47:03.786 INFO:tasks.workunit.client.1.smithi176.stdout:5/610: symlink d0/d13/d63/d72/d87/d92/lbb 0 2024-09-21T12:47:03.787 INFO:tasks.workunit.client.0.smithi046.stdout:8/200: chown d1/d24/c3e 359 1 2024-09-21T12:47:03.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/185: dwrite d5/dc/f1d [0,4194304] 0 2024-09-21T12:47:03.791 INFO:tasks.workunit.client.0.smithi046.stdout:3/186: read - d5/dc/d30/f39 zero size 2024-09-21T12:47:03.791 INFO:tasks.workunit.client.1.smithi176.stdout:4/699: mkdir d3/d42/dfe 0 2024-09-21T12:47:03.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/201: dwrite d1/f8 [0,4194304] 0 2024-09-21T12:47:03.801 INFO:tasks.workunit.client.0.smithi046.stdout:8/202: dread - d1/d12/d1a/f2c zero size 2024-09-21T12:47:03.802 INFO:tasks.workunit.client.1.smithi176.stdout:3/805: mknod d1/d34/d57/dd0/d7d/c127 0 2024-09-21T12:47:03.809 INFO:tasks.workunit.client.0.smithi046.stdout:8/203: symlink d1/d12/d1a/d33/l4d 0 2024-09-21T12:47:03.811 INFO:tasks.workunit.client.1.smithi176.stdout:2/705: creat d4/df/d2e/d6f/d5d/d81/db2/da5/dcc/fd7 x:0 0 0 2024-09-21T12:47:03.812 INFO:tasks.workunit.client.1.smithi176.stdout:2/706: readlink d4/df/d2e/d6f/d5d/d81/la7 0 2024-09-21T12:47:03.813 INFO:tasks.workunit.client.1.smithi176.stdout:7/826: write d0/d2/db/d10/d5a/fc5 [1293610,82927] 0 2024-09-21T12:47:03.817 INFO:tasks.workunit.client.1.smithi176.stdout:9/684: creat d1/df/dc3/fe7 x:0 0 0 2024-09-21T12:47:03.818 INFO:tasks.workunit.client.0.smithi046.stdout:8/204: dwrite d1/f41 [0,4194304] 0 2024-09-21T12:47:03.819 INFO:tasks.workunit.client.1.smithi176.stdout:0/832: link d9/d1a/d3f/d40/le9 d9/d1a/d1d/d23/da1/da3/d93/df9/d77/l127 0 2024-09-21T12:47:03.820 INFO:tasks.workunit.client.1.smithi176.stdout:1/724: getdents d0/db/d1a/d2c/d6b 0 2024-09-21T12:47:03.820 INFO:tasks.workunit.client.0.smithi046.stdout:0/257: dwrite d6/d7/d13/d2a/f5f [0,4194304] 0 2024-09-21T12:47:03.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/187: write d5/fb [1988541,125699] 0 2024-09-21T12:47:03.825 INFO:tasks.workunit.client.0.smithi046.stdout:0/258: dread - d6/d7/d13/f3d zero size 2024-09-21T12:47:03.825 INFO:tasks.workunit.client.0.smithi046.stdout:5/208: dread d4/dc/d13/f23 [0,4194304] 0 2024-09-21T12:47:03.827 INFO:tasks.workunit.client.1.smithi176.stdout:5/611: creat d0/d13/d5d/d98/d9b/dad/fbc x:0 0 0 2024-09-21T12:47:03.828 INFO:tasks.workunit.client.0.smithi046.stdout:8/205: unlink d1/c1d 0 2024-09-21T12:47:03.828 INFO:tasks.workunit.client.1.smithi176.stdout:5/612: dread - d0/d13/d63/d2e/d37/d55/fa7 zero size 2024-09-21T12:47:03.829 INFO:tasks.workunit.client.1.smithi176.stdout:2/707: creat d4/df/d2e/d6f/d5d/d67/fd8 x:0 0 0 2024-09-21T12:47:03.831 INFO:tasks.workunit.client.1.smithi176.stdout:2/708: write d4/fb0 [3546212,42592] 0 2024-09-21T12:47:03.833 INFO:tasks.workunit.client.1.smithi176.stdout:1/725: dread d0/db/d1a/d2c/dc5/d2b/d43/f60 [0,4194304] 0 2024-09-21T12:47:03.834 INFO:tasks.workunit.client.1.smithi176.stdout:4/700: truncate d3/d5/db/d96/da3/ff9 823955 0 2024-09-21T12:47:03.834 INFO:tasks.workunit.client.0.smithi046.stdout:5/209: rmdir d4/dc/d28 39 2024-09-21T12:47:03.834 INFO:tasks.workunit.client.1.smithi176.stdout:2/709: truncate d4/df/d2e/d6f/d5d/d67/f97 620941 0 2024-09-21T12:47:03.835 INFO:tasks.workunit.client.0.smithi046.stdout:5/210: stat d4/d22/d10/d1a 0 2024-09-21T12:47:03.837 INFO:tasks.workunit.client.0.smithi046.stdout:3/188: symlink d5/l40 0 2024-09-21T12:47:03.838 INFO:tasks.workunit.client.1.smithi176.stdout:7/827: dwrite d0/d2/db/d10/d72/d94/fef [0,4194304] 0 2024-09-21T12:47:03.842 INFO:tasks.workunit.client.0.smithi046.stdout:8/206: link d1/d12/d1a/d33/f4c d1/d12/d46/d35/d36/f4e 0 2024-09-21T12:47:03.844 INFO:tasks.workunit.client.1.smithi176.stdout:9/685: write d1/df/d23/f45 [1434045,17999] 0 2024-09-21T12:47:03.845 INFO:tasks.workunit.client.0.smithi046.stdout:0/259: creat d6/f62 x:0 0 0 2024-09-21T12:47:03.846 INFO:tasks.workunit.client.1.smithi176.stdout:1/726: mkdir d0/db/d6f/de1/d10b 0 2024-09-21T12:47:03.846 INFO:tasks.workunit.client.0.smithi046.stdout:3/189: mknod d5/dc/d28/c41 0 2024-09-21T12:47:03.849 INFO:tasks.workunit.client.1.smithi176.stdout:4/701: creat d3/d21/d88/da7/fff x:0 0 0 2024-09-21T12:47:03.850 INFO:tasks.workunit.client.0.smithi046.stdout:0/260: mkdir d6/d7/d13/d43/d52/d63 0 2024-09-21T12:47:03.851 INFO:tasks.workunit.client.1.smithi176.stdout:3/806: creat d1/d5/f128 x:0 0 0 2024-09-21T12:47:03.852 INFO:tasks.workunit.client.0.smithi046.stdout:3/190: unlink d5/dc/d26/f35 0 2024-09-21T12:47:03.855 INFO:tasks.workunit.client.0.smithi046.stdout:8/207: fsync d1/fa 0 2024-09-21T12:47:03.857 INFO:tasks.workunit.client.1.smithi176.stdout:9/686: stat d1/df/d48/d69/d40 0 2024-09-21T12:47:03.858 INFO:tasks.workunit.client.0.smithi046.stdout:0/261: creat d6/d7/d13/d43/d52/f64 x:0 0 0 2024-09-21T12:47:03.860 INFO:tasks.workunit.client.1.smithi176.stdout:4/702: truncate d3/d5/db/d96/feb 1180772 0 2024-09-21T12:47:03.861 INFO:tasks.workunit.client.0.smithi046.stdout:3/191: rmdir d5/dc 39 2024-09-21T12:47:03.861 INFO:tasks.workunit.client.1.smithi176.stdout:4/703: write d3/d21/d27/fee [121304,21647] 0 2024-09-21T12:47:03.865 INFO:tasks.workunit.client.1.smithi176.stdout:0/833: rename d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd/d10b to d9/d1a/d3f/d128 0 2024-09-21T12:47:03.866 INFO:tasks.workunit.client.1.smithi176.stdout:9/687: symlink d1/d61/le8 0 2024-09-21T12:47:03.867 INFO:tasks.workunit.client.0.smithi046.stdout:3/192: stat d5/dc/l1f 0 2024-09-21T12:47:03.868 INFO:tasks.workunit.client.1.smithi176.stdout:4/704: dwrite d3/d21/d5e/f74 [0,4194304] 0 2024-09-21T12:47:03.868 INFO:tasks.workunit.client.1.smithi176.stdout:4/705: dread - d3/d42/d47/fd5 zero size 2024-09-21T12:47:03.869 INFO:tasks.workunit.client.0.smithi046.stdout:5/211: link d4/d16/f36 d4/dc/d28/f3f 0 2024-09-21T12:47:03.869 INFO:tasks.workunit.client.0.smithi046.stdout:3/193: truncate d5/dc/d30/f39 641129 0 2024-09-21T12:47:03.870 INFO:tasks.workunit.client.1.smithi176.stdout:5/613: rename d0/d13/d63/d72/d87/d92/c9a to d0/d13/d63/d2e/d39/cbd 0 2024-09-21T12:47:03.870 INFO:tasks.workunit.client.1.smithi176.stdout:1/727: creat d0/f10c x:0 0 0 2024-09-21T12:47:03.871 INFO:tasks.workunit.client.1.smithi176.stdout:9/688: readlink d1/df/d48/d69/d38/l47 0 2024-09-21T12:47:03.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/208: fsync d1/d24/f31 0 2024-09-21T12:47:03.874 INFO:tasks.workunit.client.1.smithi176.stdout:9/689: dread - d1/df/d23/dcf/fd6 zero size 2024-09-21T12:47:03.875 INFO:tasks.workunit.client.1.smithi176.stdout:0/834: creat d9/d1a/d1d/d23/da1/da3/d1e/de1/f129 x:0 0 0 2024-09-21T12:47:03.875 INFO:tasks.workunit.client.0.smithi046.stdout:0/262: link d6/f3c d6/d2f/d32/f65 0 2024-09-21T12:47:03.877 INFO:tasks.workunit.client.1.smithi176.stdout:3/807: dread d1/d5/f83 [0,4194304] 0 2024-09-21T12:47:03.878 INFO:tasks.workunit.client.0.smithi046.stdout:3/194: dread d5/dc/f1d [0,4194304] 0 2024-09-21T12:47:03.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/212: dwrite d4/f2e [0,4194304] 0 2024-09-21T12:47:03.879 INFO:tasks.workunit.client.1.smithi176.stdout:0/835: dread d9/d1a/f58 [0,4194304] 0 2024-09-21T12:47:03.880 INFO:tasks.workunit.client.1.smithi176.stdout:2/710: rename d4/df/d2e/d39/d55 to d4/df/d2e/d6f/d5d/d81/dd9 0 2024-09-21T12:47:03.881 INFO:tasks.workunit.client.0.smithi046.stdout:5/213: write d4/d22/d10/d1a/f37 [77585,25050] 0 2024-09-21T12:47:03.883 INFO:tasks.workunit.client.1.smithi176.stdout:4/706: mknod d3/d21/df5/c100 0 2024-09-21T12:47:03.884 INFO:tasks.workunit.client.0.smithi046.stdout:0/263: dread d6/f23 [0,4194304] 0 2024-09-21T12:47:03.885 INFO:tasks.workunit.client.0.smithi046.stdout:8/209: creat d1/f4f x:0 0 0 2024-09-21T12:47:03.885 INFO:tasks.workunit.client.1.smithi176.stdout:3/808: mkdir d1/d9e/d129 0 2024-09-21T12:47:03.887 INFO:tasks.workunit.client.1.smithi176.stdout:6/653: sync 2024-09-21T12:47:03.888 INFO:tasks.workunit.client.1.smithi176.stdout:8/673: sync 2024-09-21T12:47:03.888 INFO:tasks.workunit.client.1.smithi176.stdout:1/728: rename d0/db/d6a/f7c to d0/db/d1a/d73/f10d 0 2024-09-21T12:47:03.893 INFO:tasks.workunit.client.1.smithi176.stdout:2/711: mkdir d4/df/d2e/d39/db7/d80/dda 0 2024-09-21T12:47:03.894 INFO:tasks.workunit.client.1.smithi176.stdout:6/654: dwrite d2/dd/d26/f38 [0,4194304] 0 2024-09-21T12:47:03.894 INFO:tasks.workunit.client.1.smithi176.stdout:5/614: dread d0/d13/d5d/f73 [0,4194304] 0 2024-09-21T12:47:03.898 INFO:tasks.workunit.client.1.smithi176.stdout:4/707: mkdir d3/d42/d56/d101 0 2024-09-21T12:47:03.899 INFO:tasks.workunit.client.1.smithi176.stdout:3/809: rmdir d1/d34/d71/d91/df6/d11f 39 2024-09-21T12:47:03.907 INFO:tasks.workunit.client.1.smithi176.stdout:8/674: dread d6/db/d37/f88 [0,4194304] 0 2024-09-21T12:47:03.907 INFO:tasks.workunit.client.0.smithi046.stdout:5/214: truncate d4/dc/d28/f3f 867498 0 2024-09-21T12:47:03.907 INFO:tasks.workunit.client.1.smithi176.stdout:8/675: stat d6/db/d13/f29 0 2024-09-21T12:47:03.908 INFO:tasks.workunit.client.1.smithi176.stdout:8/676: chown d6/d8/d24/l60 2034 1 2024-09-21T12:47:03.913 INFO:tasks.workunit.client.1.smithi176.stdout:8/677: dwrite d6/d8/d24/d35/fc7 [0,4194304] 0 2024-09-21T12:47:03.915 INFO:tasks.workunit.client.1.smithi176.stdout:6/655: fdatasync d2/dd/d26/d2b/f92 0 2024-09-21T12:47:03.916 INFO:tasks.workunit.client.0.smithi046.stdout:5/215: rmdir d4 39 2024-09-21T12:47:03.918 INFO:tasks.workunit.client.1.smithi176.stdout:5/615: creat d0/d13/d63/d66/fbe x:0 0 0 2024-09-21T12:47:03.919 INFO:tasks.workunit.client.1.smithi176.stdout:5/616: dread - d0/d13/d63/d72/d87/d92/fb9 zero size 2024-09-21T12:47:03.920 INFO:tasks.workunit.client.0.smithi046.stdout:8/210: dwrite d1/d12/d46/d35/d36/f4e [0,4194304] 0 2024-09-21T12:47:03.923 INFO:tasks.workunit.client.0.smithi046.stdout:5/216: dread - d4/dc/d13/f35 zero size 2024-09-21T12:47:03.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/195: truncate d5/f20 1294114 0 2024-09-21T12:47:03.926 INFO:tasks.workunit.client.1.smithi176.stdout:3/810: creat d1/d34/d48/deb/dc6/f12a x:0 0 0 2024-09-21T12:47:03.926 INFO:tasks.workunit.client.1.smithi176.stdout:2/712: dread d4/df/d2e/d6f/d5d/d67/fb4 [0,4194304] 0 2024-09-21T12:47:03.928 INFO:tasks.workunit.client.1.smithi176.stdout:7/828: sync 2024-09-21T12:47:03.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/264: getdents d6/d7/d37 0 2024-09-21T12:47:03.930 INFO:tasks.workunit.client.1.smithi176.stdout:0/836: link d9/dc2/cdc d9/d1a/d3f/d40/d79/c12a 0 2024-09-21T12:47:03.932 INFO:tasks.workunit.client.0.smithi046.stdout:8/211: creat d1/d12/d46/d35/f50 x:0 0 0 2024-09-21T12:47:03.932 INFO:tasks.workunit.client.1.smithi176.stdout:0/837: chown d9/d1a/d3f/l64 1941 1 2024-09-21T12:47:03.933 INFO:tasks.workunit.client.0.smithi046.stdout:8/212: fsync d1/d12/d46/f49 0 2024-09-21T12:47:03.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/196: dread d5/dc/d28/f33 [0,4194304] 0 2024-09-21T12:47:03.934 INFO:tasks.workunit.client.1.smithi176.stdout:7/829: dwrite d0/d2/f5c [0,4194304] 0 2024-09-21T12:47:03.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/213: write d1/d24/f4a [91677,116173] 0 2024-09-21T12:47:03.936 INFO:tasks.workunit.client.0.smithi046.stdout:8/214: read d1/d24/f4a [159855,58621] 0 2024-09-21T12:47:03.939 INFO:tasks.workunit.client.1.smithi176.stdout:8/678: mkdir d6/d16/d36/d67/dd1 0 2024-09-21T12:47:03.943 INFO:tasks.workunit.client.1.smithi176.stdout:6/656: chown d2/d6f/f78 16559337 1 2024-09-21T12:47:03.944 INFO:tasks.workunit.client.1.smithi176.stdout:4/708: mkdir d3/d42/d102 0 2024-09-21T12:47:03.945 INFO:tasks.workunit.client.0.smithi046.stdout:3/197: fsync d5/dc/fe 0 2024-09-21T12:47:03.947 INFO:tasks.workunit.client.1.smithi176.stdout:9/690: rename d1/d63/f9f to d1/df/fe9 0 2024-09-21T12:47:03.950 INFO:tasks.workunit.client.0.smithi046.stdout:8/215: unlink d1/d12/d1a/c2d 0 2024-09-21T12:47:03.954 INFO:tasks.workunit.client.0.smithi046.stdout:8/216: dread d1/f1c [0,4194304] 0 2024-09-21T12:47:03.956 INFO:tasks.workunit.client.0.smithi046.stdout:0/265: mknod d6/d7/c66 0 2024-09-21T12:47:03.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/266: write d6/d7/d37/f61 [703048,50888] 0 2024-09-21T12:47:03.960 INFO:tasks.workunit.client.0.smithi046.stdout:3/198: creat d5/d16/f42 x:0 0 0 2024-09-21T12:47:03.960 INFO:tasks.workunit.client.1.smithi176.stdout:0/838: write d9/d1a/d1d/d22/fb7 [457328,15119] 0 2024-09-21T12:47:03.960 INFO:tasks.workunit.client.1.smithi176.stdout:6/657: fsync d2/dd/f11 0 2024-09-21T12:47:03.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/217: truncate d4/dc/d28/f3f 1033597 0 2024-09-21T12:47:03.962 INFO:tasks.workunit.client.0.smithi046.stdout:5/218: stat d4/dc/d28/d2d 0 2024-09-21T12:47:03.962 INFO:tasks.workunit.client.1.smithi176.stdout:5/617: dread - d0/d13/d63/d2e/d39/fb3 zero size 2024-09-21T12:47:03.963 INFO:tasks.workunit.client.0.smithi046.stdout:8/217: mkdir d1/d12/d46/d35/d36/d51 0 2024-09-21T12:47:03.963 INFO:tasks.workunit.client.0.smithi046.stdout:8/218: stat d1/d12/d46/d35/f3c 0 2024-09-21T12:47:03.964 INFO:tasks.workunit.client.0.smithi046.stdout:8/219: read d1/f20 [3219284,60721] 0 2024-09-21T12:47:03.965 INFO:tasks.workunit.client.0.smithi046.stdout:0/267: creat d6/d7/d37/f67 x:0 0 0 2024-09-21T12:47:03.965 INFO:tasks.workunit.client.0.smithi046.stdout:3/199: readlink d5/l1c 0 2024-09-21T12:47:03.967 INFO:tasks.workunit.client.1.smithi176.stdout:6/658: dwrite d2/d6f/d7f/fa8 [0,4194304] 0 2024-09-21T12:47:03.967 INFO:tasks.workunit.client.0.smithi046.stdout:5/219: mknod d4/d16/c40 0 2024-09-21T12:47:03.968 INFO:tasks.workunit.client.1.smithi176.stdout:1/729: getdents d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3 0 2024-09-21T12:47:03.968 INFO:tasks.workunit.client.1.smithi176.stdout:7/830: dread d0/d2/db/d10/d3b/f88 [0,4194304] 0 2024-09-21T12:47:03.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/268: mknod d6/d2f/c68 0 2024-09-21T12:47:03.971 INFO:tasks.workunit.client.0.smithi046.stdout:5/220: rmdir d4/dc/d28/d2d/d3b 39 2024-09-21T12:47:03.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/269: symlink d6/d7/d37/l69 0 2024-09-21T12:47:03.977 INFO:tasks.workunit.client.1.smithi176.stdout:4/709: mkdir d3/d21/d27/d2c/d103 0 2024-09-21T12:47:03.977 INFO:tasks.workunit.client.1.smithi176.stdout:2/713: creat d4/d3d/fdb x:0 0 0 2024-09-21T12:47:03.978 INFO:tasks.workunit.client.0.smithi046.stdout:0/270: readlink d6/d7/d9/l19 0 2024-09-21T12:47:03.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/221: chown d4/c25 0 1 2024-09-21T12:47:03.979 INFO:tasks.workunit.client.1.smithi176.stdout:9/691: unlink d1/df/d48/d69/d40/c6b 0 2024-09-21T12:47:03.981 INFO:tasks.workunit.client.0.smithi046.stdout:3/200: getdents d5/dc/d26 0 2024-09-21T12:47:03.982 INFO:tasks.workunit.client.1.smithi176.stdout:7/831: rmdir d0/d2/db/d10/d31 39 2024-09-21T12:47:03.983 INFO:tasks.workunit.client.1.smithi176.stdout:7/832: chown d0/d2/db/d10/d72/d7e/dba 44607 1 2024-09-21T12:47:03.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/220: dread d1/d12/f19 [0,4194304] 0 2024-09-21T12:47:03.985 INFO:tasks.workunit.client.1.smithi176.stdout:9/692: dwrite d1/d63/f6e [0,4194304] 0 2024-09-21T12:47:03.985 INFO:tasks.workunit.client.1.smithi176.stdout:1/730: read d0/db/d1a/f21 [147399,29082] 0 2024-09-21T12:47:03.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/221: write d1/f8 [2982369,123327] 0 2024-09-21T12:47:03.987 INFO:tasks.workunit.client.0.smithi046.stdout:5/222: dread d4/dc/f39 [0,4194304] 0 2024-09-21T12:47:03.987 INFO:tasks.workunit.client.0.smithi046.stdout:3/201: creat d5/dc/d30/d34/f43 x:0 0 0 2024-09-21T12:47:03.989 INFO:tasks.workunit.client.1.smithi176.stdout:0/839: write d9/d1a/d1d/d81/d115/d98/fa2 [619181,31305] 0 2024-09-21T12:47:03.992 INFO:tasks.workunit.client.1.smithi176.stdout:5/618: read d0/d13/d63/d2e/d39/d41/f49 [691081,118527] 0 2024-09-21T12:47:03.993 INFO:tasks.workunit.client.1.smithi176.stdout:3/811: rename d1/d34/d42/d5b/fec to d1/d34/d48/deb/db3/f12b 0 2024-09-21T12:47:03.994 INFO:tasks.workunit.client.1.smithi176.stdout:5/619: truncate d0/d13/d63/d2e/d71/f95 4571678 0 2024-09-21T12:47:03.996 INFO:tasks.workunit.client.0.smithi046.stdout:8/222: creat d1/d12/f52 x:0 0 0 2024-09-21T12:47:03.997 INFO:tasks.workunit.client.0.smithi046.stdout:8/223: readlink d1/d12/d1a/d33/l4d 0 2024-09-21T12:47:03.997 INFO:tasks.workunit.client.1.smithi176.stdout:6/659: mknod d2/dd/d26/d2b/d10/d87/ccf 0 2024-09-21T12:47:04.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/202: truncate d5/f8 8980714 0 2024-09-21T12:47:04.002 INFO:tasks.workunit.client.1.smithi176.stdout:8/679: getdents d6/d16/d36/d67 0 2024-09-21T12:47:04.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/223: dread d4/d22/f32 [0,4194304] 0 2024-09-21T12:47:04.004 INFO:tasks.workunit.client.0.smithi046.stdout:8/224: dwrite d1/d12/d46/d35/d36/f4e [0,4194304] 0 2024-09-21T12:47:04.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/271: link d6/d7/d13/d2a/l2e d6/d7/d13/d43/d52/d63/l6a 0 2024-09-21T12:47:04.007 INFO:tasks.workunit.client.1.smithi176.stdout:9/693: unlink d1/df/d48/d69/d38/c5f 0 2024-09-21T12:47:04.009 INFO:tasks.workunit.client.0.smithi046.stdout:0/272: dread d6/d7/d9/f50 [0,4194304] 0 2024-09-21T12:47:04.011 INFO:tasks.workunit.client.1.smithi176.stdout:7/833: write d0/d2/db/d10/d72/d7e/fe0 [713225,16833] 0 2024-09-21T12:47:04.015 INFO:tasks.workunit.client.0.smithi046.stdout:8/225: mkdir d1/d12/d53 0 2024-09-21T12:47:04.015 INFO:tasks.workunit.client.1.smithi176.stdout:3/812: truncate d1/d5/d25/d84/fdf 56942 0 2024-09-21T12:47:04.016 INFO:tasks.workunit.client.0.smithi046.stdout:8/226: chown d1/d12/d1a/f2c 14 1 2024-09-21T12:47:04.016 INFO:tasks.workunit.client.1.smithi176.stdout:3/813: chown d1/d34/d48/deb/dc6/f105 27573 1 2024-09-21T12:47:04.017 INFO:tasks.workunit.client.1.smithi176.stdout:3/814: write d1/d34/d71/f11c [56475,26795] 0 2024-09-21T12:47:04.018 INFO:tasks.workunit.client.0.smithi046.stdout:0/273: unlink d6/f42 0 2024-09-21T12:47:04.019 INFO:tasks.workunit.client.0.smithi046.stdout:3/203: mkdir d5/dc/d26/d3c/d44 0 2024-09-21T12:47:04.019 INFO:tasks.workunit.client.1.smithi176.stdout:6/660: truncate d2/dd/d26/d2b/d10/f2f 4447761 0 2024-09-21T12:47:04.021 INFO:tasks.workunit.client.1.smithi176.stdout:8/680: symlink d6/d16/d36/d67/ld2 0 2024-09-21T12:47:04.022 INFO:tasks.workunit.client.1.smithi176.stdout:8/681: stat d6/d8/d54/dca/fa7 0 2024-09-21T12:47:04.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/227: rmdir d1/d12/d46/d35/d36 39 2024-09-21T12:47:04.027 INFO:tasks.workunit.client.1.smithi176.stdout:0/840: mknod d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2/d10e/dfa/c12b 0 2024-09-21T12:47:04.028 INFO:tasks.workunit.client.0.smithi046.stdout:0/274: write d6/d7/d13/d49/f5c [887927,106395] 0 2024-09-21T12:47:04.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/204: truncate d5/dc/f15 578508 0 2024-09-21T12:47:04.032 INFO:tasks.workunit.client.0.smithi046.stdout:2/164: sync 2024-09-21T12:47:04.033 INFO:tasks.workunit.client.0.smithi046.stdout:5/224: write d4/dc/d28/f3f [379755,77045] 0 2024-09-21T12:47:04.033 INFO:tasks.workunit.client.1.smithi176.stdout:3/815: dread d1/d34/d5d/d78/d10b/dd2/fee [0,4194304] 0 2024-09-21T12:47:04.034 INFO:tasks.workunit.client.1.smithi176.stdout:4/710: rename d3/d42/d56/lbc to d3/d21/d5e/l104 0 2024-09-21T12:47:04.036 INFO:tasks.workunit.client.0.smithi046.stdout:0/275: rmdir d6 39 2024-09-21T12:47:04.037 INFO:tasks.workunit.client.1.smithi176.stdout:9/694: write d1/df/d48/d69/d4d/faa [322249,33047] 0 2024-09-21T12:47:04.037 INFO:tasks.workunit.client.0.smithi046.stdout:5/225: creat d4/dc/d13/f41 x:0 0 0 2024-09-21T12:47:04.039 INFO:tasks.workunit.client.1.smithi176.stdout:6/661: creat d2/d6f/fd0 x:0 0 0 2024-09-21T12:47:04.040 INFO:tasks.workunit.client.0.smithi046.stdout:2/165: rename c9 to d16/d22/d2b/d30/c3a 0 2024-09-21T12:47:04.040 INFO:tasks.workunit.client.1.smithi176.stdout:9/695: dread d1/df/d48/d69/f3d [0,4194304] 0 2024-09-21T12:47:04.041 INFO:tasks.workunit.client.1.smithi176.stdout:1/731: creat d0/db/d1a/f10e x:0 0 0 2024-09-21T12:47:04.042 INFO:tasks.workunit.client.1.smithi176.stdout:8/682: creat d6/d8/d24/d35/d51/fd3 x:0 0 0 2024-09-21T12:47:04.043 INFO:tasks.workunit.client.1.smithi176.stdout:8/683: chown d6/d8/fb5 516043309 1 2024-09-21T12:47:04.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/205: rename d5/dc/d30/c3f to d5/dc/d30/d34/c45 0 2024-09-21T12:47:04.045 INFO:tasks.workunit.client.1.smithi176.stdout:0/841: mknod d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd/c12c 0 2024-09-21T12:47:04.046 INFO:tasks.workunit.client.0.smithi046.stdout:0/276: mkdir d6/d7/d9/d6b 0 2024-09-21T12:47:04.047 INFO:tasks.workunit.client.1.smithi176.stdout:7/834: creat d0/d5d/d7a/f12a x:0 0 0 2024-09-21T12:47:04.048 INFO:tasks.workunit.client.1.smithi176.stdout:1/732: dwrite d0/db/d1a/d2c/d48/d50/f90 [0,4194304] 0 2024-09-21T12:47:04.048 INFO:tasks.workunit.client.1.smithi176.stdout:4/711: dread d3/d21/d27/f7d [0,4194304] 0 2024-09-21T12:47:04.050 INFO:tasks.workunit.client.0.smithi046.stdout:3/206: dwrite d5/dc/d28/f2c [0,4194304] 0 2024-09-21T12:47:04.050 INFO:tasks.workunit.client.0.smithi046.stdout:2/166: mknod d16/c3b 0 2024-09-21T12:47:04.050 INFO:tasks.workunit.client.1.smithi176.stdout:4/712: write d3/d5/db/d96/da3/fd8 [4790438,64597] 0 2024-09-21T12:47:04.052 INFO:tasks.workunit.client.1.smithi176.stdout:2/714: link d4/d3a/f5c d4/df/d2e/fdc 0 2024-09-21T12:47:04.055 INFO:tasks.workunit.client.0.smithi046.stdout:2/167: chown d16/d22/d38 125306300 1 2024-09-21T12:47:04.058 INFO:tasks.workunit.client.1.smithi176.stdout:6/662: fdatasync d2/dd/d26/d2b/f92 0 2024-09-21T12:47:04.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/168: symlink d16/d22/d2b/l3c 0 2024-09-21T12:47:04.060 INFO:tasks.workunit.client.1.smithi176.stdout:2/715: dwrite d4/df/d2e/d4d/d70/fb3 [0,4194304] 0 2024-09-21T12:47:04.061 INFO:tasks.workunit.client.1.smithi176.stdout:2/716: readlink d4/df/d2e/d6f/l4c 0 2024-09-21T12:47:04.063 INFO:tasks.workunit.client.1.smithi176.stdout:8/684: mkdir d6/db/d37/d89/d8a/dd4 0 2024-09-21T12:47:04.065 INFO:tasks.workunit.client.0.smithi046.stdout:5/226: getdents d4/dc/d28/d2d/d3b 0 2024-09-21T12:47:04.071 INFO:tasks.workunit.client.1.smithi176.stdout:1/733: unlink d0/db/f15 0 2024-09-21T12:47:04.071 INFO:tasks.workunit.client.0.smithi046.stdout:3/207: link d5/dc/l3b d5/dc/d26/d3c/d44/l46 0 2024-09-21T12:47:04.074 INFO:tasks.workunit.client.1.smithi176.stdout:7/835: rename d0/d2/da8/dca to d0/d2/db/d10/d23/da6/d12b 0 2024-09-21T12:47:04.078 INFO:tasks.workunit.client.0.smithi046.stdout:5/227: symlink d4/dc/d13/d15/l42 0 2024-09-21T12:47:04.078 INFO:tasks.workunit.client.0.smithi046.stdout:5/228: stat d4/c25 0 2024-09-21T12:47:04.079 INFO:tasks.workunit.client.1.smithi176.stdout:4/713: mknod d3/d21/d88/da7/c105 0 2024-09-21T12:47:04.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/229: read d4/f2e [1118950,82203] 0 2024-09-21T12:47:04.080 INFO:tasks.workunit.client.0.smithi046.stdout:5/230: chown d4/dc/d28/f3f 99072548 1 2024-09-21T12:47:04.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/208: unlink d5/f2f 0 2024-09-21T12:47:04.081 INFO:tasks.workunit.client.1.smithi176.stdout:5/620: getdents d0/d13/d63/d8d 0 2024-09-21T12:47:04.081 INFO:tasks.workunit.client.0.smithi046.stdout:0/277: write d6/d7/d9/f50 [702064,75234] 0 2024-09-21T12:47:04.082 INFO:tasks.workunit.client.1.smithi176.stdout:3/816: dwrite d1/d5/f9b [0,4194304] 0 2024-09-21T12:47:04.083 INFO:tasks.workunit.client.1.smithi176.stdout:5/621: fdatasync d0/d13/d63/d2e/d39/d41/f60 0 2024-09-21T12:47:04.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/231: rmdir d4/dc/d13/d15 39 2024-09-21T12:47:04.088 INFO:tasks.workunit.client.1.smithi176.stdout:9/696: mkdir d1/df/dea 0 2024-09-21T12:47:04.089 INFO:tasks.workunit.client.1.smithi176.stdout:9/697: dread - d1/df/d48/d69/d76/d7c/fd3 zero size 2024-09-21T12:47:04.090 INFO:tasks.workunit.client.1.smithi176.stdout:6/663: mknod d2/dd/dc7/cd1 0 2024-09-21T12:47:04.090 INFO:tasks.workunit.client.0.smithi046.stdout:0/278: dwrite d6/d7/d13/d2a/d31/f26 [0,4194304] 0 2024-09-21T12:47:04.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/169: write d16/d22/d2b/d30/f32 [319703,85867] 0 2024-09-21T12:47:04.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/170: write d16/f1d [1848504,124230] 0 2024-09-21T12:47:04.096 INFO:tasks.workunit.client.1.smithi176.stdout:8/685: readlink d6/db/l3b 0 2024-09-21T12:47:04.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/171: dwrite d16/d22/f31 [0,4194304] 0 2024-09-21T12:47:04.102 INFO:tasks.workunit.client.0.smithi046.stdout:5/232: mkdir d4/dc/d28/d2d/d43 0 2024-09-21T12:47:04.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/233: stat d4/d22/c21 0 2024-09-21T12:47:04.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/172: symlink d16/d22/d2b/l3d 0 2024-09-21T12:47:04.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/234: rename d4/l18 to d4/d22/d10/d1a/l44 0 2024-09-21T12:47:04.111 INFO:tasks.workunit.client.1.smithi176.stdout:5/622: truncate d0/d10/f2b 1178041 0 2024-09-21T12:47:04.112 INFO:tasks.workunit.client.0.smithi046.stdout:2/173: chown d16/f21 11554 1 2024-09-21T12:47:04.115 INFO:tasks.workunit.client.1.smithi176.stdout:9/698: mknod d1/df/d9a/dbc/ceb 0 2024-09-21T12:47:04.116 INFO:tasks.workunit.client.1.smithi176.stdout:2/717: mkdir d4/df/d2e/ddd 0 2024-09-21T12:47:04.118 INFO:tasks.workunit.client.1.smithi176.stdout:8/686: creat d6/db/d37/d89/fd5 x:0 0 0 2024-09-21T12:47:04.118 INFO:tasks.workunit.client.1.smithi176.stdout:0/842: creat d9/d1a/d1d/d23/da1/da3/d93/df9/d77/f12d x:0 0 0 2024-09-21T12:47:04.119 INFO:tasks.workunit.client.1.smithi176.stdout:1/734: creat d0/db/d1a/d2c/dc5/d41/d59/d99/de8/f10f x:0 0 0 2024-09-21T12:47:04.122 INFO:tasks.workunit.client.0.smithi046.stdout:5/235: getdents d4/d16 0 2024-09-21T12:47:04.123 INFO:tasks.workunit.client.0.smithi046.stdout:5/236: chown d4/dc/d13/l3e 79 1 2024-09-21T12:47:04.124 INFO:tasks.workunit.client.1.smithi176.stdout:3/817: rename d1/d34/d42/f67 to d1/d34/d71/d91/df6/d11f/f12c 0 2024-09-21T12:47:04.125 INFO:tasks.workunit.client.0.smithi046.stdout:2/174: truncate fa 3756617 0 2024-09-21T12:47:04.128 INFO:tasks.workunit.client.1.smithi176.stdout:2/718: dread d4/df/d4b/fc7 [0,4194304] 0 2024-09-21T12:47:04.132 INFO:tasks.workunit.client.0.smithi046.stdout:5/237: mkdir d4/dc/d45 0 2024-09-21T12:47:04.132 INFO:tasks.workunit.client.0.smithi046.stdout:5/238: readlink d4/d22/l1f 0 2024-09-21T12:47:04.136 INFO:tasks.workunit.client.0.smithi046.stdout:2/175: dread fc [0,4194304] 0 2024-09-21T12:47:04.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/176: chown c3 60585544 1 2024-09-21T12:47:04.138 INFO:tasks.workunit.client.0.smithi046.stdout:2/177: chown d16/f21 0 1 2024-09-21T12:47:04.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/239: link d4/dc/d28/f3f d4/d16/f46 0 2024-09-21T12:47:04.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/240: symlink d4/dc/d28/l47 0 2024-09-21T12:47:04.146 INFO:tasks.workunit.client.0.smithi046.stdout:2/178: truncate d16/f25 160680 0 2024-09-21T12:47:04.148 INFO:tasks.workunit.client.0.smithi046.stdout:2/179: dread d16/d22/f2a [0,4194304] 0 2024-09-21T12:47:04.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/241: creat d4/dc/d28/d2d/d43/f48 x:0 0 0 2024-09-21T12:47:04.150 INFO:tasks.workunit.client.0.smithi046.stdout:5/242: write d4/dc/d13/f41 [454580,918] 0 2024-09-21T12:47:04.151 INFO:tasks.workunit.client.0.smithi046.stdout:2/180: link d16/d22/f2d d16/d22/d38/f3e 0 2024-09-21T12:47:04.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/181: write d16/d22/f29 [1313479,45571] 0 2024-09-21T12:47:04.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/182: stat d16/f21 0 2024-09-21T12:47:04.156 INFO:tasks.workunit.client.1.smithi176.stdout:0/843: rmdir d9/d1a/d20 39 2024-09-21T12:47:04.157 INFO:tasks.workunit.client.0.smithi046.stdout:5/243: dwrite d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:04.157 INFO:tasks.workunit.client.1.smithi176.stdout:1/735: creat d0/d91/f110 x:0 0 0 2024-09-21T12:47:04.157 INFO:tasks.workunit.client.1.smithi176.stdout:7/836: creat d0/d2f/f12c x:0 0 0 2024-09-21T12:47:04.158 INFO:tasks.workunit.client.1.smithi176.stdout:9/699: write d1/df/d48/d69/fc7 [1074217,74350] 0 2024-09-21T12:47:04.158 INFO:tasks.workunit.client.1.smithi176.stdout:0/844: fsync d9/f14 0 2024-09-21T12:47:04.158 INFO:tasks.workunit.client.1.smithi176.stdout:3/818: mknod d1/d34/d71/d91/c12d 0 2024-09-21T12:47:04.159 INFO:tasks.workunit.client.1.smithi176.stdout:2/719: creat d4/df/d2e/d39/db7/fde x:0 0 0 2024-09-21T12:47:04.161 INFO:tasks.workunit.client.1.smithi176.stdout:7/837: chown d0/d2/d30/d93/d96/c110 14 1 2024-09-21T12:47:04.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/244: rmdir d4/dc/d28/d2d/d43 39 2024-09-21T12:47:04.161 INFO:tasks.workunit.client.0.smithi046.stdout:5/245: chown d4/d22/d10/d1a 26985 1 2024-09-21T12:47:04.162 INFO:tasks.workunit.client.1.smithi176.stdout:4/714: getdents d3/d42/d47/d5c 0 2024-09-21T12:47:04.163 INFO:tasks.workunit.client.0.smithi046.stdout:5/246: write d4/d22/d10/d1a/f27 [1334492,40893] 0 2024-09-21T12:47:04.164 INFO:tasks.workunit.client.1.smithi176.stdout:6/664: creat d2/d63/fd2 x:0 0 0 2024-09-21T12:47:04.165 INFO:tasks.workunit.client.1.smithi176.stdout:5/623: dread d0/d13/f26 [0,4194304] 0 2024-09-21T12:47:04.165 INFO:tasks.workunit.client.1.smithi176.stdout:9/700: fdatasync d1/df/d23/fa3 0 2024-09-21T12:47:04.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/247: dread d4/f8 [0,4194304] 0 2024-09-21T12:47:04.169 INFO:tasks.workunit.client.1.smithi176.stdout:7/838: dwrite d0/d2/db/d10/d72/fab [0,4194304] 0 2024-09-21T12:47:04.174 INFO:tasks.workunit.client.0.smithi046.stdout:5/248: dread d4/f2e [0,4194304] 0 2024-09-21T12:47:04.174 INFO:tasks.workunit.client.1.smithi176.stdout:0/845: rename d9/d1a/d1d/d23/d5f/fcb to d9/d1a/d1d/d23/da1/da3/d93/d9f/f12e 0 2024-09-21T12:47:04.176 INFO:tasks.workunit.client.0.smithi046.stdout:5/249: dread d4/dc/d13/f23 [4194304,4194304] 0 2024-09-21T12:47:04.176 INFO:tasks.workunit.client.1.smithi176.stdout:0/846: chown d9/d1a/d3f/d40/f4c 17008177 1 2024-09-21T12:47:04.177 INFO:tasks.workunit.client.1.smithi176.stdout:7/839: dwrite d0/d2/db/d10/d23/d85/fad [0,4194304] 0 2024-09-21T12:47:04.178 INFO:tasks.workunit.client.1.smithi176.stdout:0/847: fsync d9/d1a/d3f/d128/f11b 0 2024-09-21T12:47:04.178 INFO:tasks.workunit.client.1.smithi176.stdout:7/840: chown d0/d5d/lda 18 1 2024-09-21T12:47:04.179 INFO:tasks.workunit.client.1.smithi176.stdout:4/715: dread d3/d42/d47/d5c/f94 [0,4194304] 0 2024-09-21T12:47:04.181 INFO:tasks.workunit.client.1.smithi176.stdout:4/716: write d3/d21/d97/f9a [184638,89777] 0 2024-09-21T12:47:04.184 INFO:tasks.workunit.client.1.smithi176.stdout:1/736: creat d0/db/d1a/d2c/d48/d50/da6/f111 x:0 0 0 2024-09-21T12:47:04.185 INFO:tasks.workunit.client.1.smithi176.stdout:1/737: read - d0/db/d2a/def/ff0 zero size 2024-09-21T12:47:04.185 INFO:tasks.workunit.client.1.smithi176.stdout:2/720: mkdir d4/df/ddf 0 2024-09-21T12:47:04.186 INFO:tasks.workunit.client.1.smithi176.stdout:2/721: dread - d4/df/d4b/fae zero size 2024-09-21T12:47:04.186 INFO:tasks.workunit.client.1.smithi176.stdout:1/738: chown d0/db/d1a/d2c/dc5/d2b/d43/f69 18421146 1 2024-09-21T12:47:04.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/250: dwrite d4/dc/d13/f38 [4194304,4194304] 0 2024-09-21T12:47:04.190 INFO:tasks.workunit.client.0.smithi046.stdout:2/183: write f13 [965183,122468] 0 2024-09-21T12:47:04.196 INFO:tasks.workunit.client.1.smithi176.stdout:5/624: rename d0/d13/d63/d2e/l42 to d0/d13/d63/d2e/d37/db5/lbf 0 2024-09-21T12:47:04.201 INFO:tasks.workunit.client.1.smithi176.stdout:4/717: mkdir d3/d5/db/d36/d106 0 2024-09-21T12:47:04.201 INFO:tasks.workunit.client.1.smithi176.stdout:6/665: dread d2/fbe [0,4194304] 0 2024-09-21T12:47:04.201 INFO:tasks.workunit.client.1.smithi176.stdout:1/739: creat d0/db/d1a/d2c/d84/f112 x:0 0 0 2024-09-21T12:47:04.203 INFO:tasks.workunit.client.1.smithi176.stdout:3/819: link d1/d8d/ce5 d1/d9e/db4/c12e 0 2024-09-21T12:47:04.203 INFO:tasks.workunit.client.1.smithi176.stdout:2/722: creat d4/df/d2e/d6f/d5d/d67/d9f/fe0 x:0 0 0 2024-09-21T12:47:04.204 INFO:tasks.workunit.client.1.smithi176.stdout:5/625: mkdir d0/d13/d63/d8d/daf/dc0 0 2024-09-21T12:47:04.205 INFO:tasks.workunit.client.1.smithi176.stdout:9/701: dwrite d1/d63/f6e [4194304,4194304] 0 2024-09-21T12:47:04.207 INFO:tasks.workunit.client.1.smithi176.stdout:7/841: creat d0/d2/db/d10/d3b/f12d x:0 0 0 2024-09-21T12:47:04.207 INFO:tasks.workunit.client.1.smithi176.stdout:2/723: read d4/df/f22 [309429,13061] 0 2024-09-21T12:47:04.207 INFO:tasks.workunit.client.1.smithi176.stdout:3/820: chown d1/d34/d48/deb/c94 18178 1 2024-09-21T12:47:04.209 INFO:tasks.workunit.client.1.smithi176.stdout:1/740: mknod d0/db/d1a/d2c/dc5/d41/d59/d99/de8/c113 0 2024-09-21T12:47:04.213 INFO:tasks.workunit.client.1.smithi176.stdout:5/626: creat d0/d13/d63/d2e/fc1 x:0 0 0 2024-09-21T12:47:04.216 INFO:tasks.workunit.client.1.smithi176.stdout:7/842: write d0/d2/d30/d93/d96/d89/f97 [1278450,110836] 0 2024-09-21T12:47:04.216 INFO:tasks.workunit.client.0.smithi046.stdout:5/251: truncate d4/d22/d10/d1a/f1c 1241965 0 2024-09-21T12:47:04.217 INFO:tasks.workunit.client.1.smithi176.stdout:1/741: write d0/db/d1a/d73/f95 [2447331,31583] 0 2024-09-21T12:47:04.219 INFO:tasks.workunit.client.1.smithi176.stdout:4/718: dwrite d3/d21/d88/f91 [0,4194304] 0 2024-09-21T12:47:04.219 INFO:tasks.workunit.client.1.smithi176.stdout:6/666: dwrite d2/dd/d26/d2b/d10/d1b/f9b [0,4194304] 0 2024-09-21T12:47:04.221 INFO:tasks.workunit.client.1.smithi176.stdout:1/742: dread - d0/db/d1a/d2c/dc5/d41/f9a zero size 2024-09-21T12:47:04.227 INFO:tasks.workunit.client.1.smithi176.stdout:9/702: creat d1/df/d48/d69/d40/fec x:0 0 0 2024-09-21T12:47:04.229 INFO:tasks.workunit.client.1.smithi176.stdout:5/627: creat d0/d13/d63/d72/fc2 x:0 0 0 2024-09-21T12:47:04.231 INFO:tasks.workunit.client.1.smithi176.stdout:6/667: dread - d2/d5d/fca zero size 2024-09-21T12:47:04.231 INFO:tasks.workunit.client.1.smithi176.stdout:7/843: dwrite d0/d5d/d5e/f128 [0,4194304] 0 2024-09-21T12:47:04.232 INFO:tasks.workunit.client.1.smithi176.stdout:3/821: write d1/f51 [1106384,112108] 0 2024-09-21T12:47:04.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/184: dread fa [0,4194304] 0 2024-09-21T12:47:04.233 INFO:tasks.workunit.client.1.smithi176.stdout:4/719: rename d3/d5/db to d3/d42/d56/d101/d107 0 2024-09-21T12:47:04.233 INFO:tasks.workunit.client.1.smithi176.stdout:5/628: stat d0/d13/d63/d66/fbe 0 2024-09-21T12:47:04.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/185: read d16/d22/f2a [69359,21282] 0 2024-09-21T12:47:04.234 INFO:tasks.workunit.client.0.smithi046.stdout:2/186: chown c14 679464166 1 2024-09-21T12:47:04.235 INFO:tasks.workunit.client.1.smithi176.stdout:1/743: creat d0/db/d6f/f114 x:0 0 0 2024-09-21T12:47:04.236 INFO:tasks.workunit.client.1.smithi176.stdout:6/668: chown d2/dd/d26/d2b/d68/l86 30161 1 2024-09-21T12:47:04.236 INFO:tasks.workunit.client.1.smithi176.stdout:7/844: rmdir d0/d98 39 2024-09-21T12:47:04.237 INFO:tasks.workunit.client.1.smithi176.stdout:4/720: write d3/d21/d27/fee [673137,53953] 0 2024-09-21T12:47:04.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/187: mknod d16/d22/d2b/d30/c3f 0 2024-09-21T12:47:04.238 INFO:tasks.workunit.client.1.smithi176.stdout:9/703: symlink d1/df/led 0 2024-09-21T12:47:04.239 INFO:tasks.workunit.client.0.smithi046.stdout:2/188: write d16/f1d [2107871,32635] 0 2024-09-21T12:47:04.241 INFO:tasks.workunit.client.1.smithi176.stdout:7/845: creat d0/d5d/d8a/f12e x:0 0 0 2024-09-21T12:47:04.242 INFO:tasks.workunit.client.0.smithi046.stdout:5/252: dwrite d4/dc/d13/f23 [0,4194304] 0 2024-09-21T12:47:04.242 INFO:tasks.workunit.client.1.smithi176.stdout:6/669: read d2/dd/d26/d2b/d10/f1f [1178205,42246] 0 2024-09-21T12:47:04.245 INFO:tasks.workunit.client.1.smithi176.stdout:1/744: truncate d0/db/d1a/d2c/dc5/d41/d59/d99/db3/fe6 111579 0 2024-09-21T12:47:04.245 INFO:tasks.workunit.client.1.smithi176.stdout:3/822: creat d1/d34/d57/f12f x:0 0 0 2024-09-21T12:47:04.245 INFO:tasks.workunit.client.1.smithi176.stdout:2/724: dwrite d4/df/d2e/fdc [0,4194304] 0 2024-09-21T12:47:04.246 INFO:tasks.workunit.client.1.smithi176.stdout:6/670: stat d2/dd/d26/d2b/d10/d1b/d7b 0 2024-09-21T12:47:04.248 INFO:tasks.workunit.client.0.smithi046.stdout:5/253: creat d4/dc/d45/f49 x:0 0 0 2024-09-21T12:47:04.251 INFO:tasks.workunit.client.1.smithi176.stdout:4/721: getdents d3/d21/da6 0 2024-09-21T12:47:04.255 INFO:tasks.workunit.client.1.smithi176.stdout:9/704: dwrite d1/df/d48/d69/fbb [0,4194304] 0 2024-09-21T12:47:04.259 INFO:tasks.workunit.client.1.smithi176.stdout:9/705: dread d1/df/d48/d69/fbb [0,4194304] 0 2024-09-21T12:47:04.260 INFO:tasks.workunit.client.1.smithi176.stdout:3/823: symlink d1/d5/d25/d38/l130 0 2024-09-21T12:47:04.263 INFO:tasks.workunit.client.1.smithi176.stdout:1/745: mknod d0/db/d1a/d2c/d48/d108/c115 0 2024-09-21T12:47:04.266 INFO:tasks.workunit.client.0.smithi046.stdout:2/189: write fa [3636572,49096] 0 2024-09-21T12:47:04.267 INFO:tasks.workunit.client.1.smithi176.stdout:2/725: mknod d4/df/d2e/ddd/ce1 0 2024-09-21T12:47:04.268 INFO:tasks.workunit.client.1.smithi176.stdout:8/687: sync 2024-09-21T12:47:04.269 INFO:tasks.workunit.client.1.smithi176.stdout:7/846: write d0/f6f [965224,101658] 0 2024-09-21T12:47:04.270 INFO:tasks.workunit.client.1.smithi176.stdout:9/706: mkdir d1/df/d48/d69/d76/d7c/dee 0 2024-09-21T12:47:04.270 INFO:tasks.workunit.client.1.smithi176.stdout:5/629: dwrite d0/d13/d63/d66/f69 [0,4194304] 0 2024-09-21T12:47:04.271 INFO:tasks.workunit.client.1.smithi176.stdout:2/726: truncate d4/df/d2e/d4d/fba 417934 0 2024-09-21T12:47:04.272 INFO:tasks.workunit.client.1.smithi176.stdout:7/847: dread - d0/d2/da8/f10b zero size 2024-09-21T12:47:04.275 INFO:tasks.workunit.client.0.smithi046.stdout:2/190: dwrite d16/f1a [4194304,4194304] 0 2024-09-21T12:47:04.276 INFO:tasks.workunit.client.1.smithi176.stdout:7/848: chown d0/d2/db/d10 15421248 1 2024-09-21T12:47:04.277 INFO:tasks.workunit.client.1.smithi176.stdout:2/727: readlink d4/df/d2e/d6f/d5d/d81/db2/lbd 0 2024-09-21T12:47:04.277 INFO:tasks.workunit.client.1.smithi176.stdout:6/671: write d2/d63/f49 [258571,98811] 0 2024-09-21T12:47:04.280 INFO:tasks.workunit.client.1.smithi176.stdout:4/722: getdents d3/d42/d56/d101/d107 0 2024-09-21T12:47:04.281 INFO:tasks.workunit.client.0.smithi046.stdout:5/254: chown d4/d22/d10/d1a/f1c 1870500 1 2024-09-21T12:47:04.281 INFO:tasks.workunit.client.1.smithi176.stdout:9/707: creat d1/df/fef x:0 0 0 2024-09-21T12:47:04.283 INFO:tasks.workunit.client.0.smithi046.stdout:5/255: truncate d4/dc/d13/f41 1332716 0 2024-09-21T12:47:04.283 INFO:tasks.workunit.client.1.smithi176.stdout:6/672: chown d2/dd/c62 474135 1 2024-09-21T12:47:04.286 INFO:tasks.workunit.client.0.smithi046.stdout:2/191: dread d16/f1d [0,4194304] 0 2024-09-21T12:47:04.286 INFO:tasks.workunit.client.1.smithi176.stdout:8/688: dwrite d6/d8/fb7 [0,4194304] 0 2024-09-21T12:47:04.286 INFO:tasks.workunit.client.1.smithi176.stdout:3/824: dwrite d1/d34/d57/dd0/d7d/f80 [0,4194304] 0 2024-09-21T12:47:04.291 INFO:tasks.workunit.client.1.smithi176.stdout:8/689: truncate d6/d16/d9c/fb3 210005 0 2024-09-21T12:47:04.293 INFO:tasks.workunit.client.1.smithi176.stdout:9/708: mkdir d1/df/d23/d67/df0 0 2024-09-21T12:47:04.297 INFO:tasks.workunit.client.0.smithi046.stdout:5/256: creat d4/f4a x:0 0 0 2024-09-21T12:47:04.298 INFO:tasks.workunit.client.1.smithi176.stdout:6/673: dwrite d2/f31 [0,4194304] 0 2024-09-21T12:47:04.299 INFO:tasks.workunit.client.1.smithi176.stdout:3/825: creat d1/d5/d25/d84/f131 x:0 0 0 2024-09-21T12:47:04.301 INFO:tasks.workunit.client.0.smithi046.stdout:2/192: getdents d16/d22/d2b/d30 0 2024-09-21T12:47:04.303 INFO:tasks.workunit.client.1.smithi176.stdout:9/709: unlink d1/df/d48/f6c 0 2024-09-21T12:47:04.304 INFO:tasks.workunit.client.1.smithi176.stdout:9/710: fdatasync d1/df/d23/dcf/fd6 0 2024-09-21T12:47:04.305 INFO:tasks.workunit.client.1.smithi176.stdout:7/849: creat d0/d5d/f12f x:0 0 0 2024-09-21T12:47:04.308 INFO:tasks.workunit.client.1.smithi176.stdout:5/630: getdents d0/d13/d5d/d98/d9b/dad 0 2024-09-21T12:47:04.312 INFO:tasks.workunit.client.0.smithi046.stdout:2/193: link lb d16/d22/l40 0 2024-09-21T12:47:04.313 INFO:tasks.workunit.client.1.smithi176.stdout:4/723: rmdir d3/d42/d56/d101/d107/d36/d106 0 2024-09-21T12:47:04.314 INFO:tasks.workunit.client.0.smithi046.stdout:2/194: dread d16/d22/f2a [0,4194304] 0 2024-09-21T12:47:04.315 INFO:tasks.workunit.client.1.smithi176.stdout:6/674: dread d2/f96 [0,4194304] 0 2024-09-21T12:47:04.315 INFO:tasks.workunit.client.1.smithi176.stdout:3/826: symlink d1/d34/l132 0 2024-09-21T12:47:04.316 INFO:tasks.workunit.client.1.smithi176.stdout:4/724: write d3/d5/dc5/fc8 [330178,48990] 0 2024-09-21T12:47:04.318 INFO:tasks.workunit.client.1.smithi176.stdout:2/728: dread d4/df/f21 [0,4194304] 0 2024-09-21T12:47:04.318 INFO:tasks.workunit.client.1.smithi176.stdout:9/711: link d1/df/d48/d69/d76/fae d1/df/d48/d69/d38/ff1 0 2024-09-21T12:47:04.319 INFO:tasks.workunit.client.1.smithi176.stdout:3/827: chown d1/d9e/l11e 43538431 1 2024-09-21T12:47:04.321 INFO:tasks.workunit.client.1.smithi176.stdout:6/675: symlink d2/dd/d26/d2b/ld3 0 2024-09-21T12:47:04.321 INFO:tasks.workunit.client.1.smithi176.stdout:4/725: rmdir d3/d21/d88 39 2024-09-21T12:47:04.322 INFO:tasks.workunit.client.1.smithi176.stdout:9/712: creat d1/df/dc3/ff2 x:0 0 0 2024-09-21T12:47:04.323 INFO:tasks.workunit.client.1.smithi176.stdout:2/729: creat d4/df/d2e/d6f/d6d/fe2 x:0 0 0 2024-09-21T12:47:04.323 INFO:tasks.workunit.client.1.smithi176.stdout:8/690: dread d6/d8/d24/d35/f42 [0,4194304] 0 2024-09-21T12:47:04.326 INFO:tasks.workunit.client.1.smithi176.stdout:7/850: dread d0/d2/db/d10/f12 [0,4194304] 0 2024-09-21T12:47:04.328 INFO:tasks.workunit.client.0.smithi046.stdout:6/169: sync 2024-09-21T12:47:04.328 INFO:tasks.workunit.client.1.smithi176.stdout:7/851: write d0/d2/db/f129 [1010880,57056] 0 2024-09-21T12:47:04.330 INFO:tasks.workunit.client.1.smithi176.stdout:3/828: dread d1/d3e/fbe [0,4194304] 0 2024-09-21T12:47:04.330 INFO:tasks.workunit.client.1.smithi176.stdout:9/713: creat d1/df/d48/d69/d4d/ff3 x:0 0 0 2024-09-21T12:47:04.332 INFO:tasks.workunit.client.1.smithi176.stdout:3/829: chown d1/d34/d57/dd0/l114 104 1 2024-09-21T12:47:04.332 INFO:tasks.workunit.client.1.smithi176.stdout:2/730: creat d4/df/d2e/d4d/fe3 x:0 0 0 2024-09-21T12:47:04.333 INFO:tasks.workunit.client.1.smithi176.stdout:2/731: chown d4/df/d2e/d6f/d5d/d81/dd9 35 1 2024-09-21T12:47:04.334 INFO:tasks.workunit.client.1.smithi176.stdout:8/691: creat d6/d16/d79/fd6 x:0 0 0 2024-09-21T12:47:04.334 INFO:tasks.workunit.client.1.smithi176.stdout:2/732: dread - d4/df/d2e/d39/db7/d80/fb5 zero size 2024-09-21T12:47:04.336 INFO:tasks.workunit.client.1.smithi176.stdout:7/852: write d0/d2f/d43/f76 [7410420,130831] 0 2024-09-21T12:47:04.337 INFO:tasks.workunit.client.1.smithi176.stdout:8/692: read - d6/db/d37/d89/fd5 zero size 2024-09-21T12:47:04.337 INFO:tasks.workunit.client.1.smithi176.stdout:9/714: rename d1/df/d9a/dbc/ceb to d1/df/d23/d67/df0/cf4 0 2024-09-21T12:47:04.338 INFO:tasks.workunit.client.0.smithi046.stdout:2/195: truncate d16/f27 600232 0 2024-09-21T12:47:04.338 INFO:tasks.workunit.client.0.smithi046.stdout:2/196: stat d16/d22/d2b/l3d 0 2024-09-21T12:47:04.339 INFO:tasks.workunit.client.1.smithi176.stdout:3/830: symlink d1/d5/d25/d40/l133 0 2024-09-21T12:47:04.341 INFO:tasks.workunit.client.1.smithi176.stdout:9/715: write d1/d61/d73/fb9 [347889,92528] 0 2024-09-21T12:47:04.341 INFO:tasks.workunit.client.1.smithi176.stdout:2/733: creat d4/df/d2e/d39/fe4 x:0 0 0 2024-09-21T12:47:04.341 INFO:tasks.workunit.client.1.smithi176.stdout:6/676: dread d2/d63/f53 [0,4194304] 0 2024-09-21T12:47:04.342 INFO:tasks.workunit.client.1.smithi176.stdout:4/726: write d3/d42/f57 [759238,111725] 0 2024-09-21T12:47:04.343 INFO:tasks.workunit.client.1.smithi176.stdout:5/631: dwrite d0/d13/d63/d2e/f46 [0,4194304] 0 2024-09-21T12:47:04.343 INFO:tasks.workunit.client.1.smithi176.stdout:9/716: dread - d1/df/dc3/fe7 zero size 2024-09-21T12:47:04.345 INFO:tasks.workunit.client.0.smithi046.stdout:2/197: dwrite d16/d22/f2e [0,4194304] 0 2024-09-21T12:47:04.345 INFO:tasks.workunit.client.1.smithi176.stdout:6/677: fsync d2/dd/d26/d2b/fa1 0 2024-09-21T12:47:04.346 INFO:tasks.workunit.client.1.smithi176.stdout:7/853: creat d0/d2/da8/dbe/f130 x:0 0 0 2024-09-21T12:47:04.347 INFO:tasks.workunit.client.0.smithi046.stdout:2/198: write d16/d22/f31 [4470158,2234] 0 2024-09-21T12:47:04.351 INFO:tasks.workunit.client.1.smithi176.stdout:5/632: creat d0/d13/d63/d66/fc3 x:0 0 0 2024-09-21T12:47:04.352 INFO:tasks.workunit.client.1.smithi176.stdout:5/633: write d0/d13/d63/d2e/d37/db5/db7/f47 [915200,11485] 0 2024-09-21T12:47:04.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/170: dwrite de/f16 [0,4194304] 0 2024-09-21T12:47:04.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/171: stat de/f17 0 2024-09-21T12:47:04.357 INFO:tasks.workunit.client.0.smithi046.stdout:2/199: truncate f15 4717002 0 2024-09-21T12:47:04.360 INFO:tasks.workunit.client.1.smithi176.stdout:9/717: stat d1/df/d48/d69/d40/d84 0 2024-09-21T12:47:04.361 INFO:tasks.workunit.client.1.smithi176.stdout:0/848: sync 2024-09-21T12:47:04.361 INFO:tasks.workunit.client.0.smithi046.stdout:6/172: rmdir de/d2a 39 2024-09-21T12:47:04.361 INFO:tasks.workunit.client.0.smithi046.stdout:6/173: readlink l7 0 2024-09-21T12:47:04.362 INFO:tasks.workunit.client.1.smithi176.stdout:9/718: readlink d1/d63/l81 0 2024-09-21T12:47:04.362 INFO:tasks.workunit.client.0.smithi046.stdout:6/174: chown de/f26 380431 1 2024-09-21T12:47:04.362 INFO:tasks.workunit.client.1.smithi176.stdout:3/831: write d1/d3e/fbe [428203,122147] 0 2024-09-21T12:47:04.365 INFO:tasks.workunit.client.1.smithi176.stdout:9/719: chown d1/df/d48/d69/d4d 0 1 2024-09-21T12:47:04.365 INFO:tasks.workunit.client.1.smithi176.stdout:8/693: dwrite d6/d16/f63 [0,4194304] 0 2024-09-21T12:47:04.365 INFO:tasks.workunit.client.1.smithi176.stdout:2/734: truncate d4/df/d2e/d39/f66 5004549 0 2024-09-21T12:47:04.369 INFO:tasks.workunit.client.0.smithi046.stdout:6/175: dwrite de/f13 [0,4194304] 0 2024-09-21T12:47:04.369 INFO:tasks.workunit.client.1.smithi176.stdout:6/678: rename d2/dd/d79/l90 to d2/dd/d26/d2b/d10/d1b/d37/ld4 0 2024-09-21T12:47:04.372 INFO:tasks.workunit.client.0.smithi046.stdout:2/200: rename f11 to d16/d22/f41 0 2024-09-21T12:47:04.373 INFO:tasks.workunit.client.1.smithi176.stdout:3/832: dread d1/d34/d5d/d78/fef [0,4194304] 0 2024-09-21T12:47:04.379 INFO:tasks.workunit.client.1.smithi176.stdout:9/720: rmdir d1/df/d1c 39 2024-09-21T12:47:04.380 INFO:tasks.workunit.client.0.smithi046.stdout:2/201: creat d16/d22/d38/f42 x:0 0 0 2024-09-21T12:47:04.381 INFO:tasks.workunit.client.1.smithi176.stdout:9/721: write d1/df/d23/dcf/fd6 [662004,38959] 0 2024-09-21T12:47:04.381 INFO:tasks.workunit.client.0.smithi046.stdout:2/202: chown c14 5 1 2024-09-21T12:47:04.382 INFO:tasks.workunit.client.1.smithi176.stdout:2/735: creat d4/df/d2e/d6f/fe5 x:0 0 0 2024-09-21T12:47:04.382 INFO:tasks.workunit.client.1.smithi176.stdout:7/854: dread d0/d2/db/d10/d3b/f5b [0,4194304] 0 2024-09-21T12:47:04.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/176: dwrite de/d2a/f2f [0,4194304] 0 2024-09-21T12:47:04.383 INFO:tasks.workunit.client.1.smithi176.stdout:2/736: dread - d4/df/d2e/d4d/fe3 zero size 2024-09-21T12:47:04.385 INFO:tasks.workunit.client.1.smithi176.stdout:8/694: creat d6/db/d13/d98/fd7 x:0 0 0 2024-09-21T12:47:04.387 INFO:tasks.workunit.client.0.smithi046.stdout:6/177: dread de/f13 [0,4194304] 0 2024-09-21T12:47:04.390 INFO:tasks.workunit.client.0.smithi046.stdout:2/203: mkdir d16/d22/d2b/d43 0 2024-09-21T12:47:04.391 INFO:tasks.workunit.client.1.smithi176.stdout:1/746: sync 2024-09-21T12:47:04.393 INFO:tasks.workunit.client.0.smithi046.stdout:6/178: mkdir de/d2a/d34 0 2024-09-21T12:47:04.397 INFO:tasks.workunit.client.1.smithi176.stdout:1/747: dwrite d0/db/d1a/d2c/dc5/d2b/d43/f69 [0,4194304] 0 2024-09-21T12:47:04.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/204: symlink d16/d22/d2b/d43/l44 0 2024-09-21T12:47:04.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/179: mkdir de/d35 0 2024-09-21T12:47:04.405 INFO:tasks.workunit.client.1.smithi176.stdout:5/634: rename d0/d13/d63/d2e/d39/f43 to d0/d13/d63/d72/d87/fc4 0 2024-09-21T12:47:04.407 INFO:tasks.workunit.client.1.smithi176.stdout:6/679: mkdir d2/dd5 0 2024-09-21T12:47:04.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:04 smithi046 ceph-mon[27868]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:04.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:04 smithi046 ceph-mon[27868]: pgmap v28: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 179 MiB/s wr, 306 op/s 2024-09-21T12:47:04.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/205: getdents d16 0 2024-09-21T12:47:04.417 INFO:tasks.workunit.client.1.smithi176.stdout:7/855: mknod d0/d2/db/d10/d31/c131 0 2024-09-21T12:47:04.418 INFO:tasks.workunit.client.1.smithi176.stdout:9/722: dwrite d1/df/d23/fa3 [0,4194304] 0 2024-09-21T12:47:04.420 INFO:tasks.workunit.client.1.smithi176.stdout:9/723: read - d1/d61/d73/d7d/fca zero size 2024-09-21T12:47:04.421 INFO:tasks.workunit.client.1.smithi176.stdout:2/737: mknod d4/df/ce6 0 2024-09-21T12:47:04.421 INFO:tasks.workunit.client.1.smithi176.stdout:2/738: chown d4/d3d/d65/d9b/fa8 0 1 2024-09-21T12:47:04.421 INFO:tasks.workunit.client.1.smithi176.stdout:2/739: stat d4/d3a 0 2024-09-21T12:47:04.421 INFO:tasks.workunit.client.1.smithi176.stdout:9/724: dread - d1/df/fdb zero size 2024-09-21T12:47:04.423 INFO:tasks.workunit.client.1.smithi176.stdout:2/740: chown d4/df/d2e/d6f/d5d/d81/db2/da5/dcc 2 1 2024-09-21T12:47:04.424 INFO:tasks.workunit.client.1.smithi176.stdout:8/695: rename d6/db/f2c to d6/db/d13/d98/da1/fd8 0 2024-09-21T12:47:04.425 INFO:tasks.workunit.client.1.smithi176.stdout:8/696: stat d6/d8/d24/d35/f61 0 2024-09-21T12:47:04.426 INFO:tasks.workunit.client.0.smithi046.stdout:6/180: truncate f3 4170326 0 2024-09-21T12:47:04.427 INFO:tasks.workunit.client.0.smithi046.stdout:6/181: write de/f28 [276631,15749] 0 2024-09-21T12:47:04.428 INFO:tasks.workunit.client.1.smithi176.stdout:3/833: truncate d1/d8d/f97 794665 0 2024-09-21T12:47:04.429 INFO:tasks.workunit.client.1.smithi176.stdout:5/635: symlink d0/d13/d63/d2e/d71/lc5 0 2024-09-21T12:47:04.431 INFO:tasks.workunit.client.0.smithi046.stdout:2/206: link d16/d22/d2b/l3c d16/d22/d2b/l45 0 2024-09-21T12:47:04.432 INFO:tasks.workunit.client.1.smithi176.stdout:1/748: write d0/db/d1a/d2c/d37/f45 [47494,81113] 0 2024-09-21T12:47:04.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/207: chown d16/l19 98866 1 2024-09-21T12:47:04.433 INFO:tasks.workunit.client.0.smithi046.stdout:6/182: rename de/c22 to de/d35/c36 0 2024-09-21T12:47:04.433 INFO:tasks.workunit.client.1.smithi176.stdout:1/749: readlink d0/db/d1a/d2c/dc5/d41/l55 0 2024-09-21T12:47:04.434 INFO:tasks.workunit.client.0.smithi046.stdout:6/183: write fb [246513,101547] 0 2024-09-21T12:47:04.435 INFO:tasks.workunit.client.0.smithi046.stdout:2/208: symlink d16/d22/d38/l46 0 2024-09-21T12:47:04.436 INFO:tasks.workunit.client.0.smithi046.stdout:2/209: stat d16/d22/d38 0 2024-09-21T12:47:04.437 INFO:tasks.workunit.client.1.smithi176.stdout:6/680: dwrite d2/dd/d26/d2b/d10/d1b/f2a [8388608,4194304] 0 2024-09-21T12:47:04.441 INFO:tasks.workunit.client.0.smithi046.stdout:6/184: creat de/d2a/d34/f37 x:0 0 0 2024-09-21T12:47:04.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/185: dwrite de/f18 [0,4194304] 0 2024-09-21T12:47:04.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/186: symlink de/d2a/d34/l38 0 2024-09-21T12:47:04.459 INFO:tasks.workunit.client.0.smithi046.stdout:2/210: getdents d16/d22/d2b 0 2024-09-21T12:47:04.459 INFO:tasks.workunit.client.0.smithi046.stdout:6/187: chown de/f20 23288590 1 2024-09-21T12:47:04.468 INFO:tasks.workunit.client.0.smithi046.stdout:2/211: rename d16/d22/d2b/d30/f32 to d16/d22/d2b/d30/f47 0 2024-09-21T12:47:04.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/212: write d16/d22/f29 [729407,70007] 0 2024-09-21T12:47:04.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/213: chown fa 77982926 1 2024-09-21T12:47:04.474 INFO:tasks.workunit.client.0.smithi046.stdout:6/188: creat de/f39 x:0 0 0 2024-09-21T12:47:04.478 INFO:tasks.workunit.client.0.smithi046.stdout:2/214: rename d16/d22/d38/f3e to d16/f48 0 2024-09-21T12:47:04.479 INFO:tasks.workunit.client.0.smithi046.stdout:6/189: symlink de/d35/l3a 0 2024-09-21T12:47:04.480 INFO:tasks.workunit.client.0.smithi046.stdout:6/190: write de/f1d [1372687,38453] 0 2024-09-21T12:47:04.486 INFO:tasks.workunit.client.0.smithi046.stdout:6/191: dwrite de/f28 [0,4194304] 0 2024-09-21T12:47:04.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/192: dwrite de/f15 [0,4194304] 0 2024-09-21T12:47:04.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/193: chown de/d2a/d34/l38 0 1 2024-09-21T12:47:04.501 INFO:tasks.workunit.client.1.smithi176.stdout:4/727: getdents d3/d42/d56/d101/d107 0 2024-09-21T12:47:04.501 INFO:tasks.workunit.client.1.smithi176.stdout:0/849: link d9/d1a/d3f/d40/d79/cd4 d9/d1a/d1d/d22/c12f 0 2024-09-21T12:47:04.504 INFO:tasks.workunit.client.1.smithi176.stdout:7/856: truncate d0/d2/db/d10/f22 4714706 0 2024-09-21T12:47:04.509 INFO:tasks.workunit.client.1.smithi176.stdout:3/834: fdatasync d1/d35/d5e/d90/f9c 0 2024-09-21T12:47:04.510 INFO:tasks.workunit.client.1.smithi176.stdout:3/835: dread - d1/d34/d57/f12f zero size 2024-09-21T12:47:04.510 INFO:tasks.workunit.client.1.smithi176.stdout:5/636: mknod d0/d13/d63/d72/d87/d92/cc6 0 2024-09-21T12:47:04.510 INFO:tasks.workunit.client.1.smithi176.stdout:3/836: readlink d1/l12 0 2024-09-21T12:47:04.511 INFO:tasks.workunit.client.1.smithi176.stdout:5/637: truncate d0/d13/d5d/d98/d9b/faa 684046 0 2024-09-21T12:47:04.513 INFO:tasks.workunit.client.1.smithi176.stdout:6/681: rename d2/dd/d26/d2b/fa1 to d2/dd/d26/d2b/d10/d39/daf/fd6 0 2024-09-21T12:47:04.517 INFO:tasks.workunit.client.1.smithi176.stdout:7/857: fdatasync d0/d2/da8/dbe/ff8 0 2024-09-21T12:47:04.518 INFO:tasks.workunit.client.1.smithi176.stdout:7/858: write d0/d2/db/d10/d5a/fc5 [2015168,57893] 0 2024-09-21T12:47:04.519 INFO:tasks.workunit.client.1.smithi176.stdout:7/859: read - d0/d2/da8/f102 zero size 2024-09-21T12:47:04.521 INFO:tasks.workunit.client.1.smithi176.stdout:1/750: creat d0/d91/dd3/df5/f116 x:0 0 0 2024-09-21T12:47:04.523 INFO:tasks.workunit.client.1.smithi176.stdout:5/638: creat d0/d13/d63/d2e/d71/fc7 x:0 0 0 2024-09-21T12:47:04.524 INFO:tasks.workunit.client.1.smithi176.stdout:6/682: rename d2/dd/d26/d2b/f3b to d2/dd/d26/d2b/d10/d1b/d37/fd7 0 2024-09-21T12:47:04.524 INFO:tasks.workunit.client.1.smithi176.stdout:5/639: write d0/d13/d63/d2e/d39/d41/f60 [899522,50585] 0 2024-09-21T12:47:04.525 INFO:tasks.workunit.client.1.smithi176.stdout:4/728: dread d3/d42/d56/d101/d107/d96/da3/fad [0,4194304] 0 2024-09-21T12:47:04.526 INFO:tasks.workunit.client.1.smithi176.stdout:0/850: mkdir d9/d1a/db8/d130 0 2024-09-21T12:47:04.528 INFO:tasks.workunit.client.1.smithi176.stdout:0/851: chown d9/d1a/d1d/d23/da1/da3/d8f/dd8/fe6 29075100 1 2024-09-21T12:47:04.530 INFO:tasks.workunit.client.1.smithi176.stdout:2/741: link d4/df/d2e/d6f/d5d/d67/fc3 d4/df/d2e/d39/fe7 0 2024-09-21T12:47:04.531 INFO:tasks.workunit.client.1.smithi176.stdout:8/697: link d6/db/d37/d7a/fa5 d6/d8/d24/d35/d51/fd9 0 2024-09-21T12:47:04.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/215: truncate d16/d22/f41 658985 0 2024-09-21T12:47:04.534 INFO:tasks.workunit.client.1.smithi176.stdout:1/751: creat d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3/f117 x:0 0 0 2024-09-21T12:47:04.534 INFO:tasks.workunit.client.1.smithi176.stdout:6/683: read - d2/dd/d26/d2b/f92 zero size 2024-09-21T12:47:04.538 INFO:tasks.workunit.client.1.smithi176.stdout:5/640: mknod d0/d13/d63/d72/d87/d92/cc8 0 2024-09-21T12:47:04.539 INFO:tasks.workunit.client.1.smithi176.stdout:9/725: getdents d1/d61/d73/db6 0 2024-09-21T12:47:04.540 INFO:tasks.workunit.client.1.smithi176.stdout:4/729: read d3/d42/d47/d5c/fb0 [442865,118281] 0 2024-09-21T12:47:04.541 INFO:tasks.workunit.client.1.smithi176.stdout:0/852: rename d9/d1a/d1d/d81/d115/d98/lba to d9/d1a/d1d/d23/da1/da3/d1e/d47/l131 0 2024-09-21T12:47:04.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/194: write f3 [1144998,2124] 0 2024-09-21T12:47:04.543 INFO:tasks.workunit.client.0.smithi046.stdout:6/195: write de/f15 [3068770,114030] 0 2024-09-21T12:47:04.544 INFO:tasks.workunit.client.1.smithi176.stdout:8/698: read d6/d8/d24/d35/f61 [1157050,1378] 0 2024-09-21T12:47:04.545 INFO:tasks.workunit.client.1.smithi176.stdout:0/853: dread d9/d1a/d1d/d22/fb7 [0,4194304] 0 2024-09-21T12:47:04.546 INFO:tasks.workunit.client.1.smithi176.stdout:6/684: creat d2/dd/d26/d2b/d10/d39/fd8 x:0 0 0 2024-09-21T12:47:04.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/196: creat de/d2a/d34/f3b x:0 0 0 2024-09-21T12:47:04.547 INFO:tasks.workunit.client.1.smithi176.stdout:2/742: dread d4/df/fc1 [0,4194304] 0 2024-09-21T12:47:04.549 INFO:tasks.workunit.client.1.smithi176.stdout:5/641: mkdir d0/d13/d63/d2e/d37/db5/dc9 0 2024-09-21T12:47:04.549 INFO:tasks.workunit.client.1.smithi176.stdout:3/837: write d1/da/fb [1440037,1641] 0 2024-09-21T12:47:04.551 INFO:tasks.workunit.client.0.smithi046.stdout:6/197: mknod de/d2a/d34/c3c 0 2024-09-21T12:47:04.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/216: truncate d16/d22/f2e 1027062 0 2024-09-21T12:47:04.552 INFO:tasks.workunit.client.1.smithi176.stdout:5/642: dread d0/d10/f79 [0,4194304] 0 2024-09-21T12:47:04.553 INFO:tasks.workunit.client.1.smithi176.stdout:8/699: dwrite d6/d16/d79/fd6 [0,4194304] 0 2024-09-21T12:47:04.557 INFO:tasks.workunit.client.1.smithi176.stdout:8/700: truncate d6/d16/d36/d67/f6d 5103148 0 2024-09-21T12:47:04.559 INFO:tasks.workunit.client.1.smithi176.stdout:0/854: fdatasync d9/f52 0 2024-09-21T12:47:04.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/198: dwrite fa [0,4194304] 0 2024-09-21T12:47:04.560 INFO:tasks.workunit.client.0.smithi046.stdout:2/217: unlink d16/f1e 0 2024-09-21T12:47:04.560 INFO:tasks.workunit.client.1.smithi176.stdout:3/838: dwrite d1/da/fb2 [0,4194304] 0 2024-09-21T12:47:04.562 INFO:tasks.workunit.client.1.smithi176.stdout:3/839: stat d1/d5/d25/d61/dc3 0 2024-09-21T12:47:04.562 INFO:tasks.workunit.client.1.smithi176.stdout:4/730: dwrite d3/fd1 [4194304,4194304] 0 2024-09-21T12:47:04.562 INFO:tasks.workunit.client.1.smithi176.stdout:6/685: write d2/dd/d26/d2b/d10/f1f [2461707,13475] 0 2024-09-21T12:47:04.563 INFO:tasks.workunit.client.1.smithi176.stdout:3/840: readlink d1/d5/d25/l75 0 2024-09-21T12:47:04.564 INFO:tasks.workunit.client.1.smithi176.stdout:2/743: mknod d4/df/d2e/d6f/d5d/d67/d9f/ce8 0 2024-09-21T12:47:04.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:04 smithi176 ceph-mon[35476]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:04.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:04 smithi176 ceph-mon[35476]: pgmap v28: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 43 MiB/s rd, 179 MiB/s wr, 306 op/s 2024-09-21T12:47:04.572 INFO:tasks.workunit.client.1.smithi176.stdout:9/726: dwrite d1/df/d48/d69/d76/fae [0,4194304] 0 2024-09-21T12:47:04.573 INFO:tasks.workunit.client.0.smithi046.stdout:2/218: fsync d16/f1d 0 2024-09-21T12:47:04.575 INFO:tasks.workunit.client.1.smithi176.stdout:5/643: creat d0/d10/d70/fca x:0 0 0 2024-09-21T12:47:04.578 INFO:tasks.workunit.client.0.smithi046.stdout:2/219: rmdir d16/d22/d2b/d30 39 2024-09-21T12:47:04.580 INFO:tasks.workunit.client.1.smithi176.stdout:0/855: readlink d9/d1a/d20/d65/l9e 0 2024-09-21T12:47:04.580 INFO:tasks.workunit.client.1.smithi176.stdout:3/841: creat d1/d34/d48/deb/dc6/f134 x:0 0 0 2024-09-21T12:47:04.581 INFO:tasks.workunit.client.1.smithi176.stdout:0/856: readlink d9/d1a/d1d/d23/l54 0 2024-09-21T12:47:04.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/220: unlink f13 0 2024-09-21T12:47:04.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/221: chown d16/d22/d2b/d43/l44 12856 1 2024-09-21T12:47:04.584 INFO:tasks.workunit.client.1.smithi176.stdout:2/744: mknod d4/df/d2e/d6f/d5d/d81/ce9 0 2024-09-21T12:47:04.587 INFO:tasks.workunit.client.1.smithi176.stdout:3/842: dwrite d1/d34/d48/deb/dc6/f134 [0,4194304] 0 2024-09-21T12:47:04.590 INFO:tasks.workunit.client.0.smithi046.stdout:2/222: dwrite d16/d22/d38/f35 [0,4194304] 0 2024-09-21T12:47:04.590 INFO:tasks.workunit.client.1.smithi176.stdout:9/727: truncate d1/d61/d73/db6/fe3 6078727 0 2024-09-21T12:47:04.591 INFO:tasks.workunit.client.0.smithi046.stdout:2/223: readlink l12 0 2024-09-21T12:47:04.593 INFO:tasks.workunit.client.1.smithi176.stdout:2/745: dwrite d4/df/d2e/d6f/d5d/d67/f97 [0,4194304] 0 2024-09-21T12:47:04.599 INFO:tasks.workunit.client.1.smithi176.stdout:5/644: getdents d0/d13/d63/d2e/d37/d55 0 2024-09-21T12:47:04.600 INFO:tasks.workunit.client.1.smithi176.stdout:9/728: unlink d1/df/d48/d69/d4d/l83 0 2024-09-21T12:47:04.601 INFO:tasks.workunit.client.1.smithi176.stdout:9/729: chown d1/df/d48/d69/c65 2 1 2024-09-21T12:47:04.603 INFO:tasks.workunit.client.1.smithi176.stdout:2/746: rename d4/df/d2e/d39/fe7 to d4/df/d2e/d39/fea 0 2024-09-21T12:47:04.607 INFO:tasks.workunit.client.1.smithi176.stdout:5/645: symlink d0/d13/d63/d72/d87/d92/lcb 0 2024-09-21T12:47:04.609 INFO:tasks.workunit.client.1.smithi176.stdout:9/730: rename d1/df/d48/d69/d76/dd8 to d1/df/dea/df5 0 2024-09-21T12:47:04.610 INFO:tasks.workunit.client.1.smithi176.stdout:2/747: rmdir d4/df/dc4 39 2024-09-21T12:47:04.613 INFO:tasks.workunit.client.0.smithi046.stdout:2/224: rename d16/d22/l40 to d16/d22/d2b/l49 0 2024-09-21T12:47:04.615 INFO:tasks.workunit.client.1.smithi176.stdout:5/646: creat d0/d13/d63/d2e/d39/d41/fcc x:0 0 0 2024-09-21T12:47:04.616 INFO:tasks.workunit.client.1.smithi176.stdout:8/701: write d6/f1a [1939459,81940] 0 2024-09-21T12:47:04.618 INFO:tasks.workunit.client.1.smithi176.stdout:9/731: dwrite d1/df/d48/d69/d40/fe4 [0,4194304] 0 2024-09-21T12:47:04.618 INFO:tasks.workunit.client.1.smithi176.stdout:3/843: dread d1/d35/fbd [0,4194304] 0 2024-09-21T12:47:04.619 INFO:tasks.workunit.client.1.smithi176.stdout:8/702: dread - d6/db/d37/d7a/f96 zero size 2024-09-21T12:47:04.620 INFO:tasks.workunit.client.1.smithi176.stdout:8/703: readlink d6/db/d37/lb1 0 2024-09-21T12:47:04.623 INFO:tasks.workunit.client.1.smithi176.stdout:5/647: rename d0/d13/d63/l54 to d0/d13/d63/d72/d87/d92/lcd 0 2024-09-21T12:47:04.632 INFO:tasks.workunit.client.1.smithi176.stdout:2/748: truncate d4/df/d4b/fc7 2380021 0 2024-09-21T12:47:04.632 INFO:tasks.workunit.client.1.smithi176.stdout:6/686: write d2/dd/d26/d2b/d10/d1b/d37/fd7 [4496234,120026] 0 2024-09-21T12:47:04.636 INFO:tasks.workunit.client.1.smithi176.stdout:9/732: truncate d1/df/d48/d69/d40/d84/f95 499141 0 2024-09-21T12:47:04.637 INFO:tasks.workunit.client.1.smithi176.stdout:2/749: mkdir d4/df/d83/d8e/deb 0 2024-09-21T12:47:04.638 INFO:tasks.workunit.client.1.smithi176.stdout:2/750: chown d4/df/d2e/d6f/f33 88 1 2024-09-21T12:47:04.638 INFO:tasks.workunit.client.1.smithi176.stdout:6/687: symlink d2/d6f/d7f/ld9 0 2024-09-21T12:47:04.640 INFO:tasks.workunit.client.1.smithi176.stdout:2/751: fdatasync d4/df/d2e/d39/db7/d80/fb5 0 2024-09-21T12:47:04.640 INFO:tasks.workunit.client.1.smithi176.stdout:9/733: creat d1/d63/ff6 x:0 0 0 2024-09-21T12:47:04.641 INFO:tasks.workunit.client.1.smithi176.stdout:6/688: mknod d2/dd/dc7/cda 0 2024-09-21T12:47:04.642 INFO:tasks.workunit.client.1.smithi176.stdout:6/689: fsync d2/dd/d26/d2b/d68/fb2 0 2024-09-21T12:47:04.643 INFO:tasks.workunit.client.1.smithi176.stdout:6/690: readlink d2/dd/d26/d2b/d10/d1b/d37/l6d 0 2024-09-21T12:47:04.692 INFO:tasks.workunit.client.1.smithi176.stdout:7/860: sync 2024-09-21T12:47:04.692 INFO:tasks.workunit.client.1.smithi176.stdout:7/861: stat d0/d2f/d43/lc3 0 2024-09-21T12:47:04.711 INFO:tasks.workunit.client.1.smithi176.stdout:6/691: write d2/dd/d26/d2b/d10/d39/daf/fd6 [354207,32914] 0 2024-09-21T12:47:04.712 INFO:tasks.workunit.client.1.smithi176.stdout:2/752: creat d4/df/d2e/fec x:0 0 0 2024-09-21T12:47:04.715 INFO:tasks.workunit.client.1.smithi176.stdout:9/734: getdents d1/df/d23/dcf 0 2024-09-21T12:47:04.718 INFO:tasks.workunit.client.1.smithi176.stdout:2/753: dwrite d4/df/d2e/d39/db7/d80/fc2 [0,4194304] 0 2024-09-21T12:47:04.719 INFO:tasks.workunit.client.0.smithi046.stdout:2/225: write d16/d22/f41 [235563,72181] 0 2024-09-21T12:47:04.720 INFO:tasks.workunit.client.1.smithi176.stdout:9/735: creat d1/df/d48/ff7 x:0 0 0 2024-09-21T12:47:04.721 INFO:tasks.workunit.client.1.smithi176.stdout:2/754: unlink d4/df/d2e/d6f/c5f 0 2024-09-21T12:47:04.723 INFO:tasks.workunit.client.0.smithi046.stdout:2/226: chown d16/d22/d2b/l49 11865231 1 2024-09-21T12:47:04.724 INFO:tasks.workunit.client.0.smithi046.stdout:2/227: chown d16/d22/f2a 2727 1 2024-09-21T12:47:04.725 INFO:tasks.workunit.client.1.smithi176.stdout:9/736: creat d1/df/d23/d67/df0/ff8 x:0 0 0 2024-09-21T12:47:04.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/228: dread d16/d22/f41 [0,4194304] 0 2024-09-21T12:47:04.726 INFO:tasks.workunit.client.1.smithi176.stdout:2/755: creat d4/df/d2e/d6f/fed x:0 0 0 2024-09-21T12:47:04.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/229: stat d16/d22/d2b/l3d 0 2024-09-21T12:47:04.727 INFO:tasks.workunit.client.1.smithi176.stdout:3/844: write d1/d34/d71/d91/df6/d11f/f12c [902354,130146] 0 2024-09-21T12:47:04.729 INFO:tasks.workunit.client.1.smithi176.stdout:5/648: rename d0/d13/d63/d72/d87/d92/lcd to d0/d13/d63/d72/d87/d92/lce 0 2024-09-21T12:47:04.733 INFO:tasks.workunit.client.1.smithi176.stdout:2/756: symlink d4/df/d2e/d6f/d5d/lee 0 2024-09-21T12:47:04.733 INFO:tasks.workunit.client.0.smithi046.stdout:2/230: dwrite d16/d22/d2b/f37 [0,4194304] 0 2024-09-21T12:47:04.737 INFO:tasks.workunit.client.0.smithi046.stdout:2/231: dread d16/d22/f2a [0,4194304] 0 2024-09-21T12:47:04.738 INFO:tasks.workunit.client.1.smithi176.stdout:5/649: mkdir d0/d13/d63/d72/d87/dcf 0 2024-09-21T12:47:04.740 INFO:tasks.workunit.client.1.smithi176.stdout:2/757: creat d4/df/d2e/d4d/d70/fef x:0 0 0 2024-09-21T12:47:04.745 INFO:tasks.workunit.client.0.smithi046.stdout:2/232: creat d16/d22/d2b/d30/f4a x:0 0 0 2024-09-21T12:47:04.745 INFO:tasks.workunit.client.1.smithi176.stdout:6/692: write d2/d63/f51 [1142164,27323] 0 2024-09-21T12:47:04.747 INFO:tasks.workunit.client.1.smithi176.stdout:2/758: dwrite d4/df/d2e/d6f/d5d/d67/f97 [0,4194304] 0 2024-09-21T12:47:04.748 INFO:tasks.workunit.client.0.smithi046.stdout:2/233: rmdir d16/d22/d2b/d30 39 2024-09-21T12:47:04.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/234: chown d16/d22/d2b/d43/l44 3791287 1 2024-09-21T12:47:04.751 INFO:tasks.workunit.client.1.smithi176.stdout:9/737: dread d1/d8b/fa4 [0,4194304] 0 2024-09-21T12:47:04.752 INFO:tasks.workunit.client.1.smithi176.stdout:5/650: symlink d0/d13/d63/d72/d87/dcf/ld0 0 2024-09-21T12:47:04.756 INFO:tasks.workunit.client.1.smithi176.stdout:6/693: write d2/f64 [3258694,109711] 0 2024-09-21T12:47:04.758 INFO:tasks.workunit.client.1.smithi176.stdout:2/759: rename d4/df/d2e/d39/db7/d80/fc2 to d4/df/d2e/ddd/ff0 0 2024-09-21T12:47:04.759 INFO:tasks.workunit.client.1.smithi176.stdout:9/738: mknod d1/df/d48/d69/d40/d84/cf9 0 2024-09-21T12:47:04.762 INFO:tasks.workunit.client.1.smithi176.stdout:3/845: write d1/f18 [1487555,16938] 0 2024-09-21T12:47:04.763 INFO:tasks.workunit.client.0.smithi046.stdout:2/235: link fa d16/d22/d2b/d30/f4b 0 2024-09-21T12:47:04.765 INFO:tasks.workunit.client.1.smithi176.stdout:2/760: unlink d4/df/d2e/d6f/d5d/d67/fb4 0 2024-09-21T12:47:04.767 INFO:tasks.workunit.client.0.smithi046.stdout:2/236: chown d16/l1b 32854087 1 2024-09-21T12:47:04.768 INFO:tasks.workunit.client.1.smithi176.stdout:9/739: mkdir d1/df/dea/dfa 0 2024-09-21T12:47:04.771 INFO:tasks.workunit.client.0.smithi046.stdout:2/237: chown d16/d22/f41 858919 1 2024-09-21T12:47:04.771 INFO:tasks.workunit.client.0.smithi046.stdout:2/238: chown d16/d22/d2b/d43 201845804 1 2024-09-21T12:47:04.772 INFO:tasks.workunit.client.1.smithi176.stdout:6/694: mknod d2/dd/d26/cdb 0 2024-09-21T12:47:04.775 INFO:tasks.workunit.client.0.smithi046.stdout:2/239: write d16/f1a [4387296,8882] 0 2024-09-21T12:47:04.775 INFO:tasks.workunit.client.1.smithi176.stdout:9/740: mkdir d1/df/d23/d67/dfb 0 2024-09-21T12:47:04.776 INFO:tasks.workunit.client.0.smithi046.stdout:2/240: read d16/d22/f31 [2141340,68306] 0 2024-09-21T12:47:04.776 INFO:tasks.workunit.client.0.smithi046.stdout:2/241: readlink l12 0 2024-09-21T12:47:04.776 INFO:tasks.workunit.client.1.smithi176.stdout:3/846: symlink d1/d34/d71/d91/df6/l135 0 2024-09-21T12:47:04.779 INFO:tasks.workunit.client.1.smithi176.stdout:5/651: truncate d0/d13/d63/d2e/d39/d41/f9d 118237 0 2024-09-21T12:47:04.780 INFO:tasks.workunit.client.1.smithi176.stdout:6/695: creat d2/dd/d79/fdc x:0 0 0 2024-09-21T12:47:04.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/242: dwrite d16/d22/d2b/d30/f4a [0,4194304] 0 2024-09-21T12:47:04.782 INFO:tasks.workunit.client.1.smithi176.stdout:9/741: readlink d1/l3e 0 2024-09-21T12:47:04.786 INFO:tasks.workunit.client.1.smithi176.stdout:3/847: unlink d1/d5/d25/c7c 0 2024-09-21T12:47:04.787 INFO:tasks.workunit.client.1.smithi176.stdout:3/848: write d1/da/f2e [2659091,103952] 0 2024-09-21T12:47:04.788 INFO:tasks.workunit.client.1.smithi176.stdout:3/849: write d1/d34/d48/deb/dc6/f12a [890356,109616] 0 2024-09-21T12:47:04.789 INFO:tasks.workunit.client.1.smithi176.stdout:5/652: creat d0/d13/fd1 x:0 0 0 2024-09-21T12:47:04.790 INFO:tasks.workunit.client.1.smithi176.stdout:3/850: fdatasync d1/d5/d25/d84/f131 0 2024-09-21T12:47:04.793 INFO:tasks.workunit.client.1.smithi176.stdout:2/761: truncate d4/df/fc1 147061 0 2024-09-21T12:47:04.799 INFO:tasks.workunit.client.1.smithi176.stdout:2/762: creat d4/d3d/d65/ff1 x:0 0 0 2024-09-21T12:47:04.800 INFO:tasks.workunit.client.1.smithi176.stdout:9/742: rename d1/l22 to d1/df/dea/df5/lfc 0 2024-09-21T12:47:04.803 INFO:tasks.workunit.client.1.smithi176.stdout:9/743: fdatasync d1/df/d48/d69/d40/d84/fa8 0 2024-09-21T12:47:04.804 INFO:tasks.workunit.client.1.smithi176.stdout:2/763: rename d4/df/d83/d8e/faf to d4/df/dc4/ff2 0 2024-09-21T12:47:04.804 INFO:tasks.workunit.client.1.smithi176.stdout:6/696: dwrite d2/dd/d26/d2b/d10/d39/f5b [0,4194304] 0 2024-09-21T12:47:04.808 INFO:tasks.workunit.client.1.smithi176.stdout:3/851: dread d1/d35/d5e/d90/f9c [0,4194304] 0 2024-09-21T12:47:04.810 INFO:tasks.workunit.client.1.smithi176.stdout:9/744: dwrite d1/df/d23/f45 [0,4194304] 0 2024-09-21T12:47:04.838 INFO:tasks.workunit.client.0.smithi046.stdout:2/243: dwrite d16/f21 [0,4194304] 0 2024-09-21T12:47:04.839 INFO:tasks.workunit.client.1.smithi176.stdout:9/745: mkdir d1/df/d48/d69/d40/d84/dfd 0 2024-09-21T12:47:04.839 INFO:tasks.workunit.client.1.smithi176.stdout:6/697: mknod d2/dd/d26/cdd 0 2024-09-21T12:47:04.841 INFO:tasks.workunit.client.1.smithi176.stdout:9/746: rename d1/df/f46 to d1/d61/d73/ffe 0 2024-09-21T12:47:04.843 INFO:tasks.workunit.client.1.smithi176.stdout:3/852: link d1/d35/d5e/d90/f9c d1/d34/d57/dd0/d7d/f136 0 2024-09-21T12:47:04.845 INFO:tasks.workunit.client.1.smithi176.stdout:3/853: stat d1/d5/d25/f10d 0 2024-09-21T12:47:04.845 INFO:tasks.workunit.client.1.smithi176.stdout:6/698: symlink d2/dd/d26/d2b/d10/lde 0 2024-09-21T12:47:04.846 INFO:tasks.workunit.client.1.smithi176.stdout:1/752: sync 2024-09-21T12:47:04.848 INFO:tasks.workunit.client.1.smithi176.stdout:6/699: fdatasync d2/dd/d26/d2b/f2e 0 2024-09-21T12:47:04.849 INFO:tasks.workunit.client.1.smithi176.stdout:9/747: creat d1/df/fff x:0 0 0 2024-09-21T12:47:04.850 INFO:tasks.workunit.client.1.smithi176.stdout:3/854: symlink d1/d5/l137 0 2024-09-21T12:47:04.851 INFO:tasks.workunit.client.1.smithi176.stdout:5/653: dwrite d0/d13/d63/d2e/d39/d41/f77 [0,4194304] 0 2024-09-21T12:47:04.854 INFO:tasks.workunit.client.1.smithi176.stdout:3/855: fdatasync d1/d34/f52 0 2024-09-21T12:47:04.858 INFO:tasks.workunit.client.1.smithi176.stdout:1/753: link d0/db/d1a/fb7 d0/db/d1a/d2c/d6b/dd7/dfd/f118 0 2024-09-21T12:47:04.860 INFO:tasks.workunit.client.1.smithi176.stdout:6/700: rename d2/dd/d26/d2b/d10/d1b/f9b to d2/d6f/d7f/dbf/fdf 0 2024-09-21T12:47:04.862 INFO:tasks.workunit.client.1.smithi176.stdout:9/748: dwrite d1/d8b/fa6 [0,4194304] 0 2024-09-21T12:47:04.863 INFO:tasks.workunit.client.1.smithi176.stdout:6/701: readlink d2/d6f/d7f/dbf/lc8 0 2024-09-21T12:47:04.866 INFO:tasks.workunit.client.1.smithi176.stdout:9/749: dread - d1/df/d48/d69/d38/fc5 zero size 2024-09-21T12:47:04.870 INFO:tasks.workunit.client.1.smithi176.stdout:5/654: dwrite d0/d13/d63/d8d/daf/fb4 [0,4194304] 0 2024-09-21T12:47:04.871 INFO:tasks.workunit.client.1.smithi176.stdout:1/754: dwrite d0/fa [4194304,4194304] 0 2024-09-21T12:47:04.876 INFO:tasks.workunit.client.1.smithi176.stdout:4/731: sync 2024-09-21T12:47:04.877 INFO:tasks.workunit.client.1.smithi176.stdout:0/857: sync 2024-09-21T12:47:04.877 INFO:tasks.workunit.client.1.smithi176.stdout:8/704: sync 2024-09-21T12:47:04.877 INFO:tasks.workunit.client.1.smithi176.stdout:7/862: sync 2024-09-21T12:47:04.882 INFO:tasks.workunit.client.1.smithi176.stdout:9/750: dread d1/d8b/fa4 [0,4194304] 0 2024-09-21T12:47:04.883 INFO:tasks.workunit.client.1.smithi176.stdout:6/702: dwrite d2/dd/d26/d2b/d10/d1b/fa2 [0,4194304] 0 2024-09-21T12:47:04.883 INFO:tasks.workunit.client.1.smithi176.stdout:0/858: creat d9/d1a/d1d/d23/da1/d99/f132 x:0 0 0 2024-09-21T12:47:04.887 INFO:tasks.workunit.client.1.smithi176.stdout:4/732: dread d3/f3c [0,4194304] 0 2024-09-21T12:47:04.890 INFO:tasks.workunit.client.1.smithi176.stdout:8/705: dwrite d6/d8/d24/d35/d51/f55 [0,4194304] 0 2024-09-21T12:47:04.893 INFO:tasks.workunit.client.1.smithi176.stdout:0/859: creat d9/d1a/d1d/d23/da1/da3/f133 x:0 0 0 2024-09-21T12:47:04.893 INFO:tasks.workunit.client.1.smithi176.stdout:9/751: getdents d1/df/d23/dcf/ddd/de5 0 2024-09-21T12:47:04.897 INFO:tasks.workunit.client.1.smithi176.stdout:8/706: mknod d6/d16/d36/d7d/d81/cda 0 2024-09-21T12:47:04.899 INFO:tasks.workunit.client.1.smithi176.stdout:6/703: getdents d2/dd/d26/d2b 0 2024-09-21T12:47:04.899 INFO:tasks.workunit.client.1.smithi176.stdout:2/764: chown d4/df/fc1 465 1 2024-09-21T12:47:04.899 INFO:tasks.workunit.client.1.smithi176.stdout:8/707: chown d6/d16/d36/cac 308 1 2024-09-21T12:47:04.900 INFO:tasks.workunit.client.1.smithi176.stdout:6/704: fsync d2/d6f/d7f/fa8 0 2024-09-21T12:47:04.901 INFO:tasks.workunit.client.1.smithi176.stdout:2/765: chown d4/df/d2e/d6f/d5d/d81/l8c 63 1 2024-09-21T12:47:04.902 INFO:tasks.workunit.client.1.smithi176.stdout:0/860: getdents d9/d35/de7 0 2024-09-21T12:47:04.903 INFO:tasks.workunit.client.1.smithi176.stdout:2/766: write d4/df/d2e/d6f/d5d/f8d [6328098,9920] 0 2024-09-21T12:47:04.906 INFO:tasks.workunit.client.1.smithi176.stdout:8/708: dread d6/d16/f63 [0,4194304] 0 2024-09-21T12:47:04.906 INFO:tasks.workunit.client.1.smithi176.stdout:4/733: link d3/l65 d3/d21/d5e/l108 0 2024-09-21T12:47:04.908 INFO:tasks.workunit.client.1.smithi176.stdout:7/863: dread d0/d2/db/fd0 [4194304,4194304] 0 2024-09-21T12:47:04.909 INFO:tasks.workunit.client.1.smithi176.stdout:0/861: creat d9/d1a/d3f/d10d/dcc/f134 x:0 0 0 2024-09-21T12:47:04.910 INFO:tasks.workunit.client.1.smithi176.stdout:3/856: truncate d1/d5/f9b 3754155 0 2024-09-21T12:47:04.912 INFO:tasks.workunit.client.1.smithi176.stdout:5/655: write d0/d13/d63/d72/d87/fc4 [4667051,9788] 0 2024-09-21T12:47:04.915 INFO:tasks.workunit.client.1.smithi176.stdout:0/862: rmdir d9/d1a 39 2024-09-21T12:47:04.916 INFO:tasks.workunit.client.1.smithi176.stdout:2/767: dwrite d4/d3d/d65/d9b/fa8 [0,4194304] 0 2024-09-21T12:47:04.917 INFO:tasks.workunit.client.1.smithi176.stdout:9/752: link d1/df/d48/d69/d38/f43 d1/f100 0 2024-09-21T12:47:04.921 INFO:tasks.workunit.client.1.smithi176.stdout:3/857: mkdir d1/d34/d71/d91/df6/d11f/d138 0 2024-09-21T12:47:04.922 INFO:tasks.workunit.client.1.smithi176.stdout:8/709: dwrite d6/db/d37/d89/f8d [0,4194304] 0 2024-09-21T12:47:04.923 INFO:tasks.workunit.client.1.smithi176.stdout:6/705: getdents d2/dd/d26/d2b/d10/d1b/d37 0 2024-09-21T12:47:04.926 INFO:tasks.workunit.client.1.smithi176.stdout:5/656: readlink d0/d13/d63/d2e/d37/db5/db7/lb1 0 2024-09-21T12:47:04.927 INFO:tasks.workunit.client.1.smithi176.stdout:4/734: dwrite d3/d42/d56/d101/d107/f31 [0,4194304] 0 2024-09-21T12:47:04.927 INFO:tasks.workunit.client.1.smithi176.stdout:7/864: symlink d0/d2/db/d10/d31/d118/l132 0 2024-09-21T12:47:04.929 INFO:tasks.workunit.client.1.smithi176.stdout:9/753: mknod d1/df/d48/d69/d40/d84/c101 0 2024-09-21T12:47:04.931 INFO:tasks.workunit.client.1.smithi176.stdout:6/706: chown d2/dd/d26/d2b/d5a 59 1 2024-09-21T12:47:04.931 INFO:tasks.workunit.client.1.smithi176.stdout:6/707: readlink d2/dd/d26/d2b/la6 0 2024-09-21T12:47:04.934 INFO:tasks.workunit.client.1.smithi176.stdout:3/858: truncate d1/da/f89 5000379 0 2024-09-21T12:47:04.935 INFO:tasks.workunit.client.1.smithi176.stdout:5/657: write d0/f8 [1670903,32054] 0 2024-09-21T12:47:04.938 INFO:tasks.workunit.client.1.smithi176.stdout:7/865: rmdir d0/d2/db/d10/d72/d51 39 2024-09-21T12:47:04.939 INFO:tasks.workunit.client.1.smithi176.stdout:2/768: dwrite d4/df/dc4/fca [0,4194304] 0 2024-09-21T12:47:04.941 INFO:tasks.workunit.client.1.smithi176.stdout:6/708: write d2/dd/d26/d2b/d10/d39/fd8 [972017,120814] 0 2024-09-21T12:47:04.942 INFO:tasks.workunit.client.1.smithi176.stdout:9/754: mknod d1/df/d48/d69/dc8/c102 0 2024-09-21T12:47:04.944 INFO:tasks.workunit.client.1.smithi176.stdout:2/769: chown d4/fb0 1 1 2024-09-21T12:47:04.944 INFO:tasks.workunit.client.1.smithi176.stdout:7/866: chown d0/d2/db/d10/d3b/f88 6 1 2024-09-21T12:47:04.944 INFO:tasks.workunit.client.1.smithi176.stdout:5/658: mknod d0/d13/d63/d2e/d39/d41/cd2 0 2024-09-21T12:47:04.946 INFO:tasks.workunit.client.1.smithi176.stdout:4/735: dread d3/fd1 [4194304,4194304] 0 2024-09-21T12:47:04.946 INFO:tasks.workunit.client.1.smithi176.stdout:8/710: dwrite d6/db/d37/d7a/f96 [0,4194304] 0 2024-09-21T12:47:04.948 INFO:tasks.workunit.client.1.smithi176.stdout:4/736: readlink d3/d21/d5e/l85 0 2024-09-21T12:47:04.949 INFO:tasks.workunit.client.1.smithi176.stdout:9/755: creat d1/df/d23/dcf/ddd/f103 x:0 0 0 2024-09-21T12:47:04.950 INFO:tasks.workunit.client.1.smithi176.stdout:6/709: creat d2/dd/d26/d2b/d10/d1b/d37/fe0 x:0 0 0 2024-09-21T12:47:04.951 INFO:tasks.workunit.client.1.smithi176.stdout:5/659: rmdir d0/d13/d63/d2e/d39/d41 39 2024-09-21T12:47:04.954 INFO:tasks.workunit.client.1.smithi176.stdout:7/867: fsync d0/d2/db/d10/d23/da6/d105/fb5 0 2024-09-21T12:47:04.954 INFO:tasks.workunit.client.1.smithi176.stdout:3/859: dread d1/d35/d5e/d90/fda [0,4194304] 0 2024-09-21T12:47:04.954 INFO:tasks.workunit.client.1.smithi176.stdout:9/756: rmdir d1/df 39 2024-09-21T12:47:04.956 INFO:tasks.workunit.client.1.smithi176.stdout:5/660: symlink d0/d13/d63/d72/d87/ld3 0 2024-09-21T12:47:04.957 INFO:tasks.workunit.client.1.smithi176.stdout:5/661: write d0/d10/d70/f8b [1553556,19981] 0 2024-09-21T12:47:04.957 INFO:tasks.workunit.client.1.smithi176.stdout:8/711: mkdir d6/d8/d24/d35/ddb 0 2024-09-21T12:47:04.959 INFO:tasks.workunit.client.1.smithi176.stdout:4/737: creat d3/d21/d88/da7/f109 x:0 0 0 2024-09-21T12:47:04.960 INFO:tasks.workunit.client.1.smithi176.stdout:9/757: rmdir d1/d61 39 2024-09-21T12:47:04.960 INFO:tasks.workunit.client.1.smithi176.stdout:4/738: chown d3/d42/d56/fb8 13448 1 2024-09-21T12:47:04.964 INFO:tasks.workunit.client.1.smithi176.stdout:3/860: dread d1/d34/d57/dd0/d7d/f136 [0,4194304] 0 2024-09-21T12:47:04.965 INFO:tasks.workunit.client.1.smithi176.stdout:4/739: creat d3/d42/d56/f10a x:0 0 0 2024-09-21T12:47:04.969 INFO:tasks.workunit.client.1.smithi176.stdout:9/758: mknod d1/df/d23/d67/dfb/c104 0 2024-09-21T12:47:04.970 INFO:tasks.workunit.client.1.smithi176.stdout:4/740: fdatasync d3/d42/d4d/f9e 0 2024-09-21T12:47:04.970 INFO:tasks.workunit.client.1.smithi176.stdout:7/868: link d0/d2f/lff d0/d2/db/d10/d3b/d79/l133 0 2024-09-21T12:47:04.971 INFO:tasks.workunit.client.1.smithi176.stdout:3/861: dwrite d1/d5/d25/d84/f131 [0,4194304] 0 2024-09-21T12:47:04.972 INFO:tasks.workunit.client.1.smithi176.stdout:5/662: getdents d0/d13/d63 0 2024-09-21T12:47:04.973 INFO:tasks.workunit.client.1.smithi176.stdout:8/712: write d6/d8/d54/dca/fa7 [558262,19848] 0 2024-09-21T12:47:04.975 INFO:tasks.workunit.client.1.smithi176.stdout:9/759: dread d1/df/d48/d69/d4d/faa [0,4194304] 0 2024-09-21T12:47:04.975 INFO:tasks.workunit.client.1.smithi176.stdout:8/713: readlink d6/db/d37/lb1 0 2024-09-21T12:47:04.976 INFO:tasks.workunit.client.1.smithi176.stdout:9/760: stat d1/f2f 0 2024-09-21T12:47:04.976 INFO:tasks.workunit.client.1.smithi176.stdout:5/663: mkdir d0/d13/d63/dd4 0 2024-09-21T12:47:04.981 INFO:tasks.workunit.client.1.smithi176.stdout:3/862: rename d1/d5/d25/d38/l130 to d1/d34/d42/d5b/d120/l139 0 2024-09-21T12:47:04.982 INFO:tasks.workunit.client.1.smithi176.stdout:8/714: creat d6/db/d37/fdc x:0 0 0 2024-09-21T12:47:04.985 INFO:tasks.workunit.client.1.smithi176.stdout:9/761: dread d1/d61/d73/d7d/f8d [0,4194304] 0 2024-09-21T12:47:04.986 INFO:tasks.workunit.client.1.smithi176.stdout:4/741: truncate d3/d42/d4d/f9e 3810804 0 2024-09-21T12:47:04.988 INFO:tasks.workunit.client.1.smithi176.stdout:3/863: rename d1/d5/d25/d38/c72 to d1/d34/d71/d91/df6/d11f/c13a 0 2024-09-21T12:47:04.989 INFO:tasks.workunit.client.1.smithi176.stdout:9/762: write d1/df/d1c/f3c [4560552,67564] 0 2024-09-21T12:47:04.992 INFO:tasks.workunit.client.1.smithi176.stdout:8/715: rename d6/db/d37/d89/d8a/cb9 to d6/d8/d24/d35/d51/cdd 0 2024-09-21T12:47:04.993 INFO:tasks.workunit.client.1.smithi176.stdout:3/864: mkdir d1/d5/d25/d61/dc3/d13b 0 2024-09-21T12:47:04.994 INFO:tasks.workunit.client.1.smithi176.stdout:7/869: truncate d0/d2/db/d10/d72/d7e/fe0 145771 0 2024-09-21T12:47:05.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/116: sync 2024-09-21T12:47:05.021 INFO:tasks.workunit.client.0.smithi046.stdout:7/117: dread d2/f3 [4194304,4194304] 0 2024-09-21T12:47:05.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/118: dread d2/fa [0,4194304] 0 2024-09-21T12:47:05.023 INFO:tasks.workunit.client.0.smithi046.stdout:7/119: stat d2/d4/df/l1a 0 2024-09-21T12:47:05.024 INFO:tasks.workunit.client.0.smithi046.stdout:7/120: chown d2/dd/c24 0 1 2024-09-21T12:47:05.025 INFO:tasks.workunit.client.0.smithi046.stdout:7/121: read - d2/dd/f1b zero size 2024-09-21T12:47:05.026 INFO:tasks.workunit.client.0.smithi046.stdout:7/122: unlink d2/l1f 0 2024-09-21T12:47:05.032 INFO:tasks.workunit.client.0.smithi046.stdout:7/123: creat d2/dd/f29 x:0 0 0 2024-09-21T12:47:05.034 INFO:tasks.workunit.client.0.smithi046.stdout:7/124: rmdir d2/d4/df/d17 39 2024-09-21T12:47:05.035 INFO:tasks.workunit.client.0.smithi046.stdout:7/125: read d2/fe [5203293,82069] 0 2024-09-21T12:47:05.037 INFO:tasks.workunit.client.0.smithi046.stdout:7/126: mknod d2/d4/df/d17/c2a 0 2024-09-21T12:47:05.038 INFO:tasks.workunit.client.0.smithi046.stdout:7/127: dread - d2/dd/f29 zero size 2024-09-21T12:47:05.039 INFO:tasks.workunit.client.1.smithi176.stdout:1/755: sync 2024-09-21T12:47:05.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/128: read d2/fa [139429,95574] 0 2024-09-21T12:47:05.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/129: chown d2/d4/df/f10 1061069411 1 2024-09-21T12:47:05.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/130: write d2/d4/f8 [1596903,22765] 0 2024-09-21T12:47:05.049 INFO:tasks.workunit.client.0.smithi046.stdout:7/131: dread d2/d4/df/f10 [0,4194304] 0 2024-09-21T12:47:05.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/132: creat d2/dd/f2b x:0 0 0 2024-09-21T12:47:05.051 INFO:tasks.workunit.client.0.smithi046.stdout:7/133: write d2/d4/df/f1d [688406,17925] 0 2024-09-21T12:47:05.053 INFO:tasks.workunit.client.0.smithi046.stdout:7/134: symlink d2/dd/l2c 0 2024-09-21T12:47:05.054 INFO:tasks.workunit.client.0.smithi046.stdout:7/135: write d2/dd/f1b [400890,57462] 0 2024-09-21T12:47:05.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/136: write d2/d4/f1c [6404313,13747] 0 2024-09-21T12:47:05.056 INFO:tasks.workunit.client.1.smithi176.stdout:8/716: rename d6/db/d37/d89/d8a/da6 to d6/db/d13/d98/dde 0 2024-09-21T12:47:05.056 INFO:tasks.workunit.client.1.smithi176.stdout:3/865: creat d1/d34/d5d/f13c x:0 0 0 2024-09-21T12:47:05.056 INFO:tasks.workunit.client.1.smithi176.stdout:7/870: creat d0/d2/db/d10/d3b/d106/f134 x:0 0 0 2024-09-21T12:47:05.056 INFO:tasks.workunit.client.0.smithi046.stdout:7/137: dread - d2/dd/f29 zero size 2024-09-21T12:47:05.057 INFO:tasks.workunit.client.1.smithi176.stdout:9/763: write d1/df/d48/d69/d4d/f96 [1249428,86662] 0 2024-09-21T12:47:05.058 INFO:tasks.workunit.client.0.smithi046.stdout:7/138: fsync d2/fe 0 2024-09-21T12:47:05.058 INFO:tasks.workunit.client.1.smithi176.stdout:4/742: getdents d3/d5/dc5/dd6 0 2024-09-21T12:47:05.059 INFO:tasks.workunit.client.1.smithi176.stdout:3/866: write d1/d34/d57/fbf [3614854,71261] 0 2024-09-21T12:47:05.059 INFO:tasks.workunit.client.1.smithi176.stdout:8/717: mknod d6/d8/d54/cdf 0 2024-09-21T12:47:05.059 INFO:tasks.workunit.client.0.smithi046.stdout:7/139: truncate d2/d4/df/f1d 1562326 0 2024-09-21T12:47:05.061 INFO:tasks.workunit.client.1.smithi176.stdout:7/871: creat d0/d5d/d8a/f135 x:0 0 0 2024-09-21T12:47:05.062 INFO:tasks.workunit.client.0.smithi046.stdout:7/140: write d2/f3 [8404585,92114] 0 2024-09-21T12:47:05.062 INFO:tasks.workunit.client.1.smithi176.stdout:9/764: mkdir d1/df/d23/d67/d105 0 2024-09-21T12:47:05.066 INFO:tasks.workunit.client.1.smithi176.stdout:5/664: rename d0/d13/d63/d8d/daf/dc0 to d0/d13/d63/d2e/d39/dd5 0 2024-09-21T12:47:05.067 INFO:tasks.workunit.client.1.smithi176.stdout:1/756: dwrite d0/f3d [0,4194304] 0 2024-09-21T12:47:05.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/141: rename d2/dd/l2c to d2/d4/l2d 0 2024-09-21T12:47:05.072 INFO:tasks.workunit.client.1.smithi176.stdout:8/718: unlink d6/d8/le 0 2024-09-21T12:47:05.074 INFO:tasks.workunit.client.1.smithi176.stdout:7/872: dread d0/d5d/d5e/f128 [0,4194304] 0 2024-09-21T12:47:05.075 INFO:tasks.workunit.client.1.smithi176.stdout:3/867: dwrite d1/d34/d5d/f13c [0,4194304] 0 2024-09-21T12:47:05.078 INFO:tasks.workunit.client.1.smithi176.stdout:8/719: readlink d6/d16/d36/d7d/la8 0 2024-09-21T12:47:05.078 INFO:tasks.workunit.client.1.smithi176.stdout:9/765: dwrite d1/d63/fb2 [0,4194304] 0 2024-09-21T12:47:05.082 INFO:tasks.workunit.client.1.smithi176.stdout:3/868: dread - d1/d5/d25/d61/dc3/f121 zero size 2024-09-21T12:47:05.082 INFO:tasks.workunit.client.1.smithi176.stdout:7/873: symlink d0/d2/db/d10/d23/l136 0 2024-09-21T12:47:05.084 INFO:tasks.workunit.client.1.smithi176.stdout:8/720: read d6/d8/fb5 [371612,46908] 0 2024-09-21T12:47:05.085 INFO:tasks.workunit.client.1.smithi176.stdout:9/766: dread - d1/df/d48/d69/d76/d7c/fc6 zero size 2024-09-21T12:47:05.086 INFO:tasks.workunit.client.1.smithi176.stdout:5/665: dwrite d0/d13/d63/d2e/d37/db5/db7/f47 [0,4194304] 0 2024-09-21T12:47:05.088 INFO:tasks.workunit.client.1.smithi176.stdout:3/869: mknod d1/d34/d48/deb/c13d 0 2024-09-21T12:47:05.091 INFO:tasks.workunit.client.0.smithi046.stdout:9/213: sync 2024-09-21T12:47:05.092 INFO:tasks.workunit.client.1.smithi176.stdout:4/743: dwrite d3/d5/f4a [0,4194304] 0 2024-09-21T12:47:05.092 INFO:tasks.workunit.client.0.smithi046.stdout:1/195: sync 2024-09-21T12:47:05.092 INFO:tasks.workunit.client.0.smithi046.stdout:4/235: sync 2024-09-21T12:47:05.093 INFO:tasks.workunit.client.1.smithi176.stdout:9/767: write d1/df/d48/d69/f6f [3050092,109973] 0 2024-09-21T12:47:05.093 INFO:tasks.workunit.client.0.smithi046.stdout:7/142: dwrite d2/fa [0,4194304] 0 2024-09-21T12:47:05.095 INFO:tasks.workunit.client.1.smithi176.stdout:1/757: dwrite d0/db/d1a/d2c/d37/fbd [0,4194304] 0 2024-09-21T12:47:05.097 INFO:tasks.workunit.client.1.smithi176.stdout:4/744: fdatasync d3/d42/d56/d101/d107/d96/fea 0 2024-09-21T12:47:05.097 INFO:tasks.workunit.client.1.smithi176.stdout:1/758: stat d0/db 0 2024-09-21T12:47:05.103 INFO:tasks.workunit.client.1.smithi176.stdout:9/768: dread d1/df/d1c/f7a [0,4194304] 0 2024-09-21T12:47:05.104 INFO:tasks.workunit.client.0.smithi046.stdout:7/143: fsync d2/d4/df/f10 0 2024-09-21T12:47:05.108 INFO:tasks.workunit.client.1.smithi176.stdout:3/870: rename d1/d34/d48/f65 to d1/d34/d5d/dfe/f13e 0 2024-09-21T12:47:05.108 INFO:tasks.workunit.client.0.smithi046.stdout:4/236: rmdir d1/d27/d46 39 2024-09-21T12:47:05.113 INFO:tasks.workunit.client.0.smithi046.stdout:9/214: mknod d11/d19/d1b/d1c/d1f/d30/c3d 0 2024-09-21T12:47:05.114 INFO:tasks.workunit.client.1.smithi176.stdout:1/759: mkdir d0/db/d1a/d2c/dc5/d41/d59/d119 0 2024-09-21T12:47:05.115 INFO:tasks.workunit.client.0.smithi046.stdout:7/144: mknod d2/dd/c2e 0 2024-09-21T12:47:05.116 INFO:tasks.workunit.client.1.smithi176.stdout:7/874: link d0/d2/db/d10/d3b/f5b d0/d2/db/d10/f137 0 2024-09-21T12:47:05.116 INFO:tasks.workunit.client.0.smithi046.stdout:7/145: fdatasync d2/dd/f2b 0 2024-09-21T12:47:05.116 INFO:tasks.workunit.client.1.smithi176.stdout:7/875: write d0/d5d/d5e/f77 [3698931,13877] 0 2024-09-21T12:47:05.117 INFO:tasks.workunit.client.0.smithi046.stdout:4/237: write d1/d13/d25/f4a [2787349,121915] 0 2024-09-21T12:47:05.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/215: mkdir d11/d19/d1b/d1c/d1f/d30/d3e 0 2024-09-21T12:47:05.120 INFO:tasks.workunit.client.0.smithi046.stdout:9/216: chown d11/d19/d1b/c23 21531751 1 2024-09-21T12:47:05.121 INFO:tasks.workunit.client.1.smithi176.stdout:4/745: mkdir d3/d21/d10b 0 2024-09-21T12:47:05.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/217: chown f6 131151197 1 2024-09-21T12:47:05.122 INFO:tasks.workunit.client.0.smithi046.stdout:7/146: creat d2/d4/f2f x:0 0 0 2024-09-21T12:47:05.124 INFO:tasks.workunit.client.1.smithi176.stdout:9/769: dread d1/df/d23/f36 [0,4194304] 0 2024-09-21T12:47:05.124 INFO:tasks.workunit.client.1.smithi176.stdout:9/770: fsync d1/df/d48/d69/d38/fdf 0 2024-09-21T12:47:05.125 INFO:tasks.workunit.client.0.smithi046.stdout:1/196: rename d4/d13/d38/c49 to d4/c4b 0 2024-09-21T12:47:05.130 INFO:tasks.workunit.client.0.smithi046.stdout:9/218: creat d11/d19/d1b/f3f x:0 0 0 2024-09-21T12:47:05.130 INFO:tasks.workunit.client.0.smithi046.stdout:4/238: mkdir d1/d13/d4e 0 2024-09-21T12:47:05.131 INFO:tasks.workunit.client.1.smithi176.stdout:9/771: dread d1/df/d23/f45 [0,4194304] 0 2024-09-21T12:47:05.131 INFO:tasks.workunit.client.1.smithi176.stdout:5/666: getdents d0/d13/d63/d2e/d37 0 2024-09-21T12:47:05.132 INFO:tasks.workunit.client.1.smithi176.stdout:5/667: readlink d0/d13/d63/d2e/d37/db5/db7/lb1 0 2024-09-21T12:47:05.133 INFO:tasks.workunit.client.1.smithi176.stdout:7/876: mkdir d0/d2/db/d10/d3b/d138 0 2024-09-21T12:47:05.136 INFO:tasks.workunit.client.1.smithi176.stdout:0/863: sync 2024-09-21T12:47:05.136 INFO:tasks.workunit.client.1.smithi176.stdout:3/871: rename d1/d5/d25/d61/c7e to d1/d35/c13f 0 2024-09-21T12:47:05.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/239: rename d1/fe to d1/d13/d25/d29/d43/d3d/f4f 0 2024-09-21T12:47:05.142 INFO:tasks.workunit.client.1.smithi176.stdout:3/872: dwrite d1/d34/d48/deb/dc6/f12a [0,4194304] 0 2024-09-21T12:47:05.142 INFO:tasks.workunit.client.0.smithi046.stdout:9/219: creat d11/d19/d1b/d31/f40 x:0 0 0 2024-09-21T12:47:05.143 INFO:tasks.workunit.client.1.smithi176.stdout:5/668: symlink d0/d13/d5d/ld6 0 2024-09-21T12:47:05.145 INFO:tasks.workunit.client.0.smithi046.stdout:4/240: chown d1/d27/d46/f3e 21 1 2024-09-21T12:47:05.145 INFO:tasks.workunit.client.0.smithi046.stdout:4/241: readlink d1/d13/l20 0 2024-09-21T12:47:05.146 INFO:tasks.workunit.client.1.smithi176.stdout:7/877: chown d0/d98/ca9 726 1 2024-09-21T12:47:05.149 INFO:tasks.workunit.client.0.smithi046.stdout:9/220: dread d11/d19/d1b/f25 [0,4194304] 0 2024-09-21T12:47:05.150 INFO:tasks.workunit.client.1.smithi176.stdout:0/864: stat d9/d1a/d1d/d23/f102 0 2024-09-21T12:47:05.153 INFO:tasks.workunit.client.1.smithi176.stdout:1/760: rename d0/f58 to d0/db/d1a/d2c/d66/f11a 0 2024-09-21T12:47:05.154 INFO:tasks.workunit.client.0.smithi046.stdout:4/242: creat d1/d13/d25/d3a/f50 x:0 0 0 2024-09-21T12:47:05.155 INFO:tasks.workunit.client.0.smithi046.stdout:4/243: fdatasync d1/d13/d25/d29/d43/d3d/f4c 0 2024-09-21T12:47:05.156 INFO:tasks.workunit.client.0.smithi046.stdout:1/197: truncate d4/d13/f16 1992141 0 2024-09-21T12:47:05.157 INFO:tasks.workunit.client.0.smithi046.stdout:4/244: write d1/d13/d25/f19 [1597464,121131] 0 2024-09-21T12:47:05.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/221: symlink d11/d19/d1b/d1c/d1f/d30/l41 0 2024-09-21T12:47:05.160 INFO:tasks.workunit.client.0.smithi046.stdout:9/222: write d11/d19/d1b/d1c/f2e [458698,130089] 0 2024-09-21T12:47:05.162 INFO:tasks.workunit.client.1.smithi176.stdout:7/878: dread d0/d2/db/d10/f2c [0,4194304] 0 2024-09-21T12:47:05.163 INFO:tasks.workunit.client.1.smithi176.stdout:9/772: rename d1/df/d1c/f7a to d1/df/d9a/f106 0 2024-09-21T12:47:05.165 INFO:tasks.workunit.client.1.smithi176.stdout:1/761: truncate d0/db/d6a/fac 569617 0 2024-09-21T12:47:05.165 INFO:tasks.workunit.client.1.smithi176.stdout:7/879: read d0/d2/db/d10/d23/da6/d105/f7d [3678976,26893] 0 2024-09-21T12:47:05.165 INFO:tasks.workunit.client.1.smithi176.stdout:1/762: read - d0/db/d6a/f100 zero size 2024-09-21T12:47:05.166 INFO:tasks.workunit.client.0.smithi046.stdout:1/198: fdatasync d4/d13/f36 0 2024-09-21T12:47:05.167 INFO:tasks.workunit.client.1.smithi176.stdout:4/746: getdents d3/d21/d5e 0 2024-09-21T12:47:05.169 INFO:tasks.workunit.client.1.smithi176.stdout:0/865: getdents d9/d35/de7 0 2024-09-21T12:47:05.176 INFO:tasks.workunit.client.1.smithi176.stdout:7/880: dread d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:47:05.178 INFO:tasks.workunit.client.1.smithi176.stdout:3/873: rename d1/d5/d25/d38/f54 to d1/d34/d5d/f140 0 2024-09-21T12:47:05.179 INFO:tasks.workunit.client.1.smithi176.stdout:9/773: read - d1/df/d48/f89 zero size 2024-09-21T12:47:05.181 INFO:tasks.workunit.client.1.smithi176.stdout:9/774: stat d1/d8b/de1 0 2024-09-21T12:47:05.184 INFO:tasks.workunit.client.1.smithi176.stdout:1/763: creat d0/db/d1a/d2c/d66/d6d/dd8/f11b x:0 0 0 2024-09-21T12:47:05.185 INFO:tasks.workunit.client.1.smithi176.stdout:7/881: dwrite d0/d2/db/f129 [0,4194304] 0 2024-09-21T12:47:05.185 INFO:tasks.workunit.client.1.smithi176.stdout:5/669: dwrite d0/d13/f5c [4194304,4194304] 0 2024-09-21T12:47:05.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/245: truncate d1/f26 543811 0 2024-09-21T12:47:05.186 INFO:tasks.workunit.client.1.smithi176.stdout:0/866: rmdir d9/d1a/d1d/d23/d5f/ddd 39 2024-09-21T12:47:05.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/199: getdents d4 0 2024-09-21T12:47:05.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/200: readlink d4/d13/l34 0 2024-09-21T12:47:05.191 INFO:tasks.workunit.client.0.smithi046.stdout:9/223: dwrite d11/d19/d20/d26/f27 [0,4194304] 0 2024-09-21T12:47:05.195 INFO:tasks.workunit.client.1.smithi176.stdout:5/670: dwrite d0/d13/d63/d2e/d39/fb3 [0,4194304] 0 2024-09-21T12:47:05.203 INFO:tasks.workunit.client.1.smithi176.stdout:9/775: rmdir d1/df/dc3 39 2024-09-21T12:47:05.205 INFO:tasks.workunit.client.1.smithi176.stdout:9/776: write d1/df/d48/d69/d38/f5c [103739,43141] 0 2024-09-21T12:47:05.206 INFO:tasks.workunit.client.1.smithi176.stdout:1/764: mknod d0/db/d1a/d2c/d37/c11c 0 2024-09-21T12:47:05.210 INFO:tasks.workunit.client.0.smithi046.stdout:9/224: dread d11/d19/f1a [0,4194304] 0 2024-09-21T12:47:05.212 INFO:tasks.workunit.client.0.smithi046.stdout:9/225: write d11/d19/d1b/f3f [922655,110494] 0 2024-09-21T12:47:05.213 INFO:tasks.workunit.client.1.smithi176.stdout:2/770: sync 2024-09-21T12:47:05.214 INFO:tasks.workunit.client.1.smithi176.stdout:4/747: creat d3/d5/f10c x:0 0 0 2024-09-21T12:47:05.215 INFO:tasks.workunit.client.1.smithi176.stdout:9/777: creat d1/df/d48/d69/d4d/f107 x:0 0 0 2024-09-21T12:47:05.222 INFO:tasks.workunit.client.1.smithi176.stdout:3/874: creat d1/d34/d71/d91/df6/f141 x:0 0 0 2024-09-21T12:47:05.224 INFO:tasks.workunit.client.0.smithi046.stdout:4/246: dread d1/d13/d25/d29/d43/d3d/f4f [0,4194304] 0 2024-09-21T12:47:05.225 INFO:tasks.workunit.client.1.smithi176.stdout:2/771: creat d4/df/d2e/d4d/ff3 x:0 0 0 2024-09-21T12:47:05.225 INFO:tasks.workunit.client.1.smithi176.stdout:4/748: rmdir d3/d42/d56/d101/d107 39 2024-09-21T12:47:05.225 INFO:tasks.workunit.client.1.smithi176.stdout:2/772: read - d4/d3d/d76/fc9 zero size 2024-09-21T12:47:05.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/201: dread d4/d29/d32/f3f [0,4194304] 0 2024-09-21T12:47:05.227 INFO:tasks.workunit.client.1.smithi176.stdout:9/778: unlink d1/df/d9a/ldc 0 2024-09-21T12:47:05.229 INFO:tasks.workunit.client.0.smithi046.stdout:4/247: fsync d1/d13/d25/d3a/f3c 0 2024-09-21T12:47:05.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/202: dread d4/d13/f1d [0,4194304] 0 2024-09-21T12:47:05.231 INFO:tasks.workunit.client.0.smithi046.stdout:1/203: dread - d4/f22 zero size 2024-09-21T12:47:05.232 INFO:tasks.workunit.client.1.smithi176.stdout:7/882: dwrite d0/d2/db/fe [0,4194304] 0 2024-09-21T12:47:05.235 INFO:tasks.workunit.client.1.smithi176.stdout:9/779: dread d1/f66 [0,4194304] 0 2024-09-21T12:47:05.235 INFO:tasks.workunit.client.1.smithi176.stdout:0/867: dwrite d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/f5a [0,4194304] 0 2024-09-21T12:47:05.240 INFO:tasks.workunit.client.1.smithi176.stdout:1/765: write d0/db/d6f/fc9 [105470,88205] 0 2024-09-21T12:47:05.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/204: symlink d4/d13/l4c 0 2024-09-21T12:47:05.240 INFO:tasks.workunit.client.1.smithi176.stdout:8/721: sync 2024-09-21T12:47:05.240 INFO:tasks.workunit.client.1.smithi176.stdout:6/710: sync 2024-09-21T12:47:05.241 INFO:tasks.workunit.client.1.smithi176.stdout:4/749: dread d3/d21/f89 [0,4194304] 0 2024-09-21T12:47:05.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/205: write d4/fe [3598526,25080] 0 2024-09-21T12:47:05.244 INFO:tasks.workunit.client.1.smithi176.stdout:4/750: dread - d3/d42/d47/dab/fd9 zero size 2024-09-21T12:47:05.246 INFO:tasks.workunit.client.1.smithi176.stdout:3/875: mknod d1/d34/d71/d91/df6/d11f/d138/c142 0 2024-09-21T12:47:05.247 INFO:tasks.workunit.client.1.smithi176.stdout:5/671: truncate d0/d13/d63/d66/f69 714367 0 2024-09-21T12:47:05.249 INFO:tasks.workunit.client.0.smithi046.stdout:1/206: mkdir d4/d4d 0 2024-09-21T12:47:05.249 INFO:tasks.workunit.client.1.smithi176.stdout:0/868: dwrite d9/d1a/fd0 [0,4194304] 0 2024-09-21T12:47:05.256 INFO:tasks.workunit.client.0.smithi046.stdout:4/248: link d1/d13/c2b d1/d13/c51 0 2024-09-21T12:47:05.256 INFO:tasks.workunit.client.1.smithi176.stdout:4/751: symlink d3/d42/dae/l10d 0 2024-09-21T12:47:05.259 INFO:tasks.workunit.client.1.smithi176.stdout:9/780: dread d1/d8b/fc9 [0,4194304] 0 2024-09-21T12:47:05.259 INFO:tasks.workunit.client.1.smithi176.stdout:6/711: rename d2/dd/d26/d2b/d10/d1b/d7b/c97 to d2/d6f/d81/ce1 0 2024-09-21T12:47:05.260 INFO:tasks.workunit.client.1.smithi176.stdout:0/869: dread d9/f2b [0,4194304] 0 2024-09-21T12:47:05.260 INFO:tasks.workunit.client.1.smithi176.stdout:8/722: dread d6/db/d13/d98/f9e [0,4194304] 0 2024-09-21T12:47:05.262 INFO:tasks.workunit.client.1.smithi176.stdout:3/876: mknod d1/d3e/ddc/c143 0 2024-09-21T12:47:05.263 INFO:tasks.workunit.client.0.smithi046.stdout:4/249: symlink d1/d13/l52 0 2024-09-21T12:47:05.266 INFO:tasks.workunit.client.1.smithi176.stdout:2/773: dread d4/df/d2e/d6f/f3e [0,4194304] 0 2024-09-21T12:47:05.267 INFO:tasks.workunit.client.1.smithi176.stdout:4/752: dwrite d3/d42/f57 [0,4194304] 0 2024-09-21T12:47:05.267 INFO:tasks.workunit.client.1.smithi176.stdout:3/877: read d1/d5/d25/d61/fa5 [7690936,25847] 0 2024-09-21T12:47:05.268 INFO:tasks.workunit.client.1.smithi176.stdout:2/774: dread - d4/d3a/fd0 zero size 2024-09-21T12:47:05.269 INFO:tasks.workunit.client.1.smithi176.stdout:2/775: chown d4/d3d/fdb 3 1 2024-09-21T12:47:05.270 INFO:tasks.workunit.client.1.smithi176.stdout:2/776: write d4/df/d2e/d39/fe4 [1046557,18277] 0 2024-09-21T12:47:05.270 INFO:tasks.workunit.client.0.smithi046.stdout:4/250: creat d1/d13/d25/d29/d43/d3d/f53 x:0 0 0 2024-09-21T12:47:05.273 INFO:tasks.workunit.client.1.smithi176.stdout:9/781: mkdir d1/df/d23/d67/df0/d108 0 2024-09-21T12:47:05.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/207: read d4/d29/f41 [221640,6320] 0 2024-09-21T12:47:05.281 INFO:tasks.workunit.client.1.smithi176.stdout:6/712: chown d2/d6f/d81/ce1 173 1 2024-09-21T12:47:05.284 INFO:tasks.workunit.client.1.smithi176.stdout:5/672: rename d0/d13/d63/d72/f8f to d0/d13/d63/d8d/fd7 0 2024-09-21T12:47:05.285 INFO:tasks.workunit.client.0.smithi046.stdout:8/228: sync 2024-09-21T12:47:05.285 INFO:tasks.workunit.client.0.smithi046.stdout:2/244: sync 2024-09-21T12:47:05.285 INFO:tasks.workunit.client.0.smithi046.stdout:5/257: sync 2024-09-21T12:47:05.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/279: sync 2024-09-21T12:47:05.285 INFO:tasks.workunit.client.0.smithi046.stdout:6/199: sync 2024-09-21T12:47:05.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/209: sync 2024-09-21T12:47:05.286 INFO:tasks.workunit.client.1.smithi176.stdout:1/766: dwrite d0/db/d1a/d2c/dc5/d2b/d43/f8e [0,4194304] 0 2024-09-21T12:47:05.287 INFO:tasks.workunit.client.1.smithi176.stdout:3/878: creat d1/da/f144 x:0 0 0 2024-09-21T12:47:05.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/251: creat d1/d13/d25/d29/f54 x:0 0 0 2024-09-21T12:47:05.289 INFO:tasks.workunit.client.0.smithi046.stdout:3/210: dread d5/dc/d30/f39 [0,4194304] 0 2024-09-21T12:47:05.290 INFO:tasks.workunit.client.0.smithi046.stdout:1/208: mknod d4/d13/d38/c4e 0 2024-09-21T12:47:05.290 INFO:tasks.workunit.client.1.smithi176.stdout:2/777: chown d4/df/d2e/d39/f66 104 1 2024-09-21T12:47:05.294 INFO:tasks.workunit.client.1.smithi176.stdout:0/870: write d9/d1a/d1d/d23/da1/da3/d1e/d47/ff1 [95657,46807] 0 2024-09-21T12:47:05.294 INFO:tasks.workunit.client.0.smithi046.stdout:6/200: symlink de/d35/l3d 0 2024-09-21T12:47:05.295 INFO:tasks.workunit.client.1.smithi176.stdout:7/883: getdents d0/d2/d30/d93 0 2024-09-21T12:47:05.296 INFO:tasks.workunit.client.0.smithi046.stdout:8/229: dwrite d1/d12/f3b [0,4194304] 0 2024-09-21T12:47:05.296 INFO:tasks.workunit.client.1.smithi176.stdout:7/884: write d0/d5d/f12f [797079,58283] 0 2024-09-21T12:47:05.297 INFO:tasks.workunit.client.1.smithi176.stdout:9/782: creat d1/d61/d73/f109 x:0 0 0 2024-09-21T12:47:05.298 INFO:tasks.workunit.client.1.smithi176.stdout:9/783: readlink d1/df/l51 0 2024-09-21T12:47:05.298 INFO:tasks.workunit.client.0.smithi046.stdout:2/245: rmdir d16/d22/d38 39 2024-09-21T12:47:05.298 INFO:tasks.workunit.client.1.smithi176.stdout:7/885: read d0/d5d/dec/f108 [1116958,138] 0 2024-09-21T12:47:05.301 INFO:tasks.workunit.client.1.smithi176.stdout:6/713: symlink d2/dd/d26/d2b/d10/d1b/d7b/le2 0 2024-09-21T12:47:05.303 INFO:tasks.workunit.client.0.smithi046.stdout:0/280: mknod d6/d7/d13/d43/d52/c6c 0 2024-09-21T12:47:05.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/211: creat d5/d16/f47 x:0 0 0 2024-09-21T12:47:05.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/230: dwrite d1/f4f [0,4194304] 0 2024-09-21T12:47:05.306 INFO:tasks.workunit.client.0.smithi046.stdout:1/209: mkdir d4/d13/d38/d4f 0 2024-09-21T12:47:05.308 INFO:tasks.workunit.client.0.smithi046.stdout:6/201: rmdir de 39 2024-09-21T12:47:05.312 INFO:tasks.workunit.client.0.smithi046.stdout:2/246: truncate d16/f48 241460 0 2024-09-21T12:47:05.312 INFO:tasks.workunit.client.0.smithi046.stdout:1/210: dread d4/d13/f19 [0,4194304] 0 2024-09-21T12:47:05.313 INFO:tasks.workunit.client.0.smithi046.stdout:2/247: chown c4 266904 1 2024-09-21T12:47:05.313 INFO:tasks.workunit.client.1.smithi176.stdout:3/879: symlink d1/d9e/db4/l145 0 2024-09-21T12:47:05.314 INFO:tasks.workunit.client.1.smithi176.stdout:3/880: chown d1/d34/d48/f50 34032508 1 2024-09-21T12:47:05.321 INFO:tasks.workunit.client.1.smithi176.stdout:0/871: creat d9/d1a/d1d/d23/dd3/dee/f135 x:0 0 0 2024-09-21T12:47:05.322 INFO:tasks.workunit.client.1.smithi176.stdout:6/714: dread d2/dd/d26/d2b/d5a/f60 [0,4194304] 0 2024-09-21T12:47:05.323 INFO:tasks.workunit.client.1.smithi176.stdout:6/715: write d2/dd/d26/d2b/d10/d39/f5b [4408127,45891] 0 2024-09-21T12:47:05.326 INFO:tasks.workunit.client.0.smithi046.stdout:8/231: dread d1/d24/f4a [0,4194304] 0 2024-09-21T12:47:05.327 INFO:tasks.workunit.client.0.smithi046.stdout:8/232: chown d1/d12/f13 1256 1 2024-09-21T12:47:05.328 INFO:tasks.workunit.client.0.smithi046.stdout:8/233: readlink d1/lc 0 2024-09-21T12:47:05.333 INFO:tasks.workunit.client.0.smithi046.stdout:4/252: rename d1/d13/l20 to d1/d13/d25/l55 0 2024-09-21T12:47:05.338 INFO:tasks.workunit.client.1.smithi176.stdout:8/723: getdents d6/db/d37/d89/d8a 0 2024-09-21T12:47:05.338 INFO:tasks.workunit.client.1.smithi176.stdout:3/881: dwrite d1/d34/d5d/d78/f106 [4194304,4194304] 0 2024-09-21T12:47:05.339 INFO:tasks.workunit.client.0.smithi046.stdout:6/202: symlink de/d2a/d34/l3e 0 2024-09-21T12:47:05.340 INFO:tasks.workunit.client.0.smithi046.stdout:6/203: truncate de/f32 56513 0 2024-09-21T12:47:05.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/212: write d5/f24 [986089,111321] 0 2024-09-21T12:47:05.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/211: mknod d4/d4d/c50 0 2024-09-21T12:47:05.347 INFO:tasks.workunit.client.1.smithi176.stdout:3/882: dwrite d1/d8d/f103 [0,4194304] 0 2024-09-21T12:47:05.347 INFO:tasks.workunit.client.0.smithi046.stdout:0/281: creat d6/d7/d13/f6d x:0 0 0 2024-09-21T12:47:05.348 INFO:tasks.workunit.client.0.smithi046.stdout:2/248: write d16/f27 [1189038,15725] 0 2024-09-21T12:47:05.349 INFO:tasks.workunit.client.1.smithi176.stdout:4/753: getdents d3/d42/d47 0 2024-09-21T12:47:05.354 INFO:tasks.workunit.client.0.smithi046.stdout:3/213: mknod d5/dc/d26/d3c/c48 0 2024-09-21T12:47:05.356 INFO:tasks.workunit.client.0.smithi046.stdout:1/212: symlink d4/d29/d32/l51 0 2024-09-21T12:47:05.358 INFO:tasks.workunit.client.0.smithi046.stdout:4/253: symlink d1/d13/d25/d29/l56 0 2024-09-21T12:47:05.359 INFO:tasks.workunit.client.1.smithi176.stdout:9/784: link d1/df/d48/d69/d38/c6d d1/d8b/c10a 0 2024-09-21T12:47:05.361 INFO:tasks.workunit.client.0.smithi046.stdout:2/249: chown d16/c3b 17096 1 2024-09-21T12:47:05.362 INFO:tasks.workunit.client.0.smithi046.stdout:8/234: truncate d1/d12/d1a/d33/f4c 3421937 0 2024-09-21T12:47:05.364 INFO:tasks.workunit.client.0.smithi046.stdout:6/204: mknod de/c3f 0 2024-09-21T12:47:05.365 INFO:tasks.workunit.client.1.smithi176.stdout:7/886: link d0/d2/db/d10/f2c d0/d2/d30/d93/d96/d89/dcf/f139 0 2024-09-21T12:47:05.367 INFO:tasks.workunit.client.0.smithi046.stdout:4/254: dwrite d1/d13/d25/d3a/f4d [0,4194304] 0 2024-09-21T12:47:05.367 INFO:tasks.workunit.client.1.smithi176.stdout:3/883: dread - d1/d8d/fd1 zero size 2024-09-21T12:47:05.369 INFO:tasks.workunit.client.1.smithi176.stdout:3/884: chown d1/d34/d57/dd0/c10e 7972 1 2024-09-21T12:47:05.370 INFO:tasks.workunit.client.0.smithi046.stdout:3/214: symlink d5/d16/l49 0 2024-09-21T12:47:05.371 INFO:tasks.workunit.client.1.smithi176.stdout:5/673: getdents d0/d13/d63/d2e/d37 0 2024-09-21T12:47:05.371 INFO:tasks.workunit.client.1.smithi176.stdout:7/887: dwrite d0/d2/db/d10/d23/f8e [0,4194304] 0 2024-09-21T12:47:05.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/213: rmdir d4/d29/d32 39 2024-09-21T12:47:05.374 INFO:tasks.workunit.client.1.smithi176.stdout:1/767: getdents d0/d5b 0 2024-09-21T12:47:05.375 INFO:tasks.workunit.client.1.smithi176.stdout:1/768: chown d0/fc1 365030411 1 2024-09-21T12:47:05.376 INFO:tasks.workunit.client.1.smithi176.stdout:2/778: link d4/df/d2e/d4d/lb1 d4/df/d4b/lf4 0 2024-09-21T12:47:05.376 INFO:tasks.workunit.client.0.smithi046.stdout:2/250: dwrite d16/f21 [4194304,4194304] 0 2024-09-21T12:47:05.378 INFO:tasks.workunit.client.0.smithi046.stdout:8/235: dwrite d1/d12/d46/f49 [0,4194304] 0 2024-09-21T12:47:05.380 INFO:tasks.workunit.client.1.smithi176.stdout:0/872: rename d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/laa to d9/d1a/db8/l136 0 2024-09-21T12:47:05.382 INFO:tasks.workunit.client.1.smithi176.stdout:6/716: creat d2/d63/fe3 x:0 0 0 2024-09-21T12:47:05.386 INFO:tasks.workunit.client.1.smithi176.stdout:4/754: write d3/d42/d56/f90 [104746,16353] 0 2024-09-21T12:47:05.387 INFO:tasks.workunit.client.1.smithi176.stdout:5/674: creat d0/d13/d63/d8d/daf/fd8 x:0 0 0 2024-09-21T12:47:05.388 INFO:tasks.workunit.client.1.smithi176.stdout:5/675: fsync d0/d13/d63/d66/fc3 0 2024-09-21T12:47:05.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/214: mknod d4/d13/c52 0 2024-09-21T12:47:05.390 INFO:tasks.workunit.client.0.smithi046.stdout:4/255: dread d1/d13/d25/f19 [0,4194304] 0 2024-09-21T12:47:05.396 INFO:tasks.workunit.client.1.smithi176.stdout:8/724: creat d6/d16/d36/fe0 x:0 0 0 2024-09-21T12:47:05.397 INFO:tasks.workunit.client.1.smithi176.stdout:0/873: fdatasync d9/d1a/d1d/d90/f94 0 2024-09-21T12:47:05.399 INFO:tasks.workunit.client.0.smithi046.stdout:4/256: rename d1/d13/d25/d3a/f50 to d1/f57 0 2024-09-21T12:47:05.399 INFO:tasks.workunit.client.1.smithi176.stdout:1/769: dwrite d0/db/d1a/d73/f10d [0,4194304] 0 2024-09-21T12:47:05.402 INFO:tasks.workunit.client.1.smithi176.stdout:4/755: truncate d3/d21/d27/f7d 1599688 0 2024-09-21T12:47:05.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/215: write d4/f1b [4587872,16650] 0 2024-09-21T12:47:05.403 INFO:tasks.workunit.client.1.smithi176.stdout:7/888: symlink d0/d2/d30/d93/d96/l13a 0 2024-09-21T12:47:05.405 INFO:tasks.workunit.client.0.smithi046.stdout:4/257: truncate d1/d13/d25/d29/d33/f41 1648493 0 2024-09-21T12:47:05.409 INFO:tasks.workunit.client.0.smithi046.stdout:0/282: truncate d6/d7/f45 3871154 0 2024-09-21T12:47:05.409 INFO:tasks.workunit.client.1.smithi176.stdout:6/717: dwrite d2/dd/d26/d2b/fce [0,4194304] 0 2024-09-21T12:47:05.410 INFO:tasks.workunit.client.1.smithi176.stdout:0/874: dwrite d9/d1a/d1d/d23/da1/da3/f97 [4194304,4194304] 0 2024-09-21T12:47:05.411 INFO:tasks.workunit.client.1.smithi176.stdout:3/885: rename d1/d5/d25/d84 to d1/d5/d25/d146 0 2024-09-21T12:47:05.413 INFO:tasks.workunit.client.1.smithi176.stdout:1/770: stat d0/db/d1a/f20 0 2024-09-21T12:47:05.415 INFO:tasks.workunit.client.0.smithi046.stdout:8/236: dread d1/fa [0,4194304] 0 2024-09-21T12:47:05.419 INFO:tasks.workunit.client.0.smithi046.stdout:6/205: truncate f9 4057445 0 2024-09-21T12:47:05.420 INFO:tasks.workunit.client.0.smithi046.stdout:4/258: rename d1/d13/d25/d29/d43/d3d to d1/d27/d58 0 2024-09-21T12:47:05.423 INFO:tasks.workunit.client.0.smithi046.stdout:4/259: fdatasync d1/d27/d58/f4c 0 2024-09-21T12:47:05.425 INFO:tasks.workunit.client.0.smithi046.stdout:4/260: read d1/d13/d25/d29/d33/f41 [644319,122413] 0 2024-09-21T12:47:05.425 INFO:tasks.workunit.client.0.smithi046.stdout:8/237: rmdir d1/d12/d1a/d33 39 2024-09-21T12:47:05.425 INFO:tasks.workunit.client.1.smithi176.stdout:6/718: dwrite d2/dd/d26/d2b/d10/d39/f6c [0,4194304] 0 2024-09-21T12:47:05.427 INFO:tasks.workunit.client.1.smithi176.stdout:2/779: dwrite d4/f28 [0,4194304] 0 2024-09-21T12:47:05.428 INFO:tasks.workunit.client.0.smithi046.stdout:6/206: symlink de/d35/l40 0 2024-09-21T12:47:05.429 INFO:tasks.workunit.client.0.smithi046.stdout:2/251: write d16/d22/f2e [1124525,30022] 0 2024-09-21T12:47:05.429 INFO:tasks.workunit.client.0.smithi046.stdout:6/207: chown de/l14 0 1 2024-09-21T12:47:05.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/252: dread d16/d22/f2d [0,4194304] 0 2024-09-21T12:47:05.432 INFO:tasks.workunit.client.0.smithi046.stdout:6/208: write de/d2a/f2f [4281055,112524] 0 2024-09-21T12:47:05.432 INFO:tasks.workunit.client.1.smithi176.stdout:0/875: rename d9/dc2 to d9/d1a/d1d/d23/da1/d99/d137 0 2024-09-21T12:47:05.433 INFO:tasks.workunit.client.1.smithi176.stdout:0/876: stat d9/f16 0 2024-09-21T12:47:05.435 INFO:tasks.workunit.client.1.smithi176.stdout:2/780: dread d4/f28 [0,4194304] 0 2024-09-21T12:47:05.437 INFO:tasks.workunit.client.0.smithi046.stdout:0/283: rename d6/d7/f4d to d6/d7/d9/d6b/f6e 0 2024-09-21T12:47:05.438 INFO:tasks.workunit.client.1.smithi176.stdout:7/889: dread d0/d2/db/d10/d72/d7e/de2/df3/d11e/f122 [0,4194304] 0 2024-09-21T12:47:05.445 INFO:tasks.workunit.client.0.smithi046.stdout:1/216: dwrite d4/f9 [4194304,4194304] 0 2024-09-21T12:47:05.446 INFO:tasks.workunit.client.1.smithi176.stdout:5/676: truncate d0/d13/d63/d72/d87/fc4 4225102 0 2024-09-21T12:47:05.453 INFO:tasks.workunit.client.0.smithi046.stdout:6/209: fsync de/f16 0 2024-09-21T12:47:05.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/210: write f3 [4733263,100421] 0 2024-09-21T12:47:05.457 INFO:tasks.workunit.client.1.smithi176.stdout:8/725: dwrite d6/db/d13/d98/da1/fd8 [0,4194304] 0 2024-09-21T12:47:05.459 INFO:tasks.workunit.client.1.smithi176.stdout:8/726: write d6/d16/d36/fc3 [842362,80498] 0 2024-09-21T12:47:05.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/284: dread d6/f23 [0,4194304] 0 2024-09-21T12:47:05.464 INFO:tasks.workunit.client.0.smithi046.stdout:4/261: mknod d1/d27/c59 0 2024-09-21T12:47:05.465 INFO:tasks.workunit.client.1.smithi176.stdout:9/785: sync 2024-09-21T12:47:05.467 INFO:tasks.workunit.client.0.smithi046.stdout:4/262: write d1/d13/f30 [1354206,56664] 0 2024-09-21T12:47:05.472 INFO:tasks.workunit.client.0.smithi046.stdout:2/253: mknod d16/d22/c4c 0 2024-09-21T12:47:05.472 INFO:tasks.workunit.client.0.smithi046.stdout:0/285: dwrite d6/d7/d37/d53/f56 [0,4194304] 0 2024-09-21T12:47:05.475 INFO:tasks.workunit.client.0.smithi046.stdout:6/211: stat de/f2c 0 2024-09-21T12:47:05.475 INFO:tasks.workunit.client.0.smithi046.stdout:1/217: dread d4/d13/f19 [0,4194304] 0 2024-09-21T12:47:05.479 INFO:tasks.workunit.client.0.smithi046.stdout:8/238: rename d1/d12/l23 to d1/d12/d53/l54 0 2024-09-21T12:47:05.480 INFO:tasks.workunit.client.0.smithi046.stdout:6/212: read de/d2a/f33 [2641403,123176] 0 2024-09-21T12:47:05.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/147: sync 2024-09-21T12:47:05.491 INFO:tasks.workunit.client.0.smithi046.stdout:2/254: rmdir d16/d22/d2b/d43 39 2024-09-21T12:47:05.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/255: readlink d16/l1b 0 2024-09-21T12:47:05.495 INFO:tasks.workunit.client.1.smithi176.stdout:4/756: unlink d3/d5/c66 0 2024-09-21T12:47:05.497 INFO:tasks.workunit.client.1.smithi176.stdout:1/771: read d0/f5e [206754,16691] 0 2024-09-21T12:47:05.497 INFO:tasks.workunit.client.0.smithi046.stdout:6/213: rmdir de 39 2024-09-21T12:47:05.499 INFO:tasks.workunit.client.0.smithi046.stdout:7/148: creat d2/d4/df/d17/f30 x:0 0 0 2024-09-21T12:47:05.500 INFO:tasks.workunit.client.1.smithi176.stdout:4/757: dwrite d3/fe0 [0,4194304] 0 2024-09-21T12:47:05.501 INFO:tasks.workunit.client.0.smithi046.stdout:4/263: mknod d1/d13/c5a 0 2024-09-21T12:47:05.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/286: mknod d6/d7/c6f 0 2024-09-21T12:47:05.507 INFO:tasks.workunit.client.1.smithi176.stdout:0/877: fdatasync d9/d1a/d3f/fa4 0 2024-09-21T12:47:05.509 INFO:tasks.workunit.client.0.smithi046.stdout:1/218: fdatasync d4/d13/f16 0 2024-09-21T12:47:05.511 INFO:tasks.workunit.client.0.smithi046.stdout:8/239: mknod d1/d12/d1a/c55 0 2024-09-21T12:47:05.515 INFO:tasks.workunit.client.1.smithi176.stdout:5/677: creat d0/fd9 x:0 0 0 2024-09-21T12:47:05.518 INFO:tasks.workunit.client.0.smithi046.stdout:7/149: mkdir d2/d4/df/d17/d31 0 2024-09-21T12:47:05.521 INFO:tasks.workunit.client.0.smithi046.stdout:8/240: dwrite d1/d12/f39 [0,4194304] 0 2024-09-21T12:47:05.521 INFO:tasks.workunit.client.0.smithi046.stdout:4/264: mknod d1/d27/d37/c5b 0 2024-09-21T12:47:05.524 INFO:tasks.workunit.client.1.smithi176.stdout:9/786: mknod d1/df/d48/d69/d76/d7c/c10b 0 2024-09-21T12:47:05.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/150: truncate d2/dd/f2b 406806 0 2024-09-21T12:47:05.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/214: dwrite de/f26 [0,4194304] 0 2024-09-21T12:47:05.526 INFO:tasks.workunit.client.0.smithi046.stdout:0/287: symlink d6/d2f/l70 0 2024-09-21T12:47:05.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/265: truncate d1/d13/f31 6640020 0 2024-09-21T12:47:05.528 INFO:tasks.workunit.client.1.smithi176.stdout:3/886: mknod d1/d34/d5d/dce/c147 0 2024-09-21T12:47:05.530 INFO:tasks.workunit.client.1.smithi176.stdout:3/887: write d1/d34/f8c [680171,39685] 0 2024-09-21T12:47:05.531 INFO:tasks.workunit.client.1.smithi176.stdout:3/888: stat d1/d34/d48/deb/dc6/f105 0 2024-09-21T12:47:05.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/219: mkdir d4/d13/d38/d53 0 2024-09-21T12:47:05.533 INFO:tasks.workunit.client.0.smithi046.stdout:2/256: dread f15 [0,4194304] 0 2024-09-21T12:47:05.533 INFO:tasks.workunit.client.0.smithi046.stdout:8/241: mknod d1/c56 0 2024-09-21T12:47:05.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/288: write d6/d7/d13/d2a/f5f [4150340,2300] 0 2024-09-21T12:47:05.537 INFO:tasks.workunit.client.0.smithi046.stdout:4/266: rmdir d1/d13 39 2024-09-21T12:47:05.538 INFO:tasks.workunit.client.0.smithi046.stdout:8/242: dread - d1/d12/d46/d35/f50 zero size 2024-09-21T12:47:05.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/215: mknod de/d2a/d34/c41 0 2024-09-21T12:47:05.540 INFO:tasks.workunit.client.1.smithi176.stdout:2/781: symlink d4/df/d83/d8e/deb/lf5 0 2024-09-21T12:47:05.541 INFO:tasks.workunit.client.1.smithi176.stdout:2/782: chown d4/df/d2e/d6f/d5d/lee 5984715 1 2024-09-21T12:47:05.541 INFO:tasks.workunit.client.1.smithi176.stdout:2/783: chown d4/df/f6b 14434 1 2024-09-21T12:47:05.543 INFO:tasks.workunit.client.1.smithi176.stdout:7/890: symlink d0/d2/db/d10/d3b/l13b 0 2024-09-21T12:47:05.544 INFO:tasks.workunit.client.1.smithi176.stdout:5/678: write d0/d13/d63/d2e/d39/d41/fa3 [57496,54285] 0 2024-09-21T12:47:05.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/267: creat d1/d27/d58/f5c x:0 0 0 2024-09-21T12:47:05.548 INFO:tasks.workunit.client.0.smithi046.stdout:0/289: rename d6/d7/d37/f61 to d6/d7/d37/f71 0 2024-09-21T12:47:05.549 INFO:tasks.workunit.client.0.smithi046.stdout:6/216: dwrite fa [0,4194304] 0 2024-09-21T12:47:05.551 INFO:tasks.workunit.client.1.smithi176.stdout:7/891: dread d0/d2/db/d10/d23/da6/d12b/fdf [0,4194304] 0 2024-09-21T12:47:05.552 INFO:tasks.workunit.client.0.smithi046.stdout:1/220: creat d4/d13/d38/d4f/f54 x:0 0 0 2024-09-21T12:47:05.553 INFO:tasks.workunit.client.1.smithi176.stdout:3/889: creat d1/f148 x:0 0 0 2024-09-21T12:47:05.554 INFO:tasks.workunit.client.0.smithi046.stdout:7/151: dread d2/d4/f8 [4194304,4194304] 0 2024-09-21T12:47:05.558 INFO:tasks.workunit.client.1.smithi176.stdout:4/758: mknod d3/d42/d56/d101/d107/df0/c10e 0 2024-09-21T12:47:05.562 INFO:tasks.workunit.client.1.smithi176.stdout:6/719: rename d2/dd/d26/d2b/ld3 to d2/dd/d26/d2b/d10/d1b/le4 0 2024-09-21T12:47:05.562 INFO:tasks.workunit.client.0.smithi046.stdout:0/290: dread d6/d7/d13/d2a/d31/f46 [0,4194304] 0 2024-09-21T12:47:05.567 INFO:tasks.workunit.client.0.smithi046.stdout:1/221: dwrite d4/d13/d38/d4f/f54 [0,4194304] 0 2024-09-21T12:47:05.567 INFO:tasks.workunit.client.0.smithi046.stdout:7/152: dwrite d2/f3 [4194304,4194304] 0 2024-09-21T12:47:05.567 INFO:tasks.workunit.client.1.smithi176.stdout:2/784: mknod d4/d3d/d76/cf6 0 2024-09-21T12:47:05.568 INFO:tasks.workunit.client.0.smithi046.stdout:4/268: truncate d1/d13/d25/d29/f2f 4404273 0 2024-09-21T12:47:05.569 INFO:tasks.workunit.client.0.smithi046.stdout:7/153: dread d2/dd/f2b [0,4194304] 0 2024-09-21T12:47:05.570 INFO:tasks.workunit.client.1.smithi176.stdout:8/727: creat d6/fe1 x:0 0 0 2024-09-21T12:47:05.570 INFO:tasks.workunit.client.0.smithi046.stdout:4/269: write d1/d27/d37/f49 [319640,125539] 0 2024-09-21T12:47:05.571 INFO:tasks.workunit.client.0.smithi046.stdout:6/217: mkdir de/d35/d42 0 2024-09-21T12:47:05.575 INFO:tasks.workunit.client.1.smithi176.stdout:5/679: mkdir d0/d13/d63/d2e/dda 0 2024-09-21T12:47:05.575 INFO:tasks.workunit.client.1.smithi176.stdout:0/878: dwrite d9/d1a/d1d/d23/da1/da3/d8f/dd8/fe6 [0,4194304] 0 2024-09-21T12:47:05.584 INFO:tasks.workunit.client.1.smithi176.stdout:9/787: dwrite d1/df/d1c/f49 [4194304,4194304] 0 2024-09-21T12:47:05.590 INFO:tasks.workunit.client.0.smithi046.stdout:2/257: truncate d16/d22/d2b/d30/f47 388965 0 2024-09-21T12:47:05.592 INFO:tasks.workunit.client.1.smithi176.stdout:6/720: rename d2/dd/d26/d2b/f14 to d2/d6f/fe5 0 2024-09-21T12:47:05.592 INFO:tasks.workunit.client.1.smithi176.stdout:6/721: fsync d2/dd/f48 0 2024-09-21T12:47:05.595 INFO:tasks.workunit.client.1.smithi176.stdout:8/728: fsync d6/d16/d36/d7d/d81/f97 0 2024-09-21T12:47:05.598 INFO:tasks.workunit.client.0.smithi046.stdout:6/218: creat de/d35/f43 x:0 0 0 2024-09-21T12:47:05.599 INFO:tasks.workunit.client.0.smithi046.stdout:4/270: chown d1/d13/c2b 7 1 2024-09-21T12:47:05.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/243: mknod d1/d12/d46/d35/d36/d51/c57 0 2024-09-21T12:47:05.600 INFO:tasks.workunit.client.0.smithi046.stdout:6/219: dread - de/d2a/d34/f37 zero size 2024-09-21T12:47:05.602 INFO:tasks.workunit.client.1.smithi176.stdout:5/680: readlink d0/d13/d63/l4a 0 2024-09-21T12:47:05.602 INFO:tasks.workunit.client.0.smithi046.stdout:6/220: read de/f26 [3147990,67226] 0 2024-09-21T12:47:05.603 INFO:tasks.workunit.client.0.smithi046.stdout:6/221: stat de/f16 0 2024-09-21T12:47:05.605 INFO:tasks.workunit.client.0.smithi046.stdout:1/222: rename d4/c3d to d4/d13/d38/d4f/c55 0 2024-09-21T12:47:05.607 INFO:tasks.workunit.client.1.smithi176.stdout:1/772: getdents d0/db/d1a/d2c/dc5/d41 0 2024-09-21T12:47:05.608 INFO:tasks.workunit.client.0.smithi046.stdout:2/258: fsync fc 0 2024-09-21T12:47:05.611 INFO:tasks.workunit.client.1.smithi176.stdout:7/892: write d0/d5d/d5e/f75 [833644,65130] 0 2024-09-21T12:47:05.612 INFO:tasks.workunit.client.1.smithi176.stdout:7/893: write d0/d5d/f12f [358286,56448] 0 2024-09-21T12:47:05.613 INFO:tasks.workunit.client.1.smithi176.stdout:9/788: chown d1/df/d48/d69/d40/c44 1172 1 2024-09-21T12:47:05.614 INFO:tasks.workunit.client.1.smithi176.stdout:4/759: write d3/d42/d56/d101/d107/d96/da3/fca [960398,116434] 0 2024-09-21T12:47:05.614 INFO:tasks.workunit.client.0.smithi046.stdout:8/244: mknod d1/d12/d46/d35/d36/c58 0 2024-09-21T12:47:05.615 INFO:tasks.workunit.client.1.smithi176.stdout:4/760: readlink d3/d21/d27/d2c/lfa 0 2024-09-21T12:47:05.618 INFO:tasks.workunit.client.1.smithi176.stdout:2/785: write d4/df/d2e/d39/db7/f82 [3127130,112276] 0 2024-09-21T12:47:05.622 INFO:tasks.workunit.client.1.smithi176.stdout:6/722: rmdir d2/dd/d26/d2b/d10/d39 39 2024-09-21T12:47:05.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/259: unlink d16/d22/d2b/d30/c36 0 2024-09-21T12:47:05.629 INFO:tasks.workunit.client.0.smithi046.stdout:0/291: dwrite d6/d7/f45 [0,4194304] 0 2024-09-21T12:47:05.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/154: creat d2/f32 x:0 0 0 2024-09-21T12:47:05.634 INFO:tasks.workunit.client.1.smithi176.stdout:1/773: fdatasync d0/db/d2a/f5f 0 2024-09-21T12:47:05.635 INFO:tasks.workunit.client.0.smithi046.stdout:4/271: getdents d1/d13/d25/d29/d45 0 2024-09-21T12:47:05.637 INFO:tasks.workunit.client.0.smithi046.stdout:0/292: dwrite d6/d7/d13/f1d [0,4194304] 0 2024-09-21T12:47:05.638 INFO:tasks.workunit.client.1.smithi176.stdout:5/681: dread d0/f52 [0,4194304] 0 2024-09-21T12:47:05.642 INFO:tasks.workunit.client.1.smithi176.stdout:9/789: creat d1/df/d48/d69/dc8/f10c x:0 0 0 2024-09-21T12:47:05.644 INFO:tasks.workunit.client.0.smithi046.stdout:0/293: dread d6/f1a [0,4194304] 0 2024-09-21T12:47:05.645 INFO:tasks.workunit.client.1.smithi176.stdout:5/682: dwrite d0/f64 [8388608,4194304] 0 2024-09-21T12:47:05.649 INFO:tasks.workunit.client.0.smithi046.stdout:7/155: fdatasync d2/dd/f29 0 2024-09-21T12:47:05.650 INFO:tasks.workunit.client.0.smithi046.stdout:8/245: rename d1/f41 to d1/d12/d1a/d33/f59 0 2024-09-21T12:47:05.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/294: dread d6/d7/d37/f71 [0,4194304] 0 2024-09-21T12:47:05.652 INFO:tasks.workunit.client.0.smithi046.stdout:0/295: write d6/d7/d13/f1d [1468871,93816] 0 2024-09-21T12:47:05.654 INFO:tasks.workunit.client.1.smithi176.stdout:8/729: creat d6/d16/d36/d67/dd1/fe2 x:0 0 0 2024-09-21T12:47:05.654 INFO:tasks.workunit.client.1.smithi176.stdout:8/730: chown d6/d16/d36/d7d 89 1 2024-09-21T12:47:05.657 INFO:tasks.workunit.client.0.smithi046.stdout:6/222: rmdir de/d35/d42 0 2024-09-21T12:47:05.658 INFO:tasks.workunit.client.1.smithi176.stdout:0/879: creat d9/f138 x:0 0 0 2024-09-21T12:47:05.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/223: write d4/f10 [60690,32429] 0 2024-09-21T12:47:05.660 INFO:tasks.workunit.client.1.smithi176.stdout:2/786: write d4/df/f21 [1217416,78730] 0 2024-09-21T12:47:05.662 INFO:tasks.workunit.client.1.smithi176.stdout:2/787: write d4/df/d2e/d39/db7/f82 [3145120,130566] 0 2024-09-21T12:47:05.662 INFO:tasks.workunit.client.1.smithi176.stdout:7/894: dwrite d0/d2/d30/d93/d96/d89/dcf/f139 [0,4194304] 0 2024-09-21T12:47:05.664 INFO:tasks.workunit.client.0.smithi046.stdout:8/246: write d1/d12/d46/f37 [1161846,29790] 0 2024-09-21T12:47:05.665 INFO:tasks.workunit.client.1.smithi176.stdout:9/790: mkdir d1/df/d9a/d10d 0 2024-09-21T12:47:05.669 INFO:tasks.workunit.client.1.smithi176.stdout:5/683: symlink d0/d13/d5d/ldb 0 2024-09-21T12:47:05.672 INFO:tasks.workunit.client.1.smithi176.stdout:9/791: dwrite d1/df/d48/d69/d4d/ff3 [0,4194304] 0 2024-09-21T12:47:05.673 INFO:tasks.workunit.client.1.smithi176.stdout:9/792: fsync d1/df/d48/d69/d4d/f107 0 2024-09-21T12:47:05.674 INFO:tasks.workunit.client.1.smithi176.stdout:9/793: truncate d1/df/d48/ff7 979003 0 2024-09-21T12:47:05.677 INFO:tasks.workunit.client.0.smithi046.stdout:8/247: creat d1/d12/d46/d35/d36/d51/f5a x:0 0 0 2024-09-21T12:47:05.677 INFO:tasks.workunit.client.1.smithi176.stdout:1/774: symlink d0/db/d6f/de1/d10b/l11d 0 2024-09-21T12:47:05.681 INFO:tasks.workunit.client.1.smithi176.stdout:7/895: creat d0/d2/da8/dbe/f13c x:0 0 0 2024-09-21T12:47:05.684 INFO:tasks.workunit.client.1.smithi176.stdout:6/723: rename d2/dd/d26/d2b/d10/d87/l9e to d2/dd/d26/d2b/d10/le6 0 2024-09-21T12:47:05.685 INFO:tasks.workunit.client.0.smithi046.stdout:4/272: getdents d1/d13/d25/d3a 0 2024-09-21T12:47:05.685 INFO:tasks.workunit.client.0.smithi046.stdout:4/273: readlink d1/l1c 0 2024-09-21T12:47:05.685 INFO:tasks.workunit.client.1.smithi176.stdout:8/731: dwrite d6/d8/d24/f82 [0,4194304] 0 2024-09-21T12:47:05.686 INFO:tasks.workunit.client.1.smithi176.stdout:0/880: mknod d9/d1a/d3f/c139 0 2024-09-21T12:47:05.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/223: creat de/f44 x:0 0 0 2024-09-21T12:47:05.688 INFO:tasks.workunit.client.1.smithi176.stdout:9/794: symlink d1/df/d48/d69/dc8/l10e 0 2024-09-21T12:47:05.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/260: getdents d16/d22/d38 0 2024-09-21T12:47:05.691 INFO:tasks.workunit.client.1.smithi176.stdout:1/775: mkdir d0/d91/dd3/d11e 0 2024-09-21T12:47:05.691 INFO:tasks.workunit.client.1.smithi176.stdout:7/896: dwrite d0/d2/db/d10/d5a/fc5 [0,4194304] 0 2024-09-21T12:47:05.691 INFO:tasks.workunit.client.0.smithi046.stdout:2/261: chown l8 12 1 2024-09-21T12:47:05.691 INFO:tasks.workunit.client.1.smithi176.stdout:4/761: getdents d3/d21/d88/da7 0 2024-09-21T12:47:05.694 INFO:tasks.workunit.client.1.smithi176.stdout:1/776: fdatasync d0/db/d1a/d2c/dc5/d41/d59/d99/fa3 0 2024-09-21T12:47:05.694 INFO:tasks.workunit.client.1.smithi176.stdout:4/762: write d3/d21/d5e/fce [1007924,33866] 0 2024-09-21T12:47:05.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/296: truncate d6/d7/d13/f29 3374772 0 2024-09-21T12:47:05.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/297: chown d6/f1a 14169 1 2024-09-21T12:47:05.699 INFO:tasks.workunit.client.0.smithi046.stdout:1/224: write d4/d13/f1a [394439,3185] 0 2024-09-21T12:47:05.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/248: write d1/f20 [1701053,33980] 0 2024-09-21T12:47:05.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/249: fdatasync d1/d12/d46/d35/d36/d51/f5a 0 2024-09-21T12:47:05.705 INFO:tasks.workunit.client.0.smithi046.stdout:8/250: write d1/f1f [516632,37416] 0 2024-09-21T12:47:05.705 INFO:tasks.workunit.client.0.smithi046.stdout:8/251: chown d1/f1f 1920 1 2024-09-21T12:47:05.706 INFO:tasks.workunit.client.1.smithi176.stdout:1/777: dwrite d0/d63/f6c [0,4194304] 0 2024-09-21T12:47:05.706 INFO:tasks.workunit.client.0.smithi046.stdout:6/224: truncate de/f16 4193576 0 2024-09-21T12:47:05.708 INFO:tasks.workunit.client.1.smithi176.stdout:1/778: write d0/db/d6f/fc9 [991138,70572] 0 2024-09-21T12:47:05.710 INFO:tasks.workunit.client.1.smithi176.stdout:4/763: creat d3/d42/d4d/f10f x:0 0 0 2024-09-21T12:47:05.713 INFO:tasks.workunit.client.1.smithi176.stdout:3/890: rename d1/d5/d25/d61/cb5 to d1/d34/d48/deb/dc6/c149 0 2024-09-21T12:47:05.713 INFO:tasks.workunit.client.0.smithi046.stdout:6/225: dread de/d2a/f2f [0,4194304] 0 2024-09-21T12:47:05.713 INFO:tasks.workunit.client.0.smithi046.stdout:1/225: symlink d4/d13/d38/l56 0 2024-09-21T12:47:05.714 INFO:tasks.workunit.client.1.smithi176.stdout:6/724: dread d2/dd/d26/d2b/d10/d1b/f2a [8388608,4194304] 0 2024-09-21T12:47:05.715 INFO:tasks.workunit.client.1.smithi176.stdout:3/891: chown d1/d5/f10f 31 1 2024-09-21T12:47:05.715 INFO:tasks.workunit.client.1.smithi176.stdout:7/897: dwrite d0/d2/db/d10/d72/d7e/de2/df3/d11e/f122 [4194304,4194304] 0 2024-09-21T12:47:05.717 INFO:tasks.workunit.client.1.smithi176.stdout:9/795: mknod d1/df/c10f 0 2024-09-21T12:47:05.721 INFO:tasks.workunit.client.0.smithi046.stdout:4/274: truncate d1/d27/d46/f3e 3996505 0 2024-09-21T12:47:05.723 INFO:tasks.workunit.client.1.smithi176.stdout:7/898: dread d0/d2/db/d10/d72/f10c [0,4194304] 0 2024-09-21T12:47:05.725 INFO:tasks.workunit.client.1.smithi176.stdout:6/725: dwrite d2/dd/d26/d2b/d10/d1b/d37/fe0 [0,4194304] 0 2024-09-21T12:47:05.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/226: creat d4/d4d/f57 x:0 0 0 2024-09-21T12:47:05.729 INFO:tasks.workunit.client.1.smithi176.stdout:1/779: symlink d0/db/d1a/d2c/dc5/d41/d59/d9b/l11f 0 2024-09-21T12:47:05.730 INFO:tasks.workunit.client.1.smithi176.stdout:0/881: dwrite d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/ffe [0,4194304] 0 2024-09-21T12:47:05.731 INFO:tasks.workunit.client.0.smithi046.stdout:8/252: mkdir d1/d12/d46/d35/d5b 0 2024-09-21T12:47:05.732 INFO:tasks.workunit.client.1.smithi176.stdout:0/882: readlink d9/d1a/d3f/l64 0 2024-09-21T12:47:05.732 INFO:tasks.workunit.client.0.smithi046.stdout:8/253: stat d1/ff 0 2024-09-21T12:47:05.733 INFO:tasks.workunit.client.1.smithi176.stdout:4/764: mknod d3/d42/d56/d101/d107/d96/db2/c110 0 2024-09-21T12:47:05.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/254: chown d1/c15 0 1 2024-09-21T12:47:05.735 INFO:tasks.workunit.client.0.smithi046.stdout:2/262: dwrite d16/d22/d2b/d30/f4b [0,4194304] 0 2024-09-21T12:47:05.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/275: write d1/ff [4512536,60839] 0 2024-09-21T12:47:05.740 INFO:tasks.workunit.client.0.smithi046.stdout:0/298: rename d6/d2f/d59 to d6/d7/d13/d72 0 2024-09-21T12:47:05.742 INFO:tasks.workunit.client.1.smithi176.stdout:8/732: truncate d6/d16/d36/d67/f6d 2222023 0 2024-09-21T12:47:05.743 INFO:tasks.workunit.client.1.smithi176.stdout:8/733: dread - d6/db/d37/d89/fd5 zero size 2024-09-21T12:47:05.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/227: creat d4/d13/d38/f58 x:0 0 0 2024-09-21T12:47:05.746 INFO:tasks.workunit.client.1.smithi176.stdout:9/796: creat d1/d8b/f110 x:0 0 0 2024-09-21T12:47:05.746 INFO:tasks.workunit.client.1.smithi176.stdout:7/899: creat d0/d2/db/d10/d23/dce/f13d x:0 0 0 2024-09-21T12:47:05.747 INFO:tasks.workunit.client.1.smithi176.stdout:6/726: chown d2/l6b 1492 1 2024-09-21T12:47:05.748 INFO:tasks.workunit.client.0.smithi046.stdout:8/255: creat d1/d12/f5c x:0 0 0 2024-09-21T12:47:05.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/263: stat d16/f25 0 2024-09-21T12:47:05.750 INFO:tasks.workunit.client.1.smithi176.stdout:1/780: mkdir d0/db/d1a/d2c/dc5/d2b/d43/d92/d120 0 2024-09-21T12:47:05.752 INFO:tasks.workunit.client.1.smithi176.stdout:0/883: creat d9/d1a/d1d/d23/da1/da3/d8f/f13a x:0 0 0 2024-09-21T12:47:05.755 INFO:tasks.workunit.client.1.smithi176.stdout:9/797: chown d1/d61/d73/ffe 1 1 2024-09-21T12:47:05.756 INFO:tasks.workunit.client.1.smithi176.stdout:9/798: chown d1/df/d48/d69/d40/d84/l9d 308827987 1 2024-09-21T12:47:05.757 INFO:tasks.workunit.client.0.smithi046.stdout:2/264: dwrite d16/f21 [4194304,4194304] 0 2024-09-21T12:47:05.757 INFO:tasks.workunit.client.0.smithi046.stdout:6/226: rename de/f18 to de/f45 0 2024-09-21T12:47:05.758 INFO:tasks.workunit.client.1.smithi176.stdout:9/799: truncate d1/df/d48/d69/d38/fc5 423931 0 2024-09-21T12:47:05.758 INFO:tasks.workunit.client.0.smithi046.stdout:6/227: read de/f28 [1942298,98178] 0 2024-09-21T12:47:05.759 INFO:tasks.workunit.client.1.smithi176.stdout:3/892: dread d1/d35/ff0 [0,4194304] 0 2024-09-21T12:47:05.761 INFO:tasks.workunit.client.0.smithi046.stdout:1/228: symlink d4/d13/d38/d48/l59 0 2024-09-21T12:47:05.763 INFO:tasks.workunit.client.1.smithi176.stdout:6/727: unlink d2/dd/d26/d2b/d10/d1b/d7b/le2 0 2024-09-21T12:47:05.771 INFO:tasks.workunit.client.1.smithi176.stdout:2/788: rename d4/d3a to d4/df/df7 0 2024-09-21T12:47:05.774 INFO:tasks.workunit.client.1.smithi176.stdout:7/900: creat d0/d2/db/d10/d3b/d138/f13e x:0 0 0 2024-09-21T12:47:05.781 INFO:tasks.workunit.client.1.smithi176.stdout:7/901: dwrite d0/d2/d30/d93/d96/f124 [0,4194304] 0 2024-09-21T12:47:05.781 INFO:tasks.workunit.client.1.smithi176.stdout:1/781: truncate d0/db/d1a/d2c/d66/d6d/dd8/ff2 3054695 0 2024-09-21T12:47:05.785 INFO:tasks.workunit.client.1.smithi176.stdout:5/684: rename d0/d13/d63/d2e/d39 to d0/d13/d63/d8d/ddc 0 2024-09-21T12:47:05.788 INFO:tasks.workunit.client.0.smithi046.stdout:4/276: creat d1/f5d x:0 0 0 2024-09-21T12:47:05.788 INFO:tasks.workunit.client.0.smithi046.stdout:0/299: write d6/d7/d13/d2a/d31/f5a [740977,65905] 0 2024-09-21T12:47:05.790 INFO:tasks.workunit.client.1.smithi176.stdout:2/789: creat d4/df/d4b/ff8 x:0 0 0 2024-09-21T12:47:05.791 INFO:tasks.workunit.client.1.smithi176.stdout:8/734: write d6/d16/d36/d67/f85 [3561246,76928] 0 2024-09-21T12:47:05.797 INFO:tasks.workunit.client.1.smithi176.stdout:4/765: truncate d3/d42/f57 134830 0 2024-09-21T12:47:05.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/229: truncate d4/f1f 883887 0 2024-09-21T12:47:05.800 INFO:tasks.workunit.client.1.smithi176.stdout:7/902: mknod d0/d2/d30/d93/da2/c13f 0 2024-09-21T12:47:05.803 INFO:tasks.workunit.client.1.smithi176.stdout:5/685: mkdir d0/d13/d63/d2e/d37/db5/db7/ddd 0 2024-09-21T12:47:05.803 INFO:tasks.workunit.client.0.smithi046.stdout:2/265: write fc [887850,47076] 0 2024-09-21T12:47:05.804 INFO:tasks.workunit.client.0.smithi046.stdout:2/266: chown d16/d22 14756377 1 2024-09-21T12:47:05.804 INFO:tasks.workunit.client.1.smithi176.stdout:2/790: stat d4/df/d2e/d6f/d5d/d81/db2/c47 0 2024-09-21T12:47:05.806 INFO:tasks.workunit.client.1.smithi176.stdout:2/791: write d4/d3d/d65/f9d [171560,117688] 0 2024-09-21T12:47:05.809 INFO:tasks.workunit.client.1.smithi176.stdout:8/735: rename d6/db/da3/fbe to d6/d16/d79/fe3 0 2024-09-21T12:47:05.809 INFO:tasks.workunit.client.0.smithi046.stdout:0/300: dread d6/d7/d37/f48 [0,4194304] 0 2024-09-21T12:47:05.809 INFO:tasks.workunit.client.1.smithi176.stdout:2/792: dread - d4/df/d2e/d39/db7/d80/fce zero size 2024-09-21T12:47:05.811 INFO:tasks.workunit.client.1.smithi176.stdout:5/686: dwrite d0/d13/d63/d2e/d71/f95 [0,4194304] 0 2024-09-21T12:47:05.812 INFO:tasks.workunit.client.0.smithi046.stdout:6/228: link fa de/f46 0 2024-09-21T12:47:05.812 INFO:tasks.workunit.client.0.smithi046.stdout:8/256: write d1/d24/f29 [20174,28993] 0 2024-09-21T12:47:05.812 INFO:tasks.workunit.client.1.smithi176.stdout:6/728: dwrite d2/f96 [0,4194304] 0 2024-09-21T12:47:05.816 INFO:tasks.workunit.client.0.smithi046.stdout:0/301: dwrite d6/d7/d13/f36 [0,4194304] 0 2024-09-21T12:47:05.816 INFO:tasks.workunit.client.1.smithi176.stdout:4/766: dread - d3/d5/d37/fbb zero size 2024-09-21T12:47:05.818 INFO:tasks.workunit.client.0.smithi046.stdout:0/302: write d6/f21 [3893863,96151] 0 2024-09-21T12:47:05.830 INFO:tasks.workunit.client.0.smithi046.stdout:6/229: symlink de/d2a/d34/l47 0 2024-09-21T12:47:05.836 INFO:tasks.workunit.client.0.smithi046.stdout:8/257: dread d1/d12/d1a/d33/f4c [0,4194304] 0 2024-09-21T12:47:05.839 INFO:tasks.workunit.client.0.smithi046.stdout:0/303: rmdir d6/d2f 39 2024-09-21T12:47:05.840 INFO:tasks.workunit.client.1.smithi176.stdout:3/893: link d1/d5/l6b d1/d9e/l14a 0 2024-09-21T12:47:05.841 INFO:tasks.workunit.client.0.smithi046.stdout:2/267: symlink d16/d22/d2b/d43/l4d 0 2024-09-21T12:47:05.842 INFO:tasks.workunit.client.1.smithi176.stdout:5/687: write d0/d13/d5d/f73 [5111516,63484] 0 2024-09-21T12:47:05.844 INFO:tasks.workunit.client.0.smithi046.stdout:4/277: read d1/d27/d46/f3e [1613141,89632] 0 2024-09-21T12:47:05.845 INFO:tasks.workunit.client.0.smithi046.stdout:4/278: truncate d1/f39 978206 0 2024-09-21T12:47:05.845 INFO:tasks.workunit.client.1.smithi176.stdout:1/782: rmdir d0/df4 0 2024-09-21T12:47:05.847 INFO:tasks.workunit.client.1.smithi176.stdout:7/903: creat d0/d2/d30/d93/d96/d89/d11b/f140 x:0 0 0 2024-09-21T12:47:05.847 INFO:tasks.workunit.client.1.smithi176.stdout:7/904: chown d0/d2/db/d10/d23/da6/d105/f119 3139 1 2024-09-21T12:47:05.848 INFO:tasks.workunit.client.0.smithi046.stdout:0/304: rename d6/d7/d9/c16 to d6/d7/d13/d43/c73 0 2024-09-21T12:47:05.849 INFO:tasks.workunit.client.0.smithi046.stdout:2/268: unlink c4 0 2024-09-21T12:47:05.851 INFO:tasks.workunit.client.1.smithi176.stdout:8/736: mknod d6/db/ce4 0 2024-09-21T12:47:05.852 INFO:tasks.workunit.client.0.smithi046.stdout:1/230: dwrite d4/f1f [0,4194304] 0 2024-09-21T12:47:05.853 INFO:tasks.workunit.client.1.smithi176.stdout:2/793: mkdir d4/df/d2e/d39/db7/d80/dda/df9 0 2024-09-21T12:47:05.855 INFO:tasks.workunit.client.0.smithi046.stdout:8/258: rename d1/d24/c3e to d1/d24/c5d 0 2024-09-21T12:47:05.857 INFO:tasks.workunit.client.0.smithi046.stdout:8/259: truncate d1/d12/f5c 529668 0 2024-09-21T12:47:05.857 INFO:tasks.workunit.client.0.smithi046.stdout:8/260: stat d1/l22 0 2024-09-21T12:47:05.861 INFO:tasks.workunit.client.1.smithi176.stdout:6/729: mkdir d2/d63/de7 0 2024-09-21T12:47:05.862 INFO:tasks.workunit.client.1.smithi176.stdout:6/730: write d2/dd/d26/d2b/f2e [623021,110772] 0 2024-09-21T12:47:05.863 INFO:tasks.workunit.client.1.smithi176.stdout:4/767: creat d3/d42/d56/d4e/df8/f111 x:0 0 0 2024-09-21T12:47:05.864 INFO:tasks.workunit.client.0.smithi046.stdout:6/230: truncate de/f1d 1102628 0 2024-09-21T12:47:05.864 INFO:tasks.workunit.client.1.smithi176.stdout:6/731: chown d2/dd/d26/d2b/d10/d1b/c80 493 1 2024-09-21T12:47:05.865 INFO:tasks.workunit.client.1.smithi176.stdout:6/732: chown d2/dd/f11 124 1 2024-09-21T12:47:05.867 INFO:tasks.workunit.client.0.smithi046.stdout:0/305: symlink d6/d2f/l74 0 2024-09-21T12:47:05.868 INFO:tasks.workunit.client.1.smithi176.stdout:8/737: mkdir d6/db/d13/d98/dde/de5 0 2024-09-21T12:47:05.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/258: sync 2024-09-21T12:47:05.870 INFO:tasks.workunit.client.0.smithi046.stdout:3/215: sync 2024-09-21T12:47:05.870 INFO:tasks.workunit.client.0.smithi046.stdout:9/226: sync 2024-09-21T12:47:05.870 INFO:tasks.workunit.client.0.smithi046.stdout:7/156: sync 2024-09-21T12:47:05.870 INFO:tasks.workunit.client.1.smithi176.stdout:3/894: getdents d1/d34/d57/dd0/d7d/dcc 0 2024-09-21T12:47:05.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/269: mkdir d16/d22/d4e 0 2024-09-21T12:47:05.874 INFO:tasks.workunit.client.0.smithi046.stdout:1/231: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:47:05.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/231: unlink l7 0 2024-09-21T12:47:05.875 INFO:tasks.workunit.client.0.smithi046.stdout:1/232: dread - d4/d4d/f57 zero size 2024-09-21T12:47:05.876 INFO:tasks.workunit.client.1.smithi176.stdout:4/768: mknod d3/d42/d4d/c112 0 2024-09-21T12:47:05.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/232: chown de/c3f 8191254 1 2024-09-21T12:47:05.881 INFO:tasks.workunit.client.0.smithi046.stdout:7/157: dread d2/dd/f1b [0,4194304] 0 2024-09-21T12:47:05.882 INFO:tasks.workunit.client.1.smithi176.stdout:1/783: symlink d0/db/l121 0 2024-09-21T12:47:05.882 INFO:tasks.workunit.client.1.smithi176.stdout:0/884: sync 2024-09-21T12:47:05.883 INFO:tasks.workunit.client.0.smithi046.stdout:5/259: dwrite d4/dc/d13/f41 [0,4194304] 0 2024-09-21T12:47:05.883 INFO:tasks.workunit.client.1.smithi176.stdout:7/905: write d0/d2/f42 [1720980,45796] 0 2024-09-21T12:47:05.884 INFO:tasks.workunit.client.1.smithi176.stdout:1/784: dread - d0/d91/dd3/f101 zero size 2024-09-21T12:47:05.885 INFO:tasks.workunit.client.0.smithi046.stdout:8/261: symlink d1/d12/d46/d35/l5e 0 2024-09-21T12:47:05.887 INFO:tasks.workunit.client.1.smithi176.stdout:6/733: rename d2/dd/d26/cdd to d2/dd/d26/d2b/d68/ce8 0 2024-09-21T12:47:05.890 INFO:tasks.workunit.client.1.smithi176.stdout:5/688: write d0/d13/d63/d8d/ddc/d41/f9d [824064,115503] 0 2024-09-21T12:47:05.890 INFO:tasks.workunit.client.1.smithi176.stdout:7/906: dread d0/d2/db/d10/d23/f8e [0,4194304] 0 2024-09-21T12:47:05.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/279: rename d1/d13/c5a to d1/d13/d25/d29/c5e 0 2024-09-21T12:47:05.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/262: read d1/d12/d1a/d33/f38 [531875,117729] 0 2024-09-21T12:47:05.893 INFO:tasks.workunit.client.1.smithi176.stdout:2/794: dwrite d4/df/df7/fa9 [0,4194304] 0 2024-09-21T12:47:05.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/263: write d1/d12/f5c [402831,65592] 0 2024-09-21T12:47:05.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/264: fsync d1/f1f 0 2024-09-21T12:47:05.895 INFO:tasks.workunit.client.1.smithi176.stdout:3/895: write d1/da/fb [1494359,8906] 0 2024-09-21T12:47:05.899 INFO:tasks.workunit.client.0.smithi046.stdout:2/270: read d16/d22/d2b/d30/f47 [216648,66484] 0 2024-09-21T12:47:05.902 INFO:tasks.workunit.client.0.smithi046.stdout:6/233: fsync fa 0 2024-09-21T12:47:05.904 INFO:tasks.workunit.client.1.smithi176.stdout:8/738: link d6/d16/d36/f9a d6/d8/d54/fe6 0 2024-09-21T12:47:05.905 INFO:tasks.workunit.client.0.smithi046.stdout:5/260: mknod d4/d22/d10/d1a/c4b 0 2024-09-21T12:47:05.905 INFO:tasks.workunit.client.0.smithi046.stdout:5/261: chown d4/d16/l2f 253479902 1 2024-09-21T12:47:05.906 INFO:tasks.workunit.client.1.smithi176.stdout:5/689: creat d0/d13/d63/d72/fde x:0 0 0 2024-09-21T12:47:05.909 INFO:tasks.workunit.client.1.smithi176.stdout:5/690: read d0/d13/d5d/f73 [3706938,22742] 0 2024-09-21T12:47:05.911 INFO:tasks.workunit.client.0.smithi046.stdout:3/216: symlink d5/l4a 0 2024-09-21T12:47:05.911 INFO:tasks.workunit.client.0.smithi046.stdout:3/217: chown d5/d16 96 1 2024-09-21T12:47:05.913 INFO:tasks.workunit.client.0.smithi046.stdout:5/262: dwrite d4/dc/d13/f41 [0,4194304] 0 2024-09-21T12:47:05.919 INFO:tasks.workunit.client.1.smithi176.stdout:0/885: link d9/d1a/d1d/d23/d5f/f89 d9/d1a/d1d/d90/f13b 0 2024-09-21T12:47:05.921 INFO:tasks.workunit.client.1.smithi176.stdout:0/886: dread - d9/f138 zero size 2024-09-21T12:47:05.922 INFO:tasks.workunit.client.1.smithi176.stdout:4/769: dread d3/d42/d56/d101/d107/d36/f43 [0,4194304] 0 2024-09-21T12:47:05.923 INFO:tasks.workunit.client.1.smithi176.stdout:8/739: dread d6/d16/f63 [0,4194304] 0 2024-09-21T12:47:05.923 INFO:tasks.workunit.client.0.smithi046.stdout:8/265: write d1/d12/d1a/d33/f59 [2119027,119827] 0 2024-09-21T12:47:05.924 INFO:tasks.workunit.client.1.smithi176.stdout:0/887: dread - d9/d1a/d1d/d23/da1/da3/d93/df9/d77/f12d zero size 2024-09-21T12:47:05.925 INFO:tasks.workunit.client.1.smithi176.stdout:2/795: write d4/df/d2e/d39/fea [23940,75336] 0 2024-09-21T12:47:05.925 INFO:tasks.workunit.client.0.smithi046.stdout:9/227: creat d11/d19/d36/f42 x:0 0 0 2024-09-21T12:47:05.926 INFO:tasks.workunit.client.1.smithi176.stdout:0/888: dread d9/f2b [0,4194304] 0 2024-09-21T12:47:05.927 INFO:tasks.workunit.client.0.smithi046.stdout:9/228: truncate d11/d19/d36/f42 1029728 0 2024-09-21T12:47:05.927 INFO:tasks.workunit.client.1.smithi176.stdout:7/907: mkdir d0/d2/d30/df4/d121/d141 0 2024-09-21T12:47:05.927 INFO:tasks.workunit.client.0.smithi046.stdout:9/229: stat d11/d19/d1b/d1c 0 2024-09-21T12:47:05.928 INFO:tasks.workunit.client.1.smithi176.stdout:3/896: dread d1/d35/f32 [0,4194304] 0 2024-09-21T12:47:05.928 INFO:tasks.workunit.client.0.smithi046.stdout:1/233: fdatasync d4/d29/d32/f40 0 2024-09-21T12:47:05.929 INFO:tasks.workunit.client.1.smithi176.stdout:5/691: creat d0/d13/d63/d72/fdf x:0 0 0 2024-09-21T12:47:05.929 INFO:tasks.workunit.client.1.smithi176.stdout:7/908: chown d0/d2/db/f26 9 1 2024-09-21T12:47:05.929 INFO:tasks.workunit.client.0.smithi046.stdout:1/234: dread - d4/d13/d38/f58 zero size 2024-09-21T12:47:05.930 INFO:tasks.workunit.client.1.smithi176.stdout:3/897: chown d1/d5/d25/d40/f113 88543051 1 2024-09-21T12:47:05.930 INFO:tasks.workunit.client.0.smithi046.stdout:2/271: creat d16/d22/d38/f4f x:0 0 0 2024-09-21T12:47:05.931 INFO:tasks.workunit.client.1.smithi176.stdout:6/734: creat d2/dd/d26/fe9 x:0 0 0 2024-09-21T12:47:05.931 INFO:tasks.workunit.client.1.smithi176.stdout:9/800: sync 2024-09-21T12:47:05.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/230: dread d11/f16 [0,4194304] 0 2024-09-21T12:47:05.936 INFO:tasks.workunit.client.0.smithi046.stdout:9/231: write d11/d19/d36/f42 [2039805,123152] 0 2024-09-21T12:47:05.937 INFO:tasks.workunit.client.0.smithi046.stdout:4/280: mkdir d1/d5f 0 2024-09-21T12:47:05.937 INFO:tasks.workunit.client.0.smithi046.stdout:2/272: dread d16/d22/d2b/d30/f47 [0,4194304] 0 2024-09-21T12:47:05.938 INFO:tasks.workunit.client.1.smithi176.stdout:1/785: getdents d0/db/d1a/d2c/d48/d108 0 2024-09-21T12:47:05.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/273: chown d16/d22/d4e 2202143 1 2024-09-21T12:47:05.940 INFO:tasks.workunit.client.0.smithi046.stdout:5/263: unlink d4/l14 0 2024-09-21T12:47:05.941 INFO:tasks.workunit.client.0.smithi046.stdout:9/232: dread d11/d19/d1b/f3f [0,4194304] 0 2024-09-21T12:47:05.941 INFO:tasks.workunit.client.0.smithi046.stdout:5/264: dread - d4/dc/d13/f35 zero size 2024-09-21T12:47:05.942 INFO:tasks.workunit.client.1.smithi176.stdout:7/909: rename d0/d2/f5c to d0/d98/de1/f142 0 2024-09-21T12:47:05.945 INFO:tasks.workunit.client.1.smithi176.stdout:3/898: unlink d1/d34/d57/f12f 0 2024-09-21T12:47:05.954 INFO:tasks.workunit.client.1.smithi176.stdout:9/801: unlink d1/df/d48/d69/d40/d84/l9d 0 2024-09-21T12:47:05.956 INFO:tasks.workunit.client.1.smithi176.stdout:2/796: link d4/df/d2e/d6f/d5d/f77 d4/d40/ffa 0 2024-09-21T12:47:05.957 INFO:tasks.workunit.client.1.smithi176.stdout:9/802: dwrite d1/df/d48/f4a [0,4194304] 0 2024-09-21T12:47:05.960 INFO:tasks.workunit.client.1.smithi176.stdout:4/770: dwrite d3/d42/d56/d101/d107/d36/f6e [0,4194304] 0 2024-09-21T12:47:05.964 INFO:tasks.workunit.client.1.smithi176.stdout:4/771: dread d3/fe0 [0,4194304] 0 2024-09-21T12:47:05.965 INFO:tasks.workunit.client.1.smithi176.stdout:4/772: write d3/d42/d56/d4e/df8/f111 [445686,33555] 0 2024-09-21T12:47:05.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/306: getdents d6/d7/d37 0 2024-09-21T12:47:05.968 INFO:tasks.workunit.client.1.smithi176.stdout:6/735: write d2/d63/fa4 [660731,51753] 0 2024-09-21T12:47:05.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/307: read - d6/d7/d13/d43/d52/f5e zero size 2024-09-21T12:47:05.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/308: chown d6/c1e 66861140 1 2024-09-21T12:47:05.974 INFO:tasks.workunit.client.0.smithi046.stdout:6/234: mkdir de/d48 0 2024-09-21T12:47:05.974 INFO:tasks.workunit.client.1.smithi176.stdout:8/740: truncate d6/db/d13/d98/da1/fd8 628857 0 2024-09-21T12:47:05.976 INFO:tasks.workunit.client.1.smithi176.stdout:3/899: truncate d1/f51 1339059 0 2024-09-21T12:47:05.977 INFO:tasks.workunit.client.1.smithi176.stdout:5/692: link d0/d13/d5d/d98/d9b/dad/fbc d0/fe0 0 2024-09-21T12:47:05.982 INFO:tasks.workunit.client.1.smithi176.stdout:9/803: unlink d1/f2a 0 2024-09-21T12:47:05.983 INFO:tasks.workunit.client.0.smithi046.stdout:2/274: mknod d16/d22/d38/c50 0 2024-09-21T12:47:05.983 INFO:tasks.workunit.client.1.smithi176.stdout:1/786: dwrite d0/db/d1a/d2c/d6b/fd5 [0,4194304] 0 2024-09-21T12:47:05.984 INFO:tasks.workunit.client.1.smithi176.stdout:1/787: chown d0/db/d1a/d2c/dc5/d41 5 1 2024-09-21T12:47:05.987 INFO:tasks.workunit.client.0.smithi046.stdout:4/281: dread d1/d13/d25/d29/d33/f41 [0,4194304] 0 2024-09-21T12:47:05.989 INFO:tasks.workunit.client.0.smithi046.stdout:9/233: creat d11/d19/d1b/d31/f43 x:0 0 0 2024-09-21T12:47:05.991 INFO:tasks.workunit.client.1.smithi176.stdout:1/788: dread d0/db/d1a/d2c/d48/d50/f9c [0,4194304] 0 2024-09-21T12:47:05.991 INFO:tasks.workunit.client.1.smithi176.stdout:4/773: mkdir d3/d21/df5/d113 0 2024-09-21T12:47:05.991 INFO:tasks.workunit.client.0.smithi046.stdout:9/234: write d11/d19/d1b/d1c/f2e [2456109,87946] 0 2024-09-21T12:47:05.992 INFO:tasks.workunit.client.0.smithi046.stdout:9/235: fsync d11/d19/f37 0 2024-09-21T12:47:05.993 INFO:tasks.workunit.client.0.smithi046.stdout:9/236: dread - d11/f3c zero size 2024-09-21T12:47:05.994 INFO:tasks.workunit.client.0.smithi046.stdout:3/218: link d5/dc/d26/f27 d5/dc/d26/d3c/d44/f4b 0 2024-09-21T12:47:05.994 INFO:tasks.workunit.client.0.smithi046.stdout:9/237: chown d11/d19/d1b/d1c/l38 7780 1 2024-09-21T12:47:05.996 INFO:tasks.workunit.client.0.smithi046.stdout:1/235: mkdir d4/d13/d38/d53/d5a 0 2024-09-21T12:47:05.997 INFO:tasks.workunit.client.1.smithi176.stdout:8/741: dread d6/d16/d36/d67/f70 [0,4194304] 0 2024-09-21T12:47:05.997 INFO:tasks.workunit.client.1.smithi176.stdout:6/736: unlink d2/dd/d26/d2b/d68/l86 0 2024-09-21T12:47:06.000 INFO:tasks.workunit.client.0.smithi046.stdout:3/219: dwrite d5/fb [0,4194304] 0 2024-09-21T12:47:06.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/158: getdents d2/dd 0 2024-09-21T12:47:06.000 INFO:tasks.workunit.client.1.smithi176.stdout:2/797: dwrite d4/df/d2e/d6f/f2c [4194304,4194304] 0 2024-09-21T12:47:06.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/309: unlink d6/d7/d13/d43/d52/d63/l6a 0 2024-09-21T12:47:06.003 INFO:tasks.workunit.client.1.smithi176.stdout:5/693: write d0/d10/f4c [617552,98744] 0 2024-09-21T12:47:06.004 INFO:tasks.workunit.client.0.smithi046.stdout:6/235: unlink de/c3f 0 2024-09-21T12:47:06.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/310: write d6/d7/d13/f4b [684284,52319] 0 2024-09-21T12:47:06.005 INFO:tasks.workunit.client.1.smithi176.stdout:5/694: write d0/d13/fd1 [319219,91843] 0 2024-09-21T12:47:06.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/311: chown d6/d7/d13/d2a/d31/l30 113635 1 2024-09-21T12:47:06.008 INFO:tasks.workunit.client.0.smithi046.stdout:5/265: mknod d4/dc/c4c 0 2024-09-21T12:47:06.012 INFO:tasks.workunit.client.1.smithi176.stdout:9/804: chown d1/l4c 1501685 1 2024-09-21T12:47:06.012 INFO:tasks.workunit.client.1.smithi176.stdout:0/889: getdents d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88 0 2024-09-21T12:47:06.012 INFO:tasks.workunit.client.1.smithi176.stdout:5/695: dwrite d0/d13/d63/d66/fbe [0,4194304] 0 2024-09-21T12:47:06.017 INFO:tasks.workunit.client.0.smithi046.stdout:1/236: symlink d4/d29/d32/l5b 0 2024-09-21T12:47:06.017 INFO:tasks.workunit.client.0.smithi046.stdout:9/238: read fb [395880,80395] 0 2024-09-21T12:47:06.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/239: read d11/d19/d1b/f25 [810047,17056] 0 2024-09-21T12:47:06.021 INFO:tasks.workunit.client.1.smithi176.stdout:6/737: symlink d2/d6f/d7f/lea 0 2024-09-21T12:47:06.021 INFO:tasks.workunit.client.0.smithi046.stdout:3/220: rmdir d5/d16 39 2024-09-21T12:47:06.022 INFO:tasks.workunit.client.1.smithi176.stdout:5/696: dwrite d0/d13/d63/d72/fdf [0,4194304] 0 2024-09-21T12:47:06.024 INFO:tasks.workunit.client.0.smithi046.stdout:6/236: read de/f13 [2618389,73144] 0 2024-09-21T12:47:06.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/312: symlink d6/d7/d13/d2a/d31/l75 0 2024-09-21T12:47:06.030 INFO:tasks.workunit.client.0.smithi046.stdout:0/313: fsync d6/d7/d13/d2a/f44 0 2024-09-21T12:47:06.036 INFO:tasks.workunit.client.0.smithi046.stdout:1/237: creat d4/d13/d38/d48/f5c x:0 0 0 2024-09-21T12:47:06.040 INFO:tasks.workunit.client.0.smithi046.stdout:9/240: dread d11/d19/d1b/f3f [0,4194304] 0 2024-09-21T12:47:06.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/159: creat d2/d4/f33 x:0 0 0 2024-09-21T12:47:06.042 INFO:tasks.workunit.client.1.smithi176.stdout:1/789: write d0/db/d1a/d2c/dc5/d41/d59/fc0 [1519998,41630] 0 2024-09-21T12:47:06.043 INFO:tasks.workunit.client.0.smithi046.stdout:9/241: write d11/f3c [662952,129768] 0 2024-09-21T12:47:06.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/282: dwrite d1/d13/d25/d3a/f3c [0,4194304] 0 2024-09-21T12:47:06.046 INFO:tasks.workunit.client.1.smithi176.stdout:2/798: symlink d4/df/d2e/d6f/d5d/d67/dd6/lfb 0 2024-09-21T12:47:06.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/237: creat de/d2a/f49 x:0 0 0 2024-09-21T12:47:06.048 INFO:tasks.workunit.client.1.smithi176.stdout:2/799: write d4/df/d2e/d39/f66 [1068263,67150] 0 2024-09-21T12:47:06.049 INFO:tasks.workunit.client.0.smithi046.stdout:2/275: creat d16/d22/d2b/f51 x:0 0 0 2024-09-21T12:47:06.050 INFO:tasks.workunit.client.1.smithi176.stdout:2/800: read - d4/df/d2e/d6f/d6d/fe2 zero size 2024-09-21T12:47:06.051 INFO:tasks.workunit.client.1.smithi176.stdout:2/801: chown f2 11048690 1 2024-09-21T12:47:06.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/276: fsync d16/d22/f41 0 2024-09-21T12:47:06.052 INFO:tasks.workunit.client.1.smithi176.stdout:9/805: write d1/d61/d73/ffe [3176662,13511] 0 2024-09-21T12:47:06.054 INFO:tasks.workunit.client.1.smithi176.stdout:6/738: mknod d2/dd/d26/ceb 0 2024-09-21T12:47:06.054 INFO:tasks.workunit.client.1.smithi176.stdout:8/742: dwrite d6/fa [0,4194304] 0 2024-09-21T12:47:06.056 INFO:tasks.workunit.client.0.smithi046.stdout:9/242: dwrite d11/d19/d1b/d1c/f2e [0,4194304] 0 2024-09-21T12:47:06.056 INFO:tasks.workunit.client.1.smithi176.stdout:7/910: getdents d0/d2/d30/d93 0 2024-09-21T12:47:06.056 INFO:tasks.workunit.client.1.smithi176.stdout:0/890: dread d9/d1a/d1d/d23/da1/da3/d93/df9/d77/fb6 [0,4194304] 0 2024-09-21T12:47:06.057 INFO:tasks.workunit.client.0.smithi046.stdout:2/277: write d16/d22/d38/f42 [111234,130883] 0 2024-09-21T12:47:06.057 INFO:tasks.workunit.client.1.smithi176.stdout:6/739: fdatasync d2/dd/d26/d2b/d10/f12 0 2024-09-21T12:47:06.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/278: fdatasync fc 0 2024-09-21T12:47:06.059 INFO:tasks.workunit.client.1.smithi176.stdout:1/790: mkdir d0/db/d1a/d2c/dc5/d2b/d43/d122 0 2024-09-21T12:47:06.062 INFO:tasks.workunit.client.0.smithi046.stdout:3/221: dread f2 [0,4194304] 0 2024-09-21T12:47:06.063 INFO:tasks.workunit.client.1.smithi176.stdout:1/791: chown d0/db/d1a/d2c/dc5/d41/d59/ce0 894465 1 2024-09-21T12:47:06.063 INFO:tasks.workunit.client.1.smithi176.stdout:5/697: write d0/d10/f36 [777460,31620] 0 2024-09-21T12:47:06.067 INFO:tasks.workunit.client.1.smithi176.stdout:2/802: rename d4/df/d2e/d6f/d5d/d81/l8c to d4/d63/lfc 0 2024-09-21T12:47:06.068 INFO:tasks.workunit.client.1.smithi176.stdout:1/792: chown d0/db/d1a/f8a 24850 1 2024-09-21T12:47:06.069 INFO:tasks.workunit.client.1.smithi176.stdout:8/743: dwrite d6/d8/f10 [0,4194304] 0 2024-09-21T12:47:06.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/283: symlink d1/d13/d25/d3a/l60 0 2024-09-21T12:47:06.070 INFO:tasks.workunit.client.1.smithi176.stdout:1/793: read d0/db/f1f [1774100,21828] 0 2024-09-21T12:47:06.070 INFO:tasks.workunit.client.0.smithi046.stdout:7/160: dwrite d2/d4/f8 [0,4194304] 0 2024-09-21T12:47:06.071 INFO:tasks.workunit.client.0.smithi046.stdout:7/161: chown d2/f32 160 1 2024-09-21T12:47:06.073 INFO:tasks.workunit.client.0.smithi046.stdout:5/266: rename d4/c25 to d4/c4d 0 2024-09-21T12:47:06.074 INFO:tasks.workunit.client.0.smithi046.stdout:1/238: mkdir d4/d13/d38/d53/d5a/d5d 0 2024-09-21T12:47:06.075 INFO:tasks.workunit.client.1.smithi176.stdout:3/900: sync 2024-09-21T12:47:06.075 INFO:tasks.workunit.client.1.smithi176.stdout:4/774: sync 2024-09-21T12:47:06.076 INFO:tasks.workunit.client.1.smithi176.stdout:5/698: chown d0/d10/l22 123797 1 2024-09-21T12:47:06.079 INFO:tasks.workunit.client.1.smithi176.stdout:4/775: readlink d3/d42/dae/l10d 0 2024-09-21T12:47:06.084 INFO:tasks.workunit.client.0.smithi046.stdout:0/314: creat d6/d7/d13/f76 x:0 0 0 2024-09-21T12:47:06.084 INFO:tasks.workunit.client.1.smithi176.stdout:1/794: dwrite d0/db/d1a/d2c/d6b/fd5 [0,4194304] 0 2024-09-21T12:47:06.087 INFO:tasks.workunit.client.1.smithi176.stdout:3/901: unlink d1/d34/d48/deb/f7f 0 2024-09-21T12:47:06.087 INFO:tasks.workunit.client.0.smithi046.stdout:7/162: fdatasync d2/dd/f2b 0 2024-09-21T12:47:06.088 INFO:tasks.workunit.client.1.smithi176.stdout:6/740: dwrite d2/dd/d26/d2b/d10/d1b/d37/f4f [4194304,4194304] 0 2024-09-21T12:47:06.090 INFO:tasks.workunit.client.1.smithi176.stdout:5/699: mkdir d0/d13/d5d/d98/da5/de1 0 2024-09-21T12:47:06.095 INFO:tasks.workunit.client.1.smithi176.stdout:8/744: mkdir d6/de7 0 2024-09-21T12:47:06.095 INFO:tasks.workunit.client.1.smithi176.stdout:1/795: creat d0/d91/f123 x:0 0 0 2024-09-21T12:47:06.098 INFO:tasks.workunit.client.1.smithi176.stdout:8/745: chown d6/d8/d24/c46 1 1 2024-09-21T12:47:06.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/238: link fa de/d48/f4a 0 2024-09-21T12:47:06.099 INFO:tasks.workunit.client.1.smithi176.stdout:6/741: dwrite d2/d6f/fbb [0,4194304] 0 2024-09-21T12:47:06.099 INFO:tasks.workunit.client.1.smithi176.stdout:3/902: dread d1/d34/d48/fa4 [0,4194304] 0 2024-09-21T12:47:06.101 INFO:tasks.workunit.client.1.smithi176.stdout:6/742: chown d2/dd/d79/fdc 677982710 1 2024-09-21T12:47:06.101 INFO:tasks.workunit.client.1.smithi176.stdout:3/903: chown d1/d34/d71/d91/df6/fff 61940778 1 2024-09-21T12:47:06.102 INFO:tasks.workunit.client.1.smithi176.stdout:7/911: getdents d0/d98/de1 0 2024-09-21T12:47:06.104 INFO:tasks.workunit.client.0.smithi046.stdout:5/267: symlink d4/dc/d28/d2d/d43/l4e 0 2024-09-21T12:47:06.105 INFO:tasks.workunit.client.1.smithi176.stdout:0/891: dread d9/d1a/d1d/d23/f5b [0,4194304] 0 2024-09-21T12:47:06.105 INFO:tasks.workunit.client.1.smithi176.stdout:1/796: creat d0/d91/db1/f124 x:0 0 0 2024-09-21T12:47:06.108 INFO:tasks.workunit.client.1.smithi176.stdout:0/892: fdatasync d9/d1a/d1d/d23/da1/db0/f119 0 2024-09-21T12:47:06.111 INFO:tasks.workunit.client.1.smithi176.stdout:5/700: creat d0/d13/d63/d2e/dda/fe2 x:0 0 0 2024-09-21T12:47:06.111 INFO:tasks.workunit.client.1.smithi176.stdout:8/746: mkdir d6/d8/d24/d5e/de8 0 2024-09-21T12:47:06.112 INFO:tasks.workunit.client.1.smithi176.stdout:2/803: write d4/df/d2e/d6f/d6d/f71 [992264,85570] 0 2024-09-21T12:47:06.114 INFO:tasks.workunit.client.0.smithi046.stdout:2/279: dwrite f15 [0,4194304] 0 2024-09-21T12:47:06.115 INFO:tasks.workunit.client.1.smithi176.stdout:7/912: truncate d0/d2/db/d10/d5a/fbc 4869684 0 2024-09-21T12:47:06.115 INFO:tasks.workunit.client.0.smithi046.stdout:4/284: write d1/d13/d25/d29/f2f [5079081,48585] 0 2024-09-21T12:47:06.117 INFO:tasks.workunit.client.1.smithi176.stdout:9/806: dwrite d1/f5d [0,4194304] 0 2024-09-21T12:47:06.118 INFO:tasks.workunit.client.1.smithi176.stdout:9/807: fsync d1/d8b/faf 0 2024-09-21T12:47:06.118 INFO:tasks.workunit.client.0.smithi046.stdout:3/222: dwrite d5/dc/d26/d3c/d44/f4b [0,4194304] 0 2024-09-21T12:47:06.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/239: getdents d4/d29/d32 0 2024-09-21T12:47:06.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/239: dread de/d48/f4a [0,4194304] 0 2024-09-21T12:47:06.123 INFO:tasks.workunit.client.1.smithi176.stdout:0/893: stat d9/d35/c36 0 2024-09-21T12:47:06.126 INFO:tasks.workunit.client.1.smithi176.stdout:3/904: mkdir d1/d3e/d14b 0 2024-09-21T12:47:06.128 INFO:tasks.workunit.client.0.smithi046.stdout:2/280: dwrite fc [0,4194304] 0 2024-09-21T12:47:06.129 INFO:tasks.workunit.client.0.smithi046.stdout:7/163: getdents d2/d4 0 2024-09-21T12:47:06.134 INFO:tasks.workunit.client.1.smithi176.stdout:2/804: mkdir d4/df/d2e/d39/db7/d80/dda/dfd 0 2024-09-21T12:47:06.135 INFO:tasks.workunit.client.0.smithi046.stdout:3/223: unlink d5/dc/d30/c3e 0 2024-09-21T12:47:06.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/243: dwrite d11/d19/f24 [0,4194304] 0 2024-09-21T12:47:06.135 INFO:tasks.workunit.client.0.smithi046.stdout:7/164: chown d2/d4/df/d17/d31 1203 1 2024-09-21T12:47:06.135 INFO:tasks.workunit.client.0.smithi046.stdout:5/268: rename d4/f2e to d4/dc/d28/d2d/f4f 0 2024-09-21T12:47:06.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/269: stat d4/d22 0 2024-09-21T12:47:06.142 INFO:tasks.workunit.client.1.smithi176.stdout:9/808: unlink d1/df/f41 0 2024-09-21T12:47:06.143 INFO:tasks.workunit.client.0.smithi046.stdout:7/165: dread d2/d4/f1c [0,4194304] 0 2024-09-21T12:47:06.145 INFO:tasks.workunit.client.1.smithi176.stdout:0/894: mknod d9/d1a/d1d/d23/da1/da3/d93/d9f/c13c 0 2024-09-21T12:47:06.145 INFO:tasks.workunit.client.0.smithi046.stdout:5/270: dwrite d4/f8 [0,4194304] 0 2024-09-21T12:47:06.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/166: dread d2/dd/f1b [0,4194304] 0 2024-09-21T12:47:06.147 INFO:tasks.workunit.client.0.smithi046.stdout:3/224: fsync d5/d16/f42 0 2024-09-21T12:47:06.148 INFO:tasks.workunit.client.0.smithi046.stdout:7/167: fdatasync d2/d4/df/f1d 0 2024-09-21T12:47:06.149 INFO:tasks.workunit.client.1.smithi176.stdout:8/747: symlink d6/db/d37/d89/d8a/dd4/le9 0 2024-09-21T12:47:06.150 INFO:tasks.workunit.client.0.smithi046.stdout:9/244: mkdir d11/d19/d1b/d31/d44 0 2024-09-21T12:47:06.152 INFO:tasks.workunit.client.1.smithi176.stdout:2/805: creat d4/df/d2e/d6f/d5d/ffe x:0 0 0 2024-09-21T12:47:06.154 INFO:tasks.workunit.client.0.smithi046.stdout:1/240: link d4/d13/f2e d4/d13/d38/d4f/f5e 0 2024-09-21T12:47:06.155 INFO:tasks.workunit.client.1.smithi176.stdout:2/806: write d4/df/d2e/d6f/d5d/d67/fc3 [693656,95068] 0 2024-09-21T12:47:06.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/285: creat d1/d27/f61 x:0 0 0 2024-09-21T12:47:06.158 INFO:tasks.workunit.client.1.smithi176.stdout:7/913: symlink d0/d2/db/d10/l143 0 2024-09-21T12:47:06.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/286: fsync d1/d27/d58/f53 0 2024-09-21T12:47:06.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 72 MiB/s rd, 277 MiB/s wr, 497 op/s 2024-09-21T12:47:06.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: Upgrade: Updating mgr.smithi046.vedsjs 2024-09-21T12:47:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.vedsjs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:47:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.vedsjs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:47:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:47:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:47:06.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:05 smithi046 ceph-mon[27868]: Deploying daemon mgr.smithi046.vedsjs on smithi046 2024-09-21T12:47:06.163 INFO:tasks.workunit.client.0.smithi046.stdout:1/241: dwrite d4/d13/d38/f3b [0,4194304] 0 2024-09-21T12:47:06.164 INFO:tasks.workunit.client.1.smithi176.stdout:6/743: rename d2/dd/c40 to d2/cec 0 2024-09-21T12:47:06.165 INFO:tasks.workunit.client.1.smithi176.stdout:0/895: rmdir d9/d1a/d1d/d23/da1/da3/d8f/d91/dbd 39 2024-09-21T12:47:06.166 INFO:tasks.workunit.client.1.smithi176.stdout:1/797: write d0/db/d6a/f9d [158960,4533] 0 2024-09-21T12:47:06.167 INFO:tasks.workunit.client.1.smithi176.stdout:1/798: stat d0/db/d1a/d2c/d66/ca5 0 2024-09-21T12:47:06.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/168: write d2/fa [1283949,29448] 0 2024-09-21T12:47:06.172 INFO:tasks.workunit.client.0.smithi046.stdout:7/169: dread - d2/d4/df/d17/f30 zero size 2024-09-21T12:47:06.173 INFO:tasks.workunit.client.0.smithi046.stdout:3/225: creat d5/dc/d26/f4c x:0 0 0 2024-09-21T12:47:06.173 INFO:tasks.workunit.client.1.smithi176.stdout:0/896: dwrite d9/f14 [0,4194304] 0 2024-09-21T12:47:06.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/170: chown d2/d4/df/l1a 103 1 2024-09-21T12:47:06.175 INFO:tasks.workunit.client.1.smithi176.stdout:2/807: symlink d4/d40/lff 0 2024-09-21T12:47:06.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/226: truncate d5/dc/d26/f3d 296324 0 2024-09-21T12:47:06.179 INFO:tasks.workunit.client.1.smithi176.stdout:9/809: mknod d1/df/d23/dcf/ddd/de5/c111 0 2024-09-21T12:47:06.182 INFO:tasks.workunit.client.0.smithi046.stdout:7/171: dwrite d2/d4/df/f1d [0,4194304] 0 2024-09-21T12:47:06.185 INFO:tasks.workunit.client.1.smithi176.stdout:8/748: dread d6/d16/d79/fd6 [0,4194304] 0 2024-09-21T12:47:06.186 INFO:tasks.workunit.client.0.smithi046.stdout:1/242: unlink d4/d13/c47 0 2024-09-21T12:47:06.187 INFO:tasks.workunit.client.1.smithi176.stdout:3/905: link d1/d34/d71/d91/df6/d11f/d138/c142 d1/d34/d71/c14c 0 2024-09-21T12:47:06.187 INFO:tasks.workunit.client.0.smithi046.stdout:1/243: readlink d4/d29/d32/l5b 0 2024-09-21T12:47:06.187 INFO:tasks.workunit.client.0.smithi046.stdout:6/240: dwrite de/f26 [4194304,4194304] 0 2024-09-21T12:47:06.189 INFO:tasks.workunit.client.0.smithi046.stdout:2/281: write d16/d22/f29 [230389,14707] 0 2024-09-21T12:47:06.193 INFO:tasks.workunit.client.0.smithi046.stdout:3/227: mkdir d5/dc/d30/d4d 0 2024-09-21T12:47:06.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/241: dwrite de/d35/f43 [0,4194304] 0 2024-09-21T12:47:06.196 INFO:tasks.workunit.client.0.smithi046.stdout:9/245: fdatasync d11/d19/f24 0 2024-09-21T12:47:06.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/287: link d1/f57 d1/d13/d25/d29/d33/f62 0 2024-09-21T12:47:06.199 INFO:tasks.workunit.client.1.smithi176.stdout:0/897: symlink d9/d1a/d1d/d23/da1/da3/d93/df9/d75/l13d 0 2024-09-21T12:47:06.200 INFO:tasks.workunit.client.0.smithi046.stdout:5/271: creat d4/dc/d13/f50 x:0 0 0 2024-09-21T12:47:06.200 INFO:tasks.workunit.client.1.smithi176.stdout:2/808: fdatasync d4/df/d2e/d6f/d5d/f77 0 2024-09-21T12:47:06.202 INFO:tasks.workunit.client.1.smithi176.stdout:0/898: write d9/d1a/d1d/d23/da1/da3/d8f/dd8/fe6 [2103379,106544] 0 2024-09-21T12:47:06.203 INFO:tasks.workunit.client.1.smithi176.stdout:9/810: fsync d1/f71 0 2024-09-21T12:47:06.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/244: symlink d4/d13/d38/d4f/l5f 0 2024-09-21T12:47:06.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/288: dwrite d1/f5d [0,4194304] 0 2024-09-21T12:47:06.210 INFO:tasks.workunit.client.1.smithi176.stdout:8/749: dwrite d6/d8/f2a [0,4194304] 0 2024-09-21T12:47:06.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/289: fdatasync d1/f39 0 2024-09-21T12:47:06.213 INFO:tasks.workunit.client.0.smithi046.stdout:7/172: dread d2/f3 [4194304,4194304] 0 2024-09-21T12:47:06.214 INFO:tasks.workunit.client.1.smithi176.stdout:5/701: truncate d0/d10/d70/f8b 169205 0 2024-09-21T12:47:06.219 INFO:tasks.workunit.client.1.smithi176.stdout:0/899: mknod d9/d1a/d1d/d23/da1/da3/d1e/de1/de3/c13e 0 2024-09-21T12:47:06.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/272: dread d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:06.221 INFO:tasks.workunit.client.1.smithi176.stdout:0/900: read d9/d1a/d1d/d90/f13b [1322297,58126] 0 2024-09-21T12:47:06.222 INFO:tasks.workunit.client.1.smithi176.stdout:0/901: write d9/d1a/d1d/d23/da1/da3/f97 [5432312,17602] 0 2024-09-21T12:47:06.222 INFO:tasks.workunit.client.1.smithi176.stdout:4/776: sync 2024-09-21T12:47:06.227 INFO:tasks.workunit.client.0.smithi046.stdout:5/273: dwrite d4/dc/d28/d2d/d43/f48 [0,4194304] 0 2024-09-21T12:47:06.274 INFO:tasks.workunit.client.1.smithi176.stdout:1/799: rename d0/db/d1a/d2c/d66/feb to d0/db/d1a/d2c/d48/f125 0 2024-09-21T12:47:06.275 INFO:tasks.workunit.client.1.smithi176.stdout:2/809: rename d4/df/d2e to d4/df/d2e/d39/db7/d100 22 2024-09-21T12:47:06.276 INFO:tasks.workunit.client.1.smithi176.stdout:1/800: read d0/d5b/fc2 [38941,126024] 0 2024-09-21T12:47:06.276 INFO:tasks.workunit.client.1.smithi176.stdout:2/810: write d4/df/d2e/d6f/d5d/d67/fc3 [312733,99143] 0 2024-09-21T12:47:06.277 INFO:tasks.workunit.client.1.smithi176.stdout:5/702: creat d0/d13/d63/d8d/daf/fe3 x:0 0 0 2024-09-21T12:47:06.283 INFO:tasks.workunit.client.1.smithi176.stdout:9/811: mknod d1/df/d48/d69/d76/d7c/d9e/c112 0 2024-09-21T12:47:06.284 INFO:tasks.workunit.client.1.smithi176.stdout:9/812: readlink d1/df/d23/l25 0 2024-09-21T12:47:06.285 INFO:tasks.workunit.client.0.smithi046.stdout:4/290: fsync d1/d13/d25/d29/f42 0 2024-09-21T12:47:06.285 INFO:tasks.workunit.client.1.smithi176.stdout:6/744: dwrite d2/dd/d26/d2b/f92 [0,4194304] 0 2024-09-21T12:47:06.285 INFO:tasks.workunit.client.0.smithi046.stdout:4/291: write d1/d13/d25/f1e [1913649,90058] 0 2024-09-21T12:47:06.287 INFO:tasks.workunit.client.0.smithi046.stdout:4/292: read d1/d13/d25/f19 [2445055,118894] 0 2024-09-21T12:47:06.288 INFO:tasks.workunit.client.1.smithi176.stdout:8/750: mknod d6/d8/d24/d5e/de8/cea 0 2024-09-21T12:47:06.290 INFO:tasks.workunit.client.1.smithi176.stdout:6/745: dread d2/dd/d26/d2b/d10/f12 [0,4194304] 0 2024-09-21T12:47:06.290 INFO:tasks.workunit.client.1.smithi176.stdout:7/914: sync 2024-09-21T12:47:06.291 INFO:tasks.workunit.client.1.smithi176.stdout:4/777: rename d3/d5/lef to d3/d42/d4d/l114 0 2024-09-21T12:47:06.292 INFO:tasks.workunit.client.1.smithi176.stdout:7/915: write d0/d5d/f12f [1460163,46504] 0 2024-09-21T12:47:06.294 INFO:tasks.workunit.client.1.smithi176.stdout:5/703: symlink d0/d13/d63/d2e/le4 0 2024-09-21T12:47:06.295 INFO:tasks.workunit.client.1.smithi176.stdout:5/704: dread - d0/d13/d63/d2e/fc1 zero size 2024-09-21T12:47:06.296 INFO:tasks.workunit.client.0.smithi046.stdout:9/246: write d11/d19/d1b/f3f [1731089,118507] 0 2024-09-21T12:47:06.298 INFO:tasks.workunit.client.1.smithi176.stdout:7/916: dwrite d0/d2/f42 [0,4194304] 0 2024-09-21T12:47:06.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/228: rmdir d5/dc/d30/d4d 0 2024-09-21T12:47:06.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/245: creat d4/d13/d38/d53/d5a/d5d/f60 x:0 0 0 2024-09-21T12:47:06.302 INFO:tasks.workunit.client.0.smithi046.stdout:1/246: chown d4/d13/f19 605 1 2024-09-21T12:47:06.303 INFO:tasks.workunit.client.1.smithi176.stdout:9/813: creat d1/df/d9a/dbc/f113 x:0 0 0 2024-09-21T12:47:06.304 INFO:tasks.workunit.client.1.smithi176.stdout:9/814: chown d1/d61/d73/ca2 0 1 2024-09-21T12:47:06.304 INFO:tasks.workunit.client.0.smithi046.stdout:6/242: creat de/f4b x:0 0 0 2024-09-21T12:47:06.308 INFO:tasks.workunit.client.0.smithi046.stdout:4/293: creat d1/d27/d37/f63 x:0 0 0 2024-09-21T12:47:06.308 INFO:tasks.workunit.client.1.smithi176.stdout:0/902: sync 2024-09-21T12:47:06.309 INFO:tasks.workunit.client.1.smithi176.stdout:3/906: sync 2024-09-21T12:47:06.310 INFO:tasks.workunit.client.1.smithi176.stdout:0/903: write d9/d1a/d3f/d10d/dcc/f134 [434883,81536] 0 2024-09-21T12:47:06.311 INFO:tasks.workunit.client.1.smithi176.stdout:0/904: chown d9/d1a/d1d/d23/c2f 1260829 1 2024-09-21T12:47:06.313 INFO:tasks.workunit.client.1.smithi176.stdout:6/746: rename d2/dd/d26/d2b/d10/d1b/d37/l6d to d2/dd/d26/d2b/d10/d1b/d7b/led 0 2024-09-21T12:47:06.314 INFO:tasks.workunit.client.0.smithi046.stdout:2/282: link d16/d22/d2b/d30/c3f d16/d22/d2b/c52 0 2024-09-21T12:47:06.314 INFO:tasks.workunit.client.0.smithi046.stdout:4/294: dwrite d1/d27/d58/f5c [0,4194304] 0 2024-09-21T12:47:06.315 INFO:tasks.workunit.client.1.smithi176.stdout:1/801: mkdir d0/db/d1a/d2c/dc5/d41/d59/d99/d126 0 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: pgmap v29: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 72 MiB/s rd, 277 MiB/s wr, 497 op/s 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: Upgrade: Updating mgr.smithi046.vedsjs 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.vedsjs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi046.vedsjs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:47:06.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:47:06.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:05 smithi176 ceph-mon[35476]: Deploying daemon mgr.smithi046.vedsjs on smithi046 2024-09-21T12:47:06.317 INFO:tasks.workunit.client.0.smithi046.stdout:9/247: mkdir d11/d19/d36/d45 0 2024-09-21T12:47:06.319 INFO:tasks.workunit.client.0.smithi046.stdout:9/248: write d11/d19/d36/f42 [407825,78628] 0 2024-09-21T12:47:06.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/249: fdatasync d11/f3c 0 2024-09-21T12:47:06.323 INFO:tasks.workunit.client.0.smithi046.stdout:1/247: write d4/d13/f1c [3192918,70982] 0 2024-09-21T12:47:06.324 INFO:tasks.workunit.client.1.smithi176.stdout:7/917: fdatasync d0/d2/db/d10/d23/da6/d105/f119 0 2024-09-21T12:47:06.325 INFO:tasks.workunit.client.0.smithi046.stdout:6/243: chown l4 31030789 1 2024-09-21T12:47:06.328 INFO:tasks.workunit.client.1.smithi176.stdout:9/815: rmdir d1/df/d23/dcf/ddd 39 2024-09-21T12:47:06.330 INFO:tasks.workunit.client.0.smithi046.stdout:5/274: link d4/dc/d28/d2d/d43/f48 d4/dc/d13/d15/f51 0 2024-09-21T12:47:06.331 INFO:tasks.workunit.client.1.smithi176.stdout:8/751: mknod d6/db/d13/d98/dde/de5/ceb 0 2024-09-21T12:47:06.333 INFO:tasks.workunit.client.0.smithi046.stdout:6/244: dwrite de/f32 [0,4194304] 0 2024-09-21T12:47:06.333 INFO:tasks.workunit.client.1.smithi176.stdout:3/907: chown d1/f39 35839 1 2024-09-21T12:47:06.334 INFO:tasks.workunit.client.0.smithi046.stdout:3/229: dread d5/d16/f1e [0,4194304] 0 2024-09-21T12:47:06.336 INFO:tasks.workunit.client.1.smithi176.stdout:4/778: write d3/d42/d47/d5c/f94 [1588177,61341] 0 2024-09-21T12:47:06.336 INFO:tasks.workunit.client.0.smithi046.stdout:2/283: chown d16/f20 1 1 2024-09-21T12:47:06.336 INFO:tasks.workunit.client.0.smithi046.stdout:4/295: rmdir d1/d13/d25/d29/d43 39 2024-09-21T12:47:06.339 INFO:tasks.workunit.client.0.smithi046.stdout:2/284: write d16/f1a [6760038,50661] 0 2024-09-21T12:47:06.344 INFO:tasks.workunit.client.0.smithi046.stdout:6/245: dwrite de/f39 [0,4194304] 0 2024-09-21T12:47:06.345 INFO:tasks.workunit.client.1.smithi176.stdout:2/811: truncate d4/df/d2e/d39/fea 282545 0 2024-09-21T12:47:06.346 INFO:tasks.workunit.client.0.smithi046.stdout:3/230: dread d5/dc/d26/f27 [0,4194304] 0 2024-09-21T12:47:06.348 INFO:tasks.workunit.client.1.smithi176.stdout:5/705: dwrite d0/d13/f26 [4194304,4194304] 0 2024-09-21T12:47:06.348 INFO:tasks.workunit.client.0.smithi046.stdout:7/173: truncate d2/fe 3705370 0 2024-09-21T12:47:06.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/250: write d11/d19/d1b/f25 [1555676,113303] 0 2024-09-21T12:47:06.350 INFO:tasks.workunit.client.0.smithi046.stdout:3/231: read - d5/dc/d26/f4c zero size 2024-09-21T12:47:06.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/248: rmdir d4/d29 39 2024-09-21T12:47:06.355 INFO:tasks.workunit.client.1.smithi176.stdout:0/905: write d9/d1a/d1d/d23/fb4 [201603,68961] 0 2024-09-21T12:47:06.355 INFO:tasks.workunit.client.0.smithi046.stdout:6/246: dwrite de/d35/f43 [0,4194304] 0 2024-09-21T12:47:06.356 INFO:tasks.workunit.client.1.smithi176.stdout:9/816: rmdir d1/df/d48/d69/d40 39 2024-09-21T12:47:06.357 INFO:tasks.workunit.client.1.smithi176.stdout:9/817: chown d1/l4c 13362 1 2024-09-21T12:47:06.358 INFO:tasks.workunit.client.1.smithi176.stdout:6/747: write d2/dd/d79/f91 [915573,119548] 0 2024-09-21T12:47:06.359 INFO:tasks.workunit.client.0.smithi046.stdout:6/247: write de/f26 [184713,123] 0 2024-09-21T12:47:06.362 INFO:tasks.workunit.client.0.smithi046.stdout:9/251: dwrite d11/f12 [0,4194304] 0 2024-09-21T12:47:06.362 INFO:tasks.workunit.client.1.smithi176.stdout:3/908: creat d1/d5/d25/d61/dc3/f14d x:0 0 0 2024-09-21T12:47:06.365 INFO:tasks.workunit.client.0.smithi046.stdout:6/248: dread fa [0,4194304] 0 2024-09-21T12:47:06.368 INFO:tasks.workunit.client.1.smithi176.stdout:2/812: mknod d4/df/d83/d8e/c101 0 2024-09-21T12:47:06.369 INFO:tasks.workunit.client.1.smithi176.stdout:2/813: write d4/df/d2e/fec [742362,108603] 0 2024-09-21T12:47:06.371 INFO:tasks.workunit.client.1.smithi176.stdout:2/814: dread - d4/df/d2e/d6f/d5d/d67/d9f/fe0 zero size 2024-09-21T12:47:06.372 INFO:tasks.workunit.client.1.smithi176.stdout:2/815: fdatasync d4/df/d2e/d6f/fed 0 2024-09-21T12:47:06.373 INFO:tasks.workunit.client.1.smithi176.stdout:0/906: creat d9/d1a/d20/f13f x:0 0 0 2024-09-21T12:47:06.374 INFO:tasks.workunit.client.1.smithi176.stdout:2/816: write d4/df/d2e/d6f/d5d/d81/dd9/fac [3180412,15961] 0 2024-09-21T12:47:06.374 INFO:tasks.workunit.client.0.smithi046.stdout:3/232: creat d5/dc/d26/d3c/f4e x:0 0 0 2024-09-21T12:47:06.375 INFO:tasks.workunit.client.1.smithi176.stdout:2/817: fdatasync d4/df/d2e/d39/db7/d80/fce 0 2024-09-21T12:47:06.376 INFO:tasks.workunit.client.0.smithi046.stdout:3/233: chown d5/dc/l32 96799 1 2024-09-21T12:47:06.376 INFO:tasks.workunit.client.1.smithi176.stdout:9/818: symlink d1/df/d48/d69/d4d/l114 0 2024-09-21T12:47:06.377 INFO:tasks.workunit.client.1.smithi176.stdout:5/706: dread d0/d13/d5d/f73 [4194304,4194304] 0 2024-09-21T12:47:06.378 INFO:tasks.workunit.client.0.smithi046.stdout:3/234: dread d5/d16/f1e [0,4194304] 0 2024-09-21T12:47:06.378 INFO:tasks.workunit.client.1.smithi176.stdout:5/707: write d0/d13/d63/d66/fbe [734767,38647] 0 2024-09-21T12:47:06.381 INFO:tasks.workunit.client.0.smithi046.stdout:5/275: truncate d4/fa 1113464 0 2024-09-21T12:47:06.381 INFO:tasks.workunit.client.0.smithi046.stdout:9/252: mknod d11/d19/d1b/d31/c46 0 2024-09-21T12:47:06.383 INFO:tasks.workunit.client.1.smithi176.stdout:1/802: rename d0/db/d1a/d2c/dc5/d2b/l8f to d0/db/d1a/d2c/dc5/l127 0 2024-09-21T12:47:06.385 INFO:tasks.workunit.client.1.smithi176.stdout:7/918: creat d0/d2/d30/d93/d96/f144 x:0 0 0 2024-09-21T12:47:06.386 INFO:tasks.workunit.client.0.smithi046.stdout:4/296: mknod d1/d5f/c64 0 2024-09-21T12:47:06.386 INFO:tasks.workunit.client.1.smithi176.stdout:1/803: truncate d0/db/d1a/d2c/dc5/d41/d59/d99/db3/fe6 446950 0 2024-09-21T12:47:06.387 INFO:tasks.workunit.client.1.smithi176.stdout:1/804: chown d0/db/d1a/f38 65280 1 2024-09-21T12:47:06.388 INFO:tasks.workunit.client.1.smithi176.stdout:1/805: readlink d0/db/le5 0 2024-09-21T12:47:06.388 INFO:tasks.workunit.client.0.smithi046.stdout:9/253: dwrite f2 [4194304,4194304] 0 2024-09-21T12:47:06.388 INFO:tasks.workunit.client.1.smithi176.stdout:1/806: stat d0/db/d1a/d2c/d48/d108 0 2024-09-21T12:47:06.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/254: fsync d11/d19/d20/d26/f27 0 2024-09-21T12:47:06.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/249: fsync de/f46 0 2024-09-21T12:47:06.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/250: chown de/f46 3179 1 2024-09-21T12:47:06.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/174: mkdir d2/d4/df/d17/d31/d34 0 2024-09-21T12:47:06.399 INFO:tasks.workunit.client.1.smithi176.stdout:5/708: creat d0/d13/d5d/fe5 x:0 0 0 2024-09-21T12:47:06.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/285: dwrite d16/f48 [0,4194304] 0 2024-09-21T12:47:06.401 INFO:tasks.workunit.client.0.smithi046.stdout:3/235: rmdir d5/dc/d30/d34 39 2024-09-21T12:47:06.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/286: fsync d16/f27 0 2024-09-21T12:47:06.403 INFO:tasks.workunit.client.1.smithi176.stdout:8/752: write d6/d8/fa2 [508319,21953] 0 2024-09-21T12:47:06.404 INFO:tasks.workunit.client.0.smithi046.stdout:1/249: dwrite d4/d29/d32/f40 [0,4194304] 0 2024-09-21T12:47:06.404 INFO:tasks.workunit.client.1.smithi176.stdout:4/779: rename d3/d42/f8e to d3/d42/f115 0 2024-09-21T12:47:06.406 INFO:tasks.workunit.client.1.smithi176.stdout:5/709: dwrite d0/d13/d63/d66/fbe [4194304,4194304] 0 2024-09-21T12:47:06.411 INFO:tasks.workunit.client.1.smithi176.stdout:6/748: rename d2/l6b to d2/dd/d79/lee 0 2024-09-21T12:47:06.412 INFO:tasks.workunit.client.0.smithi046.stdout:2/287: dwrite d16/f21 [0,4194304] 0 2024-09-21T12:47:06.412 INFO:tasks.workunit.client.1.smithi176.stdout:3/909: write d1/da/f22 [1107507,20018] 0 2024-09-21T12:47:06.412 INFO:tasks.workunit.client.1.smithi176.stdout:4/780: dwrite d3/d5/f8d [0,4194304] 0 2024-09-21T12:47:06.414 INFO:tasks.workunit.client.1.smithi176.stdout:6/749: write d2/f31 [6239890,26236] 0 2024-09-21T12:47:06.415 INFO:tasks.workunit.client.1.smithi176.stdout:3/910: write d1/d3e/f123 [69370,64392] 0 2024-09-21T12:47:06.416 INFO:tasks.workunit.client.1.smithi176.stdout:7/919: unlink d0/d2/db/d10/d72/d7e/de2/df3/d11e/f122 0 2024-09-21T12:47:06.418 INFO:tasks.workunit.client.1.smithi176.stdout:6/750: write d2/d63/f51 [1158291,22842] 0 2024-09-21T12:47:06.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/288: dwrite d16/d22/d38/f42 [0,4194304] 0 2024-09-21T12:47:06.423 INFO:tasks.workunit.client.0.smithi046.stdout:9/255: unlink d11/f16 0 2024-09-21T12:47:06.427 INFO:tasks.workunit.client.0.smithi046.stdout:6/251: mkdir de/d2a/d4c 0 2024-09-21T12:47:06.428 INFO:tasks.workunit.client.1.smithi176.stdout:6/751: write d2/dd/d26/d2b/d10/f8e [1037463,33108] 0 2024-09-21T12:47:06.434 INFO:tasks.workunit.client.1.smithi176.stdout:3/911: dwrite d1/d5/d25/d61/f115 [0,4194304] 0 2024-09-21T12:47:06.434 INFO:tasks.workunit.client.0.smithi046.stdout:7/175: creat d2/d4/df/d17/f35 x:0 0 0 2024-09-21T12:47:06.434 INFO:tasks.workunit.client.0.smithi046.stdout:2/289: dread d16/f27 [0,4194304] 0 2024-09-21T12:47:06.434 INFO:tasks.workunit.client.0.smithi046.stdout:9/256: dwrite d11/d19/d36/f42 [0,4194304] 0 2024-09-21T12:47:06.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/176: dread - d2/d4/f2f zero size 2024-09-21T12:47:06.437 INFO:tasks.workunit.client.1.smithi176.stdout:3/912: fsync d1/d5/d25/d146/f131 0 2024-09-21T12:47:06.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/177: fdatasync d2/dd/f29 0 2024-09-21T12:47:06.438 INFO:tasks.workunit.client.1.smithi176.stdout:8/753: symlink d6/db/d37/d7a/lec 0 2024-09-21T12:47:06.438 INFO:tasks.workunit.client.0.smithi046.stdout:9/257: readlink d11/d19/l3a 0 2024-09-21T12:47:06.439 INFO:tasks.workunit.client.1.smithi176.stdout:8/754: truncate d6/db/d37/d7a/f96 5222276 0 2024-09-21T12:47:06.447 INFO:tasks.workunit.client.0.smithi046.stdout:3/236: creat d5/dc/d26/f4f x:0 0 0 2024-09-21T12:47:06.451 INFO:tasks.workunit.client.1.smithi176.stdout:1/807: symlink d0/db/d1a/d2c/dc5/d2b/l128 0 2024-09-21T12:47:06.453 INFO:tasks.workunit.client.0.smithi046.stdout:1/250: dread d4/f1f [0,4194304] 0 2024-09-21T12:47:06.453 INFO:tasks.workunit.client.1.smithi176.stdout:1/808: write d0/db/d1a/f10e [900454,95412] 0 2024-09-21T12:47:06.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/252: chown de/c12 6055965 1 2024-09-21T12:47:06.456 INFO:tasks.workunit.client.1.smithi176.stdout:4/781: dread d3/d21/d27/d2c/f67 [4194304,4194304] 0 2024-09-21T12:47:06.457 INFO:tasks.workunit.client.1.smithi176.stdout:4/782: truncate d3/d42/d56/d4e/ff3 490375 0 2024-09-21T12:47:06.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/290: creat d16/d22/d38/f53 x:0 0 0 2024-09-21T12:47:06.460 INFO:tasks.workunit.client.0.smithi046.stdout:6/253: dwrite de/d35/f43 [0,4194304] 0 2024-09-21T12:47:06.460 INFO:tasks.workunit.client.0.smithi046.stdout:2/291: dread d16/d22/f29 [0,4194304] 0 2024-09-21T12:47:06.461 INFO:tasks.workunit.client.0.smithi046.stdout:7/178: mknod d2/d4/df/d17/c36 0 2024-09-21T12:47:06.461 INFO:tasks.workunit.client.0.smithi046.stdout:2/292: stat d16/d22/d2b/d30/c3a 0 2024-09-21T12:47:06.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/293: readlink d16/l1b 0 2024-09-21T12:47:06.463 INFO:tasks.workunit.client.0.smithi046.stdout:5/276: creat d4/d22/d10/f52 x:0 0 0 2024-09-21T12:47:06.464 INFO:tasks.workunit.client.0.smithi046.stdout:3/237: symlink d5/dc/l50 0 2024-09-21T12:47:06.466 INFO:tasks.workunit.client.0.smithi046.stdout:8/266: sync 2024-09-21T12:47:06.466 INFO:tasks.workunit.client.0.smithi046.stdout:0/315: sync 2024-09-21T12:47:06.472 INFO:tasks.workunit.client.0.smithi046.stdout:6/254: mkdir de/d2a/d4d 0 2024-09-21T12:47:06.474 INFO:tasks.workunit.client.1.smithi176.stdout:9/819: sync 2024-09-21T12:47:06.475 INFO:tasks.workunit.client.1.smithi176.stdout:8/755: dread d6/d16/d36/f9a [0,4194304] 0 2024-09-21T12:47:06.477 INFO:tasks.workunit.client.0.smithi046.stdout:4/297: getdents d1/d13 0 2024-09-21T12:47:06.477 INFO:tasks.workunit.client.0.smithi046.stdout:8/267: chown d1/d12/d1a/c45 406922 1 2024-09-21T12:47:06.478 INFO:tasks.workunit.client.0.smithi046.stdout:0/316: mknod d6/d7/d13/d2a/d38/c77 0 2024-09-21T12:47:06.479 INFO:tasks.workunit.client.0.smithi046.stdout:1/251: fsync d4/f5 0 2024-09-21T12:47:06.481 INFO:tasks.workunit.client.0.smithi046.stdout:7/179: mkdir d2/d37 0 2024-09-21T12:47:06.483 INFO:tasks.workunit.client.0.smithi046.stdout:6/255: mkdir de/d2a/d34/d4e 0 2024-09-21T12:47:06.484 INFO:tasks.workunit.client.0.smithi046.stdout:5/277: symlink d4/l53 0 2024-09-21T12:47:06.485 INFO:tasks.workunit.client.0.smithi046.stdout:9/258: creat d11/d19/d1b/d1c/f47 x:0 0 0 2024-09-21T12:47:06.491 INFO:tasks.workunit.client.0.smithi046.stdout:8/268: mknod d1/d12/d46/c5f 0 2024-09-21T12:47:06.496 INFO:tasks.workunit.client.0.smithi046.stdout:1/252: fdatasync d4/f9 0 2024-09-21T12:47:06.498 INFO:tasks.workunit.client.0.smithi046.stdout:8/269: dwrite d1/d12/d46/d35/f50 [0,4194304] 0 2024-09-21T12:47:06.498 INFO:tasks.workunit.client.0.smithi046.stdout:7/180: read d2/d4/f8 [1617943,87342] 0 2024-09-21T12:47:06.499 INFO:tasks.workunit.client.0.smithi046.stdout:8/270: stat d1/d12/d1a/f1b 0 2024-09-21T12:47:06.500 INFO:tasks.workunit.client.0.smithi046.stdout:6/256: symlink de/d2a/d34/l4f 0 2024-09-21T12:47:06.500 INFO:tasks.workunit.client.0.smithi046.stdout:7/181: truncate d2/dd/f29 47706 0 2024-09-21T12:47:06.505 INFO:tasks.workunit.client.0.smithi046.stdout:5/278: mkdir d4/dc/d13/d15/d54 0 2024-09-21T12:47:06.508 INFO:tasks.workunit.client.1.smithi176.stdout:0/907: rmdir d9/d1a/d3f/d40/d79/dc0 0 2024-09-21T12:47:06.543 INFO:tasks.workunit.client.0.smithi046.stdout:4/298: rmdir d1/d13/d25/d29/d43 39 2024-09-21T12:47:06.550 INFO:tasks.workunit.client.1.smithi176.stdout:2/818: link d4/l41 d4/df/d2e/d6f/d5d/d67/d9f/l102 0 2024-09-21T12:47:06.553 INFO:tasks.workunit.client.1.smithi176.stdout:6/752: creat d2/dd/d26/d2b/d10/d87/fef x:0 0 0 2024-09-21T12:47:06.569 INFO:tasks.workunit.client.1.smithi176.stdout:1/809: creat d0/db/d6f/de1/d10b/f129 x:0 0 0 2024-09-21T12:47:06.570 INFO:tasks.workunit.client.0.smithi046.stdout:5/279: write d4/dc/d28/d2d/d43/f48 [5239087,64541] 0 2024-09-21T12:47:06.570 INFO:tasks.workunit.client.0.smithi046.stdout:5/280: read - d4/d22/d10/f52 zero size 2024-09-21T12:47:06.571 INFO:tasks.workunit.client.0.smithi046.stdout:4/299: creat d1/d13/d25/d29/d33/f65 x:0 0 0 2024-09-21T12:47:06.573 INFO:tasks.workunit.client.0.smithi046.stdout:4/300: write d1/f2a [2738117,82806] 0 2024-09-21T12:47:06.573 INFO:tasks.workunit.client.0.smithi046.stdout:1/253: mknod d4/d29/c61 0 2024-09-21T12:47:06.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/301: chown d1/d13/c2b 166 1 2024-09-21T12:47:06.578 INFO:tasks.workunit.client.1.smithi176.stdout:9/820: symlink d1/df/dea/df5/l115 0 2024-09-21T12:47:06.583 INFO:tasks.workunit.client.0.smithi046.stdout:7/182: creat d2/d4/df/d17/d31/d34/f38 x:0 0 0 2024-09-21T12:47:06.585 INFO:tasks.workunit.client.1.smithi176.stdout:8/756: dwrite d6/d8/d24/d35/f42 [0,4194304] 0 2024-09-21T12:47:06.588 INFO:tasks.workunit.client.1.smithi176.stdout:0/908: truncate d9/d1a/d1d/d23/da1/da3/f9d 733239 0 2024-09-21T12:47:06.596 INFO:tasks.workunit.client.0.smithi046.stdout:5/281: truncate d4/dc/f39 3193678 0 2024-09-21T12:47:06.598 INFO:tasks.workunit.client.1.smithi176.stdout:2/819: creat d4/df/d2e/d6f/d5d/d67/d9f/f103 x:0 0 0 2024-09-21T12:47:06.600 INFO:tasks.workunit.client.1.smithi176.stdout:6/753: write d2/dd/d26/d2b/d10/d39/f8b [684517,76455] 0 2024-09-21T12:47:06.600 INFO:tasks.workunit.client.1.smithi176.stdout:6/754: chown d2/d5d 18 1 2024-09-21T12:47:06.604 INFO:tasks.workunit.client.0.smithi046.stdout:4/302: mkdir d1/d27/d37/d66 0 2024-09-21T12:47:06.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/238: dwrite d5/dc/f15 [0,4194304] 0 2024-09-21T12:47:06.607 INFO:tasks.workunit.client.1.smithi176.stdout:1/810: write d0/db/d1a/d2c/f57 [919283,29865] 0 2024-09-21T12:47:06.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/183: creat d2/d4/df/d17/f39 x:0 0 0 2024-09-21T12:47:06.614 INFO:tasks.workunit.client.0.smithi046.stdout:0/317: dwrite d6/d7/fa [4194304,4194304] 0 2024-09-21T12:47:06.615 INFO:tasks.workunit.client.1.smithi176.stdout:4/783: symlink d3/d42/dfe/l116 0 2024-09-21T12:47:06.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/282: creat d4/dc/d28/d2d/d43/f55 x:0 0 0 2024-09-21T12:47:06.619 INFO:tasks.workunit.client.1.smithi176.stdout:9/821: creat d1/df/dea/f116 x:0 0 0 2024-09-21T12:47:06.623 INFO:tasks.workunit.client.1.smithi176.stdout:7/920: link d0/d2/db/d10/d3b/l13b d0/d2/da8/l145 0 2024-09-21T12:47:06.636 INFO:tasks.workunit.client.0.smithi046.stdout:7/184: creat d2/d4/df/d17/d31/d34/f3a x:0 0 0 2024-09-21T12:47:06.638 INFO:tasks.workunit.client.0.smithi046.stdout:7/185: dread d2/dd/f2b [0,4194304] 0 2024-09-21T12:47:06.643 INFO:tasks.workunit.client.1.smithi176.stdout:4/784: mknod d3/d42/d56/d4e/df8/c117 0 2024-09-21T12:47:06.645 INFO:tasks.workunit.client.1.smithi176.stdout:7/921: symlink d0/d2/d30/d93/l146 0 2024-09-21T12:47:06.649 INFO:tasks.workunit.client.1.smithi176.stdout:0/909: creat d9/d1a/d1d/d23/da1/da3/d1e/dbf/d120/f140 x:0 0 0 2024-09-21T12:47:06.651 INFO:tasks.workunit.client.1.smithi176.stdout:7/922: dwrite d0/d5d/ffa [0,4194304] 0 2024-09-21T12:47:06.652 INFO:tasks.workunit.client.1.smithi176.stdout:2/820: creat d4/df/d2e/d39/db7/d80/dda/df9/f104 x:0 0 0 2024-09-21T12:47:06.653 INFO:tasks.workunit.client.1.smithi176.stdout:7/923: write d0/d2/db/fe [4450161,75476] 0 2024-09-21T12:47:06.653 INFO:tasks.workunit.client.1.smithi176.stdout:2/821: chown d4/df/d2e/d4d/d70/fef 126288852 1 2024-09-21T12:47:06.660 INFO:tasks.workunit.client.1.smithi176.stdout:3/913: getdents d1/d34/d57/dd0 0 2024-09-21T12:47:06.660 INFO:tasks.workunit.client.1.smithi176.stdout:3/914: dread - d1/f148 zero size 2024-09-21T12:47:06.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/186: creat d2/d4/df/d17/f3b x:0 0 0 2024-09-21T12:47:06.665 INFO:tasks.workunit.client.1.smithi176.stdout:0/910: mkdir d9/d1a/d1d/d23/dd3/dee/d141 0 2024-09-21T12:47:06.669 INFO:tasks.workunit.client.0.smithi046.stdout:4/303: link d1/d13/d25/d29/d43/c44 d1/d27/d37/d66/c67 0 2024-09-21T12:47:06.672 INFO:tasks.workunit.client.1.smithi176.stdout:3/915: read d1/d3e/f41 [71937,58865] 0 2024-09-21T12:47:06.675 INFO:tasks.workunit.client.0.smithi046.stdout:4/304: dread d1/f26 [0,4194304] 0 2024-09-21T12:47:06.677 INFO:tasks.workunit.client.1.smithi176.stdout:6/755: link d2/f56 d2/dd/d26/d2b/d10/d1b/ff0 0 2024-09-21T12:47:06.678 INFO:tasks.workunit.client.1.smithi176.stdout:6/756: fdatasync d2/dd/d26/d2b/d10/f1f 0 2024-09-21T12:47:06.680 INFO:tasks.workunit.client.1.smithi176.stdout:4/785: link d3/d21/d27/d2c/f41 d3/d42/d56/d101/f118 0 2024-09-21T12:47:06.680 INFO:tasks.workunit.client.1.smithi176.stdout:7/924: dread d0/f16 [0,4194304] 0 2024-09-21T12:47:06.682 INFO:tasks.workunit.client.1.smithi176.stdout:6/757: symlink d2/dd/d26/d2b/d10/d1b/d7b/lf1 0 2024-09-21T12:47:06.683 INFO:tasks.workunit.client.1.smithi176.stdout:0/911: rmdir d9/d1a/d1d/d23/d5f/ddd 39 2024-09-21T12:47:06.683 INFO:tasks.workunit.client.1.smithi176.stdout:6/758: fdatasync d2/f96 0 2024-09-21T12:47:06.685 INFO:tasks.workunit.client.1.smithi176.stdout:0/912: chown d9/d1a/d1d/d23/da1/da3/d93/df9/d75 219 1 2024-09-21T12:47:06.685 INFO:tasks.workunit.client.1.smithi176.stdout:6/759: write d2/dd/d79/f91 [1427025,71375] 0 2024-09-21T12:47:06.685 INFO:tasks.workunit.client.1.smithi176.stdout:4/786: dread d3/d42/f115 [0,4194304] 0 2024-09-21T12:47:06.687 INFO:tasks.workunit.client.1.smithi176.stdout:6/760: write d2/d63/fb1 [1830857,93839] 0 2024-09-21T12:47:06.687 INFO:tasks.workunit.client.1.smithi176.stdout:3/916: dread d1/d5/fcf [0,4194304] 0 2024-09-21T12:47:06.689 INFO:tasks.workunit.client.1.smithi176.stdout:4/787: creat d3/d42/d56/d4e/f119 x:0 0 0 2024-09-21T12:47:06.690 INFO:tasks.workunit.client.1.smithi176.stdout:4/788: fdatasync d3/d42/f69 0 2024-09-21T12:47:06.691 INFO:tasks.workunit.client.1.smithi176.stdout:7/925: truncate d0/d2/db/d10/d72/d7e/fe0 202188 0 2024-09-21T12:47:06.693 INFO:tasks.workunit.client.1.smithi176.stdout:4/789: dread - d3/d42/f6b zero size 2024-09-21T12:47:06.697 INFO:tasks.workunit.client.1.smithi176.stdout:5/710: link d0/d13/d63/d66/f69 d0/d13/d5d/fe6 0 2024-09-21T12:47:06.699 INFO:tasks.workunit.client.1.smithi176.stdout:0/913: dread d9/d1a/d1d/d23/da1/da3/d8f/dd8/fe6 [0,4194304] 0 2024-09-21T12:47:06.699 INFO:tasks.workunit.client.1.smithi176.stdout:6/761: link d2/dd/dc7/cda d2/d6f/d81/cf2 0 2024-09-21T12:47:06.700 INFO:tasks.workunit.client.1.smithi176.stdout:6/762: readlink d2/dd/d79/l8d 0 2024-09-21T12:47:06.700 INFO:tasks.workunit.client.1.smithi176.stdout:3/917: link d1/d34/d71/d91/df6/l135 d1/d5/d25/d61/dc3/d13b/l14e 0 2024-09-21T12:47:06.703 INFO:tasks.workunit.client.1.smithi176.stdout:0/914: mkdir d9/d1a/d3f/d40/d79/d142 0 2024-09-21T12:47:06.704 INFO:tasks.workunit.client.1.smithi176.stdout:8/757: sync 2024-09-21T12:47:06.705 INFO:tasks.workunit.client.1.smithi176.stdout:3/918: creat d1/d34/d42/d5b/f14f x:0 0 0 2024-09-21T12:47:06.705 INFO:tasks.workunit.client.1.smithi176.stdout:8/758: readlink d6/db/d13/d98/dde/laf 0 2024-09-21T12:47:06.706 INFO:tasks.workunit.client.1.smithi176.stdout:4/790: link d3/d42/d56/d101/d107/d96/db2/c110 d3/d42/d56/d4e/c11a 0 2024-09-21T12:47:06.706 INFO:tasks.workunit.client.1.smithi176.stdout:5/711: mkdir d0/d13/d63/d8d/ddc/de7 0 2024-09-21T12:47:06.707 INFO:tasks.workunit.client.1.smithi176.stdout:7/926: dread d0/d2/db/d10/d23/f28 [0,4194304] 0 2024-09-21T12:47:06.708 INFO:tasks.workunit.client.1.smithi176.stdout:0/915: symlink d9/d1a/d3f/d10d/dcc/l143 0 2024-09-21T12:47:06.708 INFO:tasks.workunit.client.1.smithi176.stdout:5/712: truncate d0/d10/d70/fca 396292 0 2024-09-21T12:47:06.709 INFO:tasks.workunit.client.1.smithi176.stdout:4/791: stat d3/c3d 0 2024-09-21T12:47:06.710 INFO:tasks.workunit.client.1.smithi176.stdout:4/792: dread - d3/d42/d47/f8f zero size 2024-09-21T12:47:06.711 INFO:tasks.workunit.client.1.smithi176.stdout:7/927: symlink d0/d2/db/d10/d31/da0/l147 0 2024-09-21T12:47:06.711 INFO:tasks.workunit.client.1.smithi176.stdout:4/793: write d3/d42/d47/dab/fd9 [484545,27060] 0 2024-09-21T12:47:06.713 INFO:tasks.workunit.client.1.smithi176.stdout:0/916: dread - d9/d1a/d1d/d23/da1/da3/fd5 zero size 2024-09-21T12:47:06.714 INFO:tasks.workunit.client.1.smithi176.stdout:1/811: rename d0/db/d1a/d2c/dc5/d41/d59/ce0 to d0/db/d1a/d2c/d66/c12a 0 2024-09-21T12:47:06.715 INFO:tasks.workunit.client.1.smithi176.stdout:5/713: unlink d0/d13/d63/d2e/d37/f57 0 2024-09-21T12:47:06.715 INFO:tasks.workunit.client.1.smithi176.stdout:6/763: dread d2/fbe [0,4194304] 0 2024-09-21T12:47:06.716 INFO:tasks.workunit.client.0.smithi046.stdout:6/257: write de/f17 [451473,110976] 0 2024-09-21T12:47:06.718 INFO:tasks.workunit.client.1.smithi176.stdout:0/917: dread d9/d1a/d3f/d40/d79/f7f [4194304,4194304] 0 2024-09-21T12:47:06.721 INFO:tasks.workunit.client.1.smithi176.stdout:0/918: read - d9/d1a/d1d/d23/da1/da3/d8f/d91/f126 zero size 2024-09-21T12:47:06.722 INFO:tasks.workunit.client.0.smithi046.stdout:0/318: mkdir d6/d7/d13/d2a/d78 0 2024-09-21T12:47:06.723 INFO:tasks.workunit.client.1.smithi176.stdout:1/812: dwrite d0/db/d1a/d2c/d66/f6e [4194304,4194304] 0 2024-09-21T12:47:06.725 INFO:tasks.workunit.client.1.smithi176.stdout:6/764: dwrite d2/dd/d26/d2b/d10/f1f [0,4194304] 0 2024-09-21T12:47:06.725 INFO:tasks.workunit.client.1.smithi176.stdout:8/759: rename d6/db/d13/d98/dde/laf to d6/d8/d24/d35/led 0 2024-09-21T12:47:06.726 INFO:tasks.workunit.client.1.smithi176.stdout:3/919: read d1/d5/f7b [3613894,119738] 0 2024-09-21T12:47:06.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/259: dwrite d11/f18 [0,4194304] 0 2024-09-21T12:47:06.730 INFO:tasks.workunit.client.1.smithi176.stdout:0/919: mknod d9/d1a/d1d/d23/da1/da3/d1e/d47/c144 0 2024-09-21T12:47:06.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/319: creat d6/d7/d13/d72/f79 x:0 0 0 2024-09-21T12:47:06.741 INFO:tasks.workunit.client.0.smithi046.stdout:6/258: dread fb [0,4194304] 0 2024-09-21T12:47:06.745 INFO:tasks.workunit.client.1.smithi176.stdout:0/920: creat d9/d1a/d1d/d23/da1/d99/f145 x:0 0 0 2024-09-21T12:47:06.746 INFO:tasks.workunit.client.1.smithi176.stdout:3/920: read d1/d8d/fd9 [2411873,105579] 0 2024-09-21T12:47:06.749 INFO:tasks.workunit.client.0.smithi046.stdout:6/259: mknod de/d35/c50 0 2024-09-21T12:47:06.753 INFO:tasks.workunit.client.0.smithi046.stdout:6/260: mknod de/d35/c51 0 2024-09-21T12:47:06.756 INFO:tasks.workunit.client.1.smithi176.stdout:8/760: dread d6/db/da3/fc1 [0,4194304] 0 2024-09-21T12:47:06.760 INFO:tasks.workunit.client.0.smithi046.stdout:6/261: symlink de/d2a/d4d/l52 0 2024-09-21T12:47:06.760 INFO:tasks.workunit.client.1.smithi176.stdout:1/813: dread d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/f102 [0,4194304] 0 2024-09-21T12:47:06.761 INFO:tasks.workunit.client.1.smithi176.stdout:8/761: rmdir d6/d8/d24 39 2024-09-21T12:47:06.761 INFO:tasks.workunit.client.1.smithi176.stdout:1/814: readlink d0/db/d1a/d2c/l105 0 2024-09-21T12:47:06.763 INFO:tasks.workunit.client.1.smithi176.stdout:3/921: creat d1/d34/d42/f150 x:0 0 0 2024-09-21T12:47:06.764 INFO:tasks.workunit.client.0.smithi046.stdout:9/260: dread f2 [0,4194304] 0 2024-09-21T12:47:06.765 INFO:tasks.workunit.client.1.smithi176.stdout:0/921: dread d9/d1a/d1d/d90/f123 [4194304,4194304] 0 2024-09-21T12:47:06.770 INFO:tasks.workunit.client.1.smithi176.stdout:8/762: symlink d6/db/da3/lee 0 2024-09-21T12:47:06.770 INFO:tasks.workunit.client.0.smithi046.stdout:6/262: dread de/f1d [0,4194304] 0 2024-09-21T12:47:06.776 INFO:tasks.workunit.client.0.smithi046.stdout:6/263: mknod de/d2a/c53 0 2024-09-21T12:47:06.777 INFO:tasks.workunit.client.1.smithi176.stdout:8/763: readlink d6/d8/d24/d35/lc6 0 2024-09-21T12:47:06.779 INFO:tasks.workunit.client.1.smithi176.stdout:0/922: dread d9/d1a/d3f/d40/d79/f7f [0,4194304] 0 2024-09-21T12:47:06.779 INFO:tasks.workunit.client.1.smithi176.stdout:0/923: stat d9/d1a/d1d/d23/dd3 0 2024-09-21T12:47:06.794 INFO:tasks.workunit.client.1.smithi176.stdout:8/764: mkdir d6/d16/d79/def 0 2024-09-21T12:47:06.794 INFO:tasks.workunit.client.0.smithi046.stdout:9/261: link d11/d19/l3a d11/d19/d20/l48 0 2024-09-21T12:47:06.796 INFO:tasks.workunit.client.1.smithi176.stdout:0/924: unlink d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d78/c110 0 2024-09-21T12:47:06.798 INFO:tasks.workunit.client.0.smithi046.stdout:6/264: creat de/d2a/d4c/f54 x:0 0 0 2024-09-21T12:47:06.798 INFO:tasks.workunit.client.0.smithi046.stdout:6/265: chown f9 882587893 1 2024-09-21T12:47:06.799 INFO:tasks.workunit.client.1.smithi176.stdout:9/822: sync 2024-09-21T12:47:06.800 INFO:tasks.workunit.client.1.smithi176.stdout:9/823: chown d1/d8b/fa6 2703822 1 2024-09-21T12:47:06.805 INFO:tasks.workunit.client.0.smithi046.stdout:9/262: link f4 d11/d19/d1b/d1c/d1f/d30/d3e/f49 0 2024-09-21T12:47:06.807 INFO:tasks.workunit.client.0.smithi046.stdout:6/266: mkdir de/d2a/d34/d4e/d55 0 2024-09-21T12:47:06.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/263: mknod d11/d19/d1b/d1c/d1f/c4a 0 2024-09-21T12:47:06.810 INFO:tasks.workunit.client.0.smithi046.stdout:6/267: symlink de/d2a/l56 0 2024-09-21T12:47:06.810 INFO:tasks.workunit.client.0.smithi046.stdout:6/268: chown de/f17 7 1 2024-09-21T12:47:06.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/264: fdatasync f10 0 2024-09-21T12:47:06.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/254: truncate d4/f37 1182465 0 2024-09-21T12:47:06.816 INFO:tasks.workunit.client.0.smithi046.stdout:6/269: truncate de/f28 2972957 0 2024-09-21T12:47:06.820 INFO:tasks.workunit.client.0.smithi046.stdout:9/265: dwrite d11/f12 [0,4194304] 0 2024-09-21T12:47:06.828 INFO:tasks.workunit.client.0.smithi046.stdout:6/270: dread de/d48/f4a [0,4194304] 0 2024-09-21T12:47:06.830 INFO:tasks.workunit.client.1.smithi176.stdout:2/822: write d4/f64 [92185,72316] 0 2024-09-21T12:47:06.831 INFO:tasks.workunit.client.1.smithi176.stdout:2/823: dread - d4/d3d/fdb zero size 2024-09-21T12:47:06.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/187: write d2/d4/f1c [2183759,70716] 0 2024-09-21T12:47:06.833 INFO:tasks.workunit.client.0.smithi046.stdout:3/239: dwrite d5/f20 [0,4194304] 0 2024-09-21T12:47:06.835 INFO:tasks.workunit.client.0.smithi046.stdout:1/255: dwrite d4/d13/d38/d4f/f54 [0,4194304] 0 2024-09-21T12:47:06.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/266: dread d11/f18 [0,4194304] 0 2024-09-21T12:47:06.837 INFO:tasks.workunit.client.0.smithi046.stdout:6/271: write de/f45 [2893057,67028] 0 2024-09-21T12:47:06.838 INFO:tasks.workunit.client.1.smithi176.stdout:2/824: dwrite d4/df/d2e/d6f/d5d/ffe [0,4194304] 0 2024-09-21T12:47:06.839 INFO:tasks.workunit.client.1.smithi176.stdout:2/825: chown d4/df/f22 30949 1 2024-09-21T12:47:06.844 INFO:tasks.workunit.client.0.smithi046.stdout:6/272: mknod de/d35/c57 0 2024-09-21T12:47:06.846 INFO:tasks.workunit.client.1.smithi176.stdout:6/765: sync 2024-09-21T12:47:06.846 INFO:tasks.workunit.client.0.smithi046.stdout:9/267: mkdir d11/d19/d1b/d4b 0 2024-09-21T12:47:06.846 INFO:tasks.workunit.client.0.smithi046.stdout:4/305: dwrite d1/d13/d25/d29/f42 [0,4194304] 0 2024-09-21T12:47:06.848 INFO:tasks.workunit.client.0.smithi046.stdout:1/256: rename d4/d13/d38/l56 to d4/d13/d38/d53/d5a/d5d/l62 0 2024-09-21T12:47:06.859 INFO:tasks.workunit.client.0.smithi046.stdout:3/240: rename d5/dc/d30/d34/f43 to d5/dc/d26/d3c/f51 0 2024-09-21T12:47:06.862 INFO:tasks.workunit.client.0.smithi046.stdout:5/283: mknod d4/d22/c56 0 2024-09-21T12:47:06.863 INFO:tasks.workunit.client.1.smithi176.stdout:6/766: getdents d2/dd/d26/d2b 0 2024-09-21T12:47:06.864 INFO:tasks.workunit.client.0.smithi046.stdout:4/306: symlink d1/d27/l68 0 2024-09-21T12:47:06.867 INFO:tasks.workunit.client.0.smithi046.stdout:7/188: creat d2/d4/f3c x:0 0 0 2024-09-21T12:47:06.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/284: dwrite d4/dc/d13/f35 [0,4194304] 0 2024-09-21T12:47:06.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/285: readlink d4/d22/l1f 0 2024-09-21T12:47:06.872 INFO:tasks.workunit.client.0.smithi046.stdout:3/241: symlink d5/dc/d28/l52 0 2024-09-21T12:47:06.874 INFO:tasks.workunit.client.1.smithi176.stdout:0/925: unlink l4 0 2024-09-21T12:47:06.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/189: creat d2/dd/f3d x:0 0 0 2024-09-21T12:47:06.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/286: creat d4/dc/d13/d15/f57 x:0 0 0 2024-09-21T12:47:06.879 INFO:tasks.workunit.client.0.smithi046.stdout:5/287: readlink d4/dc/d13/l3e 0 2024-09-21T12:47:06.880 INFO:tasks.workunit.client.1.smithi176.stdout:7/928: rename d0/d2/db/d10/d3b to d0/d2/d30/df4/d121/d141/d148 0 2024-09-21T12:47:06.883 INFO:tasks.workunit.client.1.smithi176.stdout:0/926: creat d9/d1a/d1d/d23/da1/da3/d1e/dbf/d120/f146 x:0 0 0 2024-09-21T12:47:06.883 INFO:tasks.workunit.client.1.smithi176.stdout:0/927: readlink d9/d1a/d1d/d23/l57 0 2024-09-21T12:47:06.888 INFO:tasks.workunit.client.1.smithi176.stdout:7/929: creat d0/d2/d30/df4/d121/d141/f149 x:0 0 0 2024-09-21T12:47:06.888 INFO:tasks.workunit.client.1.smithi176.stdout:0/928: dwrite d9/f27 [4194304,4194304] 0 2024-09-21T12:47:06.889 INFO:tasks.workunit.client.0.smithi046.stdout:5/288: stat d4/dc/d13/c17 0 2024-09-21T12:47:06.890 INFO:tasks.workunit.client.1.smithi176.stdout:0/929: write d9/d1a/d3f/d10d/dcc/f134 [169529,39663] 0 2024-09-21T12:47:06.894 INFO:tasks.workunit.client.0.smithi046.stdout:7/190: symlink d2/d37/l3e 0 2024-09-21T12:47:06.895 INFO:tasks.workunit.client.0.smithi046.stdout:7/191: chown d2/d4/df/d17/f28 4026423 1 2024-09-21T12:47:06.897 INFO:tasks.workunit.client.0.smithi046.stdout:4/307: getdents d1/d13/d25/d29/d43 0 2024-09-21T12:47:06.897 INFO:tasks.workunit.client.1.smithi176.stdout:4/794: write d3/d42/d56/d101/d107/d96/db2/fc7 [154007,51773] 0 2024-09-21T12:47:06.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/192: creat d2/dd/f3f x:0 0 0 2024-09-21T12:47:06.901 INFO:tasks.workunit.client.0.smithi046.stdout:7/193: chown d2/d4/df/d17/d31/d34 148068 1 2024-09-21T12:47:06.902 INFO:tasks.workunit.client.0.smithi046.stdout:4/308: mknod d1/d5f/c69 0 2024-09-21T12:47:06.903 INFO:tasks.workunit.client.0.smithi046.stdout:7/194: write d2/d4/df/d17/f39 [752192,118620] 0 2024-09-21T12:47:06.904 INFO:tasks.workunit.client.0.smithi046.stdout:4/309: fsync d1/d13/f31 0 2024-09-21T12:47:06.904 INFO:tasks.workunit.client.1.smithi176.stdout:3/922: sync 2024-09-21T12:47:06.904 INFO:tasks.workunit.client.1.smithi176.stdout:7/930: mkdir d0/d2/db/d10/d14a 0 2024-09-21T12:47:06.905 INFO:tasks.workunit.client.1.smithi176.stdout:5/714: write d0/f27 [1723785,97046] 0 2024-09-21T12:47:06.906 INFO:tasks.workunit.client.1.smithi176.stdout:5/715: read - d0/d13/d5d/d98/d9b/dad/fbc zero size 2024-09-21T12:47:06.907 INFO:tasks.workunit.client.0.smithi046.stdout:7/195: creat d2/d4/df/d17/f40 x:0 0 0 2024-09-21T12:47:06.911 INFO:tasks.workunit.client.1.smithi176.stdout:5/716: readlink d0/d13/d63/d2e/d37/db5/lbf 0 2024-09-21T12:47:06.911 INFO:tasks.workunit.client.1.smithi176.stdout:5/717: read - d0/d13/d5d/fab zero size 2024-09-21T12:47:06.914 INFO:tasks.workunit.client.1.smithi176.stdout:5/718: truncate d0/d13/d63/d2e/d37/db5/db7/f6b 712136 0 2024-09-21T12:47:06.916 INFO:tasks.workunit.client.1.smithi176.stdout:5/719: stat d0/d13/d5d/fe6 0 2024-09-21T12:47:06.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/242: rename d5/dc/f15 to d5/dc/d28/f53 0 2024-09-21T12:47:06.919 INFO:tasks.workunit.client.0.smithi046.stdout:3/243: read - d5/dc/d26/f4f zero size 2024-09-21T12:47:06.922 INFO:tasks.workunit.client.0.smithi046.stdout:3/244: creat d5/dc/f54 x:0 0 0 2024-09-21T12:47:06.923 INFO:tasks.workunit.client.1.smithi176.stdout:7/931: dread d0/d2/db/d10/d31/da1/fcd [0,4194304] 0 2024-09-21T12:47:06.925 INFO:tasks.workunit.client.0.smithi046.stdout:5/289: rename d4/d16/c26 to d4/dc/c58 0 2024-09-21T12:47:06.927 INFO:tasks.workunit.client.1.smithi176.stdout:1/815: write d0/fc [3186750,86844] 0 2024-09-21T12:47:06.927 INFO:tasks.workunit.client.0.smithi046.stdout:5/290: read - d4/dc/d28/d2d/d43/f55 zero size 2024-09-21T12:47:06.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/245: dread d5/dc/d28/f53 [0,4194304] 0 2024-09-21T12:47:06.927 INFO:tasks.workunit.client.0.smithi046.stdout:5/291: write d4/f4a [535235,1044] 0 2024-09-21T12:47:06.928 INFO:tasks.workunit.client.0.smithi046.stdout:4/310: rename d1/d13/d25/c24 to d1/d13/d4e/c6a 0 2024-09-21T12:47:06.929 INFO:tasks.workunit.client.0.smithi046.stdout:4/311: fsync d1/d27/f61 0 2024-09-21T12:47:06.931 INFO:tasks.workunit.client.0.smithi046.stdout:5/292: chown d4/c4d 1645 1 2024-09-21T12:47:06.931 INFO:tasks.workunit.client.1.smithi176.stdout:7/932: dwrite d0/d2f/f66 [4194304,4194304] 0 2024-09-21T12:47:06.932 INFO:tasks.workunit.client.0.smithi046.stdout:5/293: truncate d4/d16/f46 1061166 0 2024-09-21T12:47:06.932 INFO:tasks.workunit.client.1.smithi176.stdout:1/816: creat d0/db/d6a/d89/f12b x:0 0 0 2024-09-21T12:47:06.933 INFO:tasks.workunit.client.1.smithi176.stdout:7/933: chown d0/d5d/lda 36242 1 2024-09-21T12:47:06.934 INFO:tasks.workunit.client.1.smithi176.stdout:9/824: rename d1/df/d48/d69/f21 to d1/df/d48/f117 0 2024-09-21T12:47:06.936 INFO:tasks.workunit.client.0.smithi046.stdout:5/294: truncate d4/dc/d13/f50 705768 0 2024-09-21T12:47:06.937 INFO:tasks.workunit.client.1.smithi176.stdout:2/826: sync 2024-09-21T12:47:06.937 INFO:tasks.workunit.client.1.smithi176.stdout:1/817: symlink d0/d5b/l12c 0 2024-09-21T12:47:06.940 INFO:tasks.workunit.client.1.smithi176.stdout:7/934: unlink d0/d2/db/d10/d23/ff9 0 2024-09-21T12:47:06.941 INFO:tasks.workunit.client.1.smithi176.stdout:7/935: truncate d0/d2/da8/dbe/f111 808384 0 2024-09-21T12:47:06.944 INFO:tasks.workunit.client.1.smithi176.stdout:4/795: rename d3/d42/f6b to d3/d42/d56/d101/d107/d36/f11b 0 2024-09-21T12:47:06.945 INFO:tasks.workunit.client.1.smithi176.stdout:8/765: write d6/db/f17 [75307,124565] 0 2024-09-21T12:47:06.945 INFO:tasks.workunit.client.1.smithi176.stdout:4/796: read d3/d21/fc9 [276157,19456] 0 2024-09-21T12:47:06.946 INFO:tasks.workunit.client.1.smithi176.stdout:4/797: dread - d3/d42/d56/d4e/f119 zero size 2024-09-21T12:47:06.947 INFO:tasks.workunit.client.1.smithi176.stdout:2/827: symlink d4/df/d2e/d6f/d5d/d81/l105 0 2024-09-21T12:47:06.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/268: fsync f4 0 2024-09-21T12:47:06.949 INFO:tasks.workunit.client.1.smithi176.stdout:1/818: fsync d0/db/d1a/d2c/dc5/d2b/d43/f54 0 2024-09-21T12:47:06.950 INFO:tasks.workunit.client.1.smithi176.stdout:1/819: write d0/db/d6a/d89/f12b [226325,1125] 0 2024-09-21T12:47:06.955 INFO:tasks.workunit.client.0.smithi046.stdout:9/269: dwrite d11/d19/d36/f42 [0,4194304] 0 2024-09-21T12:47:06.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/270: stat d11/d19/d1b/l22 0 2024-09-21T12:47:06.956 INFO:tasks.workunit.client.0.smithi046.stdout:9/271: fdatasync f6 0 2024-09-21T12:47:06.957 INFO:tasks.workunit.client.0.smithi046.stdout:4/312: mkdir d1/d13/d25/d6b 0 2024-09-21T12:47:06.958 INFO:tasks.workunit.client.0.smithi046.stdout:4/313: truncate d1/d27/d58/f4c 1008481 0 2024-09-21T12:47:06.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/314: stat d1/d27/c59 0 2024-09-21T12:47:06.964 INFO:tasks.workunit.client.0.smithi046.stdout:7/196: rename d2/d4/df/c23 to d2/c41 0 2024-09-21T12:47:06.966 INFO:tasks.workunit.client.1.smithi176.stdout:0/930: mknod d9/d1a/c147 0 2024-09-21T12:47:06.967 INFO:tasks.workunit.client.1.smithi176.stdout:4/798: mknod d3/d42/d56/d101/d107/d96/db2/ddc/c11c 0 2024-09-21T12:47:06.968 INFO:tasks.workunit.client.1.smithi176.stdout:0/931: write d9/d1a/d1d/d23/da1/da3/d93/df9/fce [12441,57434] 0 2024-09-21T12:47:06.969 INFO:tasks.workunit.client.1.smithi176.stdout:2/828: mkdir d4/df/d2e/d39/db7/d80/d9e/d106 0 2024-09-21T12:47:06.973 INFO:tasks.workunit.client.0.smithi046.stdout:9/272: rmdir d11/d19/d1b 39 2024-09-21T12:47:06.974 INFO:tasks.workunit.client.0.smithi046.stdout:4/315: creat d1/d13/d25/d29/d43/f6c x:0 0 0 2024-09-21T12:47:06.976 INFO:tasks.workunit.client.0.smithi046.stdout:3/246: rename d5/l4a to d5/dc/d30/d34/l55 0 2024-09-21T12:47:06.978 INFO:tasks.workunit.client.0.smithi046.stdout:3/247: rename d5/dc to d5/dc/d26/d3c/d56 22 2024-09-21T12:47:06.978 INFO:tasks.workunit.client.0.smithi046.stdout:5/295: link d4/d16/f36 d4/d22/d10/d1a/f59 0 2024-09-21T12:47:06.981 INFO:tasks.workunit.client.0.smithi046.stdout:9/273: stat d11/d19/d1b/f25 0 2024-09-21T12:47:06.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/273: dwrite fa [4194304,4194304] 0 2024-09-21T12:47:06.982 INFO:tasks.workunit.client.1.smithi176.stdout:4/799: truncate d3/d42/d47/f8f 891942 0 2024-09-21T12:47:06.983 INFO:tasks.workunit.client.1.smithi176.stdout:6/767: write d2/dd/d79/fab [302674,86655] 0 2024-09-21T12:47:06.984 INFO:tasks.workunit.client.0.smithi046.stdout:9/274: truncate d11/d19/d36/f42 5084959 0 2024-09-21T12:47:06.984 INFO:tasks.workunit.client.1.smithi176.stdout:0/932: mkdir d9/d1a/d1d/d23/da1/d99/d137/d148 0 2024-09-21T12:47:06.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/248: creat d5/dc/f57 x:0 0 0 2024-09-21T12:47:06.988 INFO:tasks.workunit.client.0.smithi046.stdout:1/257: dwrite d4/f26 [0,4194304] 0 2024-09-21T12:47:06.990 INFO:tasks.workunit.client.1.smithi176.stdout:3/923: rename d1/d5/c13 to d1/d35/d5e/c151 0 2024-09-21T12:47:06.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/258: dread d4/d13/f36 [0,4194304] 0 2024-09-21T12:47:06.991 INFO:tasks.workunit.client.1.smithi176.stdout:3/924: chown d1/d34/d5d/dce 66186013 1 2024-09-21T12:47:06.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/259: dread d4/d13/d38/d4f/f54 [0,4194304] 0 2024-09-21T12:47:06.996 INFO:tasks.workunit.client.0.smithi046.stdout:1/260: chown d4/d13/d38/d53/d5a 1015 1 2024-09-21T12:47:06.999 INFO:tasks.workunit.client.1.smithi176.stdout:6/768: mkdir d2/d6f/df3 0 2024-09-21T12:47:07.000 INFO:tasks.workunit.client.1.smithi176.stdout:6/769: stat d2/dd/d26/d2b/d10/d1b/d37/ld4 0 2024-09-21T12:47:07.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/249: mknod d5/dc/d28/c58 0 2024-09-21T12:47:07.004 INFO:tasks.workunit.client.1.smithi176.stdout:0/933: rename d9/d1a/d20/f13f to d9/d1a/db8/dd2/f149 0 2024-09-21T12:47:07.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/250: read d5/dc/d28/f2c [121472,40279] 0 2024-09-21T12:47:07.006 INFO:tasks.workunit.client.1.smithi176.stdout:3/925: creat d1/d34/d5d/dfe/f152 x:0 0 0 2024-09-21T12:47:07.008 INFO:tasks.workunit.client.1.smithi176.stdout:9/825: getdents d1/df/d48/d69/d40/d84 0 2024-09-21T12:47:07.010 INFO:tasks.workunit.client.1.smithi176.stdout:0/934: dread d9/d1a/d1d/d23/da1/da3/d93/df9/d77/fb6 [4194304,4194304] 0 2024-09-21T12:47:07.011 INFO:tasks.workunit.client.1.smithi176.stdout:3/926: dread d1/d34/d57/dd0/f9f [0,4194304] 0 2024-09-21T12:47:07.014 INFO:tasks.workunit.client.1.smithi176.stdout:4/800: dread d3/f32 [0,4194304] 0 2024-09-21T12:47:07.015 INFO:tasks.workunit.client.1.smithi176.stdout:3/927: write d1/d35/d5e/d90/f10c [87095,111075] 0 2024-09-21T12:47:07.018 INFO:tasks.workunit.client.1.smithi176.stdout:4/801: chown d3/d21/d5e/l85 1864 1 2024-09-21T12:47:07.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/275: link d11/f18 d11/d19/d1b/d31/d44/f4c 0 2024-09-21T12:47:07.019 INFO:tasks.workunit.client.1.smithi176.stdout:9/826: dwrite d1/df/d48/d69/d76/fae [4194304,4194304] 0 2024-09-21T12:47:07.020 INFO:tasks.workunit.client.0.smithi046.stdout:3/251: symlink d5/dc/d30/d34/l59 0 2024-09-21T12:47:07.021 INFO:tasks.workunit.client.1.smithi176.stdout:9/827: truncate d1/d63/ff6 579816 0 2024-09-21T12:47:07.021 INFO:tasks.workunit.client.1.smithi176.stdout:5/720: dwrite d0/d10/d70/f8b [0,4194304] 0 2024-09-21T12:47:07.022 INFO:tasks.workunit.client.1.smithi176.stdout:5/721: fdatasync d0/d13/fd1 0 2024-09-21T12:47:07.024 INFO:tasks.workunit.client.0.smithi046.stdout:4/316: link d1/d27/l68 d1/d13/d25/l6d 0 2024-09-21T12:47:07.028 INFO:tasks.workunit.client.1.smithi176.stdout:3/928: symlink d1/d34/d42/d5b/l153 0 2024-09-21T12:47:07.030 INFO:tasks.workunit.client.1.smithi176.stdout:7/936: write d0/d2/db/d10/d72/d94/f9a [615852,92809] 0 2024-09-21T12:47:07.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/317: dwrite d1/d13/d25/d29/d33/f41 [4194304,4194304] 0 2024-09-21T12:47:07.036 INFO:tasks.workunit.client.0.smithi046.stdout:4/318: dread d1/d27/d58/f4c [0,4194304] 0 2024-09-21T12:47:07.037 INFO:tasks.workunit.client.1.smithi176.stdout:1/820: sync 2024-09-21T12:47:07.038 INFO:tasks.workunit.client.1.smithi176.stdout:7/937: dwrite d0/d2/db/d10/d23/da6/d105/f119 [0,4194304] 0 2024-09-21T12:47:07.045 INFO:tasks.workunit.client.1.smithi176.stdout:5/722: symlink d0/d13/d5d/d98/le8 0 2024-09-21T12:47:07.047 INFO:tasks.workunit.client.0.smithi046.stdout:9/276: creat d11/d19/f4d x:0 0 0 2024-09-21T12:47:07.048 INFO:tasks.workunit.client.1.smithi176.stdout:8/766: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:47:07.049 INFO:tasks.workunit.client.1.smithi176.stdout:5/723: truncate d0/d13/d63/d8d/ddc/d41/fcc 501542 0 2024-09-21T12:47:07.050 INFO:tasks.workunit.client.1.smithi176.stdout:6/770: rename d2/dd/d26/d2b/dac to d2/dd/d26/d2b/d10/df4 0 2024-09-21T12:47:07.056 INFO:tasks.workunit.client.1.smithi176.stdout:5/724: dwrite d0/d10/f4c [4194304,4194304] 0 2024-09-21T12:47:07.059 INFO:tasks.workunit.client.0.smithi046.stdout:9/277: unlink l7 0 2024-09-21T12:47:07.064 INFO:tasks.workunit.client.0.smithi046.stdout:4/319: mknod d1/d13/d25/d29/c6e 0 2024-09-21T12:47:07.067 INFO:tasks.workunit.client.0.smithi046.stdout:9/278: creat d11/d19/d1b/d1c/d1f/d30/f4e x:0 0 0 2024-09-21T12:47:07.069 INFO:tasks.workunit.client.1.smithi176.stdout:7/938: creat d0/d98/de1/f14b x:0 0 0 2024-09-21T12:47:07.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/320: dwrite d1/d13/f30 [0,4194304] 0 2024-09-21T12:47:07.072 INFO:tasks.workunit.client.0.smithi046.stdout:9/279: truncate d11/d19/d1b/d31/f43 258511 0 2024-09-21T12:47:07.074 INFO:tasks.workunit.client.1.smithi176.stdout:2/829: truncate d4/df/dc4/ff2 135698 0 2024-09-21T12:47:07.075 INFO:tasks.workunit.client.1.smithi176.stdout:5/725: mknod d0/d13/ce9 0 2024-09-21T12:47:07.077 INFO:tasks.workunit.client.1.smithi176.stdout:4/802: link d3/d5/lcb d3/d21/d88/l11d 0 2024-09-21T12:47:07.077 INFO:tasks.workunit.client.0.smithi046.stdout:5/296: dwrite d4/d16/f36 [0,4194304] 0 2024-09-21T12:47:07.078 INFO:tasks.workunit.client.1.smithi176.stdout:4/803: fdatasync d3/d5/f13 0 2024-09-21T12:47:07.081 INFO:tasks.workunit.client.1.smithi176.stdout:9/828: rmdir d1/d8b/de1 0 2024-09-21T12:47:07.082 INFO:tasks.workunit.client.0.smithi046.stdout:4/321: creat d1/d27/d37/f6f x:0 0 0 2024-09-21T12:47:07.083 INFO:tasks.workunit.client.0.smithi046.stdout:9/280: dwrite f6 [4194304,4194304] 0 2024-09-21T12:47:07.084 INFO:tasks.workunit.client.1.smithi176.stdout:1/821: truncate d0/db/d6a/fac 1279667 0 2024-09-21T12:47:07.084 INFO:tasks.workunit.client.0.smithi046.stdout:4/322: read - d1/d13/d25/d29/d33/f62 zero size 2024-09-21T12:47:07.087 INFO:tasks.workunit.client.0.smithi046.stdout:1/261: write d4/d13/f28 [451746,67619] 0 2024-09-21T12:47:07.089 INFO:tasks.workunit.client.0.smithi046.stdout:6/274: truncate de/f45 3413175 0 2024-09-21T12:47:07.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/275: dread - de/f4b zero size 2024-09-21T12:47:07.095 INFO:tasks.workunit.client.0.smithi046.stdout:4/323: dwrite d1/f2a [0,4194304] 0 2024-09-21T12:47:07.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/324: fsync d1/d27/d37/f63 0 2024-09-21T12:47:07.097 INFO:tasks.workunit.client.1.smithi176.stdout:5/726: creat d0/d13/d63/d8d/daf/fea x:0 0 0 2024-09-21T12:47:07.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/325: stat d1/d13/d25 0 2024-09-21T12:47:07.098 INFO:tasks.workunit.client.1.smithi176.stdout:5/727: chown d0/d13/d63/d72/d87/d92/cc8 246 1 2024-09-21T12:47:07.099 INFO:tasks.workunit.client.0.smithi046.stdout:9/281: rename d11/c14 to d11/d19/d1b/d31/d44/c4f 0 2024-09-21T12:47:07.099 INFO:tasks.workunit.client.1.smithi176.stdout:4/804: dread - d3/d21/d97/fd4 zero size 2024-09-21T12:47:07.099 INFO:tasks.workunit.client.1.smithi176.stdout:5/728: dread - d0/d13/d63/d2e/d71/fc7 zero size 2024-09-21T12:47:07.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/262: dwrite d4/d29/d32/f40 [0,4194304] 0 2024-09-21T12:47:07.101 INFO:tasks.workunit.client.1.smithi176.stdout:4/805: dread - d3/d42/d56/d4e/f119 zero size 2024-09-21T12:47:07.102 INFO:tasks.workunit.client.1.smithi176.stdout:9/829: mkdir d1/d61/d118 0 2024-09-21T12:47:07.105 INFO:tasks.workunit.client.1.smithi176.stdout:4/806: fdatasync d3/d42/d56/d101/d107/d96/da3/fa5 0 2024-09-21T12:47:07.105 INFO:tasks.workunit.client.1.smithi176.stdout:7/939: link d0/d2/fb7 d0/d2/d30/df4/f14c 0 2024-09-21T12:47:07.107 INFO:tasks.workunit.client.1.smithi176.stdout:0/935: dwrite d9/d1a/d1d/d23/da1/da3/fd5 [0,4194304] 0 2024-09-21T12:47:07.107 INFO:tasks.workunit.client.0.smithi046.stdout:4/326: fdatasync d1/f57 0 2024-09-21T12:47:07.109 INFO:tasks.workunit.client.0.smithi046.stdout:9/282: symlink d11/d19/d20/l50 0 2024-09-21T12:47:07.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/283: chown d11/l17 30 1 2024-09-21T12:47:07.113 INFO:tasks.workunit.client.1.smithi176.stdout:5/729: creat d0/d13/d5d/feb x:0 0 0 2024-09-21T12:47:07.116 INFO:tasks.workunit.client.1.smithi176.stdout:5/730: write d0/d13/d63/d72/fde [678337,22646] 0 2024-09-21T12:47:07.117 INFO:tasks.workunit.client.1.smithi176.stdout:3/929: dwrite d1/d34/d71/d91/df6/fff [0,4194304] 0 2024-09-21T12:47:07.117 INFO:tasks.workunit.client.1.smithi176.stdout:9/830: fdatasync d1/f2f 0 2024-09-21T12:47:07.120 INFO:tasks.workunit.client.1.smithi176.stdout:1/822: creat d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/ded/f12d x:0 0 0 2024-09-21T12:47:07.120 INFO:tasks.workunit.client.1.smithi176.stdout:4/807: symlink d3/d42/d56/d4e/df8/l11e 0 2024-09-21T12:47:07.124 INFO:tasks.workunit.client.1.smithi176.stdout:1/823: read d0/db/d1a/d2c/d84/fd4 [277764,114519] 0 2024-09-21T12:47:07.125 INFO:tasks.workunit.client.1.smithi176.stdout:7/940: fdatasync d0/d2/db/d10/d23/f8e 0 2024-09-21T12:47:07.127 INFO:tasks.workunit.client.1.smithi176.stdout:0/936: creat d9/d1a/d1d/d23/da1/da3/d93/df9/d75/df8/f14a x:0 0 0 2024-09-21T12:47:07.129 INFO:tasks.workunit.client.1.smithi176.stdout:8/767: getdents d6/d16 0 2024-09-21T12:47:07.129 INFO:tasks.workunit.client.1.smithi176.stdout:0/937: write d9/d1a/d1d/d23/da1/da3/f13 [3992143,16947] 0 2024-09-21T12:47:07.129 INFO:tasks.workunit.client.1.smithi176.stdout:8/768: chown d6/d8/d24/f82 346 1 2024-09-21T12:47:07.130 INFO:tasks.workunit.client.1.smithi176.stdout:2/830: rmdir d4/df/d2e/d39/db7/d80/dda/dfd 0 2024-09-21T12:47:07.130 INFO:tasks.workunit.client.1.smithi176.stdout:6/771: truncate d2/dd/d79/f91 1021533 0 2024-09-21T12:47:07.131 INFO:tasks.workunit.client.1.smithi176.stdout:2/831: dread d4/f64 [0,4194304] 0 2024-09-21T12:47:07.134 INFO:tasks.workunit.client.1.smithi176.stdout:3/930: creat d1/d34/d71/f154 x:0 0 0 2024-09-21T12:47:07.135 INFO:tasks.workunit.client.1.smithi176.stdout:5/731: creat d0/d13/d63/d8d/ddc/dd5/fec x:0 0 0 2024-09-21T12:47:07.135 INFO:tasks.workunit.client.1.smithi176.stdout:9/831: mknod d1/df/d48/d69/d76/d7c/d9e/c119 0 2024-09-21T12:47:07.138 INFO:tasks.workunit.client.1.smithi176.stdout:4/808: rename d3/d42/d4d/fa0 to d3/d42/d47/dab/f11f 0 2024-09-21T12:47:07.138 INFO:tasks.workunit.client.1.smithi176.stdout:4/809: chown d3/d42/d47/d5c 5 1 2024-09-21T12:47:07.141 INFO:tasks.workunit.client.1.smithi176.stdout:0/938: symlink d9/d1a/d1d/d23/da1/da3/d1e/dbf/d120/l14b 0 2024-09-21T12:47:07.141 INFO:tasks.workunit.client.1.smithi176.stdout:8/769: mkdir d6/d16/d79/df0 0 2024-09-21T12:47:07.143 INFO:tasks.workunit.client.1.smithi176.stdout:6/772: creat d2/d6f/ff5 x:0 0 0 2024-09-21T12:47:07.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/276: dwrite de/f1d [0,4194304] 0 2024-09-21T12:47:07.144 INFO:tasks.workunit.client.0.smithi046.stdout:6/277: chown fa 251 1 2024-09-21T12:47:07.144 INFO:tasks.workunit.client.1.smithi176.stdout:7/941: dwrite d0/d2/db/d10/d23/dce/f86 [0,4194304] 0 2024-09-21T12:47:07.146 INFO:tasks.workunit.client.1.smithi176.stdout:3/931: mkdir d1/d5/d25/d61/d155 0 2024-09-21T12:47:07.146 INFO:tasks.workunit.client.0.smithi046.stdout:2/294: sync 2024-09-21T12:47:07.151 INFO:tasks.workunit.client.0.smithi046.stdout:6/278: creat de/d2a/d4c/f58 x:0 0 0 2024-09-21T12:47:07.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/295: mknod d16/d22/d38/c54 0 2024-09-21T12:47:07.156 INFO:tasks.workunit.client.0.smithi046.stdout:6/279: mknod de/d2a/d34/c59 0 2024-09-21T12:47:07.159 INFO:tasks.workunit.client.1.smithi176.stdout:5/732: mknod d0/d13/d63/d2e/d37/db5/db7/ced 0 2024-09-21T12:47:07.160 INFO:tasks.workunit.client.0.smithi046.stdout:6/280: symlink de/d2a/d34/d4e/l5a 0 2024-09-21T12:47:07.160 INFO:tasks.workunit.client.0.smithi046.stdout:2/296: dwrite d16/f27 [0,4194304] 0 2024-09-21T12:47:07.161 INFO:tasks.workunit.client.0.smithi046.stdout:4/327: truncate d1/d27/d58/f5c 1842809 0 2024-09-21T12:47:07.166 INFO:tasks.workunit.client.0.smithi046.stdout:6/281: dread fb [0,4194304] 0 2024-09-21T12:47:07.167 INFO:tasks.workunit.client.0.smithi046.stdout:4/328: dread d1/d27/d37/f49 [0,4194304] 0 2024-09-21T12:47:07.167 INFO:tasks.workunit.client.1.smithi176.stdout:0/939: mknod d9/d1a/d1d/d23/da1/da3/d93/df9/d75/c14c 0 2024-09-21T12:47:07.167 INFO:tasks.workunit.client.1.smithi176.stdout:0/940: chown d9/d1a/d1d/d23/c69 70082734 1 2024-09-21T12:47:07.168 INFO:tasks.workunit.client.0.smithi046.stdout:9/284: truncate d11/d19/d1b/d1c/f2e 5398753 0 2024-09-21T12:47:07.173 INFO:tasks.workunit.client.0.smithi046.stdout:6/282: dwrite f3 [0,4194304] 0 2024-09-21T12:47:07.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/329: dwrite d1/d13/f31 [0,4194304] 0 2024-09-21T12:47:07.175 INFO:tasks.workunit.client.1.smithi176.stdout:0/941: dwrite d9/d1a/db8/fda [0,4194304] 0 2024-09-21T12:47:07.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/297: creat d16/d22/d4e/f55 x:0 0 0 2024-09-21T12:47:07.181 INFO:tasks.workunit.client.1.smithi176.stdout:7/942: rename d0/d2/d30/df4/d121/d141/d148/d106 to d0/d2/d30/d93/d96/d89/d14d 0 2024-09-21T12:47:07.187 INFO:tasks.workunit.client.0.smithi046.stdout:6/283: dread - de/f20 zero size 2024-09-21T12:47:07.188 INFO:tasks.workunit.client.0.smithi046.stdout:6/284: write de/f32 [2706775,79816] 0 2024-09-21T12:47:07.189 INFO:tasks.workunit.client.0.smithi046.stdout:6/285: dread - de/d2a/d34/f37 zero size 2024-09-21T12:47:07.190 INFO:tasks.workunit.client.0.smithi046.stdout:4/330: chown d1/d13/d25/l6d 637755 1 2024-09-21T12:47:07.190 INFO:tasks.workunit.client.1.smithi176.stdout:7/943: dread d0/d2/da8/dbe/f111 [0,4194304] 0 2024-09-21T12:47:07.191 INFO:tasks.workunit.client.1.smithi176.stdout:7/944: stat d0/d98/ca9 0 2024-09-21T12:47:07.197 INFO:tasks.workunit.client.0.smithi046.stdout:9/285: creat d11/d19/d36/d45/f51 x:0 0 0 2024-09-21T12:47:07.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/331: dwrite d1/d27/d58/f53 [0,4194304] 0 2024-09-21T12:47:07.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/286: dread d11/d19/d1b/d31/f43 [0,4194304] 0 2024-09-21T12:47:07.199 INFO:tasks.workunit.client.1.smithi176.stdout:5/733: mknod d0/d13/d63/d2e/d37/db5/db7/ddd/cee 0 2024-09-21T12:47:07.204 INFO:tasks.workunit.client.1.smithi176.stdout:9/832: write d1/df/d48/f94 [317345,120766] 0 2024-09-21T12:47:07.204 INFO:tasks.workunit.client.0.smithi046.stdout:6/286: symlink de/d35/l5b 0 2024-09-21T12:47:07.205 INFO:tasks.workunit.client.0.smithi046.stdout:2/298: mkdir d16/d22/d56 0 2024-09-21T12:47:07.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/332: dwrite d1/d13/f30 [0,4194304] 0 2024-09-21T12:47:07.207 INFO:tasks.workunit.client.1.smithi176.stdout:0/942: creat d9/d1a/db8/d130/f14d x:0 0 0 2024-09-21T12:47:07.207 INFO:tasks.workunit.client.0.smithi046.stdout:9/287: dread f2 [4194304,4194304] 0 2024-09-21T12:47:07.208 INFO:tasks.workunit.client.0.smithi046.stdout:2/299: write d16/f1a [4235985,121334] 0 2024-09-21T12:47:07.211 INFO:tasks.workunit.client.1.smithi176.stdout:1/824: write d0/db/d1a/f21 [2026490,77151] 0 2024-09-21T12:47:07.212 INFO:tasks.workunit.client.1.smithi176.stdout:4/810: sync 2024-09-21T12:47:07.214 INFO:tasks.workunit.client.1.smithi176.stdout:5/734: rename d0/d10/l6d to d0/d13/lef 0 2024-09-21T12:47:07.215 INFO:tasks.workunit.client.1.smithi176.stdout:1/825: chown d0/db/d1a/d2c/dc5/d41/c29 979 1 2024-09-21T12:47:07.215 INFO:tasks.workunit.client.1.smithi176.stdout:0/943: dwrite d9/d1a/d1d/d23/da1/da3/d93/df9/fce [0,4194304] 0 2024-09-21T12:47:07.217 INFO:tasks.workunit.client.1.smithi176.stdout:8/770: write d6/db/d13/f29 [359443,37779] 0 2024-09-21T12:47:07.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/287: rename de/c19 to de/d2a/d4d/c5c 0 2024-09-21T12:47:07.221 INFO:tasks.workunit.client.1.smithi176.stdout:4/811: dread d3/d21/d27/fee [0,4194304] 0 2024-09-21T12:47:07.221 INFO:tasks.workunit.client.1.smithi176.stdout:8/771: read d6/db/d37/d7a/f96 [2704972,2819] 0 2024-09-21T12:47:07.224 INFO:tasks.workunit.client.0.smithi046.stdout:4/333: dread d1/d27/d37/f49 [0,4194304] 0 2024-09-21T12:47:07.226 INFO:tasks.workunit.client.1.smithi176.stdout:0/944: dwrite d9/d1a/d1d/d23/da1/d99/f145 [0,4194304] 0 2024-09-21T12:47:07.233 INFO:tasks.workunit.client.0.smithi046.stdout:4/334: dwrite d1/d13/d25/d29/d33/f41 [0,4194304] 0 2024-09-21T12:47:07.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/300: mknod d16/d22/d2b/c57 0 2024-09-21T12:47:07.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/301: creat d16/d22/d2b/d30/f58 x:0 0 0 2024-09-21T12:47:07.250 INFO:tasks.workunit.client.1.smithi176.stdout:5/735: rename d0/d13/d5d/d98/le8 to d0/lf0 0 2024-09-21T12:47:07.250 INFO:tasks.workunit.client.1.smithi176.stdout:1/826: truncate d0/db/d1a/d2c/d6b/fdc 325875 0 2024-09-21T12:47:07.251 INFO:tasks.workunit.client.1.smithi176.stdout:8/772: mkdir d6/db/d13/d98/df1 0 2024-09-21T12:47:07.252 INFO:tasks.workunit.client.1.smithi176.stdout:7/945: getdents d0/d2/d30/df4/d121/d141/d148/d79 0 2024-09-21T12:47:07.252 INFO:tasks.workunit.client.1.smithi176.stdout:2/832: dwrite d4/df/d2e/d6f/d5d/d67/fc3 [0,4194304] 0 2024-09-21T12:47:07.254 INFO:tasks.workunit.client.1.smithi176.stdout:2/833: chown d4/df/d2e/l88 428408 1 2024-09-21T12:47:07.261 INFO:tasks.workunit.client.1.smithi176.stdout:2/834: dwrite d4/df/df7/fd0 [0,4194304] 0 2024-09-21T12:47:07.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/302: dread d16/d22/d38/f35 [0,4194304] 0 2024-09-21T12:47:07.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/303: fsync f15 0 2024-09-21T12:47:07.279 INFO:tasks.workunit.client.0.smithi046.stdout:4/335: rename d1/d27/d37/c5b to d1/c70 0 2024-09-21T12:47:07.281 INFO:tasks.workunit.client.1.smithi176.stdout:0/945: creat d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2/f14e x:0 0 0 2024-09-21T12:47:07.284 INFO:tasks.workunit.client.1.smithi176.stdout:5/736: mknod d0/d13/d63/d8d/ddc/d41/cf1 0 2024-09-21T12:47:07.285 INFO:tasks.workunit.client.1.smithi176.stdout:8/773: mknod d6/db/d13/d98/cf2 0 2024-09-21T12:47:07.285 INFO:tasks.workunit.client.0.smithi046.stdout:9/288: write d11/d19/d1b/d1c/d1f/d30/d3e/f49 [2613208,129643] 0 2024-09-21T12:47:07.286 INFO:tasks.workunit.client.1.smithi176.stdout:9/833: dwrite d1/f2f [0,4194304] 0 2024-09-21T12:47:07.286 INFO:tasks.workunit.client.1.smithi176.stdout:6/773: sync 2024-09-21T12:47:07.286 INFO:tasks.workunit.client.1.smithi176.stdout:3/932: sync 2024-09-21T12:47:07.286 INFO:tasks.workunit.client.1.smithi176.stdout:8/774: fsync d6/d8/d54/dca/fa7 0 2024-09-21T12:47:07.288 INFO:tasks.workunit.client.1.smithi176.stdout:1/827: mknod d0/db/d1a/d2c/d6b/dd7/c12e 0 2024-09-21T12:47:07.289 INFO:tasks.workunit.client.1.smithi176.stdout:7/946: truncate d0/d2/d30/df4/d121/d141/d148/d79/fb6 891161 0 2024-09-21T12:47:07.289 INFO:tasks.workunit.client.1.smithi176.stdout:1/828: stat d0/db/d1a/d2c/d48/d50/l9e 0 2024-09-21T12:47:07.291 INFO:tasks.workunit.client.0.smithi046.stdout:4/336: symlink d1/d27/l71 0 2024-09-21T12:47:07.292 INFO:tasks.workunit.client.1.smithi176.stdout:2/835: write d4/df/d2e/d39/fd3 [431261,110170] 0 2024-09-21T12:47:07.293 INFO:tasks.workunit.client.0.smithi046.stdout:9/289: symlink d11/d19/d20/l52 0 2024-09-21T12:47:07.294 INFO:tasks.workunit.client.1.smithi176.stdout:2/836: chown d4/df/d2e/d6f/d5d/d67/d9f/f103 795 1 2024-09-21T12:47:07.296 INFO:tasks.workunit.client.0.smithi046.stdout:2/304: creat d16/f59 x:0 0 0 2024-09-21T12:47:07.298 INFO:tasks.workunit.client.0.smithi046.stdout:4/337: symlink d1/d13/l72 0 2024-09-21T12:47:07.299 INFO:tasks.workunit.client.1.smithi176.stdout:5/737: chown d0/d13/d63/c12 311071891 1 2024-09-21T12:47:07.300 INFO:tasks.workunit.client.0.smithi046.stdout:9/290: mkdir d11/d19/d1b/d31/d53 0 2024-09-21T12:47:07.303 INFO:tasks.workunit.client.1.smithi176.stdout:6/774: write d2/d6f/f7c [1107578,94470] 0 2024-09-21T12:47:07.303 INFO:tasks.workunit.client.1.smithi176.stdout:6/775: write d2/d6f/fbb [259487,53843] 0 2024-09-21T12:47:07.304 INFO:tasks.workunit.client.1.smithi176.stdout:4/812: sync 2024-09-21T12:47:07.305 INFO:tasks.workunit.client.1.smithi176.stdout:4/813: stat d3/d5/l63 0 2024-09-21T12:47:07.305 INFO:tasks.workunit.client.0.smithi046.stdout:9/291: dread d11/d19/d1b/d1c/d1f/d30/d3e/f49 [4194304,4194304] 0 2024-09-21T12:47:07.306 INFO:tasks.workunit.client.1.smithi176.stdout:3/933: write d1/d34/d48/deb/db3/f12b [4626561,39293] 0 2024-09-21T12:47:07.310 INFO:tasks.workunit.client.1.smithi176.stdout:1/829: mknod d0/db/d1a/d2c/dc5/d2b/d43/d92/c12f 0 2024-09-21T12:47:07.312 INFO:tasks.workunit.client.1.smithi176.stdout:4/814: dwrite d3/d42/d47/d5c/fa9 [0,4194304] 0 2024-09-21T12:47:07.314 INFO:tasks.workunit.client.1.smithi176.stdout:0/946: write d9/d1a/d1d/d23/da1/fca [826548,72244] 0 2024-09-21T12:47:07.314 INFO:tasks.workunit.client.1.smithi176.stdout:3/934: mkdir d1/d34/d48/deb/dc6/d156 0 2024-09-21T12:47:07.320 INFO:tasks.workunit.client.0.smithi046.stdout:4/338: mknod d1/d13/d4e/c73 0 2024-09-21T12:47:07.322 INFO:tasks.workunit.client.1.smithi176.stdout:4/815: unlink d3/d21/d27/cfb 0 2024-09-21T12:47:07.323 INFO:tasks.workunit.client.0.smithi046.stdout:9/292: dwrite d11/d19/d1b/d31/d44/f4c [0,4194304] 0 2024-09-21T12:47:07.323 INFO:tasks.workunit.client.0.smithi046.stdout:4/339: fdatasync d1/f26 0 2024-09-21T12:47:07.324 INFO:tasks.workunit.client.1.smithi176.stdout:5/738: dwrite d0/d13/d63/d8d/ddc/d41/f4f [0,4194304] 0 2024-09-21T12:47:07.325 INFO:tasks.workunit.client.1.smithi176.stdout:4/816: chown d3/d42/d56/d101/d107/d96/ld7 433934 1 2024-09-21T12:47:07.326 INFO:tasks.workunit.client.1.smithi176.stdout:0/947: unlink d9/d1a/d1d/d23/lbe 0 2024-09-21T12:47:07.326 INFO:tasks.workunit.client.1.smithi176.stdout:5/739: chown d0/d13/d63 18 1 2024-09-21T12:47:07.327 INFO:tasks.workunit.client.1.smithi176.stdout:8/775: rename d6/db/d37/d89/d8a/l9d to d6/d16/d36/lf3 0 2024-09-21T12:47:07.331 INFO:tasks.workunit.client.1.smithi176.stdout:8/776: write d6/d8/d24/d35/d51/fd3 [977892,69324] 0 2024-09-21T12:47:07.333 INFO:tasks.workunit.client.1.smithi176.stdout:7/947: link d0/d98/ca9 d0/d5d/d7a/c14e 0 2024-09-21T12:47:07.334 INFO:tasks.workunit.client.1.smithi176.stdout:4/817: dread d3/d42/d56/d101/d107/d96/db2/fc7 [0,4194304] 0 2024-09-21T12:47:07.334 INFO:tasks.workunit.client.1.smithi176.stdout:0/948: dread d9/d1a/d3f/d40/d79/f7f [0,4194304] 0 2024-09-21T12:47:07.335 INFO:tasks.workunit.client.1.smithi176.stdout:4/818: write d3/d21/d88/da7/fff [225254,80437] 0 2024-09-21T12:47:07.336 INFO:tasks.workunit.client.1.smithi176.stdout:9/834: getdents d1/df/d48/d69/d40 0 2024-09-21T12:47:07.336 INFO:tasks.workunit.client.1.smithi176.stdout:4/819: chown d3/d21/d27/fc6 0 1 2024-09-21T12:47:07.338 INFO:tasks.workunit.client.0.smithi046.stdout:4/340: creat d1/f74 x:0 0 0 2024-09-21T12:47:07.339 INFO:tasks.workunit.client.1.smithi176.stdout:3/935: getdents d1/d34/d48/deb/dc6/d156 0 2024-09-21T12:47:07.339 INFO:tasks.workunit.client.1.smithi176.stdout:1/830: link d0/db/d2a/cd1 d0/db/d1a/d73/c130 0 2024-09-21T12:47:07.342 INFO:tasks.workunit.client.1.smithi176.stdout:3/936: write d1/d3e/fbe [1161787,67198] 0 2024-09-21T12:47:07.342 INFO:tasks.workunit.client.0.smithi046.stdout:4/341: creat d1/f75 x:0 0 0 2024-09-21T12:47:07.344 INFO:tasks.workunit.client.1.smithi176.stdout:8/777: mknod d6/d8/d24/d35/cf4 0 2024-09-21T12:47:07.344 INFO:tasks.workunit.client.1.smithi176.stdout:7/948: dwrite d0/d2/d30/d93/d96/d89/dcf/f139 [0,4194304] 0 2024-09-21T12:47:07.346 INFO:tasks.workunit.client.1.smithi176.stdout:2/837: rename d4/df/d2e/d6f/l87 to d4/d3d/l107 0 2024-09-21T12:47:07.348 INFO:tasks.workunit.client.1.smithi176.stdout:1/831: getdents d0/d91/dd3/d11e 0 2024-09-21T12:47:07.350 INFO:tasks.workunit.client.1.smithi176.stdout:5/740: getdents d0/d13/d63/d8d/daf 0 2024-09-21T12:47:07.351 INFO:tasks.workunit.client.1.smithi176.stdout:8/778: creat d6/d16/d36/d67/ff5 x:0 0 0 2024-09-21T12:47:07.352 INFO:tasks.workunit.client.1.smithi176.stdout:4/820: dwrite d3/d5/f13 [4194304,4194304] 0 2024-09-21T12:47:07.353 INFO:tasks.workunit.client.1.smithi176.stdout:5/741: fsync d0/d13/d63/d2e/f46 0 2024-09-21T12:47:07.353 INFO:tasks.workunit.client.1.smithi176.stdout:2/838: unlink d4/d3d/f5b 0 2024-09-21T12:47:07.356 INFO:tasks.workunit.client.1.smithi176.stdout:6/776: rename d2/d63/f53 to d2/dd/d26/d2b/d10/d87/ff6 0 2024-09-21T12:47:07.358 INFO:tasks.workunit.client.1.smithi176.stdout:6/777: stat d2/dd/d79/fab 0 2024-09-21T12:47:07.360 INFO:tasks.workunit.client.0.smithi046.stdout:9/293: truncate d11/d19/d1b/d31/d44/f4c 3965632 0 2024-09-21T12:47:07.360 INFO:tasks.workunit.client.1.smithi176.stdout:1/832: dread d0/db/d1a/d73/f95 [4194304,4194304] 0 2024-09-21T12:47:07.361 INFO:tasks.workunit.client.0.smithi046.stdout:9/294: chown d11/l17 4 1 2024-09-21T12:47:07.361 INFO:tasks.workunit.client.1.smithi176.stdout:3/937: truncate d1/d34/d48/deb/dc6/ff8 451955 0 2024-09-21T12:47:07.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/342: fsync d1/f74 0 2024-09-21T12:47:07.363 INFO:tasks.workunit.client.0.smithi046.stdout:9/295: write d11/d19/d1b/d31/f40 [689143,35902] 0 2024-09-21T12:47:07.363 INFO:tasks.workunit.client.1.smithi176.stdout:7/949: dread d0/d2/db/f26 [0,4194304] 0 2024-09-21T12:47:07.367 INFO:tasks.workunit.client.1.smithi176.stdout:4/821: symlink d3/d21/d88/l120 0 2024-09-21T12:47:07.367 INFO:tasks.workunit.client.1.smithi176.stdout:5/742: truncate d0/d13/d63/d2e/d37/db5/db7/f45 365565 0 2024-09-21T12:47:07.367 INFO:tasks.workunit.client.1.smithi176.stdout:2/839: dwrite d4/df/d2e/d6f/d6d/fe2 [0,4194304] 0 2024-09-21T12:47:07.367 INFO:tasks.workunit.client.0.smithi046.stdout:9/296: dread d11/f12 [0,4194304] 0 2024-09-21T12:47:07.369 INFO:tasks.workunit.client.1.smithi176.stdout:7/950: dread - d0/d2/da8/dbe/f13c zero size 2024-09-21T12:47:07.372 INFO:tasks.workunit.client.0.smithi046.stdout:4/343: creat d1/d13/d25/d29/d33/f76 x:0 0 0 2024-09-21T12:47:07.373 INFO:tasks.workunit.client.1.smithi176.stdout:7/951: chown d0/d2/db/d10/d23/da6/d12b 10591 1 2024-09-21T12:47:07.374 INFO:tasks.workunit.client.1.smithi176.stdout:2/840: readlink d4/df/d2e/d6f/d5d/d67/dd6/lfb 0 2024-09-21T12:47:07.375 INFO:tasks.workunit.client.0.smithi046.stdout:9/297: unlink d11/d19/d1b/d1c/d1f/d30/l34 0 2024-09-21T12:47:07.375 INFO:tasks.workunit.client.1.smithi176.stdout:6/778: dwrite d2/dd/d26/d2b/fb0 [0,4194304] 0 2024-09-21T12:47:07.378 INFO:tasks.workunit.client.1.smithi176.stdout:9/835: dwrite d1/df/d48/f89 [0,4194304] 0 2024-09-21T12:47:07.378 INFO:tasks.workunit.client.1.smithi176.stdout:1/833: dread - d0/db/d1a/d2c/dc5/d41/d59/d9b/fa9 zero size 2024-09-21T12:47:07.380 INFO:tasks.workunit.client.0.smithi046.stdout:4/344: read d1/d13/f30 [1714139,57872] 0 2024-09-21T12:47:07.385 INFO:tasks.workunit.client.0.smithi046.stdout:9/298: dwrite d11/d19/d1b/f3f [0,4194304] 0 2024-09-21T12:47:07.386 INFO:tasks.workunit.client.1.smithi176.stdout:6/779: dwrite d2/d6f/ff5 [0,4194304] 0 2024-09-21T12:47:07.388 INFO:tasks.workunit.client.0.smithi046.stdout:4/345: dread d1/f2a [0,4194304] 0 2024-09-21T12:47:07.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/346: chown d1/l18 29 1 2024-09-21T12:47:07.394 INFO:tasks.workunit.client.1.smithi176.stdout:5/743: creat d0/d13/d63/d2e/d37/d55/ff2 x:0 0 0 2024-09-21T12:47:07.396 INFO:tasks.workunit.client.1.smithi176.stdout:8/779: dwrite d6/db/d13/f31 [0,4194304] 0 2024-09-21T12:47:07.403 INFO:tasks.workunit.client.1.smithi176.stdout:1/834: chown d0/db/d1a/d2c/d84/c109 22658571 1 2024-09-21T12:47:07.407 INFO:tasks.workunit.client.0.smithi046.stdout:9/299: rename d11/d19/d1b/d1c/d1f/d30/f4e to d11/f54 0 2024-09-21T12:47:07.407 INFO:tasks.workunit.client.1.smithi176.stdout:6/780: creat d2/dd/d79/ff7 x:0 0 0 2024-09-21T12:47:07.410 INFO:tasks.workunit.client.1.smithi176.stdout:4/822: truncate d3/d21/d27/f7d 1575337 0 2024-09-21T12:47:07.410 INFO:tasks.workunit.client.1.smithi176.stdout:5/744: mknod d0/d13/d63/d2e/d37/d55/cf3 0 2024-09-21T12:47:07.411 INFO:tasks.workunit.client.0.smithi046.stdout:9/300: getdents d11/d19/d1b/d31/d53 0 2024-09-21T12:47:07.411 INFO:tasks.workunit.client.1.smithi176.stdout:9/836: dread d1/df/d48/d69/d38/f43 [0,4194304] 0 2024-09-21T12:47:07.412 INFO:tasks.workunit.client.1.smithi176.stdout:8/780: fdatasync d6/d16/d36/d7d/d81/fa4 0 2024-09-21T12:47:07.413 INFO:tasks.workunit.client.1.smithi176.stdout:7/952: mkdir d0/d2/db/d10/d72/d7e/d11f/d14f 0 2024-09-21T12:47:07.413 INFO:tasks.workunit.client.0.smithi046.stdout:9/301: symlink d11/d19/d1b/l55 0 2024-09-21T12:47:07.413 INFO:tasks.workunit.client.1.smithi176.stdout:0/949: sync 2024-09-21T12:47:07.414 INFO:tasks.workunit.client.0.smithi046.stdout:9/302: stat d11/l17 0 2024-09-21T12:47:07.414 INFO:tasks.workunit.client.1.smithi176.stdout:4/823: truncate d3/d42/d56/d101/d107/d96/da3/fca 1366285 0 2024-09-21T12:47:07.414 INFO:tasks.workunit.client.1.smithi176.stdout:7/953: fdatasync d0/d2/db/d10/f2c 0 2024-09-21T12:47:07.416 INFO:tasks.workunit.client.1.smithi176.stdout:0/950: truncate d9/d1a/d3f/d10d/dcc/f134 1308365 0 2024-09-21T12:47:07.418 INFO:tasks.workunit.client.0.smithi046.stdout:9/303: creat d11/d19/d1b/d4b/f56 x:0 0 0 2024-09-21T12:47:07.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/304: dread - d11/d19/d1b/d4b/f56 zero size 2024-09-21T12:47:07.419 INFO:tasks.workunit.client.1.smithi176.stdout:1/835: readlink d0/db/d1a/l3e 0 2024-09-21T12:47:07.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/347: truncate d1/d13/d25/d3a/f3c 3887767 0 2024-09-21T12:47:07.421 INFO:tasks.workunit.client.0.smithi046.stdout:9/305: rmdir d11/d19/d1b/d31 39 2024-09-21T12:47:07.422 INFO:tasks.workunit.client.1.smithi176.stdout:9/837: mkdir d1/d61/d11a 0 2024-09-21T12:47:07.424 INFO:tasks.workunit.client.0.smithi046.stdout:4/348: creat d1/d27/d46/f77 x:0 0 0 2024-09-21T12:47:07.425 INFO:tasks.workunit.client.1.smithi176.stdout:3/938: truncate d1/d34/d57/dd0/d7d/f80 4041130 0 2024-09-21T12:47:07.431 INFO:tasks.workunit.client.1.smithi176.stdout:8/781: mkdir d6/d8/d54/df6 0 2024-09-21T12:47:07.431 INFO:tasks.workunit.client.1.smithi176.stdout:8/782: stat d6/db/d37 0 2024-09-21T12:47:07.432 INFO:tasks.workunit.client.1.smithi176.stdout:2/841: truncate d4/df/d2e/d6f/d5d/ffe 1318994 0 2024-09-21T12:47:07.434 INFO:tasks.workunit.client.1.smithi176.stdout:2/842: truncate d4/df/d2e/d4d/d70/fb3 4946925 0 2024-09-21T12:47:07.434 INFO:tasks.workunit.client.1.smithi176.stdout:7/954: read d0/d2/db/d10/d72/d7e/fe0 [76613,54491] 0 2024-09-21T12:47:07.436 INFO:tasks.workunit.client.0.smithi046.stdout:9/306: rename d11/d19/d1b/l22 to d11/d19/d1b/l57 0 2024-09-21T12:47:07.438 INFO:tasks.workunit.client.1.smithi176.stdout:0/951: creat d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2/f14f x:0 0 0 2024-09-21T12:47:07.442 INFO:tasks.workunit.client.1.smithi176.stdout:1/836: truncate d0/db/fa7 584977 0 2024-09-21T12:47:07.442 INFO:tasks.workunit.client.0.smithi046.stdout:9/307: read d11/d19/d1b/d31/f43 [185770,83203] 0 2024-09-21T12:47:07.443 INFO:tasks.workunit.client.1.smithi176.stdout:5/745: symlink d0/d13/d63/d8d/ddc/de7/lf4 0 2024-09-21T12:47:07.447 INFO:tasks.workunit.client.1.smithi176.stdout:5/746: dread d0/d10/d70/f8b [0,4194304] 0 2024-09-21T12:47:07.448 INFO:tasks.workunit.client.0.smithi046.stdout:4/349: dwrite d1/f2a [0,4194304] 0 2024-09-21T12:47:07.448 INFO:tasks.workunit.client.1.smithi176.stdout:5/747: fsync d0/d13/d63/d2e/d37/d55/ff2 0 2024-09-21T12:47:07.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/350: chown d1/d13/d25/d3a/l60 0 1 2024-09-21T12:47:07.451 INFO:tasks.workunit.client.0.smithi046.stdout:9/308: mkdir d11/d19/d1b/d31/d53/d58 0 2024-09-21T12:47:07.452 INFO:tasks.workunit.client.1.smithi176.stdout:3/939: dread d1/d5/d25/f26 [0,4194304] 0 2024-09-21T12:47:07.453 INFO:tasks.workunit.client.0.smithi046.stdout:4/351: mkdir d1/d27/d46/d78 0 2024-09-21T12:47:07.454 INFO:tasks.workunit.client.1.smithi176.stdout:6/781: truncate d2/dd/d26/d2b/d10/d1b/d37/f4f 1609310 0 2024-09-21T12:47:07.455 INFO:tasks.workunit.client.0.smithi046.stdout:4/352: chown d1/d13/d25/d29/d33/f65 2 1 2024-09-21T12:47:07.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/309: mkdir d11/d19/d1b/d31/d44/d59 0 2024-09-21T12:47:07.461 INFO:tasks.workunit.client.0.smithi046.stdout:9/310: rmdir d11/d19/d1b/d31 39 2024-09-21T12:47:07.467 INFO:tasks.workunit.client.0.smithi046.stdout:9/311: creat d11/d19/d1b/d31/f5a x:0 0 0 2024-09-21T12:47:07.468 INFO:tasks.workunit.client.0.smithi046.stdout:9/312: dread - d11/d19/d1b/d31/f5a zero size 2024-09-21T12:47:07.472 INFO:tasks.workunit.client.0.smithi046.stdout:9/313: mkdir d11/d5b 0 2024-09-21T12:47:07.484 INFO:tasks.workunit.client.0.smithi046.stdout:4/353: dwrite d1/d27/d58/f5c [0,4194304] 0 2024-09-21T12:47:07.485 INFO:tasks.workunit.client.0.smithi046.stdout:4/354: write d1/ff [4745738,85836] 0 2024-09-21T12:47:07.492 INFO:tasks.workunit.client.0.smithi046.stdout:4/355: mknod d1/d27/d46/d78/c79 0 2024-09-21T12:47:07.496 INFO:tasks.workunit.client.0.smithi046.stdout:4/356: rename d1/d27/d37/f6f to d1/d13/d25/d29/d43/f7a 0 2024-09-21T12:47:07.506 INFO:tasks.workunit.client.1.smithi176.stdout:8/783: creat d6/db/d13/d98/dde/ff7 x:0 0 0 2024-09-21T12:47:07.506 INFO:tasks.workunit.client.0.smithi046.stdout:9/314: dread d11/d19/d1b/d1c/f2e [0,4194304] 0 2024-09-21T12:47:07.507 INFO:tasks.workunit.client.0.smithi046.stdout:4/357: link d1/d13/d25/d3a/l60 d1/d13/d25/d29/l7b 0 2024-09-21T12:47:07.508 INFO:tasks.workunit.client.1.smithi176.stdout:2/843: readlink d4/df/d2e/d39/db7/lc6 0 2024-09-21T12:47:07.511 INFO:tasks.workunit.client.1.smithi176.stdout:1/837: read - d0/db/d1a/d2c/dc5/d41/d59/d9b/fb2 zero size 2024-09-21T12:47:07.513 INFO:tasks.workunit.client.1.smithi176.stdout:9/838: mknod d1/c11b 0 2024-09-21T12:47:07.514 INFO:tasks.workunit.client.1.smithi176.stdout:7/955: dread d0/d2/db/d10/d23/da6/d12b/fdf [0,4194304] 0 2024-09-21T12:47:07.515 INFO:tasks.workunit.client.1.smithi176.stdout:3/940: symlink d1/d5/d25/d61/l157 0 2024-09-21T12:47:07.515 INFO:tasks.workunit.client.1.smithi176.stdout:6/782: rmdir d2/dd/d26/d2b/d10/d1b 39 2024-09-21T12:47:07.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/315: dwrite d11/d19/d36/d45/f51 [0,4194304] 0 2024-09-21T12:47:07.516 INFO:tasks.workunit.client.0.smithi046.stdout:4/358: dwrite d1/d27/d58/f5c [0,4194304] 0 2024-09-21T12:47:07.526 INFO:tasks.workunit.client.1.smithi176.stdout:8/784: unlink d6/d16/d36/d67/f85 0 2024-09-21T12:47:07.528 INFO:tasks.workunit.client.1.smithi176.stdout:4/824: rename d3/d21/d88/da7/c105 to d3/d42/d56/d101/d107/d96/c121 0 2024-09-21T12:47:07.531 INFO:tasks.workunit.client.0.smithi046.stdout:9/316: rename d11/d19/d1b/d1c/d1f/c28 to d11/d19/d1b/d31/d53/d58/c5c 0 2024-09-21T12:47:07.532 INFO:tasks.workunit.client.1.smithi176.stdout:2/844: truncate d4/d3d/d65/f89 1712033 0 2024-09-21T12:47:07.533 INFO:tasks.workunit.client.1.smithi176.stdout:7/956: dread d0/d2/db/d10/f12 [4194304,4194304] 0 2024-09-21T12:47:07.533 INFO:tasks.workunit.client.1.smithi176.stdout:2/845: fdatasync d4/d3d/fdb 0 2024-09-21T12:47:07.534 INFO:tasks.workunit.client.1.smithi176.stdout:7/957: readlink d0/d5d/d7a/ldb 0 2024-09-21T12:47:07.534 INFO:tasks.workunit.client.1.smithi176.stdout:2/846: chown d4/df/d2e/d4d 17025 1 2024-09-21T12:47:07.535 INFO:tasks.workunit.client.1.smithi176.stdout:1/838: mkdir d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/d131 0 2024-09-21T12:47:07.536 INFO:tasks.workunit.client.0.smithi046.stdout:9/317: creat d11/d19/d1b/d1c/d1f/d30/f5d x:0 0 0 2024-09-21T12:47:07.538 INFO:tasks.workunit.client.1.smithi176.stdout:5/748: truncate d0/d13/d63/d8d/fd7 1820668 0 2024-09-21T12:47:07.538 INFO:tasks.workunit.client.0.smithi046.stdout:9/318: read d11/d19/d1b/d1c/f2f [248834,6725] 0 2024-09-21T12:47:07.539 INFO:tasks.workunit.client.1.smithi176.stdout:3/941: fdatasync d1/d34/ffc 0 2024-09-21T12:47:07.541 INFO:tasks.workunit.client.1.smithi176.stdout:1/839: dwrite d0/fc [0,4194304] 0 2024-09-21T12:47:07.541 INFO:tasks.workunit.client.1.smithi176.stdout:3/942: fdatasync d1/d34/d71/d91/df6/d11f/f12c 0 2024-09-21T12:47:07.543 INFO:tasks.workunit.client.1.smithi176.stdout:3/943: write d1/d5/d25/d40/f113 [1899404,2455] 0 2024-09-21T12:47:07.544 INFO:tasks.workunit.client.0.smithi046.stdout:9/319: mkdir d11/d19/d1b/d31/d53/d5e 0 2024-09-21T12:47:07.548 INFO:tasks.workunit.client.1.smithi176.stdout:0/952: rename d9/d1a/d1d/d23/da1/da3/f5d to d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2/d10e/f150 0 2024-09-21T12:47:07.550 INFO:tasks.workunit.client.0.smithi046.stdout:9/320: creat d11/d19/d1b/d4b/f5f x:0 0 0 2024-09-21T12:47:07.551 INFO:tasks.workunit.client.1.smithi176.stdout:4/825: mknod d3/d42/d56/d4e/c122 0 2024-09-21T12:47:07.553 INFO:tasks.workunit.client.0.smithi046.stdout:9/321: symlink d11/d19/d20/l60 0 2024-09-21T12:47:07.554 INFO:tasks.workunit.client.0.smithi046.stdout:9/322: write d11/d19/d1b/d4b/f56 [337272,49056] 0 2024-09-21T12:47:07.555 INFO:tasks.workunit.client.1.smithi176.stdout:0/953: dread d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/d11d/f122 [0,4194304] 0 2024-09-21T12:47:07.556 INFO:tasks.workunit.client.1.smithi176.stdout:0/954: dread - d9/d1a/d1d/d23/da1/db0/f119 zero size 2024-09-21T12:47:07.556 INFO:tasks.workunit.client.1.smithi176.stdout:0/955: chown d9/d1a/fd0 1068870856 1 2024-09-21T12:47:07.557 INFO:tasks.workunit.client.1.smithi176.stdout:9/839: mknod d1/df/d23/d67/df0/d108/c11c 0 2024-09-21T12:47:07.558 INFO:tasks.workunit.client.1.smithi176.stdout:0/956: read - d9/d1a/d1d/d23/da1/da3/d1e/dbf/d120/f140 zero size 2024-09-21T12:47:07.558 INFO:tasks.workunit.client.0.smithi046.stdout:9/323: dread f2 [0,4194304] 0 2024-09-21T12:47:07.558 INFO:tasks.workunit.client.1.smithi176.stdout:5/749: mknod d0/d13/d63/d2e/d37/cf5 0 2024-09-21T12:47:07.559 INFO:tasks.workunit.client.1.smithi176.stdout:5/750: write d0/fd9 [370394,32332] 0 2024-09-21T12:47:07.560 INFO:tasks.workunit.client.1.smithi176.stdout:5/751: write d0/d13/d63/d72/d87/f89 [719168,6872] 0 2024-09-21T12:47:07.565 INFO:tasks.workunit.client.1.smithi176.stdout:6/783: rename d2/dd/d79/lee to d2/dd/d79/lf8 0 2024-09-21T12:47:07.568 INFO:tasks.workunit.client.1.smithi176.stdout:3/944: mknod d1/d9e/db4/c158 0 2024-09-21T12:47:07.569 INFO:tasks.workunit.client.1.smithi176.stdout:3/945: readlink d1/d34/d57/dd0/l114 0 2024-09-21T12:47:07.569 INFO:tasks.workunit.client.0.smithi046.stdout:9/324: creat d11/f61 x:0 0 0 2024-09-21T12:47:07.570 INFO:tasks.workunit.client.0.smithi046.stdout:9/325: chown d11/d19/d1b/d1c/d1f/l2d 231524213 1 2024-09-21T12:47:07.573 INFO:tasks.workunit.client.1.smithi176.stdout:8/785: dwrite d6/d16/d36/d67/f8e [0,4194304] 0 2024-09-21T12:47:07.574 INFO:tasks.workunit.client.1.smithi176.stdout:7/958: symlink d0/d2/d30/d93/d96/l150 0 2024-09-21T12:47:07.575 INFO:tasks.workunit.client.1.smithi176.stdout:7/959: dread - d0/d5d/d7a/f12a zero size 2024-09-21T12:47:07.575 INFO:tasks.workunit.client.0.smithi046.stdout:9/326: creat d11/d19/d1b/d31/d53/d58/f62 x:0 0 0 2024-09-21T12:47:07.578 INFO:tasks.workunit.client.1.smithi176.stdout:0/957: mkdir d9/d1a/d1d/d23/da1/da3/d1e/de1/d151 0 2024-09-21T12:47:07.578 INFO:tasks.workunit.client.0.smithi046.stdout:9/327: rmdir d11/d19/d1b/d4b 39 2024-09-21T12:47:07.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/328: mknod d11/d19/d20/c63 0 2024-09-21T12:47:07.584 INFO:tasks.workunit.client.1.smithi176.stdout:1/840: mkdir d0/d132 0 2024-09-21T12:47:07.584 INFO:tasks.workunit.client.1.smithi176.stdout:6/784: mknod d2/d6f/d81/cf9 0 2024-09-21T12:47:07.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/329: write d11/d19/d1b/d31/d44/f4c [2950345,123447] 0 2024-09-21T12:47:07.586 INFO:tasks.workunit.client.1.smithi176.stdout:3/946: mkdir d1/d35/d5e/d90/d159 0 2024-09-21T12:47:07.592 INFO:tasks.workunit.client.1.smithi176.stdout:2/847: truncate d4/df/d2e/d6f/f2c 2275094 0 2024-09-21T12:47:07.595 INFO:tasks.workunit.client.0.smithi046.stdout:9/330: dwrite d11/f54 [0,4194304] 0 2024-09-21T12:47:07.598 INFO:tasks.workunit.client.1.smithi176.stdout:1/841: mknod d0/db/d1a/d2c/d48/d108/c133 0 2024-09-21T12:47:07.599 INFO:tasks.workunit.client.0.smithi046.stdout:9/331: fdatasync f6 0 2024-09-21T12:47:07.601 INFO:tasks.workunit.client.1.smithi176.stdout:6/785: stat d2/dd/d26/d2b/d10/d1b 0 2024-09-21T12:47:07.602 INFO:tasks.workunit.client.1.smithi176.stdout:3/947: rmdir d1/d34/d42/d5b 39 2024-09-21T12:47:07.603 INFO:tasks.workunit.client.1.smithi176.stdout:3/948: stat d1/d9e/db4/c12e 0 2024-09-21T12:47:07.604 INFO:tasks.workunit.client.1.smithi176.stdout:4/826: creat d3/d42/d56/d101/d107/d96/f123 x:0 0 0 2024-09-21T12:47:07.604 INFO:tasks.workunit.client.1.smithi176.stdout:6/786: write d2/dd/d26/d2b/d10/d1b/fa2 [4166492,19669] 0 2024-09-21T12:47:07.606 INFO:tasks.workunit.client.0.smithi046.stdout:9/332: read d11/d19/d1b/d4b/f56 [5468,77355] 0 2024-09-21T12:47:07.606 INFO:tasks.workunit.client.1.smithi176.stdout:4/827: write d3/fb1 [4651682,31661] 0 2024-09-21T12:47:07.608 INFO:tasks.workunit.client.1.smithi176.stdout:7/960: mkdir d0/d151 0 2024-09-21T12:47:07.612 INFO:tasks.workunit.client.1.smithi176.stdout:3/949: dread d1/d34/d71/d91/df6/d11f/f12c [0,4194304] 0 2024-09-21T12:47:07.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/333: mkdir d11/d19/d36/d45/d64 0 2024-09-21T12:47:07.613 INFO:tasks.workunit.client.1.smithi176.stdout:3/950: write d1/d34/d57/dd0/d7d/ff4 [5018473,70655] 0 2024-09-21T12:47:07.615 INFO:tasks.workunit.client.1.smithi176.stdout:2/848: mknod d4/df/d83/d8e/deb/c108 0 2024-09-21T12:47:07.616 INFO:tasks.workunit.client.1.smithi176.stdout:2/849: fsync d4/df/d2e/d6f/d5d/d67/f97 0 2024-09-21T12:47:07.617 INFO:tasks.workunit.client.1.smithi176.stdout:2/850: truncate d4/d3d/d65/ff1 663871 0 2024-09-21T12:47:07.619 INFO:tasks.workunit.client.0.smithi046.stdout:9/334: mknod d11/d19/d1b/d1c/d1f/d30/d3e/c65 0 2024-09-21T12:47:07.623 INFO:tasks.workunit.client.0.smithi046.stdout:9/335: symlink d11/d19/d20/d26/l66 0 2024-09-21T12:47:07.625 INFO:tasks.workunit.client.1.smithi176.stdout:6/787: rename d2/dd/d26/d2b/d10/df4 to d2/dd/d26/d2b/d68/dfa 0 2024-09-21T12:47:07.628 INFO:tasks.workunit.client.1.smithi176.stdout:0/958: link d9/d1a/d1d/d23/da1/da3/d93/df9/d75/df8/f104 d9/d1a/d1d/d23/dd3/dee/d141/f152 0 2024-09-21T12:47:07.634 INFO:tasks.workunit.client.1.smithi176.stdout:5/752: getdents d0/d13/d63/d72/d87 0 2024-09-21T12:47:07.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/336: getdents d11/d19/d1b/d31/d44 0 2024-09-21T12:47:07.636 INFO:tasks.workunit.client.1.smithi176.stdout:1/842: dwrite d0/db/d1a/d2c/d84/fa0 [0,4194304] 0 2024-09-21T12:47:07.637 INFO:tasks.workunit.client.1.smithi176.stdout:8/786: getdents d6/db/d37 0 2024-09-21T12:47:07.637 INFO:tasks.workunit.client.1.smithi176.stdout:1/843: stat d0/db/d1a/d2c/d6b/dd7/c12e 0 2024-09-21T12:47:07.640 INFO:tasks.workunit.client.0.smithi046.stdout:9/337: rename d11/d19/d1b/d31/f40 to d11/d19/d36/d45/f67 0 2024-09-21T12:47:07.642 INFO:tasks.workunit.client.0.smithi046.stdout:9/338: write d11/f61 [474320,80196] 0 2024-09-21T12:47:07.644 INFO:tasks.workunit.client.0.smithi046.stdout:9/339: dread d11/d19/d1b/d31/f43 [0,4194304] 0 2024-09-21T12:47:07.645 INFO:tasks.workunit.client.0.smithi046.stdout:9/340: dread - d11/d19/d1b/d1c/f47 zero size 2024-09-21T12:47:07.650 INFO:tasks.workunit.client.0.smithi046.stdout:9/341: unlink d11/d19/d20/c63 0 2024-09-21T12:47:07.651 INFO:tasks.workunit.client.1.smithi176.stdout:4/828: dwrite d3/d42/dae/fc3 [0,4194304] 0 2024-09-21T12:47:07.654 INFO:tasks.workunit.client.1.smithi176.stdout:5/753: creat d0/d13/d63/d8d/daf/ff6 x:0 0 0 2024-09-21T12:47:07.658 INFO:tasks.workunit.client.0.smithi046.stdout:9/342: dwrite d11/f3c [0,4194304] 0 2024-09-21T12:47:07.658 INFO:tasks.workunit.client.1.smithi176.stdout:1/844: truncate d0/db/d1a/d2c/dc5/ff6 5095590 0 2024-09-21T12:47:07.660 INFO:tasks.workunit.client.1.smithi176.stdout:3/951: dwrite d1/d34/d48/deb/dc6/fed [0,4194304] 0 2024-09-21T12:47:07.662 INFO:tasks.workunit.client.1.smithi176.stdout:7/961: creat d0/d2/d30/d93/d96/f152 x:0 0 0 2024-09-21T12:47:07.664 INFO:tasks.workunit.client.1.smithi176.stdout:8/787: dwrite d6/db/da3/fc1 [0,4194304] 0 2024-09-21T12:47:07.664 INFO:tasks.workunit.client.1.smithi176.stdout:0/959: dread d9/d1a/d1d/d23/da1/da3/f50 [0,4194304] 0 2024-09-21T12:47:07.667 INFO:tasks.workunit.client.1.smithi176.stdout:0/960: read - d9/d1a/db8/dd2/f149 zero size 2024-09-21T12:47:07.667 INFO:tasks.workunit.client.1.smithi176.stdout:9/840: sync 2024-09-21T12:47:07.667 INFO:tasks.workunit.client.1.smithi176.stdout:0/961: readlink d9/d1a/d1d/la9 0 2024-09-21T12:47:07.667 INFO:tasks.workunit.client.1.smithi176.stdout:0/962: chown d9/d35/l114 62 1 2024-09-21T12:47:07.670 INFO:tasks.workunit.client.1.smithi176.stdout:4/829: symlink d3/d42/d56/d101/d107/d96/da3/l124 0 2024-09-21T12:47:07.670 INFO:tasks.workunit.client.0.smithi046.stdout:9/343: symlink d11/d19/d1b/d31/l68 0 2024-09-21T12:47:07.670 INFO:tasks.workunit.client.1.smithi176.stdout:2/851: creat d4/d3d/f109 x:0 0 0 2024-09-21T12:47:07.671 INFO:tasks.workunit.client.1.smithi176.stdout:5/754: stat d0/l44 0 2024-09-21T12:47:07.672 INFO:tasks.workunit.client.1.smithi176.stdout:5/755: read - d0/d13/d63/d72/fc2 zero size 2024-09-21T12:47:07.674 INFO:tasks.workunit.client.1.smithi176.stdout:1/845: fdatasync d0/db/d2a/ff1 0 2024-09-21T12:47:07.677 INFO:tasks.workunit.client.1.smithi176.stdout:3/952: creat d1/d34/d5d/dfe/f15a x:0 0 0 2024-09-21T12:47:07.678 INFO:tasks.workunit.client.1.smithi176.stdout:1/846: readlink d0/db/d1a/d2c/dc5/d2b/d43/d92/lc4 0 2024-09-21T12:47:07.680 INFO:tasks.workunit.client.1.smithi176.stdout:6/788: dwrite d2/dd/d26/d2b/d10/d39/f4a [0,4194304] 0 2024-09-21T12:47:07.680 INFO:tasks.workunit.client.0.smithi046.stdout:9/344: mkdir d11/d69 0 2024-09-21T12:47:07.685 INFO:tasks.workunit.client.1.smithi176.stdout:0/963: creat d9/d1a/d1d/d23/da1/da3/d93/df9/d75/f153 x:0 0 0 2024-09-21T12:47:07.689 INFO:tasks.workunit.client.1.smithi176.stdout:3/953: dread d1/d34/d57/dd0/d7d/ff4 [4194304,4194304] 0 2024-09-21T12:47:07.690 INFO:tasks.workunit.client.1.smithi176.stdout:6/789: dread d2/dd/d26/d2b/d10/d39/daf/fd6 [0,4194304] 0 2024-09-21T12:47:07.690 INFO:tasks.workunit.client.1.smithi176.stdout:7/962: dwrite d0/d98/de1/f142 [0,4194304] 0 2024-09-21T12:47:07.692 INFO:tasks.workunit.client.1.smithi176.stdout:4/830: mkdir d3/d42/d56/d101/d125 0 2024-09-21T12:47:07.695 INFO:tasks.workunit.client.1.smithi176.stdout:1/847: dwrite d0/db/d1a/d2c/d37/fd6 [4194304,4194304] 0 2024-09-21T12:47:07.696 INFO:tasks.workunit.client.1.smithi176.stdout:8/788: dwrite d6/d16/d79/fe3 [0,4194304] 0 2024-09-21T12:47:07.698 INFO:tasks.workunit.client.1.smithi176.stdout:3/954: creat d1/d34/d5d/dce/f15b x:0 0 0 2024-09-21T12:47:07.701 INFO:tasks.workunit.client.0.smithi046.stdout:9/345: dread d11/d19/d1b/d1c/f2f [0,4194304] 0 2024-09-21T12:47:07.702 INFO:tasks.workunit.client.1.smithi176.stdout:4/831: chown d3/d42/d4d/f9e 17 1 2024-09-21T12:47:07.703 INFO:tasks.workunit.client.1.smithi176.stdout:8/789: mknod d6/d16/cf8 0 2024-09-21T12:47:07.703 INFO:tasks.workunit.client.1.smithi176.stdout:6/790: mknod d2/dd5/cfb 0 2024-09-21T12:47:07.705 INFO:tasks.workunit.client.1.smithi176.stdout:1/848: mknod d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3/c134 0 2024-09-21T12:47:07.710 INFO:tasks.workunit.client.1.smithi176.stdout:9/841: link d1/fd d1/df/d48/d69/d76/d7c/d9e/f11d 0 2024-09-21T12:47:07.711 INFO:tasks.workunit.client.1.smithi176.stdout:9/842: stat d1/df/fef 0 2024-09-21T12:47:07.712 INFO:tasks.workunit.client.0.smithi046.stdout:9/346: symlink d11/d19/d1b/d1c/l6a 0 2024-09-21T12:47:07.715 INFO:tasks.workunit.client.1.smithi176.stdout:4/832: symlink d3/d42/d56/d101/d107/d96/da3/l126 0 2024-09-21T12:47:07.767 INFO:tasks.workunit.client.0.smithi046.stdout:8/271: sync 2024-09-21T12:47:07.767 INFO:tasks.workunit.client.0.smithi046.stdout:9/347: mknod d11/d19/d1b/d31/d53/d58/c6b 0 2024-09-21T12:47:07.770 INFO:tasks.workunit.client.1.smithi176.stdout:6/791: creat d2/dd/d26/d2b/d10/d1b/d37/ffc x:0 0 0 2024-09-21T12:47:07.770 INFO:tasks.workunit.client.1.smithi176.stdout:2/852: truncate d4/df/df7/f5c 2640902 0 2024-09-21T12:47:07.771 INFO:tasks.workunit.client.0.smithi046.stdout:8/272: fsync d1/d12/d1a/d33/f38 0 2024-09-21T12:47:07.772 INFO:tasks.workunit.client.0.smithi046.stdout:8/273: chown d1/d12/f19 2902 1 2024-09-21T12:47:07.781 INFO:tasks.workunit.client.1.smithi176.stdout:0/964: link d9/d1a/c147 d9/d1a/d1d/d23/da1/da3/d8f/d91/c154 0 2024-09-21T12:47:07.782 INFO:tasks.workunit.client.0.smithi046.stdout:8/274: mkdir d1/d12/d53/d60 0 2024-09-21T12:47:07.783 INFO:tasks.workunit.client.1.smithi176.stdout:0/965: fsync d9/d1a/d1d/d23/da1/da3/fd5 0 2024-09-21T12:47:07.784 INFO:tasks.workunit.client.1.smithi176.stdout:8/790: creat d6/de7/ff9 x:0 0 0 2024-09-21T12:47:07.785 INFO:tasks.workunit.client.1.smithi176.stdout:0/966: chown d9/d1a/db8/dd2/l125 1 1 2024-09-21T12:47:07.786 INFO:tasks.workunit.client.1.smithi176.stdout:7/963: dwrite d0/d2/db/d10/f137 [4194304,4194304] 0 2024-09-21T12:47:07.787 INFO:tasks.workunit.client.1.smithi176.stdout:6/792: mknod d2/d6f/d7f/dbf/cfd 0 2024-09-21T12:47:07.787 INFO:tasks.workunit.client.1.smithi176.stdout:0/967: write d9/f14 [9035877,18278] 0 2024-09-21T12:47:07.787 INFO:tasks.workunit.client.0.smithi046.stdout:9/348: link d11/d19/d1b/d1c/d1f/c2c d11/d5b/c6c 0 2024-09-21T12:47:07.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/349: write d11/d19/d1b/f25 [2666809,78148] 0 2024-09-21T12:47:07.790 INFO:tasks.workunit.client.0.smithi046.stdout:8/275: dread d1/d12/d46/f37 [0,4194304] 0 2024-09-21T12:47:07.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/350: fsync d11/d19/f4d 0 2024-09-21T12:47:07.790 INFO:tasks.workunit.client.1.smithi176.stdout:4/833: mkdir d3/d42/d47/d5c/dec/d127 0 2024-09-21T12:47:07.793 INFO:tasks.workunit.client.1.smithi176.stdout:3/955: dwrite d1/d34/d42/fdd [0,4194304] 0 2024-09-21T12:47:07.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/351: symlink d11/d19/d1b/d1c/d1f/l6d 0 2024-09-21T12:47:07.797 INFO:tasks.workunit.client.1.smithi176.stdout:9/843: creat d1/df/f11e x:0 0 0 2024-09-21T12:47:07.797 INFO:tasks.workunit.client.1.smithi176.stdout:5/756: sync 2024-09-21T12:47:07.797 INFO:tasks.workunit.client.0.smithi046.stdout:8/276: mknod d1/d12/d46/d35/d5b/c61 0 2024-09-21T12:47:07.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/352: write d11/d19/d1b/d1c/d1f/d30/f5d [292907,119289] 0 2024-09-21T12:47:07.798 INFO:tasks.workunit.client.1.smithi176.stdout:9/844: truncate d1/df/d48/d69/fbb 4761400 0 2024-09-21T12:47:07.799 INFO:tasks.workunit.client.1.smithi176.stdout:9/845: chown d1/df/d48/d69/dc8/f10c 3069 1 2024-09-21T12:47:07.799 INFO:tasks.workunit.client.0.smithi046.stdout:9/353: chown d11/d19/c1d 188694528 1 2024-09-21T12:47:07.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/277: read d1/f4f [1575503,47313] 0 2024-09-21T12:47:07.801 INFO:tasks.workunit.client.1.smithi176.stdout:7/964: unlink d0/d2f/d43/f76 0 2024-09-21T12:47:07.802 INFO:tasks.workunit.client.1.smithi176.stdout:0/968: dread - d9/d1a/d1d/d23/dd3/f118 zero size 2024-09-21T12:47:07.802 INFO:tasks.workunit.client.0.smithi046.stdout:8/278: chown d1/d12/d1a/c55 3016168 1 2024-09-21T12:47:07.802 INFO:tasks.workunit.client.1.smithi176.stdout:7/965: chown d0/d2/db/d10/d72/d7e/fe0 1 1 2024-09-21T12:47:07.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/279: chown d1/d12/d1a/l28 253 1 2024-09-21T12:47:07.804 INFO:tasks.workunit.client.0.smithi046.stdout:9/354: mkdir d11/d19/d36/d45/d6e 0 2024-09-21T12:47:07.807 INFO:tasks.workunit.client.1.smithi176.stdout:7/966: fsync d0/d2/db/d10/f137 0 2024-09-21T12:47:07.808 INFO:tasks.workunit.client.1.smithi176.stdout:7/967: write d0/d2/db/d10/d72/fee [605970,31611] 0 2024-09-21T12:47:07.812 INFO:tasks.workunit.client.1.smithi176.stdout:3/956: mknod d1/d34/d5d/d78/c15c 0 2024-09-21T12:47:07.814 INFO:tasks.workunit.client.1.smithi176.stdout:2/853: rename d4/df/d2e/d39/db7/d80/d9e/caa to d4/df/d2e/c10a 0 2024-09-21T12:47:07.817 INFO:tasks.workunit.client.1.smithi176.stdout:9/846: creat d1/d61/d73/d7d/f11f x:0 0 0 2024-09-21T12:47:07.817 INFO:tasks.workunit.client.0.smithi046.stdout:9/355: mkdir d11/d5b/d6f 0 2024-09-21T12:47:07.819 INFO:tasks.workunit.client.1.smithi176.stdout:6/793: mkdir d2/dd/d26/d2b/d10/dfe 0 2024-09-21T12:47:07.820 INFO:tasks.workunit.client.1.smithi176.stdout:0/969: mkdir d9/d1a/d1d/d23/da1/da3/d1e/d47/d155 0 2024-09-21T12:47:07.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/356: read d11/d19/d1b/d4b/f56 [373045,129359] 0 2024-09-21T12:47:07.821 INFO:tasks.workunit.client.0.smithi046.stdout:9/357: readlink d11/l2a 0 2024-09-21T12:47:07.826 INFO:tasks.workunit.client.1.smithi176.stdout:7/968: mknod d0/d2/db/d10/d23/da6/d105/c153 0 2024-09-21T12:47:07.827 INFO:tasks.workunit.client.1.smithi176.stdout:3/957: truncate d1/d8d/fd1 957198 0 2024-09-21T12:47:07.828 INFO:tasks.workunit.client.1.smithi176.stdout:5/757: rename d0/d13/d63/d72/d87/d92/lbb to d0/d13/d63/d72/d87/lf7 0 2024-09-21T12:47:07.829 INFO:tasks.workunit.client.1.smithi176.stdout:2/854: mkdir d4/df/d4b/d10b 0 2024-09-21T12:47:07.830 INFO:tasks.workunit.client.1.smithi176.stdout:9/847: mknod d1/df/d48/d69/d76/c120 0 2024-09-21T12:47:07.830 INFO:tasks.workunit.client.0.smithi046.stdout:8/280: write d1/d24/f4a [923323,118072] 0 2024-09-21T12:47:07.831 INFO:tasks.workunit.client.1.smithi176.stdout:0/970: creat d9/d1a/d1d/d23/da1/da3/d8f/dd8/f156 x:0 0 0 2024-09-21T12:47:07.832 INFO:tasks.workunit.client.0.smithi046.stdout:8/281: write d1/d12/f2a [379084,24112] 0 2024-09-21T12:47:07.833 INFO:tasks.workunit.client.1.smithi176.stdout:0/971: write d9/d1a/d1d/d23/fb4 [760215,11181] 0 2024-09-21T12:47:07.833 INFO:tasks.workunit.client.1.smithi176.stdout:4/834: creat d3/d42/d56/d101/f128 x:0 0 0 2024-09-21T12:47:07.835 INFO:tasks.workunit.client.0.smithi046.stdout:8/282: mknod d1/d12/d46/d35/d5b/c62 0 2024-09-21T12:47:07.836 INFO:tasks.workunit.client.1.smithi176.stdout:3/958: dread - d1/d34/d71/dc5/fe8 zero size 2024-09-21T12:47:07.836 INFO:tasks.workunit.client.1.smithi176.stdout:3/959: stat d1/d34/d57/dc7/fde 0 2024-09-21T12:47:07.837 INFO:tasks.workunit.client.1.smithi176.stdout:5/758: creat d0/d13/d63/d72/d87/dcf/ff8 x:0 0 0 2024-09-21T12:47:07.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/283: read d1/d12/d46/f49 [2879048,115787] 0 2024-09-21T12:47:07.838 INFO:tasks.workunit.client.1.smithi176.stdout:3/960: read d1/d5/d25/d40/f113 [239508,112855] 0 2024-09-21T12:47:07.839 INFO:tasks.workunit.client.1.smithi176.stdout:5/759: fdatasync d0/d13/d63/d72/d87/dcf/ff8 0 2024-09-21T12:47:07.840 INFO:tasks.workunit.client.1.smithi176.stdout:1/849: sync 2024-09-21T12:47:07.841 INFO:tasks.workunit.client.1.smithi176.stdout:8/791: write d6/d16/f22 [3785611,101181] 0 2024-09-21T12:47:07.841 INFO:tasks.workunit.client.1.smithi176.stdout:1/850: truncate d0/f10c 566010 0 2024-09-21T12:47:07.842 INFO:tasks.workunit.client.0.smithi046.stdout:8/284: truncate d1/f4f 4194057 0 2024-09-21T12:47:07.844 INFO:tasks.workunit.client.1.smithi176.stdout:9/848: rename d1/df/d1c to d1/df/d9a/d121 0 2024-09-21T12:47:07.848 INFO:tasks.workunit.client.0.smithi046.stdout:8/285: mknod d1/d12/d53/d60/c63 0 2024-09-21T12:47:07.849 INFO:tasks.workunit.client.0.smithi046.stdout:8/286: chown d1/d12/d1a/d33/f38 959 1 2024-09-21T12:47:07.852 INFO:tasks.workunit.client.1.smithi176.stdout:6/794: creat d2/dd/d26/d2b/d10/fff x:0 0 0 2024-09-21T12:47:07.852 INFO:tasks.workunit.client.1.smithi176.stdout:2/855: write d4/df/d2e/d6f/d5d/f77 [61754,11557] 0 2024-09-21T12:47:07.853 INFO:tasks.workunit.client.1.smithi176.stdout:8/792: rmdir d6/d8/d24/d35/d51 39 2024-09-21T12:47:07.853 INFO:tasks.workunit.client.1.smithi176.stdout:3/961: dread d1/d5/d25/d146/f131 [0,4194304] 0 2024-09-21T12:47:07.856 INFO:tasks.workunit.client.1.smithi176.stdout:1/851: symlink d0/db/d1a/d2c/d66/d6d/l135 0 2024-09-21T12:47:07.858 INFO:tasks.workunit.client.1.smithi176.stdout:0/972: rename d9/d1a/d1d/d90/f94 to d9/d1a/d3f/d128/f157 0 2024-09-21T12:47:07.858 INFO:tasks.workunit.client.1.smithi176.stdout:6/795: rename d2/dd/d26/d2b/d10/d39 to d2/dd/d26/d2b/d10/d39/daf/d100 22 2024-09-21T12:47:07.860 INFO:tasks.workunit.client.1.smithi176.stdout:6/796: read - d2/dd/d26/d2b/d10/d87/fef zero size 2024-09-21T12:47:07.862 INFO:tasks.workunit.client.1.smithi176.stdout:2/856: creat d4/df/d2e/d6f/d5d/d81/f10c x:0 0 0 2024-09-21T12:47:07.863 INFO:tasks.workunit.client.1.smithi176.stdout:3/962: truncate d1/d34/d48/f50 1105607 0 2024-09-21T12:47:07.865 INFO:tasks.workunit.client.1.smithi176.stdout:5/760: dwrite d0/d13/d5d/f94 [0,4194304] 0 2024-09-21T12:47:07.867 INFO:tasks.workunit.client.1.smithi176.stdout:6/797: mknod d2/dd5/c101 0 2024-09-21T12:47:07.867 INFO:tasks.workunit.client.1.smithi176.stdout:0/973: rename d9/d1a/d1d/d23/da1/da3/d93/d9f/c13c to d9/d1a/d1d/d23/da1/da3/d8f/c158 0 2024-09-21T12:47:07.867 INFO:tasks.workunit.client.1.smithi176.stdout:6/798: fsync d2/d6f/f7c 0 2024-09-21T12:47:07.870 INFO:tasks.workunit.client.1.smithi176.stdout:3/963: fsync d1/f39 0 2024-09-21T12:47:07.870 INFO:tasks.workunit.client.1.smithi176.stdout:7/969: link d0/l3c d0/d2/db/d10/d72/l154 0 2024-09-21T12:47:07.870 INFO:tasks.workunit.client.1.smithi176.stdout:5/761: mknod d0/d13/d63/d2e/d71/cf9 0 2024-09-21T12:47:07.873 INFO:tasks.workunit.client.1.smithi176.stdout:8/793: rename d6/d16/d79/df0 to d6/d8/d24/d5e/dfa 0 2024-09-21T12:47:07.875 INFO:tasks.workunit.client.1.smithi176.stdout:9/849: dwrite d1/df/d48/d69/fd7 [0,4194304] 0 2024-09-21T12:47:07.875 INFO:tasks.workunit.client.1.smithi176.stdout:6/799: write d2/d63/f51 [1486972,129257] 0 2024-09-21T12:47:07.878 INFO:tasks.workunit.client.1.smithi176.stdout:3/964: unlink d1/f51 0 2024-09-21T12:47:07.879 INFO:tasks.workunit.client.1.smithi176.stdout:2/857: truncate d4/df/d2e/d6f/f2c 995258 0 2024-09-21T12:47:07.881 INFO:tasks.workunit.client.1.smithi176.stdout:1/852: truncate d0/db/d1a/d2c/dc5/d2b/d43/f69 188231 0 2024-09-21T12:47:07.882 INFO:tasks.workunit.client.1.smithi176.stdout:3/965: chown d1/d34/d5d/dfe/l124 566595 1 2024-09-21T12:47:07.883 INFO:tasks.workunit.client.1.smithi176.stdout:8/794: rmdir d6/de7 39 2024-09-21T12:47:07.884 INFO:tasks.workunit.client.1.smithi176.stdout:5/762: dread d0/d13/d63/f51 [0,4194304] 0 2024-09-21T12:47:07.885 INFO:tasks.workunit.client.1.smithi176.stdout:9/850: dread - d1/df/d48/d69/d76/fac zero size 2024-09-21T12:47:07.886 INFO:tasks.workunit.client.1.smithi176.stdout:0/974: truncate d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/d11d/f122 2023651 0 2024-09-21T12:47:07.887 INFO:tasks.workunit.client.1.smithi176.stdout:3/966: creat d1/d34/d5d/d78/f15d x:0 0 0 2024-09-21T12:47:07.888 INFO:tasks.workunit.client.1.smithi176.stdout:5/763: dread - d0/d13/d63/d8d/daf/fe3 zero size 2024-09-21T12:47:07.888 INFO:tasks.workunit.client.1.smithi176.stdout:8/795: symlink d6/db/d13/d98/dde/lfb 0 2024-09-21T12:47:07.890 INFO:tasks.workunit.client.1.smithi176.stdout:1/853: truncate d0/db/d1a/d2c/dc5/d41/d59/d99/de8/f10f 961561 0 2024-09-21T12:47:07.890 INFO:tasks.workunit.client.1.smithi176.stdout:7/970: getdents d0/d2/d30/d93/d96/d89/d14d 0 2024-09-21T12:47:07.890 INFO:tasks.workunit.client.1.smithi176.stdout:0/975: symlink d9/d1a/d1d/d23/da1/db0/l159 0 2024-09-21T12:47:07.891 INFO:tasks.workunit.client.1.smithi176.stdout:9/851: symlink d1/df/l122 0 2024-09-21T12:47:07.891 INFO:tasks.workunit.client.1.smithi176.stdout:8/796: write d6/fa [870518,100655] 0 2024-09-21T12:47:07.891 INFO:tasks.workunit.client.1.smithi176.stdout:2/858: truncate d4/df/d2e/d6f/d6d/f74 586501 0 2024-09-21T12:47:07.892 INFO:tasks.workunit.client.1.smithi176.stdout:5/764: dread - d0/d13/d63/d8d/ddc/dd5/fec zero size 2024-09-21T12:47:07.894 INFO:tasks.workunit.client.1.smithi176.stdout:1/854: dread - d0/db/d1a/d2c/dc5/d2b/d43/dfa/fff zero size 2024-09-21T12:47:07.894 INFO:tasks.workunit.client.0.smithi046.stdout:0/320: sync 2024-09-21T12:47:07.895 INFO:tasks.workunit.client.1.smithi176.stdout:2/859: truncate d4/df/d2e/d39/db7/d80/dda/df9/f104 883776 0 2024-09-21T12:47:07.896 INFO:tasks.workunit.client.1.smithi176.stdout:2/860: chown d4/l30 326093591 1 2024-09-21T12:47:07.898 INFO:tasks.workunit.client.1.smithi176.stdout:3/967: unlink d1/d34/d71/d91/df6/d11f/f12c 0 2024-09-21T12:47:07.899 INFO:tasks.workunit.client.1.smithi176.stdout:2/861: truncate d4/df/d2e/d39/db7/d80/fce 890175 0 2024-09-21T12:47:07.900 INFO:tasks.workunit.client.0.smithi046.stdout:8/287: link d1/fa d1/d12/d53/d60/f64 0 2024-09-21T12:47:07.901 INFO:tasks.workunit.client.0.smithi046.stdout:0/321: dwrite d6/d7/fa [0,4194304] 0 2024-09-21T12:47:07.902 INFO:tasks.workunit.client.1.smithi176.stdout:0/976: readlink d9/la 0 2024-09-21T12:47:07.902 INFO:tasks.workunit.client.0.smithi046.stdout:8/288: write d1/d12/f2a [1286819,15043] 0 2024-09-21T12:47:07.910 INFO:tasks.workunit.client.0.smithi046.stdout:0/322: dwrite d6/d7/d9/ff [0,4194304] 0 2024-09-21T12:47:07.911 INFO:tasks.workunit.client.1.smithi176.stdout:9/852: dread d1/df/d48/d69/d40/f53 [0,4194304] 0 2024-09-21T12:47:07.916 INFO:tasks.workunit.client.0.smithi046.stdout:0/323: rename d6/d7/d13/d2a/d31 to d6/d2f/d32/d7a 0 2024-09-21T12:47:07.917 INFO:tasks.workunit.client.1.smithi176.stdout:4/835: sync 2024-09-21T12:47:07.920 INFO:tasks.workunit.client.1.smithi176.stdout:1/855: rename d0/db/d1a/d2c/dc5/d2b/d43/lb0 to d0/db/d1a/d2c/dc5/d41/d59/d99/db3/l136 0 2024-09-21T12:47:07.920 INFO:tasks.workunit.client.1.smithi176.stdout:6/800: dwrite d2/f20 [0,4194304] 0 2024-09-21T12:47:07.921 INFO:tasks.workunit.client.1.smithi176.stdout:3/968: mkdir d1/d3e/d15e 0 2024-09-21T12:47:07.921 INFO:tasks.workunit.client.1.smithi176.stdout:6/801: write d2/d6f/f78 [311707,13220] 0 2024-09-21T12:47:07.923 INFO:tasks.workunit.client.1.smithi176.stdout:2/862: mknod d4/df/d2e/d6f/d5d/d67/c10d 0 2024-09-21T12:47:07.924 INFO:tasks.workunit.client.0.smithi046.stdout:0/324: dwrite d6/d7/d13/f3d [0,4194304] 0 2024-09-21T12:47:07.925 INFO:tasks.workunit.client.1.smithi176.stdout:1/856: write d0/db/d1a/d2c/d6b/dd7/f103 [1030394,97133] 0 2024-09-21T12:47:07.925 INFO:tasks.workunit.client.1.smithi176.stdout:3/969: chown d1/d5/f7b 3 1 2024-09-21T12:47:07.925 INFO:tasks.workunit.client.1.smithi176.stdout:2/863: stat d4/df/d2e/fec 0 2024-09-21T12:47:07.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/325: readlink d6/d2f/d32/d7a/l75 0 2024-09-21T12:47:07.926 INFO:tasks.workunit.client.1.smithi176.stdout:2/864: dread - d4/d3d/fdb zero size 2024-09-21T12:47:07.927 INFO:tasks.workunit.client.1.smithi176.stdout:1/857: write d0/d91/f123 [932999,35121] 0 2024-09-21T12:47:07.928 INFO:tasks.workunit.client.1.smithi176.stdout:3/970: truncate d1/d35/fbd 4253208 0 2024-09-21T12:47:07.929 INFO:tasks.workunit.client.1.smithi176.stdout:2/865: truncate d4/d3d/fdb 707127 0 2024-09-21T12:47:07.931 INFO:tasks.workunit.client.1.smithi176.stdout:0/977: creat d9/d1a/d1d/d22/f15a x:0 0 0 2024-09-21T12:47:07.935 INFO:tasks.workunit.client.0.smithi046.stdout:0/326: dwrite d6/d2f/d32/d7a/f26 [4194304,4194304] 0 2024-09-21T12:47:07.938 INFO:tasks.workunit.client.1.smithi176.stdout:9/853: mkdir d1/df/d48/d69/d76/d123 0 2024-09-21T12:47:07.942 INFO:tasks.workunit.client.1.smithi176.stdout:6/802: chown d2/dd/d26/d2b/d10/le6 1 1 2024-09-21T12:47:07.943 INFO:tasks.workunit.client.1.smithi176.stdout:3/971: chown d1/d5/f14 102 1 2024-09-21T12:47:07.944 INFO:tasks.workunit.client.1.smithi176.stdout:1/858: creat d0/db/d1a/d2c/dc5/d41/d59/f137 x:0 0 0 2024-09-21T12:47:07.945 INFO:tasks.workunit.client.0.smithi046.stdout:8/289: write d1/d24/f30 [894618,110100] 0 2024-09-21T12:47:07.945 INFO:tasks.workunit.client.1.smithi176.stdout:5/765: dwrite d0/f52 [0,4194304] 0 2024-09-21T12:47:07.946 INFO:tasks.workunit.client.1.smithi176.stdout:6/803: write d2/fbe [2514139,61374] 0 2024-09-21T12:47:07.947 INFO:tasks.workunit.client.1.smithi176.stdout:3/972: write d1/da/fb2 [2858120,120372] 0 2024-09-21T12:47:07.949 INFO:tasks.workunit.client.1.smithi176.stdout:6/804: write d2/dd/f11 [3954638,118421] 0 2024-09-21T12:47:07.952 INFO:tasks.workunit.client.0.smithi046.stdout:8/290: creat d1/d12/d46/d35/d36/d51/f65 x:0 0 0 2024-09-21T12:47:07.954 INFO:tasks.workunit.client.0.smithi046.stdout:8/291: truncate d1/d12/d1a/f2c 484577 0 2024-09-21T12:47:07.961 INFO:tasks.workunit.client.1.smithi176.stdout:2/866: symlink d4/df/ddf/l10e 0 2024-09-21T12:47:07.963 INFO:tasks.workunit.client.1.smithi176.stdout:4/836: dread d3/d21/d88/f91 [0,4194304] 0 2024-09-21T12:47:07.964 INFO:tasks.workunit.client.1.smithi176.stdout:5/766: mkdir d0/d13/d5d/d98/d9b/dad/dfa 0 2024-09-21T12:47:07.966 INFO:tasks.workunit.client.1.smithi176.stdout:6/805: unlink d2/dd/d26/d2b/d10/d1b/c3f 0 2024-09-21T12:47:07.967 INFO:tasks.workunit.client.1.smithi176.stdout:8/797: getdents d6/d8/d24/d35 0 2024-09-21T12:47:07.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/327: write d6/d7/d13/f29 [2229920,25695] 0 2024-09-21T12:47:07.973 INFO:tasks.workunit.client.1.smithi176.stdout:7/971: dwrite d0/d2/db/d10/d23/da6/d12b/f117 [0,4194304] 0 2024-09-21T12:47:07.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/328: mkdir d6/d7/d13/d7b 0 2024-09-21T12:47:07.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/329: creat d6/d7/d37/d53/f7c x:0 0 0 2024-09-21T12:47:07.981 INFO:tasks.workunit.client.1.smithi176.stdout:9/854: write d1/df/d48/d69/d40/d84/fa8 [200522,19502] 0 2024-09-21T12:47:07.983 INFO:tasks.workunit.client.1.smithi176.stdout:1/859: dwrite d0/d63/fcf [0,4194304] 0 2024-09-21T12:47:07.984 INFO:tasks.workunit.client.0.smithi046.stdout:8/292: dread d1/f8 [0,4194304] 0 2024-09-21T12:47:07.985 INFO:tasks.workunit.client.1.smithi176.stdout:4/837: dwrite d3/d42/d56/d101/d107/d96/fea [0,4194304] 0 2024-09-21T12:47:07.986 INFO:tasks.workunit.client.1.smithi176.stdout:8/798: truncate d6/d8/d24/d35/fc0 802484 0 2024-09-21T12:47:07.986 INFO:tasks.workunit.client.1.smithi176.stdout:1/860: stat d0/l5 0 2024-09-21T12:47:07.988 INFO:tasks.workunit.client.1.smithi176.stdout:6/806: creat d2/dd/d26/d2b/d10/d1b/f102 x:0 0 0 2024-09-21T12:47:07.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/293: mknod d1/d12/d1a/d33/c66 0 2024-09-21T12:47:07.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/294: readlink d1/l22 0 2024-09-21T12:47:07.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/330: rename d6/l1b to d6/d7/l7d 0 2024-09-21T12:47:07.993 INFO:tasks.workunit.client.1.smithi176.stdout:0/978: dread d9/f14 [0,4194304] 0 2024-09-21T12:47:07.994 INFO:tasks.workunit.client.1.smithi176.stdout:3/973: write d1/d34/d57/dd0/f62 [3988912,24773] 0 2024-09-21T12:47:07.994 INFO:tasks.workunit.client.1.smithi176.stdout:2/867: dread d4/df/d2e/fdc [0,4194304] 0 2024-09-21T12:47:07.996 INFO:tasks.workunit.client.1.smithi176.stdout:5/767: dwrite d0/d13/d63/d8d/ddc/d41/f6c [0,4194304] 0 2024-09-21T12:47:07.999 INFO:tasks.workunit.client.1.smithi176.stdout:7/972: truncate d0/d2/db/d10/d23/d85/f104 241440 0 2024-09-21T12:47:08.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/331: dwrite d6/d7/d37/d53/f56 [0,4194304] 0 2024-09-21T12:47:08.002 INFO:tasks.workunit.client.1.smithi176.stdout:9/855: read d1/df/d48/d69/d76/fae [5421092,71160] 0 2024-09-21T12:47:08.002 INFO:tasks.workunit.client.1.smithi176.stdout:6/807: mkdir d2/dd/d26/d2b/d5a/d103 0 2024-09-21T12:47:08.002 INFO:tasks.workunit.client.1.smithi176.stdout:8/799: creat d6/de7/ffc x:0 0 0 2024-09-21T12:47:08.003 INFO:tasks.workunit.client.0.smithi046.stdout:0/332: write d6/d7/d13/f6d [454781,64913] 0 2024-09-21T12:47:08.004 INFO:tasks.workunit.client.1.smithi176.stdout:3/974: dread d1/d34/d57/dd0/f9f [0,4194304] 0 2024-09-21T12:47:08.004 INFO:tasks.workunit.client.1.smithi176.stdout:2/868: fdatasync d4/df/f6b 0 2024-09-21T12:47:08.006 INFO:tasks.workunit.client.1.smithi176.stdout:8/800: chown d6/db/c34 44418280 1 2024-09-21T12:47:08.008 INFO:tasks.workunit.client.1.smithi176.stdout:7/973: readlink d0/d2/db/l27 0 2024-09-21T12:47:08.009 INFO:tasks.workunit.client.0.smithi046.stdout:0/333: creat d6/d4f/f7e x:0 0 0 2024-09-21T12:47:08.010 INFO:tasks.workunit.client.1.smithi176.stdout:1/861: mkdir d0/db/d1a/d2c/dc5/d2b/d43/d92/d120/d138 0 2024-09-21T12:47:08.011 INFO:tasks.workunit.client.1.smithi176.stdout:5/768: dwrite d0/d13/d63/d8d/ddc/d41/f4f [0,4194304] 0 2024-09-21T12:47:08.014 INFO:tasks.workunit.client.1.smithi176.stdout:5/769: write d0/d13/d63/d8d/daf/fe3 [855129,37352] 0 2024-09-21T12:47:08.017 INFO:tasks.workunit.client.0.smithi046.stdout:0/334: rename d6/d7/d13/d2a to d6/d7/d13/d43/d52/d63/d7f 0 2024-09-21T12:47:08.017 INFO:tasks.workunit.client.1.smithi176.stdout:4/838: write d3/d42/d47/f7a [452529,41924] 0 2024-09-21T12:47:08.019 INFO:tasks.workunit.client.1.smithi176.stdout:6/808: dread d2/dd/d26/d2b/d10/d39/f8b [0,4194304] 0 2024-09-21T12:47:08.021 INFO:tasks.workunit.client.1.smithi176.stdout:3/975: readlink d1/d34/d71/d91/df6/d11f/l126 0 2024-09-21T12:47:08.021 INFO:tasks.workunit.client.1.smithi176.stdout:9/856: rename d1/d8b/ca5 to d1/df/d9a/d10d/c124 0 2024-09-21T12:47:08.023 INFO:tasks.workunit.client.0.smithi046.stdout:0/335: rmdir d6/d7/d13/d72 39 2024-09-21T12:47:08.023 INFO:tasks.workunit.client.1.smithi176.stdout:2/869: dread d4/df/d2e/d6f/d6d/f71 [0,4194304] 0 2024-09-21T12:47:08.026 INFO:tasks.workunit.client.1.smithi176.stdout:7/974: chown d0/d2/db/d10/d72/d51/fa7 226415 1 2024-09-21T12:47:08.026 INFO:tasks.workunit.client.1.smithi176.stdout:8/801: truncate d6/d16/d36/fc3 1367517 0 2024-09-21T12:47:08.028 INFO:tasks.workunit.client.0.smithi046.stdout:0/336: rename d6/d2f/l70 to d6/d7/d37/d53/l80 0 2024-09-21T12:47:08.030 INFO:tasks.workunit.client.0.smithi046.stdout:8/295: dread d1/f4f [0,4194304] 0 2024-09-21T12:47:08.031 INFO:tasks.workunit.client.1.smithi176.stdout:5/770: creat d0/d13/d5d/d98/d9b/ffb x:0 0 0 2024-09-21T12:47:08.031 INFO:tasks.workunit.client.1.smithi176.stdout:6/809: dwrite d2/d63/f51 [0,4194304] 0 2024-09-21T12:47:08.031 INFO:tasks.workunit.client.1.smithi176.stdout:7/975: chown d0/d2/da8/dbe/ff8 101 1 2024-09-21T12:47:08.032 INFO:tasks.workunit.client.0.smithi046.stdout:8/296: creat d1/d24/f67 x:0 0 0 2024-09-21T12:47:08.035 INFO:tasks.workunit.client.1.smithi176.stdout:3/976: fsync d1/d5/d25/d146/fc8 0 2024-09-21T12:47:08.037 INFO:tasks.workunit.client.1.smithi176.stdout:0/979: dwrite d9/f2b [0,4194304] 0 2024-09-21T12:47:08.039 INFO:tasks.workunit.client.1.smithi176.stdout:1/862: dread d0/db/d1a/d2c/dc5/fc6 [0,4194304] 0 2024-09-21T12:47:08.040 INFO:tasks.workunit.client.1.smithi176.stdout:0/980: chown d9/d1a/d1d/d23/da1/da3/d8f/dd8 225731 1 2024-09-21T12:47:08.041 INFO:tasks.workunit.client.1.smithi176.stdout:8/802: dwrite d6/db/d13/d98/dde/ff7 [0,4194304] 0 2024-09-21T12:47:08.041 INFO:tasks.workunit.client.1.smithi176.stdout:0/981: chown d9/d1a/d3f/d40/f4c 1780406430 1 2024-09-21T12:47:08.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/297: mknod d1/d12/d1a/c68 0 2024-09-21T12:47:08.047 INFO:tasks.workunit.client.1.smithi176.stdout:4/839: write d3/d42/d56/d101/d107/d36/fe9 [743069,81012] 0 2024-09-21T12:47:08.047 INFO:tasks.workunit.client.1.smithi176.stdout:5/771: chown d0/d13/d63/f3d 183507 1 2024-09-21T12:47:08.048 INFO:tasks.workunit.client.1.smithi176.stdout:5/772: readlink d0/d13/d63/d2e/d71/lc5 0 2024-09-21T12:47:08.048 INFO:tasks.workunit.client.0.smithi046.stdout:0/337: truncate d6/d7/d9/d6b/f6e 2406641 0 2024-09-21T12:47:08.049 INFO:tasks.workunit.client.1.smithi176.stdout:6/810: creat d2/dd/d26/d2b/d10/d87/f104 x:0 0 0 2024-09-21T12:47:08.049 INFO:tasks.workunit.client.1.smithi176.stdout:5/773: fsync d0/d13/f5c 0 2024-09-21T12:47:08.051 INFO:tasks.workunit.client.1.smithi176.stdout:7/976: rmdir d0/d2/db/d10/d72/d7e/de2/df3 39 2024-09-21T12:47:08.053 INFO:tasks.workunit.client.0.smithi046.stdout:0/338: symlink d6/d7/d9/d54/l81 0 2024-09-21T12:47:08.053 INFO:tasks.workunit.client.1.smithi176.stdout:8/803: mkdir d6/de7/dfd 0 2024-09-21T12:47:08.054 INFO:tasks.workunit.client.1.smithi176.stdout:1/863: chown d0/db/d1a/d2c/d66/c12a 36 1 2024-09-21T12:47:08.055 INFO:tasks.workunit.client.0.smithi046.stdout:0/339: dread - d6/d7/d13/d72/f79 zero size 2024-09-21T12:47:08.057 INFO:tasks.workunit.client.1.smithi176.stdout:6/811: symlink d2/dd/dc7/l105 0 2024-09-21T12:47:08.058 INFO:tasks.workunit.client.0.smithi046.stdout:0/340: readlink d6/d7/d13/d43/d52/d63/d7f/l2e 0 2024-09-21T12:47:08.058 INFO:tasks.workunit.client.1.smithi176.stdout:3/977: truncate d1/d34/d48/f68 7708948 0 2024-09-21T12:47:08.059 INFO:tasks.workunit.client.1.smithi176.stdout:4/840: creat d3/d42/d56/d101/d125/f129 x:0 0 0 2024-09-21T12:47:08.060 INFO:tasks.workunit.client.1.smithi176.stdout:8/804: symlink d6/db/d13/d98/da1/lfe 0 2024-09-21T12:47:08.060 INFO:tasks.workunit.client.1.smithi176.stdout:2/870: getdents d4/d40 0 2024-09-21T12:47:08.060 INFO:tasks.workunit.client.1.smithi176.stdout:4/841: chown d3/f32 1292 1 2024-09-21T12:47:08.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/341: link d6/d7/d13/f29 d6/d4f/f82 0 2024-09-21T12:47:08.063 INFO:tasks.workunit.client.1.smithi176.stdout:5/774: fsync d0/d13/d63/d2e/d37/db5/db7/f6b 0 2024-09-21T12:47:08.065 INFO:tasks.workunit.client.1.smithi176.stdout:5/775: readlink d0/d13/d63/d2e/d37/db5/db7/l99 0 2024-09-21T12:47:08.066 INFO:tasks.workunit.client.0.smithi046.stdout:0/342: unlink d6/d7/d13/f6d 0 2024-09-21T12:47:08.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/343: mknod d6/d2f/d32/d7a/c83 0 2024-09-21T12:47:08.069 INFO:tasks.workunit.client.1.smithi176.stdout:4/842: write d3/d42/d56/d101/d107/f33 [3784187,63321] 0 2024-09-21T12:47:08.070 INFO:tasks.workunit.client.1.smithi176.stdout:6/812: rename d2/d6f/d81/cf2 to d2/dd/d79/c106 0 2024-09-21T12:47:08.075 INFO:tasks.workunit.client.1.smithi176.stdout:0/982: dread d9/d1a/d1d/d23/da1/da3/fd5 [0,4194304] 0 2024-09-21T12:47:08.075 INFO:tasks.workunit.client.1.smithi176.stdout:2/871: creat d4/df/d4b/d10b/f10f x:0 0 0 2024-09-21T12:47:08.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/298: dread d1/d12/d46/d35/d36/f4e [0,4194304] 0 2024-09-21T12:47:08.076 INFO:tasks.workunit.client.0.smithi046.stdout:8/299: stat d1/c15 0 2024-09-21T12:47:08.079 INFO:tasks.workunit.client.1.smithi176.stdout:4/843: rename d3/d42/d56/d101/d125/f129 to d3/d42/d102/f12a 0 2024-09-21T12:47:08.081 INFO:tasks.workunit.client.1.smithi176.stdout:9/857: truncate d1/df/d9a/d121/f3a 2428500 0 2024-09-21T12:47:08.083 INFO:tasks.workunit.client.1.smithi176.stdout:9/858: read d1/df/d23/f59 [858121,5808] 0 2024-09-21T12:47:08.084 INFO:tasks.workunit.client.1.smithi176.stdout:0/983: creat d9/d1a/d1d/d81/d115/f15b x:0 0 0 2024-09-21T12:47:08.088 INFO:tasks.workunit.client.1.smithi176.stdout:1/864: write d0/db/d1a/d2c/dc5/d2b/d43/f54 [2828864,16539] 0 2024-09-21T12:47:08.088 INFO:tasks.workunit.client.1.smithi176.stdout:7/977: write d0/d2/db/d10/f22 [5637714,10156] 0 2024-09-21T12:47:08.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/300: getdents d1/d12/d46/d35/d36 0 2024-09-21T12:47:08.089 INFO:tasks.workunit.client.0.smithi046.stdout:8/301: chown d1/d24 11657 1 2024-09-21T12:47:08.091 INFO:tasks.workunit.client.1.smithi176.stdout:4/844: mknod d3/d21/d5e/c12b 0 2024-09-21T12:47:08.092 INFO:tasks.workunit.client.1.smithi176.stdout:8/805: getdents d6/db/d37/d89 0 2024-09-21T12:47:08.093 INFO:tasks.workunit.client.1.smithi176.stdout:9/859: symlink d1/df/d9a/d121/l125 0 2024-09-21T12:47:08.094 INFO:tasks.workunit.client.1.smithi176.stdout:9/860: write d1/df/d48/d69/d38/fc5 [1006362,23586] 0 2024-09-21T12:47:08.096 INFO:tasks.workunit.client.1.smithi176.stdout:0/984: unlink d9/d1a/d1d/d23/dd3/dee/d141/f152 0 2024-09-21T12:47:08.099 INFO:tasks.workunit.client.1.smithi176.stdout:2/872: dread d4/df/d2e/d6f/f59 [0,4194304] 0 2024-09-21T12:47:08.099 INFO:tasks.workunit.client.0.smithi046.stdout:8/302: truncate d1/d12/d1a/d33/f38 1330820 0 2024-09-21T12:47:08.100 INFO:tasks.workunit.client.1.smithi176.stdout:3/978: write d1/fe [1660790,50188] 0 2024-09-21T12:47:08.100 INFO:tasks.workunit.client.1.smithi176.stdout:4/845: mknod d3/d5/dc5/c12c 0 2024-09-21T12:47:08.101 INFO:tasks.workunit.client.0.smithi046.stdout:0/344: truncate d6/d7/d37/d53/f56 282033 0 2024-09-21T12:47:08.102 INFO:tasks.workunit.client.0.smithi046.stdout:0/345: fsync d6/d7/f45 0 2024-09-21T12:47:08.103 INFO:tasks.workunit.client.1.smithi176.stdout:8/806: creat d6/d16/d79/fff x:0 0 0 2024-09-21T12:47:08.103 INFO:tasks.workunit.client.0.smithi046.stdout:8/303: rmdir d1/d12/d46 39 2024-09-21T12:47:08.104 INFO:tasks.workunit.client.0.smithi046.stdout:8/304: write d1/fd [7263399,69623] 0 2024-09-21T12:47:08.108 INFO:tasks.workunit.client.0.smithi046.stdout:0/346: mknod d6/d7/d9/d54/c84 0 2024-09-21T12:47:08.108 INFO:tasks.workunit.client.1.smithi176.stdout:6/813: write d2/fbc [240948,30477] 0 2024-09-21T12:47:08.109 INFO:tasks.workunit.client.1.smithi176.stdout:6/814: readlink d2/dd/d26/d2b/d10/le6 0 2024-09-21T12:47:08.110 INFO:tasks.workunit.client.1.smithi176.stdout:6/815: write d2/dd/f48 [5503146,20032] 0 2024-09-21T12:47:08.110 INFO:tasks.workunit.client.1.smithi176.stdout:0/985: chown d9/d1a/d1d/d23/da1/da3/lcf 141453 1 2024-09-21T12:47:08.112 INFO:tasks.workunit.client.1.smithi176.stdout:1/865: unlink d0/db/d1a/d2c/dc5/d2b/d43/f69 0 2024-09-21T12:47:08.114 INFO:tasks.workunit.client.1.smithi176.stdout:0/986: dread d9/d1a/d1d/d81/f83 [0,4194304] 0 2024-09-21T12:47:08.115 INFO:tasks.workunit.client.1.smithi176.stdout:2/873: creat d4/df/d2e/d6f/d5d/d67/dd6/f110 x:0 0 0 2024-09-21T12:47:08.116 INFO:tasks.workunit.client.1.smithi176.stdout:2/874: dread - d4/df/d2e/d39/db7/d80/fb5 zero size 2024-09-21T12:47:08.116 INFO:tasks.workunit.client.1.smithi176.stdout:0/987: chown d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d78 3 1 2024-09-21T12:47:08.116 INFO:tasks.workunit.client.0.smithi046.stdout:0/347: rename d6/d7/d13/l39 to d6/d7/d9/l85 0 2024-09-21T12:47:08.117 INFO:tasks.workunit.client.0.smithi046.stdout:0/348: dread - d6/d7/d13/d43/d52/f5e zero size 2024-09-21T12:47:08.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/305: creat d1/d12/d46/d35/d5b/f69 x:0 0 0 2024-09-21T12:47:08.121 INFO:tasks.workunit.client.1.smithi176.stdout:8/807: creat d6/db/d13/d98/da1/f100 x:0 0 0 2024-09-21T12:47:08.123 INFO:tasks.workunit.client.1.smithi176.stdout:0/988: dwrite d9/d1a/d1d/d23/da1/da3/f133 [0,4194304] 0 2024-09-21T12:47:08.127 INFO:tasks.workunit.client.1.smithi176.stdout:1/866: symlink d0/db/d6f/l139 0 2024-09-21T12:47:08.127 INFO:tasks.workunit.client.1.smithi176.stdout:2/875: rmdir d4/d63 39 2024-09-21T12:47:08.129 INFO:tasks.workunit.client.0.smithi046.stdout:0/349: symlink d6/l86 0 2024-09-21T12:47:08.131 INFO:tasks.workunit.client.1.smithi176.stdout:4/846: link d3/d42/dae/fc3 d3/d42/dae/f12d 0 2024-09-21T12:47:08.133 INFO:tasks.workunit.client.1.smithi176.stdout:8/808: dread d6/d8/d54/dca/fa7 [0,4194304] 0 2024-09-21T12:47:08.133 INFO:tasks.workunit.client.0.smithi046.stdout:0/350: mknod d6/d7/d37/c87 0 2024-09-21T12:47:08.134 INFO:tasks.workunit.client.1.smithi176.stdout:0/989: rmdir d9/d35 39 2024-09-21T12:47:08.136 INFO:tasks.workunit.client.1.smithi176.stdout:9/861: creat d1/f126 x:0 0 0 2024-09-21T12:47:08.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/306: getdents d1/d24 0 2024-09-21T12:47:08.137 INFO:tasks.workunit.client.1.smithi176.stdout:2/876: mknod d4/df/d2e/d6f/d5d/d67/dd6/c111 0 2024-09-21T12:47:08.138 INFO:tasks.workunit.client.0.smithi046.stdout:8/307: chown d1/d12/d1a 33113 1 2024-09-21T12:47:08.138 INFO:tasks.workunit.client.1.smithi176.stdout:4/847: creat d3/d5/d37/f12e x:0 0 0 2024-09-21T12:47:08.139 INFO:tasks.workunit.client.1.smithi176.stdout:0/990: mknod d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/d11d/c15c 0 2024-09-21T12:47:08.139 INFO:tasks.workunit.client.1.smithi176.stdout:8/809: dwrite d6/db/d13/d98/fd7 [0,4194304] 0 2024-09-21T12:47:08.142 INFO:tasks.workunit.client.1.smithi176.stdout:1/867: rename d0/db/d1a/d2c/d48/f78 to d0/db/d1a/d2c/d37/f13a 0 2024-09-21T12:47:08.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/351: getdents d6/d7/d13/d43 0 2024-09-21T12:47:08.142 INFO:tasks.workunit.client.0.smithi046.stdout:8/308: read d1/f11 [8306008,107673] 0 2024-09-21T12:47:08.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/352: chown d6/d7/d13/f29 0 1 2024-09-21T12:47:08.145 INFO:tasks.workunit.client.0.smithi046.stdout:0/353: symlink d6/d4f/l88 0 2024-09-21T12:47:08.149 INFO:tasks.workunit.client.1.smithi176.stdout:9/862: rmdir d1/df/d23/dcf/ddd/de5 39 2024-09-21T12:47:08.149 INFO:tasks.workunit.client.1.smithi176.stdout:9/863: readlink d1/l5b 0 2024-09-21T12:47:08.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/354: rename d6/d7/d13/f29 to d6/d60/f89 0 2024-09-21T12:47:08.152 INFO:tasks.workunit.client.1.smithi176.stdout:4/848: mknod d3/d42/d56/d101/d107/d96/c12f 0 2024-09-21T12:47:08.155 INFO:tasks.workunit.client.0.smithi046.stdout:0/355: dread d6/d7/fa [0,4194304] 0 2024-09-21T12:47:08.158 INFO:tasks.workunit.client.1.smithi176.stdout:9/864: mkdir d1/df/d9a/d127 0 2024-09-21T12:47:08.159 INFO:tasks.workunit.client.1.smithi176.stdout:8/810: creat d6/db/f101 x:0 0 0 2024-09-21T12:47:08.160 INFO:tasks.workunit.client.0.smithi046.stdout:0/356: mkdir d6/d7/d13/d43/d52/d63/d7f/d78/d8a 0 2024-09-21T12:47:08.161 INFO:tasks.workunit.client.0.smithi046.stdout:0/357: chown d6/d7/d13/f1d 66462842 1 2024-09-21T12:47:08.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:07 smithi046 ceph-mon[27868]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 195 MiB/s wr, 369 op/s 2024-09-21T12:47:08.162 INFO:tasks.workunit.client.1.smithi176.stdout:1/868: write d0/db/d1a/d2c/dc5/d41/d59/d9b/fb2 [497748,54738] 0 2024-09-21T12:47:08.162 INFO:tasks.workunit.client.1.smithi176.stdout:8/811: mkdir d6/d8/d54/dca/d102 0 2024-09-21T12:47:08.164 INFO:tasks.workunit.client.1.smithi176.stdout:9/865: link d1/d61/d73/d7d/cbd d1/df/d48/d69/dc8/c128 0 2024-09-21T12:47:08.164 INFO:tasks.workunit.client.1.smithi176.stdout:4/849: dread d3/d42/d47/d5c/f94 [0,4194304] 0 2024-09-21T12:47:08.166 INFO:tasks.workunit.client.0.smithi046.stdout:7/197: sync 2024-09-21T12:47:08.167 INFO:tasks.workunit.client.1.smithi176.stdout:9/866: creat d1/d61/d118/f129 x:0 0 0 2024-09-21T12:47:08.168 INFO:tasks.workunit.client.1.smithi176.stdout:0/991: dwrite d9/d1a/d1d/d23/da1/da3/ff3 [0,4194304] 0 2024-09-21T12:47:08.177 INFO:tasks.workunit.client.1.smithi176.stdout:8/812: dwrite d6/de7/ffc [0,4194304] 0 2024-09-21T12:47:08.179 INFO:tasks.workunit.client.1.smithi176.stdout:1/869: dwrite d0/db/d1a/d2c/dc5/d41/d59/d99/de8/f10f [0,4194304] 0 2024-09-21T12:47:08.180 INFO:tasks.workunit.client.1.smithi176.stdout:9/867: dwrite d1/df/fef [0,4194304] 0 2024-09-21T12:47:08.191 INFO:tasks.workunit.client.0.smithi046.stdout:0/358: chown d6/d7/d9/d54/c84 2 1 2024-09-21T12:47:08.193 INFO:tasks.workunit.client.1.smithi176.stdout:4/850: creat d3/d42/d56/d4e/df8/f130 x:0 0 0 2024-09-21T12:47:08.198 INFO:tasks.workunit.client.1.smithi176.stdout:1/870: mknod d0/db/d1a/d2c/dc5/d41/c13b 0 2024-09-21T12:47:08.199 INFO:tasks.workunit.client.0.smithi046.stdout:7/198: mkdir d2/d4/df/d42 0 2024-09-21T12:47:08.202 INFO:tasks.workunit.client.0.smithi046.stdout:0/359: symlink d6/d7/d13/d43/d52/d63/d7f/d78/d8a/l8b 0 2024-09-21T12:47:08.203 INFO:tasks.workunit.client.1.smithi176.stdout:8/813: truncate d6/db/d37/d7a/fa5 296212 0 2024-09-21T12:47:08.203 INFO:tasks.workunit.client.1.smithi176.stdout:1/871: symlink d0/db/d6f/de1/l13c 0 2024-09-21T12:47:08.204 INFO:tasks.workunit.client.1.smithi176.stdout:9/868: mkdir d1/df/d48/d69/d40/d84/dfd/d12a 0 2024-09-21T12:47:08.204 INFO:tasks.workunit.client.0.smithi046.stdout:0/360: mkdir d6/d7/d13/d43/d52/d8c 0 2024-09-21T12:47:08.205 INFO:tasks.workunit.client.1.smithi176.stdout:0/992: dread d9/d1a/d1d/d90/f13b [0,4194304] 0 2024-09-21T12:47:08.209 INFO:tasks.workunit.client.1.smithi176.stdout:8/814: rename d6/f1a to d6/db/d13/d98/dde/de5/f103 0 2024-09-21T12:47:08.211 INFO:tasks.workunit.client.0.smithi046.stdout:0/361: dwrite d6/d7/d13/d43/d52/d63/d7f/f5f [4194304,4194304] 0 2024-09-21T12:47:08.215 INFO:tasks.workunit.client.0.smithi046.stdout:0/362: read d6/d7/f12 [3547646,13571] 0 2024-09-21T12:47:08.216 INFO:tasks.workunit.client.0.smithi046.stdout:0/363: fsync d6/d7/d37/f67 0 2024-09-21T12:47:08.217 INFO:tasks.workunit.client.0.smithi046.stdout:0/364: dread - d6/d7/d37/d53/f55 zero size 2024-09-21T12:47:08.219 INFO:tasks.workunit.client.1.smithi176.stdout:9/869: creat d1/df/d23/dcf/f12b x:0 0 0 2024-09-21T12:47:08.221 INFO:tasks.workunit.client.1.smithi176.stdout:4/851: dwrite d3/d5/d37/fbb [0,4194304] 0 2024-09-21T12:47:08.223 INFO:tasks.workunit.client.1.smithi176.stdout:0/993: write d9/d1a/d1d/d22/fb7 [651423,614] 0 2024-09-21T12:47:08.224 INFO:tasks.workunit.client.1.smithi176.stdout:5/776: sync 2024-09-21T12:47:08.225 INFO:tasks.workunit.client.1.smithi176.stdout:1/872: link d0/db/d1a/d2c/f79 d0/db/d1a/d2c/d84/f13d 0 2024-09-21T12:47:08.228 INFO:tasks.workunit.client.1.smithi176.stdout:5/777: chown d0/d13/d63/d8d/ddc/d41/cf1 23578 1 2024-09-21T12:47:08.229 INFO:tasks.workunit.client.1.smithi176.stdout:4/852: getdents d3/d42/d47/d5c/dec/d127 0 2024-09-21T12:47:08.230 INFO:tasks.workunit.client.1.smithi176.stdout:4/853: stat d3/d42/d56/lfd 0 2024-09-21T12:47:08.233 INFO:tasks.workunit.client.1.smithi176.stdout:0/994: unlink d9/d1a/d1d/d23/da1/da3/d8f/dd8/de2/d10e/c74 0 2024-09-21T12:47:08.233 INFO:tasks.workunit.client.1.smithi176.stdout:1/873: creat d0/d132/f13e x:0 0 0 2024-09-21T12:47:08.234 INFO:tasks.workunit.client.1.smithi176.stdout:9/870: write d1/fd [4427152,1261] 0 2024-09-21T12:47:08.235 INFO:tasks.workunit.client.1.smithi176.stdout:5/778: readlink d0/d13/lef 0 2024-09-21T12:47:08.237 INFO:tasks.workunit.client.1.smithi176.stdout:8/815: dwrite d6/d8/d24/d35/fc0 [0,4194304] 0 2024-09-21T12:47:08.237 INFO:tasks.workunit.client.1.smithi176.stdout:0/995: creat d9/d1a/d1d/d81/d115/f15d x:0 0 0 2024-09-21T12:47:08.239 INFO:tasks.workunit.client.1.smithi176.stdout:5/779: write d0/d13/d5d/f94 [2772056,121497] 0 2024-09-21T12:47:08.239 INFO:tasks.workunit.client.1.smithi176.stdout:0/996: dread - d9/d1a/db8/d130/f14d zero size 2024-09-21T12:47:08.240 INFO:tasks.workunit.client.1.smithi176.stdout:9/871: read d1/df/d48/d69/d4d/f96 [194160,53059] 0 2024-09-21T12:47:08.243 INFO:tasks.workunit.client.1.smithi176.stdout:9/872: write d1/df/d48/d69/d40/fec [933736,108301] 0 2024-09-21T12:47:08.246 INFO:tasks.workunit.client.1.smithi176.stdout:1/874: rename d0/db/d1a/d2c/dc5/d2b/d43 to d0/d13f 0 2024-09-21T12:47:08.249 INFO:tasks.workunit.client.1.smithi176.stdout:0/997: dread - d9/d1a/d1d/d23/da1/da3/fdf zero size 2024-09-21T12:47:08.252 INFO:tasks.workunit.client.1.smithi176.stdout:9/873: symlink d1/df/d48/d69/d76/d123/l12c 0 2024-09-21T12:47:08.252 INFO:tasks.workunit.client.1.smithi176.stdout:5/780: dwrite d0/d13/d63/d2e/fb6 [0,4194304] 0 2024-09-21T12:47:08.255 INFO:tasks.workunit.client.1.smithi176.stdout:4/854: dwrite d3/d5/d37/f92 [0,4194304] 0 2024-09-21T12:47:08.256 INFO:tasks.workunit.client.1.smithi176.stdout:9/874: write d1/fd [4765423,69990] 0 2024-09-21T12:47:08.260 INFO:tasks.workunit.client.1.smithi176.stdout:9/875: write d1/df/d23/fa3 [618829,111662] 0 2024-09-21T12:47:08.260 INFO:tasks.workunit.client.1.smithi176.stdout:1/875: dread d0/db/d1a/d2c/dc5/fc6 [0,4194304] 0 2024-09-21T12:47:08.262 INFO:tasks.workunit.client.1.smithi176.stdout:5/781: mkdir d0/d13/d63/d2e/d37/d55/dfc 0 2024-09-21T12:47:08.264 INFO:tasks.workunit.client.1.smithi176.stdout:1/876: write d0/db/d2a/def/ff0 [251127,25696] 0 2024-09-21T12:47:08.264 INFO:tasks.workunit.client.1.smithi176.stdout:9/876: symlink d1/d8b/l12d 0 2024-09-21T12:47:08.265 INFO:tasks.workunit.client.1.smithi176.stdout:9/877: stat d1/df/d23/d67 0 2024-09-21T12:47:08.266 INFO:tasks.workunit.client.1.smithi176.stdout:5/782: creat d0/d13/d63/d8d/ffd x:0 0 0 2024-09-21T12:47:08.267 INFO:tasks.workunit.client.1.smithi176.stdout:5/783: chown d0/f27 45657058 1 2024-09-21T12:47:08.269 INFO:tasks.workunit.client.1.smithi176.stdout:9/878: read d1/d63/fb2 [49477,95916] 0 2024-09-21T12:47:08.269 INFO:tasks.workunit.client.1.smithi176.stdout:0/998: rename d9/d1a/d1d/d23/da1/da3/d93/df9/d77/f92 to d9/d1a/d1d/d23/da1/d99/f15e 0 2024-09-21T12:47:08.271 INFO:tasks.workunit.client.1.smithi176.stdout:8/816: dread d6/f90 [0,4194304] 0 2024-09-21T12:47:08.272 INFO:tasks.workunit.client.1.smithi176.stdout:3/979: sync 2024-09-21T12:47:08.272 INFO:tasks.workunit.client.1.smithi176.stdout:6/816: sync 2024-09-21T12:47:08.272 INFO:tasks.workunit.client.1.smithi176.stdout:7/978: sync 2024-09-21T12:47:08.272 INFO:tasks.workunit.client.1.smithi176.stdout:2/877: sync 2024-09-21T12:47:08.273 INFO:tasks.workunit.client.1.smithi176.stdout:8/817: readlink d6/db/l48 0 2024-09-21T12:47:08.273 INFO:tasks.workunit.client.1.smithi176.stdout:5/784: creat d0/d13/d63/d8d/ddc/ffe x:0 0 0 2024-09-21T12:47:08.273 INFO:tasks.workunit.client.1.smithi176.stdout:9/879: mknod d1/d61/d73/d7d/c12e 0 2024-09-21T12:47:08.275 INFO:tasks.workunit.client.1.smithi176.stdout:1/877: dread d0/db/d6f/fc9 [0,4194304] 0 2024-09-21T12:47:08.278 INFO:tasks.workunit.client.1.smithi176.stdout:3/980: creat d1/d34/d71/dc5/f15f x:0 0 0 2024-09-21T12:47:08.281 INFO:tasks.workunit.client.1.smithi176.stdout:5/785: symlink d0/d13/d63/d72/d87/d92/lff 0 2024-09-21T12:47:08.281 INFO:tasks.workunit.client.1.smithi176.stdout:9/880: dread - d1/df/dc3/ff2 zero size 2024-09-21T12:47:08.282 INFO:tasks.workunit.client.1.smithi176.stdout:6/817: creat d2/d6f/df3/f107 x:0 0 0 2024-09-21T12:47:08.283 INFO:tasks.workunit.client.1.smithi176.stdout:2/878: dwrite d4/df/d2e/d6f/d6d/fe2 [0,4194304] 0 2024-09-21T12:47:08.284 INFO:tasks.workunit.client.1.smithi176.stdout:8/818: symlink d6/db/d37/d7a/l104 0 2024-09-21T12:47:08.287 INFO:tasks.workunit.client.1.smithi176.stdout:7/979: write d0/d2/db/f26 [1330572,35325] 0 2024-09-21T12:47:08.288 INFO:tasks.workunit.client.1.smithi176.stdout:4/855: dwrite d3/d42/d56/d101/d107/d96/fbe [0,4194304] 0 2024-09-21T12:47:08.288 INFO:tasks.workunit.client.1.smithi176.stdout:3/981: fdatasync d1/d5/d25/d38/f3f 0 2024-09-21T12:47:08.290 INFO:tasks.workunit.client.1.smithi176.stdout:9/881: dread - d1/df/d48/d69/dc8/f10c zero size 2024-09-21T12:47:08.291 INFO:tasks.workunit.client.1.smithi176.stdout:8/819: mknod d6/d8/d54/c105 0 2024-09-21T12:47:08.291 INFO:tasks.workunit.client.1.smithi176.stdout:5/786: mknod d0/d13/d63/c100 0 2024-09-21T12:47:08.292 INFO:tasks.workunit.client.1.smithi176.stdout:9/882: fsync d1/df/d23/fa3 0 2024-09-21T12:47:08.293 INFO:tasks.workunit.client.1.smithi176.stdout:4/856: write d3/d42/d56/d101/d107/d96/da3/fd8 [1540769,117486] 0 2024-09-21T12:47:08.294 INFO:tasks.workunit.client.1.smithi176.stdout:7/980: rmdir d0/d2/d30 39 2024-09-21T12:47:08.295 INFO:tasks.workunit.client.1.smithi176.stdout:6/818: mknod d2/dd/d26/c108 0 2024-09-21T12:47:08.297 INFO:tasks.workunit.client.1.smithi176.stdout:9/883: read d1/fd [1758059,28993] 0 2024-09-21T12:47:08.298 INFO:tasks.workunit.client.1.smithi176.stdout:6/819: readlink d2/d6f/d81/lb6 0 2024-09-21T12:47:08.298 INFO:tasks.workunit.client.1.smithi176.stdout:2/879: creat d4/df/d2e/d39/db7/d80/dda/f112 x:0 0 0 2024-09-21T12:47:08.299 INFO:tasks.workunit.client.1.smithi176.stdout:0/999: dread d9/d1a/d1d/d23/da1/da3/d93/df9/d77/d88/f5a [0,4194304] 0 2024-09-21T12:47:08.300 INFO:tasks.workunit.client.1.smithi176.stdout:1/878: dwrite d0/db/d1a/d2c/dc5/d2b/f3b [0,4194304] 0 2024-09-21T12:47:08.301 INFO:tasks.workunit.client.1.smithi176.stdout:8/820: write d6/db/d37/f88 [1686702,94873] 0 2024-09-21T12:47:08.301 INFO:tasks.workunit.client.1.smithi176.stdout:3/982: dread d1/d34/d48/deb/dc6/ff8 [0,4194304] 0 2024-09-21T12:47:08.303 INFO:tasks.workunit.client.1.smithi176.stdout:5/787: stat d0/d13/d63/d8d/daf/fea 0 2024-09-21T12:47:08.306 INFO:tasks.workunit.client.1.smithi176.stdout:4/857: creat d3/d42/d102/f131 x:0 0 0 2024-09-21T12:47:08.308 INFO:tasks.workunit.client.1.smithi176.stdout:6/820: mknod d2/dd/d26/d2b/d68/c109 0 2024-09-21T12:47:08.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:07 smithi176 ceph-mon[35476]: pgmap v30: 65 pgs: 65 active+clean; 2.0 GiB data, 5.7 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 195 MiB/s wr, 369 op/s 2024-09-21T12:47:08.319 INFO:tasks.workunit.client.1.smithi176.stdout:7/981: dread d0/d5d/ffa [0,4194304] 0 2024-09-21T12:47:08.322 INFO:tasks.workunit.client.1.smithi176.stdout:5/788: creat d0/d13/d63/d2e/d37/f101 x:0 0 0 2024-09-21T12:47:08.322 INFO:tasks.workunit.client.1.smithi176.stdout:1/879: write d0/db/f17 [4173467,114035] 0 2024-09-21T12:47:08.325 INFO:tasks.workunit.client.1.smithi176.stdout:9/884: truncate d1/df/d48/d69/f6f 2111676 0 2024-09-21T12:47:08.326 INFO:tasks.workunit.client.1.smithi176.stdout:5/789: truncate d0/d10/d70/fca 1068047 0 2024-09-21T12:47:08.327 INFO:tasks.workunit.client.1.smithi176.stdout:3/983: write d1/d8d/fd1 [1663947,88776] 0 2024-09-21T12:47:08.331 INFO:tasks.workunit.client.1.smithi176.stdout:5/790: readlink d0/d13/lef 0 2024-09-21T12:47:08.335 INFO:tasks.workunit.client.1.smithi176.stdout:1/880: symlink d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/l140 0 2024-09-21T12:47:08.339 INFO:tasks.workunit.client.1.smithi176.stdout:3/984: fdatasync d1/d34/d57/dd0/d7d/ff4 0 2024-09-21T12:47:08.340 INFO:tasks.workunit.client.1.smithi176.stdout:8/821: dread d6/db/d13/f31 [0,4194304] 0 2024-09-21T12:47:08.340 INFO:tasks.workunit.client.1.smithi176.stdout:6/821: dwrite d2/d5d/fae [0,4194304] 0 2024-09-21T12:47:08.342 INFO:tasks.workunit.client.1.smithi176.stdout:2/880: dwrite d4/d3d/d65/f89 [0,4194304] 0 2024-09-21T12:47:08.346 INFO:tasks.workunit.client.1.smithi176.stdout:1/881: creat d0/d13f/d92/d120/f141 x:0 0 0 2024-09-21T12:47:08.346 INFO:tasks.workunit.client.1.smithi176.stdout:4/858: dwrite d3/d42/d56/d4e/f6a [0,4194304] 0 2024-09-21T12:47:08.346 INFO:tasks.workunit.client.1.smithi176.stdout:5/791: symlink d0/d13/d63/dd4/l102 0 2024-09-21T12:47:08.348 INFO:tasks.workunit.client.1.smithi176.stdout:6/822: read - d2/dd/d26/d2b/d10/d87/f104 zero size 2024-09-21T12:47:08.350 INFO:tasks.workunit.client.1.smithi176.stdout:1/882: fsync d0/db/d1a/d2c/d6b/fd5 0 2024-09-21T12:47:08.350 INFO:tasks.workunit.client.1.smithi176.stdout:2/881: truncate d4/d3d/fdb 1529675 0 2024-09-21T12:47:08.352 INFO:tasks.workunit.client.1.smithi176.stdout:7/982: dread d0/d2/db/d10/f2b [0,4194304] 0 2024-09-21T12:47:08.354 INFO:tasks.workunit.client.1.smithi176.stdout:3/985: rename d1/d35/fc9 to d1/d34/d48/f160 0 2024-09-21T12:47:08.355 INFO:tasks.workunit.client.1.smithi176.stdout:4/859: dread d3/d42/d47/d5c/fb0 [0,4194304] 0 2024-09-21T12:47:08.357 INFO:tasks.workunit.client.1.smithi176.stdout:9/885: dread d1/d8b/fa6 [0,4194304] 0 2024-09-21T12:47:08.358 INFO:tasks.workunit.client.1.smithi176.stdout:5/792: mknod d0/d13/d5d/d98/d9b/dad/c103 0 2024-09-21T12:47:08.358 INFO:tasks.workunit.client.1.smithi176.stdout:9/886: rename d1 to d1/df/d48/d69/d76/d12f 22 2024-09-21T12:47:08.359 INFO:tasks.workunit.client.1.smithi176.stdout:6/823: mkdir d2/d6f/d81/d10a 0 2024-09-21T12:47:08.361 INFO:tasks.workunit.client.1.smithi176.stdout:1/883: truncate d0/db/d1a/d2c/d48/d50/f64 894840 0 2024-09-21T12:47:08.361 INFO:tasks.workunit.client.1.smithi176.stdout:7/983: read d0/d2/db/f14 [5175987,11905] 0 2024-09-21T12:47:08.362 INFO:tasks.workunit.client.1.smithi176.stdout:1/884: fsync d0/db/d6f/de1/d10b/f129 0 2024-09-21T12:47:08.362 INFO:tasks.workunit.client.1.smithi176.stdout:3/986: symlink d1/d34/d57/dc7/l161 0 2024-09-21T12:47:08.363 INFO:tasks.workunit.client.1.smithi176.stdout:9/887: rmdir d1/df/d9a/dbc 39 2024-09-21T12:47:08.363 INFO:tasks.workunit.client.1.smithi176.stdout:7/984: chown d0/d5d/d5e/ce4 15324 1 2024-09-21T12:47:08.363 INFO:tasks.workunit.client.1.smithi176.stdout:6/824: fsync d2/d6f/d7f/dbf/fdf 0 2024-09-21T12:47:08.365 INFO:tasks.workunit.client.1.smithi176.stdout:5/793: write d0/d13/d63/d72/d87/d92/fb9 [855386,112137] 0 2024-09-21T12:47:08.365 INFO:tasks.workunit.client.1.smithi176.stdout:1/885: dread - d0/db/d6f/fcb zero size 2024-09-21T12:47:08.366 INFO:tasks.workunit.client.1.smithi176.stdout:9/888: read - d1/df/d9a/dbc/f113 zero size 2024-09-21T12:47:08.367 INFO:tasks.workunit.client.1.smithi176.stdout:7/985: symlink d0/d5d/dec/l155 0 2024-09-21T12:47:08.368 INFO:tasks.workunit.client.1.smithi176.stdout:3/987: creat d1/d34/d42/d5b/f162 x:0 0 0 2024-09-21T12:47:08.368 INFO:tasks.workunit.client.1.smithi176.stdout:1/886: chown d0/db/d6f/de1/l13c 1074 1 2024-09-21T12:47:08.368 INFO:tasks.workunit.client.1.smithi176.stdout:8/822: write d6/d16/f2d [270972,71447] 0 2024-09-21T12:47:08.368 INFO:tasks.workunit.client.1.smithi176.stdout:6/825: mknod d2/dd/d26/d2b/d10/d87/c10b 0 2024-09-21T12:47:08.370 INFO:tasks.workunit.client.1.smithi176.stdout:9/889: creat d1/df/d23/d67/df0/f130 x:0 0 0 2024-09-21T12:47:08.371 INFO:tasks.workunit.client.1.smithi176.stdout:7/986: read - d0/d2/d30/df4/d121/d141/f149 zero size 2024-09-21T12:47:08.371 INFO:tasks.workunit.client.1.smithi176.stdout:5/794: truncate d0/d13/d63/d2e/d71/fc7 456593 0 2024-09-21T12:47:08.375 INFO:tasks.workunit.client.1.smithi176.stdout:3/988: symlink d1/d34/d71/d91/df6/d11f/l163 0 2024-09-21T12:47:08.377 INFO:tasks.workunit.client.1.smithi176.stdout:6/826: rename d2/d6f/f7c to d2/dd/d26/d2b/d10/d39/f10c 0 2024-09-21T12:47:08.377 INFO:tasks.workunit.client.1.smithi176.stdout:4/860: truncate d3/fb1 3073789 0 2024-09-21T12:47:08.378 INFO:tasks.workunit.client.1.smithi176.stdout:6/827: readlink d2/d63/lb5 0 2024-09-21T12:47:08.379 INFO:tasks.workunit.client.1.smithi176.stdout:2/882: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:47:08.380 INFO:tasks.workunit.client.1.smithi176.stdout:6/828: fsync d2/d5d/fca 0 2024-09-21T12:47:08.382 INFO:tasks.workunit.client.1.smithi176.stdout:3/989: creat d1/d34/d71/d91/df6/d11f/f164 x:0 0 0 2024-09-21T12:47:08.383 INFO:tasks.workunit.client.1.smithi176.stdout:6/829: chown d2/dd/d26/d2b/d10/d1b/d37/f4b 1354909 1 2024-09-21T12:47:08.387 INFO:tasks.workunit.client.1.smithi176.stdout:7/987: mkdir d0/d2/d30/df4/d121/d141/d148/d156 0 2024-09-21T12:47:08.387 INFO:tasks.workunit.client.1.smithi176.stdout:9/890: dwrite d1/df/d48/d69/d38/ff1 [4194304,4194304] 0 2024-09-21T12:47:08.388 INFO:tasks.workunit.client.1.smithi176.stdout:2/883: mkdir d4/df/d2e/d6f/d5d/d67/d9f/d113 0 2024-09-21T12:47:08.390 INFO:tasks.workunit.client.1.smithi176.stdout:6/830: mkdir d2/dd/d26/d2b/d10d 0 2024-09-21T12:47:08.393 INFO:tasks.workunit.client.1.smithi176.stdout:1/887: dread d0/db/f17 [0,4194304] 0 2024-09-21T12:47:08.393 INFO:tasks.workunit.client.1.smithi176.stdout:2/884: write d4/df/d2e/d39/db7/d80/fb5 [373660,32936] 0 2024-09-21T12:47:08.393 INFO:tasks.workunit.client.1.smithi176.stdout:4/861: truncate d3/d42/d56/d101/d107/d36/f11b 718730 0 2024-09-21T12:47:08.396 INFO:tasks.workunit.client.1.smithi176.stdout:8/823: dwrite d6/d8/d54/f8c [0,4194304] 0 2024-09-21T12:47:08.399 INFO:tasks.workunit.client.1.smithi176.stdout:6/831: rename d2/dd/d26/l3a to d2/dd/d26/d2b/d10/d39/daf/l10e 0 2024-09-21T12:47:08.400 INFO:tasks.workunit.client.1.smithi176.stdout:5/795: write d0/d13/d63/d2e/d37/db5/db7/f3e [3082072,16755] 0 2024-09-21T12:47:08.401 INFO:tasks.workunit.client.1.smithi176.stdout:2/885: symlink d4/df/d2e/l114 0 2024-09-21T12:47:08.403 INFO:tasks.workunit.client.1.smithi176.stdout:4/862: symlink d3/d42/d56/d101/d107/l132 0 2024-09-21T12:47:08.406 INFO:tasks.workunit.client.1.smithi176.stdout:1/888: mkdir d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/d131/d142 0 2024-09-21T12:47:08.408 INFO:tasks.workunit.client.1.smithi176.stdout:4/863: creat d3/d42/d102/f133 x:0 0 0 2024-09-21T12:47:08.410 INFO:tasks.workunit.client.1.smithi176.stdout:2/886: truncate d4/df/d2e/fec 1749249 0 2024-09-21T12:47:08.411 INFO:tasks.workunit.client.1.smithi176.stdout:1/889: unlink d0/ca8 0 2024-09-21T12:47:08.412 INFO:tasks.workunit.client.1.smithi176.stdout:4/864: chown d3/d21/d5e/fce 2084 1 2024-09-21T12:47:08.412 INFO:tasks.workunit.client.1.smithi176.stdout:8/824: dwrite d6/fe1 [0,4194304] 0 2024-09-21T12:47:08.418 INFO:tasks.workunit.client.1.smithi176.stdout:9/891: dread d1/d8b/fc9 [0,4194304] 0 2024-09-21T12:47:08.420 INFO:tasks.workunit.client.1.smithi176.stdout:5/796: dwrite d0/d13/d63/d8d/ddc/d41/f6c [0,4194304] 0 2024-09-21T12:47:08.423 INFO:tasks.workunit.client.1.smithi176.stdout:1/890: dwrite d0/d91/db1/f124 [0,4194304] 0 2024-09-21T12:47:08.423 INFO:tasks.workunit.client.1.smithi176.stdout:5/797: fdatasync d0/d13/d63/d2e/d37/db5/db7/f3e 0 2024-09-21T12:47:08.438 INFO:tasks.workunit.client.1.smithi176.stdout:6/832: dread d2/dd/d26/d2b/d10/d1b/d37/f4b [0,4194304] 0 2024-09-21T12:47:08.440 INFO:tasks.workunit.client.1.smithi176.stdout:5/798: dwrite d0/d13/d5d/fab [0,4194304] 0 2024-09-21T12:47:08.441 INFO:tasks.workunit.client.1.smithi176.stdout:6/833: dread d2/fbc [0,4194304] 0 2024-09-21T12:47:08.446 INFO:tasks.workunit.client.1.smithi176.stdout:5/799: dwrite d0/d13/d63/d72/d87/d92/fb9 [0,4194304] 0 2024-09-21T12:47:08.453 INFO:tasks.workunit.client.1.smithi176.stdout:5/800: dwrite d0/d13/d63/d72/fdf [4194304,4194304] 0 2024-09-21T12:47:08.508 INFO:tasks.workunit.client.1.smithi176.stdout:2/887: mkdir d4/df/d2e/d115 0 2024-09-21T12:47:08.508 INFO:tasks.workunit.client.1.smithi176.stdout:4/865: chown d3/d21/d27/d2c/f41 0 1 2024-09-21T12:47:08.510 INFO:tasks.workunit.client.1.smithi176.stdout:4/866: dread - d3/d21/d88/da7/f109 zero size 2024-09-21T12:47:08.511 INFO:tasks.workunit.client.1.smithi176.stdout:9/892: write d1/df/d48/d69/d4d/f96 [1131814,127116] 0 2024-09-21T12:47:08.513 INFO:tasks.workunit.client.1.smithi176.stdout:7/988: dwrite d0/d2/db/d10/d72/d51/f6e [4194304,4194304] 0 2024-09-21T12:47:08.513 INFO:tasks.workunit.client.1.smithi176.stdout:1/891: mkdir d0/db/d1a/d2c/d6b/dd7/d143 0 2024-09-21T12:47:08.515 INFO:tasks.workunit.client.1.smithi176.stdout:7/989: readlink d0/d2/d30/d93/d96/l8b 0 2024-09-21T12:47:08.524 INFO:tasks.workunit.client.1.smithi176.stdout:3/990: sync 2024-09-21T12:47:08.531 INFO:tasks.workunit.client.1.smithi176.stdout:3/991: dread d1/d35/f32 [0,4194304] 0 2024-09-21T12:47:08.538 INFO:tasks.workunit.client.0.smithi046.stdout:3/252: sync 2024-09-21T12:47:08.540 INFO:tasks.workunit.client.1.smithi176.stdout:6/834: mkdir d2/d6f/d7f/dbf/d10f 0 2024-09-21T12:47:08.541 INFO:tasks.workunit.client.0.smithi046.stdout:3/253: unlink d5/d16/l49 0 2024-09-21T12:47:08.543 INFO:tasks.workunit.client.0.smithi046.stdout:3/254: write d5/dc/d26/f4f [438729,89126] 0 2024-09-21T12:47:08.543 INFO:tasks.workunit.client.1.smithi176.stdout:5/801: symlink d0/l104 0 2024-09-21T12:47:08.548 INFO:tasks.workunit.client.1.smithi176.stdout:7/990: truncate d0/d5d/d7a/f11a 772891 0 2024-09-21T12:47:08.549 INFO:tasks.workunit.client.1.smithi176.stdout:7/991: chown d0/d2/d30/df4/d121/d141/d148/d138/f13e 57442037 1 2024-09-21T12:47:08.551 INFO:tasks.workunit.client.1.smithi176.stdout:5/802: symlink d0/d13/d63/d72/d87/d92/l105 0 2024-09-21T12:47:08.553 INFO:tasks.workunit.client.1.smithi176.stdout:8/825: getdents d6/d16/d36/d67/dd1 0 2024-09-21T12:47:08.554 INFO:tasks.workunit.client.1.smithi176.stdout:4/867: rename d3/d42/d56/d4e/df8/f111 to d3/d42/f134 0 2024-09-21T12:47:08.559 INFO:tasks.workunit.client.1.smithi176.stdout:8/826: dwrite d6/db/d13/d98/da1/f100 [0,4194304] 0 2024-09-21T12:47:08.566 INFO:tasks.workunit.client.1.smithi176.stdout:7/992: dread d0/d2/db/d10/f29 [0,4194304] 0 2024-09-21T12:47:08.570 INFO:tasks.workunit.client.1.smithi176.stdout:7/993: dwrite d0/d2f/d43/f6b [0,4194304] 0 2024-09-21T12:47:08.575 INFO:tasks.workunit.client.1.smithi176.stdout:7/994: read d0/d2/db/d10/d31/da1/f120 [168896,8227] 0 2024-09-21T12:47:08.576 INFO:tasks.workunit.client.1.smithi176.stdout:7/995: dread - d0/d2/d30/d93/d96/d89/d14d/f134 zero size 2024-09-21T12:47:08.614 INFO:tasks.workunit.client.1.smithi176.stdout:5/803: mkdir d0/d13/d63/d72/d87/d92/d106 0 2024-09-21T12:47:08.614 INFO:tasks.workunit.client.1.smithi176.stdout:5/804: readlink d0/d13/d63/d72/d87/dcf/ld0 0 2024-09-21T12:47:08.616 INFO:tasks.workunit.client.1.smithi176.stdout:9/893: getdents d1/df/d48/d69/d76/d7c 0 2024-09-21T12:47:08.617 INFO:tasks.workunit.client.1.smithi176.stdout:9/894: fsync d1/df/d48/d69/fc7 0 2024-09-21T12:47:08.617 INFO:tasks.workunit.client.1.smithi176.stdout:9/895: stat d1/df/d48/d69/d40 0 2024-09-21T12:47:08.684 INFO:tasks.workunit.client.1.smithi176.stdout:8/827: write d6/db/d13/d98/dde/de5/f103 [2260466,9056] 0 2024-09-21T12:47:08.689 INFO:tasks.workunit.client.1.smithi176.stdout:8/828: stat d6/d16/d36/l3d 0 2024-09-21T12:47:08.692 INFO:tasks.workunit.client.1.smithi176.stdout:6/835: rename d2/dd/d26/d2b/d5a to d2/dd/d26/d110 0 2024-09-21T12:47:08.696 INFO:tasks.workunit.client.1.smithi176.stdout:4/868: rename d3/d42/d56/d4e/df8/l11e to d3/d21/df5/l135 0 2024-09-21T12:47:08.699 INFO:tasks.workunit.client.1.smithi176.stdout:6/836: dwrite d2/dd/d26/d2b/d68/dfa/fb4 [4194304,4194304] 0 2024-09-21T12:47:08.700 INFO:tasks.workunit.client.1.smithi176.stdout:8/829: rename d6/db/d13/d98/fd7 to d6/d8/d24/d5e/de8/f106 0 2024-09-21T12:47:08.705 INFO:tasks.workunit.client.1.smithi176.stdout:6/837: chown d2/dd/l99 1707 1 2024-09-21T12:47:08.706 INFO:tasks.workunit.client.1.smithi176.stdout:8/830: stat l2 0 2024-09-21T12:47:08.706 INFO:tasks.workunit.client.1.smithi176.stdout:2/888: write d4/df/df7/f5c [969056,70379] 0 2024-09-21T12:47:08.708 INFO:tasks.workunit.client.1.smithi176.stdout:1/892: write d0/db/d1a/d2c/d48/d50/f9c [519741,1725] 0 2024-09-21T12:47:08.710 INFO:tasks.workunit.client.1.smithi176.stdout:5/805: sync 2024-09-21T12:47:08.711 INFO:tasks.workunit.client.1.smithi176.stdout:5/806: chown d0/fd9 157158 1 2024-09-21T12:47:08.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/255: dwrite d5/dc/d28/f53 [0,4194304] 0 2024-09-21T12:47:08.713 INFO:tasks.workunit.client.1.smithi176.stdout:5/807: chown d0/d13/d5d/d98/da5 2 1 2024-09-21T12:47:08.715 INFO:tasks.workunit.client.1.smithi176.stdout:8/831: dwrite d6/db/d37/f88 [4194304,4194304] 0 2024-09-21T12:47:08.718 INFO:tasks.workunit.client.1.smithi176.stdout:5/808: write d0/d13/d63/d2e/d37/db5/fba [1011181,118565] 0 2024-09-21T12:47:08.718 INFO:tasks.workunit.client.1.smithi176.stdout:3/992: dwrite d1/d5/d25/d61/fe1 [0,4194304] 0 2024-09-21T12:47:08.721 INFO:tasks.workunit.client.1.smithi176.stdout:8/832: write d6/d16/f2d [1591826,113810] 0 2024-09-21T12:47:08.723 INFO:tasks.workunit.client.1.smithi176.stdout:2/889: link d4/df/d2e/d6f/f3e d4/df/d2e/d39/db7/d80/dda/df9/f116 0 2024-09-21T12:47:08.724 INFO:tasks.workunit.client.1.smithi176.stdout:8/833: write d6/db/da3/fc1 [486648,63974] 0 2024-09-21T12:47:08.725 INFO:tasks.workunit.client.1.smithi176.stdout:7/996: write d0/d2/db/d10/d23/dce/f47 [3509428,55629] 0 2024-09-21T12:47:08.725 INFO:tasks.workunit.client.1.smithi176.stdout:6/838: getdents d2/dd/d26/d2b/d68 0 2024-09-21T12:47:08.727 INFO:tasks.workunit.client.1.smithi176.stdout:9/896: truncate d1/d63/fb2 3378615 0 2024-09-21T12:47:08.730 INFO:tasks.workunit.client.1.smithi176.stdout:1/893: dwrite d0/db/d1a/d2c/d37/fd6 [4194304,4194304] 0 2024-09-21T12:47:08.731 INFO:tasks.workunit.client.1.smithi176.stdout:4/869: truncate d3/d42/d56/d101/d107/d96/da3/fad 3807782 0 2024-09-21T12:47:08.732 INFO:tasks.workunit.client.1.smithi176.stdout:8/834: mknod d6/d8/d24/d5e/c107 0 2024-09-21T12:47:08.733 INFO:tasks.workunit.client.0.smithi046.stdout:3/256: write d5/dc/d28/f2c [3821432,13464] 0 2024-09-21T12:47:08.733 INFO:tasks.workunit.client.1.smithi176.stdout:4/870: fdatasync d3/d42/d56/f10a 0 2024-09-21T12:47:08.736 INFO:tasks.workunit.client.1.smithi176.stdout:2/890: creat d4/df/d2e/d6f/d5d/d81/f117 x:0 0 0 2024-09-21T12:47:08.736 INFO:tasks.workunit.client.1.smithi176.stdout:2/891: chown d4/df/d2e/d4d 101 1 2024-09-21T12:47:08.736 INFO:tasks.workunit.client.1.smithi176.stdout:9/897: symlink d1/df/d48/d69/d40/d84/dfd/l131 0 2024-09-21T12:47:08.737 INFO:tasks.workunit.client.0.smithi046.stdout:3/257: symlink d5/dc/d30/d34/l5a 0 2024-09-21T12:47:08.739 INFO:tasks.workunit.client.1.smithi176.stdout:8/835: chown d6/d16/d9c/fbf 793715219 1 2024-09-21T12:47:08.739 INFO:tasks.workunit.client.1.smithi176.stdout:6/839: dread d2/dd/d79/fab [0,4194304] 0 2024-09-21T12:47:08.741 INFO:tasks.workunit.client.1.smithi176.stdout:5/809: creat d0/d13/d5d/d98/da5/de1/f107 x:0 0 0 2024-09-21T12:47:08.741 INFO:tasks.workunit.client.1.smithi176.stdout:6/840: chown d2/d6f/d7f/dbf/lc8 380 1 2024-09-21T12:47:08.742 INFO:tasks.workunit.client.1.smithi176.stdout:3/993: dread d1/da/f22 [0,4194304] 0 2024-09-21T12:47:08.742 INFO:tasks.workunit.client.1.smithi176.stdout:1/894: dread d0/db/d1a/d73/f85 [0,4194304] 0 2024-09-21T12:47:08.743 INFO:tasks.workunit.client.1.smithi176.stdout:7/997: mknod d0/d2/db/d10/c157 0 2024-09-21T12:47:08.744 INFO:tasks.workunit.client.1.smithi176.stdout:5/810: chown d0/d13/d63/d72/l96 1506826463 1 2024-09-21T12:47:08.745 INFO:tasks.workunit.client.1.smithi176.stdout:6/841: truncate d2/dd/d26/d2b/d68/fb2 343606 0 2024-09-21T12:47:08.746 INFO:tasks.workunit.client.1.smithi176.stdout:9/898: mkdir d1/df/d23/d67/df0/d108/d132 0 2024-09-21T12:47:08.747 INFO:tasks.workunit.client.1.smithi176.stdout:8/836: mkdir d6/db/d13/d98/dde/de5/d108 0 2024-09-21T12:47:08.747 INFO:tasks.workunit.client.1.smithi176.stdout:9/899: write d1/df/fef [5112893,13715] 0 2024-09-21T12:47:08.748 INFO:tasks.workunit.client.1.smithi176.stdout:6/842: write d2/dd/d26/f38 [4576911,78340] 0 2024-09-21T12:47:08.748 INFO:tasks.workunit.client.1.smithi176.stdout:7/998: write d0/f20 [2877112,46777] 0 2024-09-21T12:47:08.752 INFO:tasks.workunit.client.1.smithi176.stdout:1/895: rmdir d0/db/d1a/d2c/dc5/d41/d59 39 2024-09-21T12:47:08.754 INFO:tasks.workunit.client.1.smithi176.stdout:2/892: dread d4/df/d2e/d6f/d6d/f74 [0,4194304] 0 2024-09-21T12:47:08.756 INFO:tasks.workunit.client.1.smithi176.stdout:8/837: write d6/d16/d79/fd6 [2385902,20688] 0 2024-09-21T12:47:08.757 INFO:tasks.workunit.client.1.smithi176.stdout:6/843: read d2/f34 [3819796,12535] 0 2024-09-21T12:47:08.758 INFO:tasks.workunit.client.1.smithi176.stdout:4/871: rename d3/d21/d27/l5a to d3/d21/l136 0 2024-09-21T12:47:08.758 INFO:tasks.workunit.client.0.smithi046.stdout:3/258: write d5/d16/f1e [1353257,29241] 0 2024-09-21T12:47:08.759 INFO:tasks.workunit.client.1.smithi176.stdout:9/900: dwrite d1/df/d9a/d121/f3c [4194304,4194304] 0 2024-09-21T12:47:08.759 INFO:tasks.workunit.client.1.smithi176.stdout:5/811: mknod d0/d13/d63/c108 0 2024-09-21T12:47:08.760 INFO:tasks.workunit.client.1.smithi176.stdout:6/844: readlink d2/dd/d26/d2b/d10/l33 0 2024-09-21T12:47:08.761 INFO:tasks.workunit.client.1.smithi176.stdout:6/845: chown d2/dd/d26/d2b/d68 616766 1 2024-09-21T12:47:08.765 INFO:tasks.workunit.client.0.smithi046.stdout:5/297: sync 2024-09-21T12:47:08.766 INFO:tasks.workunit.client.0.smithi046.stdout:1/263: sync 2024-09-21T12:47:08.766 INFO:tasks.workunit.client.0.smithi046.stdout:6/288: sync 2024-09-21T12:47:08.766 INFO:tasks.workunit.client.1.smithi176.stdout:3/994: write d1/d34/d57/ff9 [327620,87684] 0 2024-09-21T12:47:08.770 INFO:tasks.workunit.client.1.smithi176.stdout:6/846: dread - d2/d6f/d81/fb3 zero size 2024-09-21T12:47:08.771 INFO:tasks.workunit.client.1.smithi176.stdout:6/847: write d2/f31 [7759469,52436] 0 2024-09-21T12:47:08.773 INFO:tasks.workunit.client.1.smithi176.stdout:7/999: rename d0/d2/db/c13 to d0/d2/d30/d93/d96/d89/d11b/c158 0 2024-09-21T12:47:08.774 INFO:tasks.workunit.client.0.smithi046.stdout:5/298: dwrite d4/dc/d13/f23 [0,4194304] 0 2024-09-21T12:47:08.779 INFO:tasks.workunit.client.0.smithi046.stdout:5/299: dread d4/dc/d13/f23 [0,4194304] 0 2024-09-21T12:47:08.780 INFO:tasks.workunit.client.0.smithi046.stdout:6/289: link de/d2a/c53 de/d2a/d34/c5d 0 2024-09-21T12:47:08.781 INFO:tasks.workunit.client.0.smithi046.stdout:1/264: link d4/d29/c44 d4/d13/d38/c63 0 2024-09-21T12:47:08.784 INFO:tasks.workunit.client.1.smithi176.stdout:6/848: creat d2/d6f/d7f/f111 x:0 0 0 2024-09-21T12:47:08.785 INFO:tasks.workunit.client.1.smithi176.stdout:8/838: getdents d6/d16/d79 0 2024-09-21T12:47:08.786 INFO:tasks.workunit.client.0.smithi046.stdout:3/259: dread d5/f6 [0,4194304] 0 2024-09-21T12:47:08.786 INFO:tasks.workunit.client.0.smithi046.stdout:1/265: unlink d4/d13/c39 0 2024-09-21T12:47:08.789 INFO:tasks.workunit.client.0.smithi046.stdout:6/290: rename de/f45 to de/d2a/f5e 0 2024-09-21T12:47:08.790 INFO:tasks.workunit.client.1.smithi176.stdout:1/896: link d0/db/d6f/de1/d10b/l11d d0/db/d1a/d2c/dc5/d41/l144 0 2024-09-21T12:47:08.791 INFO:tasks.workunit.client.1.smithi176.stdout:1/897: write d0/d63/f6c [976841,20751] 0 2024-09-21T12:47:08.793 INFO:tasks.workunit.client.1.smithi176.stdout:6/849: mknod d2/dd/d26/d2b/d10/d87/c112 0 2024-09-21T12:47:08.794 INFO:tasks.workunit.client.0.smithi046.stdout:1/266: mknod d4/d13/d38/d48/c64 0 2024-09-21T12:47:08.795 INFO:tasks.workunit.client.1.smithi176.stdout:8/839: rename d6/db/d37/d89/f8d to d6/db/d37/d89/d8a/dd4/f109 0 2024-09-21T12:47:08.796 INFO:tasks.workunit.client.0.smithi046.stdout:6/291: fsync de/f13 0 2024-09-21T12:47:08.798 INFO:tasks.workunit.client.0.smithi046.stdout:3/260: mknod d5/c5b 0 2024-09-21T12:47:08.799 INFO:tasks.workunit.client.1.smithi176.stdout:8/840: dread d6/db/d37/f88 [4194304,4194304] 0 2024-09-21T12:47:08.799 INFO:tasks.workunit.client.0.smithi046.stdout:2/305: sync 2024-09-21T12:47:08.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/359: sync 2024-09-21T12:47:08.799 INFO:tasks.workunit.client.0.smithi046.stdout:8/309: sync 2024-09-21T12:47:08.799 INFO:tasks.workunit.client.0.smithi046.stdout:9/358: sync 2024-09-21T12:47:08.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/199: sync 2024-09-21T12:47:08.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/365: sync 2024-09-21T12:47:08.800 INFO:tasks.workunit.client.0.smithi046.stdout:1/267: readlink d4/l8 0 2024-09-21T12:47:08.803 INFO:tasks.workunit.client.1.smithi176.stdout:9/901: getdents d1/df/dc3 0 2024-09-21T12:47:08.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/310: write d1/d12/d1a/f2c [1244533,1461] 0 2024-09-21T12:47:08.805 INFO:tasks.workunit.client.1.smithi176.stdout:5/812: getdents d0/d13/d63/d2e/d37 0 2024-09-21T12:47:08.807 INFO:tasks.workunit.client.1.smithi176.stdout:6/850: rmdir d2/dd 39 2024-09-21T12:47:08.809 INFO:tasks.workunit.client.0.smithi046.stdout:7/200: dread d2/d4/f8 [0,4194304] 0 2024-09-21T12:47:08.811 INFO:tasks.workunit.client.0.smithi046.stdout:4/360: dwrite d1/d13/d25/d29/d33/f76 [0,4194304] 0 2024-09-21T12:47:08.817 INFO:tasks.workunit.client.0.smithi046.stdout:2/306: creat d16/d22/d2b/d43/f5a x:0 0 0 2024-09-21T12:47:08.819 INFO:tasks.workunit.client.0.smithi046.stdout:6/292: dread de/f15 [0,4194304] 0 2024-09-21T12:47:08.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/307: truncate d16/d22/d38/f4f 505908 0 2024-09-21T12:47:08.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/308: fsync fa 0 2024-09-21T12:47:08.820 INFO:tasks.workunit.client.0.smithi046.stdout:5/300: truncate d4/dc/d28/d2d/d43/f48 1756523 0 2024-09-21T12:47:08.820 INFO:tasks.workunit.client.0.smithi046.stdout:6/293: fdatasync de/f46 0 2024-09-21T12:47:08.822 INFO:tasks.workunit.client.0.smithi046.stdout:6/294: fdatasync de/d2a/f49 0 2024-09-21T12:47:08.822 INFO:tasks.workunit.client.1.smithi176.stdout:1/898: creat d0/db/d1a/d2c/d6b/dd7/dfd/f145 x:0 0 0 2024-09-21T12:47:08.823 INFO:tasks.workunit.client.1.smithi176.stdout:3/995: dwrite d1/d34/d48/f68 [4194304,4194304] 0 2024-09-21T12:47:08.826 INFO:tasks.workunit.client.0.smithi046.stdout:0/366: symlink d6/d7/d13/d43/d52/d63/d7f/d78/l8d 0 2024-09-21T12:47:08.830 INFO:tasks.workunit.client.0.smithi046.stdout:0/367: read d6/d7/d13/d43/d52/d63/d7f/f5f [5073656,4010] 0 2024-09-21T12:47:08.831 INFO:tasks.workunit.client.0.smithi046.stdout:3/261: mknod d5/dc/d26/d3c/d44/c5c 0 2024-09-21T12:47:08.831 INFO:tasks.workunit.client.0.smithi046.stdout:6/295: dwrite de/d48/f4a [8388608,4194304] 0 2024-09-21T12:47:08.834 INFO:tasks.workunit.client.0.smithi046.stdout:6/296: readlink de/d2a/d34/l3e 0 2024-09-21T12:47:08.836 INFO:tasks.workunit.client.0.smithi046.stdout:8/311: mkdir d1/d24/d6a 0 2024-09-21T12:47:08.836 INFO:tasks.workunit.client.0.smithi046.stdout:6/297: write de/f44 [909869,112684] 0 2024-09-21T12:47:08.837 INFO:tasks.workunit.client.0.smithi046.stdout:8/312: chown d1/c17 1 1 2024-09-21T12:47:08.842 INFO:tasks.workunit.client.0.smithi046.stdout:9/359: dwrite f6 [0,4194304] 0 2024-09-21T12:47:08.844 INFO:tasks.workunit.client.1.smithi176.stdout:1/899: fsync d0/db/d1a/f20 0 2024-09-21T12:47:08.844 INFO:tasks.workunit.client.1.smithi176.stdout:9/902: dread d1/f97 [0,4194304] 0 2024-09-21T12:47:08.845 INFO:tasks.workunit.client.0.smithi046.stdout:9/360: fdatasync d11/d19/d36/d45/f51 0 2024-09-21T12:47:08.845 INFO:tasks.workunit.client.0.smithi046.stdout:7/201: mkdir d2/d4/d43 0 2024-09-21T12:47:08.845 INFO:tasks.workunit.client.0.smithi046.stdout:7/202: dread - d2/d4/f2f zero size 2024-09-21T12:47:08.847 INFO:tasks.workunit.client.1.smithi176.stdout:5/813: mkdir d0/d13/d63/d8d/ddc/d109 0 2024-09-21T12:47:08.848 INFO:tasks.workunit.client.1.smithi176.stdout:6/851: symlink d2/dd/d79/l113 0 2024-09-21T12:47:08.850 INFO:tasks.workunit.client.1.smithi176.stdout:4/872: sync 2024-09-21T12:47:08.850 INFO:tasks.workunit.client.1.smithi176.stdout:2/893: sync 2024-09-21T12:47:08.851 INFO:tasks.workunit.client.1.smithi176.stdout:8/841: creat d6/f10a x:0 0 0 2024-09-21T12:47:08.855 INFO:tasks.workunit.client.1.smithi176.stdout:8/842: read d6/d8/fb5 [381,126339] 0 2024-09-21T12:47:08.858 INFO:tasks.workunit.client.1.smithi176.stdout:4/873: dwrite d3/d21/d5e/fce [0,4194304] 0 2024-09-21T12:47:08.860 INFO:tasks.workunit.client.0.smithi046.stdout:8/313: dread d1/d12/f3b [0,4194304] 0 2024-09-21T12:47:08.860 INFO:tasks.workunit.client.1.smithi176.stdout:9/903: mknod d1/d8b/c133 0 2024-09-21T12:47:08.862 INFO:tasks.workunit.client.0.smithi046.stdout:2/309: symlink d16/d22/d4e/l5b 0 2024-09-21T12:47:08.862 INFO:tasks.workunit.client.0.smithi046.stdout:2/310: stat d16/d22/f41 0 2024-09-21T12:47:08.865 INFO:tasks.workunit.client.1.smithi176.stdout:4/874: dread d3/d42/d47/dab/fd9 [0,4194304] 0 2024-09-21T12:47:08.866 INFO:tasks.workunit.client.1.smithi176.stdout:8/843: dread d6/db/d13/d98/da1/fd8 [0,4194304] 0 2024-09-21T12:47:08.869 INFO:tasks.workunit.client.1.smithi176.stdout:3/996: dwrite d1/d3e/f41 [0,4194304] 0 2024-09-21T12:47:08.869 INFO:tasks.workunit.client.0.smithi046.stdout:3/262: creat d5/dc/d26/d3c/d44/f5d x:0 0 0 2024-09-21T12:47:08.870 INFO:tasks.workunit.client.1.smithi176.stdout:2/894: write d4/df/f22 [251224,93390] 0 2024-09-21T12:47:08.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/263: dread - d5/d16/f47 zero size 2024-09-21T12:47:08.875 INFO:tasks.workunit.client.0.smithi046.stdout:4/361: dwrite d1/d13/d25/d29/d33/f62 [0,4194304] 0 2024-09-21T12:47:08.875 INFO:tasks.workunit.client.0.smithi046.stdout:6/298: rmdir de/d2a 39 2024-09-21T12:47:08.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/299: stat de/c29 0 2024-09-21T12:47:08.877 INFO:tasks.workunit.client.1.smithi176.stdout:2/895: dwrite d4/df/d4b/fc7 [0,4194304] 0 2024-09-21T12:47:08.878 INFO:tasks.workunit.client.0.smithi046.stdout:4/362: write d1/f74 [667378,54263] 0 2024-09-21T12:47:08.878 INFO:tasks.workunit.client.0.smithi046.stdout:6/300: chown de/c1f 0 1 2024-09-21T12:47:08.878 INFO:tasks.workunit.client.0.smithi046.stdout:4/363: chown d1/d27 258 1 2024-09-21T12:47:08.881 INFO:tasks.workunit.client.1.smithi176.stdout:9/904: unlink d1/df/d48/d69/f27 0 2024-09-21T12:47:08.883 INFO:tasks.workunit.client.1.smithi176.stdout:1/900: creat d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/ded/f146 x:0 0 0 2024-09-21T12:47:08.890 INFO:tasks.workunit.client.0.smithi046.stdout:5/301: dwrite d4/d22/f32 [0,4194304] 0 2024-09-21T12:47:08.890 INFO:tasks.workunit.client.1.smithi176.stdout:3/997: rmdir d1/d5/d25/d146 39 2024-09-21T12:47:08.901 INFO:tasks.workunit.client.1.smithi176.stdout:2/896: dread d4/df/df7/f45 [0,4194304] 0 2024-09-21T12:47:08.903 INFO:tasks.workunit.client.0.smithi046.stdout:9/361: mknod d11/d19/d36/d45/d64/c70 0 2024-09-21T12:47:08.904 INFO:tasks.workunit.client.1.smithi176.stdout:5/814: truncate d0/d13/d63/d72/f91 3749357 0 2024-09-21T12:47:08.904 INFO:tasks.workunit.client.1.smithi176.stdout:1/901: truncate d0/db/d6f/f7d 522675 0 2024-09-21T12:47:08.906 INFO:tasks.workunit.client.1.smithi176.stdout:6/852: truncate d2/dd/d26/d2b/d10/d39/fd8 180024 0 2024-09-21T12:47:08.906 INFO:tasks.workunit.client.1.smithi176.stdout:6/853: fsync d2/d6f/d7f/fa8 0 2024-09-21T12:47:08.907 INFO:tasks.workunit.client.0.smithi046.stdout:2/311: mkdir d16/d5c 0 2024-09-21T12:47:08.908 INFO:tasks.workunit.client.1.smithi176.stdout:8/844: getdents d6/d16/d36/d67/dd1 0 2024-09-21T12:47:08.910 INFO:tasks.workunit.client.1.smithi176.stdout:2/897: mkdir d4/df/d2e/d6f/d5d/d118 0 2024-09-21T12:47:08.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/368: rename d6/c14 to d6/d7/c8e 0 2024-09-21T12:47:08.913 INFO:tasks.workunit.client.0.smithi046.stdout:0/369: fsync d6/d7/d9/ff 0 2024-09-21T12:47:08.913 INFO:tasks.workunit.client.0.smithi046.stdout:1/268: getdents d4/d13/d38/d53/d5a/d5d 0 2024-09-21T12:47:08.916 INFO:tasks.workunit.client.0.smithi046.stdout:3/264: mkdir d5/d5e 0 2024-09-21T12:47:08.917 INFO:tasks.workunit.client.1.smithi176.stdout:1/902: symlink d0/db/d2a/def/l147 0 2024-09-21T12:47:08.919 INFO:tasks.workunit.client.0.smithi046.stdout:6/301: symlink de/d2a/d4c/l5f 0 2024-09-21T12:47:08.920 INFO:tasks.workunit.client.1.smithi176.stdout:5/815: truncate d0/d13/d63/d2e/d37/fb2 437731 0 2024-09-21T12:47:08.920 INFO:tasks.workunit.client.1.smithi176.stdout:9/905: dwrite d1/d61/d73/d7d/fab [0,4194304] 0 2024-09-21T12:47:08.924 INFO:tasks.workunit.client.1.smithi176.stdout:4/875: link d3/d42/d4d/c73 d3/d42/d47/c137 0 2024-09-21T12:47:08.926 INFO:tasks.workunit.client.0.smithi046.stdout:8/314: creat d1/d12/d1a/f6b x:0 0 0 2024-09-21T12:47:08.926 INFO:tasks.workunit.client.1.smithi176.stdout:5/816: dread d0/d13/d63/d72/fde [0,4194304] 0 2024-09-21T12:47:08.927 INFO:tasks.workunit.client.0.smithi046.stdout:6/302: dwrite de/f26 [4194304,4194304] 0 2024-09-21T12:47:08.931 INFO:tasks.workunit.client.1.smithi176.stdout:8/845: readlink d6/d8/l65 0 2024-09-21T12:47:08.934 INFO:tasks.workunit.client.0.smithi046.stdout:7/203: rename d2/dd/c24 to d2/d4/d43/c44 0 2024-09-21T12:47:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:0/370: symlink d6/d7/d13/d43/d52/l8f 0 2024-09-21T12:47:08.941 INFO:tasks.workunit.client.0.smithi046.stdout:6/303: dwrite de/d2a/d34/f37 [0,4194304] 0 2024-09-21T12:47:08.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/265: dread d5/fb [0,4194304] 0 2024-09-21T12:47:08.947 INFO:tasks.workunit.client.1.smithi176.stdout:6/854: dread d2/dd/d26/d110/f60 [0,4194304] 0 2024-09-21T12:47:08.948 INFO:tasks.workunit.client.0.smithi046.stdout:8/315: mkdir d1/d12/d1a/d33/d6c 0 2024-09-21T12:47:08.949 INFO:tasks.workunit.client.1.smithi176.stdout:9/906: unlink d1/df/d48/d69/d76/d7c/fc4 0 2024-09-21T12:47:08.950 INFO:tasks.workunit.client.0.smithi046.stdout:7/204: dread d2/d4/f8 [4194304,4194304] 0 2024-09-21T12:47:08.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/266: chown d5/dc/d26/f27 7111 1 2024-09-21T12:47:08.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/364: dwrite d1/d13/d25/d3a/f3c [0,4194304] 0 2024-09-21T12:47:08.953 INFO:tasks.workunit.client.1.smithi176.stdout:4/876: fsync d3/d42/d56/d101/d107/f20 0 2024-09-21T12:47:08.956 INFO:tasks.workunit.client.1.smithi176.stdout:5/817: write d0/d13/d63/d66/fc3 [762453,25372] 0 2024-09-21T12:47:08.958 INFO:tasks.workunit.client.1.smithi176.stdout:8/846: mknod d6/db/d32/c10b 0 2024-09-21T12:47:08.958 INFO:tasks.workunit.client.1.smithi176.stdout:5/818: write d0/d13/d63/d72/d87/dcf/ff8 [465320,17425] 0 2024-09-21T12:47:08.961 INFO:tasks.workunit.client.1.smithi176.stdout:3/998: rmdir d1/d3e/d15e 0 2024-09-21T12:47:08.962 INFO:tasks.workunit.client.1.smithi176.stdout:1/903: write d0/f5e [3870555,68481] 0 2024-09-21T12:47:08.971 INFO:tasks.workunit.client.1.smithi176.stdout:9/907: mkdir d1/df/d23/d67/df0/d108/d134 0 2024-09-21T12:47:08.973 INFO:tasks.workunit.client.1.smithi176.stdout:4/877: write d3/d42/d56/d101/d107/fc4 [248184,36054] 0 2024-09-21T12:47:08.975 INFO:tasks.workunit.client.1.smithi176.stdout:4/878: chown d3/d42/d56/d101/d107/d96/da3/l126 649571217 1 2024-09-21T12:47:08.979 INFO:tasks.workunit.client.1.smithi176.stdout:2/898: creat d4/df/d2e/f119 x:0 0 0 2024-09-21T12:47:08.981 INFO:tasks.workunit.client.0.smithi046.stdout:4/365: dread d1/f5d [0,4194304] 0 2024-09-21T12:47:08.983 INFO:tasks.workunit.client.1.smithi176.stdout:5/819: creat d0/d13/d63/d8d/ddc/d109/f10a x:0 0 0 2024-09-21T12:47:08.986 INFO:tasks.workunit.client.0.smithi046.stdout:5/302: link d4/fa d4/dc/d28/f5a 0 2024-09-21T12:47:08.989 INFO:tasks.workunit.client.0.smithi046.stdout:8/316: creat d1/d12/d46/d35/d5b/f6d x:0 0 0 2024-09-21T12:47:08.992 INFO:tasks.workunit.client.0.smithi046.stdout:3/267: mkdir d5/d16/d5f 0 2024-09-21T12:47:08.993 INFO:tasks.workunit.client.1.smithi176.stdout:5/820: creat d0/d13/d63/d2e/f10b x:0 0 0 2024-09-21T12:47:08.996 INFO:tasks.workunit.client.0.smithi046.stdout:9/362: rename d11/d5b/c6c to d11/d19/d1b/d31/c71 0 2024-09-21T12:47:08.998 INFO:tasks.workunit.client.1.smithi176.stdout:5/821: dread d0/d13/d63/d8d/ddc/d41/f9d [0,4194304] 0 2024-09-21T12:47:08.999 INFO:tasks.workunit.client.0.smithi046.stdout:6/304: getdents de/d2a/d34/d4e/d55 0 2024-09-21T12:47:09.000 INFO:tasks.workunit.client.0.smithi046.stdout:6/305: read de/d35/f43 [750482,65655] 0 2024-09-21T12:47:09.001 INFO:tasks.workunit.client.1.smithi176.stdout:8/847: truncate d6/d8/d24/d35/d51/fd3 915871 0 2024-09-21T12:47:09.002 INFO:tasks.workunit.client.0.smithi046.stdout:0/371: write d6/d2f/d32/d7a/f46 [288074,38701] 0 2024-09-21T12:47:09.002 INFO:tasks.workunit.client.0.smithi046.stdout:5/303: rmdir d4/dc/d28/d2d 39 2024-09-21T12:47:09.003 INFO:tasks.workunit.client.1.smithi176.stdout:6/855: write d2/dd/d26/d2b/d10/d39/fd8 [604494,34295] 0 2024-09-21T12:47:09.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/304: stat d4/dc/d13/f23 0 2024-09-21T12:47:09.004 INFO:tasks.workunit.client.1.smithi176.stdout:1/904: link d0/d91/dd3/cfb d0/d13f/d92/c148 0 2024-09-21T12:47:09.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/372: truncate d6/d7/d13/d72/f79 441228 0 2024-09-21T12:47:09.004 INFO:tasks.workunit.client.1.smithi176.stdout:3/999: write d1/d34/f8c [1068155,68791] 0 2024-09-21T12:47:09.005 INFO:tasks.workunit.client.0.smithi046.stdout:8/317: write d1/fd [6990268,63498] 0 2024-09-21T12:47:09.006 INFO:tasks.workunit.client.1.smithi176.stdout:4/879: dwrite d3/d42/dae/f12d [4194304,4194304] 0 2024-09-21T12:47:09.007 INFO:tasks.workunit.client.1.smithi176.stdout:4/880: chown d3/d21/d5e/f74 670 1 2024-09-21T12:47:09.009 INFO:tasks.workunit.client.0.smithi046.stdout:3/268: mkdir d5/dc/d28/d60 0 2024-09-21T12:47:09.010 INFO:tasks.workunit.client.1.smithi176.stdout:8/848: mknod d6/db/d37/d89/d8a/dd4/c10c 0 2024-09-21T12:47:09.011 INFO:tasks.workunit.client.0.smithi046.stdout:4/366: write d1/d27/d46/f3e [3149083,48796] 0 2024-09-21T12:47:09.012 INFO:tasks.workunit.client.1.smithi176.stdout:2/899: truncate d4/df/df7/f5c 320334 0 2024-09-21T12:47:09.013 INFO:tasks.workunit.client.1.smithi176.stdout:2/900: fsync d4/d3d/d65/f9d 0 2024-09-21T12:47:09.013 INFO:tasks.workunit.client.0.smithi046.stdout:1/269: rename d4/d13/d38/d4f/f54 to d4/d13/d38/d53/d5a/f65 0 2024-09-21T12:47:09.014 INFO:tasks.workunit.client.1.smithi176.stdout:1/905: creat d0/d13f/dfa/f149 x:0 0 0 2024-09-21T12:47:09.016 INFO:tasks.workunit.client.1.smithi176.stdout:4/881: write d3/fe0 [210080,2451] 0 2024-09-21T12:47:09.017 INFO:tasks.workunit.client.0.smithi046.stdout:6/306: creat de/d2a/d4d/f60 x:0 0 0 2024-09-21T12:47:09.020 INFO:tasks.workunit.client.1.smithi176.stdout:8/849: creat d6/d16/d36/d7d/f10d x:0 0 0 2024-09-21T12:47:09.023 INFO:tasks.workunit.client.0.smithi046.stdout:3/269: creat d5/dc/d30/d34/f61 x:0 0 0 2024-09-21T12:47:09.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/367: rmdir d1/d13/d25/d29/d33 39 2024-09-21T12:47:09.027 INFO:tasks.workunit.client.0.smithi046.stdout:4/368: write d1/d13/d25/d3a/f4d [4256285,27090] 0 2024-09-21T12:47:09.029 INFO:tasks.workunit.client.1.smithi176.stdout:1/906: rename d0/d91/dd3/df5/f116 to d0/dec/f14a 0 2024-09-21T12:47:09.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/270: creat d4/d13/d38/d53/f66 x:0 0 0 2024-09-21T12:47:09.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/271: dread - d4/d13/f2e zero size 2024-09-21T12:47:09.033 INFO:tasks.workunit.client.0.smithi046.stdout:1/272: stat d4/d13/f2e 0 2024-09-21T12:47:09.034 INFO:tasks.workunit.client.1.smithi176.stdout:4/882: creat d3/d21/d27/d9b/da2/f138 x:0 0 0 2024-09-21T12:47:09.036 INFO:tasks.workunit.client.1.smithi176.stdout:1/907: dwrite d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3/f117 [0,4194304] 0 2024-09-21T12:47:09.039 INFO:tasks.workunit.client.0.smithi046.stdout:6/307: creat de/d35/f61 x:0 0 0 2024-09-21T12:47:09.041 INFO:tasks.workunit.client.1.smithi176.stdout:6/856: write d2/dd/d26/d2b/d10/f2f [2512733,121450] 0 2024-09-21T12:47:09.041 INFO:tasks.workunit.client.0.smithi046.stdout:7/205: getdents d2/d4 0 2024-09-21T12:47:09.042 INFO:tasks.workunit.client.1.smithi176.stdout:8/850: rename d6/db/l20 to d6/d8/d24/d5e/de8/l10e 0 2024-09-21T12:47:09.043 INFO:tasks.workunit.client.0.smithi046.stdout:7/206: write d2/d4/df/d17/d31/d34/f3a [593646,25222] 0 2024-09-21T12:47:09.044 INFO:tasks.workunit.client.1.smithi176.stdout:5/822: dwrite d0/d13/d63/d8d/ddc/f8e [0,4194304] 0 2024-09-21T12:47:09.044 INFO:tasks.workunit.client.0.smithi046.stdout:7/207: read - d2/dd/f3d zero size 2024-09-21T12:47:09.048 INFO:tasks.workunit.client.1.smithi176.stdout:2/901: write d4/df/d2e/d6f/d6d/f71 [2079486,112589] 0 2024-09-21T12:47:09.048 INFO:tasks.workunit.client.1.smithi176.stdout:1/908: rmdir d0/db/d6a 39 2024-09-21T12:47:09.050 INFO:tasks.workunit.client.1.smithi176.stdout:1/909: readlink d0/db/d1a/d2c/d48/d50/l9e 0 2024-09-21T12:47:09.055 INFO:tasks.workunit.client.1.smithi176.stdout:8/851: truncate d6/d16/f1e 4376383 0 2024-09-21T12:47:09.055 INFO:tasks.workunit.client.0.smithi046.stdout:3/270: dwrite d5/fb [0,4194304] 0 2024-09-21T12:47:09.057 INFO:tasks.workunit.client.0.smithi046.stdout:9/363: truncate d11/f54 391347 0 2024-09-21T12:47:09.061 INFO:tasks.workunit.client.0.smithi046.stdout:6/308: fsync f9 0 2024-09-21T12:47:09.067 INFO:tasks.workunit.client.0.smithi046.stdout:8/318: link d1/d12/d1a/c40 d1/d12/d1a/d33/c6e 0 2024-09-21T12:47:09.071 INFO:tasks.workunit.client.0.smithi046.stdout:5/305: rename d4/dc/d28 to d4/dc/d13/d5b 0 2024-09-21T12:47:09.074 INFO:tasks.workunit.client.0.smithi046.stdout:9/364: rmdir d11/d19/d36/d45 39 2024-09-21T12:47:09.075 INFO:tasks.workunit.client.0.smithi046.stdout:7/208: write d2/dd/f1b [953208,31105] 0 2024-09-21T12:47:09.076 INFO:tasks.workunit.client.0.smithi046.stdout:9/365: stat d11/d19/d1b/d31/c46 0 2024-09-21T12:47:09.079 INFO:tasks.workunit.client.1.smithi176.stdout:1/910: creat d0/db/d6a/d89/f14b x:0 0 0 2024-09-21T12:47:09.080 INFO:tasks.workunit.client.0.smithi046.stdout:6/309: truncate de/d2a/f33 992391 0 2024-09-21T12:47:09.082 INFO:tasks.workunit.client.0.smithi046.stdout:1/273: write d4/f37 [1244659,20809] 0 2024-09-21T12:47:09.083 INFO:tasks.workunit.client.0.smithi046.stdout:8/319: mknod d1/d12/d1a/d33/c6f 0 2024-09-21T12:47:09.085 INFO:tasks.workunit.client.1.smithi176.stdout:2/902: rmdir d4/df/d2e/d39/db7/d80/d9e/d106 0 2024-09-21T12:47:09.085 INFO:tasks.workunit.client.1.smithi176.stdout:5/823: dwrite d0/d13/d63/f3d [0,4194304] 0 2024-09-21T12:47:09.086 INFO:tasks.workunit.client.0.smithi046.stdout:8/320: chown d1/d12/d1a/l28 37052096 1 2024-09-21T12:47:09.086 INFO:tasks.workunit.client.0.smithi046.stdout:9/366: dwrite d11/d19/f4d [0,4194304] 0 2024-09-21T12:47:09.087 INFO:tasks.workunit.client.1.smithi176.stdout:2/903: chown d4/df/d2e/d39/db7/d80/cbe 24440747 1 2024-09-21T12:47:09.089 INFO:tasks.workunit.client.1.smithi176.stdout:1/911: creat d0/db/d1a/d2c/dc5/d41/d59/f14c x:0 0 0 2024-09-21T12:47:09.093 INFO:tasks.workunit.client.1.smithi176.stdout:6/857: getdents d2/dd5 0 2024-09-21T12:47:09.095 INFO:tasks.workunit.client.0.smithi046.stdout:5/306: dread d4/dc/d13/f35 [0,4194304] 0 2024-09-21T12:47:09.096 INFO:tasks.workunit.client.0.smithi046.stdout:5/307: write d4/f8 [4489410,69684] 0 2024-09-21T12:47:09.098 INFO:tasks.workunit.client.1.smithi176.stdout:5/824: creat d0/d13/d63/d2e/f10c x:0 0 0 2024-09-21T12:47:09.099 INFO:tasks.workunit.client.1.smithi176.stdout:5/825: dread - d0/fe0 zero size 2024-09-21T12:47:09.104 INFO:tasks.workunit.client.1.smithi176.stdout:8/852: getdents d6/d8/d24/d35 0 2024-09-21T12:47:09.107 INFO:tasks.workunit.client.1.smithi176.stdout:9/908: sync 2024-09-21T12:47:09.108 INFO:tasks.workunit.client.0.smithi046.stdout:3/271: creat d5/f62 x:0 0 0 2024-09-21T12:47:09.109 INFO:tasks.workunit.client.1.smithi176.stdout:2/904: write d4/df/d2e/f7a [226264,128922] 0 2024-09-21T12:47:09.110 INFO:tasks.workunit.client.0.smithi046.stdout:9/367: stat d11/d19/d36/d45/f67 0 2024-09-21T12:47:09.110 INFO:tasks.workunit.client.1.smithi176.stdout:2/905: chown d4/df/d2e/d6f/d5d/d67/d9f/fe0 1907 1 2024-09-21T12:47:09.111 INFO:tasks.workunit.client.0.smithi046.stdout:9/368: write d11/d19/d1b/d1c/f2f [1538452,23747] 0 2024-09-21T12:47:09.111 INFO:tasks.workunit.client.1.smithi176.stdout:1/912: mknod d0/db/d1a/d2c/dc5/d41/d59/d119/c14d 0 2024-09-21T12:47:09.112 INFO:tasks.workunit.client.0.smithi046.stdout:9/369: chown d11/d19/d1b/d1c/f47 1 1 2024-09-21T12:47:09.113 INFO:tasks.workunit.client.1.smithi176.stdout:5/826: write d0/d13/d63/d66/f69 [815597,1130] 0 2024-09-21T12:47:09.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/370: write d11/d19/d1b/d1c/f47 [697557,101012] 0 2024-09-21T12:47:09.115 INFO:tasks.workunit.client.1.smithi176.stdout:8/853: symlink d6/d8/d24/d35/d51/l10f 0 2024-09-21T12:47:09.116 INFO:tasks.workunit.client.0.smithi046.stdout:9/371: chown fb 149399453 1 2024-09-21T12:47:09.117 INFO:tasks.workunit.client.1.smithi176.stdout:1/913: dwrite d0/d13f/f8e [0,4194304] 0 2024-09-21T12:47:09.117 INFO:tasks.workunit.client.1.smithi176.stdout:6/858: write d2/d6f/fe5 [3767681,125814] 0 2024-09-21T12:47:09.117 INFO:tasks.workunit.client.0.smithi046.stdout:9/372: fdatasync d11/f3c 0 2024-09-21T12:47:09.118 INFO:tasks.workunit.client.0.smithi046.stdout:1/274: dwrite d4/d13/f20 [0,4194304] 0 2024-09-21T12:47:09.118 INFO:tasks.workunit.client.1.smithi176.stdout:6/859: stat d2/dd/f11 0 2024-09-21T12:47:09.119 INFO:tasks.workunit.client.1.smithi176.stdout:6/860: write d2/f96 [4802882,62368] 0 2024-09-21T12:47:09.120 INFO:tasks.workunit.client.1.smithi176.stdout:9/909: write d1/d8b/fc9 [3043578,61847] 0 2024-09-21T12:47:09.122 INFO:tasks.workunit.client.1.smithi176.stdout:6/861: read d2/d63/fa4 [569744,84779] 0 2024-09-21T12:47:09.125 INFO:tasks.workunit.client.0.smithi046.stdout:7/209: truncate d2/d4/f8 978742 0 2024-09-21T12:47:09.126 INFO:tasks.workunit.client.0.smithi046.stdout:7/210: fsync d2/d4/f2f 0 2024-09-21T12:47:09.129 INFO:tasks.workunit.client.1.smithi176.stdout:5/827: truncate d0/fa8 23559 0 2024-09-21T12:47:09.129 INFO:tasks.workunit.client.1.smithi176.stdout:2/906: dwrite d4/df/d2e/ddd/ff0 [0,4194304] 0 2024-09-21T12:47:09.131 INFO:tasks.workunit.client.0.smithi046.stdout:8/321: link d1/d12/d46/d35/d5b/f69 d1/d12/d46/d35/d5b/f70 0 2024-09-21T12:47:09.132 INFO:tasks.workunit.client.1.smithi176.stdout:2/907: write d4/d3d/d65/f89 [1359800,80594] 0 2024-09-21T12:47:09.132 INFO:tasks.workunit.client.1.smithi176.stdout:8/854: rmdir d6/db/d37/d89/d8a/dd4 39 2024-09-21T12:47:09.137 INFO:tasks.workunit.client.1.smithi176.stdout:1/914: creat d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/f14e x:0 0 0 2024-09-21T12:47:09.139 INFO:tasks.workunit.client.1.smithi176.stdout:9/910: rename d1/d61/d73/d7d/f8d to d1/df/d48/d69/d76/f135 0 2024-09-21T12:47:09.139 INFO:tasks.workunit.client.0.smithi046.stdout:1/275: stat d4/l8 0 2024-09-21T12:47:09.140 INFO:tasks.workunit.client.0.smithi046.stdout:6/310: link de/d2a/d34/l4f de/d2a/d34/d4e/l62 0 2024-09-21T12:47:09.141 INFO:tasks.workunit.client.1.smithi176.stdout:2/908: dwrite d4/df/d2e/d39/db7/f82 [0,4194304] 0 2024-09-21T12:47:09.143 INFO:tasks.workunit.client.1.smithi176.stdout:5/828: symlink d0/d13/d63/d2e/dda/l10d 0 2024-09-21T12:47:09.143 INFO:tasks.workunit.client.0.smithi046.stdout:9/373: dread d11/d19/d1b/d1c/d1f/d30/d3e/f49 [0,4194304] 0 2024-09-21T12:47:09.145 INFO:tasks.workunit.client.0.smithi046.stdout:9/374: read d11/d19/d1b/f3f [205703,83189] 0 2024-09-21T12:47:09.151 INFO:tasks.workunit.client.1.smithi176.stdout:6/862: rename d2/dd/d26/d2b/d10/d1b/l58 to d2/dd/d26/d2b/d10/d1b/d37/l114 0 2024-09-21T12:47:09.152 INFO:tasks.workunit.client.0.smithi046.stdout:7/211: fsync d2/d4/f8 0 2024-09-21T12:47:09.152 INFO:tasks.workunit.client.1.smithi176.stdout:9/911: truncate d1/d61/d73/d7d/fcb 2417736 0 2024-09-21T12:47:09.154 INFO:tasks.workunit.client.0.smithi046.stdout:5/308: getdents d4 0 2024-09-21T12:47:09.156 INFO:tasks.workunit.client.0.smithi046.stdout:9/375: unlink d11/d19/d20/l60 0 2024-09-21T12:47:09.157 INFO:tasks.workunit.client.0.smithi046.stdout:5/309: write d4/d22/d10/d1a/f59 [5028864,77127] 0 2024-09-21T12:47:09.157 INFO:tasks.workunit.client.0.smithi046.stdout:3/272: dwrite d5/dc/d30/f39 [0,4194304] 0 2024-09-21T12:47:09.158 INFO:tasks.workunit.client.0.smithi046.stdout:1/276: truncate d4/d13/d38/d53/d5a/f65 2624542 0 2024-09-21T12:47:09.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/376: write d11/f61 [937800,28770] 0 2024-09-21T12:47:09.159 INFO:tasks.workunit.client.1.smithi176.stdout:1/915: mkdir d0/db/d1a/d2c/d6b/dd7/d143/d14f 0 2024-09-21T12:47:09.160 INFO:tasks.workunit.client.0.smithi046.stdout:3/273: read d5/fb [2521368,30818] 0 2024-09-21T12:47:09.161 INFO:tasks.workunit.client.0.smithi046.stdout:6/311: mkdir de/d2a/d34/d4e/d55/d63 0 2024-09-21T12:47:09.161 INFO:tasks.workunit.client.0.smithi046.stdout:9/377: chown d11/d19/d1b/d1c/f47 15331650 1 2024-09-21T12:47:09.168 INFO:tasks.workunit.client.1.smithi176.stdout:4/883: sync 2024-09-21T12:47:09.169 INFO:tasks.workunit.client.0.smithi046.stdout:5/310: mkdir d4/dc/d13/d15/d5c 0 2024-09-21T12:47:09.172 INFO:tasks.workunit.client.1.smithi176.stdout:1/916: dread - d0/db/d1a/fb7 zero size 2024-09-21T12:47:09.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/277: mknod d4/d13/c67 0 2024-09-21T12:47:09.173 INFO:tasks.workunit.client.0.smithi046.stdout:7/212: read d2/fe [2730271,109647] 0 2024-09-21T12:47:09.178 INFO:tasks.workunit.client.1.smithi176.stdout:8/855: getdents d6/d8/d24 0 2024-09-21T12:47:09.180 INFO:tasks.workunit.client.0.smithi046.stdout:1/278: dwrite d4/d13/d38/d48/f5c [0,4194304] 0 2024-09-21T12:47:09.181 INFO:tasks.workunit.client.1.smithi176.stdout:6/863: dread d2/d6f/fbb [0,4194304] 0 2024-09-21T12:47:09.181 INFO:tasks.workunit.client.1.smithi176.stdout:4/884: creat d3/d21/d27/d9b/f139 x:0 0 0 2024-09-21T12:47:09.182 INFO:tasks.workunit.client.1.smithi176.stdout:6/864: write d2/d63/fb1 [2437304,27285] 0 2024-09-21T12:47:09.185 INFO:tasks.workunit.client.1.smithi176.stdout:5/829: rmdir d0/d13/d5d/d98/d9b/dad/dfa 0 2024-09-21T12:47:09.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/213: creat d2/d4/df/d17/d31/f45 x:0 0 0 2024-09-21T12:47:09.187 INFO:tasks.workunit.client.1.smithi176.stdout:5/830: read d0/d13/fd1 [277222,61732] 0 2024-09-21T12:47:09.188 INFO:tasks.workunit.client.0.smithi046.stdout:7/214: write d2/fa [2493764,123376] 0 2024-09-21T12:47:09.189 INFO:tasks.workunit.client.0.smithi046.stdout:7/215: dread - d2/d4/df/d17/d31/f45 zero size 2024-09-21T12:47:09.190 INFO:tasks.workunit.client.1.smithi176.stdout:2/909: truncate d4/d3d/fdb 759558 0 2024-09-21T12:47:09.191 INFO:tasks.workunit.client.1.smithi176.stdout:2/910: dread - d4/d3d/d76/fc9 zero size 2024-09-21T12:47:09.192 INFO:tasks.workunit.client.0.smithi046.stdout:7/216: truncate d2/d4/df/d17/d31/f45 243194 0 2024-09-21T12:47:09.192 INFO:tasks.workunit.client.0.smithi046.stdout:7/217: fsync d2/dd/f3d 0 2024-09-21T12:47:09.193 INFO:tasks.workunit.client.0.smithi046.stdout:6/312: creat de/d2a/d34/d4e/d55/d63/f64 x:0 0 0 2024-09-21T12:47:09.194 INFO:tasks.workunit.client.0.smithi046.stdout:7/218: read d2/dd/f1b [169143,12707] 0 2024-09-21T12:47:09.194 INFO:tasks.workunit.client.1.smithi176.stdout:8/856: dread d6/db/d37/d7a/fa5 [0,4194304] 0 2024-09-21T12:47:09.195 INFO:tasks.workunit.client.1.smithi176.stdout:4/885: symlink d3/d42/d47/dab/l13a 0 2024-09-21T12:47:09.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/279: dwrite d4/f9 [0,4194304] 0 2024-09-21T12:47:09.204 INFO:tasks.workunit.client.1.smithi176.stdout:6/865: dread d2/dd/d26/d2b/f2e [0,4194304] 0 2024-09-21T12:47:09.253 INFO:tasks.workunit.client.0.smithi046.stdout:9/378: write fb [1347952,99117] 0 2024-09-21T12:47:09.254 INFO:tasks.workunit.client.1.smithi176.stdout:9/912: creat d1/df/d48/d69/d40/d84/dfd/d12a/f136 x:0 0 0 2024-09-21T12:47:09.255 INFO:tasks.workunit.client.1.smithi176.stdout:9/913: write d1/df/d48/d69/d4d/f107 [453201,26413] 0 2024-09-21T12:47:09.257 INFO:tasks.workunit.client.0.smithi046.stdout:6/313: stat de/d2a/d4d/c5c 0 2024-09-21T12:47:09.258 INFO:tasks.workunit.client.1.smithi176.stdout:9/914: truncate d1/df/d23/dcf/ddd/f103 615681 0 2024-09-21T12:47:09.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/314: write de/d48/f4a [9901655,117633] 0 2024-09-21T12:47:09.259 INFO:tasks.workunit.client.1.smithi176.stdout:9/915: write d1/df/d48/d69/d76/d7c/fc6 [979234,113810] 0 2024-09-21T12:47:09.266 INFO:tasks.workunit.client.0.smithi046.stdout:3/274: getdents d5 0 2024-09-21T12:47:09.267 INFO:tasks.workunit.client.0.smithi046.stdout:3/275: read - d5/dc/d26/f4c zero size 2024-09-21T12:47:09.270 INFO:tasks.workunit.client.0.smithi046.stdout:9/379: dwrite f4 [0,4194304] 0 2024-09-21T12:47:09.272 INFO:tasks.workunit.client.0.smithi046.stdout:7/219: link d2/d4/df/f1d d2/d4/df/d17/d31/d34/f46 0 2024-09-21T12:47:09.273 INFO:tasks.workunit.client.1.smithi176.stdout:5/831: dwrite d0/d13/d5d/d98/d9b/dad/fbc [0,4194304] 0 2024-09-21T12:47:09.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/315: creat de/d2a/d34/d4e/d55/d63/f65 x:0 0 0 2024-09-21T12:47:09.275 INFO:tasks.workunit.client.0.smithi046.stdout:7/220: readlink d2/d4/l27 0 2024-09-21T12:47:09.277 INFO:tasks.workunit.client.0.smithi046.stdout:3/276: dwrite d5/dc/f54 [0,4194304] 0 2024-09-21T12:47:09.278 INFO:tasks.workunit.client.0.smithi046.stdout:7/221: dread d2/dd/f2b [0,4194304] 0 2024-09-21T12:47:09.280 INFO:tasks.workunit.client.1.smithi176.stdout:8/857: creat d6/d16/d79/def/f110 x:0 0 0 2024-09-21T12:47:09.281 INFO:tasks.workunit.client.0.smithi046.stdout:7/222: chown d2 7113 1 2024-09-21T12:47:09.284 INFO:tasks.workunit.client.1.smithi176.stdout:6/866: symlink d2/dd/d26/d110/d103/l115 0 2024-09-21T12:47:09.286 INFO:tasks.workunit.client.1.smithi176.stdout:1/917: getdents d0/db/d1a/d2c/dc5/d41/d59/d9b 0 2024-09-21T12:47:09.287 INFO:tasks.workunit.client.0.smithi046.stdout:9/380: symlink d11/d19/d1b/d31/d53/l72 0 2024-09-21T12:47:09.287 INFO:tasks.workunit.client.1.smithi176.stdout:1/918: chown d0/db/d1a/d2c/l105 863 1 2024-09-21T12:47:09.287 INFO:tasks.workunit.client.0.smithi046.stdout:5/311: getdents d4 0 2024-09-21T12:47:09.289 INFO:tasks.workunit.client.0.smithi046.stdout:3/277: mkdir d5/dc/d28/d63 0 2024-09-21T12:47:09.291 INFO:tasks.workunit.client.1.smithi176.stdout:5/832: dread d0/d13/d63/d2e/d37/db5/db7/f45 [0,4194304] 0 2024-09-21T12:47:09.291 INFO:tasks.workunit.client.0.smithi046.stdout:9/381: dread f2 [0,4194304] 0 2024-09-21T12:47:09.296 INFO:tasks.workunit.client.0.smithi046.stdout:3/278: creat d5/d16/f64 x:0 0 0 2024-09-21T12:47:09.297 INFO:tasks.workunit.client.0.smithi046.stdout:5/312: dwrite d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:09.297 INFO:tasks.workunit.client.0.smithi046.stdout:7/223: fsync d2/d4/df/f1d 0 2024-09-21T12:47:09.301 INFO:tasks.workunit.client.0.smithi046.stdout:5/313: read d4/d16/f46 [7636,129048] 0 2024-09-21T12:47:09.304 INFO:tasks.workunit.client.0.smithi046.stdout:1/280: getdents d4 0 2024-09-21T12:47:09.304 INFO:tasks.workunit.client.0.smithi046.stdout:1/281: dread - d4/d13/d38/f58 zero size 2024-09-21T12:47:09.306 INFO:tasks.workunit.client.0.smithi046.stdout:6/316: link de/d2a/d4c/l5f de/d48/l66 0 2024-09-21T12:47:09.309 INFO:tasks.workunit.client.0.smithi046.stdout:9/382: rename d11/d19/d20/d26/f27 to d11/d19/d20/f73 0 2024-09-21T12:47:09.310 INFO:tasks.workunit.client.1.smithi176.stdout:5/833: fdatasync d0/d13/d63/d2e/d37/db5/db7/f6b 0 2024-09-21T12:47:09.311 INFO:tasks.workunit.client.1.smithi176.stdout:9/916: write d1/df/d48/f117 [284355,77688] 0 2024-09-21T12:47:09.313 INFO:tasks.workunit.client.0.smithi046.stdout:3/279: creat d5/d16/f65 x:0 0 0 2024-09-21T12:47:09.315 INFO:tasks.workunit.client.1.smithi176.stdout:4/886: link d3/d42/d56/l98 d3/d42/d56/d101/l13b 0 2024-09-21T12:47:09.316 INFO:tasks.workunit.client.0.smithi046.stdout:9/383: dread d11/d19/d1b/f25 [0,4194304] 0 2024-09-21T12:47:09.317 INFO:tasks.workunit.client.1.smithi176.stdout:8/858: dwrite d6/db/d37/d7a/f96 [0,4194304] 0 2024-09-21T12:47:09.318 INFO:tasks.workunit.client.1.smithi176.stdout:6/867: mkdir d2/dd/d26/d2b/d10/d116 0 2024-09-21T12:47:09.318 INFO:tasks.workunit.client.0.smithi046.stdout:5/314: stat d4/dc/c58 0 2024-09-21T12:47:09.319 INFO:tasks.workunit.client.0.smithi046.stdout:5/315: dread - d4/d22/d10/f52 zero size 2024-09-21T12:47:09.320 INFO:tasks.workunit.client.0.smithi046.stdout:5/316: chown d4/dc/d13/d15/f57 6690763 1 2024-09-21T12:47:09.320 INFO:tasks.workunit.client.0.smithi046.stdout:5/317: chown d4/d16/l3c 169 1 2024-09-21T12:47:09.320 INFO:tasks.workunit.client.0.smithi046.stdout:1/282: creat d4/d4d/f68 x:0 0 0 2024-09-21T12:47:09.321 INFO:tasks.workunit.client.1.smithi176.stdout:1/919: dwrite d0/fea [0,4194304] 0 2024-09-21T12:47:09.321 INFO:tasks.workunit.client.1.smithi176.stdout:2/911: getdents d4/d63 0 2024-09-21T12:47:09.322 INFO:tasks.workunit.client.0.smithi046.stdout:6/317: rmdir de/d2a/d4c 39 2024-09-21T12:47:09.324 INFO:tasks.workunit.client.1.smithi176.stdout:9/917: creat d1/d61/d73/f137 x:0 0 0 2024-09-21T12:47:09.325 INFO:tasks.workunit.client.1.smithi176.stdout:9/918: read - d1/df/dc3/ff2 zero size 2024-09-21T12:47:09.326 INFO:tasks.workunit.client.1.smithi176.stdout:5/834: rename d0/d13/d5d/d98/d9b to d0/d13/d63/d2e/d37/d55/dfc/d10e 0 2024-09-21T12:47:09.327 INFO:tasks.workunit.client.1.smithi176.stdout:5/835: readlink d0/l58 0 2024-09-21T12:47:09.327 INFO:tasks.workunit.client.1.smithi176.stdout:9/919: readlink d1/d61/d73/db6/lc2 0 2024-09-21T12:47:09.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/280: symlink d5/dc/d26/l66 0 2024-09-21T12:47:09.328 INFO:tasks.workunit.client.1.smithi176.stdout:9/920: readlink d1/df/d48/d69/l8a 0 2024-09-21T12:47:09.329 INFO:tasks.workunit.client.1.smithi176.stdout:5/836: chown d0/d13/d63/d8d/daf/fd8 50670 1 2024-09-21T12:47:09.329 INFO:tasks.workunit.client.1.smithi176.stdout:8/859: mknod d6/db/d32/c111 0 2024-09-21T12:47:09.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/224: link d2/d4/df/d17/d31/d34/f46 d2/d4/f47 0 2024-09-21T12:47:09.330 INFO:tasks.workunit.client.0.smithi046.stdout:9/384: mkdir d11/d19/d1b/d1c/d1f/d74 0 2024-09-21T12:47:09.331 INFO:tasks.workunit.client.1.smithi176.stdout:1/920: rmdir d0/db/d1a/d2c/d66/d6d 39 2024-09-21T12:47:09.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/318: unlink d4/dc/d13/d5b/c31 0 2024-09-21T12:47:09.333 INFO:tasks.workunit.client.0.smithi046.stdout:5/319: fdatasync d4/f4a 0 2024-09-21T12:47:09.334 INFO:tasks.workunit.client.0.smithi046.stdout:1/283: creat d4/d13/d38/d4f/f69 x:0 0 0 2024-09-21T12:47:09.336 INFO:tasks.workunit.client.0.smithi046.stdout:1/284: chown d4/d4d/f57 197 1 2024-09-21T12:47:09.338 INFO:tasks.workunit.client.0.smithi046.stdout:9/385: dwrite d11/d19/d1b/d1c/f2e [4194304,4194304] 0 2024-09-21T12:47:09.340 INFO:tasks.workunit.client.1.smithi176.stdout:4/887: unlink d3/d5/c3f 0 2024-09-21T12:47:09.341 INFO:tasks.workunit.client.0.smithi046.stdout:3/281: fdatasync d5/dc/f1b 0 2024-09-21T12:47:09.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/225: creat d2/d4/df/d17/d31/d34/f48 x:0 0 0 2024-09-21T12:47:09.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/226: readlink d2/dd/l18 0 2024-09-21T12:47:09.349 INFO:tasks.workunit.client.1.smithi176.stdout:5/837: truncate d0/d13/d63/d8d/ddc/d41/f9d 823028 0 2024-09-21T12:47:09.352 INFO:tasks.workunit.client.1.smithi176.stdout:1/921: dread - d0/db/d1a/d2c/dc5/d41/d59/fda zero size 2024-09-21T12:47:09.355 INFO:tasks.workunit.client.1.smithi176.stdout:2/912: getdents d4/df/d2e/d6f/d5d/d118 0 2024-09-21T12:47:09.357 INFO:tasks.workunit.client.1.smithi176.stdout:2/913: write d4/df/d2e/d6f/d5d/f8d [1044163,105566] 0 2024-09-21T12:47:09.357 INFO:tasks.workunit.client.1.smithi176.stdout:4/888: dread d3/d42/d56/d101/d107/d36/f43 [0,4194304] 0 2024-09-21T12:47:09.358 INFO:tasks.workunit.client.1.smithi176.stdout:2/914: chown d4/df/d2e/d6f/d6d/f74 32113 1 2024-09-21T12:47:09.359 INFO:tasks.workunit.client.1.smithi176.stdout:8/860: getdents d6/de7/dfd 0 2024-09-21T12:47:09.359 INFO:tasks.workunit.client.1.smithi176.stdout:2/915: write d4/f37 [2505297,2539] 0 2024-09-21T12:47:09.360 INFO:tasks.workunit.client.1.smithi176.stdout:9/921: dread d1/df/d23/f45 [0,4194304] 0 2024-09-21T12:47:09.362 INFO:tasks.workunit.client.0.smithi046.stdout:3/282: rmdir d5/d16 39 2024-09-21T12:47:09.364 INFO:tasks.workunit.client.1.smithi176.stdout:8/861: dread d6/d8/d24/d35/f94 [0,4194304] 0 2024-09-21T12:47:09.365 INFO:tasks.workunit.client.0.smithi046.stdout:6/318: write de/d2a/f5e [3090038,35540] 0 2024-09-21T12:47:09.366 INFO:tasks.workunit.client.1.smithi176.stdout:6/868: getdents d2/dd/d26/d110 0 2024-09-21T12:47:09.368 INFO:tasks.workunit.client.1.smithi176.stdout:5/838: write d0/d13/f84 [969437,24126] 0 2024-09-21T12:47:09.368 INFO:tasks.workunit.client.1.smithi176.stdout:6/869: chown d2/dd/d26/d2b/d10/d39/f8b 62956 1 2024-09-21T12:47:09.370 INFO:tasks.workunit.client.0.smithi046.stdout:6/319: write de/d2a/d34/f3b [812411,75259] 0 2024-09-21T12:47:09.370 INFO:tasks.workunit.client.0.smithi046.stdout:9/386: symlink d11/d19/d1b/d31/d53/d5e/l75 0 2024-09-21T12:47:09.372 INFO:tasks.workunit.client.0.smithi046.stdout:5/320: dwrite d4/d16/f36 [0,4194304] 0 2024-09-21T12:47:09.375 INFO:tasks.workunit.client.1.smithi176.stdout:5/839: dwrite d0/d13/d63/d2e/d37/d55/dfc/d10e/faa [0,4194304] 0 2024-09-21T12:47:09.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/285: dwrite d4/d13/f2e [0,4194304] 0 2024-09-21T12:47:09.377 INFO:tasks.workunit.client.0.smithi046.stdout:7/227: link d2/d4/df/f10 d2/d4/df/d42/f49 0 2024-09-21T12:47:09.382 INFO:tasks.workunit.client.0.smithi046.stdout:5/321: dwrite d4/d22/d10/d1a/f59 [0,4194304] 0 2024-09-21T12:47:09.385 INFO:tasks.workunit.client.0.smithi046.stdout:1/286: creat d4/f6a x:0 0 0 2024-09-21T12:47:09.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/228: symlink d2/d4/d43/l4a 0 2024-09-21T12:47:09.387 INFO:tasks.workunit.client.0.smithi046.stdout:5/322: dread d4/d22/f32 [0,4194304] 0 2024-09-21T12:47:09.387 INFO:tasks.workunit.client.1.smithi176.stdout:4/889: fsync d3/d42/d56/d101/d107/d96/da3/ff9 0 2024-09-21T12:47:09.388 INFO:tasks.workunit.client.0.smithi046.stdout:7/229: write d2/dd/f29 [973196,92125] 0 2024-09-21T12:47:09.389 INFO:tasks.workunit.client.0.smithi046.stdout:9/387: creat d11/d19/d36/d45/d6e/f76 x:0 0 0 2024-09-21T12:47:09.394 INFO:tasks.workunit.client.1.smithi176.stdout:5/840: dread d0/d13/d63/d2e/d37/d55/f83 [0,4194304] 0 2024-09-21T12:47:09.394 INFO:tasks.workunit.client.1.smithi176.stdout:1/922: truncate d0/db/d1a/d2c/d66/d6d/dd8/ff2 2753629 0 2024-09-21T12:47:09.395 INFO:tasks.workunit.client.1.smithi176.stdout:8/862: dwrite d6/db/d13/f31 [4194304,4194304] 0 2024-09-21T12:47:09.395 INFO:tasks.workunit.client.1.smithi176.stdout:6/870: dread d2/d6f/d7f/dbf/fdf [0,4194304] 0 2024-09-21T12:47:09.397 INFO:tasks.workunit.client.1.smithi176.stdout:9/922: write d1/df/d23/dcf/fd2 [209063,78275] 0 2024-09-21T12:47:09.398 INFO:tasks.workunit.client.1.smithi176.stdout:4/890: creat d3/d42/d56/d101/d107/d96/db2/f13c x:0 0 0 2024-09-21T12:47:09.398 INFO:tasks.workunit.client.1.smithi176.stdout:2/916: link d4/df/d83/l91 d4/df/d2e/d6f/d5d/d81/dd9/l11a 0 2024-09-21T12:47:09.399 INFO:tasks.workunit.client.1.smithi176.stdout:9/923: stat d1/df/d9a/f106 0 2024-09-21T12:47:09.401 INFO:tasks.workunit.client.1.smithi176.stdout:8/863: unlink d6/d16/d79/fe3 0 2024-09-21T12:47:09.401 INFO:tasks.workunit.client.1.smithi176.stdout:1/923: rmdir d0/db/d6f/de1 39 2024-09-21T12:47:09.403 INFO:tasks.workunit.client.1.smithi176.stdout:9/924: symlink d1/d63/l138 0 2024-09-21T12:47:09.404 INFO:tasks.workunit.client.1.smithi176.stdout:4/891: symlink d3/d42/d56/d101/l13d 0 2024-09-21T12:47:09.406 INFO:tasks.workunit.client.1.smithi176.stdout:4/892: symlink d3/d42/d47/l13e 0 2024-09-21T12:47:09.411 INFO:tasks.workunit.client.1.smithi176.stdout:9/925: dwrite d1/df/d23/dcf/fd2 [0,4194304] 0 2024-09-21T12:47:09.411 INFO:tasks.workunit.client.1.smithi176.stdout:5/841: read d0/d13/f3c [842035,38412] 0 2024-09-21T12:47:09.411 INFO:tasks.workunit.client.0.smithi046.stdout:7/230: dread d2/d4/f1c [0,4194304] 0 2024-09-21T12:47:09.411 INFO:tasks.workunit.client.0.smithi046.stdout:3/283: mknod d5/c67 0 2024-09-21T12:47:09.411 INFO:tasks.workunit.client.0.smithi046.stdout:5/323: rmdir d4/dc/d13/d15 39 2024-09-21T12:47:09.412 INFO:tasks.workunit.client.1.smithi176.stdout:9/926: dread - d1/d8b/f110 zero size 2024-09-21T12:47:09.412 INFO:tasks.workunit.client.1.smithi176.stdout:6/871: link d2/dd/d26/d2b/d10/l33 d2/dd/d26/d2b/d10/dfe/l117 0 2024-09-21T12:47:09.412 INFO:tasks.workunit.client.0.smithi046.stdout:7/231: fdatasync d2/d4/df/d17/d31/d34/f38 0 2024-09-21T12:47:09.414 INFO:tasks.workunit.client.1.smithi176.stdout:9/927: chown d1/df/d48/d69/dc8/f10c 940333531 1 2024-09-21T12:47:09.417 INFO:tasks.workunit.client.1.smithi176.stdout:4/893: getdents d3/d21/d10b 0 2024-09-21T12:47:09.422 INFO:tasks.workunit.client.0.smithi046.stdout:9/388: rename d11/f18 to d11/d19/d36/f77 0 2024-09-21T12:47:09.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/324: dread d4/d22/d10/d1a/f59 [0,4194304] 0 2024-09-21T12:47:09.427 INFO:tasks.workunit.client.1.smithi176.stdout:4/894: creat d3/d5/dc5/dd6/f13f x:0 0 0 2024-09-21T12:47:09.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/232: dwrite d2/d4/f1c [0,4194304] 0 2024-09-21T12:47:09.429 INFO:tasks.workunit.client.1.smithi176.stdout:4/895: chown d3/d42/dae/ce4 0 1 2024-09-21T12:47:09.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/320: dwrite f9 [0,4194304] 0 2024-09-21T12:47:09.431 INFO:tasks.workunit.client.0.smithi046.stdout:9/389: fsync d11/f12 0 2024-09-21T12:47:09.431 INFO:tasks.workunit.client.0.smithi046.stdout:7/233: truncate d2/d4/df/d42/f49 1958628 0 2024-09-21T12:47:09.434 INFO:tasks.workunit.client.0.smithi046.stdout:7/234: write d2/d4/df/d17/d31/d34/f38 [407437,69150] 0 2024-09-21T12:47:09.435 INFO:tasks.workunit.client.1.smithi176.stdout:5/842: getdents d0/d13/d5d/d98/da5/de1 0 2024-09-21T12:47:09.437 INFO:tasks.workunit.client.1.smithi176.stdout:2/917: dread d4/d3d/d65/d9b/fa8 [0,4194304] 0 2024-09-21T12:47:09.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/235: dwrite d2/f32 [0,4194304] 0 2024-09-21T12:47:09.445 INFO:tasks.workunit.client.0.smithi046.stdout:1/287: mkdir d4/d13/d6b 0 2024-09-21T12:47:09.447 INFO:tasks.workunit.client.1.smithi176.stdout:4/896: write d3/f3c [1054556,107286] 0 2024-09-21T12:47:09.448 INFO:tasks.workunit.client.1.smithi176.stdout:2/918: write d4/df/d2e/d39/fe4 [1496410,110423] 0 2024-09-21T12:47:09.449 INFO:tasks.workunit.client.0.smithi046.stdout:1/288: write d4/d13/d38/d53/d5a/d5d/f60 [952420,116033] 0 2024-09-21T12:47:09.453 INFO:tasks.workunit.client.0.smithi046.stdout:9/390: symlink d11/d19/d36/l78 0 2024-09-21T12:47:09.453 INFO:tasks.workunit.client.1.smithi176.stdout:8/864: write d6/db/d13/d98/fb2 [264788,127880] 0 2024-09-21T12:47:09.455 INFO:tasks.workunit.client.1.smithi176.stdout:6/872: dread d2/dd/d26/d2b/d10/d39/f10c [0,4194304] 0 2024-09-21T12:47:09.457 INFO:tasks.workunit.client.1.smithi176.stdout:8/865: chown d6/d16/d36/d67/cb8 460186 1 2024-09-21T12:47:09.457 INFO:tasks.workunit.client.0.smithi046.stdout:7/236: rename d2/dd/f1b to d2/d4/df/d17/d31/d34/f4b 0 2024-09-21T12:47:09.458 INFO:tasks.workunit.client.1.smithi176.stdout:8/866: chown l2 7828 1 2024-09-21T12:47:09.458 INFO:tasks.workunit.client.0.smithi046.stdout:7/237: chown d2/d4/f47 388 1 2024-09-21T12:47:09.459 INFO:tasks.workunit.client.1.smithi176.stdout:1/924: dwrite d0/fc1 [0,4194304] 0 2024-09-21T12:47:09.459 INFO:tasks.workunit.client.1.smithi176.stdout:6/873: read d2/dd/d26/d2b/d68/dfa/fb4 [5012169,17633] 0 2024-09-21T12:47:09.459 INFO:tasks.workunit.client.1.smithi176.stdout:6/874: stat d2/dd/c62 0 2024-09-21T12:47:09.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/325: mkdir d4/dc/d13/d15/d54/d5d 0 2024-09-21T12:47:09.463 INFO:tasks.workunit.client.1.smithi176.stdout:9/928: truncate d1/df/d48/ff7 161827 0 2024-09-21T12:47:09.465 INFO:tasks.workunit.client.0.smithi046.stdout:9/391: dread d11/f54 [0,4194304] 0 2024-09-21T12:47:09.466 INFO:tasks.workunit.client.0.smithi046.stdout:9/392: chown d11 3768119 1 2024-09-21T12:47:09.471 INFO:tasks.workunit.client.0.smithi046.stdout:5/326: unlink d4/dc/d13/d5b/f5a 0 2024-09-21T12:47:09.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/393: mkdir d11/d19/d1b/d1c/d1f/d30/d79 0 2024-09-21T12:47:09.481 INFO:tasks.workunit.client.0.smithi046.stdout:3/284: truncate d5/f24 445307 0 2024-09-21T12:47:09.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/238: creat d2/d4/df/f4c x:0 0 0 2024-09-21T12:47:09.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/239: read d2/f3 [2290187,90781] 0 2024-09-21T12:47:09.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/240: chown d2/f32 170012986 1 2024-09-21T12:47:09.485 INFO:tasks.workunit.client.0.smithi046.stdout:1/289: creat d4/d29/f6c x:0 0 0 2024-09-21T12:47:09.490 INFO:tasks.workunit.client.0.smithi046.stdout:5/327: rename d4/d22/d10/d34 to d4/dc/d13/d5e 0 2024-09-21T12:47:09.492 INFO:tasks.workunit.client.0.smithi046.stdout:7/241: creat d2/d37/f4d x:0 0 0 2024-09-21T12:47:09.494 INFO:tasks.workunit.client.0.smithi046.stdout:1/290: unlink d4/d13/d38/f3b 0 2024-09-21T12:47:09.495 INFO:tasks.workunit.client.0.smithi046.stdout:3/285: creat d5/dc/f68 x:0 0 0 2024-09-21T12:47:09.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/286: chown d5/dc/d30 8 1 2024-09-21T12:47:09.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/394: getdents d11/d19/d1b 0 2024-09-21T12:47:09.499 INFO:tasks.workunit.client.0.smithi046.stdout:9/395: fdatasync fb 0 2024-09-21T12:47:09.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/242: truncate d2/d4/df/d17/d31/d34/f46 1243655 0 2024-09-21T12:47:09.503 INFO:tasks.workunit.client.0.smithi046.stdout:1/291: rename d4/c12 to d4/d13/d38/d4f/c6d 0 2024-09-21T12:47:09.511 INFO:tasks.workunit.client.0.smithi046.stdout:3/287: symlink d5/d16/d5f/l69 0 2024-09-21T12:47:09.511 INFO:tasks.workunit.client.0.smithi046.stdout:3/288: stat d5/d16/l29 0 2024-09-21T12:47:09.512 INFO:tasks.workunit.client.0.smithi046.stdout:7/243: mkdir d2/d4e 0 2024-09-21T12:47:09.516 INFO:tasks.workunit.client.0.smithi046.stdout:7/244: mkdir d2/d4/d43/d4f 0 2024-09-21T12:47:09.516 INFO:tasks.workunit.client.0.smithi046.stdout:7/245: stat d2/d4/df/d17/d31/d34 0 2024-09-21T12:47:09.520 INFO:tasks.workunit.client.0.smithi046.stdout:3/289: mknod d5/d5e/c6a 0 2024-09-21T12:47:09.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/246: symlink d2/l50 0 2024-09-21T12:47:09.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/247: chown d2 0 1 2024-09-21T12:47:09.523 INFO:tasks.workunit.client.0.smithi046.stdout:3/290: truncate d5/f62 97030 0 2024-09-21T12:47:09.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/248: creat d2/d4/df/d17/f51 x:0 0 0 2024-09-21T12:47:09.526 INFO:tasks.workunit.client.0.smithi046.stdout:7/249: truncate d2/d4/df/d17/d31/d34/f48 248832 0 2024-09-21T12:47:09.527 INFO:tasks.workunit.client.0.smithi046.stdout:7/250: chown d2/d4/df/d17/f35 170836 1 2024-09-21T12:47:09.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/251: dread d2/d4/df/d17/d31/d34/f38 [0,4194304] 0 2024-09-21T12:47:09.533 INFO:tasks.workunit.client.1.smithi176.stdout:5/843: rename d0/d13/d63/d8d/daf to d0/d13/d5d/d98/da5/de1/d10f 0 2024-09-21T12:47:09.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/291: link d5/dc/d30/f39 d5/f6b 0 2024-09-21T12:47:09.534 INFO:tasks.workunit.client.1.smithi176.stdout:5/844: truncate d0/d13/d63/d2e/d37/d55/dfc/d10e/ffb 198267 0 2024-09-21T12:47:09.535 INFO:tasks.workunit.client.0.smithi046.stdout:9/396: write f10 [2663652,33958] 0 2024-09-21T12:47:09.535 INFO:tasks.workunit.client.0.smithi046.stdout:9/397: stat d11/d19/d36/f77 0 2024-09-21T12:47:09.536 INFO:tasks.workunit.client.1.smithi176.stdout:4/897: rmdir d3 39 2024-09-21T12:47:09.538 INFO:tasks.workunit.client.1.smithi176.stdout:2/919: mkdir d4/d3d/d76/d11b 0 2024-09-21T12:47:09.539 INFO:tasks.workunit.client.0.smithi046.stdout:7/252: mknod d2/d4/df/d17/c52 0 2024-09-21T12:47:09.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/398: dread d11/d19/d1b/d1c/d1f/d30/d3e/f49 [0,4194304] 0 2024-09-21T12:47:09.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/253: readlink d2/d4/l20 0 2024-09-21T12:47:09.542 INFO:tasks.workunit.client.0.smithi046.stdout:3/292: stat d5/dc/d26 0 2024-09-21T12:47:09.542 INFO:tasks.workunit.client.0.smithi046.stdout:9/399: write d11/d19/d1b/d1c/f47 [1739348,71415] 0 2024-09-21T12:47:09.545 INFO:tasks.workunit.client.1.smithi176.stdout:8/867: mknod d6/db/d37/c112 0 2024-09-21T12:47:09.546 INFO:tasks.workunit.client.1.smithi176.stdout:8/868: write d6/d16/d36/d67/f8e [4775821,72182] 0 2024-09-21T12:47:09.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/292: unlink d4/d13/f28 0 2024-09-21T12:47:09.549 INFO:tasks.workunit.client.1.smithi176.stdout:1/925: creat d0/d13f/d92/f150 x:0 0 0 2024-09-21T12:47:09.550 INFO:tasks.workunit.client.0.smithi046.stdout:9/400: dwrite d11/d19/d1b/d1c/d1f/d30/d3e/f49 [4194304,4194304] 0 2024-09-21T12:47:09.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/254: unlink d2/d4/df/d17/f51 0 2024-09-21T12:47:09.555 INFO:tasks.workunit.client.0.smithi046.stdout:1/293: dwrite d4/d13/d38/f42 [0,4194304] 0 2024-09-21T12:47:09.557 INFO:tasks.workunit.client.1.smithi176.stdout:6/875: rename d2/d63/fd2 to d2/dd/d26/d2b/d10/d39/f118 0 2024-09-21T12:47:09.560 INFO:tasks.workunit.client.1.smithi176.stdout:5/845: mkdir d0/d13/d63/d72/d87/dcf/d110 0 2024-09-21T12:47:09.561 INFO:tasks.workunit.client.1.smithi176.stdout:5/846: chown d0/d13/d63/d8d/ddc/fb3 107 1 2024-09-21T12:47:09.564 INFO:tasks.workunit.client.1.smithi176.stdout:2/920: creat d4/df/d2e/d39/db7/d80/f11c x:0 0 0 2024-09-21T12:47:09.565 INFO:tasks.workunit.client.1.smithi176.stdout:2/921: write d4/df/d4b/fc7 [225973,28141] 0 2024-09-21T12:47:09.565 INFO:tasks.workunit.client.1.smithi176.stdout:4/898: dread d3/d21/d88/da7/fff [0,4194304] 0 2024-09-21T12:47:09.566 INFO:tasks.workunit.client.0.smithi046.stdout:1/294: dwrite d4/d13/d38/f58 [0,4194304] 0 2024-09-21T12:47:09.568 INFO:tasks.workunit.client.0.smithi046.stdout:9/401: unlink d11/d19/d20/l50 0 2024-09-21T12:47:09.571 INFO:tasks.workunit.client.0.smithi046.stdout:7/255: truncate d2/dd/f2b 1312443 0 2024-09-21T12:47:09.574 INFO:tasks.workunit.client.1.smithi176.stdout:6/876: creat d2/d6f/d7f/dbf/f119 x:0 0 0 2024-09-21T12:47:09.578 INFO:tasks.workunit.client.1.smithi176.stdout:5/847: rename d0/d10/f2b to d0/f111 0 2024-09-21T12:47:09.580 INFO:tasks.workunit.client.1.smithi176.stdout:6/877: dwrite d2/d63/f51 [0,4194304] 0 2024-09-21T12:47:09.581 INFO:tasks.workunit.client.1.smithi176.stdout:4/899: mkdir d3/d42/d47/d5c/dec/d140 0 2024-09-21T12:47:09.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/402: mknod d11/d19/d1b/d31/c7a 0 2024-09-21T12:47:09.583 INFO:tasks.workunit.client.1.smithi176.stdout:2/922: mkdir d4/df/d2e/d39/db7/d80/d9e/d11d 0 2024-09-21T12:47:09.586 INFO:tasks.workunit.client.0.smithi046.stdout:1/295: link d4/d13/d38/d48/f5c d4/d13/f6e 0 2024-09-21T12:47:09.590 INFO:tasks.workunit.client.0.smithi046.stdout:9/403: mknod d11/d19/d20/c7b 0 2024-09-21T12:47:09.590 INFO:tasks.workunit.client.1.smithi176.stdout:2/923: dwrite d4/df/d2e/f7a [0,4194304] 0 2024-09-21T12:47:09.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/256: rename d2/d4/d43/c44 to d2/dd/c53 0 2024-09-21T12:47:09.594 INFO:tasks.workunit.client.0.smithi046.stdout:1/296: dwrite d4/d13/d38/d4f/f69 [0,4194304] 0 2024-09-21T12:47:09.595 INFO:tasks.workunit.client.1.smithi176.stdout:5/848: chown d0/d13/d63/d8d/ddc/c9e 710 1 2024-09-21T12:47:09.596 INFO:tasks.workunit.client.0.smithi046.stdout:7/257: dread - d2/d4/df/d17/f30 zero size 2024-09-21T12:47:09.596 INFO:tasks.workunit.client.1.smithi176.stdout:5/849: stat d0/f8 0 2024-09-21T12:47:09.600 INFO:tasks.workunit.client.1.smithi176.stdout:6/878: dread d2/f20 [0,4194304] 0 2024-09-21T12:47:09.601 INFO:tasks.workunit.client.0.smithi046.stdout:1/297: rmdir d4/d13 39 2024-09-21T12:47:09.602 INFO:tasks.workunit.client.1.smithi176.stdout:4/900: read d3/d21/d27/d2c/f35 [2903609,26714] 0 2024-09-21T12:47:09.603 INFO:tasks.workunit.client.1.smithi176.stdout:5/850: dread d0/d13/d63/d2e/d37/d55/dfc/d10e/dad/fbc [0,4194304] 0 2024-09-21T12:47:09.603 INFO:tasks.workunit.client.1.smithi176.stdout:4/901: readlink d3/d42/dfe/l116 0 2024-09-21T12:47:09.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/258: unlink d2/d4/l25 0 2024-09-21T12:47:09.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/259: stat d2/d37/l3e 0 2024-09-21T12:47:09.606 INFO:tasks.workunit.client.0.smithi046.stdout:9/404: creat d11/d69/f7c x:0 0 0 2024-09-21T12:47:09.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/405: read d11/d19/d1b/d1c/f47 [734264,13058] 0 2024-09-21T12:47:09.610 INFO:tasks.workunit.client.1.smithi176.stdout:5/851: dwrite d0/f27 [4194304,4194304] 0 2024-09-21T12:47:09.611 INFO:tasks.workunit.client.0.smithi046.stdout:7/260: unlink d2/d4/l2d 0 2024-09-21T12:47:09.612 INFO:tasks.workunit.client.1.smithi176.stdout:4/902: dwrite d3/d42/d56/d101/d107/d96/f123 [0,4194304] 0 2024-09-21T12:47:09.612 INFO:tasks.workunit.client.0.smithi046.stdout:3/293: write d5/f10 [700098,113714] 0 2024-09-21T12:47:09.614 INFO:tasks.workunit.client.1.smithi176.stdout:4/903: fsync d3/d42/d56/f90 0 2024-09-21T12:47:09.615 INFO:tasks.workunit.client.0.smithi046.stdout:7/261: write d2/d4/df/d17/d31/f45 [757372,126761] 0 2024-09-21T12:47:09.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/406: dwrite d11/d19/f24 [0,4194304] 0 2024-09-21T12:47:09.617 INFO:tasks.workunit.client.1.smithi176.stdout:2/924: dread d4/f37 [0,4194304] 0 2024-09-21T12:47:09.620 INFO:tasks.workunit.client.1.smithi176.stdout:8/869: getdents d6/db/d37 0 2024-09-21T12:47:09.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/298: read d4/d13/f1a [85285,95323] 0 2024-09-21T12:47:09.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/262: dwrite d2/d4/df/d17/d31/d34/f3a [0,4194304] 0 2024-09-21T12:47:09.626 INFO:tasks.workunit.client.1.smithi176.stdout:5/852: rename d0/d13/d5d/feb to d0/d13/d63/d8d/ddc/d109/f112 0 2024-09-21T12:47:09.630 INFO:tasks.workunit.client.1.smithi176.stdout:9/929: sync 2024-09-21T12:47:09.630 INFO:tasks.workunit.client.1.smithi176.stdout:5/853: truncate d0/d13/d5d/d98/da5/de1/d10f/fd8 520588 0 2024-09-21T12:47:09.638 INFO:tasks.workunit.client.1.smithi176.stdout:8/870: fdatasync d6/db/d37/f3a 0 2024-09-21T12:47:09.639 INFO:tasks.workunit.client.1.smithi176.stdout:8/871: readlink d6/d8/d24/d5e/ld0 0 2024-09-21T12:47:09.639 INFO:tasks.workunit.client.0.smithi046.stdout:3/294: mkdir d5/d16/d5f/d6c 0 2024-09-21T12:47:09.640 INFO:tasks.workunit.client.0.smithi046.stdout:3/295: fdatasync d5/dc/d26/f4f 0 2024-09-21T12:47:09.641 INFO:tasks.workunit.client.0.smithi046.stdout:1/299: chown d4/d13/d38/d4f/c6d 722 1 2024-09-21T12:47:09.641 INFO:tasks.workunit.client.0.smithi046.stdout:3/296: stat d5/dc/d26/l2e 0 2024-09-21T12:47:09.642 INFO:tasks.workunit.client.0.smithi046.stdout:3/297: dread - d5/dc/d30/d34/f61 zero size 2024-09-21T12:47:09.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/263: creat d2/d4/f54 x:0 0 0 2024-09-21T12:47:09.646 INFO:tasks.workunit.client.1.smithi176.stdout:8/872: creat d6/db/da3/f113 x:0 0 0 2024-09-21T12:47:09.648 INFO:tasks.workunit.client.1.smithi176.stdout:8/873: chown d6/d8/d24/d5e/ld0 8358 1 2024-09-21T12:47:09.648 INFO:tasks.workunit.client.0.smithi046.stdout:1/300: creat d4/d13/d38/f6f x:0 0 0 2024-09-21T12:47:09.648 INFO:tasks.workunit.client.0.smithi046.stdout:1/301: dread - d4/f6a zero size 2024-09-21T12:47:09.651 INFO:tasks.workunit.client.1.smithi176.stdout:2/925: creat d4/d3d/f11e x:0 0 0 2024-09-21T12:47:09.652 INFO:tasks.workunit.client.0.smithi046.stdout:3/298: creat d5/d16/d5f/d6c/f6d x:0 0 0 2024-09-21T12:47:09.653 INFO:tasks.workunit.client.1.smithi176.stdout:4/904: rename d3/d21/d97/f9a to d3/d21/d27/f141 0 2024-09-21T12:47:09.655 INFO:tasks.workunit.client.1.smithi176.stdout:4/905: readlink d3/d42/d56/d101/d107/d96/da3/l126 0 2024-09-21T12:47:09.655 INFO:tasks.workunit.client.0.smithi046.stdout:1/302: dwrite d4/d13/f1c [4194304,4194304] 0 2024-09-21T12:47:09.656 INFO:tasks.workunit.client.1.smithi176.stdout:8/874: creat d6/db/d13/d98/da1/f114 x:0 0 0 2024-09-21T12:47:09.658 INFO:tasks.workunit.client.0.smithi046.stdout:7/264: truncate d2/d4/f47 1839125 0 2024-09-21T12:47:09.659 INFO:tasks.workunit.client.0.smithi046.stdout:7/265: fsync d2/dd/f3f 0 2024-09-21T12:47:09.662 INFO:tasks.workunit.client.1.smithi176.stdout:2/926: rmdir d4/d3d 39 2024-09-21T12:47:09.665 INFO:tasks.workunit.client.1.smithi176.stdout:5/854: rename d0/d13/d63/d2e/d37/d55/l7c to d0/d13/d63/d72/l113 0 2024-09-21T12:47:09.666 INFO:tasks.workunit.client.1.smithi176.stdout:4/906: dread - d3/d5/ff1 zero size 2024-09-21T12:47:09.667 INFO:tasks.workunit.client.0.smithi046.stdout:3/299: mkdir d5/dc/d28/d60/d6e 0 2024-09-21T12:47:09.669 INFO:tasks.workunit.client.1.smithi176.stdout:8/875: rename d6/d16/d36/d7d/d81 to d6/d16/d36/d67/dd1/d115 0 2024-09-21T12:47:09.670 INFO:tasks.workunit.client.1.smithi176.stdout:5/855: creat d0/d13/d63/d8d/f114 x:0 0 0 2024-09-21T12:47:09.672 INFO:tasks.workunit.client.1.smithi176.stdout:4/907: truncate d3/d21/d97/fa4 287558 0 2024-09-21T12:47:09.673 INFO:tasks.workunit.client.1.smithi176.stdout:8/876: creat d6/db/d13/f116 x:0 0 0 2024-09-21T12:47:09.673 INFO:tasks.workunit.client.1.smithi176.stdout:2/927: dwrite d4/d3d/d76/fc9 [0,4194304] 0 2024-09-21T12:47:09.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/266: rmdir d2/d4/d43/d4f 0 2024-09-21T12:47:09.675 INFO:tasks.workunit.client.1.smithi176.stdout:8/877: truncate d6/d16/d36/fe0 791588 0 2024-09-21T12:47:09.675 INFO:tasks.workunit.client.0.smithi046.stdout:9/407: write d11/d19/d1b/d31/f43 [1254804,111856] 0 2024-09-21T12:47:09.676 INFO:tasks.workunit.client.1.smithi176.stdout:5/856: unlink d0/d13/d63/d72/d87/d92/lff 0 2024-09-21T12:47:09.679 INFO:tasks.workunit.client.0.smithi046.stdout:3/300: creat d5/f6f x:0 0 0 2024-09-21T12:47:09.679 INFO:tasks.workunit.client.1.smithi176.stdout:5/857: read d0/d13/d63/d8d/ddc/d41/f77 [387599,104141] 0 2024-09-21T12:47:09.681 INFO:tasks.workunit.client.0.smithi046.stdout:9/408: chown d11/l15 79088613 1 2024-09-21T12:47:09.682 INFO:tasks.workunit.client.1.smithi176.stdout:8/878: read - d6/d8/d24/d35/d51/fc9 zero size 2024-09-21T12:47:09.690 INFO:tasks.workunit.client.1.smithi176.stdout:8/879: mknod d6/d8/d24/d5e/c117 0 2024-09-21T12:47:09.690 INFO:tasks.workunit.client.1.smithi176.stdout:9/930: dwrite d1/df/d9a/d121/f3a [0,4194304] 0 2024-09-21T12:47:09.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/303: write d4/d13/d38/d48/f5c [4975212,61463] 0 2024-09-21T12:47:09.691 INFO:tasks.workunit.client.0.smithi046.stdout:9/409: getdents d11/d19/d36/d45/d6e 0 2024-09-21T12:47:09.691 INFO:tasks.workunit.client.1.smithi176.stdout:8/880: write d6/d16/d36/fe0 [1120634,46319] 0 2024-09-21T12:47:09.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/410: write d11/d19/d1b/d1c/f2f [56622,71788] 0 2024-09-21T12:47:09.693 INFO:tasks.workunit.client.1.smithi176.stdout:8/881: dread - d6/db/d13/d98/da1/f114 zero size 2024-09-21T12:47:09.693 INFO:tasks.workunit.client.1.smithi176.stdout:2/928: rmdir d4/df/d2e/d39/db7/d80/d9e/d11d 0 2024-09-21T12:47:09.697 INFO:tasks.workunit.client.1.smithi176.stdout:1/926: sync 2024-09-21T12:47:09.698 INFO:tasks.workunit.client.1.smithi176.stdout:1/927: fdatasync d0/db/d6a/d89/f12b 0 2024-09-21T12:47:09.699 INFO:tasks.workunit.client.0.smithi046.stdout:1/304: dwrite d4/f6a [0,4194304] 0 2024-09-21T12:47:09.699 INFO:tasks.workunit.client.0.smithi046.stdout:9/411: rmdir d11/d19/d1b/d31/d44 39 2024-09-21T12:47:09.700 INFO:tasks.workunit.client.0.smithi046.stdout:9/412: chown fb 6 1 2024-09-21T12:47:09.701 INFO:tasks.workunit.client.1.smithi176.stdout:9/931: rmdir d1/df/d48/d69/dc8 39 2024-09-21T12:47:09.703 INFO:tasks.workunit.client.1.smithi176.stdout:8/882: fsync d6/d16/d9c/fbd 0 2024-09-21T12:47:09.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/413: fsync f2 0 2024-09-21T12:47:09.710 INFO:tasks.workunit.client.1.smithi176.stdout:4/908: dwrite d3/d5/ff1 [0,4194304] 0 2024-09-21T12:47:09.711 INFO:tasks.workunit.client.0.smithi046.stdout:9/414: chown d11/d19/d1b/d31/d53/l72 5441 1 2024-09-21T12:47:09.712 INFO:tasks.workunit.client.1.smithi176.stdout:4/909: fdatasync d3/d21/d88/da7/f109 0 2024-09-21T12:47:09.713 INFO:tasks.workunit.client.0.smithi046.stdout:7/267: dwrite d2/dd/f2b [0,4194304] 0 2024-09-21T12:47:09.715 INFO:tasks.workunit.client.0.smithi046.stdout:7/268: chown d2/d4/f8 814773059 1 2024-09-21T12:47:09.716 INFO:tasks.workunit.client.1.smithi176.stdout:5/858: getdents d0/d13/d5d/d98 0 2024-09-21T12:47:09.716 INFO:tasks.workunit.client.1.smithi176.stdout:6/879: sync 2024-09-21T12:47:09.717 INFO:tasks.workunit.client.0.smithi046.stdout:7/269: dread - d2/d4/df/f4c zero size 2024-09-21T12:47:09.717 INFO:tasks.workunit.client.0.smithi046.stdout:9/415: rmdir d11/d19/d20 39 2024-09-21T12:47:09.718 INFO:tasks.workunit.client.0.smithi046.stdout:1/305: write d4/d13/f19 [349627,76525] 0 2024-09-21T12:47:09.718 INFO:tasks.workunit.client.1.smithi176.stdout:5/859: chown d0/d13/d63/d2e/d37/d55/dfc 12858740 1 2024-09-21T12:47:09.718 INFO:tasks.workunit.client.1.smithi176.stdout:6/880: stat d2/dd/d26/d2b/d10/d1b 0 2024-09-21T12:47:09.720 INFO:tasks.workunit.client.1.smithi176.stdout:1/928: write d0/db/d1a/d2c/dc5/d2b/f35 [2479210,21279] 0 2024-09-21T12:47:09.721 INFO:tasks.workunit.client.0.smithi046.stdout:9/416: write d11/d19/d1b/d1c/d1f/d30/f5d [1056494,95889] 0 2024-09-21T12:47:09.721 INFO:tasks.workunit.client.1.smithi176.stdout:5/860: write d0/d13/d63/d8d/ddc/d41/f4f [1173629,64474] 0 2024-09-21T12:47:09.722 INFO:tasks.workunit.client.0.smithi046.stdout:1/306: write d4/d4d/f68 [544044,16564] 0 2024-09-21T12:47:09.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/270: dwrite d2/d4/df/d17/f30 [0,4194304] 0 2024-09-21T12:47:09.729 INFO:tasks.workunit.client.1.smithi176.stdout:8/883: dread d6/d8/d24/d5e/de8/f106 [0,4194304] 0 2024-09-21T12:47:09.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/312: sync 2024-09-21T12:47:09.729 INFO:tasks.workunit.client.0.smithi046.stdout:0/373: sync 2024-09-21T12:47:09.730 INFO:tasks.workunit.client.1.smithi176.stdout:1/929: rename d0/d63/f6c to d0/db/d1a/d2c/d48/d108/f151 0 2024-09-21T12:47:09.730 INFO:tasks.workunit.client.1.smithi176.stdout:2/929: dwrite d4/d63/f94 [0,4194304] 0 2024-09-21T12:47:09.732 INFO:tasks.workunit.client.0.smithi046.stdout:9/417: dread d11/f61 [0,4194304] 0 2024-09-21T12:47:09.732 INFO:tasks.workunit.client.1.smithi176.stdout:5/861: mkdir d0/d13/d63/d2e/d37/d55/dfc/d10e/dad/d115 0 2024-09-21T12:47:09.732 INFO:tasks.workunit.client.1.smithi176.stdout:8/884: chown d6/db/d37/d7a/f7e 0 1 2024-09-21T12:47:09.733 INFO:tasks.workunit.client.1.smithi176.stdout:9/932: dwrite d1/df/f12 [0,4194304] 0 2024-09-21T12:47:09.736 INFO:tasks.workunit.client.1.smithi176.stdout:1/930: dread d0/d13f/fe3 [0,4194304] 0 2024-09-21T12:47:09.739 INFO:tasks.workunit.client.1.smithi176.stdout:1/931: write d0/db/d1a/d2c/d6b/dd7/dfd/f145 [632268,100687] 0 2024-09-21T12:47:09.740 INFO:tasks.workunit.client.0.smithi046.stdout:2/313: creat d16/d5c/f5d x:0 0 0 2024-09-21T12:47:09.740 INFO:tasks.workunit.client.1.smithi176.stdout:2/930: symlink d4/df/d2e/d6f/d5d/d81/db2/l11f 0 2024-09-21T12:47:09.741 INFO:tasks.workunit.client.1.smithi176.stdout:5/862: symlink d0/d13/d63/d72/d87/d92/l116 0 2024-09-21T12:47:09.743 INFO:tasks.workunit.client.1.smithi176.stdout:9/933: mknod d1/df/d48/d69/d40/d84/dfd/c139 0 2024-09-21T12:47:09.744 INFO:tasks.workunit.client.1.smithi176.stdout:1/932: stat d0/db/d1a/d2c/dc5/d41/l144 0 2024-09-21T12:47:09.747 INFO:tasks.workunit.client.0.smithi046.stdout:2/314: mknod d16/c5e 0 2024-09-21T12:47:09.748 INFO:tasks.workunit.client.1.smithi176.stdout:2/931: dread - d4/df/d2e/d6f/d5d/d81/db2/fd2 zero size 2024-09-21T12:47:09.749 INFO:tasks.workunit.client.1.smithi176.stdout:1/933: creat d0/d5b/f152 x:0 0 0 2024-09-21T12:47:09.750 INFO:tasks.workunit.client.0.smithi046.stdout:2/315: creat d16/d22/d2b/d30/f5f x:0 0 0 2024-09-21T12:47:09.751 INFO:tasks.workunit.client.1.smithi176.stdout:2/932: write d4/df/d2e/d4d/d70/fb3 [3575308,42858] 0 2024-09-21T12:47:09.753 INFO:tasks.workunit.client.1.smithi176.stdout:6/881: dread d2/dd/f11 [0,4194304] 0 2024-09-21T12:47:09.754 INFO:tasks.workunit.client.1.smithi176.stdout:9/934: dwrite d1/df/d23/dcf/f12b [0,4194304] 0 2024-09-21T12:47:09.755 INFO:tasks.workunit.client.0.smithi046.stdout:2/316: dread d16/d22/f2e [0,4194304] 0 2024-09-21T12:47:09.756 INFO:tasks.workunit.client.1.smithi176.stdout:9/935: truncate d1/df/d48/f4a 5168150 0 2024-09-21T12:47:09.769 INFO:tasks.workunit.client.1.smithi176.stdout:4/910: sync 2024-09-21T12:47:09.861 INFO:tasks.workunit.client.1.smithi176.stdout:1/934: mkdir d0/d91/dd3/df5/d153 0 2024-09-21T12:47:09.861 INFO:tasks.workunit.client.1.smithi176.stdout:1/935: fsync d0/f3d 0 2024-09-21T12:47:09.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/322: sync 2024-09-21T12:47:09.862 INFO:tasks.workunit.client.0.smithi046.stdout:4/369: sync 2024-09-21T12:47:09.862 INFO:tasks.workunit.client.1.smithi176.stdout:1/936: chown d0/db/d2a/fdf 3902115 1 2024-09-21T12:47:09.862 INFO:tasks.workunit.client.0.smithi046.stdout:8/323: chown d1/d12/d1a/c45 430247 1 2024-09-21T12:47:09.864 INFO:tasks.workunit.client.0.smithi046.stdout:7/271: write d2/fe [43331,55758] 0 2024-09-21T12:47:09.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/324: dread d1/f11 [4194304,4194304] 0 2024-09-21T12:47:09.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/307: truncate d4/d13/f6e 688175 0 2024-09-21T12:47:09.899 INFO:tasks.workunit.client.1.smithi176.stdout:2/933: mkdir d4/df/d2e/d39/db7/d80/dda/d120 0 2024-09-21T12:47:09.900 INFO:tasks.workunit.client.1.smithi176.stdout:2/934: write d4/df/d2e/d39/fea [3746876,87016] 0 2024-09-21T12:47:09.904 INFO:tasks.workunit.client.0.smithi046.stdout:9/418: dwrite d11/f54 [0,4194304] 0 2024-09-21T12:47:09.905 INFO:tasks.workunit.client.1.smithi176.stdout:9/936: unlink d1/df/d23/dcf/ddd/f103 0 2024-09-21T12:47:09.906 INFO:tasks.workunit.client.1.smithi176.stdout:8/885: dwrite d6/db/d37/d7a/fa5 [0,4194304] 0 2024-09-21T12:47:09.907 INFO:tasks.workunit.client.0.smithi046.stdout:0/374: truncate d6/d7/d13/f1d 2796582 0 2024-09-21T12:47:09.908 INFO:tasks.workunit.client.1.smithi176.stdout:8/886: fdatasync d6/db/d13/f29 0 2024-09-21T12:47:09.908 INFO:tasks.workunit.client.1.smithi176.stdout:4/911: rmdir d3/d42/d56/d101 39 2024-09-21T12:47:09.910 INFO:tasks.workunit.client.1.smithi176.stdout:5/863: write d0/d13/d5d/f73 [4454438,16114] 0 2024-09-21T12:47:09.914 INFO:tasks.workunit.client.1.smithi176.stdout:1/937: unlink d0/db/l4e 0 2024-09-21T12:47:09.919 INFO:tasks.workunit.client.1.smithi176.stdout:1/938: dwrite d0/db/d1a/d2c/dc5/d2b/f3b [0,4194304] 0 2024-09-21T12:47:09.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/317: write d16/f20 [409812,128326] 0 2024-09-21T12:47:09.934 INFO:tasks.workunit.client.0.smithi046.stdout:4/370: dwrite d1/d27/d46/f48 [0,4194304] 0 2024-09-21T12:47:09.936 INFO:tasks.workunit.client.0.smithi046.stdout:4/371: write d1/d27/d46/f3e [3705491,123119] 0 2024-09-21T12:47:09.937 INFO:tasks.workunit.client.1.smithi176.stdout:4/912: fsync d3/d42/f134 0 2024-09-21T12:47:09.938 INFO:tasks.workunit.client.0.smithi046.stdout:4/372: fsync d1/d13/d25/d29/f42 0 2024-09-21T12:47:09.938 INFO:tasks.workunit.client.0.smithi046.stdout:1/308: dread d4/f2c [0,4194304] 0 2024-09-21T12:47:09.944 INFO:tasks.workunit.client.1.smithi176.stdout:1/939: dread - d0/db/d2a/f5f zero size 2024-09-21T12:47:09.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/375: truncate d6/d7/f45 3607664 0 2024-09-21T12:47:09.952 INFO:tasks.workunit.client.0.smithi046.stdout:4/373: mknod d1/d27/d58/c7c 0 2024-09-21T12:47:09.953 INFO:tasks.workunit.client.1.smithi176.stdout:4/913: readlink d3/d42/d56/d101/d107/l55 0 2024-09-21T12:47:09.953 INFO:tasks.workunit.client.0.smithi046.stdout:4/374: truncate d1/d27/d46/f3e 4661304 0 2024-09-21T12:47:09.954 INFO:tasks.workunit.client.0.smithi046.stdout:1/309: unlink d4/d13/f20 0 2024-09-21T12:47:09.955 INFO:tasks.workunit.client.1.smithi176.stdout:8/887: write d6/d16/d9c/fb3 [348558,11484] 0 2024-09-21T12:47:09.955 INFO:tasks.workunit.client.1.smithi176.stdout:6/882: link d2/d63/l69 d2/dd/d26/d2b/d10/l11a 0 2024-09-21T12:47:09.957 INFO:tasks.workunit.client.0.smithi046.stdout:9/419: truncate d11/d19/d1b/d1c/f2e 4725534 0 2024-09-21T12:47:09.960 INFO:tasks.workunit.client.1.smithi176.stdout:9/937: link d1/df/dc3/fe7 d1/d61/d73/f13a 0 2024-09-21T12:47:09.962 INFO:tasks.workunit.client.1.smithi176.stdout:4/914: read d3/d42/d56/f8c [1063641,16613] 0 2024-09-21T12:47:09.962 INFO:tasks.workunit.client.1.smithi176.stdout:8/888: dwrite d6/d16/d36/d67/dd1/fe2 [0,4194304] 0 2024-09-21T12:47:09.962 INFO:tasks.workunit.client.1.smithi176.stdout:1/940: dread d0/db/d1a/d2c/d84/fd4 [0,4194304] 0 2024-09-21T12:47:09.964 INFO:tasks.workunit.client.1.smithi176.stdout:2/935: getdents d4/df/d2e/d6f/d5d/d81/dd9 0 2024-09-21T12:47:09.964 INFO:tasks.workunit.client.1.smithi176.stdout:8/889: stat d6/d16/d36/d67 0 2024-09-21T12:47:09.966 INFO:tasks.workunit.client.1.smithi176.stdout:5/864: getdents d0/d13/d63/d2e/d37 0 2024-09-21T12:47:09.968 INFO:tasks.workunit.client.1.smithi176.stdout:6/883: mknod d2/dd/d26/d2b/d10/d1b/c11b 0 2024-09-21T12:47:09.971 INFO:tasks.workunit.client.0.smithi046.stdout:4/375: dread d1/d27/d58/f4f [0,4194304] 0 2024-09-21T12:47:09.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/272: rename d2/d4/df/d17/d31/d34/f46 to d2/f55 0 2024-09-21T12:47:09.973 INFO:tasks.workunit.client.1.smithi176.stdout:1/941: dwrite d0/db/d1a/d2c/dc5/d41/d59/f14c [0,4194304] 0 2024-09-21T12:47:09.973 INFO:tasks.workunit.client.1.smithi176.stdout:8/890: dwrite d6/f5b [0,4194304] 0 2024-09-21T12:47:09.974 INFO:tasks.workunit.client.1.smithi176.stdout:1/942: readlink d0/db/d6f/l139 0 2024-09-21T12:47:09.975 INFO:tasks.workunit.client.1.smithi176.stdout:9/938: rename d1/df/d48/d69/d38/c6d to d1/df/dc3/c13b 0 2024-09-21T12:47:09.976 INFO:tasks.workunit.client.0.smithi046.stdout:0/376: mknod d6/d7/d37/d53/c90 0 2024-09-21T12:47:09.979 INFO:tasks.workunit.client.1.smithi176.stdout:9/939: write d1/df/dea/f116 [189298,6442] 0 2024-09-21T12:47:09.980 INFO:tasks.workunit.client.1.smithi176.stdout:9/940: stat d1/d61/le8 0 2024-09-21T12:47:09.982 INFO:tasks.workunit.client.1.smithi176.stdout:2/936: creat d4/df/df7/f121 x:0 0 0 2024-09-21T12:47:09.982 INFO:tasks.workunit.client.1.smithi176.stdout:8/891: dwrite d6/db/d13/d98/dde/ff7 [0,4194304] 0 2024-09-21T12:47:09.990 INFO:tasks.workunit.client.0.smithi046.stdout:1/310: chown d4/d29/d32/l51 12 1 2024-09-21T12:47:09.993 INFO:tasks.workunit.client.1.smithi176.stdout:4/915: rename d3/d5/d37/c54 to d3/d42/d56/d101/d107/df0/c142 0 2024-09-21T12:47:09.995 INFO:tasks.workunit.client.1.smithi176.stdout:4/916: write d3/d21/d88/da7/f109 [412318,64589] 0 2024-09-21T12:47:09.999 INFO:tasks.workunit.client.1.smithi176.stdout:6/884: mkdir d2/dd/d26/d2b/d10/d11c 0 2024-09-21T12:47:09.999 INFO:tasks.workunit.client.1.smithi176.stdout:9/941: dread d1/d61/d73/fb9 [0,4194304] 0 2024-09-21T12:47:09.999 INFO:tasks.workunit.client.1.smithi176.stdout:6/885: chown d2/d63/fa4 12 1 2024-09-21T12:47:09.999 INFO:tasks.workunit.client.1.smithi176.stdout:1/943: creat d0/db/d6f/de1/f154 x:0 0 0 2024-09-21T12:47:10.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/377: symlink d6/d7/d9/l91 0 2024-09-21T12:47:10.000 INFO:tasks.workunit.client.0.smithi046.stdout:0/378: chown d6/f1a 2299359 1 2024-09-21T12:47:10.001 INFO:tasks.workunit.client.1.smithi176.stdout:5/865: rename d0/d13/d63/d2e to d0/d13/d63/d8d/d117 0 2024-09-21T12:47:10.002 INFO:tasks.workunit.client.1.smithi176.stdout:5/866: dread - d0/d13/d63/d8d/d117/fc1 zero size 2024-09-21T12:47:10.003 INFO:tasks.workunit.client.0.smithi046.stdout:2/318: getdents d16 0 2024-09-21T12:47:10.003 INFO:tasks.workunit.client.1.smithi176.stdout:4/917: creat d3/d42/d56/d101/d125/f143 x:0 0 0 2024-09-21T12:47:10.004 INFO:tasks.workunit.client.1.smithi176.stdout:8/892: getdents d6/d8/d24/d5e/dfa 0 2024-09-21T12:47:10.004 INFO:tasks.workunit.client.0.smithi046.stdout:9/420: unlink d11/d19/d20/d26/l35 0 2024-09-21T12:47:10.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/421: write f2 [7491386,72011] 0 2024-09-21T12:47:10.006 INFO:tasks.workunit.client.0.smithi046.stdout:9/422: readlink d11/d19/d36/l78 0 2024-09-21T12:47:10.012 INFO:tasks.workunit.client.0.smithi046.stdout:0/379: creat d6/d60/f92 x:0 0 0 2024-09-21T12:47:10.014 INFO:tasks.workunit.client.1.smithi176.stdout:4/918: stat d3/l28 0 2024-09-21T12:47:10.014 INFO:tasks.workunit.client.1.smithi176.stdout:6/886: dwrite d2/dd/d26/d2b/d10/d39/daf/fd6 [0,4194304] 0 2024-09-21T12:47:10.015 INFO:tasks.workunit.client.0.smithi046.stdout:2/319: unlink d16/d22/d2b/l49 0 2024-09-21T12:47:10.016 INFO:tasks.workunit.client.1.smithi176.stdout:2/937: dread d4/f7f [0,4194304] 0 2024-09-21T12:47:10.016 INFO:tasks.workunit.client.1.smithi176.stdout:4/919: write d3/d42/d56/d101/d107/d36/f6e [2271120,108364] 0 2024-09-21T12:47:10.016 INFO:tasks.workunit.client.0.smithi046.stdout:0/380: dread d6/d7/d13/f4b [0,4194304] 0 2024-09-21T12:47:10.017 INFO:tasks.workunit.client.1.smithi176.stdout:8/893: rename d6/d8/d24/d5e/de8/cea to d6/db/d37/d7a/c118 0 2024-09-21T12:47:10.020 INFO:tasks.workunit.client.1.smithi176.stdout:1/944: fdatasync d0/db/d1a/d2c/dc5/d41/f9a 0 2024-09-21T12:47:10.020 INFO:tasks.workunit.client.1.smithi176.stdout:9/942: dread d1/df/d48/d69/d40/f53 [0,4194304] 0 2024-09-21T12:47:10.023 INFO:tasks.workunit.client.1.smithi176.stdout:1/945: write d0/db/d1a/d2c/dc5/d41/d59/d99/db3/df3/f117 [755168,99228] 0 2024-09-21T12:47:10.025 INFO:tasks.workunit.client.1.smithi176.stdout:5/867: truncate d0/d13/d63/f3a 2664229 0 2024-09-21T12:47:10.026 INFO:tasks.workunit.client.1.smithi176.stdout:5/868: chown d0/d13/d63/d72/d87/dcf/d110 77 1 2024-09-21T12:47:10.027 INFO:tasks.workunit.client.0.smithi046.stdout:8/325: rename d1/d12/d1a/l28 to d1/d12/d46/d35/l71 0 2024-09-21T12:47:10.030 INFO:tasks.workunit.client.0.smithi046.stdout:7/273: dread d2/d4/df/f1d [0,4194304] 0 2024-09-21T12:47:10.030 INFO:tasks.workunit.client.0.smithi046.stdout:8/326: read d1/f4f [107697,112622] 0 2024-09-21T12:47:10.032 INFO:tasks.workunit.client.0.smithi046.stdout:2/320: symlink d16/d5c/l60 0 2024-09-21T12:47:10.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/376: dwrite d1/d13/f30 [0,4194304] 0 2024-09-21T12:47:10.034 INFO:tasks.workunit.client.1.smithi176.stdout:9/943: dread d1/df/d48/d69/d38/ff1 [0,4194304] 0 2024-09-21T12:47:10.035 INFO:tasks.workunit.client.0.smithi046.stdout:5/328: sync 2024-09-21T12:47:10.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/321: sync 2024-09-21T12:47:10.035 INFO:tasks.workunit.client.0.smithi046.stdout:3/301: sync 2024-09-21T12:47:10.037 INFO:tasks.workunit.client.0.smithi046.stdout:1/311: link d4/f9 d4/d13/d38/d53/d5a/f70 0 2024-09-21T12:47:10.044 INFO:tasks.workunit.client.0.smithi046.stdout:1/312: dwrite d4/d13/d38/d4f/f69 [0,4194304] 0 2024-09-21T12:47:10.047 INFO:tasks.workunit.client.0.smithi046.stdout:0/381: rename f5 to d6/d7/d13/d43/d52/d63/d7f/d38/f93 0 2024-09-21T12:47:10.053 INFO:tasks.workunit.client.1.smithi176.stdout:1/946: mknod d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/c155 0 2024-09-21T12:47:10.053 INFO:tasks.workunit.client.0.smithi046.stdout:2/321: creat d16/d22/d4e/f61 x:0 0 0 2024-09-21T12:47:10.054 INFO:tasks.workunit.client.1.smithi176.stdout:1/947: stat d0/db/d1a/d2c/d6b/dd7/f103 0 2024-09-21T12:47:10.054 INFO:tasks.workunit.client.1.smithi176.stdout:5/869: mknod d0/d13/d63/d8d/d117/d37/c118 0 2024-09-21T12:47:10.055 INFO:tasks.workunit.client.0.smithi046.stdout:4/377: mkdir d1/d27/d58/d7d 0 2024-09-21T12:47:10.061 INFO:tasks.workunit.client.1.smithi176.stdout:4/920: getdents d3/d21/df5/d113 0 2024-09-21T12:47:10.062 INFO:tasks.workunit.client.0.smithi046.stdout:5/329: symlink d4/l5f 0 2024-09-21T12:47:10.063 INFO:tasks.workunit.client.1.smithi176.stdout:8/894: mknod d6/d16/d36/c119 0 2024-09-21T12:47:10.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/330: dwrite d4/dc/d13/f50 [0,4194304] 0 2024-09-21T12:47:10.068 INFO:tasks.workunit.client.1.smithi176.stdout:1/948: unlink d0/db/d1a/d2c/d84/fb9 0 2024-09-21T12:47:10.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/313: readlink d4/l8 0 2024-09-21T12:47:10.073 INFO:tasks.workunit.client.0.smithi046.stdout:0/382: symlink d6/d2f/l94 0 2024-09-21T12:47:10.075 INFO:tasks.workunit.client.1.smithi176.stdout:2/938: creat d4/f122 x:0 0 0 2024-09-21T12:47:10.076 INFO:tasks.workunit.client.1.smithi176.stdout:2/939: write d4/df/d2e/d6f/d5d/d67/dd6/f110 [394495,23308] 0 2024-09-21T12:47:10.076 INFO:tasks.workunit.client.1.smithi176.stdout:4/921: creat d3/d42/dae/f144 x:0 0 0 2024-09-21T12:47:10.076 INFO:tasks.workunit.client.1.smithi176.stdout:4/922: dread - d3/d5/f10c zero size 2024-09-21T12:47:10.081 INFO:tasks.workunit.client.0.smithi046.stdout:6/322: creat de/d2a/d4c/f67 x:0 0 0 2024-09-21T12:47:10.081 INFO:tasks.workunit.client.0.smithi046.stdout:6/323: chown de/d2a 16 1 2024-09-21T12:47:10.081 INFO:tasks.workunit.client.0.smithi046.stdout:2/322: dread d16/d22/f29 [0,4194304] 0 2024-09-21T12:47:10.082 INFO:tasks.workunit.client.0.smithi046.stdout:6/324: write de/f46 [1918466,33396] 0 2024-09-21T12:47:10.083 INFO:tasks.workunit.client.1.smithi176.stdout:6/887: getdents d2/d6f 0 2024-09-21T12:47:10.083 INFO:tasks.workunit.client.1.smithi176.stdout:2/940: dread d4/df/d2e/d39/fd3 [0,4194304] 0 2024-09-21T12:47:10.083 INFO:tasks.workunit.client.0.smithi046.stdout:6/325: chown de/c29 15457052 1 2024-09-21T12:47:10.085 INFO:tasks.workunit.client.1.smithi176.stdout:1/949: dread d0/db/d6a/fcd [0,4194304] 0 2024-09-21T12:47:10.085 INFO:tasks.workunit.client.0.smithi046.stdout:9/423: getdents d11/d19/d1b/d1c 0 2024-09-21T12:47:10.086 INFO:tasks.workunit.client.0.smithi046.stdout:1/314: write d4/f1b [2531882,56894] 0 2024-09-21T12:47:10.088 INFO:tasks.workunit.client.0.smithi046.stdout:1/315: fsync d4/d13/d38/d4f/f5e 0 2024-09-21T12:47:10.089 INFO:tasks.workunit.client.1.smithi176.stdout:2/941: creat d4/df/d2e/d6f/d5d/d67/f123 x:0 0 0 2024-09-21T12:47:10.091 INFO:tasks.workunit.client.0.smithi046.stdout:7/274: rmdir d2/d4e 0 2024-09-21T12:47:10.094 INFO:tasks.workunit.client.1.smithi176.stdout:8/895: write d6/d8/d54/fe6 [3988416,29584] 0 2024-09-21T12:47:10.095 INFO:tasks.workunit.client.1.smithi176.stdout:5/870: truncate d0/d10/f4c 8098356 0 2024-09-21T12:47:10.095 INFO:tasks.workunit.client.1.smithi176.stdout:8/896: write d6/db/d13/d98/da1/f100 [1808882,23515] 0 2024-09-21T12:47:10.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/323: symlink d16/d22/d4e/l62 0 2024-09-21T12:47:10.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/324: chown d16/d22/d38/f4f 162 1 2024-09-21T12:47:10.100 INFO:tasks.workunit.client.0.smithi046.stdout:6/326: readlink de/l2d 0 2024-09-21T12:47:10.101 INFO:tasks.workunit.client.1.smithi176.stdout:8/897: dwrite d6/fa [0,4194304] 0 2024-09-21T12:47:10.101 INFO:tasks.workunit.client.1.smithi176.stdout:6/888: write d2/dd/fba [391066,17803] 0 2024-09-21T12:47:10.106 INFO:tasks.workunit.client.0.smithi046.stdout:5/331: dwrite d4/d22/d10/d1a/f1c [0,4194304] 0 2024-09-21T12:47:10.106 INFO:tasks.workunit.client.0.smithi046.stdout:4/378: write d1/d13/f16 [5624289,24723] 0 2024-09-21T12:47:10.106 INFO:tasks.workunit.client.1.smithi176.stdout:1/950: symlink d0/db/d1a/d2c/dc5/l156 0 2024-09-21T12:47:10.113 INFO:tasks.workunit.client.1.smithi176.stdout:4/923: getdents d3/d42/d102 0 2024-09-21T12:47:10.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/316: write d4/f26 [4747527,7826] 0 2024-09-21T12:47:10.114 INFO:tasks.workunit.client.0.smithi046.stdout:0/383: truncate d6/d4f/f82 2420690 0 2024-09-21T12:47:10.115 INFO:tasks.workunit.client.1.smithi176.stdout:5/871: dread d0/d10/f36 [0,4194304] 0 2024-09-21T12:47:10.116 INFO:tasks.workunit.client.0.smithi046.stdout:7/275: creat d2/d4/df/d17/f56 x:0 0 0 2024-09-21T12:47:10.117 INFO:tasks.workunit.client.0.smithi046.stdout:7/276: dread - d2/d4/f33 zero size 2024-09-21T12:47:10.118 INFO:tasks.workunit.client.1.smithi176.stdout:6/889: creat d2/dd/d26/d2b/d68/dfa/f11d x:0 0 0 2024-09-21T12:47:10.120 INFO:tasks.workunit.client.0.smithi046.stdout:3/302: link d5/c14 d5/dc/d28/d60/c70 0 2024-09-21T12:47:10.121 INFO:tasks.workunit.client.1.smithi176.stdout:8/898: dread d6/d8/d24/d35/d51/fd3 [0,4194304] 0 2024-09-21T12:47:10.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/325: write d16/d22/d38/f35 [4388290,22477] 0 2024-09-21T12:47:10.123 INFO:tasks.workunit.client.1.smithi176.stdout:2/942: link d4/df/f15 d4/df/d2e/d6f/d5d/d81/f124 0 2024-09-21T12:47:10.123 INFO:tasks.workunit.client.1.smithi176.stdout:4/924: dwrite d3/d42/d56/d101/d107/d96/fbe [0,4194304] 0 2024-09-21T12:47:10.123 INFO:tasks.workunit.client.1.smithi176.stdout:8/899: write d6/de7/ff9 [258734,45495] 0 2024-09-21T12:47:10.125 INFO:tasks.workunit.client.1.smithi176.stdout:8/900: dread - d6/d8/d24/d35/d51/fc9 zero size 2024-09-21T12:47:10.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/332: symlink d4/dc/d13/d15/l60 0 2024-09-21T12:47:10.129 INFO:tasks.workunit.client.0.smithi046.stdout:0/384: dread d6/d7/f12 [0,4194304] 0 2024-09-21T12:47:10.132 INFO:tasks.workunit.client.0.smithi046.stdout:8/327: rename d1/d12/d1a/d33/f38 to d1/d12/f72 0 2024-09-21T12:47:10.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/328: dread - d1/d24/f31 zero size 2024-09-21T12:47:10.139 INFO:tasks.workunit.client.0.smithi046.stdout:1/317: creat d4/d13/d38/f71 x:0 0 0 2024-09-21T12:47:10.141 INFO:tasks.workunit.client.0.smithi046.stdout:7/277: creat d2/dd/f57 x:0 0 0 2024-09-21T12:47:10.142 INFO:tasks.workunit.client.0.smithi046.stdout:7/278: chown d2/dd 5643 1 2024-09-21T12:47:10.143 INFO:tasks.workunit.client.0.smithi046.stdout:7/279: truncate d2/d4/df/f10 2213680 0 2024-09-21T12:47:10.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/280: stat d2/d4/df/d42 0 2024-09-21T12:47:10.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/281: chown d2/d4/df/d17/d31/f45 1878390 1 2024-09-21T12:47:10.145 INFO:tasks.workunit.client.0.smithi046.stdout:2/326: mkdir d16/d5c/d63 0 2024-09-21T12:47:10.145 INFO:tasks.workunit.client.1.smithi176.stdout:1/951: dwrite d0/db/d2a/fca [4194304,4194304] 0 2024-09-21T12:47:10.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/282: dread - d2/d4/df/d17/f35 zero size 2024-09-21T12:47:10.153 INFO:tasks.workunit.client.1.smithi176.stdout:4/925: dwrite d3/d21/d27/fc6 [0,4194304] 0 2024-09-21T12:47:10.153 INFO:tasks.workunit.client.0.smithi046.stdout:3/303: truncate d5/f6b 1513346 0 2024-09-21T12:47:10.154 INFO:tasks.workunit.client.1.smithi176.stdout:1/952: chown d0/db/d1a/d2c/d37/cee 3 1 2024-09-21T12:47:10.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/304: write d5/dc/d28/f53 [1254962,32492] 0 2024-09-21T12:47:10.155 INFO:tasks.workunit.client.1.smithi176.stdout:5/872: rmdir d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/dad/d115 0 2024-09-21T12:47:10.157 INFO:tasks.workunit.client.0.smithi046.stdout:6/327: creat de/d2a/f68 x:0 0 0 2024-09-21T12:47:10.158 INFO:tasks.workunit.client.0.smithi046.stdout:6/328: truncate de/d2a/f49 474534 0 2024-09-21T12:47:10.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:09 smithi046 ceph-mon[27868]: pgmap v31: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 81 MiB/s rd, 247 MiB/s wr, 503 op/s 2024-09-21T12:47:10.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/283: mkdir d2/d4/d43/d58 0 2024-09-21T12:47:10.163 INFO:tasks.workunit.client.1.smithi176.stdout:8/901: truncate d6/fa 2472367 0 2024-09-21T12:47:10.163 INFO:tasks.workunit.client.0.smithi046.stdout:7/284: dread - d2/d4/f33 zero size 2024-09-21T12:47:10.164 INFO:tasks.workunit.client.0.smithi046.stdout:7/285: truncate d2/dd/f3f 360125 0 2024-09-21T12:47:10.164 INFO:tasks.workunit.client.1.smithi176.stdout:4/926: creat d3/d42/dae/f145 x:0 0 0 2024-09-21T12:47:10.165 INFO:tasks.workunit.client.0.smithi046.stdout:9/424: link d11/f12 d11/d19/d1b/d31/f7d 0 2024-09-21T12:47:10.166 INFO:tasks.workunit.client.0.smithi046.stdout:7/286: write d2/d4/df/d17/f40 [578401,128714] 0 2024-09-21T12:47:10.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/333: mknod d4/dc/d13/d5b/d2d/d43/c61 0 2024-09-21T12:47:10.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/334: chown d4/l5f 1171116636 1 2024-09-21T12:47:10.170 INFO:tasks.workunit.client.1.smithi176.stdout:2/943: getdents d4/d3d/d65 0 2024-09-21T12:47:10.170 INFO:tasks.workunit.client.0.smithi046.stdout:4/379: link d1/d13/d25/d29/d43/l32 d1/d13/d25/d29/d45/l7e 0 2024-09-21T12:47:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/380: fdatasync d1/f2a 0 2024-09-21T12:47:10.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/335: write d4/dc/d13/d5b/d2d/d43/f55 [152039,57016] 0 2024-09-21T12:47:10.173 INFO:tasks.workunit.client.1.smithi176.stdout:4/927: creat d3/d42/d56/d101/d107/df0/f146 x:0 0 0 2024-09-21T12:47:10.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/305: mknod d5/d16/d5f/d6c/c71 0 2024-09-21T12:47:10.175 INFO:tasks.workunit.client.1.smithi176.stdout:1/953: fsync d0/db/d1a/d2c/d66/d6d/dd8/ff2 0 2024-09-21T12:47:10.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/327: getdents d16/d22/d56 0 2024-09-21T12:47:10.177 INFO:tasks.workunit.client.0.smithi046.stdout:7/287: dwrite d2/dd/f29 [0,4194304] 0 2024-09-21T12:47:10.180 INFO:tasks.workunit.client.1.smithi176.stdout:1/954: dread d0/db/d1a/d2c/dc5/d41/d59/f14c [0,4194304] 0 2024-09-21T12:47:10.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/425: mknod d11/d19/d1b/d31/d53/d5e/c7e 0 2024-09-21T12:47:10.184 INFO:tasks.workunit.client.0.smithi046.stdout:8/329: dread d1/fd [0,4194304] 0 2024-09-21T12:47:10.187 INFO:tasks.workunit.client.0.smithi046.stdout:8/330: read - d1/d24/f31 zero size 2024-09-21T12:47:10.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/336: dwrite d4/f8 [4194304,4194304] 0 2024-09-21T12:47:10.191 INFO:tasks.workunit.client.1.smithi176.stdout:5/873: write d0/f52 [3300808,44136] 0 2024-09-21T12:47:10.192 INFO:tasks.workunit.client.0.smithi046.stdout:0/385: write d6/d7/d37/d53/f56 [469775,82555] 0 2024-09-21T12:47:10.193 INFO:tasks.workunit.client.1.smithi176.stdout:5/874: chown d0/d13/d63/d8d/d117/d37/cf5 295234612 1 2024-09-21T12:47:10.197 INFO:tasks.workunit.client.0.smithi046.stdout:2/328: readlink d16/l17 0 2024-09-21T12:47:10.197 INFO:tasks.workunit.client.1.smithi176.stdout:6/890: sync 2024-09-21T12:47:10.197 INFO:tasks.workunit.client.1.smithi176.stdout:9/944: sync 2024-09-21T12:47:10.198 INFO:tasks.workunit.client.0.smithi046.stdout:2/329: dread - d16/d22/d2b/d30/f5f zero size 2024-09-21T12:47:10.199 INFO:tasks.workunit.client.1.smithi176.stdout:8/902: dwrite d6/d8/d24/d35/f61 [0,4194304] 0 2024-09-21T12:47:10.201 INFO:tasks.workunit.client.0.smithi046.stdout:6/329: dread de/d2a/f2f [0,4194304] 0 2024-09-21T12:47:10.203 INFO:tasks.workunit.client.1.smithi176.stdout:5/875: creat d0/d13/d63/d8d/d117/d71/f119 x:0 0 0 2024-09-21T12:47:10.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/330: truncate de/d2a/d4c/f54 724944 0 2024-09-21T12:47:10.203 INFO:tasks.workunit.client.0.smithi046.stdout:9/426: creat d11/d19/d36/d45/d64/f7f x:0 0 0 2024-09-21T12:47:10.204 INFO:tasks.workunit.client.0.smithi046.stdout:9/427: stat d11/d19/f1a 0 2024-09-21T12:47:10.205 INFO:tasks.workunit.client.1.smithi176.stdout:4/928: write d3/d21/d27/fc1 [1986367,56712] 0 2024-09-21T12:47:10.206 INFO:tasks.workunit.client.1.smithi176.stdout:2/944: dwrite d4/df/d2e/d6f/d5d/d81/db2/da5/dcc/fd7 [0,4194304] 0 2024-09-21T12:47:10.209 INFO:tasks.workunit.client.1.smithi176.stdout:6/891: mknod d2/dd/d26/d2b/d10/d39/c11e 0 2024-09-21T12:47:10.211 INFO:tasks.workunit.client.1.smithi176.stdout:8/903: mkdir d6/d8/d24/d35/d51/d11a 0 2024-09-21T12:47:10.214 INFO:tasks.workunit.client.0.smithi046.stdout:3/306: mknod d5/dc/d28/d63/c72 0 2024-09-21T12:47:10.216 INFO:tasks.workunit.client.0.smithi046.stdout:3/307: fsync d5/d16/f1e 0 2024-09-21T12:47:10.217 INFO:tasks.workunit.client.1.smithi176.stdout:6/892: dwrite d2/dd/d26/d2b/d10/d1b/f102 [0,4194304] 0 2024-09-21T12:47:10.217 INFO:tasks.workunit.client.1.smithi176.stdout:5/876: creat d0/d13/d5d/f11a x:0 0 0 2024-09-21T12:47:10.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/308: chown d5/dc/d28/c58 497468 1 2024-09-21T12:47:10.220 INFO:tasks.workunit.client.0.smithi046.stdout:4/381: dwrite d1/d27/d58/f4f [0,4194304] 0 2024-09-21T12:47:10.221 INFO:tasks.workunit.client.1.smithi176.stdout:5/877: write d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/faa [2055528,103943] 0 2024-09-21T12:47:10.222 INFO:tasks.workunit.client.1.smithi176.stdout:1/955: rename d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/ded/f12d to d0/db/f157 0 2024-09-21T12:47:10.222 INFO:tasks.workunit.client.1.smithi176.stdout:5/878: rename d0/d13/d63/d8d/d117/d37 to d0/d13/d63/d8d/d117/d37/db5/db7/ddd/d11b 22 2024-09-21T12:47:10.224 INFO:tasks.workunit.client.0.smithi046.stdout:2/330: rename d16/l23 to d16/l64 0 2024-09-21T12:47:10.227 INFO:tasks.workunit.client.1.smithi176.stdout:9/945: write d1/f71 [18386,88625] 0 2024-09-21T12:47:10.229 INFO:tasks.workunit.client.0.smithi046.stdout:0/386: write d6/f18 [6601073,109506] 0 2024-09-21T12:47:10.230 INFO:tasks.workunit.client.1.smithi176.stdout:2/945: chown d4/df/c3b 13493057 1 2024-09-21T12:47:10.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/387: read d6/d7/f12 [2102110,1110] 0 2024-09-21T12:47:10.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/331: truncate d1/d12/f72 105619 0 2024-09-21T12:47:10.233 INFO:tasks.workunit.client.0.smithi046.stdout:8/332: fdatasync d1/d24/f4a 0 2024-09-21T12:47:10.235 INFO:tasks.workunit.client.1.smithi176.stdout:6/893: fdatasync d2/dd/d26/d2b/d10/d87/f8a 0 2024-09-21T12:47:10.237 INFO:tasks.workunit.client.0.smithi046.stdout:4/382: mknod d1/d27/d46/d78/c7f 0 2024-09-21T12:47:10.239 INFO:tasks.workunit.client.1.smithi176.stdout:5/879: rmdir d0/d13/d63/d8d/d117/d37/db5 39 2024-09-21T12:47:10.240 INFO:tasks.workunit.client.1.smithi176.stdout:9/946: creat d1/df/d23/f13c x:0 0 0 2024-09-21T12:47:10.241 INFO:tasks.workunit.client.0.smithi046.stdout:0/388: rmdir d6/d60 39 2024-09-21T12:47:10.241 INFO:tasks.workunit.client.1.smithi176.stdout:9/947: chown d1/df/d9a/dbc/f113 148 1 2024-09-21T12:47:10.242 INFO:tasks.workunit.client.1.smithi176.stdout:4/929: symlink d3/d42/d47/d5c/dec/d127/l147 0 2024-09-21T12:47:10.242 INFO:tasks.workunit.client.0.smithi046.stdout:4/383: dread d1/d13/f30 [0,4194304] 0 2024-09-21T12:47:10.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/331: dread de/f2c [0,4194304] 0 2024-09-21T12:47:10.244 INFO:tasks.workunit.client.0.smithi046.stdout:5/337: creat d4/d22/d10/f62 x:0 0 0 2024-09-21T12:47:10.246 INFO:tasks.workunit.client.1.smithi176.stdout:6/894: unlink d2/d63/fc0 0 2024-09-21T12:47:10.247 INFO:tasks.workunit.client.0.smithi046.stdout:2/331: getdents d16/d22/d56 0 2024-09-21T12:47:10.248 INFO:tasks.workunit.client.0.smithi046.stdout:9/428: dread f10 [0,4194304] 0 2024-09-21T12:47:10.248 INFO:tasks.workunit.client.0.smithi046.stdout:2/332: chown d16/d22/d38/c50 1 1 2024-09-21T12:47:10.250 INFO:tasks.workunit.client.1.smithi176.stdout:9/948: dread - d1/df/d48/d69/d76/d7c/fd3 zero size 2024-09-21T12:47:10.253 INFO:tasks.workunit.client.0.smithi046.stdout:7/288: getdents d2/d4/df/d42 0 2024-09-21T12:47:10.254 INFO:tasks.workunit.client.1.smithi176.stdout:4/930: unlink d3/d42/d56/fb8 0 2024-09-21T12:47:10.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/389: symlink d6/d7/d13/d43/d52/l95 0 2024-09-21T12:47:10.256 INFO:tasks.workunit.client.0.smithi046.stdout:9/429: dwrite d11/d19/d36/d45/d6e/f76 [0,4194304] 0 2024-09-21T12:47:10.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/390: write d6/d7/d9/ff [205343,33625] 0 2024-09-21T12:47:10.258 INFO:tasks.workunit.client.0.smithi046.stdout:3/309: write d5/dc/d26/d3c/d44/f4b [2830370,113906] 0 2024-09-21T12:47:10.258 INFO:tasks.workunit.client.1.smithi176.stdout:6/895: read d2/dd/f7a [3443630,58264] 0 2024-09-21T12:47:10.260 INFO:tasks.workunit.client.1.smithi176.stdout:6/896: write d2/dd/d79/fdc [266229,66605] 0 2024-09-21T12:47:10.260 INFO:tasks.workunit.client.1.smithi176.stdout:1/956: creat d0/db/d1a/d2c/dc5/f158 x:0 0 0 2024-09-21T12:47:10.262 INFO:tasks.workunit.client.0.smithi046.stdout:5/338: symlink d4/dc/d13/d15/l63 0 2024-09-21T12:47:10.263 INFO:tasks.workunit.client.1.smithi176.stdout:2/946: creat d4/f125 x:0 0 0 2024-09-21T12:47:10.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/332: rename de/d2a/d34/d4e/d55/d63 to de/d2a/d4c/d69 0 2024-09-21T12:47:10.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/333: stat de/f46 0 2024-09-21T12:47:10.267 INFO:tasks.workunit.client.1.smithi176.stdout:9/949: mkdir d1/d61/d118/d13d 0 2024-09-21T12:47:10.268 INFO:tasks.workunit.client.0.smithi046.stdout:2/333: unlink l8 0 2024-09-21T12:47:10.269 INFO:tasks.workunit.client.1.smithi176.stdout:4/931: symlink d3/d42/dae/l148 0 2024-09-21T12:47:10.271 INFO:tasks.workunit.client.1.smithi176.stdout:8/904: getdents d6/db/d37/d89 0 2024-09-21T12:47:10.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/289: creat d2/d4/df/d17/f59 x:0 0 0 2024-09-21T12:47:10.274 INFO:tasks.workunit.client.0.smithi046.stdout:7/290: chown d2/d4/c22 1034692572 1 2024-09-21T12:47:10.274 INFO:tasks.workunit.client.1.smithi176.stdout:6/897: symlink d2/dd5/l11f 0 2024-09-21T12:47:10.275 INFO:tasks.workunit.client.1.smithi176.stdout:6/898: chown d2/dd/d26/d2b/d68/dfa/f11d 50 1 2024-09-21T12:47:10.275 INFO:tasks.workunit.client.1.smithi176.stdout:8/905: dread d6/d16/d36/d67/dd1/fe2 [0,4194304] 0 2024-09-21T12:47:10.276 INFO:tasks.workunit.client.1.smithi176.stdout:1/957: mkdir d0/db/d1a/d2c/dc5/d41/d59/d9b/dce/ded/d159 0 2024-09-21T12:47:10.277 INFO:tasks.workunit.client.1.smithi176.stdout:6/899: write d2/dd/d26/d2b/d10/d1b/f102 [2874054,57800] 0 2024-09-21T12:47:10.279 INFO:tasks.workunit.client.0.smithi046.stdout:0/391: write d6/d7/fa [4811611,126089] 0 2024-09-21T12:47:10.281 INFO:tasks.workunit.client.0.smithi046.stdout:2/334: dread d16/f27 [0,4194304] 0 2024-09-21T12:47:10.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/384: dread d1/d13/d25/d29/d33/f41 [4194304,4194304] 0 2024-09-21T12:47:10.283 INFO:tasks.workunit.client.0.smithi046.stdout:8/333: creat d1/d12/d46/d35/f73 x:0 0 0 2024-09-21T12:47:10.283 INFO:tasks.workunit.client.1.smithi176.stdout:6/900: dwrite d2/d6f/d7f/f111 [0,4194304] 0 2024-09-21T12:47:10.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/335: truncate d16/d22/d4e/f61 236723 0 2024-09-21T12:47:10.286 INFO:tasks.workunit.client.1.smithi176.stdout:8/906: mkdir d6/de7/d11b 0 2024-09-21T12:47:10.287 INFO:tasks.workunit.client.0.smithi046.stdout:6/334: creat de/d2a/d34/f6a x:0 0 0 2024-09-21T12:47:10.289 INFO:tasks.workunit.client.1.smithi176.stdout:8/907: read d6/de7/ffc [2800131,51957] 0 2024-09-21T12:47:10.289 INFO:tasks.workunit.client.1.smithi176.stdout:1/958: mknod d0/d5b/c15a 0 2024-09-21T12:47:10.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/291: creat d2/dd/f5a x:0 0 0 2024-09-21T12:47:10.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/292: chown d2/fe 821 1 2024-09-21T12:47:10.296 INFO:tasks.workunit.client.1.smithi176.stdout:9/950: mkdir d1/df/d48/d69/dc8/d13e 0 2024-09-21T12:47:10.297 INFO:tasks.workunit.client.0.smithi046.stdout:7/293: truncate d2/d4/df/d17/f56 617802 0 2024-09-21T12:47:10.298 INFO:tasks.workunit.client.0.smithi046.stdout:9/430: unlink f6 0 2024-09-21T12:47:10.298 INFO:tasks.workunit.client.1.smithi176.stdout:4/932: write d3/d21/d88/da7/ff7 [825502,27521] 0 2024-09-21T12:47:10.301 INFO:tasks.workunit.client.0.smithi046.stdout:0/392: creat d6/d7/d13/d43/d52/d63/f96 x:0 0 0 2024-09-21T12:47:10.303 INFO:tasks.workunit.client.0.smithi046.stdout:4/385: mknod d1/d13/d25/d3a/c80 0 2024-09-21T12:47:10.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/334: fdatasync d1/d12/d46/d35/d36/f4b 0 2024-09-21T12:47:10.305 INFO:tasks.workunit.client.1.smithi176.stdout:6/901: dread d2/f64 [0,4194304] 0 2024-09-21T12:47:10.306 INFO:tasks.workunit.client.0.smithi046.stdout:8/335: dread - d1/d24/f31 zero size 2024-09-21T12:47:10.306 INFO:tasks.workunit.client.1.smithi176.stdout:2/947: write d4/df/d2e/fdc [555773,67875] 0 2024-09-21T12:47:10.307 INFO:tasks.workunit.client.1.smithi176.stdout:8/908: mknod d6/db/d37/c11c 0 2024-09-21T12:47:10.310 INFO:tasks.workunit.client.0.smithi046.stdout:6/335: mknod de/d2a/d34/d4e/c6b 0 2024-09-21T12:47:10.313 INFO:tasks.workunit.client.1.smithi176.stdout:9/951: mknod d1/df/dea/df5/c13f 0 2024-09-21T12:47:10.313 INFO:tasks.workunit.client.0.smithi046.stdout:9/431: mknod d11/d19/d20/d26/c80 0 2024-09-21T12:47:10.314 INFO:tasks.workunit.client.1.smithi176.stdout:2/948: dread d4/df/d2e/d6f/d6d/f71 [0,4194304] 0 2024-09-21T12:47:10.314 INFO:tasks.workunit.client.1.smithi176.stdout:9/952: chown d1/df/d48/d69/fc7 1954 1 2024-09-21T12:47:10.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/393: mkdir d6/d7/d9/d54/d97 0 2024-09-21T12:47:10.315 INFO:tasks.workunit.client.1.smithi176.stdout:6/902: mkdir d2/d6f/d81/d120 0 2024-09-21T12:47:10.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:09 smithi176 ceph-mon[35476]: pgmap v31: 65 pgs: 65 active+clean; 2.3 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 81 MiB/s rd, 247 MiB/s wr, 503 op/s 2024-09-21T12:47:10.316 INFO:tasks.workunit.client.0.smithi046.stdout:8/336: unlink d1/fe 0 2024-09-21T12:47:10.320 INFO:tasks.workunit.client.0.smithi046.stdout:5/339: rename d4/d22/d10/l2b to d4/dc/l64 0 2024-09-21T12:47:10.346 INFO:tasks.workunit.client.0.smithi046.stdout:7/294: rename d2/d4 to d2/d4/df/d17/d31/d5b 22 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:4/933: mkdir d3/d149 0 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:5/880: sync 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:2/949: dwrite d4/d3d/d65/ff1 [0,4194304] 0 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:5/881: chown d0/d13/d63/d8d/ddc/d109/f112 25953 1 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:5/882: dread - d0/d13/d63/d8d/d117/dda/fe2 zero size 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:9/953: chown d1/d61/d73/d7d/fcb 112809337 1 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:1/959: dread d0/db/d1a/d2c/dc5/ff6 [0,4194304] 0 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:9/954: chown d1/df/led 784952497 1 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:8/909: dwrite d6/d16/d36/d67/f70 [0,4194304] 0 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:4/934: rmdir d3/d42/d56/d101 39 2024-09-21T12:47:10.349 INFO:tasks.workunit.client.1.smithi176.stdout:1/960: rename d0/db/d1a/d2c/d6b/dd7/dfd to d0/d91/d15b 0 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.1.smithi176.stdout:4/935: chown d3/d42/d56/d101/d107/d36/c62 241 1 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:8/337: rename d1 to d1/d74 22 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:3/310: getdents d5 0 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:9/432: dwrite d11/d19/d20/f73 [0,4194304] 0 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/394: symlink d6/d7/d13/d43/d52/d63/d7f/d38/l98 0 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:2/336: link d16/d22/d38/c50 d16/d22/d56/c65 0 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:8/338: symlink d1/d24/l75 0 2024-09-21T12:47:10.350 INFO:tasks.workunit.client.0.smithi046.stdout:7/295: mknod d2/d4/df/d17/c5c 0 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:9/433: dwrite d11/d19/d36/d45/f51 [0,4194304] 0 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:3/311: creat d5/dc/d28/d60/f73 x:0 0 0 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:2/337: rmdir d16/d22/d4e 39 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:3/312: truncate d5/f62 302213 0 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:2/338: chown d16/d22/d2b/d43/l4d 2721014 1 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:5/340: symlink d4/dc/d13/d5b/d2d/l65 0 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:0/395: dread d6/d7/d13/d43/d52/d63/d7f/f44 [0,4194304] 0 2024-09-21T12:47:10.351 INFO:tasks.workunit.client.0.smithi046.stdout:6/336: creat de/f6c x:0 0 0 2024-09-21T12:47:10.354 INFO:tasks.workunit.client.1.smithi176.stdout:9/955: rename d1/df/d48/d69/d40/d84/dfd/d12a/f136 to d1/df/d9a/d127/f140 0 2024-09-21T12:47:10.354 INFO:tasks.workunit.client.1.smithi176.stdout:2/950: dwrite d4/df/d2e/d6f/f59 [0,4194304] 0 2024-09-21T12:47:10.356 INFO:tasks.workunit.client.0.smithi046.stdout:2/339: mknod d16/d5c/c66 0 2024-09-21T12:47:10.357 INFO:tasks.workunit.client.1.smithi176.stdout:5/883: dread d0/d13/d63/d66/fbe [0,4194304] 0 2024-09-21T12:47:10.357 INFO:tasks.workunit.client.1.smithi176.stdout:8/910: creat d6/de7/dfd/f11d x:0 0 0 2024-09-21T12:47:10.358 INFO:tasks.workunit.client.1.smithi176.stdout:4/936: rmdir d3/d42/dae 39 2024-09-21T12:47:10.359 INFO:tasks.workunit.client.1.smithi176.stdout:5/884: write d0/d13/d63/d8d/d117/f46 [979921,56659] 0 2024-09-21T12:47:10.360 INFO:tasks.workunit.client.0.smithi046.stdout:5/341: creat d4/dc/d13/d5e/f66 x:0 0 0 2024-09-21T12:47:10.364 INFO:tasks.workunit.client.0.smithi046.stdout:0/396: fsync d6/d60/f92 0 2024-09-21T12:47:10.367 INFO:tasks.workunit.client.0.smithi046.stdout:6/337: rename de/d2a/d4d/c5c to de/d2a/d4c/c6d 0 2024-09-21T12:47:10.371 INFO:tasks.workunit.client.1.smithi176.stdout:2/951: mknod d4/df/d2e/d4d/d70/c126 0 2024-09-21T12:47:10.372 INFO:tasks.workunit.client.1.smithi176.stdout:2/952: readlink d4/df/d2e/d6f/l4c 0 2024-09-21T12:47:10.375 INFO:tasks.workunit.client.0.smithi046.stdout:2/340: mkdir d16/d22/d2b/d30/d67 0 2024-09-21T12:47:10.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/338: dwrite de/f46 [12582912,4194304] 0 2024-09-21T12:47:10.378 INFO:tasks.workunit.client.0.smithi046.stdout:2/341: readlink d16/l1c 0 2024-09-21T12:47:10.380 INFO:tasks.workunit.client.1.smithi176.stdout:1/961: dwrite d0/d63/f10a [0,4194304] 0 2024-09-21T12:47:10.380 INFO:tasks.workunit.client.1.smithi176.stdout:9/956: rename d1/df/d23/d67/df0/d108/d132 to d1/df/d48/d69/d76/d123/d141 0 2024-09-21T12:47:10.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/296: dwrite d2/d4/df/f10 [0,4194304] 0 2024-09-21T12:47:10.386 INFO:tasks.workunit.client.1.smithi176.stdout:4/937: fdatasync d3/d42/d47/fd5 0 2024-09-21T12:47:10.386 INFO:tasks.workunit.client.0.smithi046.stdout:9/434: dwrite d11/d19/d1b/d31/d44/f4c [0,4194304] 0 2024-09-21T12:47:10.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/297: write d2/fa [5196228,82059] 0 2024-09-21T12:47:10.389 INFO:tasks.workunit.client.1.smithi176.stdout:5/885: stat d0/d10/la1 0 2024-09-21T12:47:10.389 INFO:tasks.workunit.client.0.smithi046.stdout:9/435: write d11/d19/d1b/d31/f5a [721293,101506] 0 2024-09-21T12:47:10.389 INFO:tasks.workunit.client.0.smithi046.stdout:7/298: write d2/dd/f5a [17544,61772] 0 2024-09-21T12:47:10.393 INFO:tasks.workunit.client.1.smithi176.stdout:6/903: link d2/dd/d26/d2b/d10/d87/ff6 d2/d63/f121 0 2024-09-21T12:47:10.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/339: dread d1/d12/d46/f49 [0,4194304] 0 2024-09-21T12:47:10.396 INFO:tasks.workunit.client.0.smithi046.stdout:5/342: mknod d4/dc/d13/c67 0 2024-09-21T12:47:10.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/340: truncate d1/d24/f4a 1568151 0 2024-09-21T12:47:10.401 INFO:tasks.workunit.client.0.smithi046.stdout:0/397: mknod d6/d7/d13/d49/d51/c99 0 2024-09-21T12:47:10.402 INFO:tasks.workunit.client.1.smithi176.stdout:1/962: read d0/f3 [3407767,27303] 0 2024-09-21T12:47:10.404 INFO:tasks.workunit.client.0.smithi046.stdout:7/299: dwrite d2/d4/df/d17/d31/f45 [0,4194304] 0 2024-09-21T12:47:10.405 INFO:tasks.workunit.client.0.smithi046.stdout:7/300: chown d2/d4/df/d17/c2a 35036 1 2024-09-21T12:47:10.408 INFO:tasks.workunit.client.0.smithi046.stdout:7/301: dread d2/d4/df/d17/d31/d34/f48 [0,4194304] 0 2024-09-21T12:47:10.408 INFO:tasks.workunit.client.1.smithi176.stdout:4/938: write d3/f32 [3205506,26330] 0 2024-09-21T12:47:10.408 INFO:tasks.workunit.client.1.smithi176.stdout:8/911: dwrite d6/d16/d79/f83 [4194304,4194304] 0 2024-09-21T12:47:10.408 INFO:tasks.workunit.client.0.smithi046.stdout:3/313: getdents d5/dc/d28/d60 0 2024-09-21T12:47:10.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/314: chown d5/dc/d26/l2e 121 1 2024-09-21T12:47:10.410 INFO:tasks.workunit.client.1.smithi176.stdout:5/886: mkdir d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/dad/d11c 0 2024-09-21T12:47:10.411 INFO:tasks.workunit.client.1.smithi176.stdout:5/887: chown d0/d13/d63/d8d/ca6 265422937 1 2024-09-21T12:47:10.412 INFO:tasks.workunit.client.0.smithi046.stdout:2/342: symlink d16/d22/d2b/d30/d67/l68 0 2024-09-21T12:47:10.413 INFO:tasks.workunit.client.0.smithi046.stdout:5/343: rmdir d4/dc/d13/d15 39 2024-09-21T12:47:10.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/343: write d16/d22/f41 [432454,18731] 0 2024-09-21T12:47:10.416 INFO:tasks.workunit.client.0.smithi046.stdout:8/341: mknod d1/d12/d46/d35/d36/c76 0 2024-09-21T12:47:10.420 INFO:tasks.workunit.client.1.smithi176.stdout:2/953: symlink d4/l127 0 2024-09-21T12:47:10.420 INFO:tasks.workunit.client.1.smithi176.stdout:9/957: symlink d1/df/d23/d67/d105/l142 0 2024-09-21T12:47:10.420 INFO:tasks.workunit.client.0.smithi046.stdout:3/315: dwrite d5/d16/f64 [0,4194304] 0 2024-09-21T12:47:10.421 INFO:tasks.workunit.client.0.smithi046.stdout:8/342: chown d1/d12/d46/d35/d36/c76 1426317988 1 2024-09-21T12:47:10.421 INFO:tasks.workunit.client.1.smithi176.stdout:2/954: write d4/d3d/f109 [23636,59941] 0 2024-09-21T12:47:10.423 INFO:tasks.workunit.client.0.smithi046.stdout:7/302: creat d2/d4/d43/f5d x:0 0 0 2024-09-21T12:47:10.425 INFO:tasks.workunit.client.1.smithi176.stdout:4/939: write d3/d42/d47/f6d [3546621,6171] 0 2024-09-21T12:47:10.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/303: write d2/d4/f2f [437711,105010] 0 2024-09-21T12:47:10.426 INFO:tasks.workunit.client.1.smithi176.stdout:8/912: symlink d6/d16/d79/def/l11e 0 2024-09-21T12:47:10.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/304: dread - d2/dd/f57 zero size 2024-09-21T12:47:10.427 INFO:tasks.workunit.client.1.smithi176.stdout:6/904: dwrite d2/d6f/fbb [0,4194304] 0 2024-09-21T12:47:10.428 INFO:tasks.workunit.client.0.smithi046.stdout:7/305: stat d2/d4/df/d17/d31/d34/f48 0 2024-09-21T12:47:10.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/306: stat d2/d4/c22 0 2024-09-21T12:47:10.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/344: rename d4/dc/d13/f41 to d4/dc/d13/d5b/d2d/d3b/f68 0 2024-09-21T12:47:10.430 INFO:tasks.workunit.client.1.smithi176.stdout:9/958: unlink d1/l1d 0 2024-09-21T12:47:10.432 INFO:tasks.workunit.client.0.smithi046.stdout:5/345: read d4/dc/d13/f50 [1674626,59744] 0 2024-09-21T12:47:10.432 INFO:tasks.workunit.client.0.smithi046.stdout:8/343: symlink d1/d12/d46/l77 0 2024-09-21T12:47:10.433 INFO:tasks.workunit.client.0.smithi046.stdout:7/307: dread d2/d4/df/f1d [0,4194304] 0 2024-09-21T12:47:10.435 INFO:tasks.workunit.client.1.smithi176.stdout:4/940: creat d3/d21/df5/f14a x:0 0 0 2024-09-21T12:47:10.437 INFO:tasks.workunit.client.0.smithi046.stdout:9/436: rename d11/d19/d36/d45/f51 to d11/d19/d1b/d1c/d1f/d30/d3e/f81 0 2024-09-21T12:47:10.437 INFO:tasks.workunit.client.1.smithi176.stdout:8/913: dread d6/d8/d54/dca/fa7 [0,4194304] 0 2024-09-21T12:47:10.438 INFO:tasks.workunit.client.0.smithi046.stdout:7/308: dread d2/dd/f5a [0,4194304] 0 2024-09-21T12:47:10.438 INFO:tasks.workunit.client.1.smithi176.stdout:6/905: mknod d2/dd/d26/d110/c122 0 2024-09-21T12:47:10.441 INFO:tasks.workunit.client.1.smithi176.stdout:8/914: dread d6/db/d13/d98/fb2 [0,4194304] 0 2024-09-21T12:47:10.441 INFO:tasks.workunit.client.1.smithi176.stdout:9/959: symlink d1/df/d48/d69/dc8/l143 0 2024-09-21T12:47:10.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/316: rename d5/dc/d28/f53 to d5/dc/d28/d60/d6e/f74 0 2024-09-21T12:47:10.450 INFO:tasks.workunit.client.0.smithi046.stdout:3/317: fdatasync d5/d16/f64 0 2024-09-21T12:47:10.451 INFO:tasks.workunit.client.1.smithi176.stdout:2/955: rmdir d4/df/d2e/d39/db7/d80/d9e 0 2024-09-21T12:47:10.451 INFO:tasks.workunit.client.1.smithi176.stdout:9/960: unlink d1/df/d48/d69/d38/fc5 0 2024-09-21T12:47:10.452 INFO:tasks.workunit.client.1.smithi176.stdout:4/941: unlink d3/d42/d56/d101/d107/d36/f11b 0 2024-09-21T12:47:10.453 INFO:tasks.workunit.client.1.smithi176.stdout:9/961: dread d1/d61/d73/fb9 [0,4194304] 0 2024-09-21T12:47:10.453 INFO:tasks.workunit.client.0.smithi046.stdout:2/344: dread f15 [0,4194304] 0 2024-09-21T12:47:10.457 INFO:tasks.workunit.client.0.smithi046.stdout:0/398: write d6/d7/d9/fb [444264,8593] 0 2024-09-21T12:47:10.459 INFO:tasks.workunit.client.0.smithi046.stdout:5/346: rename d4/dc/d13/l3e to d4/dc/d13/d15/l69 0 2024-09-21T12:47:10.463 INFO:tasks.workunit.client.0.smithi046.stdout:9/437: mknod d11/d19/d36/c82 0 2024-09-21T12:47:10.464 INFO:tasks.workunit.client.1.smithi176.stdout:2/956: dread d4/f1a [0,4194304] 0 2024-09-21T12:47:10.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/309: mknod d2/d4/d43/d58/c5e 0 2024-09-21T12:47:10.466 INFO:tasks.workunit.client.0.smithi046.stdout:5/347: dwrite d4/dc/d13/d5b/d2d/d43/f55 [0,4194304] 0 2024-09-21T12:47:10.468 INFO:tasks.workunit.client.0.smithi046.stdout:2/345: creat d16/d22/d2b/d30/d67/f69 x:0 0 0 2024-09-21T12:47:10.470 INFO:tasks.workunit.client.1.smithi176.stdout:4/942: dread d3/d42/d4d/f9e [0,4194304] 0 2024-09-21T12:47:10.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/310: dread d2/d4/f1c [0,4194304] 0 2024-09-21T12:47:10.474 INFO:tasks.workunit.client.0.smithi046.stdout:3/318: rename d5/dc/d30/d34/l59 to d5/d5e/l75 0 2024-09-21T12:47:10.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/319: write d5/dc/d26/f4c [21936,118097] 0 2024-09-21T12:47:10.477 INFO:tasks.workunit.client.1.smithi176.stdout:5/888: dwrite d0/d10/f4c [0,4194304] 0 2024-09-21T12:47:10.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/320: chown d5/c14 0 1 2024-09-21T12:47:10.478 INFO:tasks.workunit.client.0.smithi046.stdout:7/311: dwrite d2/fa [0,4194304] 0 2024-09-21T12:47:10.479 INFO:tasks.workunit.client.0.smithi046.stdout:7/312: stat d2/d4/df/d17/d31/f45 0 2024-09-21T12:47:10.480 INFO:tasks.workunit.client.0.smithi046.stdout:8/344: write d1/d12/f3b [486579,28505] 0 2024-09-21T12:47:10.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/348: write d4/d16/f46 [1159986,23282] 0 2024-09-21T12:47:10.489 INFO:tasks.workunit.client.1.smithi176.stdout:6/906: write d2/dd/d26/d110/f60 [1640352,23595] 0 2024-09-21T12:47:10.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/438: dwrite d11/f61 [0,4194304] 0 2024-09-21T12:47:10.492 INFO:tasks.workunit.client.0.smithi046.stdout:7/313: symlink d2/d4/d43/l5f 0 2024-09-21T12:47:10.494 INFO:tasks.workunit.client.1.smithi176.stdout:6/907: dwrite d2/d6f/d7f/f111 [0,4194304] 0 2024-09-21T12:47:10.495 INFO:tasks.workunit.client.0.smithi046.stdout:7/314: dread - d2/d4/f54 zero size 2024-09-21T12:47:10.499 INFO:tasks.workunit.client.0.smithi046.stdout:2/346: symlink d16/d5c/d63/l6a 0 2024-09-21T12:47:10.502 INFO:tasks.workunit.client.1.smithi176.stdout:6/908: dread d2/dd/d79/fab [0,4194304] 0 2024-09-21T12:47:10.503 INFO:tasks.workunit.client.0.smithi046.stdout:0/399: creat d6/d7/f9a x:0 0 0 2024-09-21T12:47:10.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/349: truncate d4/d22/d10/d1a/f37 1065763 0 2024-09-21T12:47:10.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/400: readlink d6/l3a 0 2024-09-21T12:47:10.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/439: dwrite d11/d19/d1b/d31/d53/d58/f62 [0,4194304] 0 2024-09-21T12:47:10.510 INFO:tasks.workunit.client.0.smithi046.stdout:7/315: dwrite d2/dd/f57 [0,4194304] 0 2024-09-21T12:47:10.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/350: unlink d4/dc/d13/d15/l63 0 2024-09-21T12:47:10.520 INFO:tasks.workunit.client.0.smithi046.stdout:0/401: dread d6/f23 [0,4194304] 0 2024-09-21T12:47:10.520 INFO:tasks.workunit.client.0.smithi046.stdout:2/347: dwrite d16/f21 [4194304,4194304] 0 2024-09-21T12:47:10.526 INFO:tasks.workunit.client.0.smithi046.stdout:3/321: dread d5/f8 [0,4194304] 0 2024-09-21T12:47:10.526 INFO:tasks.workunit.client.0.smithi046.stdout:7/316: fsync d2/d4/f1c 0 2024-09-21T12:47:10.531 INFO:tasks.workunit.client.0.smithi046.stdout:9/440: dwrite d11/d19/d1b/d1c/d1f/d30/f5d [0,4194304] 0 2024-09-21T12:47:10.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/351: dwrite d4/d22/d10/d1a/f1c [0,4194304] 0 2024-09-21T12:47:10.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/402: rmdir d6 39 2024-09-21T12:47:10.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/348: creat d16/d5c/d63/f6b x:0 0 0 2024-09-21T12:47:10.538 INFO:tasks.workunit.client.0.smithi046.stdout:3/322: rmdir d5/dc/d30 39 2024-09-21T12:47:10.543 INFO:tasks.workunit.client.0.smithi046.stdout:7/317: symlink d2/d4/df/d17/l60 0 2024-09-21T12:47:10.546 INFO:tasks.workunit.client.0.smithi046.stdout:9/441: unlink d11/f61 0 2024-09-21T12:47:10.552 INFO:tasks.workunit.client.0.smithi046.stdout:2/349: dread d16/d22/f2a [0,4194304] 0 2024-09-21T12:47:10.553 INFO:tasks.workunit.client.0.smithi046.stdout:2/350: readlink d16/l17 0 2024-09-21T12:47:10.560 INFO:tasks.workunit.client.0.smithi046.stdout:5/352: mknod d4/dc/d13/c6a 0 2024-09-21T12:47:10.563 INFO:tasks.workunit.client.1.smithi176.stdout:9/962: symlink d1/d61/d73/db6/l144 0 2024-09-21T12:47:10.565 INFO:tasks.workunit.client.1.smithi176.stdout:2/957: dread - d4/df/d2e/d6f/d5d/d67/d9f/fd4 zero size 2024-09-21T12:47:10.565 INFO:tasks.workunit.client.1.smithi176.stdout:2/958: read d4/f7f [201835,49119] 0 2024-09-21T12:47:10.566 INFO:tasks.workunit.client.0.smithi046.stdout:0/403: fdatasync d6/d7/d9/d6b/f6e 0 2024-09-21T12:47:10.566 INFO:tasks.workunit.client.1.smithi176.stdout:1/963: sync 2024-09-21T12:47:10.568 INFO:tasks.workunit.client.1.smithi176.stdout:4/943: rename d3/d42/d56/d101/d107/d36/f43 to d3/d42/d47/f14b 0 2024-09-21T12:47:10.569 INFO:tasks.workunit.client.0.smithi046.stdout:5/353: rmdir d4/d22 39 2024-09-21T12:47:10.570 INFO:tasks.workunit.client.1.smithi176.stdout:4/944: fdatasync d3/d21/d27/d9b/da2/f138 0 2024-09-21T12:47:10.570 INFO:tasks.workunit.client.1.smithi176.stdout:5/889: symlink d0/d13/d63/d72/d87/d92/l11d 0 2024-09-21T12:47:10.571 INFO:tasks.workunit.client.1.smithi176.stdout:2/959: dwrite d4/df/f21 [0,4194304] 0 2024-09-21T12:47:10.573 INFO:tasks.workunit.client.0.smithi046.stdout:3/323: dread d5/dc/f1d [0,4194304] 0 2024-09-21T12:47:10.573 INFO:tasks.workunit.client.0.smithi046.stdout:3/324: chown d5/l22 67397 1 2024-09-21T12:47:10.575 INFO:tasks.workunit.client.1.smithi176.stdout:9/963: mknod d1/df/d23/d67/dfb/c145 0 2024-09-21T12:47:10.576 INFO:tasks.workunit.client.0.smithi046.stdout:9/442: link d11/d19/d20/l2b d11/d5b/l83 0 2024-09-21T12:47:10.579 INFO:tasks.workunit.client.1.smithi176.stdout:1/964: mknod d0/dec/c15c 0 2024-09-21T12:47:10.580 INFO:tasks.workunit.client.1.smithi176.stdout:5/890: dwrite d0/d13/d63/d8d/d117/f10b [0,4194304] 0 2024-09-21T12:47:10.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/325: dwrite d5/dc/f54 [0,4194304] 0 2024-09-21T12:47:10.581 INFO:tasks.workunit.client.0.smithi046.stdout:0/404: mkdir d6/d7/d13/d72/d9b 0 2024-09-21T12:47:10.581 INFO:tasks.workunit.client.1.smithi176.stdout:6/909: dwrite d2/f64 [0,4194304] 0 2024-09-21T12:47:10.582 INFO:tasks.workunit.client.1.smithi176.stdout:4/945: fdatasync d3/d5/f4a 0 2024-09-21T12:47:10.583 INFO:tasks.workunit.client.1.smithi176.stdout:5/891: chown d0/d13/d63/d8d/d117/d37/d55/fa7 255863 1 2024-09-21T12:47:10.583 INFO:tasks.workunit.client.1.smithi176.stdout:6/910: chown d2/d6f/d81/fb3 393 1 2024-09-21T12:47:10.585 INFO:tasks.workunit.client.1.smithi176.stdout:6/911: write d2/f64 [214686,89262] 0 2024-09-21T12:47:10.585 INFO:tasks.workunit.client.1.smithi176.stdout:2/960: mknod d4/df/d83/c128 0 2024-09-21T12:47:10.586 INFO:tasks.workunit.client.0.smithi046.stdout:7/318: getdents d2/d4/df/d17/d31 0 2024-09-21T12:47:10.588 INFO:tasks.workunit.client.1.smithi176.stdout:6/912: write d2/dd/d26/d2b/d10/d87/f104 [573558,49062] 0 2024-09-21T12:47:10.590 INFO:tasks.workunit.client.1.smithi176.stdout:9/964: creat d1/df/d48/d69/d76/d123/d141/f146 x:0 0 0 2024-09-21T12:47:10.590 INFO:tasks.workunit.client.1.smithi176.stdout:6/913: write d2/dd/d26/d2b/d10/f8e [603203,86929] 0 2024-09-21T12:47:10.593 INFO:tasks.workunit.client.0.smithi046.stdout:9/443: rmdir d11/d19/d1b/d1c/d1f/d30 39 2024-09-21T12:47:10.596 INFO:tasks.workunit.client.0.smithi046.stdout:3/326: symlink d5/dc/d28/d63/l76 0 2024-09-21T12:47:10.598 INFO:tasks.workunit.client.0.smithi046.stdout:3/327: dread d5/f7 [0,4194304] 0 2024-09-21T12:47:10.599 INFO:tasks.workunit.client.0.smithi046.stdout:9/444: dread d11/d19/d36/d45/d6e/f76 [0,4194304] 0 2024-09-21T12:47:10.600 INFO:tasks.workunit.client.1.smithi176.stdout:5/892: mknod d0/d13/c11e 0 2024-09-21T12:47:10.601 INFO:tasks.workunit.client.1.smithi176.stdout:5/893: read - d0/d13/d63/d8d/ddc/ffe zero size 2024-09-21T12:47:10.601 INFO:tasks.workunit.client.0.smithi046.stdout:5/354: mkdir d4/dc/d6b 0 2024-09-21T12:47:10.604 INFO:tasks.workunit.client.0.smithi046.stdout:7/319: creat d2/d4/d43/d58/f61 x:0 0 0 2024-09-21T12:47:10.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/320: fdatasync d2/dd/f57 0 2024-09-21T12:47:10.606 INFO:tasks.workunit.client.0.smithi046.stdout:2/351: getdents d16/d22/d2b/d30 0 2024-09-21T12:47:10.606 INFO:tasks.workunit.client.0.smithi046.stdout:9/445: dwrite d11/d19/d36/f77 [0,4194304] 0 2024-09-21T12:47:10.606 INFO:tasks.workunit.client.1.smithi176.stdout:5/894: dwrite d0/d13/d5d/d98/da5/de1/f107 [0,4194304] 0 2024-09-21T12:47:10.607 INFO:tasks.workunit.client.1.smithi176.stdout:8/915: sync 2024-09-21T12:47:10.611 INFO:tasks.workunit.client.0.smithi046.stdout:3/328: unlink d5/c14 0 2024-09-21T12:47:10.614 INFO:tasks.workunit.client.1.smithi176.stdout:1/965: link d0/d91/d15b/f145 d0/db/d2a/def/f15d 0 2024-09-21T12:47:10.615 INFO:tasks.workunit.client.0.smithi046.stdout:0/405: mknod d6/d7/d13/d43/d52/d8c/c9c 0 2024-09-21T12:47:10.616 INFO:tasks.workunit.client.1.smithi176.stdout:1/966: read - d0/db/d1a/d2c/dc5/d41/d59/f137 zero size 2024-09-21T12:47:10.619 INFO:tasks.workunit.client.0.smithi046.stdout:5/355: rename d4 to d4/dc/d13/d6c 22 2024-09-21T12:47:10.621 INFO:tasks.workunit.client.1.smithi176.stdout:2/961: symlink d4/df/d2e/d115/l129 0 2024-09-21T12:47:10.626 INFO:tasks.workunit.client.0.smithi046.stdout:5/356: dwrite d4/f4a [0,4194304] 0 2024-09-21T12:47:10.626 INFO:tasks.workunit.client.0.smithi046.stdout:7/321: unlink d2/d4/f1c 0 2024-09-21T12:47:10.627 INFO:tasks.workunit.client.1.smithi176.stdout:5/895: fsync d0/d10/f79 0 2024-09-21T12:47:10.628 INFO:tasks.workunit.client.1.smithi176.stdout:5/896: chown d0/d13/d63/d8d/ddc/d41/f77 39 1 2024-09-21T12:47:10.629 INFO:tasks.workunit.client.1.smithi176.stdout:5/897: chown d0/d10/l59 26864 1 2024-09-21T12:47:10.630 INFO:tasks.workunit.client.1.smithi176.stdout:5/898: stat d0/d13/d63/d8d/d117/d37/d55/cf3 0 2024-09-21T12:47:10.631 INFO:tasks.workunit.client.1.smithi176.stdout:5/899: write d0/d13/d63/d8d/ddc/d41/fa3 [1102922,129920] 0 2024-09-21T12:47:10.632 INFO:tasks.workunit.client.1.smithi176.stdout:8/916: readlink d6/db/d13/lcd 0 2024-09-21T12:47:10.633 INFO:tasks.workunit.client.0.smithi046.stdout:2/352: truncate d16/f25 104544 0 2024-09-21T12:47:10.634 INFO:tasks.workunit.client.1.smithi176.stdout:9/965: mknod d1/c147 0 2024-09-21T12:47:10.635 INFO:tasks.workunit.client.1.smithi176.stdout:4/946: write d3/d5/d37/f68 [3885702,21634] 0 2024-09-21T12:47:10.636 INFO:tasks.workunit.client.1.smithi176.stdout:4/947: read d3/d42/f115 [271372,116986] 0 2024-09-21T12:47:10.637 INFO:tasks.workunit.client.1.smithi176.stdout:9/966: chown d1/df/d9a/dbc/f113 27 1 2024-09-21T12:47:10.642 INFO:tasks.workunit.client.0.smithi046.stdout:0/406: creat d6/d7/d9/d54/f9d x:0 0 0 2024-09-21T12:47:10.647 INFO:tasks.workunit.client.0.smithi046.stdout:9/446: dread d11/d19/d1b/d1c/f2f [0,4194304] 0 2024-09-21T12:47:10.651 INFO:tasks.workunit.client.1.smithi176.stdout:6/914: write d2/dd/d26/d2b/d10/d1b/d37/f4b [622453,20812] 0 2024-09-21T12:47:10.652 INFO:tasks.workunit.client.1.smithi176.stdout:6/915: chown d2/dd/d26/d2b/d10d 1019944 1 2024-09-21T12:47:10.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/322: rename d2/dd/f57 to d2/d4/df/d17/f62 0 2024-09-21T12:47:10.655 INFO:tasks.workunit.client.1.smithi176.stdout:4/948: write d3/d42/dae/f145 [837315,103281] 0 2024-09-21T12:47:10.656 INFO:tasks.workunit.client.1.smithi176.stdout:9/967: mknod d1/df/d48/d69/d76/c148 0 2024-09-21T12:47:10.657 INFO:tasks.workunit.client.1.smithi176.stdout:4/949: write d3/d42/d56/d101/d107/d36/fe9 [496275,100951] 0 2024-09-21T12:47:10.657 INFO:tasks.workunit.client.0.smithi046.stdout:0/407: truncate d6/d7/f5b 5192028 0 2024-09-21T12:47:10.659 INFO:tasks.workunit.client.0.smithi046.stdout:3/329: chown d5/dc/d28/c41 619801 1 2024-09-21T12:47:10.661 INFO:tasks.workunit.client.0.smithi046.stdout:9/447: truncate d11/d19/d1b/f25 2454595 0 2024-09-21T12:47:10.662 INFO:tasks.workunit.client.1.smithi176.stdout:6/916: truncate d2/dd/d26/f3d 225698 0 2024-09-21T12:47:10.663 INFO:tasks.workunit.client.0.smithi046.stdout:5/357: symlink d4/dc/d13/d5b/d2d/l6d 0 2024-09-21T12:47:10.664 INFO:tasks.workunit.client.1.smithi176.stdout:4/950: dwrite d3/d42/d56/d4e/f119 [0,4194304] 0 2024-09-21T12:47:10.664 INFO:tasks.workunit.client.1.smithi176.stdout:4/951: chown d3/d21/d5e 38720797 1 2024-09-21T12:47:10.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/323: creat d2/d4/df/d17/f63 x:0 0 0 2024-09-21T12:47:10.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/324: fsync d2/d4/df/d17/f35 0 2024-09-21T12:47:10.667 INFO:tasks.workunit.client.0.smithi046.stdout:7/325: chown d2/d4/df/d17/d31 686811 1 2024-09-21T12:47:10.670 INFO:tasks.workunit.client.1.smithi176.stdout:8/917: creat d6/d16/f11f x:0 0 0 2024-09-21T12:47:10.670 INFO:tasks.workunit.client.1.smithi176.stdout:2/962: write d4/df/f5a [650306,61296] 0 2024-09-21T12:47:10.671 INFO:tasks.workunit.client.0.smithi046.stdout:0/408: creat d6/d2f/f9e x:0 0 0 2024-09-21T12:47:10.672 INFO:tasks.workunit.client.1.smithi176.stdout:1/967: dwrite d0/db/d1a/d2c/d66/fbc [0,4194304] 0 2024-09-21T12:47:10.673 INFO:tasks.workunit.client.1.smithi176.stdout:1/968: chown d0/db/d1a/d2c/d37/cee 480841941 1 2024-09-21T12:47:10.675 INFO:tasks.workunit.client.1.smithi176.stdout:4/952: rmdir d3/d21/d5e 39 2024-09-21T12:47:10.681 INFO:tasks.workunit.client.0.smithi046.stdout:7/326: creat d2/d4/f64 x:0 0 0 2024-09-21T12:47:10.682 INFO:tasks.workunit.client.1.smithi176.stdout:2/963: dread d4/df/d2e/d39/fd3 [0,4194304] 0 2024-09-21T12:47:10.684 INFO:tasks.workunit.client.1.smithi176.stdout:2/964: write d4/df/d2e/d6f/d5d/d81/f117 [504335,94829] 0 2024-09-21T12:47:10.685 INFO:tasks.workunit.client.0.smithi046.stdout:2/353: rename d16/d22/d56 to d16/d22/d6c 0 2024-09-21T12:47:10.686 INFO:tasks.workunit.client.1.smithi176.stdout:5/900: getdents d0/d13/d63/d8d/d117/d37/d55/dfc 0 2024-09-21T12:47:10.686 INFO:tasks.workunit.client.0.smithi046.stdout:2/354: write d16/f48 [2226710,62282] 0 2024-09-21T12:47:10.687 INFO:tasks.workunit.client.1.smithi176.stdout:5/901: read d0/d13/f3c [3184399,95716] 0 2024-09-21T12:47:10.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/355: truncate d16/d22/d38/f4f 1464045 0 2024-09-21T12:47:10.689 INFO:tasks.workunit.client.1.smithi176.stdout:5/902: write d0/d13/d63/d8d/ddc/d41/fcc [1264861,10729] 0 2024-09-21T12:47:10.690 INFO:tasks.workunit.client.1.smithi176.stdout:1/969: unlink d0/db/d1a/d2c/dc5/d2b/f44 0 2024-09-21T12:47:10.695 INFO:tasks.workunit.client.0.smithi046.stdout:7/327: rmdir d2/d37 39 2024-09-21T12:47:10.696 INFO:tasks.workunit.client.1.smithi176.stdout:9/968: dwrite d1/d61/d73/f109 [0,4194304] 0 2024-09-21T12:47:10.697 INFO:tasks.workunit.client.1.smithi176.stdout:5/903: creat d0/d13/d63/d8d/f11f x:0 0 0 2024-09-21T12:47:10.698 INFO:tasks.workunit.client.1.smithi176.stdout:4/953: mkdir d3/d21/d5e/d14c 0 2024-09-21T12:47:10.698 INFO:tasks.workunit.client.1.smithi176.stdout:5/904: chown d0/d13/d63/d8d/ddc/de7/lf4 371753 1 2024-09-21T12:47:10.700 INFO:tasks.workunit.client.1.smithi176.stdout:8/918: dread d6/db/d37/f3a [0,4194304] 0 2024-09-21T12:47:10.701 INFO:tasks.workunit.client.0.smithi046.stdout:2/356: rmdir d16/d22/d2b/d30 39 2024-09-21T12:47:10.702 INFO:tasks.workunit.client.1.smithi176.stdout:2/965: truncate d4/d3d/fdb 720712 0 2024-09-21T12:47:10.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/409: dwrite d6/d7/d13/f4b [0,4194304] 0 2024-09-21T12:47:10.704 INFO:tasks.workunit.client.1.smithi176.stdout:2/966: chown d4/d63/lfc 223 1 2024-09-21T12:47:10.704 INFO:tasks.workunit.client.1.smithi176.stdout:9/969: truncate d1/df/d48/d69/d40/d84/f95 905313 0 2024-09-21T12:47:10.705 INFO:tasks.workunit.client.0.smithi046.stdout:0/410: write d6/d7/d9/ff [2630197,100431] 0 2024-09-21T12:47:10.706 INFO:tasks.workunit.client.1.smithi176.stdout:2/967: write d4/df/d4b/d10b/f10f [777287,62909] 0 2024-09-21T12:47:10.707 INFO:tasks.workunit.client.1.smithi176.stdout:9/970: write d1/df/d9a/d121/f49 [3282969,28136] 0 2024-09-21T12:47:10.709 INFO:tasks.workunit.client.1.smithi176.stdout:5/905: dwrite d0/d13/d63/d8d/ddc/d41/f4f [0,4194304] 0 2024-09-21T12:47:10.711 INFO:tasks.workunit.client.1.smithi176.stdout:9/971: chown d1/df/d48/d69/dc8/f10c 281628664 1 2024-09-21T12:47:10.713 INFO:tasks.workunit.client.1.smithi176.stdout:4/954: mknod d3/d42/d56/d101/d107/d96/c14d 0 2024-09-21T12:47:10.714 INFO:tasks.workunit.client.1.smithi176.stdout:5/906: write d0/d13/d63/d8d/d117/d71/f119 [575892,16570] 0 2024-09-21T12:47:10.714 INFO:tasks.workunit.client.1.smithi176.stdout:9/972: fdatasync d1/d61/d73/d7d/fcb 0 2024-09-21T12:47:10.716 INFO:tasks.workunit.client.1.smithi176.stdout:5/907: write d0/d13/d5d/d98/da5/de1/d10f/ff6 [956144,25885] 0 2024-09-21T12:47:10.726 INFO:tasks.workunit.client.1.smithi176.stdout:1/970: dread d0/db/d1a/d2c/d37/fbd [0,4194304] 0 2024-09-21T12:47:10.727 INFO:tasks.workunit.client.1.smithi176.stdout:1/971: chown d0/d91/d15b/f145 0 1 2024-09-21T12:47:10.732 INFO:tasks.workunit.client.1.smithi176.stdout:2/968: dread d4/df/d2e/f7a [0,4194304] 0 2024-09-21T12:47:10.733 INFO:tasks.workunit.client.1.smithi176.stdout:2/969: chown d4/df/d2e/d39/db7/d80/fce 0 1 2024-09-21T12:47:10.733 INFO:tasks.workunit.client.1.smithi176.stdout:2/970: chown d4/df/d2e/d4d/fe3 1 1 2024-09-21T12:47:10.734 INFO:tasks.workunit.client.0.smithi046.stdout:1/318: sync 2024-09-21T12:47:10.739 INFO:tasks.workunit.client.1.smithi176.stdout:4/955: creat d3/d42/d47/d5c/dec/f14e x:0 0 0 2024-09-21T12:47:10.742 INFO:tasks.workunit.client.0.smithi046.stdout:9/448: dwrite d11/d19/d1b/f25 [0,4194304] 0 2024-09-21T12:47:10.744 INFO:tasks.workunit.client.1.smithi176.stdout:2/971: rename d4/df/d2e/d4d/l84 to d4/df/d2e/d115/l12a 0 2024-09-21T12:47:10.744 INFO:tasks.workunit.client.0.smithi046.stdout:3/330: getdents d5/dc/d26/d3c/d44 0 2024-09-21T12:47:10.745 INFO:tasks.workunit.client.0.smithi046.stdout:5/358: link d4/d22/lb d4/dc/d45/l6e 0 2024-09-21T12:47:10.746 INFO:tasks.workunit.client.0.smithi046.stdout:9/449: dread - d11/d19/d36/d45/d64/f7f zero size 2024-09-21T12:47:10.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/359: chown d4/dc/d6b 3410995 1 2024-09-21T12:47:10.748 INFO:tasks.workunit.client.1.smithi176.stdout:2/972: read d4/df/d2e/d6f/d5d/d67/f97 [1404393,47719] 0 2024-09-21T12:47:10.749 INFO:tasks.workunit.client.0.smithi046.stdout:1/319: creat d4/d13/d38/d48/f72 x:0 0 0 2024-09-21T12:47:10.750 INFO:tasks.workunit.client.1.smithi176.stdout:9/973: mkdir d1/d149 0 2024-09-21T12:47:10.752 INFO:tasks.workunit.client.1.smithi176.stdout:9/974: read d1/df/fef [4540258,105022] 0 2024-09-21T12:47:10.756 INFO:tasks.workunit.client.0.smithi046.stdout:3/331: dwrite d5/dc/f68 [0,4194304] 0 2024-09-21T12:47:10.757 INFO:tasks.workunit.client.1.smithi176.stdout:2/973: dwrite d4/df/fc1 [0,4194304] 0 2024-09-21T12:47:10.758 INFO:tasks.workunit.client.0.smithi046.stdout:1/320: creat d4/d4d/f73 x:0 0 0 2024-09-21T12:47:10.759 INFO:tasks.workunit.client.0.smithi046.stdout:2/357: write d16/f1d [2780048,107929] 0 2024-09-21T12:47:10.759 INFO:tasks.workunit.client.0.smithi046.stdout:1/321: stat d4/d13 0 2024-09-21T12:47:10.761 INFO:tasks.workunit.client.0.smithi046.stdout:9/450: mkdir d11/d19/d1b/d31/d53/d84 0 2024-09-21T12:47:10.761 INFO:tasks.workunit.client.0.smithi046.stdout:7/328: dwrite d2/d4/df/d17/d31/d34/f48 [0,4194304] 0 2024-09-21T12:47:10.763 INFO:tasks.workunit.client.0.smithi046.stdout:1/322: write d4/d13/d38/f42 [4090758,52022] 0 2024-09-21T12:47:10.764 INFO:tasks.workunit.client.0.smithi046.stdout:7/329: fsync d2/d4/df/d17/f39 0 2024-09-21T12:47:10.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/323: chown d4/d13/d38/d53/f66 722242872 1 2024-09-21T12:47:10.767 INFO:tasks.workunit.client.1.smithi176.stdout:4/956: getdents d3/d149 0 2024-09-21T12:47:10.767 INFO:tasks.workunit.client.1.smithi176.stdout:2/974: dread d4/df/d2e/fdc [0,4194304] 0 2024-09-21T12:47:10.768 INFO:tasks.workunit.client.1.smithi176.stdout:1/972: write d0/db/d1a/d2c/dc5/fb6 [34992,81344] 0 2024-09-21T12:47:10.770 INFO:tasks.workunit.client.0.smithi046.stdout:3/332: dread - d5/f6f zero size 2024-09-21T12:47:10.772 INFO:tasks.workunit.client.1.smithi176.stdout:4/957: readlink d3/d42/d56/d101/d107/d36/lc0 0 2024-09-21T12:47:10.773 INFO:tasks.workunit.client.0.smithi046.stdout:2/358: creat d16/d22/d2b/d43/f6d x:0 0 0 2024-09-21T12:47:10.777 INFO:tasks.workunit.client.0.smithi046.stdout:9/451: rename d11/d19/d1b/d31/d53/d5e/l75 to d11/d19/d1b/d31/d53/l85 0 2024-09-21T12:47:10.778 INFO:tasks.workunit.client.1.smithi176.stdout:2/975: dread - d4/df/d2e/d39/db7/fde zero size 2024-09-21T12:47:10.778 INFO:tasks.workunit.client.1.smithi176.stdout:5/908: dwrite d0/d13/d63/d8d/d117/d37/db5/db7/f6b [0,4194304] 0 2024-09-21T12:47:10.779 INFO:tasks.workunit.client.0.smithi046.stdout:7/330: mknod d2/d4/d43/d58/c65 0 2024-09-21T12:47:10.780 INFO:tasks.workunit.client.1.smithi176.stdout:5/909: write d0/d13/d5d/fe5 [946686,83762] 0 2024-09-21T12:47:10.780 INFO:tasks.workunit.client.1.smithi176.stdout:2/976: chown d4/df/d2e/d6f/d5d/d67 47 1 2024-09-21T12:47:10.781 INFO:tasks.workunit.client.0.smithi046.stdout:1/324: rmdir d4/d13 39 2024-09-21T12:47:10.781 INFO:tasks.workunit.client.1.smithi176.stdout:1/973: symlink d0/d13f/l15e 0 2024-09-21T12:47:10.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/360: write d4/dc/d13/d5b/d2d/d43/f55 [4219607,81507] 0 2024-09-21T12:47:10.783 INFO:tasks.workunit.client.1.smithi176.stdout:4/958: dwrite d3/f3c [0,4194304] 0 2024-09-21T12:47:10.785 INFO:tasks.workunit.client.1.smithi176.stdout:5/910: fdatasync d0/d13/d63/d8d/f11f 0 2024-09-21T12:47:10.785 INFO:tasks.workunit.client.0.smithi046.stdout:5/361: write d4/dc/d13/d5e/f66 [1028602,53725] 0 2024-09-21T12:47:10.787 INFO:tasks.workunit.client.1.smithi176.stdout:5/911: chown d0/d13/d63/d72/d87/d92/l11d 16522817 1 2024-09-21T12:47:10.788 INFO:tasks.workunit.client.0.smithi046.stdout:9/452: unlink d11/d19/d20/f73 0 2024-09-21T12:47:10.792 INFO:tasks.workunit.client.0.smithi046.stdout:0/411: dread d6/d7/f45 [0,4194304] 0 2024-09-21T12:47:10.793 INFO:tasks.workunit.client.0.smithi046.stdout:3/333: symlink d5/dc/d30/d34/l77 0 2024-09-21T12:47:10.793 INFO:tasks.workunit.client.1.smithi176.stdout:1/974: mknod d0/db/d1a/d2c/dc5/d41/d59/d119/c15f 0 2024-09-21T12:47:10.794 INFO:tasks.workunit.client.0.smithi046.stdout:0/412: readlink d6/l5d 0 2024-09-21T12:47:10.795 INFO:tasks.workunit.client.1.smithi176.stdout:4/959: mknod d3/d42/d56/d101/d125/c14f 0 2024-09-21T12:47:10.796 INFO:tasks.workunit.client.1.smithi176.stdout:4/960: stat d3/d21/c78 0 2024-09-21T12:47:10.796 INFO:tasks.workunit.client.1.smithi176.stdout:4/961: chown d3/d21/d5e/fce 153994 1 2024-09-21T12:47:10.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/325: write d4/d13/d38/d53/d5a/d5d/f60 [893918,37232] 0 2024-09-21T12:47:10.798 INFO:tasks.workunit.client.0.smithi046.stdout:2/359: dwrite d16/d22/d2b/d30/f58 [0,4194304] 0 2024-09-21T12:47:10.798 INFO:tasks.workunit.client.1.smithi176.stdout:2/977: truncate d4/df/d2e/d6f/f2c 1096618 0 2024-09-21T12:47:10.799 INFO:tasks.workunit.client.1.smithi176.stdout:2/978: readlink d4/df/ddf/l10e 0 2024-09-21T12:47:10.800 INFO:tasks.workunit.client.1.smithi176.stdout:2/979: chown d4/df/d2e/d6f/d5d/d81/l105 1 1 2024-09-21T12:47:10.801 INFO:tasks.workunit.client.1.smithi176.stdout:2/980: write d4/df/f21 [1198687,59564] 0 2024-09-21T12:47:10.805 INFO:tasks.workunit.client.0.smithi046.stdout:7/331: dwrite d2/d4/df/d17/d31/d34/f38 [0,4194304] 0 2024-09-21T12:47:10.812 INFO:tasks.workunit.client.1.smithi176.stdout:9/975: link d1/df/dc3/fe7 d1/df/f14a 0 2024-09-21T12:47:10.813 INFO:tasks.workunit.client.0.smithi046.stdout:9/453: mknod d11/d19/d1b/d1c/d1f/d74/c86 0 2024-09-21T12:47:10.815 INFO:tasks.workunit.client.0.smithi046.stdout:1/326: creat d4/d13/d38/d53/d5a/d5d/f74 x:0 0 0 2024-09-21T12:47:10.819 INFO:tasks.workunit.client.0.smithi046.stdout:7/332: symlink d2/d4/df/d17/d31/l66 0 2024-09-21T12:47:10.821 INFO:tasks.workunit.client.1.smithi176.stdout:6/917: sync 2024-09-21T12:47:10.821 INFO:tasks.workunit.client.1.smithi176.stdout:8/919: sync 2024-09-21T12:47:10.822 INFO:tasks.workunit.client.1.smithi176.stdout:8/920: dread - d6/d8/d24/d35/d51/fc9 zero size 2024-09-21T12:47:10.823 INFO:tasks.workunit.client.1.smithi176.stdout:9/976: write d1/df/d48/d69/d40/fec [11,70275] 0 2024-09-21T12:47:10.824 INFO:tasks.workunit.client.1.smithi176.stdout:8/921: stat d6/d16/d36/d67/f8e 0 2024-09-21T12:47:10.825 INFO:tasks.workunit.client.1.smithi176.stdout:2/981: dread d4/d63/f94 [0,4194304] 0 2024-09-21T12:47:10.825 INFO:tasks.workunit.client.1.smithi176.stdout:9/977: write d1/df/d48/d69/d40/fec [262696,53712] 0 2024-09-21T12:47:10.825 INFO:tasks.workunit.client.1.smithi176.stdout:1/975: creat d0/db/d1a/d2c/dc5/d41/d59/d99/f160 x:0 0 0 2024-09-21T12:47:10.828 INFO:tasks.workunit.client.1.smithi176.stdout:5/912: getdents d0/d13/d5d 0 2024-09-21T12:47:10.828 INFO:tasks.workunit.client.1.smithi176.stdout:2/982: write d4/df/d2e/d6f/d5d/d67/f97 [566912,38430] 0 2024-09-21T12:47:10.829 INFO:tasks.workunit.client.0.smithi046.stdout:0/413: write d6/f3c [2252501,30090] 0 2024-09-21T12:47:10.831 INFO:tasks.workunit.client.1.smithi176.stdout:4/962: creat d3/d42/d56/d101/d107/d96/f150 x:0 0 0 2024-09-21T12:47:10.831 INFO:tasks.workunit.client.1.smithi176.stdout:2/983: chown d4/df/d2e/d6f/d5d/d81/db2/da5/dcc 59705 1 2024-09-21T12:47:10.831 INFO:tasks.workunit.client.0.smithi046.stdout:0/414: write d6/d2f/d32/f65 [2053281,24131] 0 2024-09-21T12:47:10.831 INFO:tasks.workunit.client.1.smithi176.stdout:8/922: dwrite d6/f5b [4194304,4194304] 0 2024-09-21T12:47:10.832 INFO:tasks.workunit.client.1.smithi176.stdout:2/984: fsync d4/df/d2e/d6f/d6d/fe2 0 2024-09-21T12:47:10.832 INFO:tasks.workunit.client.0.smithi046.stdout:9/454: creat d11/d19/d1b/d1c/d1f/d30/d3e/f87 x:0 0 0 2024-09-21T12:47:10.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/362: write d4/d22/d10/d1a/f37 [1570769,97399] 0 2024-09-21T12:47:10.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/360: rename d16/d22/d2b/d30/f4b to d16/d22/d2b/f6e 0 2024-09-21T12:47:10.837 INFO:tasks.workunit.client.1.smithi176.stdout:6/918: truncate d2/dd/d26/f95 525667 0 2024-09-21T12:47:10.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/333: symlink d2/d37/l67 0 2024-09-21T12:47:10.838 INFO:tasks.workunit.client.0.smithi046.stdout:1/327: dread d4/d13/f16 [0,4194304] 0 2024-09-21T12:47:10.839 INFO:tasks.workunit.client.0.smithi046.stdout:7/334: chown d2/d37/f4d 1103105 1 2024-09-21T12:47:10.839 INFO:tasks.workunit.client.0.smithi046.stdout:1/328: stat d4/d29/d32/f3f 0 2024-09-21T12:47:10.841 INFO:tasks.workunit.client.0.smithi046.stdout:1/329: readlink d4/d13/l2b 0 2024-09-21T12:47:10.841 INFO:tasks.workunit.client.0.smithi046.stdout:5/363: mknod d4/dc/d13/d5b/d2d/d3b/c6f 0 2024-09-21T12:47:10.843 INFO:tasks.workunit.client.0.smithi046.stdout:9/455: symlink d11/d19/d1b/d1c/d1f/d74/l88 0 2024-09-21T12:47:10.843 INFO:tasks.workunit.client.0.smithi046.stdout:5/364: write d4/d22/d10/f62 [440077,35576] 0 2024-09-21T12:47:10.845 INFO:tasks.workunit.client.0.smithi046.stdout:0/415: rename d6/d7/f12 to d6/d7/d13/d49/f9f 0 2024-09-21T12:47:10.846 INFO:tasks.workunit.client.1.smithi176.stdout:5/913: write d0/d13/d63/d8d/ddc/d109/f112 [401916,100602] 0 2024-09-21T12:47:10.846 INFO:tasks.workunit.client.0.smithi046.stdout:7/335: creat d2/d4/df/d17/d31/d34/f68 x:0 0 0 2024-09-21T12:47:10.848 INFO:tasks.workunit.client.1.smithi176.stdout:4/963: creat d3/d21/d88/f151 x:0 0 0 2024-09-21T12:47:10.849 INFO:tasks.workunit.client.0.smithi046.stdout:1/330: truncate d4/d29/d32/f46 90133 0 2024-09-21T12:47:10.852 INFO:tasks.workunit.client.1.smithi176.stdout:5/914: dwrite d0/f27 [8388608,4194304] 0 2024-09-21T12:47:10.854 INFO:tasks.workunit.client.0.smithi046.stdout:5/365: rename d4/d22/d10/d1a/f29 to d4/dc/d13/d15/d54/f70 0 2024-09-21T12:47:10.854 INFO:tasks.workunit.client.1.smithi176.stdout:5/915: dread - d0/d13/d63/d8d/d117/dda/fe2 zero size 2024-09-21T12:47:10.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/456: dwrite f10 [0,4194304] 0 2024-09-21T12:47:10.856 INFO:tasks.workunit.client.1.smithi176.stdout:8/923: dwrite d6/d16/d9c/fbf [0,4194304] 0 2024-09-21T12:47:10.858 INFO:tasks.workunit.client.0.smithi046.stdout:0/416: symlink d6/d7/d13/d43/d52/d63/d7f/d78/d8a/la0 0 2024-09-21T12:47:10.859 INFO:tasks.workunit.client.0.smithi046.stdout:0/417: readlink d6/d7/d13/d43/d52/d63/d7f/l2e 0 2024-09-21T12:47:10.862 INFO:tasks.workunit.client.0.smithi046.stdout:7/336: fsync d2/d4/df/d17/f62 0 2024-09-21T12:47:10.866 INFO:tasks.workunit.client.1.smithi176.stdout:9/978: symlink d1/df/d48/l14b 0 2024-09-21T12:47:10.868 INFO:tasks.workunit.client.0.smithi046.stdout:5/366: rename d4/d22/c21 to d4/d16/c71 0 2024-09-21T12:47:10.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/367: stat d4/d22/d10/d1a/f1c 0 2024-09-21T12:47:10.876 INFO:tasks.workunit.client.1.smithi176.stdout:5/916: mkdir d0/d13/d5d/d98/d120 0 2024-09-21T12:47:10.876 INFO:tasks.workunit.client.0.smithi046.stdout:7/337: rename d2/d37/l3e to d2/d4/d43/d58/l69 0 2024-09-21T12:47:10.877 INFO:tasks.workunit.client.0.smithi046.stdout:0/418: symlink d6/d7/d13/d43/d52/d63/d7f/la1 0 2024-09-21T12:47:10.878 INFO:tasks.workunit.client.0.smithi046.stdout:1/331: link d4/d13/c52 d4/d29/d32/c75 0 2024-09-21T12:47:10.878 INFO:tasks.workunit.client.1.smithi176.stdout:1/976: dwrite d0/db/d1a/d2c/d84/f112 [0,4194304] 0 2024-09-21T12:47:10.879 INFO:tasks.workunit.client.0.smithi046.stdout:9/457: creat d11/d19/f89 x:0 0 0 2024-09-21T12:47:10.880 INFO:tasks.workunit.client.1.smithi176.stdout:4/964: mkdir d3/d42/d47/d5c/dec/d140/d152 0 2024-09-21T12:47:10.881 INFO:tasks.workunit.client.0.smithi046.stdout:0/419: chown d6/d7/d9/l85 21556 1 2024-09-21T12:47:10.882 INFO:tasks.workunit.client.1.smithi176.stdout:8/924: symlink d6/l120 0 2024-09-21T12:47:10.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/368: rename d4/dc/f39 to d4/dc/d13/d5b/d2d/d3b/f72 0 2024-09-21T12:47:10.886 INFO:tasks.workunit.client.1.smithi176.stdout:5/917: creat d0/d13/d63/d8d/ddc/dd5/f121 x:0 0 0 2024-09-21T12:47:10.887 INFO:tasks.workunit.client.0.smithi046.stdout:1/332: creat d4/d13/d6b/f76 x:0 0 0 2024-09-21T12:47:10.889 INFO:tasks.workunit.client.1.smithi176.stdout:8/925: dwrite d6/de7/ff9 [0,4194304] 0 2024-09-21T12:47:10.890 INFO:tasks.workunit.client.1.smithi176.stdout:2/985: write d4/fb0 [3979286,3284] 0 2024-09-21T12:47:10.893 INFO:tasks.workunit.client.1.smithi176.stdout:1/977: truncate d0/db/d1a/d2c/dc5/d41/d59/d9b/fa9 548234 0 2024-09-21T12:47:10.899 INFO:tasks.workunit.client.1.smithi176.stdout:5/918: symlink d0/l122 0 2024-09-21T12:47:10.901 INFO:tasks.workunit.client.1.smithi176.stdout:6/919: getdents d2 0 2024-09-21T12:47:10.903 INFO:tasks.workunit.client.0.smithi046.stdout:7/338: rename d2/dd/l15 to d2/l6a 0 2024-09-21T12:47:10.904 INFO:tasks.workunit.client.0.smithi046.stdout:7/339: chown d2/d4/df/f1d 1 1 2024-09-21T12:47:10.904 INFO:tasks.workunit.client.1.smithi176.stdout:8/926: mknod d6/d8/d24/c121 0 2024-09-21T12:47:10.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/369: creat d4/d22/f73 x:0 0 0 2024-09-21T12:47:10.907 INFO:tasks.workunit.client.0.smithi046.stdout:5/370: fdatasync d4/d22/d10/d1a/f1c 0 2024-09-21T12:47:10.907 INFO:tasks.workunit.client.1.smithi176.stdout:2/986: rmdir d4/df/d2e/d39/db7/d80/dda 39 2024-09-21T12:47:10.908 INFO:tasks.workunit.client.1.smithi176.stdout:2/987: write d4/d3d/d65/ff1 [4310040,18171] 0 2024-09-21T12:47:10.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/333: creat d4/f77 x:0 0 0 2024-09-21T12:47:10.910 INFO:tasks.workunit.client.1.smithi176.stdout:1/978: rmdir d0/db/d1a/d2c 39 2024-09-21T12:47:10.911 INFO:tasks.workunit.client.1.smithi176.stdout:9/979: truncate d1/df/d48/d69/d4d/f96 1066108 0 2024-09-21T12:47:10.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/458: rename d11/d19/d20/d26/f39 to d11/d5b/d6f/f8a 0 2024-09-21T12:47:10.913 INFO:tasks.workunit.client.0.smithi046.stdout:5/371: dwrite d4/d22/d10/f62 [0,4194304] 0 2024-09-21T12:47:10.914 INFO:tasks.workunit.client.1.smithi176.stdout:4/965: creat d3/d42/d47/d5c/dec/d140/d152/f153 x:0 0 0 2024-09-21T12:47:10.915 INFO:tasks.workunit.client.1.smithi176.stdout:4/966: truncate d3/d42/d56/d101/d125/f143 800820 0 2024-09-21T12:47:10.915 INFO:tasks.workunit.client.0.smithi046.stdout:7/340: symlink d2/d4/df/d42/l6b 0 2024-09-21T12:47:10.916 INFO:tasks.workunit.client.0.smithi046.stdout:5/372: write d4/dc/d13/d5e/f66 [1316398,105118] 0 2024-09-21T12:47:10.916 INFO:tasks.workunit.client.1.smithi176.stdout:5/919: truncate d0/d13/d63/d72/fde 1367800 0 2024-09-21T12:47:10.917 INFO:tasks.workunit.client.0.smithi046.stdout:7/341: dread - d2/d37/f4d zero size 2024-09-21T12:47:10.919 INFO:tasks.workunit.client.1.smithi176.stdout:8/927: mknod d6/d16/d36/d67/c122 0 2024-09-21T12:47:10.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/342: dread d2/dd/f3f [0,4194304] 0 2024-09-21T12:47:10.921 INFO:tasks.workunit.client.0.smithi046.stdout:1/334: write d4/fe [4267756,127055] 0 2024-09-21T12:47:10.921 INFO:tasks.workunit.client.1.smithi176.stdout:2/988: mknod d4/d3d/d65/d9b/c12b 0 2024-09-21T12:47:10.922 INFO:tasks.workunit.client.0.smithi046.stdout:7/343: dread d2/d4/df/d17/f56 [0,4194304] 0 2024-09-21T12:47:10.923 INFO:tasks.workunit.client.0.smithi046.stdout:0/420: rename d6/d2f/d32/d7a to d6/d7/d13/d7b/da2 0 2024-09-21T12:47:10.923 INFO:tasks.workunit.client.1.smithi176.stdout:1/979: rmdir d0/d91 39 2024-09-21T12:47:10.924 INFO:tasks.workunit.client.1.smithi176.stdout:9/980: rmdir d1/d61/d73/d7d 39 2024-09-21T12:47:10.925 INFO:tasks.workunit.client.1.smithi176.stdout:9/981: write d1/d63/ff6 [920140,130871] 0 2024-09-21T12:47:10.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/344: dread d2/d4/df/d17/d31/f45 [0,4194304] 0 2024-09-21T12:47:10.928 INFO:tasks.workunit.client.0.smithi046.stdout:5/373: dread d4/dc/d13/d5e/f66 [0,4194304] 0 2024-09-21T12:47:10.929 INFO:tasks.workunit.client.1.smithi176.stdout:5/920: mknod d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/c123 0 2024-09-21T12:47:10.931 INFO:tasks.workunit.client.1.smithi176.stdout:9/982: dwrite d1/df/d23/f59 [0,4194304] 0 2024-09-21T12:47:10.933 INFO:tasks.workunit.client.1.smithi176.stdout:8/928: mknod d6/db/d37/d7a/c123 0 2024-09-21T12:47:10.935 INFO:tasks.workunit.client.1.smithi176.stdout:2/989: rename d4/d40 to d4/df/d2e/d6f/d5d/d81/db2/d12c 0 2024-09-21T12:47:10.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/335: symlink d4/d13/d38/d4f/l78 0 2024-09-21T12:47:10.938 INFO:tasks.workunit.client.1.smithi176.stdout:9/983: dwrite d1/df/d48/d69/d4d/f107 [0,4194304] 0 2024-09-21T12:47:10.942 INFO:tasks.workunit.client.0.smithi046.stdout:9/459: rename d11/d19/d1b/d31/d44/d59 to d11/d19/d1b/d1c/d1f/d30/d3e/d8b 0 2024-09-21T12:47:10.946 INFO:tasks.workunit.client.1.smithi176.stdout:4/967: symlink d3/d42/d56/d101/d107/d96/l154 0 2024-09-21T12:47:10.949 INFO:tasks.workunit.client.0.smithi046.stdout:0/421: unlink d6/d7/d13/f76 0 2024-09-21T12:47:10.950 INFO:tasks.workunit.client.1.smithi176.stdout:6/920: creat d2/dd/d26/d2b/d10/d1b/f123 x:0 0 0 2024-09-21T12:47:10.951 INFO:tasks.workunit.client.0.smithi046.stdout:5/374: unlink d4/dc/d13/d15/f57 0 2024-09-21T12:47:10.952 INFO:tasks.workunit.client.1.smithi176.stdout:5/921: write d0/d13/d63/d8d/d117/d37/d55/f83 [2060239,46097] 0 2024-09-21T12:47:10.953 INFO:tasks.workunit.client.1.smithi176.stdout:5/922: chown d0/d13/d63/d8d/d117/d71/f95 8013091 1 2024-09-21T12:47:10.954 INFO:tasks.workunit.client.1.smithi176.stdout:5/923: write d0/d13/d63/d8d/f11f [365635,104400] 0 2024-09-21T12:47:10.954 INFO:tasks.workunit.client.1.smithi176.stdout:4/968: dread d3/d42/d56/d101/d107/fc4 [0,4194304] 0 2024-09-21T12:47:10.956 INFO:tasks.workunit.client.1.smithi176.stdout:8/929: rmdir d6/de7 39 2024-09-21T12:47:10.959 INFO:tasks.workunit.client.1.smithi176.stdout:2/990: creat d4/df/d2e/d6f/d5d/d67/f12d x:0 0 0 2024-09-21T12:47:10.960 INFO:tasks.workunit.client.0.smithi046.stdout:9/460: unlink d11/d19/d1b/d1c/d1f/l6d 0 2024-09-21T12:47:10.965 INFO:tasks.workunit.client.1.smithi176.stdout:2/991: dwrite d4/df/d2e/d39/db7/d80/fce [0,4194304] 0 2024-09-21T12:47:10.968 INFO:tasks.workunit.client.1.smithi176.stdout:5/924: symlink d0/l124 0 2024-09-21T12:47:10.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/336: dwrite d4/d13/f36 [0,4194304] 0 2024-09-21T12:47:10.980 INFO:tasks.workunit.client.1.smithi176.stdout:4/969: write d3/d21/d27/d2c/f41 [901965,35414] 0 2024-09-21T12:47:10.981 INFO:tasks.workunit.client.1.smithi176.stdout:6/921: creat d2/d63/de7/f124 x:0 0 0 2024-09-21T12:47:10.982 INFO:tasks.workunit.client.1.smithi176.stdout:2/992: symlink d4/df/d2e/d4d/d70/l12e 0 2024-09-21T12:47:10.983 INFO:tasks.workunit.client.1.smithi176.stdout:6/922: read d2/dd/d26/d2b/d10/d1b/d37/f4b [1510174,8188] 0 2024-09-21T12:47:10.989 INFO:tasks.workunit.client.0.smithi046.stdout:0/422: fsync d6/d7/d13/d43/d52/d63/d7f/f5f 0 2024-09-21T12:47:10.990 INFO:tasks.workunit.client.1.smithi176.stdout:1/980: link d0/db/d1a/d2c/d6b/dd7/c12e d0/d91/dd3/df5/d153/c161 0 2024-09-21T12:47:10.991 INFO:tasks.workunit.client.1.smithi176.stdout:9/984: getdents d1/df/d23/dcf 0 2024-09-21T12:47:10.992 INFO:tasks.workunit.client.1.smithi176.stdout:4/970: mkdir d3/d5/d155 0 2024-09-21T12:47:10.993 INFO:tasks.workunit.client.0.smithi046.stdout:9/461: mkdir d11/d69/d8c 0 2024-09-21T12:47:10.993 INFO:tasks.workunit.client.1.smithi176.stdout:4/971: truncate d3/d5/d37/f12e 63343 0 2024-09-21T12:47:11.001 INFO:tasks.workunit.client.1.smithi176.stdout:1/981: mkdir d0/db/d1a/d73/d162 0 2024-09-21T12:47:11.004 INFO:tasks.workunit.client.1.smithi176.stdout:9/985: creat d1/df/d9a/d127/f14c x:0 0 0 2024-09-21T12:47:11.008 INFO:tasks.workunit.client.1.smithi176.stdout:4/972: rename d3/d42/d47/d5c/dec/d140/d152 to d3/d42/d56/d4e/df8/d156 0 2024-09-21T12:47:11.009 INFO:tasks.workunit.client.0.smithi046.stdout:0/423: creat d6/d7/d13/d72/d9b/fa3 x:0 0 0 2024-09-21T12:47:11.011 INFO:tasks.workunit.client.0.smithi046.stdout:5/375: link d4/dc/d13/d5b/l47 d4/dc/d13/d15/d54/d5d/l74 0 2024-09-21T12:47:11.012 INFO:tasks.workunit.client.1.smithi176.stdout:6/923: creat d2/d63/f125 x:0 0 0 2024-09-21T12:47:11.014 INFO:tasks.workunit.client.1.smithi176.stdout:1/982: mknod d0/db/d6f/de1/c163 0 2024-09-21T12:47:11.016 INFO:tasks.workunit.client.1.smithi176.stdout:9/986: mknod d1/df/d23/dcf/c14d 0 2024-09-21T12:47:11.018 INFO:tasks.workunit.client.1.smithi176.stdout:2/993: link d4/df/d2e/d39/ccf d4/df/d83/d8e/c12f 0 2024-09-21T12:47:11.019 INFO:tasks.workunit.client.1.smithi176.stdout:2/994: write d4/df/d4b/d10b/f10f [1374162,3047] 0 2024-09-21T12:47:11.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/424: truncate d6/d7/f5b 4368666 0 2024-09-21T12:47:11.024 INFO:tasks.workunit.client.0.smithi046.stdout:0/425: mkdir d6/d4f/da4 0 2024-09-21T12:47:11.028 INFO:tasks.workunit.client.0.smithi046.stdout:5/376: dread d4/dc/d13/f35 [0,4194304] 0 2024-09-21T12:47:11.031 INFO:tasks.workunit.client.0.smithi046.stdout:9/462: dwrite d11/d5b/d6f/f8a [0,4194304] 0 2024-09-21T12:47:11.031 INFO:tasks.workunit.client.1.smithi176.stdout:1/983: link d0/d91/dd3/f101 d0/db/d6f/de1/f164 0 2024-09-21T12:47:11.035 INFO:tasks.workunit.client.1.smithi176.stdout:9/987: creat d1/df/dea/dfa/f14e x:0 0 0 2024-09-21T12:47:11.038 INFO:tasks.workunit.client.0.smithi046.stdout:5/377: dwrite d4/f4a [0,4194304] 0 2024-09-21T12:47:11.039 INFO:tasks.workunit.client.1.smithi176.stdout:4/973: creat d3/d21/d27/d2c/f157 x:0 0 0 2024-09-21T12:47:11.039 INFO:tasks.workunit.client.0.smithi046.stdout:0/426: write d6/d7/d37/f3e [888832,125068] 0 2024-09-21T12:47:11.041 INFO:tasks.workunit.client.0.smithi046.stdout:9/463: creat d11/d19/d1b/d4b/f8d x:0 0 0 2024-09-21T12:47:11.041 INFO:tasks.workunit.client.0.smithi046.stdout:0/427: rename d6 to d6/d7/d9/d6b/da5 22 2024-09-21T12:47:11.043 INFO:tasks.workunit.client.1.smithi176.stdout:6/924: link d2/dd/cc2 d2/dd/d26/d2b/d10/d11c/c126 0 2024-09-21T12:47:11.043 INFO:tasks.workunit.client.1.smithi176.stdout:1/984: truncate d0/db/d6a/f100 448557 0 2024-09-21T12:47:11.045 INFO:tasks.workunit.client.0.smithi046.stdout:0/428: dread - d6/d7/d13/d72/d9b/fa3 zero size 2024-09-21T12:47:11.046 INFO:tasks.workunit.client.1.smithi176.stdout:2/995: dwrite d4/df/d2e/d6f/d5d/d67/fd8 [0,4194304] 0 2024-09-21T12:47:11.047 INFO:tasks.workunit.client.0.smithi046.stdout:0/429: chown d6/d7/fa 642993682 1 2024-09-21T12:47:11.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/378: dread d4/dc/d13/d5b/d2d/d43/f55 [0,4194304] 0 2024-09-21T12:47:11.048 INFO:tasks.workunit.client.1.smithi176.stdout:2/996: read d4/df/d2e/d39/fea [661909,57592] 0 2024-09-21T12:47:11.049 INFO:tasks.workunit.client.1.smithi176.stdout:2/997: chown d4/df/d4b/fae 57995146 1 2024-09-21T12:47:11.049 INFO:tasks.workunit.client.0.smithi046.stdout:9/464: truncate d11/d19/f1a 2383012 0 2024-09-21T12:47:11.053 INFO:tasks.workunit.client.1.smithi176.stdout:6/925: creat d2/d63/de7/f127 x:0 0 0 2024-09-21T12:47:11.054 INFO:tasks.workunit.client.0.smithi046.stdout:5/379: dread d4/d22/d10/d1a/f1c [0,4194304] 0 2024-09-21T12:47:11.059 INFO:tasks.workunit.client.0.smithi046.stdout:0/430: rename d6/d7/d9/d6b to d6/d7/d13/d43/d52/d63/d7f/d38/da6 0 2024-09-21T12:47:11.060 INFO:tasks.workunit.client.1.smithi176.stdout:9/988: chown d1/df/d23/dcf/fd6 4450018 1 2024-09-21T12:47:11.062 INFO:tasks.workunit.client.0.smithi046.stdout:9/465: unlink d11/d19/d1b/d1c/f2e 0 2024-09-21T12:47:11.063 INFO:tasks.workunit.client.1.smithi176.stdout:5/925: sync 2024-09-21T12:47:11.063 INFO:tasks.workunit.client.1.smithi176.stdout:8/930: sync 2024-09-21T12:47:11.063 INFO:tasks.workunit.client.1.smithi176.stdout:2/998: creat d4/df/d2e/d6f/d5d/d81/db2/da5/f130 x:0 0 0 2024-09-21T12:47:11.066 INFO:tasks.workunit.client.1.smithi176.stdout:2/999: write d4/d3d/d76/fc9 [883256,120767] 0 2024-09-21T12:47:11.067 INFO:tasks.workunit.client.1.smithi176.stdout:6/926: mkdir d2/dd/d26/d110/d128 0 2024-09-21T12:47:11.068 INFO:tasks.workunit.client.1.smithi176.stdout:9/989: dwrite d1/df/d48/d69/d76/d7c/fc6 [0,4194304] 0 2024-09-21T12:47:11.069 INFO:tasks.workunit.client.1.smithi176.stdout:1/985: mknod d0/db/d1a/d2c/c165 0 2024-09-21T12:47:11.077 INFO:tasks.workunit.client.1.smithi176.stdout:6/927: write d2/fbe [5218244,79387] 0 2024-09-21T12:47:11.079 INFO:tasks.workunit.client.1.smithi176.stdout:8/931: dwrite d6/d16/d36/d67/dd1/fe2 [0,4194304] 0 2024-09-21T12:47:11.081 INFO:tasks.workunit.client.1.smithi176.stdout:5/926: mknod d0/d13/d5d/d98/d120/c125 0 2024-09-21T12:47:11.081 INFO:tasks.workunit.client.1.smithi176.stdout:8/932: chown d6/d16/d79/def 31410866 1 2024-09-21T12:47:11.083 INFO:tasks.workunit.client.1.smithi176.stdout:4/974: dwrite d3/d42/d56/d101/d107/d96/da3/fad [0,4194304] 0 2024-09-21T12:47:11.088 INFO:tasks.workunit.client.1.smithi176.stdout:8/933: chown d6/db/d32/l74 13490487 1 2024-09-21T12:47:11.089 INFO:tasks.workunit.client.1.smithi176.stdout:8/934: chown d6/d8/f10 4089972 1 2024-09-21T12:47:11.090 INFO:tasks.workunit.client.1.smithi176.stdout:5/927: rename d0/d13/d5d/c7d to d0/d13/d63/d8d/c126 0 2024-09-21T12:47:11.091 INFO:tasks.workunit.client.1.smithi176.stdout:4/975: mknod d3/d42/d47/c158 0 2024-09-21T12:47:11.093 INFO:tasks.workunit.client.1.smithi176.stdout:4/976: read - d3/d42/d47/fd5 zero size 2024-09-21T12:47:11.093 INFO:tasks.workunit.client.1.smithi176.stdout:6/928: mknod d2/dd/d26/d2b/d10/dfe/c129 0 2024-09-21T12:47:11.094 INFO:tasks.workunit.client.1.smithi176.stdout:9/990: getdents d1/df/d48/d69/d38 0 2024-09-21T12:47:11.095 INFO:tasks.workunit.client.1.smithi176.stdout:5/928: symlink d0/d13/d63/d8d/d117/dda/l127 0 2024-09-21T12:47:11.096 INFO:tasks.workunit.client.1.smithi176.stdout:8/935: creat d6/d8/d54/df6/f124 x:0 0 0 2024-09-21T12:47:11.097 INFO:tasks.workunit.client.1.smithi176.stdout:4/977: truncate d3/d42/d102/f131 189979 0 2024-09-21T12:47:11.098 INFO:tasks.workunit.client.1.smithi176.stdout:1/986: dwrite d0/db/d1a/d2c/d6b/fdc [0,4194304] 0 2024-09-21T12:47:11.098 INFO:tasks.workunit.client.1.smithi176.stdout:9/991: fsync d1/df/f14a 0 2024-09-21T12:47:11.100 INFO:tasks.workunit.client.1.smithi176.stdout:1/987: stat d0/db/f157 0 2024-09-21T12:47:11.100 INFO:tasks.workunit.client.1.smithi176.stdout:4/978: chown d3/d21/f2e 924715 1 2024-09-21T12:47:11.100 INFO:tasks.workunit.client.1.smithi176.stdout:8/936: creat d6/db/d13/d98/f125 x:0 0 0 2024-09-21T12:47:11.102 INFO:tasks.workunit.client.1.smithi176.stdout:6/929: getdents d2/dd/d26/d2b/d10/d11c 0 2024-09-21T12:47:11.105 INFO:tasks.workunit.client.1.smithi176.stdout:8/937: readlink d6/db/d37/l50 0 2024-09-21T12:47:11.106 INFO:tasks.workunit.client.1.smithi176.stdout:4/979: symlink d3/d42/d47/d5c/dec/l159 0 2024-09-21T12:47:11.108 INFO:tasks.workunit.client.1.smithi176.stdout:8/938: rmdir d6 39 2024-09-21T12:47:11.109 INFO:tasks.workunit.client.1.smithi176.stdout:5/929: dwrite d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/faa [4194304,4194304] 0 2024-09-21T12:47:11.111 INFO:tasks.workunit.client.1.smithi176.stdout:9/992: truncate d1/d61/d73/f13a 444280 0 2024-09-21T12:47:11.113 INFO:tasks.workunit.client.1.smithi176.stdout:6/930: creat d2/dd/d26/f12a x:0 0 0 2024-09-21T12:47:11.113 INFO:tasks.workunit.client.1.smithi176.stdout:4/980: dread d3/d21/d27/d2c/f67 [4194304,4194304] 0 2024-09-21T12:47:11.115 INFO:tasks.workunit.client.1.smithi176.stdout:5/930: creat d0/d13/d63/d8d/d117/d37/db5/db7/f128 x:0 0 0 2024-09-21T12:47:11.115 INFO:tasks.workunit.client.0.smithi046.stdout:4/386: sync 2024-09-21T12:47:11.115 INFO:tasks.workunit.client.0.smithi046.stdout:6/339: sync 2024-09-21T12:47:11.115 INFO:tasks.workunit.client.0.smithi046.stdout:5/380: rename d4/d16/l3c to d4/dc/d13/d15/l75 0 2024-09-21T12:47:11.115 INFO:tasks.workunit.client.1.smithi176.stdout:4/981: chown d3/d42/d47/c158 120465 1 2024-09-21T12:47:11.117 INFO:tasks.workunit.client.1.smithi176.stdout:4/982: chown d3/d42/d102/f12a 13132 1 2024-09-21T12:47:11.120 INFO:tasks.workunit.client.1.smithi176.stdout:1/988: dwrite d0/db/d2a/ff1 [0,4194304] 0 2024-09-21T12:47:11.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/431: creat d6/d7/d13/d43/d52/d63/d7f/fa7 x:0 0 0 2024-09-21T12:47:11.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/340: mknod de/d2a/d34/d4e/c6e 0 2024-09-21T12:47:11.124 INFO:tasks.workunit.client.1.smithi176.stdout:6/931: fdatasync d2/dd/d26/d2b/d10/d1b/d37/f4f 0 2024-09-21T12:47:11.126 INFO:tasks.workunit.client.0.smithi046.stdout:9/466: rmdir d11/d19/d1b/d1c/d1f/d30/d3e/d8b 0 2024-09-21T12:47:11.131 INFO:tasks.workunit.client.1.smithi176.stdout:9/993: getdents d1/d61/d73 0 2024-09-21T12:47:11.131 INFO:tasks.workunit.client.0.smithi046.stdout:5/381: mknod d4/dc/d6b/c76 0 2024-09-21T12:47:11.132 INFO:tasks.workunit.client.1.smithi176.stdout:9/994: stat d1/df/d23/d67/df0/d108/d134 0 2024-09-21T12:47:11.132 INFO:tasks.workunit.client.1.smithi176.stdout:1/989: write d0/db/f157 [718871,58188] 0 2024-09-21T12:47:11.133 INFO:tasks.workunit.client.0.smithi046.stdout:5/382: read d4/d22/d10/d1a/f37 [132463,110492] 0 2024-09-21T12:47:11.133 INFO:tasks.workunit.client.0.smithi046.stdout:0/432: creat d6/d7/d13/d72/d9b/fa8 x:0 0 0 2024-09-21T12:47:11.135 INFO:tasks.workunit.client.1.smithi176.stdout:4/983: mkdir d3/d21/d10b/d15a 0 2024-09-21T12:47:11.136 INFO:tasks.workunit.client.0.smithi046.stdout:6/341: fdatasync de/d2a/f2f 0 2024-09-21T12:47:11.136 INFO:tasks.workunit.client.1.smithi176.stdout:4/984: chown d3/d42/dae/f12d 63045 1 2024-09-21T12:47:11.138 INFO:tasks.workunit.client.1.smithi176.stdout:6/932: symlink d2/dd/l12b 0 2024-09-21T12:47:11.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/387: rename d1/f2a to d1/d13/f81 0 2024-09-21T12:47:11.141 INFO:tasks.workunit.client.1.smithi176.stdout:8/939: dread d6/d8/f33 [4194304,4194304] 0 2024-09-21T12:47:11.141 INFO:tasks.workunit.client.1.smithi176.stdout:6/933: dread d2/dd/fba [0,4194304] 0 2024-09-21T12:47:11.143 INFO:tasks.workunit.client.1.smithi176.stdout:5/931: rename d0/d13/d5d/ldb to d0/d13/d63/l129 0 2024-09-21T12:47:11.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/383: creat d4/d22/d10/d1a/f77 x:0 0 0 2024-09-21T12:47:11.145 INFO:tasks.workunit.client.0.smithi046.stdout:0/433: mknod d6/d7/d13/d7b/ca9 0 2024-09-21T12:47:11.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/434: stat d6/d7/d13/d43/d52/d63 0 2024-09-21T12:47:11.148 INFO:tasks.workunit.client.0.smithi046.stdout:6/342: creat de/d2a/d4c/f6f x:0 0 0 2024-09-21T12:47:11.151 INFO:tasks.workunit.client.0.smithi046.stdout:9/467: dwrite d11/d19/d1b/d31/f7d [0,4194304] 0 2024-09-21T12:47:11.152 INFO:tasks.workunit.client.1.smithi176.stdout:1/990: symlink d0/db/d1a/d2c/dc5/d2b/l166 0 2024-09-21T12:47:11.153 INFO:tasks.workunit.client.1.smithi176.stdout:1/991: chown d0/db/d1a/d2c/d6b/fd5 6154 1 2024-09-21T12:47:11.153 INFO:tasks.workunit.client.0.smithi046.stdout:5/384: mknod d4/d16/c78 0 2024-09-21T12:47:11.154 INFO:tasks.workunit.client.1.smithi176.stdout:9/995: mknod d1/df/d23/d67/df0/d108/d134/c14f 0 2024-09-21T12:47:11.155 INFO:tasks.workunit.client.1.smithi176.stdout:4/985: creat d3/d149/f15b x:0 0 0 2024-09-21T12:47:11.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/388: mkdir d1/d27/d82 0 2024-09-21T12:47:11.160 INFO:tasks.workunit.client.1.smithi176.stdout:6/934: getdents d2/dd/d26/d110/d128 0 2024-09-21T12:47:11.160 INFO:tasks.workunit.client.0.smithi046.stdout:0/435: dread d6/d2f/d32/f65 [0,4194304] 0 2024-09-21T12:47:11.162 INFO:tasks.workunit.client.0.smithi046.stdout:9/468: creat d11/d19/d20/f8e x:0 0 0 2024-09-21T12:47:11.162 INFO:tasks.workunit.client.0.smithi046.stdout:0/436: chown d6/d7/d13/d43/d52/l8f 9533 1 2024-09-21T12:47:11.162 INFO:tasks.workunit.client.1.smithi176.stdout:1/992: rmdir d0/db/d1a/d2c 39 2024-09-21T12:47:11.164 INFO:tasks.workunit.client.1.smithi176.stdout:9/996: chown d1/df/d48/d69/d40/l70 26538 1 2024-09-21T12:47:11.166 INFO:tasks.workunit.client.1.smithi176.stdout:8/940: link d6/db/d37/d7a/c123 d6/d16/d36/d67/dd1/d115/c126 0 2024-09-21T12:47:11.166 INFO:tasks.workunit.client.0.smithi046.stdout:4/389: write d1/d13/f31 [1551419,109206] 0 2024-09-21T12:47:11.169 INFO:tasks.workunit.client.1.smithi176.stdout:1/993: mkdir d0/d13f/d167 0 2024-09-21T12:47:11.169 INFO:tasks.workunit.client.1.smithi176.stdout:1/994: chown d0/db/d6a 5472 1 2024-09-21T12:47:11.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/385: symlink d4/dc/d13/d5b/d2d/l79 0 2024-09-21T12:47:11.174 INFO:tasks.workunit.client.1.smithi176.stdout:9/997: mkdir d1/df/dea/df5/d150 0 2024-09-21T12:47:11.174 INFO:tasks.workunit.client.1.smithi176.stdout:9/998: readlink d1/df/d23/d67/la9 0 2024-09-21T12:47:11.175 INFO:tasks.workunit.client.1.smithi176.stdout:9/999: chown d1/df/d48/d69/d76/d7c/d9e/f11d 31 1 2024-09-21T12:47:11.176 INFO:tasks.workunit.client.0.smithi046.stdout:6/343: rename de/d2a/d34/f37 to de/d2a/f70 0 2024-09-21T12:47:11.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/390: unlink d1/f75 0 2024-09-21T12:47:11.183 INFO:tasks.workunit.client.0.smithi046.stdout:9/469: mkdir d11/d19/d1b/d31/d53/d84/d8f 0 2024-09-21T12:47:11.183 INFO:tasks.workunit.client.1.smithi176.stdout:8/941: dread d6/db/d37/d7a/fa5 [0,4194304] 0 2024-09-21T12:47:11.184 INFO:tasks.workunit.client.1.smithi176.stdout:8/942: dread - d6/d16/d79/f8f zero size 2024-09-21T12:47:11.184 INFO:tasks.workunit.client.0.smithi046.stdout:5/386: fsync d4/d22/d10/d1a/f37 0 2024-09-21T12:47:11.187 INFO:tasks.workunit.client.1.smithi176.stdout:8/943: dread d6/db/d37/f3a [0,4194304] 0 2024-09-21T12:47:11.187 INFO:tasks.workunit.client.1.smithi176.stdout:8/944: chown d6/d16/cf8 141546531 1 2024-09-21T12:47:11.189 INFO:tasks.workunit.client.0.smithi046.stdout:6/344: mkdir de/d2a/d4c/d71 0 2024-09-21T12:47:11.190 INFO:tasks.workunit.client.1.smithi176.stdout:6/935: link d2/dd/d26/d2b/d10/d39/f118 d2/dd/d26/d2b/f12c 0 2024-09-21T12:47:11.191 INFO:tasks.workunit.client.1.smithi176.stdout:1/995: dread d0/db/d1a/d2c/dc5/d41/d59/f80 [0,4194304] 0 2024-09-21T12:47:11.191 INFO:tasks.workunit.client.1.smithi176.stdout:1/996: chown d0/d5b/c15a 5725 1 2024-09-21T12:47:11.193 INFO:tasks.workunit.client.1.smithi176.stdout:6/936: write d2/dd/d26/d2b/f2e [4730921,109417] 0 2024-09-21T12:47:11.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/345: dwrite f3 [4194304,4194304] 0 2024-09-21T12:47:11.197 INFO:tasks.workunit.client.0.smithi046.stdout:6/346: fsync de/d2a/f68 0 2024-09-21T12:47:11.199 INFO:tasks.workunit.client.1.smithi176.stdout:4/986: truncate d3/d21/d27/fc6 2821927 0 2024-09-21T12:47:11.204 INFO:tasks.workunit.client.1.smithi176.stdout:6/937: creat d2/dd/d26/d2b/d10/d87/f12d x:0 0 0 2024-09-21T12:47:11.205 INFO:tasks.workunit.client.0.smithi046.stdout:0/437: getdents d6/d7/d13/d7b 0 2024-09-21T12:47:11.205 INFO:tasks.workunit.client.1.smithi176.stdout:6/938: write d2/dd/f48 [3928258,129979] 0 2024-09-21T12:47:11.207 INFO:tasks.workunit.client.1.smithi176.stdout:8/945: rename d6/db/d37 to d6/d8/d24/d5e/d127 0 2024-09-21T12:47:11.211 INFO:tasks.workunit.client.0.smithi046.stdout:9/470: unlink d11/d19/d20/l48 0 2024-09-21T12:47:11.214 INFO:tasks.workunit.client.0.smithi046.stdout:0/438: creat d6/d7/d37/faa x:0 0 0 2024-09-21T12:47:11.216 INFO:tasks.workunit.client.1.smithi176.stdout:6/939: creat d2/dd/d26/d2b/f12e x:0 0 0 2024-09-21T12:47:11.216 INFO:tasks.workunit.client.1.smithi176.stdout:1/997: write d0/db/d1a/d2c/d37/f56 [674062,40134] 0 2024-09-21T12:47:11.217 INFO:tasks.workunit.client.1.smithi176.stdout:8/946: chown d6/d16/f63 23 1 2024-09-21T12:47:11.218 INFO:tasks.workunit.client.0.smithi046.stdout:9/471: chown d11/d19/d1b/d1c/d1f/c2c 1776 1 2024-09-21T12:47:11.222 INFO:tasks.workunit.client.1.smithi176.stdout:1/998: creat d0/db/d1a/d2c/d66/d6d/f168 x:0 0 0 2024-09-21T12:47:11.224 INFO:tasks.workunit.client.1.smithi176.stdout:1/999: read d0/db/d6a/fcd [834558,74882] 0 2024-09-21T12:47:11.225 INFO:tasks.workunit.client.1.smithi176.stdout:8/947: chown d6/d8/d24/d35 25145 1 2024-09-21T12:47:11.225 INFO:tasks.workunit.client.1.smithi176.stdout:4/987: getdents d3/d21/d27/d9b 0 2024-09-21T12:47:11.226 INFO:tasks.workunit.client.1.smithi176.stdout:4/988: readlink d3/d5/l26 0 2024-09-21T12:47:11.227 INFO:tasks.workunit.client.0.smithi046.stdout:6/347: dread f9 [0,4194304] 0 2024-09-21T12:47:11.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/472: dwrite d11/d19/d20/f8e [0,4194304] 0 2024-09-21T12:47:11.229 INFO:tasks.workunit.client.0.smithi046.stdout:4/391: dwrite d1/d13/f30 [0,4194304] 0 2024-09-21T12:47:11.229 INFO:tasks.workunit.client.1.smithi176.stdout:5/932: sync 2024-09-21T12:47:11.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/473: chown d11/d19/d1b/d31/f5a 6133 1 2024-09-21T12:47:11.231 INFO:tasks.workunit.client.1.smithi176.stdout:4/989: mknod d3/d5/dc5/c15c 0 2024-09-21T12:47:11.232 INFO:tasks.workunit.client.0.smithi046.stdout:6/348: rmdir de/d2a/d4c 39 2024-09-21T12:47:11.234 INFO:tasks.workunit.client.0.smithi046.stdout:6/349: readlink de/d2a/d4d/l52 0 2024-09-21T12:47:11.235 INFO:tasks.workunit.client.1.smithi176.stdout:6/940: dwrite d2/dd/d26/d2b/d10/d39/f73 [0,4194304] 0 2024-09-21T12:47:11.236 INFO:tasks.workunit.client.0.smithi046.stdout:0/439: dwrite d6/f1a [0,4194304] 0 2024-09-21T12:47:11.236 INFO:tasks.workunit.client.1.smithi176.stdout:6/941: stat d2/dd/d26/d2b/d10/d1b/d37/f4b 0 2024-09-21T12:47:11.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/474: mkdir d11/d19/d1b/d1c/d1f/d30/d90 0 2024-09-21T12:47:11.241 INFO:tasks.workunit.client.1.smithi176.stdout:8/948: mkdir d6/d16/d36/d128 0 2024-09-21T12:47:11.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/475: chown d11/d19/d20/d26/l66 381473927 1 2024-09-21T12:47:11.242 INFO:tasks.workunit.client.1.smithi176.stdout:5/933: creat d0/d13/d63/d72/d87/d92/f12a x:0 0 0 2024-09-21T12:47:11.244 INFO:tasks.workunit.client.0.smithi046.stdout:6/350: creat de/d2a/d34/d4e/f72 x:0 0 0 2024-09-21T12:47:11.245 INFO:tasks.workunit.client.1.smithi176.stdout:6/942: mkdir d2/dd/d26/d2b/d10/d39/daf/d12f 0 2024-09-21T12:47:11.247 INFO:tasks.workunit.client.1.smithi176.stdout:8/949: readlink d6/d8/d24/d5e/de8/l10e 0 2024-09-21T12:47:11.248 INFO:tasks.workunit.client.1.smithi176.stdout:8/950: fsync d6/db/d13/f116 0 2024-09-21T12:47:11.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/351: write de/f15 [1667747,63497] 0 2024-09-21T12:47:11.251 INFO:tasks.workunit.client.1.smithi176.stdout:4/990: dread d3/d5/dc5/fc8 [0,4194304] 0 2024-09-21T12:47:11.251 INFO:tasks.workunit.client.1.smithi176.stdout:6/943: creat d2/dd/d26/d2b/d68/f130 x:0 0 0 2024-09-21T12:47:11.252 INFO:tasks.workunit.client.1.smithi176.stdout:4/991: fdatasync d3/d42/d47/f6d 0 2024-09-21T12:47:11.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/476: dwrite d11/f12 [0,4194304] 0 2024-09-21T12:47:11.253 INFO:tasks.workunit.client.1.smithi176.stdout:5/934: link d0/f111 d0/d13/d5d/d98/da5/de1/d10f/f12b 0 2024-09-21T12:47:11.254 INFO:tasks.workunit.client.1.smithi176.stdout:8/951: dread d6/d16/d36/d67/f70 [0,4194304] 0 2024-09-21T12:47:11.257 INFO:tasks.workunit.client.0.smithi046.stdout:4/392: dwrite d1/d27/d58/f4c [0,4194304] 0 2024-09-21T12:47:11.258 INFO:tasks.workunit.client.1.smithi176.stdout:4/992: rename d3/d5/l63 to d3/d42/d4d/l15d 0 2024-09-21T12:47:11.258 INFO:tasks.workunit.client.0.smithi046.stdout:0/440: getdents d6/d2f 0 2024-09-21T12:47:11.260 INFO:tasks.workunit.client.1.smithi176.stdout:6/944: creat d2/dd/d26/d110/d128/f131 x:0 0 0 2024-09-21T12:47:11.262 INFO:tasks.workunit.client.0.smithi046.stdout:6/352: creat de/d2a/d34/d4e/d55/f73 x:0 0 0 2024-09-21T12:47:11.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/353: readlink de/l1e 0 2024-09-21T12:47:11.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/354: read - de/d2a/f68 zero size 2024-09-21T12:47:11.264 INFO:tasks.workunit.client.0.smithi046.stdout:6/355: chown fa 63996284 1 2024-09-21T12:47:11.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/477: rename d11/d69 to d11/d19/d1b/d4b/d91 0 2024-09-21T12:47:11.266 INFO:tasks.workunit.client.0.smithi046.stdout:4/393: readlink d1/d13/d25/l15 0 2024-09-21T12:47:11.267 INFO:tasks.workunit.client.1.smithi176.stdout:4/993: mknod d3/d42/d4d/c15e 0 2024-09-21T12:47:11.268 INFO:tasks.workunit.client.0.smithi046.stdout:6/356: fsync de/d2a/d4c/f67 0 2024-09-21T12:47:11.273 INFO:tasks.workunit.client.1.smithi176.stdout:8/952: rename d6/d8/d24/d5e/d127/d89/d8a/dd4/c10c to d6/d16/d36/d67/c129 0 2024-09-21T12:47:11.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/357: creat de/d2a/d4d/f74 x:0 0 0 2024-09-21T12:47:11.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/358: chown de/d48 1763 1 2024-09-21T12:47:11.280 INFO:tasks.workunit.client.1.smithi176.stdout:4/994: rename d3/d42/d56/d101/d125/c14f to d3/d5/dc5/c15f 0 2024-09-21T12:47:11.280 INFO:tasks.workunit.client.0.smithi046.stdout:4/394: dread d1/d13/d25/d29/f2f [0,4194304] 0 2024-09-21T12:47:11.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/395: truncate d1/f39 1048489 0 2024-09-21T12:47:11.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/396: chown d1 28017694 1 2024-09-21T12:47:11.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/397: write d1/d13/d25/d29/f42 [4823012,26081] 0 2024-09-21T12:47:11.282 INFO:tasks.workunit.client.1.smithi176.stdout:8/953: fsync d6/de7/ffc 0 2024-09-21T12:47:11.283 INFO:tasks.workunit.client.0.smithi046.stdout:6/359: symlink de/d48/l75 0 2024-09-21T12:47:11.283 INFO:tasks.workunit.client.0.smithi046.stdout:4/398: write d1/d27/d37/f63 [583437,15171] 0 2024-09-21T12:47:11.284 INFO:tasks.workunit.client.0.smithi046.stdout:6/360: fdatasync de/f15 0 2024-09-21T12:47:11.285 INFO:tasks.workunit.client.1.smithi176.stdout:8/954: mkdir d6/db/d13/d98/dde/d12a 0 2024-09-21T12:47:11.286 INFO:tasks.workunit.client.0.smithi046.stdout:6/361: write fa [5710129,69439] 0 2024-09-21T12:47:11.287 INFO:tasks.workunit.client.0.smithi046.stdout:4/399: read d1/d13/d25/f4a [1133179,124189] 0 2024-09-21T12:47:11.288 INFO:tasks.workunit.client.1.smithi176.stdout:8/955: write d6/d8/d24/d5e/d127/d7a/fa5 [637587,76422] 0 2024-09-21T12:47:11.288 INFO:tasks.workunit.client.1.smithi176.stdout:4/995: getdents d3/d42/d56/d4e/df8 0 2024-09-21T12:47:11.290 INFO:tasks.workunit.client.0.smithi046.stdout:4/400: creat d1/d27/d46/f83 x:0 0 0 2024-09-21T12:47:11.291 INFO:tasks.workunit.client.0.smithi046.stdout:4/401: write d1/d13/f30 [1113736,45872] 0 2024-09-21T12:47:11.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/362: creat de/f76 x:0 0 0 2024-09-21T12:47:11.292 INFO:tasks.workunit.client.0.smithi046.stdout:6/363: read de/f2c [855969,72379] 0 2024-09-21T12:47:11.293 INFO:tasks.workunit.client.0.smithi046.stdout:6/364: write de/d2a/d4c/f67 [353031,87749] 0 2024-09-21T12:47:11.294 INFO:tasks.workunit.client.1.smithi176.stdout:4/996: creat d3/d5/d155/f160 x:0 0 0 2024-09-21T12:47:11.294 INFO:tasks.workunit.client.1.smithi176.stdout:4/997: chown d3/d42/d56/d101/d107/df0/lfc 10225 1 2024-09-21T12:47:11.295 INFO:tasks.workunit.client.0.smithi046.stdout:6/365: mkdir de/d2a/d4c/d77 0 2024-09-21T12:47:11.296 INFO:tasks.workunit.client.0.smithi046.stdout:6/366: dread - de/d2a/f68 zero size 2024-09-21T12:47:11.297 INFO:tasks.workunit.client.1.smithi176.stdout:4/998: symlink d3/d42/d56/d101/d125/l161 0 2024-09-21T12:47:11.297 INFO:tasks.workunit.client.1.smithi176.stdout:4/999: write d3/d5/f13 [7920685,92417] 0 2024-09-21T12:47:11.298 INFO:tasks.workunit.client.0.smithi046.stdout:6/367: fsync de/f13 0 2024-09-21T12:47:11.302 INFO:tasks.workunit.client.0.smithi046.stdout:6/368: link de/c30 de/d2a/d4d/c78 0 2024-09-21T12:47:11.305 INFO:tasks.workunit.client.0.smithi046.stdout:6/369: dread de/d48/f4a [12582912,4194304] 0 2024-09-21T12:47:11.306 INFO:tasks.workunit.client.0.smithi046.stdout:6/370: write de/d2a/d4c/f6f [887235,109771] 0 2024-09-21T12:47:11.311 INFO:tasks.workunit.client.0.smithi046.stdout:6/371: dwrite de/d2a/d4c/f54 [0,4194304] 0 2024-09-21T12:47:11.313 INFO:tasks.workunit.client.1.smithi176.stdout:8/956: dread d6/d16/f1e [0,4194304] 0 2024-09-21T12:47:11.314 INFO:tasks.workunit.client.0.smithi046.stdout:6/372: unlink de/l27 0 2024-09-21T12:47:11.364 INFO:tasks.workunit.client.1.smithi176.stdout:6/945: write d2/d6f/d81/fb3 [592002,69324] 0 2024-09-21T12:47:11.365 INFO:tasks.workunit.client.0.smithi046.stdout:9/478: write d11/d19/d1b/f3f [4427777,113926] 0 2024-09-21T12:47:11.366 INFO:tasks.workunit.client.0.smithi046.stdout:9/479: fsync d11/d19/d1b/d1c/d1f/d30/d3e/f49 0 2024-09-21T12:47:11.368 INFO:tasks.workunit.client.1.smithi176.stdout:5/935: dwrite d0/d13/d63/d8d/d117/d37/d55/fa7 [0,4194304] 0 2024-09-21T12:47:11.373 INFO:tasks.workunit.client.1.smithi176.stdout:6/946: dwrite d2/dd/d26/d2b/d68/f130 [0,4194304] 0 2024-09-21T12:47:11.374 INFO:tasks.workunit.client.1.smithi176.stdout:5/936: creat d0/d10/f12c x:0 0 0 2024-09-21T12:47:11.375 INFO:tasks.workunit.client.0.smithi046.stdout:4/402: truncate d1/d13/d25/d3a/f4d 2163738 0 2024-09-21T12:47:11.378 INFO:tasks.workunit.client.1.smithi176.stdout:6/947: creat d2/dd/d26/d2b/d10/dfe/f132 x:0 0 0 2024-09-21T12:47:11.379 INFO:tasks.workunit.client.0.smithi046.stdout:4/403: fsync d1/d13/d25/d29/f54 0 2024-09-21T12:47:11.380 INFO:tasks.workunit.client.0.smithi046.stdout:9/480: dread d11/d19/d1b/f3f [0,4194304] 0 2024-09-21T12:47:11.381 INFO:tasks.workunit.client.0.smithi046.stdout:4/404: fsync d1/d13/f30 0 2024-09-21T12:47:11.384 INFO:tasks.workunit.client.1.smithi176.stdout:5/937: rename d0/d13/d63/d8d/ddc/l5b to d0/d13/d63/d72/l12d 0 2024-09-21T12:47:11.386 INFO:tasks.workunit.client.1.smithi176.stdout:6/948: creat d2/dd/d26/d2b/d10/dfe/f133 x:0 0 0 2024-09-21T12:47:11.390 INFO:tasks.workunit.client.1.smithi176.stdout:6/949: symlink d2/d6f/d7f/l134 0 2024-09-21T12:47:11.391 INFO:tasks.workunit.client.1.smithi176.stdout:6/950: write d2/dd/d26/d2b/d10/d1b/f102 [4690818,47782] 0 2024-09-21T12:47:11.391 INFO:tasks.workunit.client.1.smithi176.stdout:8/957: truncate d6/f15 4577523 0 2024-09-21T12:47:11.393 INFO:tasks.workunit.client.0.smithi046.stdout:6/373: dwrite de/f13 [0,4194304] 0 2024-09-21T12:47:11.395 INFO:tasks.workunit.client.0.smithi046.stdout:9/481: rename d11/d5b/l83 to d11/d19/d20/l92 0 2024-09-21T12:47:11.398 INFO:tasks.workunit.client.0.smithi046.stdout:6/374: dread de/d2a/d34/f3b [0,4194304] 0 2024-09-21T12:47:11.398 INFO:tasks.workunit.client.1.smithi176.stdout:6/951: truncate d2/dd/d26/d2b/d10/d39/f5b 1769948 0 2024-09-21T12:47:11.400 INFO:tasks.workunit.client.1.smithi176.stdout:6/952: fdatasync d2/dd/d26/d2b/d10/d87/f12d 0 2024-09-21T12:47:11.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/375: write de/f46 [8518779,43042] 0 2024-09-21T12:47:11.403 INFO:tasks.workunit.client.1.smithi176.stdout:5/938: write d0/d13/f3c [173079,127644] 0 2024-09-21T12:47:11.403 INFO:tasks.workunit.client.0.smithi046.stdout:6/376: truncate de/d2a/d34/f6a 205733 0 2024-09-21T12:47:11.405 INFO:tasks.workunit.client.1.smithi176.stdout:6/953: link d2/d6f/d7f/f111 d2/dd/d26/d2b/d68/dfa/f135 0 2024-09-21T12:47:11.406 INFO:tasks.workunit.client.0.smithi046.stdout:6/377: creat de/d2a/d4d/f79 x:0 0 0 2024-09-21T12:47:11.409 INFO:tasks.workunit.client.1.smithi176.stdout:6/954: creat d2/dd/f136 x:0 0 0 2024-09-21T12:47:11.412 INFO:tasks.workunit.client.0.smithi046.stdout:6/378: symlink de/d2a/d4c/d77/l7a 0 2024-09-21T12:47:11.416 INFO:tasks.workunit.client.1.smithi176.stdout:8/958: dwrite d6/d16/d79/f8f [0,4194304] 0 2024-09-21T12:47:11.429 INFO:tasks.workunit.client.1.smithi176.stdout:6/955: dread d2/dd/d26/d2b/d10/d39/f4a [0,4194304] 0 2024-09-21T12:47:11.474 INFO:tasks.workunit.client.0.smithi046.stdout:8/345: sync 2024-09-21T12:47:11.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/346: truncate d1/d12/d46/d35/d5b/f6d 388583 0 2024-09-21T12:47:11.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/347: chown d1/d24/f29 0 1 2024-09-21T12:47:11.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/348: chown d1/d12 107454958 1 2024-09-21T12:47:11.476 INFO:tasks.workunit.client.0.smithi046.stdout:8/349: chown d1/d12/f52 37135102 1 2024-09-21T12:47:11.489 INFO:tasks.workunit.client.0.smithi046.stdout:8/350: dread d1/d12/d1a/d33/f4c [0,4194304] 0 2024-09-21T12:47:11.503 INFO:tasks.workunit.client.1.smithi176.stdout:5/939: link d0/d13/d63/d8d/ddc/d41/cf1 d0/d13/d63/d72/d87/d92/c12e 0 2024-09-21T12:47:11.504 INFO:tasks.workunit.client.0.smithi046.stdout:6/379: symlink de/d2a/d34/d4e/d55/l7b 0 2024-09-21T12:47:11.504 INFO:tasks.workunit.client.1.smithi176.stdout:5/940: truncate d0/d13/d63/d8d/ddc/dd5/f121 845617 0 2024-09-21T12:47:11.505 INFO:tasks.workunit.client.0.smithi046.stdout:6/380: chown de/f32 1894794991 1 2024-09-21T12:47:11.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/351: rmdir d1/d12/d46/d35 39 2024-09-21T12:47:11.602 INFO:tasks.workunit.client.0.smithi046.stdout:3/334: sync 2024-09-21T12:47:11.689 INFO:tasks.workunit.client.1.smithi176.stdout:6/956: creat d2/dd/d26/d110/d128/f137 x:0 0 0 2024-09-21T12:47:11.695 INFO:tasks.workunit.client.0.smithi046.stdout:8/352: mkdir d1/d78 0 2024-09-21T12:47:11.699 INFO:tasks.workunit.client.0.smithi046.stdout:6/381: mkdir de/d2a/d4c/d71/d7c 0 2024-09-21T12:47:11.704 INFO:tasks.workunit.client.0.smithi046.stdout:8/353: truncate d1/d12/d46/d35/d5b/f69 1028699 0 2024-09-21T12:47:11.712 INFO:tasks.workunit.client.0.smithi046.stdout:6/382: link de/d2a/f70 de/d2a/d4d/f7d 0 2024-09-21T12:47:11.718 INFO:tasks.workunit.client.0.smithi046.stdout:6/383: dwrite de/f13 [0,4194304] 0 2024-09-21T12:47:11.745 INFO:tasks.workunit.client.0.smithi046.stdout:2/361: sync 2024-09-21T12:47:11.746 INFO:tasks.workunit.client.0.smithi046.stdout:2/362: write d16/d22/d38/f42 [3110932,21562] 0 2024-09-21T12:47:11.746 INFO:tasks.workunit.client.0.smithi046.stdout:2/363: chown l12 3 1 2024-09-21T12:47:11.758 INFO:tasks.workunit.client.0.smithi046.stdout:2/364: creat d16/d22/d2b/f6f x:0 0 0 2024-09-21T12:47:11.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/365: mkdir d16/d5c/d70 0 2024-09-21T12:47:11.768 INFO:tasks.workunit.client.1.smithi176.stdout:5/941: mknod d0/d13/d63/d8d/d117/d37/db5/db7/ddd/c12f 0 2024-09-21T12:47:11.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/366: dwrite d16/f1a [4194304,4194304] 0 2024-09-21T12:47:11.772 INFO:tasks.workunit.client.0.smithi046.stdout:2/367: symlink d16/d5c/d63/l71 0 2024-09-21T12:47:11.774 INFO:tasks.workunit.client.1.smithi176.stdout:5/942: dwrite d0/d13/d63/d72/d87/d92/fb9 [0,4194304] 0 2024-09-21T12:47:11.776 INFO:tasks.workunit.client.1.smithi176.stdout:6/957: rename d2/d6f/ff5 to d2/f138 0 2024-09-21T12:47:11.779 INFO:tasks.workunit.client.0.smithi046.stdout:2/368: creat d16/d22/d2b/d30/d67/f72 x:0 0 0 2024-09-21T12:47:11.784 INFO:tasks.workunit.client.0.smithi046.stdout:2/369: unlink d16/l17 0 2024-09-21T12:47:11.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/370: dwrite d16/f1a [8388608,4194304] 0 2024-09-21T12:47:11.795 INFO:tasks.workunit.client.0.smithi046.stdout:3/335: rmdir d5/dc/d30/d34 39 2024-09-21T12:47:11.807 INFO:tasks.workunit.client.0.smithi046.stdout:4/405: sync 2024-09-21T12:47:11.807 INFO:tasks.workunit.client.0.smithi046.stdout:5/387: sync 2024-09-21T12:47:11.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/441: sync 2024-09-21T12:47:11.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/482: sync 2024-09-21T12:47:11.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/345: sync 2024-09-21T12:47:11.808 INFO:tasks.workunit.client.0.smithi046.stdout:1/337: sync 2024-09-21T12:47:11.809 INFO:tasks.workunit.client.0.smithi046.stdout:9/483: read f10 [531066,113793] 0 2024-09-21T12:47:11.810 INFO:tasks.workunit.client.0.smithi046.stdout:7/346: readlink d2/l6a 0 2024-09-21T12:47:11.811 INFO:tasks.workunit.client.0.smithi046.stdout:0/442: truncate d6/d2f/d32/f65 4369434 0 2024-09-21T12:47:11.812 INFO:tasks.workunit.client.0.smithi046.stdout:1/338: truncate d4/d13/d38/d53/d5a/d5d/f74 710256 0 2024-09-21T12:47:11.813 INFO:tasks.workunit.client.0.smithi046.stdout:5/388: unlink d4/c4d 0 2024-09-21T12:47:11.816 INFO:tasks.workunit.client.0.smithi046.stdout:7/347: symlink d2/d37/l6c 0 2024-09-21T12:47:11.817 INFO:tasks.workunit.client.0.smithi046.stdout:0/443: mknod d6/d2f/d32/cab 0 2024-09-21T12:47:11.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/348: truncate d2/d4/d43/d58/f61 380497 0 2024-09-21T12:47:11.819 INFO:tasks.workunit.client.0.smithi046.stdout:7/349: dread - d2/d4/df/d17/d31/d34/f68 zero size 2024-09-21T12:47:11.820 INFO:tasks.workunit.client.0.smithi046.stdout:7/350: read - d2/d4/df/d17/f59 zero size 2024-09-21T12:47:11.821 INFO:tasks.workunit.client.0.smithi046.stdout:7/351: fdatasync d2/d4/df/d17/f35 0 2024-09-21T12:47:11.822 INFO:tasks.workunit.client.0.smithi046.stdout:9/484: rename d11/d19/d20 to d11/d19/d93 0 2024-09-21T12:47:11.825 INFO:tasks.workunit.client.0.smithi046.stdout:4/406: getdents d1/d27/d46/d78 0 2024-09-21T12:47:11.825 INFO:tasks.workunit.client.0.smithi046.stdout:4/407: readlink d1/d13/l72 0 2024-09-21T12:47:11.826 INFO:tasks.workunit.client.0.smithi046.stdout:9/485: mkdir d11/d19/d1b/d4b/d91/d94 0 2024-09-21T12:47:11.830 INFO:tasks.workunit.client.0.smithi046.stdout:4/408: mkdir d1/d13/d25/d29/d43/d84 0 2024-09-21T12:47:11.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/486: mkdir d11/d19/d36/d95 0 2024-09-21T12:47:11.832 INFO:tasks.workunit.client.0.smithi046.stdout:4/409: mkdir d1/d85 0 2024-09-21T12:47:11.836 INFO:tasks.workunit.client.0.smithi046.stdout:4/410: creat d1/d27/d46/f86 x:0 0 0 2024-09-21T12:47:11.836 INFO:tasks.workunit.client.0.smithi046.stdout:4/411: fdatasync d1/ff 0 2024-09-21T12:47:11.838 INFO:tasks.workunit.client.0.smithi046.stdout:9/487: dwrite d11/d19/d1b/d4b/f8d [0,4194304] 0 2024-09-21T12:47:11.839 INFO:tasks.workunit.client.0.smithi046.stdout:4/412: mknod d1/d27/c87 0 2024-09-21T12:47:11.861 INFO:tasks.workunit.client.0.smithi046.stdout:4/413: rmdir d1/d13/d25/d29/d43 39 2024-09-21T12:47:11.864 INFO:tasks.workunit.client.0.smithi046.stdout:4/414: symlink d1/d13/d4e/l88 0 2024-09-21T12:47:11.865 INFO:tasks.workunit.client.1.smithi176.stdout:8/959: truncate d6/d16/d36/d67/dd1/fe2 3267037 0 2024-09-21T12:47:11.865 INFO:tasks.workunit.client.0.smithi046.stdout:1/339: mkdir d4/d13/d79 0 2024-09-21T12:47:11.866 INFO:tasks.workunit.client.0.smithi046.stdout:1/340: write d4/d4d/f68 [1107322,65968] 0 2024-09-21T12:47:11.866 INFO:tasks.workunit.client.0.smithi046.stdout:4/415: creat d1/d27/d58/d7d/f89 x:0 0 0 2024-09-21T12:47:11.868 INFO:tasks.workunit.client.0.smithi046.stdout:1/341: read - d4/d13/d38/d48/f72 zero size 2024-09-21T12:47:11.870 INFO:tasks.workunit.client.1.smithi176.stdout:8/960: creat d6/db/d13/d98/dde/de5/d108/f12b x:0 0 0 2024-09-21T12:47:11.870 INFO:tasks.workunit.client.1.smithi176.stdout:8/961: chown d6/d8/d24/d35/f61 55995392 1 2024-09-21T12:47:11.871 INFO:tasks.workunit.client.0.smithi046.stdout:4/416: mkdir d1/d27/d46/d78/d8a 0 2024-09-21T12:47:11.872 INFO:tasks.workunit.client.0.smithi046.stdout:1/342: rmdir d4/d29 39 2024-09-21T12:47:11.876 INFO:tasks.workunit.client.1.smithi176.stdout:8/962: creat d6/d8/d24/d35/ddb/f12c x:0 0 0 2024-09-21T12:47:11.877 INFO:tasks.workunit.client.1.smithi176.stdout:6/958: mknod d2/dd/d26/d2b/d10/d39/c139 0 2024-09-21T12:47:11.881 INFO:tasks.workunit.client.1.smithi176.stdout:8/963: link d6/d8/d24/d5e/d127/d89/d8a/dd4/le9 d6/d8/d24/l12d 0 2024-09-21T12:47:11.884 INFO:tasks.workunit.client.0.smithi046.stdout:8/354: mkdir d1/d12/d46/d35/d79 0 2024-09-21T12:47:11.887 INFO:tasks.workunit.client.0.smithi046.stdout:3/336: link d5/dc/d26/d3c/f51 d5/dc/d26/f78 0 2024-09-21T12:47:11.887 INFO:tasks.workunit.client.0.smithi046.stdout:3/337: stat d5/dc/f54 0 2024-09-21T12:47:11.888 INFO:tasks.workunit.client.0.smithi046.stdout:8/355: mknod d1/d12/d46/d35/d36/d51/c7a 0 2024-09-21T12:47:11.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/356: chown d1/d24/f67 2125463 1 2024-09-21T12:47:11.889 INFO:tasks.workunit.client.0.smithi046.stdout:6/384: rename de/d2a/f70 to de/d2a/d4c/d71/d7c/f7e 0 2024-09-21T12:47:11.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/357: creat d1/d12/d53/d60/f7b x:0 0 0 2024-09-21T12:47:11.894 INFO:tasks.workunit.client.0.smithi046.stdout:2/371: rename d16/d22/d4e/f61 to d16/d22/d2b/d43/f73 0 2024-09-21T12:47:11.894 INFO:tasks.workunit.client.1.smithi176.stdout:8/964: dread d6/d8/f33 [0,4194304] 0 2024-09-21T12:47:11.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/358: truncate d1/d12/d46/d35/d36/d51/f65 154433 0 2024-09-21T12:47:11.897 INFO:tasks.workunit.client.0.smithi046.stdout:5/389: rename d4/dc/d13/d15/d54/d5d to d4/dc/d13/d5b/d2d/d43/d7a 0 2024-09-21T12:47:11.901 INFO:tasks.workunit.client.0.smithi046.stdout:7/352: truncate d2/d4/df/f10 2634884 0 2024-09-21T12:47:11.902 INFO:tasks.workunit.client.0.smithi046.stdout:0/444: dwrite d6/d7/d13/f1d [0,4194304] 0 2024-09-21T12:47:11.905 INFO:tasks.workunit.client.1.smithi176.stdout:8/965: creat d6/d8/d24/d5e/d127/d89/d8a/f12e x:0 0 0 2024-09-21T12:47:11.909 INFO:tasks.workunit.client.0.smithi046.stdout:7/353: symlink d2/dd/l6d 0 2024-09-21T12:47:11.910 INFO:tasks.workunit.client.1.smithi176.stdout:8/966: chown d6/d16/c95 1163069992 1 2024-09-21T12:47:11.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/445: mkdir d6/dac 0 2024-09-21T12:47:11.916 INFO:tasks.workunit.client.1.smithi176.stdout:5/943: rename d0/d13/d63/d8d/d117/d37/fb2 to d0/d13/d63/d8d/d117/f130 0 2024-09-21T12:47:11.916 INFO:tasks.workunit.client.0.smithi046.stdout:0/446: mknod d6/d4f/da4/cad 0 2024-09-21T12:47:11.918 INFO:tasks.workunit.client.1.smithi176.stdout:5/944: mknod d0/d13/d63/c131 0 2024-09-21T12:47:11.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/447: fdatasync d6/d7/f5b 0 2024-09-21T12:47:11.922 INFO:tasks.workunit.client.1.smithi176.stdout:5/945: mknod d0/d13/d63/d8d/d117/d37/db5/db7/ddd/c132 0 2024-09-21T12:47:11.924 INFO:tasks.workunit.client.0.smithi046.stdout:4/417: rename d1/d27/d58/d7d to d1/d13/d8b 0 2024-09-21T12:47:11.925 INFO:tasks.workunit.client.1.smithi176.stdout:5/946: read d0/d13/d63/d72/f7e [601800,58202] 0 2024-09-21T12:47:11.926 INFO:tasks.workunit.client.0.smithi046.stdout:6/385: rename de/c12 to de/d2a/d34/d4e/c7f 0 2024-09-21T12:47:11.927 INFO:tasks.workunit.client.0.smithi046.stdout:6/386: write de/f39 [4649496,113038] 0 2024-09-21T12:47:11.927 INFO:tasks.workunit.client.0.smithi046.stdout:1/343: write d4/f9 [3240770,103595] 0 2024-09-21T12:47:11.928 INFO:tasks.workunit.client.1.smithi176.stdout:5/947: dread d0/d13/d63/d72/d87/dcf/ff8 [0,4194304] 0 2024-09-21T12:47:11.930 INFO:tasks.workunit.client.0.smithi046.stdout:2/372: rename d16/d22/d2b/d30/f47 to d16/d22/d6c/f74 0 2024-09-21T12:47:11.933 INFO:tasks.workunit.client.1.smithi176.stdout:5/948: rmdir d0/d13/d63 39 2024-09-21T12:47:11.935 INFO:tasks.workunit.client.0.smithi046.stdout:4/418: symlink d1/d27/d37/d66/l8c 0 2024-09-21T12:47:11.936 INFO:tasks.workunit.client.1.smithi176.stdout:6/959: dwrite d2/dd/d26/d2b/d10/d1b/d37/fd7 [0,4194304] 0 2024-09-21T12:47:11.937 INFO:tasks.workunit.client.1.smithi176.stdout:6/960: write d2/dd/d26/d2b/d10/d1b/fa2 [2314296,116905] 0 2024-09-21T12:47:11.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/344: creat d4/d13/f7a x:0 0 0 2024-09-21T12:47:11.940 INFO:tasks.workunit.client.0.smithi046.stdout:1/345: write d4/d13/f7a [760843,31174] 0 2024-09-21T12:47:11.943 INFO:tasks.workunit.client.0.smithi046.stdout:6/387: dread de/d2a/d4d/f7d [0,4194304] 0 2024-09-21T12:47:11.946 INFO:tasks.workunit.client.0.smithi046.stdout:8/359: rename d1/d12/d46/d35/d5b/c62 to d1/c7c 0 2024-09-21T12:47:11.946 INFO:tasks.workunit.client.0.smithi046.stdout:4/419: dwrite d1/d27/d46/f77 [0,4194304] 0 2024-09-21T12:47:11.948 INFO:tasks.workunit.client.1.smithi176.stdout:6/961: symlink d2/dd/d26/d110/l13a 0 2024-09-21T12:47:11.948 INFO:tasks.workunit.client.0.smithi046.stdout:3/338: write d5/dc/d26/f37 [973915,101094] 0 2024-09-21T12:47:11.948 INFO:tasks.workunit.client.1.smithi176.stdout:6/962: truncate d2/dd/d79/fab 1327872 0 2024-09-21T12:47:11.949 INFO:tasks.workunit.client.0.smithi046.stdout:6/388: chown de/d2a/d34/f6a 1797 1 2024-09-21T12:47:11.949 INFO:tasks.workunit.client.1.smithi176.stdout:5/949: symlink d0/d13/d63/d72/d87/dcf/l133 0 2024-09-21T12:47:11.957 INFO:tasks.workunit.client.1.smithi176.stdout:5/950: truncate d0/d13/f26 1561679 0 2024-09-21T12:47:11.957 INFO:tasks.workunit.client.0.smithi046.stdout:5/390: write d4/dc/d13/d5b/d2d/d43/f48 [1383682,113138] 0 2024-09-21T12:47:11.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/346: dwrite d4/f1b [4194304,4194304] 0 2024-09-21T12:47:11.959 INFO:tasks.workunit.client.1.smithi176.stdout:5/951: truncate d0/d13/d63/d8d/ddc/dd5/fec 492313 0 2024-09-21T12:47:11.963 INFO:tasks.workunit.client.0.smithi046.stdout:7/354: rename d2/d4/f64 to d2/d4/d43/f6e 0 2024-09-21T12:47:11.965 INFO:tasks.workunit.client.1.smithi176.stdout:8/967: write d6/d8/d24/d35/d51/f78 [3951969,23088] 0 2024-09-21T12:47:11.965 INFO:tasks.workunit.client.1.smithi176.stdout:6/963: dwrite d2/f138 [4194304,4194304] 0 2024-09-21T12:47:11.965 INFO:tasks.workunit.client.0.smithi046.stdout:7/355: chown d2/dd/f2b 113816542 1 2024-09-21T12:47:11.967 INFO:tasks.workunit.client.1.smithi176.stdout:5/952: symlink d0/d13/d63/d8d/ddc/d41/l134 0 2024-09-21T12:47:11.969 INFO:tasks.workunit.client.1.smithi176.stdout:5/953: chown d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/faa 248 1 2024-09-21T12:47:11.976 INFO:tasks.workunit.client.1.smithi176.stdout:8/968: mknod d6/db/d32/c12f 0 2024-09-21T12:47:11.977 INFO:tasks.workunit.client.0.smithi046.stdout:6/389: dread de/d2a/f5e [0,4194304] 0 2024-09-21T12:47:11.978 INFO:tasks.workunit.client.1.smithi176.stdout:8/969: read d6/db/d13/d98/da1/f100 [3017313,89050] 0 2024-09-21T12:47:11.983 INFO:tasks.workunit.client.1.smithi176.stdout:6/964: creat d2/d6f/d7f/f13b x:0 0 0 2024-09-21T12:47:11.984 INFO:tasks.workunit.client.1.smithi176.stdout:6/965: readlink d2/dd/d26/d2b/lc3 0 2024-09-21T12:47:11.986 INFO:tasks.workunit.client.1.smithi176.stdout:8/970: rmdir d6/d8/d24 39 2024-09-21T12:47:11.988 INFO:tasks.workunit.client.1.smithi176.stdout:5/954: link d0/d13/d5d/d98/da5/de1/d10f/fea d0/d13/d63/d8d/d117/f135 0 2024-09-21T12:47:11.992 INFO:tasks.workunit.client.1.smithi176.stdout:5/955: creat d0/d13/d63/d8d/ddc/d41/f136 x:0 0 0 2024-09-21T12:47:11.994 INFO:tasks.workunit.client.1.smithi176.stdout:6/966: creat d2/d6f/d7f/dbf/d10f/f13c x:0 0 0 2024-09-21T12:47:11.995 INFO:tasks.workunit.client.1.smithi176.stdout:6/967: chown d2/dd/d26/d2b/d10/d39/f73 137579492 1 2024-09-21T12:47:11.996 INFO:tasks.workunit.client.1.smithi176.stdout:6/968: fdatasync d2/dd/d26/f38 0 2024-09-21T12:47:11.996 INFO:tasks.workunit.client.0.smithi046.stdout:8/360: write d1/d12/f19 [4528896,54167] 0 2024-09-21T12:47:12.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/391: mknod d4/dc/d6b/c7b 0 2024-09-21T12:47:12.002 INFO:tasks.workunit.client.1.smithi176.stdout:6/969: dwrite d2/dd/d26/d110/d128/f131 [0,4194304] 0 2024-09-21T12:47:12.003 INFO:tasks.workunit.client.1.smithi176.stdout:6/970: read - d2/dd/d26/d2b/d10/dfe/f132 zero size 2024-09-21T12:47:12.004 INFO:tasks.workunit.client.0.smithi046.stdout:1/347: truncate d4/d4d/f57 268332 0 2024-09-21T12:47:12.005 INFO:tasks.workunit.client.0.smithi046.stdout:0/448: rename d6/d7/d13/d7b/da2/c34 to d6/d7/d13/d7b/cae 0 2024-09-21T12:47:12.007 INFO:tasks.workunit.client.1.smithi176.stdout:5/956: dread d0/d13/d63/d72/d87/fc4 [0,4194304] 0 2024-09-21T12:47:12.007 INFO:tasks.workunit.client.1.smithi176.stdout:6/971: creat d2/dd/d26/d2b/d68/dfa/f13d x:0 0 0 2024-09-21T12:47:12.009 INFO:tasks.workunit.client.0.smithi046.stdout:2/373: rename d16/d22/d6c to d16/d22/d75 0 2024-09-21T12:47:12.010 INFO:tasks.workunit.client.0.smithi046.stdout:2/374: dread - d16/d22/d2b/d43/f6d zero size 2024-09-21T12:47:12.011 INFO:tasks.workunit.client.0.smithi046.stdout:6/390: mknod de/d2a/d4c/c80 0 2024-09-21T12:47:12.012 INFO:tasks.workunit.client.0.smithi046.stdout:2/375: write d16/d22/d38/f42 [4480682,31497] 0 2024-09-21T12:47:12.013 INFO:tasks.workunit.client.1.smithi176.stdout:5/957: fdatasync d0/d10/f75 0 2024-09-21T12:47:12.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/391: dread - de/d2a/d4c/f58 zero size 2024-09-21T12:47:12.014 INFO:tasks.workunit.client.1.smithi176.stdout:5/958: readlink d0/d13/d63/d8d/d117/d37/l97 0 2024-09-21T12:47:12.014 INFO:tasks.workunit.client.0.smithi046.stdout:2/376: write d16/f48 [725113,62358] 0 2024-09-21T12:47:12.016 INFO:tasks.workunit.client.1.smithi176.stdout:6/972: creat d2/dd/d79/f13e x:0 0 0 2024-09-21T12:47:12.016 INFO:tasks.workunit.client.0.smithi046.stdout:4/420: getdents d1/d27/d82 0 2024-09-21T12:47:12.017 INFO:tasks.workunit.client.1.smithi176.stdout:6/973: chown d2/dd/d26/d2b/d68/ce8 215960 1 2024-09-21T12:47:12.020 INFO:tasks.workunit.client.1.smithi176.stdout:5/959: creat d0/d13/d5d/d98/f137 x:0 0 0 2024-09-21T12:47:12.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/392: truncate d4/dc/d13/f38 5908426 0 2024-09-21T12:47:12.025 INFO:tasks.workunit.client.0.smithi046.stdout:1/348: creat d4/d13/d6b/f7b x:0 0 0 2024-09-21T12:47:12.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/356: mkdir d2/d4/df/d6f 0 2024-09-21T12:47:12.031 INFO:tasks.workunit.client.0.smithi046.stdout:2/377: symlink d16/d22/d2b/d30/l76 0 2024-09-21T12:47:12.031 INFO:tasks.workunit.client.0.smithi046.stdout:1/349: dwrite d4/d13/d38/f58 [0,4194304] 0 2024-09-21T12:47:12.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/350: chown d4/d13/f2e 22 1 2024-09-21T12:47:12.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/421: mknod d1/d13/d25/d29/d33/c8d 0 2024-09-21T12:47:12.033 INFO:tasks.workunit.client.0.smithi046.stdout:3/339: symlink d5/dc/d28/d60/d6e/l79 0 2024-09-21T12:47:12.035 INFO:tasks.workunit.client.0.smithi046.stdout:3/340: chown f2 129907731 1 2024-09-21T12:47:12.040 INFO:tasks.workunit.client.0.smithi046.stdout:2/378: readlink d16/d22/d2b/l3c 0 2024-09-21T12:47:12.043 INFO:tasks.workunit.client.0.smithi046.stdout:8/361: rename d1/d24 to d1/d12/d46/d35/d7d 0 2024-09-21T12:47:12.044 INFO:tasks.workunit.client.0.smithi046.stdout:3/341: chown d5/l22 33 1 2024-09-21T12:47:12.046 INFO:tasks.workunit.client.0.smithi046.stdout:9/488: sync 2024-09-21T12:47:12.047 INFO:tasks.workunit.client.0.smithi046.stdout:9/489: fsync fb 0 2024-09-21T12:47:12.048 INFO:tasks.workunit.client.0.smithi046.stdout:2/379: mkdir d16/d22/d38/d77 0 2024-09-21T12:47:12.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/357: dread d2/d4/df/d17/f30 [0,4194304] 0 2024-09-21T12:47:12.051 INFO:tasks.workunit.client.0.smithi046.stdout:4/422: rename d1/d13/d25/l34 to d1/d5f/l8e 0 2024-09-21T12:47:12.056 INFO:tasks.workunit.client.0.smithi046.stdout:3/342: creat d5/dc/d28/d60/d6e/f7a x:0 0 0 2024-09-21T12:47:12.056 INFO:tasks.workunit.client.0.smithi046.stdout:0/449: getdents d6/d7/d13/d43/d52/d63/d7f/d78 0 2024-09-21T12:47:12.057 INFO:tasks.workunit.client.0.smithi046.stdout:7/358: dwrite d2/dd/f3d [0,4194304] 0 2024-09-21T12:47:12.059 INFO:tasks.workunit.client.0.smithi046.stdout:6/392: getdents de/d2a/d34/d4e 0 2024-09-21T12:47:12.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/393: stat de/d2a/d4c/c80 0 2024-09-21T12:47:12.062 INFO:tasks.workunit.client.0.smithi046.stdout:2/380: fsync d16/d22/d2b/f51 0 2024-09-21T12:47:12.064 INFO:tasks.workunit.client.0.smithi046.stdout:5/393: write d4/fa [346744,124159] 0 2024-09-21T12:47:12.064 INFO:tasks.workunit.client.0.smithi046.stdout:2/381: readlink d16/l1b 0 2024-09-21T12:47:12.067 INFO:tasks.workunit.client.0.smithi046.stdout:0/450: fdatasync d6/d2f/d32/f65 0 2024-09-21T12:47:12.069 INFO:tasks.workunit.client.0.smithi046.stdout:0/451: write d6/d7/d13/d72/f79 [688560,87093] 0 2024-09-21T12:47:12.069 INFO:tasks.workunit.client.0.smithi046.stdout:1/351: truncate d4/d13/d38/d53/d5a/d5d/f74 515574 0 2024-09-21T12:47:12.071 INFO:tasks.workunit.client.0.smithi046.stdout:9/490: mknod d11/d19/d1b/d4b/d91/d8c/c96 0 2024-09-21T12:47:12.073 INFO:tasks.workunit.client.0.smithi046.stdout:6/394: mknod de/d2a/d34/c81 0 2024-09-21T12:47:12.074 INFO:tasks.workunit.client.0.smithi046.stdout:3/343: dread d5/dc/d26/d3c/d44/f4b [0,4194304] 0 2024-09-21T12:47:12.075 INFO:tasks.workunit.client.0.smithi046.stdout:5/394: dread d4/dc/d13/f23 [4194304,4194304] 0 2024-09-21T12:47:12.076 INFO:tasks.workunit.client.0.smithi046.stdout:8/362: creat d1/d12/d46/f7e x:0 0 0 2024-09-21T12:47:12.078 INFO:tasks.workunit.client.1.smithi176.stdout:6/974: dread d2/dd/d26/d110/f60 [0,4194304] 0 2024-09-21T12:47:12.078 INFO:tasks.workunit.client.0.smithi046.stdout:4/423: chown d1/d13/d25/d29/d43/c44 52347 1 2024-09-21T12:47:12.080 INFO:tasks.workunit.client.0.smithi046.stdout:4/424: fdatasync d1/d27/d58/f4c 0 2024-09-21T12:47:12.082 INFO:tasks.workunit.client.1.smithi176.stdout:6/975: creat d2/dd/f13f x:0 0 0 2024-09-21T12:47:12.083 INFO:tasks.workunit.client.0.smithi046.stdout:5/395: dread d4/d22/d10/d1a/f37 [0,4194304] 0 2024-09-21T12:47:12.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/359: mkdir d2/d4/df/d70 0 2024-09-21T12:47:12.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/396: write d4/d22/d10/f52 [887811,68782] 0 2024-09-21T12:47:12.087 INFO:tasks.workunit.client.1.smithi176.stdout:6/976: creat d2/dd/d26/d110/d103/f140 x:0 0 0 2024-09-21T12:47:12.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/452: creat d6/d7/d13/d72/d9b/faf x:0 0 0 2024-09-21T12:47:12.090 INFO:tasks.workunit.client.0.smithi046.stdout:9/491: creat d11/d5b/f97 x:0 0 0 2024-09-21T12:47:12.091 INFO:tasks.workunit.client.1.smithi176.stdout:6/977: unlink d2/dd/d26/d2b/d10/dfe/c129 0 2024-09-21T12:47:12.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/395: unlink fa 0 2024-09-21T12:47:12.094 INFO:tasks.workunit.client.1.smithi176.stdout:5/960: write d0/d13/d63/d8d/ddc/d41/f49 [1214286,92218] 0 2024-09-21T12:47:12.094 INFO:tasks.workunit.client.0.smithi046.stdout:2/382: write d16/d22/f2a [686066,120346] 0 2024-09-21T12:47:12.097 INFO:tasks.workunit.client.0.smithi046.stdout:3/344: dread - d5/dc/d30/d34/f61 zero size 2024-09-21T12:47:12.099 INFO:tasks.workunit.client.0.smithi046.stdout:2/383: truncate d16/d5c/f5d 469355 0 2024-09-21T12:47:12.099 INFO:tasks.workunit.client.1.smithi176.stdout:6/978: rename d2/dd5/c101 to d2/d6f/c141 0 2024-09-21T12:47:12.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/396: dwrite de/d2a/d4c/f67 [0,4194304] 0 2024-09-21T12:47:12.102 INFO:tasks.workunit.client.1.smithi176.stdout:5/961: mknod d0/d13/d63/d66/c138 0 2024-09-21T12:47:12.109 INFO:tasks.workunit.client.1.smithi176.stdout:6/979: symlink d2/d5d/l142 0 2024-09-21T12:47:12.111 INFO:tasks.workunit.client.1.smithi176.stdout:6/980: chown d2/dd/d26/d2b/d10/d39/c139 28529 1 2024-09-21T12:47:12.112 INFO:tasks.workunit.client.1.smithi176.stdout:6/981: stat d2/dd/d26/d2b/d10/d1b/ca3 0 2024-09-21T12:47:12.114 INFO:tasks.workunit.client.0.smithi046.stdout:9/492: read d11/d19/f37 [3789607,129061] 0 2024-09-21T12:47:12.114 INFO:tasks.workunit.client.1.smithi176.stdout:6/982: write d2/dd/d26/d2b/d10/f2f [2849740,75765] 0 2024-09-21T12:47:12.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/363: mkdir d1/d12/d46/d35/d7f 0 2024-09-21T12:47:12.119 INFO:tasks.workunit.client.1.smithi176.stdout:6/983: symlink d2/dd/d26/d2b/d10/l143 0 2024-09-21T12:47:12.119 INFO:tasks.workunit.client.0.smithi046.stdout:8/364: write d1/d12/f3b [2332383,53409] 0 2024-09-21T12:47:12.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/493: dread d11/d19/d36/f77 [0,4194304] 0 2024-09-21T12:47:12.122 INFO:tasks.workunit.client.1.smithi176.stdout:5/962: dread d0/ff [4194304,4194304] 0 2024-09-21T12:47:12.123 INFO:tasks.workunit.client.0.smithi046.stdout:0/453: read d6/d7/d37/f48 [1476367,129537] 0 2024-09-21T12:47:12.124 INFO:tasks.workunit.client.1.smithi176.stdout:5/963: write d0/d13/d63/d8d/d117/dda/fe2 [976471,123168] 0 2024-09-21T12:47:12.127 INFO:tasks.workunit.client.0.smithi046.stdout:6/397: symlink de/d2a/d4c/d71/d7c/l82 0 2024-09-21T12:47:12.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/397: write d4/dc/d13/f50 [177884,88457] 0 2024-09-21T12:47:12.132 INFO:tasks.workunit.client.0.smithi046.stdout:1/352: dwrite d4/f5 [4194304,4194304] 0 2024-09-21T12:47:12.132 INFO:tasks.workunit.client.0.smithi046.stdout:1/353: chown d4/d13/d6b 21095011 1 2024-09-21T12:47:12.134 INFO:tasks.workunit.client.0.smithi046.stdout:1/354: chown d4/d13/l34 989915 1 2024-09-21T12:47:12.135 INFO:tasks.workunit.client.0.smithi046.stdout:1/355: readlink d4/d13/l2b 0 2024-09-21T12:47:12.137 INFO:tasks.workunit.client.1.smithi176.stdout:6/984: rename d2/dd/d26/cdb to d2/dd/d26/d2b/d10/d1b/c144 0 2024-09-21T12:47:12.139 INFO:tasks.workunit.client.0.smithi046.stdout:7/360: write d2/d4/df/d17/d31/d34/f4b [1787980,99946] 0 2024-09-21T12:47:12.139 INFO:tasks.workunit.client.1.smithi176.stdout:5/964: dwrite d0/d13/d63/d72/d87/dcf/ff8 [0,4194304] 0 2024-09-21T12:47:12.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/425: dwrite d1/d13/d25/d3a/f4d [0,4194304] 0 2024-09-21T12:47:12.143 INFO:tasks.workunit.client.1.smithi176.stdout:6/985: mknod d2/dd/d26/d2b/d10/d39/c145 0 2024-09-21T12:47:12.144 INFO:tasks.workunit.client.0.smithi046.stdout:2/384: symlink d16/d22/d38/d77/l78 0 2024-09-21T12:47:12.146 INFO:tasks.workunit.client.0.smithi046.stdout:8/365: mkdir d1/d12/d53/d80 0 2024-09-21T12:47:12.152 INFO:tasks.workunit.client.0.smithi046.stdout:0/454: creat d6/d7/d13/d43/d52/fb0 x:0 0 0 2024-09-21T12:47:12.152 INFO:tasks.workunit.client.1.smithi176.stdout:5/965: link d0/d13/d63/d8d/d117/d37/db5/db7/ddd/cee d0/d13/d63/d8d/d117/d37/db5/db7/ddd/c139 0 2024-09-21T12:47:12.153 INFO:tasks.workunit.client.0.smithi046.stdout:6/398: fsync fb 0 2024-09-21T12:47:12.155 INFO:tasks.workunit.client.0.smithi046.stdout:5/398: stat d4/dc/d13/d5b/d2d/f4f 0 2024-09-21T12:47:12.156 INFO:tasks.workunit.client.1.smithi176.stdout:5/966: unlink d0/f27 0 2024-09-21T12:47:12.158 INFO:tasks.workunit.client.0.smithi046.stdout:4/426: mkdir d1/d27/d37/d8f 0 2024-09-21T12:47:12.159 INFO:tasks.workunit.client.1.smithi176.stdout:5/967: creat d0/d13/d63/d8d/ddc/dd5/f13a x:0 0 0 2024-09-21T12:47:12.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:11 smithi046 ceph-mon[27868]: pgmap v32: 65 pgs: 65 active+clean; 2.7 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 83 MiB/s rd, 260 MiB/s wr, 485 op/s 2024-09-21T12:47:12.165 INFO:tasks.workunit.client.1.smithi176.stdout:8/971: sync 2024-09-21T12:47:12.166 INFO:tasks.workunit.client.0.smithi046.stdout:3/345: rename d5/dc/d30/d34/l5a to d5/dc/d30/l7b 0 2024-09-21T12:47:12.167 INFO:tasks.workunit.client.0.smithi046.stdout:2/385: creat d16/d5c/d63/f79 x:0 0 0 2024-09-21T12:47:12.168 INFO:tasks.workunit.client.1.smithi176.stdout:6/986: rename d2/dd/d26/d2b/d10 to d2/d6f/d146 0 2024-09-21T12:47:12.168 INFO:tasks.workunit.client.1.smithi176.stdout:5/968: mknod d0/d13/d5d/d98/d120/c13b 0 2024-09-21T12:47:12.169 INFO:tasks.workunit.client.1.smithi176.stdout:5/969: fsync d0/d13/d5d/f73 0 2024-09-21T12:47:12.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/494: truncate d11/f3c 1867331 0 2024-09-21T12:47:12.175 INFO:tasks.workunit.client.1.smithi176.stdout:5/970: dread d0/d13/d63/d8d/d117/dda/fe2 [0,4194304] 0 2024-09-21T12:47:12.175 INFO:tasks.workunit.client.1.smithi176.stdout:5/971: dread - d0/d13/d63/d8d/d117/d37/db5/db7/f128 zero size 2024-09-21T12:47:12.176 INFO:tasks.workunit.client.1.smithi176.stdout:5/972: chown d0/d13/d63/d8d/ddc/d41/f60 4 1 2024-09-21T12:47:12.176 INFO:tasks.workunit.client.1.smithi176.stdout:6/987: rename d2/d6f/d146/d1b/d37/fd7 to d2/dd/d26/d2b/f147 0 2024-09-21T12:47:12.177 INFO:tasks.workunit.client.1.smithi176.stdout:6/988: chown d2/dd/d26/d2b/d68 48 1 2024-09-21T12:47:12.177 INFO:tasks.workunit.client.0.smithi046.stdout:0/455: chown d6/d7/l7d 1755682 1 2024-09-21T12:47:12.180 INFO:tasks.workunit.client.1.smithi176.stdout:8/972: fsync d6/d8/d24/d35/f71 0 2024-09-21T12:47:12.186 INFO:tasks.workunit.client.0.smithi046.stdout:4/427: creat d1/d27/d58/f90 x:0 0 0 2024-09-21T12:47:12.187 INFO:tasks.workunit.client.1.smithi176.stdout:6/989: mkdir d2/dd/d79/d148 0 2024-09-21T12:47:12.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/366: dwrite d1/f1f [4194304,4194304] 0 2024-09-21T12:47:12.193 INFO:tasks.workunit.client.0.smithi046.stdout:2/386: mkdir d16/d22/d38/d77/d7a 0 2024-09-21T12:47:12.195 INFO:tasks.workunit.client.1.smithi176.stdout:8/973: chown d6/d16/d36/c6c 10427 1 2024-09-21T12:47:12.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/356: write d4/d29/d32/f3f [248966,66479] 0 2024-09-21T12:47:12.197 INFO:tasks.workunit.client.0.smithi046.stdout:9/495: mknod d11/d19/d1b/d31/d44/c98 0 2024-09-21T12:47:12.198 INFO:tasks.workunit.client.0.smithi046.stdout:9/496: write d11/f54 [3373443,30441] 0 2024-09-21T12:47:12.200 INFO:tasks.workunit.client.1.smithi176.stdout:5/973: mkdir d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/dad/d11c/d13c 0 2024-09-21T12:47:12.201 INFO:tasks.workunit.client.0.smithi046.stdout:0/456: mkdir d6/d7/d9/d54/db1 0 2024-09-21T12:47:12.202 INFO:tasks.workunit.client.1.smithi176.stdout:5/974: chown d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/dad/fbc 5 1 2024-09-21T12:47:12.202 INFO:tasks.workunit.client.1.smithi176.stdout:8/974: rmdir d6/d8/d24/d5e/d127/d89/d8a/dd4 39 2024-09-21T12:47:12.202 INFO:tasks.workunit.client.1.smithi176.stdout:5/975: write d0/d13/d63/d8d/d117/d37/db5/fba [970112,48450] 0 2024-09-21T12:47:12.203 INFO:tasks.workunit.client.0.smithi046.stdout:6/399: readlink de/d48/l75 0 2024-09-21T12:47:12.203 INFO:tasks.workunit.client.1.smithi176.stdout:6/990: mknod d2/dd/d26/c149 0 2024-09-21T12:47:12.205 INFO:tasks.workunit.client.0.smithi046.stdout:0/457: write d6/d7/d13/d72/d9b/fa8 [553951,47436] 0 2024-09-21T12:47:12.206 INFO:tasks.workunit.client.0.smithi046.stdout:3/346: dwrite f2 [4194304,4194304] 0 2024-09-21T12:47:12.208 INFO:tasks.workunit.client.1.smithi176.stdout:6/991: creat d2/d6f/d146/d11c/f14a x:0 0 0 2024-09-21T12:47:12.208 INFO:tasks.workunit.client.1.smithi176.stdout:8/975: read d6/fa [177885,115519] 0 2024-09-21T12:47:12.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/367: creat d1/d12/d53/d60/f81 x:0 0 0 2024-09-21T12:47:12.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/387: creat d16/d22/d2b/d30/d67/f7b x:0 0 0 2024-09-21T12:47:12.212 INFO:tasks.workunit.client.0.smithi046.stdout:8/368: truncate d1/d12/d46/f37 1602257 0 2024-09-21T12:47:12.218 INFO:tasks.workunit.client.1.smithi176.stdout:8/976: unlink d6/db/d13/f4d 0 2024-09-21T12:47:12.220 INFO:tasks.workunit.client.0.smithi046.stdout:6/400: write de/d2a/d34/d4e/d55/f73 [745132,54285] 0 2024-09-21T12:47:12.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/428: link d1/d27/d46/f86 d1/d13/d4e/f91 0 2024-09-21T12:47:12.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/429: write d1/d13/d25/d3a/f3c [3318180,42230] 0 2024-09-21T12:47:12.223 INFO:tasks.workunit.client.1.smithi176.stdout:8/977: creat d6/d8/d24/d35/ddb/f130 x:0 0 0 2024-09-21T12:47:12.223 INFO:tasks.workunit.client.1.smithi176.stdout:5/976: dread d0/d13/d63/d66/fbe [0,4194304] 0 2024-09-21T12:47:12.224 INFO:tasks.workunit.client.1.smithi176.stdout:5/977: stat d0/d13/d63/d66/c138 0 2024-09-21T12:47:12.224 INFO:tasks.workunit.client.0.smithi046.stdout:7/361: rename d2/d4/df/d17/c2a to d2/c71 0 2024-09-21T12:47:12.229 INFO:tasks.workunit.client.0.smithi046.stdout:3/347: fdatasync d5/dc/d26/f78 0 2024-09-21T12:47:12.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/388: fdatasync d16/d22/d2b/d43/f73 0 2024-09-21T12:47:12.231 INFO:tasks.workunit.client.1.smithi176.stdout:6/992: dwrite d2/f8 [0,4194304] 0 2024-09-21T12:47:12.233 INFO:tasks.workunit.client.0.smithi046.stdout:8/369: fsync d1/f8 0 2024-09-21T12:47:12.234 INFO:tasks.workunit.client.0.smithi046.stdout:8/370: chown d1/d12/f13 55 1 2024-09-21T12:47:12.235 INFO:tasks.workunit.client.0.smithi046.stdout:8/371: readlink d1/lc 0 2024-09-21T12:47:12.237 INFO:tasks.workunit.client.1.smithi176.stdout:8/978: rmdir d6/d8/d24/d5e/dfa 0 2024-09-21T12:47:12.238 INFO:tasks.workunit.client.0.smithi046.stdout:2/389: dwrite d16/d22/d4e/f55 [0,4194304] 0 2024-09-21T12:47:12.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/458: write d6/d7/d13/d49/f5c [2034212,62689] 0 2024-09-21T12:47:12.239 INFO:tasks.workunit.client.1.smithi176.stdout:8/979: write d6/de7/ffc [3481540,40511] 0 2024-09-21T12:47:12.239 INFO:tasks.workunit.client.1.smithi176.stdout:5/978: write d0/d13/d63/d8d/d117/d37/db5/db7/f47 [5030732,81491] 0 2024-09-21T12:47:12.240 INFO:tasks.workunit.client.1.smithi176.stdout:8/980: write d6/d8/d24/d35/d51/f78 [4507988,106631] 0 2024-09-21T12:47:12.241 INFO:tasks.workunit.client.0.smithi046.stdout:0/459: chown d6/d7/d13/d72/f79 1719725 1 2024-09-21T12:47:12.241 INFO:tasks.workunit.client.1.smithi176.stdout:6/993: chown d2/d6f/d146/d39/daf/l10e 225138795 1 2024-09-21T12:47:12.243 INFO:tasks.workunit.client.0.smithi046.stdout:1/357: truncate d4/fe 157230 0 2024-09-21T12:47:12.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/358: write d4/f6a [2852467,4239] 0 2024-09-21T12:47:12.246 INFO:tasks.workunit.client.0.smithi046.stdout:8/372: dwrite d1/d12/d46/d35/d36/d51/f65 [0,4194304] 0 2024-09-21T12:47:12.249 INFO:tasks.workunit.client.0.smithi046.stdout:4/430: mkdir d1/d13/d25/d3a/d92 0 2024-09-21T12:47:12.252 INFO:tasks.workunit.client.1.smithi176.stdout:5/979: creat d0/d13/d63/d72/d87/dcf/d110/f13d x:0 0 0 2024-09-21T12:47:12.254 INFO:tasks.workunit.client.1.smithi176.stdout:6/994: link d2/d6f/d146/lde d2/d6f/d146/d39/daf/d12f/l14b 0 2024-09-21T12:47:12.254 INFO:tasks.workunit.client.0.smithi046.stdout:2/390: symlink d16/d5c/l7c 0 2024-09-21T12:47:12.256 INFO:tasks.workunit.client.0.smithi046.stdout:9/497: link d11/d19/d36/d45/d64/f7f d11/f99 0 2024-09-21T12:47:12.257 INFO:tasks.workunit.client.0.smithi046.stdout:0/460: creat d6/d2f/d32/fb2 x:0 0 0 2024-09-21T12:47:12.258 INFO:tasks.workunit.client.1.smithi176.stdout:5/980: rename d0/d13/d5d/c67 to d0/d13/d63/d72/d87/dcf/d110/c13e 0 2024-09-21T12:47:12.260 INFO:tasks.workunit.client.1.smithi176.stdout:6/995: stat d2/f31 0 2024-09-21T12:47:12.262 INFO:tasks.workunit.client.1.smithi176.stdout:5/981: stat d0/lf0 0 2024-09-21T12:47:12.266 INFO:tasks.workunit.client.0.smithi046.stdout:8/373: fdatasync d1/fd 0 2024-09-21T12:47:12.267 INFO:tasks.workunit.client.0.smithi046.stdout:8/374: chown d1/d12/d46/f44 10 1 2024-09-21T12:47:12.267 INFO:tasks.workunit.client.1.smithi176.stdout:5/982: mknod d0/d13/d5d/d98/d120/c13f 0 2024-09-21T12:47:12.268 INFO:tasks.workunit.client.0.smithi046.stdout:1/359: creat d4/d13/d38/d53/d5a/f7c x:0 0 0 2024-09-21T12:47:12.269 INFO:tasks.workunit.client.1.smithi176.stdout:6/996: dread d2/dd/d26/f3d [0,4194304] 0 2024-09-21T12:47:12.269 INFO:tasks.workunit.client.0.smithi046.stdout:1/360: chown d4/d13/f1d 441719870 1 2024-09-21T12:47:12.271 INFO:tasks.workunit.client.1.smithi176.stdout:5/983: rmdir d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/dad 39 2024-09-21T12:47:12.272 INFO:tasks.workunit.client.1.smithi176.stdout:6/997: symlink d2/d6f/d7f/dbf/l14c 0 2024-09-21T12:47:12.273 INFO:tasks.workunit.client.1.smithi176.stdout:6/998: stat d2/d6f/d146/d1b/d37/ld4 0 2024-09-21T12:47:12.273 INFO:tasks.workunit.client.0.smithi046.stdout:3/348: mkdir d5/dc/d30/d7c 0 2024-09-21T12:47:12.274 INFO:tasks.workunit.client.1.smithi176.stdout:5/984: mknod d0/d13/d63/d8d/d117/d37/d55/c140 0 2024-09-21T12:47:12.278 INFO:tasks.workunit.client.0.smithi046.stdout:6/401: link de/d2a/d34/d4e/l5a de/d2a/d4c/d71/d7c/l83 0 2024-09-21T12:47:12.280 INFO:tasks.workunit.client.1.smithi176.stdout:5/985: dread d0/d13/d63/d8d/d117/d37/d55/f6e [0,4194304] 0 2024-09-21T12:47:12.280 INFO:tasks.workunit.client.0.smithi046.stdout:4/431: creat d1/d13/d25/d6b/f93 x:0 0 0 2024-09-21T12:47:12.281 INFO:tasks.workunit.client.0.smithi046.stdout:2/391: dwrite d16/d22/d2b/f6e [0,4194304] 0 2024-09-21T12:47:12.286 INFO:tasks.workunit.client.1.smithi176.stdout:5/986: rename d0/d13/d63/d8d/d117/le4 to d0/d13/d5d/d98/l141 0 2024-09-21T12:47:12.289 INFO:tasks.workunit.client.0.smithi046.stdout:8/375: symlink d1/d12/d46/l82 0 2024-09-21T12:47:12.292 INFO:tasks.workunit.client.0.smithi046.stdout:6/402: dread de/d2a/f5e [0,4194304] 0 2024-09-21T12:47:12.292 INFO:tasks.workunit.client.1.smithi176.stdout:6/999: dwrite d2/d6f/fd0 [0,4194304] 0 2024-09-21T12:47:12.292 INFO:tasks.workunit.client.0.smithi046.stdout:4/432: unlink d1/d27/d58/f4c 0 2024-09-21T12:47:12.294 INFO:tasks.workunit.client.0.smithi046.stdout:2/392: symlink d16/d22/d2b/d30/l7d 0 2024-09-21T12:47:12.295 INFO:tasks.workunit.client.1.smithi176.stdout:5/987: symlink d0/d13/d63/d8d/d117/d37/d55/dfc/d10e/dad/l142 0 2024-09-21T12:47:12.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/362: link d2/d4/df/d17/c5c d2/c72 0 2024-09-21T12:47:12.297 INFO:tasks.workunit.client.0.smithi046.stdout:7/363: write d2/d4/df/d17/f35 [28709,104471] 0 2024-09-21T12:47:12.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/393: read d16/d22/d38/f42 [1656691,113084] 0 2024-09-21T12:47:12.302 INFO:tasks.workunit.client.0.smithi046.stdout:7/364: write d2/d4/df/f4c [860879,117258] 0 2024-09-21T12:47:12.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/394: chown d16/f59 33498 1 2024-09-21T12:47:12.302 INFO:tasks.workunit.client.0.smithi046.stdout:7/365: read d2/d4/d43/d58/f61 [264468,93325] 0 2024-09-21T12:47:12.303 INFO:tasks.workunit.client.1.smithi176.stdout:5/988: mkdir d0/d13/d63/d8d/d117/d37/d55/dfc/d143 0 2024-09-21T12:47:12.303 INFO:tasks.workunit.client.0.smithi046.stdout:2/395: dread - d16/d22/d2b/d30/d67/f7b zero size 2024-09-21T12:47:12.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/376: creat d1/d12/d53/f83 x:0 0 0 2024-09-21T12:47:12.307 INFO:tasks.workunit.client.1.smithi176.stdout:5/989: readlink d0/d13/d63/d72/d87/d92/lce 0 2024-09-21T12:47:12.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/403: creat de/d2a/d4c/d69/f84 x:0 0 0 2024-09-21T12:47:12.309 INFO:tasks.workunit.client.0.smithi046.stdout:4/433: fdatasync d1/d27/d37/f49 0 2024-09-21T12:47:12.310 INFO:tasks.workunit.client.0.smithi046.stdout:6/404: write fb [2164755,67532] 0 2024-09-21T12:47:12.311 INFO:tasks.workunit.client.1.smithi176.stdout:5/990: fsync d0/d13/d63/d66/f69 0 2024-09-21T12:47:12.315 INFO:tasks.workunit.client.0.smithi046.stdout:0/461: link d6/d7/d13/d7b/da2/f5a d6/d7/d13/fb3 0 2024-09-21T12:47:12.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:11 smithi176 ceph-mon[35476]: pgmap v32: 65 pgs: 65 active+clean; 2.7 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 83 MiB/s rd, 260 MiB/s wr, 485 op/s 2024-09-21T12:47:12.316 INFO:tasks.workunit.client.0.smithi046.stdout:6/405: dread de/d2a/d34/d4e/d55/f73 [0,4194304] 0 2024-09-21T12:47:12.317 INFO:tasks.workunit.client.1.smithi176.stdout:5/991: mkdir d0/d13/d63/d8d/d117/d37/db5/db7/d144 0 2024-09-21T12:47:12.318 INFO:tasks.workunit.client.0.smithi046.stdout:3/349: dwrite d5/f8 [0,4194304] 0 2024-09-21T12:47:12.319 INFO:tasks.workunit.client.0.smithi046.stdout:1/361: getdents d4/d29 0 2024-09-21T12:47:12.322 INFO:tasks.workunit.client.1.smithi176.stdout:5/992: unlink d0/d13/d5d/fe5 0 2024-09-21T12:47:12.325 INFO:tasks.workunit.client.0.smithi046.stdout:2/396: symlink d16/l7e 0 2024-09-21T12:47:12.329 INFO:tasks.workunit.client.0.smithi046.stdout:8/377: unlink d1/d12/d53/d60/f7b 0 2024-09-21T12:47:12.331 INFO:tasks.workunit.client.1.smithi176.stdout:5/993: truncate d0/d13/f26 1614470 0 2024-09-21T12:47:12.332 INFO:tasks.workunit.client.0.smithi046.stdout:0/462: dread d6/d7/d13/d7b/da2/f26 [0,4194304] 0 2024-09-21T12:47:12.336 INFO:tasks.workunit.client.1.smithi176.stdout:8/981: sync 2024-09-21T12:47:12.337 INFO:tasks.workunit.client.1.smithi176.stdout:5/994: dwrite d0/d13/f3c [0,4194304] 0 2024-09-21T12:47:12.337 INFO:tasks.workunit.client.0.smithi046.stdout:6/406: creat de/d2a/d34/d4e/d55/f85 x:0 0 0 2024-09-21T12:47:12.338 INFO:tasks.workunit.client.0.smithi046.stdout:3/350: creat d5/dc/d28/d63/f7d x:0 0 0 2024-09-21T12:47:12.339 INFO:tasks.workunit.client.0.smithi046.stdout:1/362: rename d4/d13/d38/d48/f72 to d4/d13/f7d 0 2024-09-21T12:47:12.340 INFO:tasks.workunit.client.1.smithi176.stdout:5/995: rmdir d0/d13/d5d/d98/da5/de1/d10f 39 2024-09-21T12:47:12.342 INFO:tasks.workunit.client.1.smithi176.stdout:8/982: mknod d6/d16/d9c/dad/c131 0 2024-09-21T12:47:12.342 INFO:tasks.workunit.client.1.smithi176.stdout:8/983: chown d6/d8/d24/d35/f94 93033 1 2024-09-21T12:47:12.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/366: dwrite d2/d4/f3c [0,4194304] 0 2024-09-21T12:47:12.343 INFO:tasks.workunit.client.1.smithi176.stdout:5/996: chown d0/d13/d63/d8d/c126 129679 1 2024-09-21T12:47:12.343 INFO:tasks.workunit.client.1.smithi176.stdout:5/997: chown d0/d13/d63/d66/f69 186480858 1 2024-09-21T12:47:12.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/434: mknod d1/d27/c94 0 2024-09-21T12:47:12.347 INFO:tasks.workunit.client.0.smithi046.stdout:8/378: symlink d1/d12/d46/d35/d36/d51/l84 0 2024-09-21T12:47:12.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/463: chown d6/d60/f89 403 1 2024-09-21T12:47:12.350 INFO:tasks.workunit.client.0.smithi046.stdout:4/435: truncate d1/d27/d58/f90 740240 0 2024-09-21T12:47:12.351 INFO:tasks.workunit.client.1.smithi176.stdout:5/998: dwrite d0/d10/f4c [4194304,4194304] 0 2024-09-21T12:47:12.352 INFO:tasks.workunit.client.0.smithi046.stdout:8/379: dread d1/d12/d46/d35/d5b/f6d [0,4194304] 0 2024-09-21T12:47:12.353 INFO:tasks.workunit.client.0.smithi046.stdout:6/407: creat de/d2a/d4c/d69/f86 x:0 0 0 2024-09-21T12:47:12.353 INFO:tasks.workunit.client.0.smithi046.stdout:2/397: mkdir d16/d22/d7f 0 2024-09-21T12:47:12.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/363: rename d4/d13/f16 to d4/d4d/f7e 0 2024-09-21T12:47:12.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/436: dread d1/d27/d58/f90 [0,4194304] 0 2024-09-21T12:47:12.358 INFO:tasks.workunit.client.0.smithi046.stdout:7/367: dwrite d2/d4/df/d17/d31/d34/f4b [0,4194304] 0 2024-09-21T12:47:12.359 INFO:tasks.workunit.client.1.smithi176.stdout:5/999: fsync d0/d13/d63/d72/fde 0 2024-09-21T12:47:12.359 INFO:tasks.workunit.client.0.smithi046.stdout:2/398: chown d16/d22/d2b/f6e 1513401495 1 2024-09-21T12:47:12.359 INFO:tasks.workunit.client.0.smithi046.stdout:1/364: dread - d4/d13/d38/f6f zero size 2024-09-21T12:47:12.361 INFO:tasks.workunit.client.0.smithi046.stdout:0/464: fdatasync d6/d7/d13/f36 0 2024-09-21T12:47:12.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/365: read - d4/f77 zero size 2024-09-21T12:47:12.363 INFO:tasks.workunit.client.0.smithi046.stdout:1/366: fsync d4/f5 0 2024-09-21T12:47:12.365 INFO:tasks.workunit.client.0.smithi046.stdout:0/465: dread - d6/d7/d37/d53/f7c zero size 2024-09-21T12:47:12.366 INFO:tasks.workunit.client.0.smithi046.stdout:2/399: dread - d16/d22/d2b/d30/d67/f72 zero size 2024-09-21T12:47:12.366 INFO:tasks.workunit.client.0.smithi046.stdout:1/367: truncate d4/d13/d6b/f7b 336172 0 2024-09-21T12:47:12.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/380: rename d1/f4f to d1/d12/d46/d35/d5b/f85 0 2024-09-21T12:47:12.368 INFO:tasks.workunit.client.0.smithi046.stdout:2/400: read d16/d22/f2a [518791,109159] 0 2024-09-21T12:47:12.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/381: chown d1/d12/d46/d35/d36/d51 305 1 2024-09-21T12:47:12.370 INFO:tasks.workunit.client.0.smithi046.stdout:6/408: creat de/d2a/d4c/d71/d7c/f87 x:0 0 0 2024-09-21T12:47:12.371 INFO:tasks.workunit.client.0.smithi046.stdout:4/437: write d1/d13/f81 [3768416,120406] 0 2024-09-21T12:47:12.376 INFO:tasks.workunit.client.0.smithi046.stdout:0/466: mknod d6/d7/d13/d43/d52/cb4 0 2024-09-21T12:47:12.377 INFO:tasks.workunit.client.0.smithi046.stdout:0/467: write d6/f18 [8540783,48436] 0 2024-09-21T12:47:12.377 INFO:tasks.workunit.client.0.smithi046.stdout:8/382: fdatasync d1/d12/d46/d35/d5b/f69 0 2024-09-21T12:47:12.379 INFO:tasks.workunit.client.0.smithi046.stdout:0/468: chown d6/d7/d9/ff 100664233 1 2024-09-21T12:47:12.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/409: write de/f44 [266362,28648] 0 2024-09-21T12:47:12.380 INFO:tasks.workunit.client.1.smithi176.stdout:8/984: write d6/d8/d24/d35/d51/fc9 [638146,22970] 0 2024-09-21T12:47:12.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/368: symlink d2/d4/df/d6f/l73 0 2024-09-21T12:47:12.382 INFO:tasks.workunit.client.0.smithi046.stdout:2/401: mknod d16/d22/d7f/c80 0 2024-09-21T12:47:12.382 INFO:tasks.workunit.client.0.smithi046.stdout:7/369: dread - d2/d4/f54 zero size 2024-09-21T12:47:12.382 INFO:tasks.workunit.client.0.smithi046.stdout:0/469: write d6/d7/d9/d54/f9d [857821,101206] 0 2024-09-21T12:47:12.383 INFO:tasks.workunit.client.1.smithi176.stdout:8/985: symlink d6/de7/l132 0 2024-09-21T12:47:12.387 INFO:tasks.workunit.client.0.smithi046.stdout:8/383: mkdir d1/d12/d46/d35/d36/d86 0 2024-09-21T12:47:12.388 INFO:tasks.workunit.client.0.smithi046.stdout:8/384: write d1/d12/d46/d35/d7d/f67 [797787,108975] 0 2024-09-21T12:47:12.392 INFO:tasks.workunit.client.0.smithi046.stdout:3/351: dread d5/f20 [0,4194304] 0 2024-09-21T12:47:12.393 INFO:tasks.workunit.client.1.smithi176.stdout:8/986: link d6/d8/l65 d6/d16/d36/d67/dd1/d115/l133 0 2024-09-21T12:47:12.396 INFO:tasks.workunit.client.1.smithi176.stdout:8/987: creat d6/de7/f134 x:0 0 0 2024-09-21T12:47:12.400 INFO:tasks.workunit.client.0.smithi046.stdout:3/352: unlink d5/dc/c18 0 2024-09-21T12:47:12.401 INFO:tasks.workunit.client.0.smithi046.stdout:3/353: write d5/dc/d30/d34/f61 [152427,66806] 0 2024-09-21T12:47:12.402 INFO:tasks.workunit.client.0.smithi046.stdout:3/354: truncate d5/dc/d26/f37 1689562 0 2024-09-21T12:47:12.403 INFO:tasks.workunit.client.0.smithi046.stdout:8/385: creat d1/d78/f87 x:0 0 0 2024-09-21T12:47:12.405 INFO:tasks.workunit.client.0.smithi046.stdout:8/386: mknod d1/d12/d53/d60/c88 0 2024-09-21T12:47:12.406 INFO:tasks.workunit.client.0.smithi046.stdout:8/387: chown d1/d12/d1a/d33/c66 0 1 2024-09-21T12:47:12.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/402: getdents d16/d22/d38 0 2024-09-21T12:47:12.408 INFO:tasks.workunit.client.0.smithi046.stdout:8/388: read d1/d12/d46/d35/d5b/f70 [419225,56518] 0 2024-09-21T12:47:12.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/355: getdents d5/dc/d30/d34 0 2024-09-21T12:47:12.411 INFO:tasks.workunit.client.0.smithi046.stdout:4/438: truncate d1/f57 3639575 0 2024-09-21T12:47:12.411 INFO:tasks.workunit.client.0.smithi046.stdout:2/403: dread d16/d22/d2b/f6e [0,4194304] 0 2024-09-21T12:47:12.413 INFO:tasks.workunit.client.0.smithi046.stdout:4/439: write d1/f5d [3534806,61559] 0 2024-09-21T12:47:12.414 INFO:tasks.workunit.client.0.smithi046.stdout:4/440: fdatasync d1/d13/d8b/f89 0 2024-09-21T12:47:12.415 INFO:tasks.workunit.client.0.smithi046.stdout:0/470: write d6/f21 [3062884,30618] 0 2024-09-21T12:47:12.417 INFO:tasks.workunit.client.0.smithi046.stdout:6/410: write de/d35/f43 [11738,87043] 0 2024-09-21T12:47:12.423 INFO:tasks.workunit.client.1.smithi176.stdout:8/988: dwrite d6/d8/d24/d35/f4a [4194304,4194304] 0 2024-09-21T12:47:12.425 INFO:tasks.workunit.client.1.smithi176.stdout:8/989: truncate d6/db/d13/d98/da1/f114 369679 0 2024-09-21T12:47:12.428 INFO:tasks.workunit.client.1.smithi176.stdout:8/990: fsync d6/d8/d24/d35/f94 0 2024-09-21T12:47:12.436 INFO:tasks.workunit.client.1.smithi176.stdout:8/991: write d6/d8/d24/f3f [89433,42786] 0 2024-09-21T12:47:12.438 INFO:tasks.workunit.client.1.smithi176.stdout:8/992: write d6/d8/f33 [2204540,123202] 0 2024-09-21T12:47:12.440 INFO:tasks.workunit.client.1.smithi176.stdout:8/993: creat d6/d8/d54/dca/f135 x:0 0 0 2024-09-21T12:47:12.442 INFO:tasks.workunit.client.1.smithi176.stdout:8/994: readlink d6/d8/d24/d5e/d127/d89/d8a/dd4/le9 0 2024-09-21T12:47:12.446 INFO:tasks.workunit.client.1.smithi176.stdout:8/995: write d6/d8/d24/d5e/d127/f88 [3684065,68673] 0 2024-09-21T12:47:12.447 INFO:tasks.workunit.client.1.smithi176.stdout:8/996: read d6/d8/d24/d35/f4a [3903320,36621] 0 2024-09-21T12:47:12.449 INFO:tasks.workunit.client.1.smithi176.stdout:8/997: rmdir d6/d8/d24/d5e/de8 39 2024-09-21T12:47:12.450 INFO:tasks.workunit.client.1.smithi176.stdout:8/998: creat d6/d8/d54/f136 x:0 0 0 2024-09-21T12:47:12.458 INFO:tasks.workunit.client.1.smithi176.stdout:8/999: dwrite d6/d16/d9c/fbf [4194304,4194304] 0 2024-09-21T12:47:12.463 INFO:tasks.workunit.client.1.smithi176.stderr:+ rm -rf -- ./tmp.kdE1rqEtKd 2024-09-21T12:47:12.498 INFO:tasks.workunit.client.0.smithi046.stdout:0/471: mknod d6/d7/d37/cb5 0 2024-09-21T12:47:12.498 INFO:tasks.workunit.client.0.smithi046.stdout:6/411: chown de/d2a/f5e 47999 1 2024-09-21T12:47:12.499 INFO:tasks.workunit.client.0.smithi046.stdout:8/389: write d1/d12/d46/d35/d5b/f69 [270330,36158] 0 2024-09-21T12:47:12.500 INFO:tasks.workunit.client.0.smithi046.stdout:2/404: write d16/d22/d38/f42 [2990162,101642] 0 2024-09-21T12:47:12.500 INFO:tasks.workunit.client.0.smithi046.stdout:4/441: link d1/c3f d1/d27/d82/c95 0 2024-09-21T12:47:12.502 INFO:tasks.workunit.client.0.smithi046.stdout:6/412: read - de/d2a/d34/d4e/d55/f85 zero size 2024-09-21T12:47:12.502 INFO:tasks.workunit.client.0.smithi046.stdout:7/370: dwrite d2/d4/f47 [0,4194304] 0 2024-09-21T12:47:12.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/405: chown d16/f27 0 1 2024-09-21T12:47:12.621 INFO:tasks.workunit.client.0.smithi046.stdout:0/472: mkdir d6/d7/d13/db6 0 2024-09-21T12:47:12.623 INFO:tasks.workunit.client.0.smithi046.stdout:7/371: fsync d2/d4/f2f 0 2024-09-21T12:47:12.623 INFO:tasks.workunit.client.0.smithi046.stdout:6/413: chown de/d2a/d4d/l52 83719976 1 2024-09-21T12:47:12.623 INFO:tasks.workunit.client.0.smithi046.stdout:0/473: write d6/d2f/f9e [182508,44592] 0 2024-09-21T12:47:12.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/414: fdatasync de/d2a/d4c/d71/d7c/f87 0 2024-09-21T12:47:12.624 INFO:tasks.workunit.client.0.smithi046.stdout:7/372: chown d2/d4/df/d17/d31/f45 738603 1 2024-09-21T12:47:12.635 INFO:tasks.workunit.client.0.smithi046.stdout:8/390: dread d1/d12/d46/f49 [0,4194304] 0 2024-09-21T12:47:12.668 INFO:tasks.workunit.client.0.smithi046.stdout:6/415: chown de/l1b 144878527 1 2024-09-21T12:47:12.669 INFO:tasks.workunit.client.0.smithi046.stdout:7/373: mknod d2/d4/c74 0 2024-09-21T12:47:12.670 INFO:tasks.workunit.client.0.smithi046.stdout:0/474: mkdir d6/d7/d13/d43/d52/d63/d7f/d38/db7 0 2024-09-21T12:47:12.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/391: creat d1/d12/d46/d35/d36/d51/f89 x:0 0 0 2024-09-21T12:47:12.672 INFO:tasks.workunit.client.0.smithi046.stdout:4/442: mknod d1/d13/d25/d29/d43/d84/c96 0 2024-09-21T12:47:12.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/416: unlink de/d35/l40 0 2024-09-21T12:47:12.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/374: unlink d2/d4/df/d42/l6b 0 2024-09-21T12:47:12.676 INFO:tasks.workunit.client.0.smithi046.stdout:0/475: symlink d6/d7/d13/d43/d52/d63/d7f/d38/da6/lb8 0 2024-09-21T12:47:12.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/417: creat de/d48/f88 x:0 0 0 2024-09-21T12:47:12.678 INFO:tasks.workunit.client.0.smithi046.stdout:6/418: stat de/d2a/l56 0 2024-09-21T12:47:12.679 INFO:tasks.workunit.client.0.smithi046.stdout:7/375: rename d2/d4/d43/d58/c5e to d2/d4/d43/c75 0 2024-09-21T12:47:12.680 INFO:tasks.workunit.client.0.smithi046.stdout:7/376: chown d2/d4/df/d17/d31/d34/f48 700450 1 2024-09-21T12:47:12.682 INFO:tasks.workunit.client.0.smithi046.stdout:8/392: mknod d1/d12/d1a/d33/d6c/c8a 0 2024-09-21T12:47:12.683 INFO:tasks.workunit.client.0.smithi046.stdout:0/476: truncate d6/d7/d13/d7b/da2/f27 265145 0 2024-09-21T12:47:12.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/419: rename de/d2a/d4c/f6f to de/d35/f89 0 2024-09-21T12:47:12.687 INFO:tasks.workunit.client.0.smithi046.stdout:4/443: creat d1/f97 x:0 0 0 2024-09-21T12:47:12.693 INFO:tasks.workunit.client.0.smithi046.stdout:0/477: dread - d6/d2f/d32/f47 zero size 2024-09-21T12:47:12.696 INFO:tasks.workunit.client.0.smithi046.stdout:4/444: dwrite d1/d27/d58/f5c [4194304,4194304] 0 2024-09-21T12:47:12.698 INFO:tasks.workunit.client.0.smithi046.stdout:7/377: dread d2/fe [0,4194304] 0 2024-09-21T12:47:12.700 INFO:tasks.workunit.client.0.smithi046.stdout:8/393: creat d1/d12/d46/d35/f8b x:0 0 0 2024-09-21T12:47:12.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/420: dwrite de/d2a/d34/f3b [0,4194304] 0 2024-09-21T12:47:12.703 INFO:tasks.workunit.client.0.smithi046.stdout:0/478: rename d6/d7/d13/d43/d52/d63/d7f/d38/da6/lb8 to d6/d60/lb9 0 2024-09-21T12:47:12.703 INFO:tasks.workunit.client.0.smithi046.stdout:8/394: truncate d1/d12/d46/d35/d7d/f67 1698474 0 2024-09-21T12:47:12.707 INFO:tasks.workunit.client.0.smithi046.stdout:7/378: creat d2/d4/df/d6f/f76 x:0 0 0 2024-09-21T12:47:12.710 INFO:tasks.workunit.client.0.smithi046.stdout:8/395: dread d1/d12/d46/d35/d5b/f70 [0,4194304] 0 2024-09-21T12:47:12.714 INFO:tasks.workunit.client.0.smithi046.stdout:4/445: rename d1/d27/d46/f83 to d1/d27/d46/d78/f98 0 2024-09-21T12:47:12.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/421: read de/f32 [3923737,79563] 0 2024-09-21T12:47:12.717 INFO:tasks.workunit.client.0.smithi046.stdout:6/422: chown de/d2a/d4c/d71/d7c/l83 149270426 1 2024-09-21T12:47:12.717 INFO:tasks.workunit.client.0.smithi046.stdout:6/423: read f9 [378138,103876] 0 2024-09-21T12:47:12.718 INFO:tasks.workunit.client.0.smithi046.stdout:8/396: dwrite d1/f8 [0,4194304] 0 2024-09-21T12:47:12.730 INFO:tasks.workunit.client.0.smithi046.stdout:6/424: rename de/d2a/d34/l3e to de/d2a/d4d/l8a 0 2024-09-21T12:47:12.732 INFO:tasks.workunit.client.0.smithi046.stdout:4/446: mknod d1/d27/d37/d8f/c99 0 2024-09-21T12:47:12.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/397: truncate d1/f20 4855935 0 2024-09-21T12:47:12.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/479: link d6/f40 d6/d2f/d32/fba 0 2024-09-21T12:47:12.738 INFO:tasks.workunit.client.0.smithi046.stdout:6/425: mknod de/d2a/d4c/d71/d7c/c8b 0 2024-09-21T12:47:12.740 INFO:tasks.workunit.client.0.smithi046.stdout:2/406: write d16/d22/d2b/f51 [195464,1079] 0 2024-09-21T12:47:12.740 INFO:tasks.workunit.client.0.smithi046.stdout:2/407: stat d16/d5c 0 2024-09-21T12:47:12.743 INFO:tasks.workunit.client.0.smithi046.stdout:7/379: getdents d2 0 2024-09-21T12:47:12.743 INFO:tasks.workunit.client.0.smithi046.stdout:7/380: stat d2/d4/df 0 2024-09-21T12:47:12.744 INFO:tasks.workunit.client.0.smithi046.stdout:7/381: read d2/d4/f47 [3230506,51561] 0 2024-09-21T12:47:12.746 INFO:tasks.workunit.client.0.smithi046.stdout:7/382: write d2/d4/df/d17/d31/d34/f4b [3064932,46997] 0 2024-09-21T12:47:12.746 INFO:tasks.workunit.client.0.smithi046.stdout:0/480: creat d6/d2f/d32/fbb x:0 0 0 2024-09-21T12:47:12.748 INFO:tasks.workunit.client.0.smithi046.stdout:0/481: write d6/d7/d37/d53/f55 [543691,118081] 0 2024-09-21T12:47:12.753 INFO:tasks.workunit.client.0.smithi046.stdout:7/383: dwrite d2/dd/f3d [4194304,4194304] 0 2024-09-21T12:47:12.754 INFO:tasks.workunit.client.0.smithi046.stdout:7/384: chown d2/d4/df/d17/l21 80 1 2024-09-21T12:47:12.755 INFO:tasks.workunit.client.0.smithi046.stdout:2/408: rename d16/l33 to d16/d22/d2b/d30/l81 0 2024-09-21T12:47:12.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/447: rename d1/d27/c94 to d1/d27/c9a 0 2024-09-21T12:47:12.766 INFO:tasks.workunit.client.0.smithi046.stdout:7/385: stat d2/dd/c53 0 2024-09-21T12:47:12.769 INFO:tasks.workunit.client.0.smithi046.stdout:2/409: creat d16/d22/d38/d77/f82 x:0 0 0 2024-09-21T12:47:12.771 INFO:tasks.workunit.client.0.smithi046.stdout:7/386: mkdir d2/d37/d77 0 2024-09-21T12:47:12.775 INFO:tasks.workunit.client.0.smithi046.stdout:4/448: mknod d1/d13/d25/c9b 0 2024-09-21T12:47:12.776 INFO:tasks.workunit.client.0.smithi046.stdout:7/387: write d2/f3 [3021628,21975] 0 2024-09-21T12:47:12.779 INFO:tasks.workunit.client.0.smithi046.stdout:2/410: dwrite d16/f27 [0,4194304] 0 2024-09-21T12:47:12.781 INFO:tasks.workunit.client.0.smithi046.stdout:0/482: rename d6/d7/c17 to d6/d7/d13/cbc 0 2024-09-21T12:47:12.782 INFO:tasks.workunit.client.0.smithi046.stdout:4/449: symlink d1/d27/d46/d78/d8a/l9c 0 2024-09-21T12:47:12.787 INFO:tasks.workunit.client.0.smithi046.stdout:7/388: rename d2/d4/df/d17/f39 to d2/f78 0 2024-09-21T12:47:12.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/411: creat d16/d22/d2b/f83 x:0 0 0 2024-09-21T12:47:12.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/412: mknod d16/d5c/c84 0 2024-09-21T12:47:12.799 INFO:tasks.workunit.client.0.smithi046.stdout:4/450: getdents d1/d13/d8b 0 2024-09-21T12:47:12.800 INFO:tasks.workunit.client.0.smithi046.stdout:4/451: fsync d1/f5d 0 2024-09-21T12:47:12.800 INFO:tasks.workunit.client.0.smithi046.stdout:8/398: write d1/d12/d46/d35/d36/d51/f5a [136350,95505] 0 2024-09-21T12:47:12.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/452: fdatasync d1/d27/d46/f48 0 2024-09-21T12:47:12.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/399: mkdir d1/d12/d46/d35/d36/d51/d8c 0 2024-09-21T12:47:12.805 INFO:tasks.workunit.client.0.smithi046.stdout:4/453: mkdir d1/d27/d37/d8f/d9d 0 2024-09-21T12:47:12.814 INFO:tasks.workunit.client.0.smithi046.stdout:4/454: dwrite d1/d27/d46/d78/f98 [0,4194304] 0 2024-09-21T12:47:12.815 INFO:tasks.workunit.client.0.smithi046.stdout:6/426: dwrite de/f28 [0,4194304] 0 2024-09-21T12:47:12.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/427: dread de/d2a/f33 [0,4194304] 0 2024-09-21T12:47:12.819 INFO:tasks.workunit.client.0.smithi046.stdout:6/428: chown de/f28 52229 1 2024-09-21T12:47:12.825 INFO:tasks.workunit.client.0.smithi046.stdout:2/413: write fc [791352,44641] 0 2024-09-21T12:47:12.828 INFO:tasks.workunit.client.0.smithi046.stdout:2/414: write d16/f1a [1203485,127908] 0 2024-09-21T12:47:12.829 INFO:tasks.workunit.client.0.smithi046.stdout:6/429: truncate de/f2c 1005508 0 2024-09-21T12:47:12.832 INFO:tasks.workunit.client.0.smithi046.stdout:4/455: dread d1/f57 [0,4194304] 0 2024-09-21T12:47:12.837 INFO:tasks.workunit.client.0.smithi046.stdout:2/415: symlink d16/d5c/l85 0 2024-09-21T12:47:12.838 INFO:tasks.workunit.client.0.smithi046.stdout:2/416: write f15 [4126869,32820] 0 2024-09-21T12:47:12.839 INFO:tasks.workunit.client.0.smithi046.stdout:2/417: chown d16/d22/d2b/l3c 2 1 2024-09-21T12:47:12.839 INFO:tasks.workunit.client.0.smithi046.stdout:4/456: rmdir d1/d5f 39 2024-09-21T12:47:12.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/457: chown d1/d13/d25/d3a/f4d 0 1 2024-09-21T12:47:12.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/458: dread - d1/d27/d46/f86 zero size 2024-09-21T12:47:12.843 INFO:tasks.workunit.client.0.smithi046.stdout:4/459: write d1/d13/d8b/f89 [880801,89989] 0 2024-09-21T12:47:12.844 INFO:tasks.workunit.client.0.smithi046.stdout:7/389: write d2/dd/f3f [1354825,120031] 0 2024-09-21T12:47:12.848 INFO:tasks.workunit.client.0.smithi046.stdout:2/418: dread d16/d22/d75/f74 [0,4194304] 0 2024-09-21T12:47:12.850 INFO:tasks.workunit.client.0.smithi046.stdout:6/430: dread de/f1d [0,4194304] 0 2024-09-21T12:47:12.856 INFO:tasks.workunit.client.0.smithi046.stdout:4/460: symlink d1/d27/d46/l9e 0 2024-09-21T12:47:12.857 INFO:tasks.workunit.client.0.smithi046.stdout:2/419: symlink d16/d22/d38/l86 0 2024-09-21T12:47:12.858 INFO:tasks.workunit.client.0.smithi046.stdout:2/420: chown d16/f48 13 1 2024-09-21T12:47:12.858 INFO:tasks.workunit.client.0.smithi046.stdout:8/400: truncate d1/fd 2470604 0 2024-09-21T12:47:12.859 INFO:tasks.workunit.client.0.smithi046.stdout:6/431: creat de/d2a/d4c/d77/f8c x:0 0 0 2024-09-21T12:47:12.860 INFO:tasks.workunit.client.0.smithi046.stdout:7/390: mknod d2/d4/df/d17/c79 0 2024-09-21T12:47:12.861 INFO:tasks.workunit.client.0.smithi046.stdout:2/421: rmdir d16/d22/d38 39 2024-09-21T12:47:12.863 INFO:tasks.workunit.client.0.smithi046.stdout:7/391: read - d2/d4/df/d17/f3b zero size 2024-09-21T12:47:12.866 INFO:tasks.workunit.client.0.smithi046.stdout:8/401: dwrite d1/d12/f3b [4194304,4194304] 0 2024-09-21T12:47:12.867 INFO:tasks.workunit.client.0.smithi046.stdout:6/432: dread de/f39 [4194304,4194304] 0 2024-09-21T12:47:12.868 INFO:tasks.workunit.client.0.smithi046.stdout:2/422: getdents d16/d22 0 2024-09-21T12:47:12.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/402: readlink d1/d12/d46/d35/d7d/l75 0 2024-09-21T12:47:12.873 INFO:tasks.workunit.client.0.smithi046.stdout:7/392: dread d2/d4/df/f1d [0,4194304] 0 2024-09-21T12:47:12.874 INFO:tasks.workunit.client.0.smithi046.stdout:2/423: symlink d16/d5c/l87 0 2024-09-21T12:47:12.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/424: dread - d16/f59 zero size 2024-09-21T12:47:12.879 INFO:tasks.workunit.client.0.smithi046.stdout:8/403: dwrite d1/d12/f3b [4194304,4194304] 0 2024-09-21T12:47:12.880 INFO:tasks.workunit.client.0.smithi046.stdout:8/404: readlink d1/lc 0 2024-09-21T12:47:12.881 INFO:tasks.workunit.client.0.smithi046.stdout:2/425: mknod d16/d5c/c88 0 2024-09-21T12:47:12.881 INFO:tasks.workunit.client.0.smithi046.stdout:7/393: rename d2/d4/d43/d58/f61 to d2/d37/d77/f7a 0 2024-09-21T12:47:12.883 INFO:tasks.workunit.client.0.smithi046.stdout:2/426: write d16/d22/d2b/f6f [1002249,122708] 0 2024-09-21T12:47:12.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/405: read d1/d12/f72 [18883,107730] 0 2024-09-21T12:47:12.890 INFO:tasks.workunit.client.0.smithi046.stdout:8/406: stat d1/d12/d1a/c25 0 2024-09-21T12:47:12.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/433: dread de/d48/f4a [4194304,4194304] 0 2024-09-21T12:47:12.892 INFO:tasks.workunit.client.0.smithi046.stdout:8/407: truncate d1/d12/d1a/f6b 512131 0 2024-09-21T12:47:12.893 INFO:tasks.workunit.client.0.smithi046.stdout:7/394: symlink d2/d4/df/d17/l7b 0 2024-09-21T12:47:12.894 INFO:tasks.workunit.client.0.smithi046.stdout:8/408: chown d1/d12/d46/d35/d5b/f69 213448009 1 2024-09-21T12:47:12.896 INFO:tasks.workunit.client.0.smithi046.stdout:2/427: creat d16/d22/d38/d77/f89 x:0 0 0 2024-09-21T12:47:12.899 INFO:tasks.workunit.client.0.smithi046.stdout:2/428: dread d16/d22/d38/f4f [0,4194304] 0 2024-09-21T12:47:12.900 INFO:tasks.workunit.client.0.smithi046.stdout:7/395: fdatasync d2/d4/d43/f6e 0 2024-09-21T12:47:12.906 INFO:tasks.workunit.client.0.smithi046.stdout:2/429: rename d16/d5c/d63/l71 to d16/d22/d38/d77/l8a 0 2024-09-21T12:47:12.907 INFO:tasks.workunit.client.0.smithi046.stdout:2/430: chown d16/d22/d38/d77/d7a 41381849 1 2024-09-21T12:47:12.907 INFO:tasks.workunit.client.0.smithi046.stdout:8/409: dread d1/d12/f3b [0,4194304] 0 2024-09-21T12:47:12.908 INFO:tasks.workunit.client.0.smithi046.stdout:7/396: creat d2/d4/df/d17/f7c x:0 0 0 2024-09-21T12:47:12.909 INFO:tasks.workunit.client.0.smithi046.stdout:7/397: stat d2/d4/df/d42 0 2024-09-21T12:47:12.910 INFO:tasks.workunit.client.0.smithi046.stdout:7/398: readlink d2/d4/d43/l5f 0 2024-09-21T12:47:12.913 INFO:tasks.workunit.client.0.smithi046.stdout:6/434: link de/d2a/d34/d4e/l5a de/d2a/d34/d4e/l8d 0 2024-09-21T12:47:12.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/431: dread d16/f48 [0,4194304] 0 2024-09-21T12:47:12.919 INFO:tasks.workunit.client.0.smithi046.stdout:2/432: dread - d16/d22/d2b/d30/d67/f72 zero size 2024-09-21T12:47:12.922 INFO:tasks.workunit.client.0.smithi046.stdout:8/410: creat d1/d12/d46/d35/f8d x:0 0 0 2024-09-21T12:47:12.923 INFO:tasks.workunit.client.0.smithi046.stdout:2/433: creat d16/d22/d38/f8b x:0 0 0 2024-09-21T12:47:12.925 INFO:tasks.workunit.client.0.smithi046.stdout:6/435: link de/d2a/f2f de/d2a/d34/d4e/d55/f8e 0 2024-09-21T12:47:12.929 INFO:tasks.workunit.client.0.smithi046.stdout:2/434: dwrite d16/f21 [0,4194304] 0 2024-09-21T12:47:12.932 INFO:tasks.workunit.client.0.smithi046.stdout:6/436: mkdir de/d2a/d4c/d77/d8f 0 2024-09-21T12:47:12.933 INFO:tasks.workunit.client.0.smithi046.stdout:6/437: dread - de/d2a/d4c/d69/f86 zero size 2024-09-21T12:47:12.934 INFO:tasks.workunit.client.0.smithi046.stdout:8/411: creat d1/d12/d46/d35/d7d/d6a/f8e x:0 0 0 2024-09-21T12:47:12.935 INFO:tasks.workunit.client.0.smithi046.stdout:7/399: truncate d2/d4/df/d17/f30 1264361 0 2024-09-21T12:47:12.936 INFO:tasks.workunit.client.0.smithi046.stdout:8/412: chown d1/d12/f18 2501356 1 2024-09-21T12:47:12.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/399: sync 2024-09-21T12:47:12.939 INFO:tasks.workunit.client.0.smithi046.stdout:8/413: truncate d1/d12/d46/d35/d7d/f4a 1928173 0 2024-09-21T12:47:12.941 INFO:tasks.workunit.client.0.smithi046.stdout:5/400: rmdir d4/dc/d13/d5b/d2d/d43 39 2024-09-21T12:47:12.952 INFO:tasks.workunit.client.0.smithi046.stdout:6/438: truncate de/f1d 316483 0 2024-09-21T12:47:12.954 INFO:tasks.workunit.client.0.smithi046.stdout:6/439: fdatasync de/d35/f43 0 2024-09-21T12:47:12.954 INFO:tasks.workunit.client.0.smithi046.stdout:5/401: mknod d4/d22/d10/c7c 0 2024-09-21T12:47:12.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/414: rmdir d1/d12/d46/d35/d7f 0 2024-09-21T12:47:12.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/435: dwrite d16/d22/d38/f53 [0,4194304] 0 2024-09-21T12:47:12.962 INFO:tasks.workunit.client.0.smithi046.stdout:6/440: dread de/d2a/d34/f6a [0,4194304] 0 2024-09-21T12:47:12.963 INFO:tasks.workunit.client.0.smithi046.stdout:8/415: chown d1/d12/d1a/d33/f59 33 1 2024-09-21T12:47:12.967 INFO:tasks.workunit.client.0.smithi046.stdout:7/400: dread d2/f32 [0,4194304] 0 2024-09-21T12:47:12.980 INFO:tasks.workunit.client.0.smithi046.stdout:2/436: mknod d16/d22/d2b/d30/c8c 0 2024-09-21T12:47:12.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/441: mknod de/d2a/c90 0 2024-09-21T12:47:12.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/442: dread - de/d2a/d4d/f79 zero size 2024-09-21T12:47:12.987 INFO:tasks.workunit.client.0.smithi046.stdout:8/416: mknod d1/d12/d46/d35/c8f 0 2024-09-21T12:47:12.990 INFO:tasks.workunit.client.0.smithi046.stdout:7/401: unlink d2/d4/d43/c75 0 2024-09-21T12:47:12.991 INFO:tasks.workunit.client.0.smithi046.stdout:7/402: stat d2/d4/df/d17 0 2024-09-21T12:47:12.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/402: creat d4/dc/d13/d5b/d2d/f7d x:0 0 0 2024-09-21T12:47:12.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/443: mknod de/d2a/d4d/c91 0 2024-09-21T12:47:12.998 INFO:tasks.workunit.client.0.smithi046.stdout:7/403: truncate d2/d4/f47 494126 0 2024-09-21T12:47:12.999 INFO:tasks.workunit.client.0.smithi046.stdout:5/403: rename d4/dc/d13/d5b/d2d/l79 to d4/dc/d13/d15/d5c/l7e 0 2024-09-21T12:47:13.000 INFO:tasks.workunit.client.0.smithi046.stdout:5/404: write d4/f4a [1804375,31683] 0 2024-09-21T12:47:13.004 INFO:tasks.workunit.client.0.smithi046.stdout:7/404: dwrite d2/d4/f33 [0,4194304] 0 2024-09-21T12:47:13.007 INFO:tasks.workunit.client.0.smithi046.stdout:2/437: write d16/d22/f31 [876715,72912] 0 2024-09-21T12:47:13.012 INFO:tasks.workunit.client.0.smithi046.stdout:5/405: creat d4/dc/d13/d15/f7f x:0 0 0 2024-09-21T12:47:13.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/444: link de/d2a/d4d/f74 de/d2a/d4c/d71/d7c/f92 0 2024-09-21T12:47:13.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/438: dwrite d16/d22/d2b/d43/f73 [0,4194304] 0 2024-09-21T12:47:13.017 INFO:tasks.workunit.client.0.smithi046.stdout:7/405: rename d2/d4/df/l1a to d2/d37/l7d 0 2024-09-21T12:47:13.018 INFO:tasks.workunit.client.0.smithi046.stdout:2/439: readlink d16/d5c/d63/l6a 0 2024-09-21T12:47:13.019 INFO:tasks.workunit.client.0.smithi046.stdout:2/440: read d16/f21 [1658401,127917] 0 2024-09-21T12:47:13.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/441: truncate d16/d22/d38/f8b 550428 0 2024-09-21T12:47:13.022 INFO:tasks.workunit.client.0.smithi046.stdout:8/417: write d1/d12/d46/d35/f50 [65066,71627] 0 2024-09-21T12:47:13.024 INFO:tasks.workunit.client.0.smithi046.stdout:6/445: creat de/d2a/d4c/d71/f93 x:0 0 0 2024-09-21T12:47:13.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/446: chown de/d2a/d4c/d71/d7c 32064 1 2024-09-21T12:47:13.026 INFO:tasks.workunit.client.0.smithi046.stdout:7/406: mknod d2/dd/c7e 0 2024-09-21T12:47:13.028 INFO:tasks.workunit.client.0.smithi046.stdout:5/406: dread d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:13.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/407: write d4/d22/d10/d1a/f1c [4750097,2260] 0 2024-09-21T12:47:13.033 INFO:tasks.workunit.client.0.smithi046.stdout:2/442: dread d16/f25 [0,4194304] 0 2024-09-21T12:47:13.034 INFO:tasks.workunit.client.0.smithi046.stdout:6/447: dread - de/f6c zero size 2024-09-21T12:47:13.040 INFO:tasks.workunit.client.0.smithi046.stdout:7/407: dwrite d2/f32 [0,4194304] 0 2024-09-21T12:47:13.042 INFO:tasks.workunit.client.0.smithi046.stdout:5/408: symlink d4/dc/d13/d5e/l80 0 2024-09-21T12:47:13.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/448: unlink de/d2a/f49 0 2024-09-21T12:47:13.069 INFO:tasks.workunit.client.0.smithi046.stdout:8/418: dread d1/d12/d46/d35/d5b/f85 [0,4194304] 0 2024-09-21T12:47:13.070 INFO:tasks.workunit.client.0.smithi046.stdout:6/449: mkdir de/d2a/d4c/d77/d8f/d94 0 2024-09-21T12:47:13.075 INFO:tasks.workunit.client.0.smithi046.stdout:8/419: mkdir d1/d12/d46/d35/d90 0 2024-09-21T12:47:13.081 INFO:tasks.workunit.client.0.smithi046.stdout:7/408: dread d2/d4/df/d17/f62 [0,4194304] 0 2024-09-21T12:47:13.081 INFO:tasks.workunit.client.0.smithi046.stdout:8/420: creat d1/d12/d46/f91 x:0 0 0 2024-09-21T12:47:13.083 INFO:tasks.workunit.client.0.smithi046.stdout:7/409: dread d2/d4/df/d17/f35 [0,4194304] 0 2024-09-21T12:47:13.084 INFO:tasks.workunit.client.0.smithi046.stdout:5/409: dread d4/dc/d13/d5b/d2d/d3b/f68 [0,4194304] 0 2024-09-21T12:47:13.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/410: fsync d4/dc/d13/d15/f51 0 2024-09-21T12:47:13.087 INFO:tasks.workunit.client.0.smithi046.stdout:5/411: dread d4/dc/d13/f23 [4194304,4194304] 0 2024-09-21T12:47:13.095 INFO:tasks.workunit.client.0.smithi046.stdout:6/450: dwrite de/d2a/f2f [0,4194304] 0 2024-09-21T12:47:13.095 INFO:tasks.workunit.client.0.smithi046.stdout:5/412: rename d4/d22/f32 to d4/dc/d13/f81 0 2024-09-21T12:47:13.101 INFO:tasks.workunit.client.0.smithi046.stdout:8/421: dwrite d1/ff [4194304,4194304] 0 2024-09-21T12:47:13.106 INFO:tasks.workunit.client.0.smithi046.stdout:7/410: dwrite d2/dd/f5a [0,4194304] 0 2024-09-21T12:47:13.110 INFO:tasks.workunit.client.0.smithi046.stdout:5/413: dwrite d4/d16/f36 [4194304,4194304] 0 2024-09-21T12:47:13.112 INFO:tasks.workunit.client.0.smithi046.stdout:7/411: mkdir d2/d4/df/d17/d31/d34/d7f 0 2024-09-21T12:47:13.115 INFO:tasks.workunit.client.0.smithi046.stdout:8/422: getdents d1/d12/d1a/d33/d6c 0 2024-09-21T12:47:13.121 INFO:tasks.workunit.client.0.smithi046.stdout:8/423: truncate d1/d12/d46/d35/d7d/f29 3623466 0 2024-09-21T12:47:13.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/424: write d1/d12/d46/f91 [623590,18270] 0 2024-09-21T12:47:13.126 INFO:tasks.workunit.client.0.smithi046.stdout:8/425: creat d1/f92 x:0 0 0 2024-09-21T12:47:13.133 INFO:tasks.workunit.client.0.smithi046.stdout:5/414: write d4/dc/d13/d5b/d2d/f4f [2398913,39687] 0 2024-09-21T12:47:13.133 INFO:tasks.workunit.client.0.smithi046.stdout:7/412: truncate d2/dd/f3f 1404431 0 2024-09-21T12:47:13.135 INFO:tasks.workunit.client.0.smithi046.stdout:7/413: mknod d2/d37/c80 0 2024-09-21T12:47:13.139 INFO:tasks.workunit.client.0.smithi046.stdout:8/426: write d1/d12/f72 [657577,21616] 0 2024-09-21T12:47:13.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/414: dwrite d2/fa [0,4194304] 0 2024-09-21T12:47:13.149 INFO:tasks.workunit.client.0.smithi046.stdout:8/427: dwrite d1/d12/f3b [8388608,4194304] 0 2024-09-21T12:47:13.152 INFO:tasks.workunit.client.0.smithi046.stdout:7/415: fdatasync d2/d37/d77/f7a 0 2024-09-21T12:47:13.155 INFO:tasks.workunit.client.0.smithi046.stdout:7/416: creat d2/d37/f81 x:0 0 0 2024-09-21T12:47:13.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/417: creat d2/d37/f82 x:0 0 0 2024-09-21T12:47:13.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/428: creat d1/d12/f93 x:0 0 0 2024-09-21T12:47:13.163 INFO:tasks.workunit.client.0.smithi046.stdout:7/418: mkdir d2/d4/df/d17/d31/d34/d7f/d83 0 2024-09-21T12:47:13.163 INFO:tasks.workunit.client.0.smithi046.stdout:7/419: chown d2/d37/d77/f7a 0 1 2024-09-21T12:47:13.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/429: link d1/d12/d1a/c25 d1/d12/d46/d35/d36/d51/d8c/c94 0 2024-09-21T12:47:13.168 INFO:tasks.workunit.client.0.smithi046.stdout:8/430: creat d1/d12/f95 x:0 0 0 2024-09-21T12:47:13.169 INFO:tasks.workunit.client.0.smithi046.stdout:8/431: write d1/d12/d46/d35/d7d/d6a/f8e [753437,126408] 0 2024-09-21T12:47:13.173 INFO:tasks.workunit.client.0.smithi046.stdout:9/498: sync 2024-09-21T12:47:13.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/368: sync 2024-09-21T12:47:13.173 INFO:tasks.workunit.client.0.smithi046.stdout:3/356: sync 2024-09-21T12:47:13.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/432: rename d1/c17 to d1/d12/d46/d35/d79/c96 0 2024-09-21T12:47:13.174 INFO:tasks.workunit.client.0.smithi046.stdout:9/499: stat d11/d19/d1b/d4b/f8d 0 2024-09-21T12:47:13.174 INFO:tasks.workunit.client.0.smithi046.stdout:1/369: write d4/f9 [1560551,11699] 0 2024-09-21T12:47:13.175 INFO:tasks.workunit.client.0.smithi046.stdout:8/433: fdatasync d1/d12/d46/d35/d36/d51/f65 0 2024-09-21T12:47:13.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/434: stat d1/d12/d46/d35/d36/d51 0 2024-09-21T12:47:13.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/370: creat d4/d13/f7f x:0 0 0 2024-09-21T12:47:13.185 INFO:tasks.workunit.client.0.smithi046.stdout:9/500: read d11/d19/d36/d45/d6e/f76 [2341983,88969] 0 2024-09-21T12:47:13.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/357: dwrite d5/d16/f47 [0,4194304] 0 2024-09-21T12:47:13.189 INFO:tasks.workunit.client.0.smithi046.stdout:8/435: creat d1/d12/d53/f97 x:0 0 0 2024-09-21T12:47:13.190 INFO:tasks.workunit.client.0.smithi046.stdout:7/420: dwrite d2/d4/df/d17/d31/f45 [4194304,4194304] 0 2024-09-21T12:47:13.199 INFO:tasks.workunit.client.0.smithi046.stdout:8/436: creat d1/d12/d53/f98 x:0 0 0 2024-09-21T12:47:13.200 INFO:tasks.workunit.client.0.smithi046.stdout:7/421: symlink d2/d4/df/d17/d31/d34/d7f/l84 0 2024-09-21T12:47:13.205 INFO:tasks.workunit.client.0.smithi046.stdout:1/371: dread d4/d13/f36 [0,4194304] 0 2024-09-21T12:47:13.206 INFO:tasks.workunit.client.0.smithi046.stdout:8/437: creat d1/d12/d46/d35/d36/f99 x:0 0 0 2024-09-21T12:47:13.209 INFO:tasks.workunit.client.0.smithi046.stdout:7/422: dwrite d2/d4/df/d6f/f76 [0,4194304] 0 2024-09-21T12:47:13.214 INFO:tasks.workunit.client.0.smithi046.stdout:1/372: mkdir d4/d13/d38/d53/d80 0 2024-09-21T12:47:13.214 INFO:tasks.workunit.client.0.smithi046.stdout:9/501: link d11/d19/d1b/d31/d53/d5e/c7e d11/d19/c9a 0 2024-09-21T12:47:13.215 INFO:tasks.workunit.client.0.smithi046.stdout:1/373: dread - d4/f77 zero size 2024-09-21T12:47:13.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/438: creat d1/d12/d46/d35/d7d/d6a/f9a x:0 0 0 2024-09-21T12:47:13.217 INFO:tasks.workunit.client.0.smithi046.stdout:9/502: rename d11/d19/d1b to d11/d19/d1b/d1c/d9b 22 2024-09-21T12:47:13.218 INFO:tasks.workunit.client.0.smithi046.stdout:1/374: read d4/d13/d38/d4f/f69 [974447,18293] 0 2024-09-21T12:47:13.220 INFO:tasks.workunit.client.0.smithi046.stdout:8/439: symlink d1/d78/l9b 0 2024-09-21T12:47:13.224 INFO:tasks.workunit.client.0.smithi046.stdout:1/375: rename d4/d29/c61 to d4/d13/d38/d53/d5a/d5d/c81 0 2024-09-21T12:47:13.224 INFO:tasks.workunit.client.0.smithi046.stdout:1/376: chown d4/d4d 131 1 2024-09-21T12:47:13.225 INFO:tasks.workunit.client.0.smithi046.stdout:8/440: readlink d1/d12/d53/l54 0 2024-09-21T12:47:13.226 INFO:tasks.workunit.client.0.smithi046.stdout:8/441: dread - d1/d12/d46/d35/f8b zero size 2024-09-21T12:47:13.229 INFO:tasks.workunit.client.0.smithi046.stdout:1/377: creat d4/d13/d38/d53/d80/f82 x:0 0 0 2024-09-21T12:47:13.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/378: chown d4/d13/d38/d48 1 1 2024-09-21T12:47:13.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/379: mkdir d4/d13/d38/d4f/d83 0 2024-09-21T12:47:13.237 INFO:tasks.workunit.client.0.smithi046.stdout:7/423: truncate d2/d4/df/d17/d31/f45 7187053 0 2024-09-21T12:47:13.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/424: fsync d2/f78 0 2024-09-21T12:47:13.241 INFO:tasks.workunit.client.0.smithi046.stdout:7/425: fsync d2/f32 0 2024-09-21T12:47:13.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/426: creat d2/d4/df/d6f/f85 x:0 0 0 2024-09-21T12:47:13.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/427: dread - d2/d37/f81 zero size 2024-09-21T12:47:13.247 INFO:tasks.workunit.client.0.smithi046.stdout:8/442: dread d1/d12/f39 [0,4194304] 0 2024-09-21T12:47:13.249 INFO:tasks.workunit.client.0.smithi046.stdout:8/443: truncate d1/f1c 3904198 0 2024-09-21T12:47:13.253 INFO:tasks.workunit.client.0.smithi046.stdout:1/380: dread d4/f26 [0,4194304] 0 2024-09-21T12:47:13.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/381: creat d4/d13/f84 x:0 0 0 2024-09-21T12:47:13.259 INFO:tasks.workunit.client.0.smithi046.stdout:1/382: truncate d4/d13/f2f 3777219 0 2024-09-21T12:47:13.261 INFO:tasks.workunit.client.0.smithi046.stdout:7/428: write d2/d4/df/d17/f30 [103383,129133] 0 2024-09-21T12:47:13.261 INFO:tasks.workunit.client.0.smithi046.stdout:1/383: rmdir d4 39 2024-09-21T12:47:13.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/429: unlink d2/dd/f5a 0 2024-09-21T12:47:13.265 INFO:tasks.workunit.client.0.smithi046.stdout:7/430: creat d2/d4/f86 x:0 0 0 2024-09-21T12:47:13.268 INFO:tasks.workunit.client.0.smithi046.stdout:8/444: dread d1/d12/d1a/d33/f59 [0,4194304] 0 2024-09-21T12:47:13.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/431: dread d2/d4/df/d17/f62 [0,4194304] 0 2024-09-21T12:47:13.270 INFO:tasks.workunit.client.0.smithi046.stdout:8/445: creat d1/d12/d46/d35/d7d/d6a/f9c x:0 0 0 2024-09-21T12:47:13.271 INFO:tasks.workunit.client.0.smithi046.stdout:7/432: truncate d2/d4/d43/f5d 1011900 0 2024-09-21T12:47:13.272 INFO:tasks.workunit.client.0.smithi046.stdout:8/446: rename d1/d12/d46/d35/d90 to d1/d12/d46/d35/d90/d9d 22 2024-09-21T12:47:13.279 INFO:tasks.workunit.client.0.smithi046.stdout:8/447: rmdir d1/d12/d46/d35/d90 0 2024-09-21T12:47:13.280 INFO:tasks.workunit.client.0.smithi046.stdout:8/448: write d1/d12/f95 [458629,112086] 0 2024-09-21T12:47:13.281 INFO:tasks.workunit.client.0.smithi046.stdout:8/449: dread - d1/d12/d46/f44 zero size 2024-09-21T12:47:13.282 INFO:tasks.workunit.client.0.smithi046.stdout:8/450: chown d1/d12/f52 0 1 2024-09-21T12:47:13.291 INFO:tasks.workunit.client.0.smithi046.stdout:4/461: sync 2024-09-21T12:47:13.291 INFO:tasks.workunit.client.0.smithi046.stdout:0/483: sync 2024-09-21T12:47:13.292 INFO:tasks.workunit.client.0.smithi046.stdout:8/451: rename d1/d12/d1a/d33/c6f to d1/d12/c9e 0 2024-09-21T12:47:13.292 INFO:tasks.workunit.client.0.smithi046.stdout:7/433: dwrite d2/dd/f3f [0,4194304] 0 2024-09-21T12:47:13.294 INFO:tasks.workunit.client.0.smithi046.stdout:8/452: truncate d1/d12/d46/d35/d7d/f4a 1973302 0 2024-09-21T12:47:13.347 INFO:tasks.workunit.client.0.smithi046.stdout:7/434: creat d2/d4/df/d42/f87 x:0 0 0 2024-09-21T12:47:13.349 INFO:tasks.workunit.client.0.smithi046.stdout:0/484: creat d6/dac/fbd x:0 0 0 2024-09-21T12:47:13.353 INFO:tasks.workunit.client.0.smithi046.stdout:0/485: creat d6/d4f/fbe x:0 0 0 2024-09-21T12:47:13.354 INFO:tasks.workunit.client.0.smithi046.stdout:8/453: rename d1/d12/c14 to d1/d12/d46/d35/c9f 0 2024-09-21T12:47:13.356 INFO:tasks.workunit.client.0.smithi046.stdout:0/486: rmdir d6/d7/d13/d72 39 2024-09-21T12:47:13.357 INFO:tasks.workunit.client.0.smithi046.stdout:4/462: dwrite d1/d13/d25/d29/d33/f62 [0,4194304] 0 2024-09-21T12:47:13.358 INFO:tasks.workunit.client.0.smithi046.stdout:7/435: rename d2/d4/df/d17/d31 to d2/d4/df/d70/d88 0 2024-09-21T12:47:13.365 INFO:tasks.workunit.client.0.smithi046.stdout:7/436: creat d2/d4/f89 x:0 0 0 2024-09-21T12:47:13.365 INFO:tasks.workunit.client.0.smithi046.stdout:0/487: creat d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf x:0 0 0 2024-09-21T12:47:13.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/437: dwrite d2/dd/f29 [0,4194304] 0 2024-09-21T12:47:13.380 INFO:tasks.workunit.client.0.smithi046.stdout:7/438: dwrite d2/d4/df/d70/d88/d34/f48 [0,4194304] 0 2024-09-21T12:47:13.389 INFO:tasks.workunit.client.0.smithi046.stdout:8/454: dwrite d1/d12/d46/d35/d5b/f69 [0,4194304] 0 2024-09-21T12:47:13.391 INFO:tasks.workunit.client.0.smithi046.stdout:7/439: dwrite d2/d4/df/d70/d88/d34/f3a [0,4194304] 0 2024-09-21T12:47:13.392 INFO:tasks.workunit.client.0.smithi046.stdout:8/455: read d1/d12/d46/f37 [396589,81612] 0 2024-09-21T12:47:13.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/488: dread d6/d7/d13/d49/f9f [0,4194304] 0 2024-09-21T12:47:13.399 INFO:tasks.workunit.client.0.smithi046.stdout:8/456: dread - d1/d12/d46/d35/d36/f4b zero size 2024-09-21T12:47:13.404 INFO:tasks.workunit.client.0.smithi046.stdout:0/489: mkdir d6/d7/d13/d43/d52/dc0 0 2024-09-21T12:47:13.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/490: fsync d6/d7/d9/f50 0 2024-09-21T12:47:13.407 INFO:tasks.workunit.client.0.smithi046.stdout:7/440: write d2/d4/f47 [49856,40357] 0 2024-09-21T12:47:13.417 INFO:tasks.workunit.client.0.smithi046.stdout:8/457: truncate d1/d12/d46/d35/f50 1991577 0 2024-09-21T12:47:13.418 INFO:tasks.workunit.client.0.smithi046.stdout:8/458: rmdir d1/d12/d46/d35 39 2024-09-21T12:47:13.424 INFO:tasks.workunit.client.0.smithi046.stdout:8/459: chown d1/d12/d46/d35/d7d/f29 725672 1 2024-09-21T12:47:13.430 INFO:tasks.workunit.client.0.smithi046.stdout:8/460: link d1/d12/d1a/d33/d6c/c8a d1/d12/d46/d35/d36/ca0 0 2024-09-21T12:47:13.431 INFO:tasks.workunit.client.0.smithi046.stdout:8/461: dread - d1/d12/d46/d35/d7d/d6a/f9c zero size 2024-09-21T12:47:13.437 INFO:tasks.workunit.client.0.smithi046.stdout:8/462: mkdir d1/d12/d53/d80/da1 0 2024-09-21T12:47:13.439 INFO:tasks.workunit.client.0.smithi046.stdout:8/463: rmdir d1/d12/d46/d35/d36/d51 39 2024-09-21T12:47:13.439 INFO:tasks.workunit.client.0.smithi046.stdout:8/464: write d1/d78/f87 [552012,70781] 0 2024-09-21T12:47:13.446 INFO:tasks.workunit.client.0.smithi046.stdout:8/465: link d1/c15 d1/d12/d53/d80/da1/ca2 0 2024-09-21T12:47:13.453 INFO:tasks.workunit.client.0.smithi046.stdout:8/466: link d1/d12/d53/f97 d1/d12/d46/d35/d36/d51/d8c/fa3 0 2024-09-21T12:47:13.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/467: symlink d1/d12/d1a/la4 0 2024-09-21T12:47:13.470 INFO:tasks.workunit.client.0.smithi046.stdout:8/468: write d1/fd [2898744,66411] 0 2024-09-21T12:47:13.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/469: unlink d1/d12/d1a/d33/c6e 0 2024-09-21T12:47:13.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/470: dwrite d1/ff [0,4194304] 0 2024-09-21T12:47:13.479 INFO:tasks.workunit.client.0.smithi046.stdout:8/471: fsync d1/d12/f95 0 2024-09-21T12:47:13.481 INFO:tasks.workunit.client.0.smithi046.stdout:8/472: truncate d1/d12/d46/d35/f8b 881136 0 2024-09-21T12:47:13.482 INFO:tasks.workunit.client.0.smithi046.stdout:8/473: rmdir d1/d12/d1a/d33 39 2024-09-21T12:47:13.484 INFO:tasks.workunit.client.0.smithi046.stdout:8/474: truncate d1/d12/d53/f83 788553 0 2024-09-21T12:47:13.490 INFO:tasks.workunit.client.0.smithi046.stdout:8/475: dread d1/d12/d46/d35/d7d/f30 [0,4194304] 0 2024-09-21T12:47:13.560 INFO:tasks.workunit.client.0.smithi046.stdout:8/476: write d1/d12/d46/d35/d7d/f30 [1681621,56772] 0 2024-09-21T12:47:13.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/477: creat d1/d12/d1a/d33/fa5 x:0 0 0 2024-09-21T12:47:13.567 INFO:tasks.workunit.client.0.smithi046.stdout:8/478: mknod d1/d12/d46/d35/d36/d86/ca6 0 2024-09-21T12:47:13.573 INFO:tasks.workunit.client.0.smithi046.stdout:8/479: dread d1/fa [0,4194304] 0 2024-09-21T12:47:13.575 INFO:tasks.workunit.client.0.smithi046.stdout:8/480: creat d1/d78/fa7 x:0 0 0 2024-09-21T12:47:13.578 INFO:tasks.workunit.client.0.smithi046.stdout:8/481: unlink d1/f92 0 2024-09-21T12:47:13.580 INFO:tasks.workunit.client.0.smithi046.stdout:8/482: symlink d1/d12/d46/d35/d36/d51/d8c/la8 0 2024-09-21T12:47:13.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/483: dwrite d1/d12/d1a/f6b [0,4194304] 0 2024-09-21T12:47:13.587 INFO:tasks.workunit.client.0.smithi046.stdout:8/484: chown d1/d78/f87 435317507 1 2024-09-21T12:47:13.587 INFO:tasks.workunit.client.0.smithi046.stdout:8/485: readlink d1/d12/d1a/la4 0 2024-09-21T12:47:13.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/486: read - d1/d12/d46/d35/f8d zero size 2024-09-21T12:47:13.591 INFO:tasks.workunit.client.0.smithi046.stdout:8/487: mknod d1/d12/d1a/d33/d6c/ca9 0 2024-09-21T12:47:13.598 INFO:tasks.workunit.client.0.smithi046.stdout:8/488: getdents d1/d12/d53/d60 0 2024-09-21T12:47:13.603 INFO:tasks.workunit.client.0.smithi046.stdout:8/489: mknod d1/d12/d46/d35/d36/caa 0 2024-09-21T12:47:13.604 INFO:tasks.workunit.client.0.smithi046.stdout:8/490: fsync d1/fd 0 2024-09-21T12:47:13.610 INFO:tasks.workunit.client.0.smithi046.stdout:8/491: dwrite d1/d12/d46/d35/d5b/f70 [0,4194304] 0 2024-09-21T12:47:13.613 INFO:tasks.workunit.client.0.smithi046.stdout:8/492: mkdir d1/d12/d53/dab 0 2024-09-21T12:47:13.618 INFO:tasks.workunit.client.0.smithi046.stdout:8/493: link d1/d12/d46/f49 d1/d12/d53/d60/fac 0 2024-09-21T12:47:13.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/443: sync 2024-09-21T12:47:13.876 INFO:tasks.workunit.client.0.smithi046.stdout:6/451: sync 2024-09-21T12:47:13.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/452: write de/d2a/d34/d4e/f72 [334348,128099] 0 2024-09-21T12:47:13.879 INFO:tasks.workunit.client.0.smithi046.stdout:6/453: fdatasync de/f13 0 2024-09-21T12:47:13.882 INFO:tasks.workunit.client.0.smithi046.stdout:2/444: dwrite d16/d22/d38/f53 [0,4194304] 0 2024-09-21T12:47:13.889 INFO:tasks.workunit.client.0.smithi046.stdout:2/445: creat d16/f8d x:0 0 0 2024-09-21T12:47:13.892 INFO:tasks.workunit.client.0.smithi046.stdout:6/454: rename de/f17 to de/d2a/d34/d4e/d55/f95 0 2024-09-21T12:47:13.892 INFO:tasks.workunit.client.0.smithi046.stdout:6/455: chown de/d2a/f2f 244 1 2024-09-21T12:47:13.894 INFO:tasks.workunit.client.0.smithi046.stdout:2/446: mknod d16/d22/c8e 0 2024-09-21T12:47:13.898 INFO:tasks.workunit.client.0.smithi046.stdout:6/456: link de/d2a/l2e de/d2a/d4c/d77/d8f/l96 0 2024-09-21T12:47:13.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/457: dwrite de/d2a/d4c/f54 [0,4194304] 0 2024-09-21T12:47:13.908 INFO:tasks.workunit.client.0.smithi046.stdout:2/447: mkdir d16/d22/d2b/d30/d8f 0 2024-09-21T12:47:13.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/448: readlink d16/d5c/l60 0 2024-09-21T12:47:13.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/458: write de/d35/f89 [1389840,39559] 0 2024-09-21T12:47:13.911 INFO:tasks.workunit.client.0.smithi046.stdout:2/449: truncate d16/d5c/d63/f79 862777 0 2024-09-21T12:47:13.912 INFO:tasks.workunit.client.0.smithi046.stdout:2/450: read d16/f1d [1069921,59818] 0 2024-09-21T12:47:13.913 INFO:tasks.workunit.client.0.smithi046.stdout:6/459: read de/d2a/d34/d4e/d55/f95 [997969,103322] 0 2024-09-21T12:47:13.914 INFO:tasks.workunit.client.0.smithi046.stdout:2/451: unlink d16/d22/d2b/l45 0 2024-09-21T12:47:13.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/460: read - de/f76 zero size 2024-09-21T12:47:13.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/452: write d16/d22/d2b/d43/f73 [3530206,54482] 0 2024-09-21T12:47:13.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/453: chown d16/d5c/d63/f79 0 1 2024-09-21T12:47:13.923 INFO:tasks.workunit.client.0.smithi046.stdout:6/461: dwrite de/d2a/d4c/d71/f93 [0,4194304] 0 2024-09-21T12:47:13.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/454: dread d16/d22/f2d [0,4194304] 0 2024-09-21T12:47:13.927 INFO:tasks.workunit.client.0.smithi046.stdout:6/462: mknod de/d2a/d4c/d77/c97 0 2024-09-21T12:47:13.932 INFO:tasks.workunit.client.0.smithi046.stdout:2/455: mkdir d16/d22/d4e/d90 0 2024-09-21T12:47:13.934 INFO:tasks.workunit.client.0.smithi046.stdout:2/456: dread - d16/d22/d2b/d30/d67/f72 zero size 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:6/463: dwrite de/d2a/d4c/d69/f84 [0,4194304] 0 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/494: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:9/503: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:4/463: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:5/415: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:7/441: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:0/491: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/384: sync 2024-09-21T12:47:13.935 INFO:tasks.workunit.client.0.smithi046.stdout:3/358: sync 2024-09-21T12:47:13.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/416: truncate d4/d22/d10/f52 1001385 0 2024-09-21T12:47:13.942 INFO:tasks.workunit.client.0.smithi046.stdout:7/442: rmdir d2/dd 39 2024-09-21T12:47:13.942 INFO:tasks.workunit.client.0.smithi046.stdout:6/464: chown de/d2a/d34/d4e/d55/f95 0 1 2024-09-21T12:47:13.943 INFO:tasks.workunit.client.0.smithi046.stdout:1/385: write d4/d13/d38/d53/d80/f82 [226971,92143] 0 2024-09-21T12:47:13.945 INFO:tasks.workunit.client.0.smithi046.stdout:0/492: symlink d6/d60/lc1 0 2024-09-21T12:47:13.947 INFO:tasks.workunit.client.0.smithi046.stdout:9/504: symlink d11/d19/d36/d45/d64/l9c 0 2024-09-21T12:47:13.949 INFO:tasks.workunit.client.0.smithi046.stdout:9/505: dread - d11/d19/f89 zero size 2024-09-21T12:47:13.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/359: dwrite d5/dc/d28/d63/f7d [0,4194304] 0 2024-09-21T12:47:13.953 INFO:tasks.workunit.client.0.smithi046.stdout:8/495: mknod d1/d12/d46/d35/d36/d51/cad 0 2024-09-21T12:47:13.955 INFO:tasks.workunit.client.0.smithi046.stdout:8/496: read d1/d12/d46/d35/f8b [48696,116175] 0 2024-09-21T12:47:13.956 INFO:tasks.workunit.client.0.smithi046.stdout:6/465: mkdir de/d2a/d4c/d77/d98 0 2024-09-21T12:47:13.957 INFO:tasks.workunit.client.0.smithi046.stdout:8/497: dread - d1/d12/f93 zero size 2024-09-21T12:47:13.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/466: read de/d2a/f2f [2305183,52309] 0 2024-09-21T12:47:13.964 INFO:tasks.workunit.client.0.smithi046.stdout:6/467: truncate de/d2a/f2f 4670267 0 2024-09-21T12:47:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:4/464: dwrite d1/d13/d25/f19 [0,4194304] 0 2024-09-21T12:47:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:3/360: creat d5/dc/d28/d60/d6e/f7e x:0 0 0 2024-09-21T12:47:13.967 INFO:tasks.workunit.client.0.smithi046.stdout:1/386: dread d4/d13/d38/f42 [4194304,4194304] 0 2024-09-21T12:47:13.968 INFO:tasks.workunit.client.0.smithi046.stdout:5/417: mknod d4/dc/d13/d5b/c82 0 2024-09-21T12:47:13.978 INFO:tasks.workunit.client.0.smithi046.stdout:1/387: dwrite d4/d13/d38/d53/d5a/d5d/f60 [0,4194304] 0 2024-09-21T12:47:13.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/493: dwrite d6/d7/d13/f3d [0,4194304] 0 2024-09-21T12:47:13.987 INFO:tasks.workunit.client.0.smithi046.stdout:2/457: truncate d16/d22/d38/f8b 86156 0 2024-09-21T12:47:13.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/458: truncate d16/d22/d2b/d43/f6d 119548 0 2024-09-21T12:47:13.998 INFO:tasks.workunit.client.0.smithi046.stdout:7/443: mkdir d2/d37/d8a 0 2024-09-21T12:47:13.999 INFO:tasks.workunit.client.0.smithi046.stdout:9/506: rename d11/d19/d1b/d1c/l1e to d11/d19/d1b/d31/d44/l9d 0 2024-09-21T12:47:14.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/468: creat de/d2a/d4c/d71/d7c/f99 x:0 0 0 2024-09-21T12:47:14.003 INFO:tasks.workunit.client.0.smithi046.stdout:0/494: dread d6/d7/d9/fb [0,4194304] 0 2024-09-21T12:47:14.004 INFO:tasks.workunit.client.0.smithi046.stdout:3/361: creat d5/dc/d28/f7f x:0 0 0 2024-09-21T12:47:14.018 INFO:tasks.workunit.client.0.smithi046.stdout:3/362: chown d5/f6b 4877 1 2024-09-21T12:47:14.020 INFO:tasks.workunit.client.0.smithi046.stdout:5/418: symlink d4/dc/d13/d5b/d2d/d43/d7a/l83 0 2024-09-21T12:47:14.022 INFO:tasks.workunit.client.0.smithi046.stdout:1/388: link d4/d13/d38/f58 d4/d13/d38/d53/d80/f85 0 2024-09-21T12:47:14.025 INFO:tasks.workunit.client.0.smithi046.stdout:2/459: getdents d16/d22/d38/d77/d7a 0 2024-09-21T12:47:14.025 INFO:tasks.workunit.client.0.smithi046.stdout:6/469: dread f9 [0,4194304] 0 2024-09-21T12:47:14.026 INFO:tasks.workunit.client.0.smithi046.stdout:2/460: dread - d16/d22/d2b/d30/d67/f7b zero size 2024-09-21T12:47:14.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/470: write de/d2a/d34/f3b [2263398,80568] 0 2024-09-21T12:47:14.027 INFO:tasks.workunit.client.0.smithi046.stdout:8/498: creat d1/d12/fae x:0 0 0 2024-09-21T12:47:14.027 INFO:tasks.workunit.client.0.smithi046.stdout:2/461: stat d16/d22/d38/c50 0 2024-09-21T12:47:14.032 INFO:tasks.workunit.client.0.smithi046.stdout:8/499: dread d1/d12/d1a/f6b [0,4194304] 0 2024-09-21T12:47:14.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/465: creat d1/d27/f9f x:0 0 0 2024-09-21T12:47:14.038 INFO:tasks.workunit.client.0.smithi046.stdout:5/419: creat d4/dc/d13/d15/f84 x:0 0 0 2024-09-21T12:47:14.041 INFO:tasks.workunit.client.0.smithi046.stdout:4/466: dwrite d1/d27/d46/d78/f98 [0,4194304] 0 2024-09-21T12:47:14.042 INFO:tasks.workunit.client.0.smithi046.stdout:5/420: write d4/d22/d10/d1a/f1c [5693846,68670] 0 2024-09-21T12:47:14.044 INFO:tasks.workunit.client.0.smithi046.stdout:9/507: truncate d11/d19/d1b/d4b/f8d 483832 0 2024-09-21T12:47:14.045 INFO:tasks.workunit.client.0.smithi046.stdout:3/363: dwrite d5/dc/d26/f27 [4194304,4194304] 0 2024-09-21T12:47:14.046 INFO:tasks.workunit.client.0.smithi046.stdout:6/471: mknod de/d2a/d4c/d71/c9a 0 2024-09-21T12:47:14.050 INFO:tasks.workunit.client.0.smithi046.stdout:2/462: rmdir d16/d22/d2b/d43 39 2024-09-21T12:47:14.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/463: write d16/d5c/d63/f79 [246988,82306] 0 2024-09-21T12:47:14.057 INFO:tasks.workunit.client.0.smithi046.stdout:8/500: mknod d1/d12/d46/d35/d36/d86/caf 0 2024-09-21T12:47:14.063 INFO:tasks.workunit.client.0.smithi046.stdout:3/364: dread d5/dc/d26/f27 [0,4194304] 0 2024-09-21T12:47:14.066 INFO:tasks.workunit.client.0.smithi046.stdout:8/501: dwrite d1/d12/d46/d35/d5b/f70 [0,4194304] 0 2024-09-21T12:47:14.067 INFO:tasks.workunit.client.0.smithi046.stdout:8/502: write d1/ff [6427352,44192] 0 2024-09-21T12:47:14.067 INFO:tasks.workunit.client.0.smithi046.stdout:1/389: fdatasync d4/d29/d32/f3f 0 2024-09-21T12:47:14.068 INFO:tasks.workunit.client.0.smithi046.stdout:8/503: chown d1/d12/d53/d60/c63 963026 1 2024-09-21T12:47:14.071 INFO:tasks.workunit.client.0.smithi046.stdout:5/421: symlink d4/dc/d13/d15/l85 0 2024-09-21T12:47:14.074 INFO:tasks.workunit.client.0.smithi046.stdout:4/467: rename d1/d13/f30 to d1/d27/d37/d66/fa0 0 2024-09-21T12:47:14.079 INFO:tasks.workunit.client.0.smithi046.stdout:6/472: mknod de/d2a/d4d/c9b 0 2024-09-21T12:47:14.092 INFO:tasks.workunit.client.0.smithi046.stdout:3/365: mknod d5/dc/d26/d3c/c80 0 2024-09-21T12:47:14.094 INFO:tasks.workunit.client.0.smithi046.stdout:9/508: mknod d11/c9e 0 2024-09-21T12:47:14.095 INFO:tasks.workunit.client.0.smithi046.stdout:1/390: stat d4/d4d/f7e 0 2024-09-21T12:47:14.096 INFO:tasks.workunit.client.0.smithi046.stdout:8/504: creat d1/d12/d46/d35/d36/d51/fb0 x:0 0 0 2024-09-21T12:47:14.102 INFO:tasks.workunit.client.0.smithi046.stdout:7/444: link d2/d4/df/d6f/l73 d2/l8b 0 2024-09-21T12:47:14.103 INFO:tasks.workunit.client.0.smithi046.stdout:2/464: creat d16/d22/d75/f91 x:0 0 0 2024-09-21T12:47:14.105 INFO:tasks.workunit.client.0.smithi046.stdout:3/366: symlink d5/dc/d30/d34/l81 0 2024-09-21T12:47:14.105 INFO:tasks.workunit.client.0.smithi046.stdout:3/367: chown d5/d16/l2a 5036804 1 2024-09-21T12:47:14.108 INFO:tasks.workunit.client.0.smithi046.stdout:1/391: creat d4/d13/d38/d48/f86 x:0 0 0 2024-09-21T12:47:14.109 INFO:tasks.workunit.client.0.smithi046.stdout:8/505: creat d1/d12/d46/d35/d36/d51/fb1 x:0 0 0 2024-09-21T12:47:14.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/473: truncate de/f46 10570251 0 2024-09-21T12:47:14.115 INFO:tasks.workunit.client.0.smithi046.stdout:6/474: write de/f76 [267548,67295] 0 2024-09-21T12:47:14.116 INFO:tasks.workunit.client.0.smithi046.stdout:4/468: write d1/d27/d58/f90 [113720,57251] 0 2024-09-21T12:47:14.117 INFO:tasks.workunit.client.0.smithi046.stdout:1/392: dwrite d4/f6a [0,4194304] 0 2024-09-21T12:47:14.119 INFO:tasks.workunit.client.0.smithi046.stdout:9/509: creat d11/d19/d1b/d1c/d1f/d30/d79/f9f x:0 0 0 2024-09-21T12:47:14.126 INFO:tasks.workunit.client.0.smithi046.stdout:7/445: dwrite d2/dd/f3f [0,4194304] 0 2024-09-21T12:47:14.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/368: write d5/dc/d26/f78 [195529,93259] 0 2024-09-21T12:47:14.139 INFO:tasks.workunit.client.0.smithi046.stdout:4/469: creat d1/d13/d25/d3a/fa1 x:0 0 0 2024-09-21T12:47:14.140 INFO:tasks.workunit.client.0.smithi046.stdout:2/465: dread d16/d22/f31 [0,4194304] 0 2024-09-21T12:47:14.140 INFO:tasks.workunit.client.0.smithi046.stdout:4/470: write d1/f57 [336801,118438] 0 2024-09-21T12:47:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:13 smithi046 ceph-mon[27868]: pgmap v33: 65 pgs: 65 active+clean; 2.7 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 209 MiB/s wr, 411 op/s 2024-09-21T12:47:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:13 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:47:14.215 INFO:tasks.workunit.client.0.smithi046.stdout:1/393: mknod d4/d13/d79/c87 0 2024-09-21T12:47:14.216 INFO:tasks.workunit.client.0.smithi046.stdout:8/506: link d1/c2 d1/cb2 0 2024-09-21T12:47:14.218 INFO:tasks.workunit.client.0.smithi046.stdout:6/475: creat de/d2a/f9c x:0 0 0 2024-09-21T12:47:14.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/471: dread d1/d13/d8b/f89 [0,4194304] 0 2024-09-21T12:47:14.220 INFO:tasks.workunit.client.0.smithi046.stdout:7/446: rename d2/f32 to d2/d4/f8c 0 2024-09-21T12:47:14.221 INFO:tasks.workunit.client.0.smithi046.stdout:6/476: write de/f13 [491002,3665] 0 2024-09-21T12:47:14.223 INFO:tasks.workunit.client.0.smithi046.stdout:6/477: fsync de/d48/f88 0 2024-09-21T12:47:14.223 INFO:tasks.workunit.client.0.smithi046.stdout:3/369: dwrite d5/dc/fe [0,4194304] 0 2024-09-21T12:47:14.223 INFO:tasks.workunit.client.0.smithi046.stdout:2/466: write d16/d22/f41 [5166520,101621] 0 2024-09-21T12:47:14.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/507: fsync d1/d12/d53/d60/f64 0 2024-09-21T12:47:14.225 INFO:tasks.workunit.client.0.smithi046.stdout:9/510: getdents d11/d19/d93 0 2024-09-21T12:47:14.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/394: rename d4/d13/d38/d53/d5a/d5d/l62 to d4/d13/d38/l88 0 2024-09-21T12:47:14.227 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:13 smithi176 ceph-mon[35476]: pgmap v33: 65 pgs: 65 active+clean; 2.7 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 66 MiB/s rd, 209 MiB/s wr, 411 op/s 2024-09-21T12:47:14.227 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:13 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:47:14.230 INFO:tasks.workunit.client.0.smithi046.stdout:9/511: write d11/f12 [2444367,9162] 0 2024-09-21T12:47:14.233 INFO:tasks.workunit.client.0.smithi046.stdout:9/512: chown d11/d19/d1b/d1c/d1f/d30/c3d 22 1 2024-09-21T12:47:14.234 INFO:tasks.workunit.client.0.smithi046.stdout:7/447: dwrite d2/d4/df/d70/d88/d34/f38 [4194304,4194304] 0 2024-09-21T12:47:14.236 INFO:tasks.workunit.client.0.smithi046.stdout:6/478: dread de/d2a/d4c/d69/f84 [0,4194304] 0 2024-09-21T12:47:14.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/448: dread - d2/d4/df/d17/f3b zero size 2024-09-21T12:47:14.239 INFO:tasks.workunit.client.0.smithi046.stdout:6/479: write de/d2a/d4c/d69/f86 [276616,79370] 0 2024-09-21T12:47:14.244 INFO:tasks.workunit.client.0.smithi046.stdout:1/395: rmdir d4/d29/d32 39 2024-09-21T12:47:14.246 INFO:tasks.workunit.client.0.smithi046.stdout:1/396: write d4/d13/d38/d53/f66 [396323,65950] 0 2024-09-21T12:47:14.248 INFO:tasks.workunit.client.0.smithi046.stdout:3/370: mknod d5/c82 0 2024-09-21T12:47:14.251 INFO:tasks.workunit.client.0.smithi046.stdout:8/508: dwrite d1/d12/d1a/f6b [0,4194304] 0 2024-09-21T12:47:14.253 INFO:tasks.workunit.client.0.smithi046.stdout:7/449: rename d2/d4/df/d17/f62 to d2/d37/d77/f8d 0 2024-09-21T12:47:14.255 INFO:tasks.workunit.client.0.smithi046.stdout:9/513: write d11/d19/d1b/d31/d44/f4c [1927523,31659] 0 2024-09-21T12:47:14.259 INFO:tasks.workunit.client.0.smithi046.stdout:2/467: rmdir d16/d5c/d70 0 2024-09-21T12:47:14.261 INFO:tasks.workunit.client.0.smithi046.stdout:6/480: creat de/d2a/d4c/d77/d8f/d94/f9d x:0 0 0 2024-09-21T12:47:14.261 INFO:tasks.workunit.client.0.smithi046.stdout:8/509: dwrite d1/d12/d53/f98 [0,4194304] 0 2024-09-21T12:47:14.261 INFO:tasks.workunit.client.0.smithi046.stdout:2/468: chown d16/d22/d2b/d30/l76 5937 1 2024-09-21T12:47:14.261 INFO:tasks.workunit.client.0.smithi046.stdout:1/397: mkdir d4/d29/d89 0 2024-09-21T12:47:14.263 INFO:tasks.workunit.client.0.smithi046.stdout:9/514: symlink d11/d19/d1b/la0 0 2024-09-21T12:47:14.264 INFO:tasks.workunit.client.0.smithi046.stdout:9/515: readlink d11/l17 0 2024-09-21T12:47:14.265 INFO:tasks.workunit.client.0.smithi046.stdout:9/516: chown d11/d19/d36/d45 1035020 1 2024-09-21T12:47:14.267 INFO:tasks.workunit.client.0.smithi046.stdout:9/517: truncate d11/d19/d1b/d31/f7d 5127814 0 2024-09-21T12:47:14.268 INFO:tasks.workunit.client.0.smithi046.stdout:9/518: fsync d11/d19/f4d 0 2024-09-21T12:47:14.269 INFO:tasks.workunit.client.0.smithi046.stdout:9/519: chown d11/d19/d1b/l57 0 1 2024-09-21T12:47:14.270 INFO:tasks.workunit.client.0.smithi046.stdout:6/481: symlink de/d35/l9e 0 2024-09-21T12:47:14.271 INFO:tasks.workunit.client.0.smithi046.stdout:2/469: stat d16/d22/f2e 0 2024-09-21T12:47:14.276 INFO:tasks.workunit.client.0.smithi046.stdout:6/482: fdatasync de/d2a/d4c/d69/f84 0 2024-09-21T12:47:14.280 INFO:tasks.workunit.client.0.smithi046.stdout:9/520: creat d11/d19/d1b/d1c/d1f/d74/fa1 x:0 0 0 2024-09-21T12:47:14.280 INFO:tasks.workunit.client.0.smithi046.stdout:2/470: dwrite d16/d22/d38/d77/f82 [0,4194304] 0 2024-09-21T12:47:14.284 INFO:tasks.workunit.client.0.smithi046.stdout:9/521: symlink d11/d5b/la2 0 2024-09-21T12:47:14.287 INFO:tasks.workunit.client.0.smithi046.stdout:8/510: write d1/d12/d1a/f1b [148669,62823] 0 2024-09-21T12:47:14.288 INFO:tasks.workunit.client.0.smithi046.stdout:9/522: fsync d11/d19/d1b/d31/f43 0 2024-09-21T12:47:14.292 INFO:tasks.workunit.client.0.smithi046.stdout:6/483: getdents de/d2a 0 2024-09-21T12:47:14.297 INFO:tasks.workunit.client.0.smithi046.stdout:8/511: creat d1/d12/d46/d35/d7d/fb3 x:0 0 0 2024-09-21T12:47:14.301 INFO:tasks.workunit.client.0.smithi046.stdout:3/371: dwrite d5/dc/f1d [4194304,4194304] 0 2024-09-21T12:47:14.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/471: dwrite d16/d22/f2d [0,4194304] 0 2024-09-21T12:47:14.305 INFO:tasks.workunit.client.0.smithi046.stdout:1/398: dwrite d4/d13/f2f [0,4194304] 0 2024-09-21T12:47:14.307 INFO:tasks.workunit.client.0.smithi046.stdout:6/484: creat de/d2a/d34/d4e/d55/f9f x:0 0 0 2024-09-21T12:47:14.311 INFO:tasks.workunit.client.0.smithi046.stdout:3/372: chown d5/d5e 109 1 2024-09-21T12:47:14.312 INFO:tasks.workunit.client.0.smithi046.stdout:8/512: dread - d1/d12/d46/d35/d7d/f42 zero size 2024-09-21T12:47:14.313 INFO:tasks.workunit.client.0.smithi046.stdout:6/485: mknod de/d35/ca0 0 2024-09-21T12:47:14.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/513: read - d1/d12/d46/d35/d7d/d6a/f9a zero size 2024-09-21T12:47:14.321 INFO:tasks.workunit.client.0.smithi046.stdout:3/373: truncate d5/dc/f57 944589 0 2024-09-21T12:47:14.324 INFO:tasks.workunit.client.0.smithi046.stdout:2/472: rename d16/d22/d2b/c52 to d16/d22/d2b/d43/c92 0 2024-09-21T12:47:14.327 INFO:tasks.workunit.client.0.smithi046.stdout:3/374: rename d5/dc/d28/c58 to d5/dc/d28/c83 0 2024-09-21T12:47:14.329 INFO:tasks.workunit.client.0.smithi046.stdout:8/514: rename d1/d12/d46/d35/d36/d51/c57 to d1/cb4 0 2024-09-21T12:47:14.330 INFO:tasks.workunit.client.0.smithi046.stdout:2/473: read - d16/d22/d2b/d43/f5a zero size 2024-09-21T12:47:14.331 INFO:tasks.workunit.client.0.smithi046.stdout:9/523: dread d11/d5b/d6f/f8a [0,4194304] 0 2024-09-21T12:47:14.331 INFO:tasks.workunit.client.0.smithi046.stdout:2/474: readlink d16/d5c/l7c 0 2024-09-21T12:47:14.331 INFO:tasks.workunit.client.0.smithi046.stdout:3/375: creat d5/dc/d28/f84 x:0 0 0 2024-09-21T12:47:14.335 INFO:tasks.workunit.client.0.smithi046.stdout:8/515: mkdir d1/db5 0 2024-09-21T12:47:14.339 INFO:tasks.workunit.client.0.smithi046.stdout:8/516: write d1/d12/d46/d35/d5b/f70 [4805747,21648] 0 2024-09-21T12:47:14.341 INFO:tasks.workunit.client.0.smithi046.stdout:6/486: dwrite f9 [0,4194304] 0 2024-09-21T12:47:14.343 INFO:tasks.workunit.client.0.smithi046.stdout:8/517: chown d1/d12/d46/d35/d7d/f67 4 1 2024-09-21T12:47:14.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/399: dread d4/d29/d32/f3f [0,4194304] 0 2024-09-21T12:47:14.349 INFO:tasks.workunit.client.0.smithi046.stdout:6/487: rename de/f32 to de/d2a/d4c/d77/fa1 0 2024-09-21T12:47:14.350 INFO:tasks.workunit.client.0.smithi046.stdout:8/518: fsync d1/d12/f18 0 2024-09-21T12:47:14.353 INFO:tasks.workunit.client.0.smithi046.stdout:1/400: chown d4/d29/f6c 0 1 2024-09-21T12:47:14.355 INFO:tasks.workunit.client.0.smithi046.stdout:3/376: link d5/dc/d26/f37 d5/f85 0 2024-09-21T12:47:14.358 INFO:tasks.workunit.client.0.smithi046.stdout:6/488: read - de/f4b zero size 2024-09-21T12:47:14.358 INFO:tasks.workunit.client.0.smithi046.stdout:9/524: dread d11/d19/d36/f77 [0,4194304] 0 2024-09-21T12:47:14.360 INFO:tasks.workunit.client.0.smithi046.stdout:2/475: dwrite d16/d22/d2b/d43/f5a [0,4194304] 0 2024-09-21T12:47:14.361 INFO:tasks.workunit.client.0.smithi046.stdout:6/489: write de/d2a/d4c/d71/d7c/f87 [218077,142] 0 2024-09-21T12:47:14.362 INFO:tasks.workunit.client.0.smithi046.stdout:2/476: chown d16/d22/d38/c54 568 1 2024-09-21T12:47:14.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/401: mkdir d4/d13/d38/d48/d8a 0 2024-09-21T12:47:14.363 INFO:tasks.workunit.client.0.smithi046.stdout:2/477: stat d16/d22/f41 0 2024-09-21T12:47:14.366 INFO:tasks.workunit.client.0.smithi046.stdout:3/377: creat d5/d5e/f86 x:0 0 0 2024-09-21T12:47:14.367 INFO:tasks.workunit.client.0.smithi046.stdout:3/378: chown d5/dc/d26/l2e 32781083 1 2024-09-21T12:47:14.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/519: mknod d1/d12/d46/d35/d36/cb6 0 2024-09-21T12:47:14.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/520: dread - d1/d12/d46/d35/d7d/f42 zero size 2024-09-21T12:47:14.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/490: fdatasync de/d2a/d4d/f74 0 2024-09-21T12:47:14.371 INFO:tasks.workunit.client.0.smithi046.stdout:6/491: chown de/d2a 1671987 1 2024-09-21T12:47:14.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/402: mkdir d4/d13/d38/d53/d80/d8b 0 2024-09-21T12:47:14.375 INFO:tasks.workunit.client.0.smithi046.stdout:2/478: symlink d16/d22/d38/l93 0 2024-09-21T12:47:14.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/403: unlink d4/d13/d38/d48/c64 0 2024-09-21T12:47:14.381 INFO:tasks.workunit.client.0.smithi046.stdout:2/479: chown lb 113 1 2024-09-21T12:47:14.384 INFO:tasks.workunit.client.0.smithi046.stdout:6/492: fsync de/f20 0 2024-09-21T12:47:14.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/521: creat d1/d12/d1a/fb7 x:0 0 0 2024-09-21T12:47:14.386 INFO:tasks.workunit.client.0.smithi046.stdout:1/404: mkdir d4/d13/d38/d53/d5a/d5d/d8c 0 2024-09-21T12:47:14.389 INFO:tasks.workunit.client.0.smithi046.stdout:2/480: fsync d16/f21 0 2024-09-21T12:47:14.391 INFO:tasks.workunit.client.0.smithi046.stdout:2/481: truncate d16/d22/f31 4538565 0 2024-09-21T12:47:14.394 INFO:tasks.workunit.client.0.smithi046.stdout:6/493: unlink de/f28 0 2024-09-21T12:47:14.394 INFO:tasks.workunit.client.0.smithi046.stdout:3/379: getdents d5/dc/d28/d60 0 2024-09-21T12:47:14.397 INFO:tasks.workunit.client.0.smithi046.stdout:1/405: mknod d4/d13/d38/d53/d5a/d5d/c8d 0 2024-09-21T12:47:14.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/482: mknod d16/d22/d2b/d30/d67/c94 0 2024-09-21T12:47:14.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/483: write d16/d22/d2b/f6e [975217,105277] 0 2024-09-21T12:47:14.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/406: dread d4/f9 [0,4194304] 0 2024-09-21T12:47:14.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/407: stat d4/d13/d38/d4f 0 2024-09-21T12:47:14.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/408: readlink d4/d13/l33 0 2024-09-21T12:47:14.409 INFO:tasks.workunit.client.0.smithi046.stdout:3/380: mknod d5/dc/c87 0 2024-09-21T12:47:14.410 INFO:tasks.workunit.client.0.smithi046.stdout:3/381: chown d5/dc/l32 3078822 1 2024-09-21T12:47:14.411 INFO:tasks.workunit.client.0.smithi046.stdout:2/484: symlink d16/d22/d2b/d43/l95 0 2024-09-21T12:47:14.413 INFO:tasks.workunit.client.0.smithi046.stdout:8/522: link d1/d12/d53/d60/f64 d1/d12/d46/d35/d36/d51/d8c/fb8 0 2024-09-21T12:47:14.414 INFO:tasks.workunit.client.0.smithi046.stdout:1/409: creat d4/d13/d6b/f8e x:0 0 0 2024-09-21T12:47:14.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/382: read - d5/dc/d26/d3c/d44/f5d zero size 2024-09-21T12:47:14.415 INFO:tasks.workunit.client.0.smithi046.stdout:8/523: mknod d1/d12/d1a/d33/cb9 0 2024-09-21T12:47:14.416 INFO:tasks.workunit.client.0.smithi046.stdout:1/410: write d4/d13/f1c [3535965,20411] 0 2024-09-21T12:47:14.418 INFO:tasks.workunit.client.0.smithi046.stdout:3/383: mknod d5/dc/d30/d7c/c88 0 2024-09-21T12:47:14.419 INFO:tasks.workunit.client.0.smithi046.stdout:3/384: chown d5/dc/l13 0 1 2024-09-21T12:47:14.421 INFO:tasks.workunit.client.0.smithi046.stdout:1/411: rename d4/d13/d38/d53/f66 to d4/d13/d38/d53/d5a/f8f 0 2024-09-21T12:47:14.422 INFO:tasks.workunit.client.0.smithi046.stdout:1/412: chown d4/d13/d6b/f7b 3 1 2024-09-21T12:47:14.426 INFO:tasks.workunit.client.0.smithi046.stdout:1/413: unlink d4/d13/d38/d53/d5a/d5d/f60 0 2024-09-21T12:47:14.428 INFO:tasks.workunit.client.0.smithi046.stdout:1/414: stat d4/c4b 0 2024-09-21T12:47:14.429 INFO:tasks.workunit.client.0.smithi046.stdout:3/385: getdents d5/dc/d30/d34 0 2024-09-21T12:47:14.435 INFO:tasks.workunit.client.0.smithi046.stdout:1/415: dwrite d4/d13/d6b/f7b [0,4194304] 0 2024-09-21T12:47:14.435 INFO:tasks.workunit.client.0.smithi046.stdout:3/386: rename d5/dc/f68 to d5/dc/d30/d34/f89 0 2024-09-21T12:47:14.437 INFO:tasks.workunit.client.0.smithi046.stdout:1/416: write d4/d13/d6b/f8e [16683,88008] 0 2024-09-21T12:47:14.438 INFO:tasks.workunit.client.0.smithi046.stdout:1/417: rename d4/d13/d38 to d4/d13/d38/d53/d5a/d90 22 2024-09-21T12:47:14.445 INFO:tasks.workunit.client.0.smithi046.stdout:8/524: dwrite d1/d12/d46/d35/d7d/f42 [0,4194304] 0 2024-09-21T12:47:14.448 INFO:tasks.workunit.client.0.smithi046.stdout:1/418: symlink d4/d13/d6b/l91 0 2024-09-21T12:47:14.450 INFO:tasks.workunit.client.0.smithi046.stdout:1/419: truncate d4/d13/f84 136631 0 2024-09-21T12:47:14.451 INFO:tasks.workunit.client.0.smithi046.stdout:1/420: chown d4/d29/d32/l51 1 1 2024-09-21T12:47:14.455 INFO:tasks.workunit.client.0.smithi046.stdout:8/525: unlink d1/d12/d46/l77 0 2024-09-21T12:47:14.456 INFO:tasks.workunit.client.0.smithi046.stdout:3/387: write d5/dc/f1b [3535878,34455] 0 2024-09-21T12:47:14.459 INFO:tasks.workunit.client.0.smithi046.stdout:8/526: read d1/d12/d1a/f2c [1215452,24794] 0 2024-09-21T12:47:14.460 INFO:tasks.workunit.client.0.smithi046.stdout:1/421: mkdir d4/d13/d38/d53/d5a/d5d/d8c/d92 0 2024-09-21T12:47:14.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/388: read d5/f24 [442761,2124] 0 2024-09-21T12:47:14.464 INFO:tasks.workunit.client.0.smithi046.stdout:3/389: readlink d5/dc/d28/d63/l76 0 2024-09-21T12:47:14.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/390: chown d5/dc/d28/d60/f73 634 1 2024-09-21T12:47:14.467 INFO:tasks.workunit.client.0.smithi046.stdout:1/422: unlink d4/d13/d38/f58 0 2024-09-21T12:47:14.473 INFO:tasks.workunit.client.0.smithi046.stdout:8/527: write d1/d12/d46/d35/d7d/f29 [1972765,43939] 0 2024-09-21T12:47:14.474 INFO:tasks.workunit.client.0.smithi046.stdout:3/391: symlink d5/dc/d26/l8a 0 2024-09-21T12:47:14.478 INFO:tasks.workunit.client.0.smithi046.stdout:3/392: write d5/dc/d26/f27 [3371593,50844] 0 2024-09-21T12:47:14.480 INFO:tasks.workunit.client.0.smithi046.stdout:8/528: dwrite d1/d12/d1a/f1b [0,4194304] 0 2024-09-21T12:47:14.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/423: getdents d4/d13 0 2024-09-21T12:47:14.486 INFO:tasks.workunit.client.0.smithi046.stdout:3/393: creat d5/d16/d5f/f8b x:0 0 0 2024-09-21T12:47:14.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/424: truncate d4/f6a 4688447 0 2024-09-21T12:47:14.488 INFO:tasks.workunit.client.0.smithi046.stdout:1/425: chown d4/f9 566 1 2024-09-21T12:47:14.488 INFO:tasks.workunit.client.0.smithi046.stdout:3/394: fsync d5/dc/d28/d60/d6e/f7a 0 2024-09-21T12:47:14.489 INFO:tasks.workunit.client.0.smithi046.stdout:8/529: dwrite d1/f8 [0,4194304] 0 2024-09-21T12:47:14.489 INFO:tasks.workunit.client.0.smithi046.stdout:1/426: stat d4/d13/d38/d48 0 2024-09-21T12:47:14.491 INFO:tasks.workunit.client.0.smithi046.stdout:1/427: chown d4/d13/d6b/f7b 17 1 2024-09-21T12:47:14.495 INFO:tasks.workunit.client.0.smithi046.stdout:3/395: fdatasync d5/dc/d30/f39 0 2024-09-21T12:47:14.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/396: rmdir d5 39 2024-09-21T12:47:14.501 INFO:tasks.workunit.client.0.smithi046.stdout:1/428: mknod d4/c93 0 2024-09-21T12:47:14.511 INFO:tasks.workunit.client.0.smithi046.stdout:3/397: rename d5/dc/d28/d63/f7d to d5/dc/d30/d34/f8c 0 2024-09-21T12:47:14.519 INFO:tasks.workunit.client.0.smithi046.stdout:1/429: getdents d4/d13/d38/d53/d5a/d5d/d8c 0 2024-09-21T12:47:14.521 INFO:tasks.workunit.client.0.smithi046.stdout:3/398: creat d5/f8d x:0 0 0 2024-09-21T12:47:14.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/399: read d5/dc/fe [2111746,88510] 0 2024-09-21T12:47:14.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/430: mkdir d4/d13/d38/d53/d5a/d5d/d8c/d94 0 2024-09-21T12:47:14.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/431: dread - d4/d13/f7f zero size 2024-09-21T12:47:14.536 INFO:tasks.workunit.client.0.smithi046.stdout:3/400: getdents d5/dc/d28 0 2024-09-21T12:47:14.551 INFO:tasks.workunit.client.0.smithi046.stdout:1/432: dwrite d4/d13/d38/d48/f5c [0,4194304] 0 2024-09-21T12:47:14.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/401: dwrite d5/f20 [0,4194304] 0 2024-09-21T12:47:14.557 INFO:tasks.workunit.client.0.smithi046.stdout:3/402: write d5/dc/d28/f84 [287022,41541] 0 2024-09-21T12:47:14.580 INFO:tasks.workunit.client.0.smithi046.stdout:3/403: fsync d5/dc/d26/d3c/d44/f5d 0 2024-09-21T12:47:14.583 INFO:tasks.workunit.client.0.smithi046.stdout:1/433: truncate d4/d13/d38/d53/d80/f85 1376532 0 2024-09-21T12:47:14.596 INFO:tasks.workunit.client.0.smithi046.stdout:0/495: sync 2024-09-21T12:47:14.598 INFO:tasks.workunit.client.0.smithi046.stdout:0/496: mknod d6/d7/d9/d54/d97/cc2 0 2024-09-21T12:47:14.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/497: dread d6/d7/d13/d7b/da2/f46 [0,4194304] 0 2024-09-21T12:47:14.603 INFO:tasks.workunit.client.0.smithi046.stdout:0/498: read - d6/d7/d37/faa zero size 2024-09-21T12:47:14.619 INFO:tasks.workunit.client.0.smithi046.stdout:0/499: dwrite d6/d7/d13/f36 [0,4194304] 0 2024-09-21T12:47:14.624 INFO:tasks.workunit.client.0.smithi046.stdout:0/500: dread d6/f1a [4194304,4194304] 0 2024-09-21T12:47:14.636 INFO:tasks.workunit.client.0.smithi046.stdout:0/501: write d6/d7/d37/f71 [1071761,20305] 0 2024-09-21T12:47:14.640 INFO:tasks.workunit.client.0.smithi046.stdout:0/502: rename d6/d4f to d6/d7/d13/d43/d52/dc0/dc3 0 2024-09-21T12:47:14.645 INFO:tasks.workunit.client.0.smithi046.stdout:0/503: mkdir d6/d7/d9/dc4 0 2024-09-21T12:47:14.645 INFO:tasks.workunit.client.0.smithi046.stdout:0/504: creat d6/d7/d13/d43/d52/d63/d7f/d38/db7/fc5 x:0 0 0 2024-09-21T12:47:14.650 INFO:tasks.workunit.client.0.smithi046.stdout:0/505: link d6/d7/d37/l69 d6/d7/d13/d7b/da2/lc6 0 2024-09-21T12:47:14.660 INFO:tasks.workunit.client.0.smithi046.stdout:0/506: truncate d6/d7/d37/f71 980604 0 2024-09-21T12:47:14.663 INFO:tasks.workunit.client.0.smithi046.stdout:0/507: creat d6/d7/fc7 x:0 0 0 2024-09-21T12:47:14.663 INFO:tasks.workunit.client.0.smithi046.stdout:0/508: chown d6/d2f/d32/fbb 11 1 2024-09-21T12:47:14.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/509: unlink d6/d7/d13/d43/d52/d63/d7f/la1 0 2024-09-21T12:47:14.667 INFO:tasks.workunit.client.0.smithi046.stdout:0/510: truncate d6/d7/d9/fb 6305981 0 2024-09-21T12:47:14.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/511: dread d6/d7/d37/f48 [0,4194304] 0 2024-09-21T12:47:14.700 INFO:tasks.workunit.client.0.smithi046.stdout:0/512: write d6/d7/f5b [3477368,124694] 0 2024-09-21T12:47:14.702 INFO:tasks.workunit.client.0.smithi046.stdout:0/513: fdatasync d6/d7/d9/f57 0 2024-09-21T12:47:14.705 INFO:tasks.workunit.client.0.smithi046.stdout:0/514: creat d6/d2f/fc8 x:0 0 0 2024-09-21T12:47:14.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/515: read d6/d7/d13/d72/d9b/fa8 [53847,39257] 0 2024-09-21T12:47:14.708 INFO:tasks.workunit.client.0.smithi046.stdout:0/516: fdatasync d6/d7/d13/d49/f5c 0 2024-09-21T12:47:14.711 INFO:tasks.workunit.client.0.smithi046.stdout:0/517: symlink d6/d7/d13/d43/d52/d63/d7f/d78/d8a/lc9 0 2024-09-21T12:47:14.717 INFO:tasks.workunit.client.0.smithi046.stdout:0/518: dwrite d6/d2f/fc8 [0,4194304] 0 2024-09-21T12:47:14.744 INFO:tasks.workunit.client.0.smithi046.stdout:0/519: write d6/d7/d13/d43/d52/dc0/dc3/f82 [2027015,63844] 0 2024-09-21T12:47:14.746 INFO:tasks.workunit.client.0.smithi046.stdout:0/520: readlink d6/d7/d37/l69 0 2024-09-21T12:47:14.746 INFO:tasks.workunit.client.0.smithi046.stdout:0/521: chown d6/l5d 6296 1 2024-09-21T12:47:14.748 INFO:tasks.workunit.client.0.smithi046.stdout:0/522: mkdir d6/d7/d9/dca 0 2024-09-21T12:47:14.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/523: fsync d6/d2f/fc8 0 2024-09-21T12:47:14.751 INFO:tasks.workunit.client.0.smithi046.stdout:0/524: write d6/d7/d13/f4b [4674257,41431] 0 2024-09-21T12:47:14.752 INFO:tasks.workunit.client.0.smithi046.stdout:0/525: chown d6/d7/d13/d43 7599 1 2024-09-21T12:47:14.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/526: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/f93 [0,4194304] 0 2024-09-21T12:47:14.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/527: write d6/d7/d13/d7b/da2/f46 [975134,102052] 0 2024-09-21T12:47:14.789 INFO:tasks.workunit.client.0.smithi046.stdout:0/528: dwrite d6/d7/d13/fb3 [0,4194304] 0 2024-09-21T12:47:14.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/529: read - d6/f62 zero size 2024-09-21T12:47:14.925 INFO:tasks.workunit.client.0.smithi046.stdout:0/530: dwrite d6/d2f/d32/fb2 [0,4194304] 0 2024-09-21T12:47:14.929 INFO:tasks.workunit.client.0.smithi046.stdout:0/531: rename d6/d7/d37/f3e to d6/d60/fcb 0 2024-09-21T12:47:14.930 INFO:tasks.workunit.client.0.smithi046.stdout:0/532: mknod d6/dac/ccc 0 2024-09-21T12:47:15.061 INFO:tasks.workunit.client.0.smithi046.stdout:5/422: sync 2024-09-21T12:47:15.062 INFO:tasks.workunit.client.0.smithi046.stdout:5/423: stat d4/dc/d13/d5b/c82 0 2024-09-21T12:47:15.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/424: stat d4/dc/d13/d5b/d2d/d3b/f72 0 2024-09-21T12:47:15.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/425: dwrite d4/dc/d13/f38 [0,4194304] 0 2024-09-21T12:47:15.080 INFO:tasks.workunit.client.0.smithi046.stdout:5/426: chown d4/d16/c40 1 1 2024-09-21T12:47:15.085 INFO:tasks.workunit.client.0.smithi046.stdout:5/427: rename d4/c2a to d4/dc/d13/d5b/d2d/d3b/c86 0 2024-09-21T12:47:15.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/428: fdatasync d4/dc/d13/d5b/d2d/f7d 0 2024-09-21T12:47:15.088 INFO:tasks.workunit.client.0.smithi046.stdout:5/429: creat d4/dc/d45/f87 x:0 0 0 2024-09-21T12:47:15.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/430: chown d4/dc/d13/d15/f51 5 1 2024-09-21T12:47:15.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/431: write d4/dc/d13/d5b/d2d/f4f [508628,2790] 0 2024-09-21T12:47:15.094 INFO:tasks.workunit.client.0.smithi046.stdout:5/432: link d4/f8 d4/dc/d13/d5b/d2d/d43/d7a/f88 0 2024-09-21T12:47:15.096 INFO:tasks.workunit.client.0.smithi046.stdout:5/433: mknod d4/d22/c89 0 2024-09-21T12:47:15.103 INFO:tasks.workunit.client.0.smithi046.stdout:5/434: dwrite d4/dc/d13/d5e/f66 [0,4194304] 0 2024-09-21T12:47:15.116 INFO:tasks.workunit.client.0.smithi046.stdout:5/435: getdents d4/dc/d13/d15/d54 0 2024-09-21T12:47:15.132 INFO:tasks.workunit.client.0.smithi046.stdout:5/436: dread d4/dc/d13/d5b/d2d/d3b/f68 [0,4194304] 0 2024-09-21T12:47:15.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/437: readlink d4/dc/d13/d5b/d2d/d43/d7a/l74 0 2024-09-21T12:47:15.141 INFO:tasks.workunit.client.0.smithi046.stdout:5/438: dwrite d4/dc/d13/f23 [0,4194304] 0 2024-09-21T12:47:15.144 INFO:tasks.workunit.client.0.smithi046.stdout:5/439: mknod d4/dc/d13/d5b/d2d/d43/c8a 0 2024-09-21T12:47:15.156 INFO:tasks.workunit.client.0.smithi046.stdout:5/440: dread d4/dc/d13/d5b/f3f [4194304,4194304] 0 2024-09-21T12:47:15.160 INFO:tasks.workunit.client.0.smithi046.stdout:5/441: creat d4/dc/d13/d15/d5c/f8b x:0 0 0 2024-09-21T12:47:15.162 INFO:tasks.workunit.client.0.smithi046.stdout:5/442: mknod d4/dc/d6b/c8c 0 2024-09-21T12:47:15.163 INFO:tasks.workunit.client.0.smithi046.stdout:5/443: write d4/d22/f73 [435188,88519] 0 2024-09-21T12:47:15.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/444: creat d4/dc/d45/f8d x:0 0 0 2024-09-21T12:47:15.174 INFO:tasks.workunit.client.0.smithi046.stdout:5/445: write d4/dc/d13/d5b/d2d/d3b/f72 [1694788,46641] 0 2024-09-21T12:47:15.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/450: sync 2024-09-21T12:47:15.196 INFO:tasks.workunit.client.0.smithi046.stdout:4/472: sync 2024-09-21T12:47:15.196 INFO:tasks.workunit.client.0.smithi046.stdout:9/525: sync 2024-09-21T12:47:15.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/473: dread - d1/d13/d25/d29/f54 zero size 2024-09-21T12:47:15.198 INFO:tasks.workunit.client.0.smithi046.stdout:7/451: truncate d2/d4/df/d17/f63 229318 0 2024-09-21T12:47:15.198 INFO:tasks.workunit.client.0.smithi046.stdout:9/526: creat d11/d19/d1b/d31/d44/fa3 x:0 0 0 2024-09-21T12:47:15.203 INFO:tasks.workunit.client.0.smithi046.stdout:4/474: dwrite d1/d27/d58/f90 [0,4194304] 0 2024-09-21T12:47:15.207 INFO:tasks.workunit.client.0.smithi046.stdout:7/452: dwrite d2/d4/df/d70/d88/d34/f48 [0,4194304] 0 2024-09-21T12:47:15.214 INFO:tasks.workunit.client.0.smithi046.stdout:4/475: dwrite d1/d13/f16 [0,4194304] 0 2024-09-21T12:47:15.218 INFO:tasks.workunit.client.0.smithi046.stdout:7/453: mkdir d2/d8e 0 2024-09-21T12:47:15.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/476: mknod d1/d13/d4e/ca2 0 2024-09-21T12:47:15.225 INFO:tasks.workunit.client.0.smithi046.stdout:4/477: mknod d1/d27/d37/d8f/ca3 0 2024-09-21T12:47:15.225 INFO:tasks.workunit.client.0.smithi046.stdout:9/527: dwrite d11/f3c [0,4194304] 0 2024-09-21T12:47:15.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/528: fdatasync d11/d19/d1b/d31/f5a 0 2024-09-21T12:47:15.232 INFO:tasks.workunit.client.0.smithi046.stdout:9/529: fsync d11/d5b/d6f/f8a 0 2024-09-21T12:47:15.239 INFO:tasks.workunit.client.0.smithi046.stdout:9/530: dwrite f2 [4194304,4194304] 0 2024-09-21T12:47:15.242 INFO:tasks.workunit.client.0.smithi046.stdout:9/531: fsync d11/d19/d1b/d1c/d1f/d30/d3e/f81 0 2024-09-21T12:47:15.243 INFO:tasks.workunit.client.0.smithi046.stdout:4/478: dread d1/d13/d25/d29/d33/f62 [0,4194304] 0 2024-09-21T12:47:15.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/479: dread d1/f39 [0,4194304] 0 2024-09-21T12:47:15.306 INFO:tasks.workunit.client.0.smithi046.stdout:9/532: rename d11/d19/d36/d45/d64 to d11/d19/d1b/d31/d53/da4 0 2024-09-21T12:47:15.310 INFO:tasks.workunit.client.0.smithi046.stdout:7/454: write d2/d4/df/d17/f56 [635868,75030] 0 2024-09-21T12:47:15.315 INFO:tasks.workunit.client.0.smithi046.stdout:9/533: creat d11/d19/d1b/d31/d44/fa5 x:0 0 0 2024-09-21T12:47:15.323 INFO:tasks.workunit.client.0.smithi046.stdout:7/455: rmdir d2/d8e 0 2024-09-21T12:47:15.325 INFO:tasks.workunit.client.0.smithi046.stdout:7/456: symlink d2/dd/l8f 0 2024-09-21T12:47:15.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/534: getdents d11/d19/d1b/d4b 0 2024-09-21T12:47:15.329 INFO:tasks.workunit.client.0.smithi046.stdout:4/480: dwrite d1/d27/d46/f3e [0,4194304] 0 2024-09-21T12:47:15.331 INFO:tasks.workunit.client.0.smithi046.stdout:9/535: dread d11/d19/d36/d45/f67 [0,4194304] 0 2024-09-21T12:47:15.333 INFO:tasks.workunit.client.0.smithi046.stdout:4/481: creat d1/d27/d46/d78/fa4 x:0 0 0 2024-09-21T12:47:15.339 INFO:tasks.workunit.client.0.smithi046.stdout:9/536: dwrite d11/d19/d1b/f25 [0,4194304] 0 2024-09-21T12:47:15.343 INFO:tasks.workunit.client.0.smithi046.stdout:7/457: truncate d2/d4/df/d17/f56 184464 0 2024-09-21T12:47:15.346 INFO:tasks.workunit.client.0.smithi046.stdout:7/458: mknod d2/d4/df/d42/c90 0 2024-09-21T12:47:15.346 INFO:tasks.workunit.client.0.smithi046.stdout:4/482: write d1/f74 [955848,114524] 0 2024-09-21T12:47:15.349 INFO:tasks.workunit.client.0.smithi046.stdout:2/485: sync 2024-09-21T12:47:15.349 INFO:tasks.workunit.client.0.smithi046.stdout:6/494: sync 2024-09-21T12:47:15.351 INFO:tasks.workunit.client.0.smithi046.stdout:2/486: mkdir d16/d5c/d96 0 2024-09-21T12:47:15.352 INFO:tasks.workunit.client.0.smithi046.stdout:2/487: chown d16/d22/d2b/d30/c3a 4 1 2024-09-21T12:47:15.352 INFO:tasks.workunit.client.0.smithi046.stdout:4/483: rename d1/d27/c9a to d1/d85/ca5 0 2024-09-21T12:47:15.361 INFO:tasks.workunit.client.0.smithi046.stdout:6/495: rename de/d35/ca0 to de/d2a/d4c/d69/ca2 0 2024-09-21T12:47:15.363 INFO:tasks.workunit.client.0.smithi046.stdout:4/484: rmdir d1/d5f 39 2024-09-21T12:47:15.364 INFO:tasks.workunit.client.0.smithi046.stdout:4/485: write d1/d27/d46/f48 [4545989,43756] 0 2024-09-21T12:47:15.365 INFO:tasks.workunit.client.0.smithi046.stdout:2/488: creat d16/d22/f97 x:0 0 0 2024-09-21T12:47:15.367 INFO:tasks.workunit.client.0.smithi046.stdout:4/486: write d1/d27/d58/f4f [3514266,68946] 0 2024-09-21T12:47:15.372 INFO:tasks.workunit.client.0.smithi046.stdout:4/487: dread - d1/d27/f61 zero size 2024-09-21T12:47:15.374 INFO:tasks.workunit.client.0.smithi046.stdout:4/488: read d1/d27/d58/f5c [7173889,7288] 0 2024-09-21T12:47:15.376 INFO:tasks.workunit.client.0.smithi046.stdout:6/496: mknod de/d2a/d4c/d77/d98/ca3 0 2024-09-21T12:47:15.376 INFO:tasks.workunit.client.0.smithi046.stdout:7/459: dread d2/d4/f3c [0,4194304] 0 2024-09-21T12:47:15.378 INFO:tasks.workunit.client.0.smithi046.stdout:7/460: write d2/d37/f4d [129860,98472] 0 2024-09-21T12:47:15.381 INFO:tasks.workunit.client.0.smithi046.stdout:7/461: dread d2/d37/f4d [0,4194304] 0 2024-09-21T12:47:15.382 INFO:tasks.workunit.client.0.smithi046.stdout:6/497: mknod de/d2a/d4c/d77/ca4 0 2024-09-21T12:47:15.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/462: rmdir d2/d4/df/d42 39 2024-09-21T12:47:15.388 INFO:tasks.workunit.client.0.smithi046.stdout:2/489: getdents d16/d22/d38 0 2024-09-21T12:47:15.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/489: dread d1/d27/d46/f48 [0,4194304] 0 2024-09-21T12:47:15.390 INFO:tasks.workunit.client.0.smithi046.stdout:6/498: mknod de/d2a/d4c/d77/ca5 0 2024-09-21T12:47:15.393 INFO:tasks.workunit.client.0.smithi046.stdout:4/490: write d1/d27/d46/f77 [1978259,113498] 0 2024-09-21T12:47:15.396 INFO:tasks.workunit.client.0.smithi046.stdout:7/463: dwrite d2/d4/df/d6f/f76 [0,4194304] 0 2024-09-21T12:47:15.399 INFO:tasks.workunit.client.0.smithi046.stdout:2/490: creat d16/d22/d38/d77/d7a/f98 x:0 0 0 2024-09-21T12:47:15.400 INFO:tasks.workunit.client.0.smithi046.stdout:7/464: rename d2/d4/df/d17/c52 to d2/d37/d77/c91 0 2024-09-21T12:47:15.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/491: truncate d16/d22/d38/d77/d7a/f98 321569 0 2024-09-21T12:47:15.404 INFO:tasks.workunit.client.0.smithi046.stdout:7/465: mkdir d2/d4/df/d6f/d92 0 2024-09-21T12:47:15.410 INFO:tasks.workunit.client.0.smithi046.stdout:4/491: truncate d1/d27/d37/f49 21056 0 2024-09-21T12:47:15.413 INFO:tasks.workunit.client.0.smithi046.stdout:4/492: write d1/d13/f81 [2177451,113225] 0 2024-09-21T12:47:15.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/466: dwrite d2/dd/f3d [4194304,4194304] 0 2024-09-21T12:47:15.416 INFO:tasks.workunit.client.0.smithi046.stdout:4/493: read d1/f35 [368842,55049] 0 2024-09-21T12:47:15.417 INFO:tasks.workunit.client.0.smithi046.stdout:2/492: rmdir d16/d22/d2b 39 2024-09-21T12:47:15.420 INFO:tasks.workunit.client.0.smithi046.stdout:6/499: dwrite de/d35/f61 [0,4194304] 0 2024-09-21T12:47:15.423 INFO:tasks.workunit.client.0.smithi046.stdout:4/494: unlink d1/c3f 0 2024-09-21T12:47:15.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/467: symlink d2/d4/df/d70/d88/l93 0 2024-09-21T12:47:15.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/500: mkdir de/d2a/d4c/da6 0 2024-09-21T12:47:15.430 INFO:tasks.workunit.client.0.smithi046.stdout:6/501: read f9 [4065200,55462] 0 2024-09-21T12:47:15.433 INFO:tasks.workunit.client.0.smithi046.stdout:4/495: creat d1/d13/d25/d29/d43/d84/fa6 x:0 0 0 2024-09-21T12:47:15.441 INFO:tasks.workunit.client.0.smithi046.stdout:4/496: rename d1/d27/d46/f48 to d1/d27/d37/fa7 0 2024-09-21T12:47:15.441 INFO:tasks.workunit.client.0.smithi046.stdout:7/468: mkdir d2/d37/d8a/d94 0 2024-09-21T12:47:15.445 INFO:tasks.workunit.client.0.smithi046.stdout:2/493: creat d16/d22/d2b/f99 x:0 0 0 2024-09-21T12:47:15.445 INFO:tasks.workunit.client.0.smithi046.stdout:0/533: sync 2024-09-21T12:47:15.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/404: sync 2024-09-21T12:47:15.445 INFO:tasks.workunit.client.0.smithi046.stdout:1/434: sync 2024-09-21T12:47:15.445 INFO:tasks.workunit.client.0.smithi046.stdout:8/530: sync 2024-09-21T12:47:15.446 INFO:tasks.workunit.client.0.smithi046.stdout:2/494: chown l12 0 1 2024-09-21T12:47:15.447 INFO:tasks.workunit.client.0.smithi046.stdout:2/495: chown d16/l1b 99411 1 2024-09-21T12:47:15.447 INFO:tasks.workunit.client.0.smithi046.stdout:8/531: chown d1/d12/d1a/d33/f59 6755 1 2024-09-21T12:47:15.447 INFO:tasks.workunit.client.0.smithi046.stdout:0/534: dread - d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf zero size 2024-09-21T12:47:15.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/502: link de/d2a/f5e de/d2a/d4c/fa7 0 2024-09-21T12:47:15.450 INFO:tasks.workunit.client.0.smithi046.stdout:7/469: creat d2/d4/df/d6f/d92/f95 x:0 0 0 2024-09-21T12:47:15.451 INFO:tasks.workunit.client.0.smithi046.stdout:3/405: mkdir d5/d5e/d8e 0 2024-09-21T12:47:15.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/535: dread d6/d7/d37/d53/f55 [0,4194304] 0 2024-09-21T12:47:15.454 INFO:tasks.workunit.client.0.smithi046.stdout:0/536: chown d6/d7/d13/d7b/da2/c3b 3 1 2024-09-21T12:47:15.457 INFO:tasks.workunit.client.0.smithi046.stdout:8/532: creat d1/d12/d46/d35/d7d/fba x:0 0 0 2024-09-21T12:47:15.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/537: dread d6/d7/d13/fb3 [0,4194304] 0 2024-09-21T12:47:15.459 INFO:tasks.workunit.client.0.smithi046.stdout:0/538: fsync d6/d60/f92 0 2024-09-21T12:47:15.460 INFO:tasks.workunit.client.0.smithi046.stdout:3/406: dread d5/dc/d30/f39 [0,4194304] 0 2024-09-21T12:47:15.460 INFO:tasks.workunit.client.0.smithi046.stdout:0/539: read d6/d2f/d32/fb2 [2556733,71223] 0 2024-09-21T12:47:15.462 INFO:tasks.workunit.client.0.smithi046.stdout:0/540: read d6/d60/f89 [1803837,84232] 0 2024-09-21T12:47:15.462 INFO:tasks.workunit.client.0.smithi046.stdout:7/470: creat d2/d4/d43/d58/f96 x:0 0 0 2024-09-21T12:47:15.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/541: truncate d6/d7/f9a 790477 0 2024-09-21T12:47:15.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/435: mkdir d4/d13/d38/d53/d80/d95 0 2024-09-21T12:47:15.469 INFO:tasks.workunit.client.0.smithi046.stdout:1/436: dread d4/d13/d38/d53/d5a/f8f [0,4194304] 0 2024-09-21T12:47:15.470 INFO:tasks.workunit.client.0.smithi046.stdout:4/497: truncate d1/d27/d46/d78/f98 2464830 0 2024-09-21T12:47:15.477 INFO:tasks.workunit.client.0.smithi046.stdout:1/437: dwrite d4/f77 [0,4194304] 0 2024-09-21T12:47:15.478 INFO:tasks.workunit.client.0.smithi046.stdout:1/438: readlink d4/d29/d32/l51 0 2024-09-21T12:47:15.479 INFO:tasks.workunit.client.0.smithi046.stdout:4/498: dwrite d1/d13/d25/d29/f42 [0,4194304] 0 2024-09-21T12:47:15.480 INFO:tasks.workunit.client.0.smithi046.stdout:1/439: truncate d4/d13/d6b/f76 896521 0 2024-09-21T12:47:15.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/499: stat d1/d13/d25/d29/d43/f6c 0 2024-09-21T12:47:15.481 INFO:tasks.workunit.client.0.smithi046.stdout:1/440: chown d4/d29/d32/c43 2109 1 2024-09-21T12:47:15.486 INFO:tasks.workunit.client.0.smithi046.stdout:7/471: unlink d2/d4/df/d70/d88/d34/f3a 0 2024-09-21T12:47:15.488 INFO:tasks.workunit.client.0.smithi046.stdout:0/542: creat d6/d7/d9/d54/d97/fcd x:0 0 0 2024-09-21T12:47:15.496 INFO:tasks.workunit.client.0.smithi046.stdout:6/503: write de/d2a/d4c/fa7 [119359,1593] 0 2024-09-21T12:47:15.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/441: chown d4/f22 1373816 1 2024-09-21T12:47:15.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/442: stat d4/d13/d38/d48 0 2024-09-21T12:47:15.502 INFO:tasks.workunit.client.0.smithi046.stdout:7/472: unlink d2/d4/d43/d58/f96 0 2024-09-21T12:47:15.504 INFO:tasks.workunit.client.0.smithi046.stdout:0/543: unlink d6/l86 0 2024-09-21T12:47:15.505 INFO:tasks.workunit.client.0.smithi046.stdout:0/544: write d6/d7/d13/f3d [690324,16924] 0 2024-09-21T12:47:15.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/533: link d1/d12/f13 d1/d12/d53/d60/fbb 0 2024-09-21T12:47:15.506 INFO:tasks.workunit.client.0.smithi046.stdout:0/545: fdatasync d6/d7/d9/ff 0 2024-09-21T12:47:15.507 INFO:tasks.workunit.client.0.smithi046.stdout:4/500: mkdir d1/d27/d82/da8 0 2024-09-21T12:47:15.508 INFO:tasks.workunit.client.0.smithi046.stdout:0/546: chown d6/d7/d13/d43/d52/d63/d7f/d78/l8d 64319 1 2024-09-21T12:47:15.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/473: mkdir d2/d4/d97 0 2024-09-21T12:47:15.518 INFO:tasks.workunit.client.0.smithi046.stdout:8/534: symlink d1/d12/d53/lbc 0 2024-09-21T12:47:15.520 INFO:tasks.workunit.client.0.smithi046.stdout:4/501: mknod d1/d13/d4e/ca9 0 2024-09-21T12:47:15.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/547: symlink d6/d60/lce 0 2024-09-21T12:47:15.523 INFO:tasks.workunit.client.0.smithi046.stdout:7/474: mknod d2/d4/df/d70/d88/d34/d7f/c98 0 2024-09-21T12:47:15.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/502: mkdir d1/d13/d25/d29/d43/d84/daa 0 2024-09-21T12:47:15.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/503: fsync d1/ff 0 2024-09-21T12:47:15.527 INFO:tasks.workunit.client.0.smithi046.stdout:1/443: symlink d4/d13/d38/d53/d80/d8b/l96 0 2024-09-21T12:47:15.530 INFO:tasks.workunit.client.0.smithi046.stdout:0/548: mknod d6/d7/d13/d43/d52/d63/d7f/d78/ccf 0 2024-09-21T12:47:15.532 INFO:tasks.workunit.client.0.smithi046.stdout:7/475: mkdir d2/d37/d8a/d99 0 2024-09-21T12:47:15.533 INFO:tasks.workunit.client.0.smithi046.stdout:1/444: dwrite d4/d13/f1c [0,4194304] 0 2024-09-21T12:47:15.533 INFO:tasks.workunit.client.0.smithi046.stdout:7/476: dread - d2/d37/f81 zero size 2024-09-21T12:47:15.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/504: symlink d1/d27/d46/d78/lab 0 2024-09-21T12:47:15.542 INFO:tasks.workunit.client.0.smithi046.stdout:7/477: unlink d2/d4/l20 0 2024-09-21T12:47:15.546 INFO:tasks.workunit.client.0.smithi046.stdout:1/445: dwrite d4/d13/f36 [0,4194304] 0 2024-09-21T12:47:15.551 INFO:tasks.workunit.client.0.smithi046.stdout:4/505: symlink d1/lac 0 2024-09-21T12:47:15.555 INFO:tasks.workunit.client.0.smithi046.stdout:1/446: mknod d4/d13/d38/d4f/c97 0 2024-09-21T12:47:15.557 INFO:tasks.workunit.client.0.smithi046.stdout:7/478: mkdir d2/d4/df/d9a 0 2024-09-21T12:47:15.559 INFO:tasks.workunit.client.0.smithi046.stdout:4/506: creat d1/d27/d37/d8f/fad x:0 0 0 2024-09-21T12:47:15.561 INFO:tasks.workunit.client.0.smithi046.stdout:0/549: getdents d6 0 2024-09-21T12:47:15.564 INFO:tasks.workunit.client.0.smithi046.stdout:4/507: symlink d1/d27/d46/d78/lae 0 2024-09-21T12:47:15.565 INFO:tasks.workunit.client.0.smithi046.stdout:1/447: mknod d4/c98 0 2024-09-21T12:47:15.567 INFO:tasks.workunit.client.0.smithi046.stdout:4/508: read d1/d13/d8b/f89 [276705,60233] 0 2024-09-21T12:47:15.567 INFO:tasks.workunit.client.0.smithi046.stdout:0/550: creat d6/d7/d13/d43/d52/d63/d7f/d38/fd0 x:0 0 0 2024-09-21T12:47:15.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/535: dwrite d1/d12/d53/f97 [0,4194304] 0 2024-09-21T12:47:15.574 INFO:tasks.workunit.client.0.smithi046.stdout:4/509: chown d1/d13/f31 389886 1 2024-09-21T12:47:15.574 INFO:tasks.workunit.client.0.smithi046.stdout:1/448: creat d4/d13/d38/d53/d5a/f99 x:0 0 0 2024-09-21T12:47:15.574 INFO:tasks.workunit.client.0.smithi046.stdout:8/536: fsync d1/d12/d46/d35/d36/d51/f5a 0 2024-09-21T12:47:15.574 INFO:tasks.workunit.client.0.smithi046.stdout:7/479: getdents d2/d4/d43/d58 0 2024-09-21T12:47:15.576 INFO:tasks.workunit.client.0.smithi046.stdout:0/551: symlink d6/d7/d13/d43/d52/d63/d7f/d38/db7/ld1 0 2024-09-21T12:47:15.581 INFO:tasks.workunit.client.0.smithi046.stdout:7/480: dwrite d2/d4/df/f4c [0,4194304] 0 2024-09-21T12:47:15.583 INFO:tasks.workunit.client.0.smithi046.stdout:7/481: dread - d2/d4/df/d17/f7c zero size 2024-09-21T12:47:15.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/537: stat d1/d12/d46/d35/d36/ca0 0 2024-09-21T12:47:15.589 INFO:tasks.workunit.client.0.smithi046.stdout:4/510: symlink d1/d13/d25/d29/d43/d84/daa/laf 0 2024-09-21T12:47:15.590 INFO:tasks.workunit.client.0.smithi046.stdout:4/511: write d1/f5d [172533,16] 0 2024-09-21T12:47:15.592 INFO:tasks.workunit.client.0.smithi046.stdout:1/449: symlink d4/d13/d38/d48/d8a/l9a 0 2024-09-21T12:47:15.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/482: symlink d2/d4/df/d6f/d92/l9b 0 2024-09-21T12:47:15.595 INFO:tasks.workunit.client.0.smithi046.stdout:8/538: unlink d1/d12/f5c 0 2024-09-21T12:47:15.596 INFO:tasks.workunit.client.0.smithi046.stdout:4/512: symlink d1/d27/d58/lb0 0 2024-09-21T12:47:15.600 INFO:tasks.workunit.client.0.smithi046.stdout:8/539: creat d1/d12/d46/d35/d7d/d6a/fbd x:0 0 0 2024-09-21T12:47:15.601 INFO:tasks.workunit.client.0.smithi046.stdout:1/450: mknod d4/d29/c9b 0 2024-09-21T12:47:15.604 INFO:tasks.workunit.client.0.smithi046.stdout:8/540: read d1/d12/f18 [152701,86239] 0 2024-09-21T12:47:15.605 INFO:tasks.workunit.client.0.smithi046.stdout:8/541: stat d1/d12/d46/d35/d7d/fb3 0 2024-09-21T12:47:15.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/483: getdents d2/d4/df/d70/d88/d34 0 2024-09-21T12:47:15.612 INFO:tasks.workunit.client.0.smithi046.stdout:8/542: rename d1/d12/d46/d35/d36/d51/f65 to d1/d12/d53/fbe 0 2024-09-21T12:47:15.616 INFO:tasks.workunit.client.0.smithi046.stdout:7/484: rename d2/d4/df/d70/d88/f45 to d2/d4/f9c 0 2024-09-21T12:47:15.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/513: dread d1/d13/f31 [0,4194304] 0 2024-09-21T12:47:15.630 INFO:tasks.workunit.client.0.smithi046.stdout:7/485: dread d2/f3 [0,4194304] 0 2024-09-21T12:47:15.630 INFO:tasks.workunit.client.0.smithi046.stdout:0/552: dwrite d6/d7/d13/d7b/da2/f33 [0,4194304] 0 2024-09-21T12:47:15.640 INFO:tasks.workunit.client.0.smithi046.stdout:1/451: dwrite d4/f37 [0,4194304] 0 2024-09-21T12:47:15.641 INFO:tasks.workunit.client.0.smithi046.stdout:5/446: sync 2024-09-21T12:47:15.641 INFO:tasks.workunit.client.0.smithi046.stdout:9/537: sync 2024-09-21T12:47:15.641 INFO:tasks.workunit.client.0.smithi046.stdout:0/553: dwrite d6/d7/d13/d72/f79 [0,4194304] 0 2024-09-21T12:47:15.645 INFO:tasks.workunit.client.0.smithi046.stdout:1/452: write d4/d29/d32/f3f [198515,98669] 0 2024-09-21T12:47:15.645 INFO:tasks.workunit.client.0.smithi046.stdout:7/486: rmdir d2/d37/d8a/d94 0 2024-09-21T12:47:15.645 INFO:tasks.workunit.client.0.smithi046.stdout:5/447: chown d4/dc/d13/d5b/d2d/d43/c61 166815 1 2024-09-21T12:47:15.648 INFO:tasks.workunit.client.0.smithi046.stdout:9/538: fsync d11/d19/d1b/f3f 0 2024-09-21T12:47:15.648 INFO:tasks.workunit.client.0.smithi046.stdout:1/453: stat d4/d13/d38/d53/d5a/f7c 0 2024-09-21T12:47:15.649 INFO:tasks.workunit.client.0.smithi046.stdout:4/514: dread d1/d13/d25/d3a/f4d [0,4194304] 0 2024-09-21T12:47:15.656 INFO:tasks.workunit.client.0.smithi046.stdout:9/539: truncate d11/d19/f89 134427 0 2024-09-21T12:47:15.657 INFO:tasks.workunit.client.0.smithi046.stdout:1/454: creat d4/f9c x:0 0 0 2024-09-21T12:47:15.657 INFO:tasks.workunit.client.0.smithi046.stdout:5/448: truncate d4/dc/d13/d5b/d2d/d43/f48 1833377 0 2024-09-21T12:47:15.660 INFO:tasks.workunit.client.0.smithi046.stdout:4/515: rename d1/d13/d25/d29/d43/l2e to d1/d13/d8b/lb1 0 2024-09-21T12:47:15.661 INFO:tasks.workunit.client.0.smithi046.stdout:4/516: fdatasync d1/d13/d25/d29/f42 0 2024-09-21T12:47:15.664 INFO:tasks.workunit.client.0.smithi046.stdout:5/449: rename d4/dc/c33 to d4/dc/d13/d15/d5c/c8e 0 2024-09-21T12:47:15.665 INFO:tasks.workunit.client.0.smithi046.stdout:5/450: dread - d4/dc/d13/d15/f84 zero size 2024-09-21T12:47:15.668 INFO:tasks.workunit.client.0.smithi046.stdout:7/487: truncate d2/dd/f29 902917 0 2024-09-21T12:47:15.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/540: truncate d11/d19/d1b/d31/f43 672677 0 2024-09-21T12:47:15.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/488: creat d2/d4/df/d6f/d92/f9d x:0 0 0 2024-09-21T12:47:15.679 INFO:tasks.workunit.client.0.smithi046.stdout:5/451: dread d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:15.681 INFO:tasks.workunit.client.0.smithi046.stdout:1/455: dwrite d4/d13/d38/d53/d5a/d5d/f74 [0,4194304] 0 2024-09-21T12:47:15.682 INFO:tasks.workunit.client.0.smithi046.stdout:5/452: write d4/dc/d13/f23 [6167116,59522] 0 2024-09-21T12:47:15.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/456: chown d4/d29/d32/f40 14574 1 2024-09-21T12:47:15.686 INFO:tasks.workunit.client.0.smithi046.stdout:7/489: dread d2/f3 [0,4194304] 0 2024-09-21T12:47:15.690 INFO:tasks.workunit.client.0.smithi046.stdout:1/457: rmdir d4/d13/d6b 39 2024-09-21T12:47:15.693 INFO:tasks.workunit.client.0.smithi046.stdout:5/453: rename d4/dc/d6b/c76 to d4/dc/d13/d15/d5c/c8f 0 2024-09-21T12:47:15.696 INFO:tasks.workunit.client.0.smithi046.stdout:7/490: mknod d2/d37/c9e 0 2024-09-21T12:47:15.698 INFO:tasks.workunit.client.0.smithi046.stdout:1/458: dwrite d4/d13/d38/d48/f5c [0,4194304] 0 2024-09-21T12:47:15.703 INFO:tasks.workunit.client.0.smithi046.stdout:4/517: getdents d1/d5f 0 2024-09-21T12:47:15.706 INFO:tasks.workunit.client.0.smithi046.stdout:7/491: dwrite d2/d4/f89 [0,4194304] 0 2024-09-21T12:47:15.707 INFO:tasks.workunit.client.0.smithi046.stdout:7/492: stat d2/dd/l6d 0 2024-09-21T12:47:15.707 INFO:tasks.workunit.client.0.smithi046.stdout:9/541: getdents d11/d19/d1b 0 2024-09-21T12:47:15.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/454: rmdir d4/dc/d45 39 2024-09-21T12:47:15.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/455: chown d4/d22/d10/d1a 0 1 2024-09-21T12:47:15.712 INFO:tasks.workunit.client.0.smithi046.stdout:1/459: rename d4/f26 to d4/d4d/f9d 0 2024-09-21T12:47:15.713 INFO:tasks.workunit.client.0.smithi046.stdout:1/460: write d4/d13/d38/d53/d5a/f99 [1015712,53551] 0 2024-09-21T12:47:15.715 INFO:tasks.workunit.client.0.smithi046.stdout:1/461: dread - d4/d4d/f73 zero size 2024-09-21T12:47:15.716 INFO:tasks.workunit.client.0.smithi046.stdout:4/518: chown d1/d13/l1a 1 1 2024-09-21T12:47:15.717 INFO:tasks.workunit.client.0.smithi046.stdout:4/519: stat d1/d13/d25/c3b 0 2024-09-21T12:47:15.717 INFO:tasks.workunit.client.0.smithi046.stdout:7/493: creat d2/d4/f9f x:0 0 0 2024-09-21T12:47:15.721 INFO:tasks.workunit.client.0.smithi046.stdout:7/494: read d2/d4/df/d70/d88/d34/f4b [217365,55247] 0 2024-09-21T12:47:15.722 INFO:tasks.workunit.client.0.smithi046.stdout:1/462: rename d4/d13/d38/d53/d5a to d4/d29/d32/d9e 0 2024-09-21T12:47:15.724 INFO:tasks.workunit.client.0.smithi046.stdout:9/542: mknod d11/d19/d1b/d1c/ca6 0 2024-09-21T12:47:15.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/456: dwrite d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:15.737 INFO:tasks.workunit.client.0.smithi046.stdout:1/463: symlink d4/d13/d38/d53/d80/l9f 0 2024-09-21T12:47:15.740 INFO:tasks.workunit.client.0.smithi046.stdout:5/457: unlink d4/f4a 0 2024-09-21T12:47:15.741 INFO:tasks.workunit.client.0.smithi046.stdout:4/520: getdents d1/d13/d8b 0 2024-09-21T12:47:15.744 INFO:tasks.workunit.client.0.smithi046.stdout:1/464: write d4/d13/d6b/f8e [595455,84659] 0 2024-09-21T12:47:15.747 INFO:tasks.workunit.client.0.smithi046.stdout:4/521: dread d1/f74 [0,4194304] 0 2024-09-21T12:47:15.749 INFO:tasks.workunit.client.0.smithi046.stdout:4/522: write d1/f97 [685219,76509] 0 2024-09-21T12:47:15.749 INFO:tasks.workunit.client.0.smithi046.stdout:7/495: write d2/dd/f2b [2925388,102029] 0 2024-09-21T12:47:15.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/465: write d4/f9 [1490625,68820] 0 2024-09-21T12:47:15.751 INFO:tasks.workunit.client.0.smithi046.stdout:4/523: rename d1/d13/d25/d29 to d1/d13/d25/d29/d43/db2 22 2024-09-21T12:47:15.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/524: dread - d1/d27/f61 zero size 2024-09-21T12:47:15.756 INFO:tasks.workunit.client.0.smithi046.stdout:7/496: creat d2/d4/df/d9a/fa0 x:0 0 0 2024-09-21T12:47:15.760 INFO:tasks.workunit.client.0.smithi046.stdout:4/525: dread d1/d27/d37/f49 [0,4194304] 0 2024-09-21T12:47:15.764 INFO:tasks.workunit.client.0.smithi046.stdout:5/458: dread d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:15.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/543: dwrite d11/d19/d1b/d4b/f5f [0,4194304] 0 2024-09-21T12:47:15.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/466: dwrite d4/d13/d38/d4f/f5e [0,4194304] 0 2024-09-21T12:47:15.768 INFO:tasks.workunit.client.0.smithi046.stdout:4/526: creat d1/d27/d37/fb3 x:0 0 0 2024-09-21T12:47:15.771 INFO:tasks.workunit.client.0.smithi046.stdout:5/459: write d4/dc/d13/d5b/d2d/f4f [761964,44868] 0 2024-09-21T12:47:15.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/544: dread d11/d19/d1b/d4b/f56 [0,4194304] 0 2024-09-21T12:47:15.773 INFO:tasks.workunit.client.0.smithi046.stdout:1/467: creat d4/d13/d38/d4f/fa0 x:0 0 0 2024-09-21T12:47:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:7/497: dwrite d2/d4/df/d17/f59 [0,4194304] 0 2024-09-21T12:47:15.774 INFO:tasks.workunit.client.0.smithi046.stdout:4/527: dread - d1/d13/d25/d6b/f93 zero size 2024-09-21T12:47:15.775 INFO:tasks.workunit.client.0.smithi046.stdout:9/545: stat d11/d19/d1b/l57 0 2024-09-21T12:47:15.778 INFO:tasks.workunit.client.0.smithi046.stdout:9/546: chown d11/d19/d1b/d1c/d1f/d74/l88 30761 1 2024-09-21T12:47:15.784 INFO:tasks.workunit.client.0.smithi046.stdout:1/468: creat d4/d13/d38/fa1 x:0 0 0 2024-09-21T12:47:15.785 INFO:tasks.workunit.client.0.smithi046.stdout:7/498: creat d2/d4/df/d17/fa1 x:0 0 0 2024-09-21T12:47:15.788 INFO:tasks.workunit.client.0.smithi046.stdout:5/460: readlink d4/dc/d13/d15/d5c/l7e 0 2024-09-21T12:47:15.789 INFO:tasks.workunit.client.0.smithi046.stdout:4/528: dread - d1/d13/d25/d29/d33/f65 zero size 2024-09-21T12:47:15.789 INFO:tasks.workunit.client.0.smithi046.stdout:9/547: dwrite d11/d5b/d6f/f8a [0,4194304] 0 2024-09-21T12:47:15.791 INFO:tasks.workunit.client.0.smithi046.stdout:1/469: creat d4/d13/d38/d53/fa2 x:0 0 0 2024-09-21T12:47:15.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/548: fsync d11/d19/d1b/d31/d44/f4c 0 2024-09-21T12:47:15.804 INFO:tasks.workunit.client.0.smithi046.stdout:9/549: mkdir d11/d19/d1b/d31/d44/da7 0 2024-09-21T12:47:15.805 INFO:tasks.workunit.client.0.smithi046.stdout:9/550: chown d11/d19/d1b/d1c/d1f/d30/d3e 893277055 1 2024-09-21T12:47:15.805 INFO:tasks.workunit.client.0.smithi046.stdout:7/499: link d2/dd/c2e d2/d4/d43/ca2 0 2024-09-21T12:47:15.808 INFO:tasks.workunit.client.0.smithi046.stdout:9/551: symlink d11/d19/d1b/d31/d53/d58/la8 0 2024-09-21T12:47:15.809 INFO:tasks.workunit.client.0.smithi046.stdout:7/500: symlink d2/d37/d8a/la3 0 2024-09-21T12:47:15.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/501: read d2/d37/d77/f8d [2427957,64982] 0 2024-09-21T12:47:15.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/502: fdatasync d2/d4/f33 0 2024-09-21T12:47:15.814 INFO:tasks.workunit.client.0.smithi046.stdout:9/552: truncate d11/d19/d1b/d31/d44/f4c 189341 0 2024-09-21T12:47:15.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/503: rmdir d2/d4/df 39 2024-09-21T12:47:15.819 INFO:tasks.workunit.client.0.smithi046.stdout:9/553: creat d11/d19/d93/d26/fa9 x:0 0 0 2024-09-21T12:47:15.825 INFO:tasks.workunit.client.0.smithi046.stdout:9/554: dwrite d11/d19/d1b/d4b/f5f [0,4194304] 0 2024-09-21T12:47:15.827 INFO:tasks.workunit.client.0.smithi046.stdout:7/504: creat d2/fa4 x:0 0 0 2024-09-21T12:47:15.829 INFO:tasks.workunit.client.0.smithi046.stdout:9/555: write d11/d19/d1b/d1c/d1f/d30/d79/f9f [641594,122170] 0 2024-09-21T12:47:15.834 INFO:tasks.workunit.client.0.smithi046.stdout:9/556: dread d11/d19/d1b/d4b/f8d [0,4194304] 0 2024-09-21T12:47:15.836 INFO:tasks.workunit.client.0.smithi046.stdout:9/557: chown d11/d19/d1b/d31/d53 62642 1 2024-09-21T12:47:15.838 INFO:tasks.workunit.client.0.smithi046.stdout:7/505: getdents d2/d4 0 2024-09-21T12:47:15.844 INFO:tasks.workunit.client.0.smithi046.stdout:9/558: rename d11/d5b/la2 to d11/d19/d1b/d31/d53/d5e/laa 0 2024-09-21T12:47:15.847 INFO:tasks.workunit.client.0.smithi046.stdout:7/506: symlink d2/d4/df/d6f/d92/la5 0 2024-09-21T12:47:15.856 INFO:tasks.workunit.client.0.smithi046.stdout:9/559: creat d11/d19/d1b/d1c/fab x:0 0 0 2024-09-21T12:47:15.863 INFO:tasks.workunit.client.0.smithi046.stdout:9/560: dwrite f2 [4194304,4194304] 0 2024-09-21T12:47:15.878 INFO:tasks.workunit.client.0.smithi046.stdout:5/461: truncate d4/d22/d10/f62 1120250 0 2024-09-21T12:47:15.879 INFO:tasks.workunit.client.0.smithi046.stdout:1/470: dwrite d4/d29/f6c [0,4194304] 0 2024-09-21T12:47:15.882 INFO:tasks.workunit.client.0.smithi046.stdout:4/529: dwrite d1/d27/d46/d78/f98 [0,4194304] 0 2024-09-21T12:47:15.887 INFO:tasks.workunit.client.0.smithi046.stdout:4/530: dread d1/d13/d25/d29/d33/f62 [0,4194304] 0 2024-09-21T12:47:15.887 INFO:tasks.workunit.client.0.smithi046.stdout:5/462: rename d4/d16 to d4/dc/d13/d15/d90 0 2024-09-21T12:47:15.888 INFO:tasks.workunit.client.0.smithi046.stdout:1/471: rmdir d4/d13/d38/d53/d80 39 2024-09-21T12:47:15.889 INFO:tasks.workunit.client.0.smithi046.stdout:4/531: chown d1/d27/d37/d8f/ca3 0 1 2024-09-21T12:47:15.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/532: chown d1/d13/d25/d29/d33/c8d 1597179 1 2024-09-21T12:47:15.895 INFO:tasks.workunit.client.0.smithi046.stdout:4/533: creat d1/d27/d82/fb4 x:0 0 0 2024-09-21T12:47:15.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/472: dwrite d4/f77 [4194304,4194304] 0 2024-09-21T12:47:15.898 INFO:tasks.workunit.client.0.smithi046.stdout:1/473: readlink d4/d29/d32/l51 0 2024-09-21T12:47:15.902 INFO:tasks.workunit.client.0.smithi046.stdout:1/474: creat d4/d13/d6b/fa3 x:0 0 0 2024-09-21T12:47:15.904 INFO:tasks.workunit.client.0.smithi046.stdout:1/475: truncate d4/d13/d38/d53/fa2 1004591 0 2024-09-21T12:47:15.916 INFO:tasks.workunit.client.0.smithi046.stdout:1/476: dread d4/d13/d38/d53/d80/f82 [0,4194304] 0 2024-09-21T12:47:15.919 INFO:tasks.workunit.client.0.smithi046.stdout:7/507: truncate d2/fa 2439195 0 2024-09-21T12:47:15.921 INFO:tasks.workunit.client.0.smithi046.stdout:7/508: chown d2/d4/df/f4c 17 1 2024-09-21T12:47:15.921 INFO:tasks.workunit.client.0.smithi046.stdout:9/561: write d11/d19/f24 [3980950,78528] 0 2024-09-21T12:47:15.923 INFO:tasks.workunit.client.0.smithi046.stdout:7/509: mkdir d2/d4/d43/d58/da6 0 2024-09-21T12:47:15.926 INFO:tasks.workunit.client.0.smithi046.stdout:7/510: mknod d2/d4/df/d6f/ca7 0 2024-09-21T12:47:15.927 INFO:tasks.workunit.client.0.smithi046.stdout:7/511: truncate d2/fe 3876691 0 2024-09-21T12:47:15.929 INFO:tasks.workunit.client.0.smithi046.stdout:7/512: mknod d2/d4/d43/d58/da6/ca8 0 2024-09-21T12:47:15.932 INFO:tasks.workunit.client.0.smithi046.stdout:9/562: dread d11/d19/d36/f77 [0,4194304] 0 2024-09-21T12:47:15.936 INFO:tasks.workunit.client.0.smithi046.stdout:7/513: dwrite d2/f55 [0,4194304] 0 2024-09-21T12:47:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:7/514: fsync d2/d4/df/d9a/fa0 0 2024-09-21T12:47:15.937 INFO:tasks.workunit.client.0.smithi046.stdout:9/563: link d11/d19/d1b/la0 d11/d19/d93/lac 0 2024-09-21T12:47:15.938 INFO:tasks.workunit.client.0.smithi046.stdout:7/515: dread - d2/d4/df/d6f/d92/f9d zero size 2024-09-21T12:47:15.939 INFO:tasks.workunit.client.0.smithi046.stdout:7/516: fdatasync d2/d4/df/d70/d88/d34/f38 0 2024-09-21T12:47:15.940 INFO:tasks.workunit.client.0.smithi046.stdout:9/564: truncate d11/d19/d36/f77 1025022 0 2024-09-21T12:47:15.942 INFO:tasks.workunit.client.0.smithi046.stdout:7/517: symlink d2/d4/df/d70/d88/d34/d7f/la9 0 2024-09-21T12:47:15.943 INFO:tasks.workunit.client.0.smithi046.stdout:9/565: mknod d11/d19/d1b/d1c/d1f/cad 0 2024-09-21T12:47:15.945 INFO:tasks.workunit.client.0.smithi046.stdout:7/518: unlink d2/c72 0 2024-09-21T12:47:15.947 INFO:tasks.workunit.client.0.smithi046.stdout:9/566: rename d11/d19/d1b/d1c/d1f/d30/d79/f9f to d11/d19/d1b/d1c/d1f/d30/d3e/fae 0 2024-09-21T12:47:15.948 INFO:tasks.workunit.client.0.smithi046.stdout:7/519: creat d2/d4/df/faa x:0 0 0 2024-09-21T12:47:15.949 INFO:tasks.workunit.client.0.smithi046.stdout:9/567: creat d11/d19/d36/d45/d6e/faf x:0 0 0 2024-09-21T12:47:15.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/496: sync 2024-09-21T12:47:15.992 INFO:tasks.workunit.client.0.smithi046.stdout:2/497: dwrite d16/d22/d75/f91 [0,4194304] 0 2024-09-21T12:47:16.000 INFO:tasks.workunit.client.0.smithi046.stdout:2/498: dwrite d16/d22/d2b/d30/f58 [4194304,4194304] 0 2024-09-21T12:47:16.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/499: chown d16/d22/d2b/d30/d67 203003 1 2024-09-21T12:47:16.006 INFO:tasks.workunit.client.0.smithi046.stdout:2/500: creat d16/d22/d38/d77/f9a x:0 0 0 2024-09-21T12:47:16.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/534: truncate d1/f5d 4111533 0 2024-09-21T12:47:16.032 INFO:tasks.workunit.client.0.smithi046.stdout:4/535: mknod d1/d13/d25/d3a/cb5 0 2024-09-21T12:47:16.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/536: fdatasync d1/ff 0 2024-09-21T12:47:16.034 INFO:tasks.workunit.client.0.smithi046.stdout:4/537: write d1/d13/f16 [8057964,115143] 0 2024-09-21T12:47:16.041 INFO:tasks.workunit.client.0.smithi046.stdout:2/501: dread d16/d22/d2b/d43/f5a [0,4194304] 0 2024-09-21T12:47:16.041 INFO:tasks.workunit.client.0.smithi046.stdout:4/538: dread d1/d27/d37/f63 [0,4194304] 0 2024-09-21T12:47:16.042 INFO:tasks.workunit.client.0.smithi046.stdout:7/520: rename d2/fa to d2/d4/d97/fab 0 2024-09-21T12:47:16.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/539: readlink d1/d13/l1a 0 2024-09-21T12:47:16.046 INFO:tasks.workunit.client.0.smithi046.stdout:1/477: dwrite d4/d13/f1d [0,4194304] 0 2024-09-21T12:47:16.050 INFO:tasks.workunit.client.0.smithi046.stdout:7/521: dread d2/d4/df/f4c [0,4194304] 0 2024-09-21T12:47:16.057 INFO:tasks.workunit.client.0.smithi046.stdout:9/568: rename d11/d19/d1b/d1c/d1f to d11/d5b/d6f/db0 0 2024-09-21T12:47:16.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/502: rmdir d16/d22/d4e 39 2024-09-21T12:47:16.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/522: unlink d2/d37/d77/f7a 0 2024-09-21T12:47:16.060 INFO:tasks.workunit.client.0.smithi046.stdout:7/523: chown d2/dd 15 1 2024-09-21T12:47:16.063 INFO:tasks.workunit.client.0.smithi046.stdout:1/478: symlink d4/la4 0 2024-09-21T12:47:16.064 INFO:tasks.workunit.client.0.smithi046.stdout:4/540: symlink d1/d13/d25/d29/d45/lb6 0 2024-09-21T12:47:16.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/541: stat d1/d5f/l8e 0 2024-09-21T12:47:16.067 INFO:tasks.workunit.client.0.smithi046.stdout:2/503: rename d16/l1b to d16/d22/d38/d77/d7a/l9b 0 2024-09-21T12:47:16.068 INFO:tasks.workunit.client.0.smithi046.stdout:2/504: stat d16/d22/d2b/d30/f58 0 2024-09-21T12:47:16.068 INFO:tasks.workunit.client.0.smithi046.stdout:7/524: readlink d2/d4/df/d6f/l73 0 2024-09-21T12:47:16.069 INFO:tasks.workunit.client.0.smithi046.stdout:2/505: chown d16/d22/d2b/d30/l76 5628 1 2024-09-21T12:47:16.071 INFO:tasks.workunit.client.0.smithi046.stdout:9/569: mknod d11/d19/d1b/d31/cb1 0 2024-09-21T12:47:16.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/542: mkdir d1/d27/d58/db7 0 2024-09-21T12:47:16.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/506: dwrite d16/d22/d38/d77/f89 [0,4194304] 0 2024-09-21T12:47:16.080 INFO:tasks.workunit.client.0.smithi046.stdout:1/479: mkdir d4/d13/d38/d53/d80/d95/da5 0 2024-09-21T12:47:16.081 INFO:tasks.workunit.client.0.smithi046.stdout:1/480: fsync d4/d13/f1c 0 2024-09-21T12:47:16.085 INFO:tasks.workunit.client.0.smithi046.stdout:7/525: link d2/d4/df/d6f/d92/f95 d2/d4/fac 0 2024-09-21T12:47:16.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/507: unlink d16/d22/d2b/d43/l95 0 2024-09-21T12:47:16.088 INFO:tasks.workunit.client.0.smithi046.stdout:3/407: sync 2024-09-21T12:47:16.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/481: chown d4/d29/c44 1 1 2024-09-21T12:47:16.092 INFO:tasks.workunit.client.0.smithi046.stdout:9/570: rename d11/d19/d1b/d31/d53/d5e/laa to d11/d19/d1b/d31/d53/d58/lb2 0 2024-09-21T12:47:16.099 INFO:tasks.workunit.client.0.smithi046.stdout:4/543: rename d1/d27/d58/c7c to d1/d27/d46/d78/d8a/cb8 0 2024-09-21T12:47:16.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/508: creat d16/d22/d2b/d30/d8f/f9c x:0 0 0 2024-09-21T12:47:16.108 INFO:tasks.workunit.client.0.smithi046.stdout:9/571: link d11/d19/d36/c82 d11/d19/d1b/d31/d53/d58/cb3 0 2024-09-21T12:47:16.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/544: mkdir d1/d13/d25/d3a/d92/db9 0 2024-09-21T12:47:16.109 INFO:tasks.workunit.client.0.smithi046.stdout:4/545: chown d1/d27/d82 53423428 1 2024-09-21T12:47:16.110 INFO:tasks.workunit.client.0.smithi046.stdout:3/408: link d5/fb d5/d16/d5f/d6c/f8f 0 2024-09-21T12:47:16.111 INFO:tasks.workunit.client.0.smithi046.stdout:2/509: mkdir d16/d22/d4e/d9d 0 2024-09-21T12:47:16.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/482: getdents d4/d13/d38/d48 0 2024-09-21T12:47:16.117 INFO:tasks.workunit.client.0.smithi046.stdout:2/510: mkdir d16/d22/d38/d77/d9e 0 2024-09-21T12:47:16.118 INFO:tasks.workunit.client.0.smithi046.stdout:1/483: unlink d4/f5 0 2024-09-21T12:47:16.126 INFO:tasks.workunit.client.0.smithi046.stdout:2/511: mknod d16/d22/d75/c9f 0 2024-09-21T12:47:16.127 INFO:tasks.workunit.client.0.smithi046.stdout:2/512: chown d16/d22/d75/f74 1 1 2024-09-21T12:47:16.131 INFO:tasks.workunit.client.0.smithi046.stdout:7/526: stat d2/d4/f8 0 2024-09-21T12:47:16.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/513: dwrite d16/d22/d2b/d43/f73 [4194304,4194304] 0 2024-09-21T12:47:16.137 INFO:tasks.workunit.client.0.smithi046.stdout:9/572: getdents d11/d5b/d6f 0 2024-09-21T12:47:16.139 INFO:tasks.workunit.client.0.smithi046.stdout:7/527: mknod d2/d37/d77/cad 0 2024-09-21T12:47:16.141 INFO:tasks.workunit.client.0.smithi046.stdout:1/484: getdents d4/d13/d38/d53/d80/d95 0 2024-09-21T12:47:16.144 INFO:tasks.workunit.client.0.smithi046.stdout:4/546: truncate d1/d27/d58/f4f 366174 0 2024-09-21T12:47:16.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/528: write d2/d4/f33 [2514869,122437] 0 2024-09-21T12:47:16.146 INFO:tasks.workunit.client.0.smithi046.stdout:2/514: mknod d16/d22/d2b/ca0 0 2024-09-21T12:47:16.146 INFO:tasks.workunit.client.0.smithi046.stdout:3/409: dwrite d5/dc/d26/f37 [0,4194304] 0 2024-09-21T12:47:16.147 INFO:tasks.workunit.client.0.smithi046.stdout:9/573: creat d11/d19/d1b/d4b/d91/d94/fb4 x:0 0 0 2024-09-21T12:47:16.149 INFO:tasks.workunit.client.0.smithi046.stdout:1/485: rmdir d4/d13/d79 39 2024-09-21T12:47:16.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/515: write d16/d22/d2b/d43/f73 [163326,36635] 0 2024-09-21T12:47:16.153 INFO:tasks.workunit.client.0.smithi046.stdout:4/547: rename d1/d13/d25/d29/d43/d84 to d1/d13/d25/d29/d43/d84/dba 22 2024-09-21T12:47:16.153 INFO:tasks.workunit.client.0.smithi046.stdout:1/486: dread - d4/d29/d32/d9e/f7c zero size 2024-09-21T12:47:16.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/410: mknod d5/d16/d5f/d6c/c90 0 2024-09-21T12:47:16.157 INFO:tasks.workunit.client.0.smithi046.stdout:9/574: chown d11/d19/d1b/d31/d44/l9d 59 1 2024-09-21T12:47:16.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/529: dwrite d2/dd/f3f [0,4194304] 0 2024-09-21T12:47:16.162 INFO:tasks.workunit.client.0.smithi046.stdout:9/575: read d11/d19/f24 [306848,109724] 0 2024-09-21T12:47:16.164 INFO:tasks.workunit.client.0.smithi046.stdout:2/516: dread d16/d22/d75/f91 [0,4194304] 0 2024-09-21T12:47:16.164 INFO:tasks.workunit.client.0.smithi046.stdout:1/487: mknod d4/d13/d38/d4f/ca6 0 2024-09-21T12:47:16.165 INFO:tasks.workunit.client.0.smithi046.stdout:2/517: chown d16/d22/d38/d77 0 1 2024-09-21T12:47:16.167 INFO:tasks.workunit.client.0.smithi046.stdout:4/548: rename d1/d13/f31 to d1/d27/d58/db7/fbb 0 2024-09-21T12:47:16.173 INFO:tasks.workunit.client.0.smithi046.stdout:1/488: dwrite d4/d4d/f73 [0,4194304] 0 2024-09-21T12:47:16.175 INFO:tasks.workunit.client.0.smithi046.stdout:9/576: unlink d11/d19/d93/d26/l66 0 2024-09-21T12:47:16.177 INFO:tasks.workunit.client.0.smithi046.stdout:9/577: fsync d11/d5b/d6f/db0/d30/d3e/f49 0 2024-09-21T12:47:16.178 INFO:tasks.workunit.client.0.smithi046.stdout:9/578: stat d11/f99 0 2024-09-21T12:47:16.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/489: dread d4/d13/f6e [0,4194304] 0 2024-09-21T12:47:16.178 INFO:tasks.workunit.client.0.smithi046.stdout:9/579: chown d11/d19 252743 1 2024-09-21T12:47:16.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/549: unlink d1/f57 0 2024-09-21T12:47:16.182 INFO:tasks.workunit.client.0.smithi046.stdout:6/504: sync 2024-09-21T12:47:16.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/550: truncate d1/d27/d37/fa7 4702867 0 2024-09-21T12:47:16.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/518: dwrite d16/f1d [0,4194304] 0 2024-09-21T12:47:16.189 INFO:tasks.workunit.client.0.smithi046.stdout:1/490: unlink d4/d13/f1c 0 2024-09-21T12:47:16.195 INFO:tasks.workunit.client.0.smithi046.stdout:7/530: rename d2/d4/df/d17/f28 to d2/d37/d77/fae 0 2024-09-21T12:47:16.196 INFO:tasks.workunit.client.0.smithi046.stdout:3/411: link d5/d5e/l75 d5/d16/d5f/l91 0 2024-09-21T12:47:16.204 INFO:tasks.workunit.client.0.smithi046.stdout:1/491: dread d4/d4d/f57 [0,4194304] 0 2024-09-21T12:47:16.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/551: mknod d1/d13/d25/d29/cbc 0 2024-09-21T12:47:16.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/552: chown d1/c3 1014440 1 2024-09-21T12:47:16.210 INFO:tasks.workunit.client.0.smithi046.stdout:9/580: rename d11/d19/d93/lac to d11/d19/d1b/d31/d44/da7/lb5 0 2024-09-21T12:47:16.211 INFO:tasks.workunit.client.0.smithi046.stdout:4/553: dread d1/d13/d8b/f89 [0,4194304] 0 2024-09-21T12:47:16.211 INFO:tasks.workunit.client.0.smithi046.stdout:7/531: symlink d2/d37/d8a/d99/laf 0 2024-09-21T12:47:16.212 INFO:tasks.workunit.client.0.smithi046.stdout:7/532: readlink d2/dd/l18 0 2024-09-21T12:47:16.212 INFO:tasks.workunit.client.0.smithi046.stdout:1/492: mknod d4/d4d/ca7 0 2024-09-21T12:47:16.213 INFO:tasks.workunit.client.0.smithi046.stdout:3/412: getdents d5/d5e/d8e 0 2024-09-21T12:47:16.216 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:15 smithi046 ceph-mon[27868]: pgmap v34: 65 pgs: 65 active+clean; 3.1 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 290 MiB/s wr, 599 op/s 2024-09-21T12:47:16.216 INFO:tasks.workunit.client.0.smithi046.stdout:4/554: write d1/d13/d25/d29/f2f [4524455,66375] 0 2024-09-21T12:47:16.216 INFO:tasks.workunit.client.0.smithi046.stdout:1/493: readlink d4/l11 0 2024-09-21T12:47:16.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/413: readlink d5/d5e/l75 0 2024-09-21T12:47:16.223 INFO:tasks.workunit.client.0.smithi046.stdout:4/555: creat d1/d13/d25/d6b/fbd x:0 0 0 2024-09-21T12:47:16.225 INFO:tasks.workunit.client.0.smithi046.stdout:7/533: rename d2/d4/df/d17/f40 to d2/d4/d43/fb0 0 2024-09-21T12:47:16.226 INFO:tasks.workunit.client.0.smithi046.stdout:3/414: truncate d5/d16/f64 2700885 0 2024-09-21T12:47:16.226 INFO:tasks.workunit.client.0.smithi046.stdout:3/415: read - d5/d5e/f86 zero size 2024-09-21T12:47:16.227 INFO:tasks.workunit.client.0.smithi046.stdout:9/581: creat d11/d19/d1b/d1c/fb6 x:0 0 0 2024-09-21T12:47:16.229 INFO:tasks.workunit.client.0.smithi046.stdout:7/534: rmdir d2/d37/d8a 39 2024-09-21T12:47:16.231 INFO:tasks.workunit.client.0.smithi046.stdout:3/416: mknod d5/dc/d28/d60/c92 0 2024-09-21T12:47:16.232 INFO:tasks.workunit.client.0.smithi046.stdout:3/417: write f2 [8877724,40602] 0 2024-09-21T12:47:16.234 INFO:tasks.workunit.client.0.smithi046.stdout:3/418: write d5/dc/d30/d34/f61 [1190594,3274] 0 2024-09-21T12:47:16.235 INFO:tasks.workunit.client.0.smithi046.stdout:9/582: mknod d11/d5b/d6f/db0/d30/d3e/cb7 0 2024-09-21T12:47:16.238 INFO:tasks.workunit.client.0.smithi046.stdout:1/494: getdents d4/d13/d38 0 2024-09-21T12:47:16.240 INFO:tasks.workunit.client.0.smithi046.stdout:7/535: symlink d2/d4/df/d9a/lb1 0 2024-09-21T12:47:16.246 INFO:tasks.workunit.client.0.smithi046.stdout:3/419: fsync d5/d16/f65 0 2024-09-21T12:47:16.248 INFO:tasks.workunit.client.0.smithi046.stdout:9/583: stat d11/d19/d36/f77 0 2024-09-21T12:47:16.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/556: dwrite d1/f35 [0,4194304] 0 2024-09-21T12:47:16.251 INFO:tasks.workunit.client.0.smithi046.stdout:1/495: creat d4/d29/d32/d9e/d5d/fa8 x:0 0 0 2024-09-21T12:47:16.253 INFO:tasks.workunit.client.0.smithi046.stdout:7/536: stat d2/d4/c74 0 2024-09-21T12:47:16.260 INFO:tasks.workunit.client.0.smithi046.stdout:3/420: symlink d5/dc/d26/l93 0 2024-09-21T12:47:16.261 INFO:tasks.workunit.client.0.smithi046.stdout:9/584: creat d11/d19/d1b/d31/d53/d5e/fb8 x:0 0 0 2024-09-21T12:47:16.265 INFO:tasks.workunit.client.0.smithi046.stdout:4/557: symlink d1/d27/d37/d66/lbe 0 2024-09-21T12:47:16.267 INFO:tasks.workunit.client.0.smithi046.stdout:3/421: dwrite d5/dc/d28/f84 [0,4194304] 0 2024-09-21T12:47:16.267 INFO:tasks.workunit.client.0.smithi046.stdout:4/558: chown d1/d13/d25/d29/d43/f6c 495360 1 2024-09-21T12:47:16.269 INFO:tasks.workunit.client.0.smithi046.stdout:4/559: write d1/d27/d46/f77 [4808915,34122] 0 2024-09-21T12:47:16.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/537: mkdir d2/d4/df/d70/db2 0 2024-09-21T12:47:16.278 INFO:tasks.workunit.client.0.smithi046.stdout:7/538: creat d2/d4/df/d6f/fb3 x:0 0 0 2024-09-21T12:47:16.279 INFO:tasks.workunit.client.0.smithi046.stdout:9/585: creat d11/d5b/d6f/db0/d30/d90/fb9 x:0 0 0 2024-09-21T12:47:16.279 INFO:tasks.workunit.client.0.smithi046.stdout:1/496: getdents d4/d13/d38/d53/d80/d95 0 2024-09-21T12:47:16.282 INFO:tasks.workunit.client.0.smithi046.stdout:1/497: truncate d4/d13/d38/d4f/f5e 5207694 0 2024-09-21T12:47:16.285 INFO:tasks.workunit.client.0.smithi046.stdout:1/498: write d4/d13/f2f [4662906,112196] 0 2024-09-21T12:47:16.290 INFO:tasks.workunit.client.0.smithi046.stdout:9/586: dwrite d11/d5b/d6f/db0/d30/d90/fb9 [0,4194304] 0 2024-09-21T12:47:16.292 INFO:tasks.workunit.client.0.smithi046.stdout:7/539: dwrite d2/f78 [0,4194304] 0 2024-09-21T12:47:16.295 INFO:tasks.workunit.client.0.smithi046.stdout:4/560: write d1/d27/d58/f5c [2092193,88528] 0 2024-09-21T12:47:16.295 INFO:tasks.workunit.client.0.smithi046.stdout:1/499: mkdir d4/d13/d38/d4f/d83/da9 0 2024-09-21T12:47:16.296 INFO:tasks.workunit.client.0.smithi046.stdout:4/561: write d1/f35 [1555219,34298] 0 2024-09-21T12:47:16.300 INFO:tasks.workunit.client.0.smithi046.stdout:7/540: mkdir d2/d4/df/d70/d88/d34/d7f/db4 0 2024-09-21T12:47:16.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/562: symlink d1/d27/d46/d78/lbf 0 2024-09-21T12:47:16.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/422: dwrite d5/fb [0,4194304] 0 2024-09-21T12:47:16.308 INFO:tasks.workunit.client.0.smithi046.stdout:3/423: dread - d5/dc/d28/d60/d6e/f7a zero size 2024-09-21T12:47:16.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/541: creat d2/d4/df/d70/d88/d34/d7f/fb5 x:0 0 0 2024-09-21T12:47:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:15 smithi176 ceph-mon[35476]: pgmap v34: 65 pgs: 65 active+clean; 3.1 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 103 MiB/s rd, 290 MiB/s wr, 599 op/s 2024-09-21T12:47:16.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/587: write d11/d5b/d6f/db0/d30/d3e/f87 [826560,73939] 0 2024-09-21T12:47:16.319 INFO:tasks.workunit.client.0.smithi046.stdout:4/563: write d1/d13/d25/d29/d33/f41 [8943320,31855] 0 2024-09-21T12:47:16.320 INFO:tasks.workunit.client.0.smithi046.stdout:3/424: unlink d5/d16/f64 0 2024-09-21T12:47:16.323 INFO:tasks.workunit.client.0.smithi046.stdout:1/500: getdents d4 0 2024-09-21T12:47:16.325 INFO:tasks.workunit.client.0.smithi046.stdout:9/588: symlink d11/d19/d93/d26/lba 0 2024-09-21T12:47:16.326 INFO:tasks.workunit.client.0.smithi046.stdout:9/589: stat d11/d19/d93/f8e 0 2024-09-21T12:47:16.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/425: unlink d5/dc/l3b 0 2024-09-21T12:47:16.331 INFO:tasks.workunit.client.0.smithi046.stdout:3/426: write d5/dc/d26/f78 [670911,52368] 0 2024-09-21T12:47:16.332 INFO:tasks.workunit.client.0.smithi046.stdout:9/590: fsync d11/d19/d1b/d4b/f56 0 2024-09-21T12:47:16.333 INFO:tasks.workunit.client.0.smithi046.stdout:1/501: mknod d4/d13/d38/d53/d80/d95/da5/caa 0 2024-09-21T12:47:16.335 INFO:tasks.workunit.client.0.smithi046.stdout:7/542: dread d2/d4/f8c [0,4194304] 0 2024-09-21T12:47:16.339 INFO:tasks.workunit.client.0.smithi046.stdout:3/427: mkdir d5/dc/d94 0 2024-09-21T12:47:16.340 INFO:tasks.workunit.client.0.smithi046.stdout:1/502: rmdir d4/d29/d32 39 2024-09-21T12:47:16.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/428: fsync d5/dc/d26/f78 0 2024-09-21T12:47:16.345 INFO:tasks.workunit.client.0.smithi046.stdout:1/503: chown d4/d29/d32/d9e/f7c 1135 1 2024-09-21T12:47:16.348 INFO:tasks.workunit.client.0.smithi046.stdout:9/591: getdents d11/d19/d93/d26 0 2024-09-21T12:47:16.349 INFO:tasks.workunit.client.0.smithi046.stdout:9/592: chown d11/d19/d1b/d31/d44 2448212 1 2024-09-21T12:47:16.353 INFO:tasks.workunit.client.0.smithi046.stdout:7/543: rename l0 to d2/d4/lb6 0 2024-09-21T12:47:16.353 INFO:tasks.workunit.client.0.smithi046.stdout:9/593: symlink d11/d19/d36/d45/lbb 0 2024-09-21T12:47:16.357 INFO:tasks.workunit.client.0.smithi046.stdout:3/429: truncate d5/dc/d26/d3c/d44/f5d 860237 0 2024-09-21T12:47:16.358 INFO:tasks.workunit.client.0.smithi046.stdout:3/430: chown d5/f85 9693 1 2024-09-21T12:47:16.360 INFO:tasks.workunit.client.0.smithi046.stdout:1/504: getdents d4/d13/d38/d53/d80 0 2024-09-21T12:47:16.361 INFO:tasks.workunit.client.0.smithi046.stdout:9/594: link d11/d19/d36/f42 d11/d19/d93/fbc 0 2024-09-21T12:47:16.362 INFO:tasks.workunit.client.0.smithi046.stdout:3/431: creat d5/d16/f95 x:0 0 0 2024-09-21T12:47:16.365 INFO:tasks.workunit.client.0.smithi046.stdout:7/544: dwrite d2/d4/df/d17/fa1 [0,4194304] 0 2024-09-21T12:47:16.367 INFO:tasks.workunit.client.0.smithi046.stdout:3/432: creat d5/dc/d28/d63/f96 x:0 0 0 2024-09-21T12:47:16.372 INFO:tasks.workunit.client.0.smithi046.stdout:7/545: rmdir d2/d4/df/d6f 39 2024-09-21T12:47:16.380 INFO:tasks.workunit.client.0.smithi046.stdout:3/433: dread - d5/dc/d26/d3c/f4e zero size 2024-09-21T12:47:16.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/505: truncate d4/d13/f2f 3245446 0 2024-09-21T12:47:16.391 INFO:tasks.workunit.client.0.smithi046.stdout:0/554: sync 2024-09-21T12:47:16.392 INFO:tasks.workunit.client.0.smithi046.stdout:8/543: sync 2024-09-21T12:47:16.392 INFO:tasks.workunit.client.0.smithi046.stdout:5/463: sync 2024-09-21T12:47:16.392 INFO:tasks.workunit.client.0.smithi046.stdout:9/595: dwrite d11/d5b/d6f/db0/d30/f5d [0,4194304] 0 2024-09-21T12:47:16.393 INFO:tasks.workunit.client.0.smithi046.stdout:1/506: unlink d4/d13/d38/d48/d8a/l9a 0 2024-09-21T12:47:16.400 INFO:tasks.workunit.client.0.smithi046.stdout:8/544: rename d1/d12/d53/f83 to d1/d12/d46/d35/d36/d86/fbf 0 2024-09-21T12:47:16.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/546: dread d2/d4/f8 [0,4194304] 0 2024-09-21T12:47:16.404 INFO:tasks.workunit.client.0.smithi046.stdout:9/596: mknod d11/d5b/d6f/db0/d74/cbd 0 2024-09-21T12:47:16.406 INFO:tasks.workunit.client.0.smithi046.stdout:3/434: dwrite d5/f10 [0,4194304] 0 2024-09-21T12:47:16.410 INFO:tasks.workunit.client.0.smithi046.stdout:0/555: truncate d6/d7/d13/d49/f9f 3896921 0 2024-09-21T12:47:16.412 INFO:tasks.workunit.client.0.smithi046.stdout:7/547: chown d2/c71 6 1 2024-09-21T12:47:16.420 INFO:tasks.workunit.client.0.smithi046.stdout:0/556: dwrite d6/d7/d13/d43/d52/dc0/dc3/fbe [0,4194304] 0 2024-09-21T12:47:16.421 INFO:tasks.workunit.client.0.smithi046.stdout:1/507: symlink d4/d29/d32/d9e/d5d/d8c/d92/lab 0 2024-09-21T12:47:16.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/435: rmdir d5/dc/d30/d34 39 2024-09-21T12:47:16.426 INFO:tasks.workunit.client.0.smithi046.stdout:9/597: read d11/d19/f1a [2329916,107742] 0 2024-09-21T12:47:16.434 INFO:tasks.workunit.client.0.smithi046.stdout:0/557: creat d6/d7/d13/d43/d52/d63/fd2 x:0 0 0 2024-09-21T12:47:16.437 INFO:tasks.workunit.client.0.smithi046.stdout:5/464: creat d4/dc/d13/d5b/d2d/f91 x:0 0 0 2024-09-21T12:47:16.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/436: mknod d5/dc/d28/c97 0 2024-09-21T12:47:16.456 INFO:tasks.workunit.client.0.smithi046.stdout:9/598: creat d11/d5b/fbe x:0 0 0 2024-09-21T12:47:16.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/545: getdents d1/d12/d1a/d33 0 2024-09-21T12:47:16.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/558: link d6/d7/d13/d7b/da2/f46 d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd3 0 2024-09-21T12:47:16.468 INFO:tasks.workunit.client.0.smithi046.stdout:1/508: dwrite d4/d13/f27 [0,4194304] 0 2024-09-21T12:47:16.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/546: chown d1/d12/d1a/d33/d6c/ca9 996352825 1 2024-09-21T12:47:16.469 INFO:tasks.workunit.client.0.smithi046.stdout:5/465: truncate d4/f8 4107309 0 2024-09-21T12:47:16.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/599: mkdir d11/d5b/d6f/db0/d30/d3e/dbf 0 2024-09-21T12:47:16.475 INFO:tasks.workunit.client.0.smithi046.stdout:0/559: mknod d6/d7/d37/cd4 0 2024-09-21T12:47:16.476 INFO:tasks.workunit.client.0.smithi046.stdout:7/548: dwrite d2/d4/d97/fab [0,4194304] 0 2024-09-21T12:47:16.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/437: rename d5/dc/c36 to d5/dc/c98 0 2024-09-21T12:47:16.484 INFO:tasks.workunit.client.0.smithi046.stdout:3/438: readlink d5/dc/l32 0 2024-09-21T12:47:16.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/439: readlink d5/d16/d5f/l91 0 2024-09-21T12:47:16.488 INFO:tasks.workunit.client.0.smithi046.stdout:5/466: chown d4/d22/d10/f62 109059690 1 2024-09-21T12:47:16.491 INFO:tasks.workunit.client.0.smithi046.stdout:9/600: creat d11/d5b/fc0 x:0 0 0 2024-09-21T12:47:16.492 INFO:tasks.workunit.client.0.smithi046.stdout:0/560: mknod d6/d7/d9/cd5 0 2024-09-21T12:47:16.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/440: mknod d5/d5e/c99 0 2024-09-21T12:47:16.497 INFO:tasks.workunit.client.0.smithi046.stdout:0/561: dread d6/d7/d13/d43/d52/dc0/dc3/fbe [0,4194304] 0 2024-09-21T12:47:16.500 INFO:tasks.workunit.client.0.smithi046.stdout:8/547: rmdir d1/db5 0 2024-09-21T12:47:16.502 INFO:tasks.workunit.client.0.smithi046.stdout:5/467: creat d4/dc/d13/d15/f92 x:0 0 0 2024-09-21T12:47:16.504 INFO:tasks.workunit.client.0.smithi046.stdout:3/441: dwrite d5/dc/d26/f78 [0,4194304] 0 2024-09-21T12:47:16.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/601: creat d11/d19/d1b/fc1 x:0 0 0 2024-09-21T12:47:16.506 INFO:tasks.workunit.client.0.smithi046.stdout:3/442: chown d5/d16/d5f/d6c/c71 220018 1 2024-09-21T12:47:16.507 INFO:tasks.workunit.client.0.smithi046.stdout:9/602: chown d11/d19/d1b/d31/cb1 1 1 2024-09-21T12:47:16.507 INFO:tasks.workunit.client.0.smithi046.stdout:1/509: rmdir d4/d29/d89 0 2024-09-21T12:47:16.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/443: write d5/dc/d28/f7f [771149,125609] 0 2024-09-21T12:47:16.510 INFO:tasks.workunit.client.0.smithi046.stdout:1/510: chown d4/d13/d38/c4e 793724 1 2024-09-21T12:47:16.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/603: fsync d11/d5b/d6f/db0/d30/d3e/f87 0 2024-09-21T12:47:16.512 INFO:tasks.workunit.client.0.smithi046.stdout:3/444: chown d5/f10 49072 1 2024-09-21T12:47:16.516 INFO:tasks.workunit.client.0.smithi046.stdout:8/548: rmdir d1/d12/d1a 39 2024-09-21T12:47:16.519 INFO:tasks.workunit.client.0.smithi046.stdout:1/511: dwrite d4/d29/d32/d9e/f99 [0,4194304] 0 2024-09-21T12:47:16.521 INFO:tasks.workunit.client.0.smithi046.stdout:5/468: creat d4/dc/d13/d15/d90/f93 x:0 0 0 2024-09-21T12:47:16.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/512: chown d4/d13/d38/c4e 2775001 1 2024-09-21T12:47:16.522 INFO:tasks.workunit.client.0.smithi046.stdout:5/469: dread - d4/dc/d13/d5b/d2d/f7d zero size 2024-09-21T12:47:16.523 INFO:tasks.workunit.client.0.smithi046.stdout:5/470: stat d4/dc/d13/f23 0 2024-09-21T12:47:16.523 INFO:tasks.workunit.client.0.smithi046.stdout:1/513: truncate d4/f6a 5205860 0 2024-09-21T12:47:16.524 INFO:tasks.workunit.client.0.smithi046.stdout:1/514: readlink d4/d29/d32/d9e/d5d/d8c/d92/lab 0 2024-09-21T12:47:16.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/549: rmdir d2/d4/df/d70/d88/d34/d7f/d83 0 2024-09-21T12:47:16.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/562: mkdir d6/d7/d9/d54/db1/dd6 0 2024-09-21T12:47:16.534 INFO:tasks.workunit.client.0.smithi046.stdout:3/445: chown d5/dc/d28/d60/c70 88 1 2024-09-21T12:47:16.535 INFO:tasks.workunit.client.0.smithi046.stdout:3/446: write d5/d16/f47 [4528815,18693] 0 2024-09-21T12:47:16.535 INFO:tasks.workunit.client.0.smithi046.stdout:8/549: creat d1/d12/d46/d35/d36/d86/fc0 x:0 0 0 2024-09-21T12:47:16.539 INFO:tasks.workunit.client.0.smithi046.stdout:5/471: write d4/d22/d10/d1a/f59 [7731341,77416] 0 2024-09-21T12:47:16.542 INFO:tasks.workunit.client.0.smithi046.stdout:1/515: mknod d4/d29/d32/d9e/d5d/d8c/cac 0 2024-09-21T12:47:16.543 INFO:tasks.workunit.client.0.smithi046.stdout:0/563: dread d6/d7/d13/f3d [0,4194304] 0 2024-09-21T12:47:16.547 INFO:tasks.workunit.client.0.smithi046.stdout:0/564: write d6/d7/d37/d53/f7c [477235,23772] 0 2024-09-21T12:47:16.547 INFO:tasks.workunit.client.0.smithi046.stdout:9/604: symlink d11/d5b/d6f/db0/d30/d3e/dbf/lc2 0 2024-09-21T12:47:16.547 INFO:tasks.workunit.client.0.smithi046.stdout:1/516: dread d4/d4d/f73 [0,4194304] 0 2024-09-21T12:47:16.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/550: rmdir d2/d4/df/d6f/d92 39 2024-09-21T12:47:16.554 INFO:tasks.workunit.client.0.smithi046.stdout:7/551: chown d2/d4/df/d70/d88/l66 1 1 2024-09-21T12:47:16.555 INFO:tasks.workunit.client.0.smithi046.stdout:5/472: mkdir d4/dc/d45/d94 0 2024-09-21T12:47:16.562 INFO:tasks.workunit.client.0.smithi046.stdout:1/517: creat d4/d13/d38/fad x:0 0 0 2024-09-21T12:47:16.565 INFO:tasks.workunit.client.0.smithi046.stdout:3/447: mkdir d5/dc/d30/d9a 0 2024-09-21T12:47:16.569 INFO:tasks.workunit.client.0.smithi046.stdout:7/552: rmdir d2/d37/d77 39 2024-09-21T12:47:16.569 INFO:tasks.workunit.client.0.smithi046.stdout:7/553: chown d2/d37 0 1 2024-09-21T12:47:16.570 INFO:tasks.workunit.client.0.smithi046.stdout:7/554: dread - d2/d4/df/d70/d88/d34/d7f/fb5 zero size 2024-09-21T12:47:16.572 INFO:tasks.workunit.client.0.smithi046.stdout:5/473: rename d4/dc/d13/d15/d5c/f8b to d4/dc/d13/d5b/d2d/d3b/f95 0 2024-09-21T12:47:16.574 INFO:tasks.workunit.client.0.smithi046.stdout:5/474: read d4/d22/d10/f62 [152058,52525] 0 2024-09-21T12:47:16.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/475: chown d4/dc/d13/c6a 295 1 2024-09-21T12:47:16.576 INFO:tasks.workunit.client.0.smithi046.stdout:7/555: dwrite d2/dd/f3d [0,4194304] 0 2024-09-21T12:47:16.578 INFO:tasks.workunit.client.0.smithi046.stdout:7/556: chown d2/d4/df/d6f/ca7 21997 1 2024-09-21T12:47:16.581 INFO:tasks.workunit.client.0.smithi046.stdout:1/518: stat d4/d13/f19 0 2024-09-21T12:47:16.582 INFO:tasks.workunit.client.0.smithi046.stdout:1/519: write d4/f37 [437222,53824] 0 2024-09-21T12:47:16.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/448: fsync d5/dc/d28/d60/f73 0 2024-09-21T12:47:16.587 INFO:tasks.workunit.client.0.smithi046.stdout:8/550: write d1/d12/d46/d35/d36/f4b [840785,98323] 0 2024-09-21T12:47:16.588 INFO:tasks.workunit.client.0.smithi046.stdout:8/551: chown d1/f6 742 1 2024-09-21T12:47:16.589 INFO:tasks.workunit.client.0.smithi046.stdout:8/552: readlink d1/d12/l32 0 2024-09-21T12:47:16.589 INFO:tasks.workunit.client.0.smithi046.stdout:8/553: readlink d1/l43 0 2024-09-21T12:47:16.592 INFO:tasks.workunit.client.0.smithi046.stdout:5/476: mknod d4/dc/d13/d5b/d2d/d43/d7a/c96 0 2024-09-21T12:47:16.592 INFO:tasks.workunit.client.0.smithi046.stdout:5/477: fsync d4/fa 0 2024-09-21T12:47:16.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/557: truncate d2/d4/f86 846257 0 2024-09-21T12:47:16.602 INFO:tasks.workunit.client.0.smithi046.stdout:3/449: creat d5/dc/d26/d3c/f9b x:0 0 0 2024-09-21T12:47:16.603 INFO:tasks.workunit.client.0.smithi046.stdout:8/554: mkdir d1/dc1 0 2024-09-21T12:47:16.604 INFO:tasks.workunit.client.0.smithi046.stdout:8/555: write d1/d12/fae [271282,115961] 0 2024-09-21T12:47:16.606 INFO:tasks.workunit.client.0.smithi046.stdout:0/565: getdents d6/d7/d13 0 2024-09-21T12:47:16.606 INFO:tasks.workunit.client.0.smithi046.stdout:9/605: truncate f10 4175013 0 2024-09-21T12:47:16.607 INFO:tasks.workunit.client.0.smithi046.stdout:0/566: chown d6/d7/d13/d43/d52/d63 4 1 2024-09-21T12:47:16.615 INFO:tasks.workunit.client.0.smithi046.stdout:6/505: sync 2024-09-21T12:47:16.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/606: fsync d11/f99 0 2024-09-21T12:47:16.617 INFO:tasks.workunit.client.0.smithi046.stdout:0/567: dread - d6/d7/d37/f67 zero size 2024-09-21T12:47:16.619 INFO:tasks.workunit.client.0.smithi046.stdout:7/558: rmdir d2/d37/d77 39 2024-09-21T12:47:16.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/506: dwrite de/f13 [0,4194304] 0 2024-09-21T12:47:16.621 INFO:tasks.workunit.client.0.smithi046.stdout:1/520: link d4/d13/d38/c63 d4/d13/d38/cae 0 2024-09-21T12:47:16.624 INFO:tasks.workunit.client.0.smithi046.stdout:3/450: creat d5/d5e/d8e/f9c x:0 0 0 2024-09-21T12:47:16.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/507: dwrite de/d2a/d34/d4e/d55/f9f [0,4194304] 0 2024-09-21T12:47:16.640 INFO:tasks.workunit.client.0.smithi046.stdout:6/508: dwrite de/d48/f88 [0,4194304] 0 2024-09-21T12:47:16.647 INFO:tasks.workunit.client.0.smithi046.stdout:6/509: dread de/d2a/d34/d4e/d55/f9f [0,4194304] 0 2024-09-21T12:47:16.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/519: sync 2024-09-21T12:47:16.659 INFO:tasks.workunit.client.0.smithi046.stdout:4/564: sync 2024-09-21T12:47:16.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/520: readlink d16/d22/d2b/d30/l7d 0 2024-09-21T12:47:16.660 INFO:tasks.workunit.client.0.smithi046.stdout:2/521: chown d16/d22/d2b/f6f 0 1 2024-09-21T12:47:16.696 INFO:tasks.workunit.client.0.smithi046.stdout:9/607: creat d11/d19/d1b/d4b/d91/fc3 x:0 0 0 2024-09-21T12:47:16.700 INFO:tasks.workunit.client.0.smithi046.stdout:5/478: link d4/dc/d13/d5b/d2d/l6d d4/dc/d45/d94/l97 0 2024-09-21T12:47:16.701 INFO:tasks.workunit.client.0.smithi046.stdout:5/479: fdatasync d4/dc/d13/d15/f51 0 2024-09-21T12:47:16.704 INFO:tasks.workunit.client.0.smithi046.stdout:0/568: creat d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd7 x:0 0 0 2024-09-21T12:47:16.729 INFO:tasks.workunit.client.0.smithi046.stdout:8/556: dwrite d1/d12/d46/d35/f50 [0,4194304] 0 2024-09-21T12:47:16.733 INFO:tasks.workunit.client.0.smithi046.stdout:5/480: dread d4/dc/d13/f23 [0,4194304] 0 2024-09-21T12:47:16.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/521: dread d4/d13/f2f [0,4194304] 0 2024-09-21T12:47:16.746 INFO:tasks.workunit.client.0.smithi046.stdout:3/451: symlink d5/dc/d26/d3c/d44/l9d 0 2024-09-21T12:47:16.753 INFO:tasks.workunit.client.0.smithi046.stdout:4/565: mknod d1/d27/d82/da8/cc0 0 2024-09-21T12:47:16.758 INFO:tasks.workunit.client.0.smithi046.stdout:5/481: mkdir d4/dc/d45/d98 0 2024-09-21T12:47:16.763 INFO:tasks.workunit.client.0.smithi046.stdout:5/482: dread d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:16.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/608: unlink d11/d19/d93/l92 0 2024-09-21T12:47:16.770 INFO:tasks.workunit.client.0.smithi046.stdout:0/569: mknod d6/d7/d9/dc4/cd8 0 2024-09-21T12:47:16.771 INFO:tasks.workunit.client.0.smithi046.stdout:5/483: dwrite d4/dc/d13/d15/f84 [0,4194304] 0 2024-09-21T12:47:16.777 INFO:tasks.workunit.client.0.smithi046.stdout:3/452: read d5/d16/f1e [1197691,25391] 0 2024-09-21T12:47:16.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/510: getdents de 0 2024-09-21T12:47:16.796 INFO:tasks.workunit.client.0.smithi046.stdout:4/566: mknod d1/d27/d37/d8f/d9d/cc1 0 2024-09-21T12:47:16.869 INFO:tasks.workunit.client.0.smithi046.stdout:6/511: dwrite de/d35/f43 [0,4194304] 0 2024-09-21T12:47:16.869 INFO:tasks.workunit.client.0.smithi046.stdout:4/567: chown d1/d27/d82/c95 1844609682 1 2024-09-21T12:47:16.870 INFO:tasks.workunit.client.0.smithi046.stdout:8/557: getdents d1/d12/d1a/d33 0 2024-09-21T12:47:16.871 INFO:tasks.workunit.client.0.smithi046.stdout:4/568: dread - d1/d13/d25/d29/f54 zero size 2024-09-21T12:47:16.872 INFO:tasks.workunit.client.0.smithi046.stdout:2/522: unlink d16/d5c/l60 0 2024-09-21T12:47:16.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/512: dread - de/d2a/d4c/d71/d7c/f92 zero size 2024-09-21T12:47:16.886 INFO:tasks.workunit.client.0.smithi046.stdout:6/513: rmdir de/d2a 39 2024-09-21T12:47:16.890 INFO:tasks.workunit.client.0.smithi046.stdout:4/569: rmdir d1/d13/d25/d3a/d92/db9 0 2024-09-21T12:47:16.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/570: write d1/d13/f16 [4663165,88020] 0 2024-09-21T12:47:16.897 INFO:tasks.workunit.client.0.smithi046.stdout:4/571: dwrite d1/d13/d25/d3a/f3c [0,4194304] 0 2024-09-21T12:47:16.902 INFO:tasks.workunit.client.0.smithi046.stdout:6/514: truncate de/d2a/d4c/d71/d7c/f87 289021 0 2024-09-21T12:47:16.903 INFO:tasks.workunit.client.0.smithi046.stdout:4/572: dread d1/f26 [0,4194304] 0 2024-09-21T12:47:16.903 INFO:tasks.workunit.client.0.smithi046.stdout:2/523: getdents d16/d22/d2b/d30 0 2024-09-21T12:47:16.905 INFO:tasks.workunit.client.0.smithi046.stdout:4/573: stat d1/d13/d25/c9b 0 2024-09-21T12:47:16.905 INFO:tasks.workunit.client.0.smithi046.stdout:2/524: write d16/d22/d2b/d30/d67/f72 [801699,23714] 0 2024-09-21T12:47:16.909 INFO:tasks.workunit.client.0.smithi046.stdout:6/515: creat de/d2a/d4c/d77/d8f/fa8 x:0 0 0 2024-09-21T12:47:16.913 INFO:tasks.workunit.client.0.smithi046.stdout:2/525: creat d16/d22/d38/d77/d7a/fa1 x:0 0 0 2024-09-21T12:47:16.938 INFO:tasks.workunit.client.0.smithi046.stdout:1/522: write d4/d13/f1a [1068009,42759] 0 2024-09-21T12:47:16.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/559: truncate d2/d4/f33 3051323 0 2024-09-21T12:47:16.956 INFO:tasks.workunit.client.0.smithi046.stdout:6/516: creat de/d2a/d34/fa9 x:0 0 0 2024-09-21T12:47:16.957 INFO:tasks.workunit.client.0.smithi046.stdout:6/517: write f3 [3799901,103735] 0 2024-09-21T12:47:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/609: write d11/d19/d93/fbc [846864,77472] 0 2024-09-21T12:47:16.962 INFO:tasks.workunit.client.0.smithi046.stdout:0/570: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd3 [0,4194304] 0 2024-09-21T12:47:16.970 INFO:tasks.workunit.client.0.smithi046.stdout:0/571: mknod d6/d7/d13/d43/d52/d63/d7f/cd9 0 2024-09-21T12:47:16.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/484: unlink d4/d22/c89 0 2024-09-21T12:47:16.975 INFO:tasks.workunit.client.0.smithi046.stdout:0/572: truncate d6/d7/d13/d43/d52/d63/d7f/f5f 5983447 0 2024-09-21T12:47:16.977 INFO:tasks.workunit.client.0.smithi046.stdout:9/610: rename d11/d19/d1b/d31/d53/da4/l9c to d11/d19/d1b/d31/lc4 0 2024-09-21T12:47:16.978 INFO:tasks.workunit.client.0.smithi046.stdout:5/485: mkdir d4/d22/d99 0 2024-09-21T12:47:16.983 INFO:tasks.workunit.client.0.smithi046.stdout:0/573: dread d6/d7/d37/d53/f56 [0,4194304] 0 2024-09-21T12:47:16.983 INFO:tasks.workunit.client.0.smithi046.stdout:5/486: mkdir d4/dc/d45/d98/d9a 0 2024-09-21T12:47:16.985 INFO:tasks.workunit.client.0.smithi046.stdout:0/574: rename d6/d7/d13/d43/d52 to d6/d7/d13/d43/d52/d63/d7f/d78/d8a/dda 22 2024-09-21T12:47:16.990 INFO:tasks.workunit.client.0.smithi046.stdout:5/487: creat d4/d22/f9b x:0 0 0 2024-09-21T12:47:16.997 INFO:tasks.workunit.client.0.smithi046.stdout:5/488: link d4/dc/d13/d15/d5c/c8e d4/dc/d13/d5b/d2d/d3b/c9c 0 2024-09-21T12:47:17.012 INFO:tasks.workunit.client.0.smithi046.stdout:8/558: dwrite d1/d12/d46/d35/d36/f4e [0,4194304] 0 2024-09-21T12:47:17.016 INFO:tasks.workunit.client.0.smithi046.stdout:2/526: truncate fa 293750 0 2024-09-21T12:47:17.019 INFO:tasks.workunit.client.0.smithi046.stdout:4/574: dwrite d1/d13/d25/d29/f54 [0,4194304] 0 2024-09-21T12:47:17.022 INFO:tasks.workunit.client.0.smithi046.stdout:5/489: dread d4/dc/d13/d5e/f66 [0,4194304] 0 2024-09-21T12:47:17.023 INFO:tasks.workunit.client.0.smithi046.stdout:5/490: chown d4/dc/d13/d5b/d2d/d3b 26186 1 2024-09-21T12:47:17.025 INFO:tasks.workunit.client.0.smithi046.stdout:5/491: chown d4/d22/l1f 73454 1 2024-09-21T12:47:17.027 INFO:tasks.workunit.client.0.smithi046.stdout:8/559: truncate d1/d12/d46/d35/d36/d51/d8c/fb8 1391024 0 2024-09-21T12:47:17.028 INFO:tasks.workunit.client.0.smithi046.stdout:4/575: symlink d1/d27/d58/lc2 0 2024-09-21T12:47:17.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/576: readlink d1/d13/l1a 0 2024-09-21T12:47:17.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/577: fdatasync d1/d13/d25/d3a/f3c 0 2024-09-21T12:47:17.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/523: write d4/f1f [530812,53615] 0 2024-09-21T12:47:17.034 INFO:tasks.workunit.client.0.smithi046.stdout:8/560: rename d1/d12/d46/d35/d36/cb6 to d1/d12/d46/d35/d36/d86/cc2 0 2024-09-21T12:47:17.038 INFO:tasks.workunit.client.0.smithi046.stdout:4/578: mknod d1/d13/d25/d29/d43/cc3 0 2024-09-21T12:47:17.042 INFO:tasks.workunit.client.0.smithi046.stdout:8/561: dwrite d1/d12/d53/f98 [0,4194304] 0 2024-09-21T12:47:17.044 INFO:tasks.workunit.client.0.smithi046.stdout:2/527: dread d16/d22/d38/f42 [0,4194304] 0 2024-09-21T12:47:17.045 INFO:tasks.workunit.client.0.smithi046.stdout:2/528: chown d16/f21 4191647 1 2024-09-21T12:47:17.052 INFO:tasks.workunit.client.0.smithi046.stdout:8/562: creat d1/d12/d53/d80/da1/fc3 x:0 0 0 2024-09-21T12:47:17.052 INFO:tasks.workunit.client.0.smithi046.stdout:2/529: dread d16/d5c/d63/f79 [0,4194304] 0 2024-09-21T12:47:17.059 INFO:tasks.workunit.client.0.smithi046.stdout:8/563: rename d1/cb2 to d1/d12/d1a/d33/cc4 0 2024-09-21T12:47:17.060 INFO:tasks.workunit.client.0.smithi046.stdout:9/611: truncate d11/d19/d1b/f25 3099198 0 2024-09-21T12:47:17.061 INFO:tasks.workunit.client.0.smithi046.stdout:2/530: fdatasync d16/d22/d2b/f6e 0 2024-09-21T12:47:17.062 INFO:tasks.workunit.client.0.smithi046.stdout:9/612: write d11/d19/d1b/d31/f7d [868560,17837] 0 2024-09-21T12:47:17.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/564: rename d1/d12/d1a/d33/f59 to d1/d12/d46/d35/d36/d86/fc5 0 2024-09-21T12:47:17.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/492: getdents d4/d22 0 2024-09-21T12:47:17.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/493: dread - d4/dc/d13/d15/f7f zero size 2024-09-21T12:47:17.069 INFO:tasks.workunit.client.0.smithi046.stdout:9/613: mknod d11/cc5 0 2024-09-21T12:47:17.071 INFO:tasks.workunit.client.0.smithi046.stdout:2/531: symlink d16/d5c/d96/la2 0 2024-09-21T12:47:17.077 INFO:tasks.workunit.client.0.smithi046.stdout:8/565: rename d1/d78 to d1/d12/d46/d35/d36/dc6 0 2024-09-21T12:47:17.082 INFO:tasks.workunit.client.0.smithi046.stdout:5/494: mkdir d4/d22/d99/d9d 0 2024-09-21T12:47:17.085 INFO:tasks.workunit.client.0.smithi046.stdout:2/532: symlink d16/d22/d4e/d9d/la3 0 2024-09-21T12:47:17.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/533: write d16/d22/f97 [992869,80471] 0 2024-09-21T12:47:17.092 INFO:tasks.workunit.client.0.smithi046.stdout:2/534: dread d16/d5c/f5d [0,4194304] 0 2024-09-21T12:47:17.092 INFO:tasks.workunit.client.0.smithi046.stdout:5/495: dwrite d4/dc/d45/f87 [0,4194304] 0 2024-09-21T12:47:17.093 INFO:tasks.workunit.client.0.smithi046.stdout:2/535: dread - d16/d22/d38/d77/f9a zero size 2024-09-21T12:47:17.095 INFO:tasks.workunit.client.0.smithi046.stdout:4/579: truncate d1/d13/d25/d3a/f3c 2943016 0 2024-09-21T12:47:17.098 INFO:tasks.workunit.client.0.smithi046.stdout:5/496: rename d4/dc/d45/d98 to d4/d22/d10/d1a/d9e 0 2024-09-21T12:47:17.098 INFO:tasks.workunit.client.0.smithi046.stdout:1/524: write d4/d4d/f73 [2984405,55875] 0 2024-09-21T12:47:17.100 INFO:tasks.workunit.client.0.smithi046.stdout:1/525: chown d4/l8 0 1 2024-09-21T12:47:17.101 INFO:tasks.workunit.client.0.smithi046.stdout:8/566: dread d1/d12/d1a/f1b [0,4194304] 0 2024-09-21T12:47:17.104 INFO:tasks.workunit.client.0.smithi046.stdout:8/567: chown d1/d12/d46/d35/f8b 1 1 2024-09-21T12:47:17.105 INFO:tasks.workunit.client.0.smithi046.stdout:4/580: creat d1/d27/d37/d8f/d9d/fc4 x:0 0 0 2024-09-21T12:47:17.108 INFO:tasks.workunit.client.0.smithi046.stdout:1/526: chown d4/d29/c44 2855 1 2024-09-21T12:47:17.108 INFO:tasks.workunit.client.0.smithi046.stdout:2/536: link d16/f59 d16/d22/d2b/d30/d67/fa4 0 2024-09-21T12:47:17.109 INFO:tasks.workunit.client.0.smithi046.stdout:5/497: dwrite d4/dc/d13/d15/f7f [0,4194304] 0 2024-09-21T12:47:17.113 INFO:tasks.workunit.client.0.smithi046.stdout:0/575: truncate d6/d7/d13/d43/d52/d63/d7f/f5f 5910514 0 2024-09-21T12:47:17.113 INFO:tasks.workunit.client.0.smithi046.stdout:1/527: dread d4/d4d/f57 [0,4194304] 0 2024-09-21T12:47:17.117 INFO:tasks.workunit.client.0.smithi046.stdout:5/498: mknod d4/c9f 0 2024-09-21T12:47:17.121 INFO:tasks.workunit.client.0.smithi046.stdout:4/581: getdents d1/d27/d46 0 2024-09-21T12:47:17.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/576: mknod d6/d7/d13/d43/d52/dc0/cdb 0 2024-09-21T12:47:17.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/568: dwrite d1/d12/d46/d35/d5b/f69 [0,4194304] 0 2024-09-21T12:47:17.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/528: write d4/d29/d32/d9e/f99 [1760933,88541] 0 2024-09-21T12:47:17.124 INFO:tasks.workunit.client.0.smithi046.stdout:5/499: write d4/dc/d13/d15/d90/f36 [3083490,70640] 0 2024-09-21T12:47:17.125 INFO:tasks.workunit.client.0.smithi046.stdout:9/614: dwrite d11/d19/f1a [0,4194304] 0 2024-09-21T12:47:17.126 INFO:tasks.workunit.client.0.smithi046.stdout:1/529: readlink d4/d13/l34 0 2024-09-21T12:47:17.128 INFO:tasks.workunit.client.0.smithi046.stdout:0/577: chown d6/d7/d37/d53 1849 1 2024-09-21T12:47:17.128 INFO:tasks.workunit.client.0.smithi046.stdout:1/530: dread - d4/d13/d38/d4f/fa0 zero size 2024-09-21T12:47:17.133 INFO:tasks.workunit.client.0.smithi046.stdout:8/569: symlink d1/d12/d1a/d33/lc7 0 2024-09-21T12:47:17.136 INFO:tasks.workunit.client.0.smithi046.stdout:4/582: fdatasync d1/d13/d25/d29/d43/f7a 0 2024-09-21T12:47:17.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/570: fdatasync d1/d12/d46/d35/d36/d86/fc0 0 2024-09-21T12:47:17.148 INFO:tasks.workunit.client.0.smithi046.stdout:5/500: dwrite d4/dc/d13/d5b/d2d/d43/f55 [0,4194304] 0 2024-09-21T12:47:17.150 INFO:tasks.workunit.client.0.smithi046.stdout:8/571: creat d1/d12/d53/d80/da1/fc8 x:0 0 0 2024-09-21T12:47:17.159 INFO:tasks.workunit.client.0.smithi046.stdout:5/501: write d4/dc/d13/d5e/f66 [2616364,56313] 0 2024-09-21T12:47:17.162 INFO:tasks.workunit.client.0.smithi046.stdout:0/578: truncate d6/d60/fcb 432306 0 2024-09-21T12:47:17.163 INFO:tasks.workunit.client.0.smithi046.stdout:5/502: fsync d4/dc/d45/f8d 0 2024-09-21T12:47:17.164 INFO:tasks.workunit.client.0.smithi046.stdout:4/583: dread d1/d13/d25/f19 [0,4194304] 0 2024-09-21T12:47:17.164 INFO:tasks.workunit.client.0.smithi046.stdout:8/572: mknod d1/d12/cc9 0 2024-09-21T12:47:17.167 INFO:tasks.workunit.client.0.smithi046.stdout:1/531: dwrite d4/f1b [4194304,4194304] 0 2024-09-21T12:47:17.169 INFO:tasks.workunit.client.0.smithi046.stdout:9/615: dwrite d11/d19/d1b/d4b/f56 [0,4194304] 0 2024-09-21T12:47:17.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/503: creat d4/dc/d13/d15/fa0 x:0 0 0 2024-09-21T12:47:17.171 INFO:tasks.workunit.client.0.smithi046.stdout:4/584: chown d1/d13/d25/d29/c6e 5593 1 2024-09-21T12:47:17.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/585: chown d1/d13/d25/d29/d33/f76 24765 1 2024-09-21T12:47:17.182 INFO:tasks.workunit.client.0.smithi046.stdout:5/504: creat d4/dc/d13/d5b/d2d/d3b/fa1 x:0 0 0 2024-09-21T12:47:17.183 INFO:tasks.workunit.client.0.smithi046.stdout:1/532: dwrite d4/d13/f2e [0,4194304] 0 2024-09-21T12:47:17.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/579: link d6/d7/d13/d49/f9f d6/d7/d9/dc4/fdc 0 2024-09-21T12:47:17.184 INFO:tasks.workunit.client.0.smithi046.stdout:0/580: chown d6/f23 4 1 2024-09-21T12:47:17.187 INFO:tasks.workunit.client.0.smithi046.stdout:4/586: read d1/d27/d46/f77 [981074,105039] 0 2024-09-21T12:47:17.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/533: write d4/d13/d38/d53/d80/f82 [306060,41841] 0 2024-09-21T12:47:17.192 INFO:tasks.workunit.client.0.smithi046.stdout:9/616: getdents d11/d19/d93 0 2024-09-21T12:47:17.193 INFO:tasks.workunit.client.0.smithi046.stdout:5/505: mkdir d4/dc/d13/da2 0 2024-09-21T12:47:17.197 INFO:tasks.workunit.client.0.smithi046.stdout:8/573: dread d1/d12/f3b [4194304,4194304] 0 2024-09-21T12:47:17.198 INFO:tasks.workunit.client.0.smithi046.stdout:1/534: truncate d4/d4d/f57 387637 0 2024-09-21T12:47:17.198 INFO:tasks.workunit.client.0.smithi046.stdout:0/581: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd7 [0,4194304] 0 2024-09-21T12:47:17.201 INFO:tasks.workunit.client.0.smithi046.stdout:9/617: fdatasync d11/f99 0 2024-09-21T12:47:17.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/587: dwrite d1/d27/d46/d78/fa4 [0,4194304] 0 2024-09-21T12:47:17.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/535: fsync d4/d13/f7a 0 2024-09-21T12:47:17.209 INFO:tasks.workunit.client.0.smithi046.stdout:5/506: dread d4/fa [0,4194304] 0 2024-09-21T12:47:17.210 INFO:tasks.workunit.client.0.smithi046.stdout:0/582: dread - d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf zero size 2024-09-21T12:47:17.210 INFO:tasks.workunit.client.0.smithi046.stdout:9/618: rmdir d11/d19/d36/d45/d6e 39 2024-09-21T12:47:17.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/574: truncate d1/d12/d53/d60/f64 473723 0 2024-09-21T12:47:17.216 INFO:tasks.workunit.client.0.smithi046.stdout:9/619: write d11/d19/d1b/d4b/d91/d94/fb4 [1041934,99538] 0 2024-09-21T12:47:17.218 INFO:tasks.workunit.client.0.smithi046.stdout:0/583: mknod d6/d7/d9/dc4/cdd 0 2024-09-21T12:47:17.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/507: symlink d4/dc/d13/d15/d54/la3 0 2024-09-21T12:47:17.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/588: dwrite d1/d13/d25/d3a/fa1 [0,4194304] 0 2024-09-21T12:47:17.223 INFO:tasks.workunit.client.0.smithi046.stdout:4/589: chown d1/d27/d37/d8f/c99 5436 1 2024-09-21T12:47:17.224 INFO:tasks.workunit.client.0.smithi046.stdout:1/536: rename d4/d29/d32/d9e/d5d/f74 to d4/d13/d38/faf 0 2024-09-21T12:47:17.226 INFO:tasks.workunit.client.0.smithi046.stdout:9/620: mkdir d11/d19/d1b/d4b/d91/dc6 0 2024-09-21T12:47:17.229 INFO:tasks.workunit.client.0.smithi046.stdout:8/575: symlink d1/d12/d53/d80/lca 0 2024-09-21T12:47:17.237 INFO:tasks.workunit.client.0.smithi046.stdout:4/590: mknod d1/d13/d25/d6b/cc5 0 2024-09-21T12:47:17.240 INFO:tasks.workunit.client.0.smithi046.stdout:1/537: rename d4/d29/c9b to d4/d13/d38/d4f/cb0 0 2024-09-21T12:47:17.241 INFO:tasks.workunit.client.0.smithi046.stdout:1/538: chown d4/d13/f2f 132579125 1 2024-09-21T12:47:17.243 INFO:tasks.workunit.client.0.smithi046.stdout:8/576: creat d1/d12/d53/d80/da1/fcb x:0 0 0 2024-09-21T12:47:17.248 INFO:tasks.workunit.client.0.smithi046.stdout:4/591: mknod d1/d13/d25/d6b/cc6 0 2024-09-21T12:47:17.251 INFO:tasks.workunit.client.0.smithi046.stdout:9/621: symlink d11/d19/d1b/d4b/d91/dc6/lc7 0 2024-09-21T12:47:17.251 INFO:tasks.workunit.client.0.smithi046.stdout:0/584: dwrite d6/d7/d37/f48 [4194304,4194304] 0 2024-09-21T12:47:17.252 INFO:tasks.workunit.client.0.smithi046.stdout:1/539: creat d4/d29/d32/d9e/d5d/d8c/d92/fb1 x:0 0 0 2024-09-21T12:47:17.252 INFO:tasks.workunit.client.0.smithi046.stdout:9/622: stat d11/d19/f4d 0 2024-09-21T12:47:17.253 INFO:tasks.workunit.client.0.smithi046.stdout:1/540: readlink d4/d13/l2b 0 2024-09-21T12:47:17.254 INFO:tasks.workunit.client.0.smithi046.stdout:1/541: dread - d4/d13/f7d zero size 2024-09-21T12:47:17.255 INFO:tasks.workunit.client.0.smithi046.stdout:8/577: rename d1/d12/d1a/f6b to d1/d12/d53/fcc 0 2024-09-21T12:47:17.256 INFO:tasks.workunit.client.0.smithi046.stdout:1/542: write d4/f9 [4016687,30555] 0 2024-09-21T12:47:17.259 INFO:tasks.workunit.client.0.smithi046.stdout:0/585: dread d6/f23 [0,4194304] 0 2024-09-21T12:47:17.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/592: symlink d1/d13/d4e/lc7 0 2024-09-21T12:47:17.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/593: chown d1/l18 41 1 2024-09-21T12:47:17.267 INFO:tasks.workunit.client.0.smithi046.stdout:5/508: dwrite d4/dc/d13/f81 [0,4194304] 0 2024-09-21T12:47:17.267 INFO:tasks.workunit.client.0.smithi046.stdout:8/578: rmdir d1/d12/d46/d35/d36/dc6 39 2024-09-21T12:47:17.269 INFO:tasks.workunit.client.0.smithi046.stdout:5/509: write d4/dc/d13/f38 [1635034,24799] 0 2024-09-21T12:47:17.274 INFO:tasks.workunit.client.0.smithi046.stdout:0/586: mknod d6/d7/d13/d43/d52/d8c/cde 0 2024-09-21T12:47:17.275 INFO:tasks.workunit.client.0.smithi046.stdout:4/594: rename d1/d27/l71 to d1/d13/d25/d3a/lc8 0 2024-09-21T12:47:17.280 INFO:tasks.workunit.client.0.smithi046.stdout:0/587: symlink d6/d7/d9/ldf 0 2024-09-21T12:47:17.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/623: creat d11/d19/d1b/d1c/fc8 x:0 0 0 2024-09-21T12:47:17.282 INFO:tasks.workunit.client.0.smithi046.stdout:4/595: symlink d1/d13/d25/d3a/lc9 0 2024-09-21T12:47:17.284 INFO:tasks.workunit.client.0.smithi046.stdout:5/510: symlink d4/dc/d13/d5b/la4 0 2024-09-21T12:47:17.287 INFO:tasks.workunit.client.0.smithi046.stdout:0/588: dread d6/d7/d13/d72/d9b/fa8 [0,4194304] 0 2024-09-21T12:47:17.288 INFO:tasks.workunit.client.0.smithi046.stdout:4/596: truncate d1/f35 193254 0 2024-09-21T12:47:17.291 INFO:tasks.workunit.client.0.smithi046.stdout:5/511: chown d4/dc/d13/d5b/d2d/d43/d7a/f88 47 1 2024-09-21T12:47:17.291 INFO:tasks.workunit.client.0.smithi046.stdout:1/543: truncate d4/d13/d6b/f7b 2607493 0 2024-09-21T12:47:17.291 INFO:tasks.workunit.client.0.smithi046.stdout:8/579: link d1/d12/d46/d35/d36/d86/cc2 d1/d12/d46/d35/d79/ccd 0 2024-09-21T12:47:17.292 INFO:tasks.workunit.client.0.smithi046.stdout:1/544: chown d4/d29/d32/l51 4668796 1 2024-09-21T12:47:17.293 INFO:tasks.workunit.client.0.smithi046.stdout:1/545: write d4/f1f [5148164,111600] 0 2024-09-21T12:47:17.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/512: dread d4/dc/d13/d15/f7f [0,4194304] 0 2024-09-21T12:47:17.298 INFO:tasks.workunit.client.0.smithi046.stdout:5/513: write d4/d22/f73 [849356,75578] 0 2024-09-21T12:47:17.299 INFO:tasks.workunit.client.0.smithi046.stdout:5/514: read - d4/dc/d45/f8d zero size 2024-09-21T12:47:17.303 INFO:tasks.workunit.client.0.smithi046.stdout:1/546: creat d4/fb2 x:0 0 0 2024-09-21T12:47:17.307 INFO:tasks.workunit.client.0.smithi046.stdout:5/515: dwrite d4/dc/d13/d5b/d2d/d3b/fa1 [0,4194304] 0 2024-09-21T12:47:17.311 INFO:tasks.workunit.client.0.smithi046.stdout:8/580: dread d1/f8 [0,4194304] 0 2024-09-21T12:47:17.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/624: truncate d11/d19/d1b/d31/f7d 3432007 0 2024-09-21T12:47:17.312 INFO:tasks.workunit.client.0.smithi046.stdout:9/625: chown d11/d19/d1b/d1c 44 1 2024-09-21T12:47:17.313 INFO:tasks.workunit.client.0.smithi046.stdout:0/589: write d6/d7/d13/d43/d52/d63/d7f/f44 [1130399,442] 0 2024-09-21T12:47:17.320 INFO:tasks.workunit.client.0.smithi046.stdout:4/597: truncate d1/d13/d25/d29/d33/f41 5824086 0 2024-09-21T12:47:17.328 INFO:tasks.workunit.client.0.smithi046.stdout:5/516: symlink d4/d22/d99/d9d/la5 0 2024-09-21T12:47:17.330 INFO:tasks.workunit.client.0.smithi046.stdout:8/581: fsync d1/d12/f18 0 2024-09-21T12:47:17.331 INFO:tasks.workunit.client.0.smithi046.stdout:8/582: readlink d1/d12/d1a/la4 0 2024-09-21T12:47:17.337 INFO:tasks.workunit.client.0.smithi046.stdout:0/590: truncate d6/f1a 4915000 0 2024-09-21T12:47:17.339 INFO:tasks.workunit.client.0.smithi046.stdout:9/626: dwrite d11/d19/d93/f8e [0,4194304] 0 2024-09-21T12:47:17.341 INFO:tasks.workunit.client.0.smithi046.stdout:5/517: rmdir d4/dc/d13/d5b/d2d/d43 39 2024-09-21T12:47:17.342 INFO:tasks.workunit.client.0.smithi046.stdout:4/598: dread d1/d27/d58/f5c [4194304,4194304] 0 2024-09-21T12:47:17.345 INFO:tasks.workunit.client.0.smithi046.stdout:9/627: dread d11/d19/f1a [0,4194304] 0 2024-09-21T12:47:17.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/453: sync 2024-09-21T12:47:17.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/454: readlink d5/dc/l32 0 2024-09-21T12:47:17.347 INFO:tasks.workunit.client.0.smithi046.stdout:3/455: chown d5/dc/d30/d7c 1 1 2024-09-21T12:47:17.350 INFO:tasks.workunit.client.0.smithi046.stdout:0/591: creat d6/d7/d13/d49/fe0 x:0 0 0 2024-09-21T12:47:17.352 INFO:tasks.workunit.client.0.smithi046.stdout:1/547: truncate d4/d29/d32/d9e/f65 2591871 0 2024-09-21T12:47:17.353 INFO:tasks.workunit.client.0.smithi046.stdout:1/548: fsync d4/d4d/f73 0 2024-09-21T12:47:17.354 INFO:tasks.workunit.client.0.smithi046.stdout:8/583: mkdir d1/d12/d46/d35/d36/dce 0 2024-09-21T12:47:17.364 INFO:tasks.workunit.client.0.smithi046.stdout:4/599: stat d1/d13/d25/d29/f42 0 2024-09-21T12:47:17.368 INFO:tasks.workunit.client.0.smithi046.stdout:9/628: rename d11/d19/d1b/d31/f43 to d11/d5b/d6f/db0/d30/d3e/dbf/fc9 0 2024-09-21T12:47:17.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/549: dwrite d4/d13/d6b/f8e [0,4194304] 0 2024-09-21T12:47:17.371 INFO:tasks.workunit.client.0.smithi046.stdout:5/518: creat d4/dc/fa6 x:0 0 0 2024-09-21T12:47:17.373 INFO:tasks.workunit.client.0.smithi046.stdout:5/519: readlink d4/dc/d13/d5b/d2d/d3b/l3d 0 2024-09-21T12:47:17.378 INFO:tasks.workunit.client.0.smithi046.stdout:9/629: dwrite d11/f3c [0,4194304] 0 2024-09-21T12:47:17.380 INFO:tasks.workunit.client.0.smithi046.stdout:3/456: link d5/dc/d28/d60/d6e/l79 d5/dc/d28/l9e 0 2024-09-21T12:47:17.382 INFO:tasks.workunit.client.0.smithi046.stdout:3/457: chown d5/dc/d28/c41 99 1 2024-09-21T12:47:17.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/520: mkdir d4/d22/d10/d1a/d9e/da7 0 2024-09-21T12:47:17.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/584: creat d1/d12/d46/d35/fcf x:0 0 0 2024-09-21T12:47:17.387 INFO:tasks.workunit.client.0.smithi046.stdout:9/630: symlink d11/d5b/d6f/db0/d30/lca 0 2024-09-21T12:47:17.389 INFO:tasks.workunit.client.0.smithi046.stdout:9/631: truncate d11/d5b/d6f/db0/d30/d3e/f81 5218178 0 2024-09-21T12:47:17.390 INFO:tasks.workunit.client.0.smithi046.stdout:9/632: chown d11/d19/c1d 9339926 1 2024-09-21T12:47:17.393 INFO:tasks.workunit.client.0.smithi046.stdout:8/585: creat d1/d12/d46/d35/d36/d51/d8c/fd0 x:0 0 0 2024-09-21T12:47:17.395 INFO:tasks.workunit.client.0.smithi046.stdout:1/550: dread d4/d29/f6c [0,4194304] 0 2024-09-21T12:47:17.396 INFO:tasks.workunit.client.0.smithi046.stdout:3/458: rename d5/dc/d30/d34/l55 to d5/dc/d26/d3c/l9f 0 2024-09-21T12:47:17.397 INFO:tasks.workunit.client.0.smithi046.stdout:1/551: write d4/d13/f84 [620330,43178] 0 2024-09-21T12:47:17.397 INFO:tasks.workunit.client.0.smithi046.stdout:9/633: creat d11/d5b/d6f/fcb x:0 0 0 2024-09-21T12:47:17.400 INFO:tasks.workunit.client.0.smithi046.stdout:4/600: truncate d1/d13/f16 3695338 0 2024-09-21T12:47:17.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/586: mkdir d1/d12/d46/d35/d7d/d6a/dd1 0 2024-09-21T12:47:17.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/587: chown d1/d12/d46/d35/d7d/f42 2496428 1 2024-09-21T12:47:17.405 INFO:tasks.workunit.client.0.smithi046.stdout:5/521: link d4/d22/c56 d4/dc/d6b/ca8 0 2024-09-21T12:47:17.405 INFO:tasks.workunit.client.0.smithi046.stdout:5/522: stat d4/c9f 0 2024-09-21T12:47:17.411 INFO:tasks.workunit.client.0.smithi046.stdout:8/588: creat d1/fd2 x:0 0 0 2024-09-21T12:47:17.416 INFO:tasks.workunit.client.0.smithi046.stdout:3/459: creat d5/fa0 x:0 0 0 2024-09-21T12:47:17.416 INFO:tasks.workunit.client.0.smithi046.stdout:9/634: dread d11/d19/d1b/d31/f7d [0,4194304] 0 2024-09-21T12:47:17.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/552: creat d4/d13/d38/d53/fb3 x:0 0 0 2024-09-21T12:47:17.420 INFO:tasks.workunit.client.0.smithi046.stdout:8/589: creat d1/d12/d46/d35/d36/d51/d8c/fd3 x:0 0 0 2024-09-21T12:47:17.422 INFO:tasks.workunit.client.0.smithi046.stdout:3/460: truncate d5/f24 213651 0 2024-09-21T12:47:17.427 INFO:tasks.workunit.client.0.smithi046.stdout:8/590: creat d1/d12/d53/fd4 x:0 0 0 2024-09-21T12:47:17.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/635: link d11/f54 d11/d19/d1b/d31/d44/fcc 0 2024-09-21T12:47:17.432 INFO:tasks.workunit.client.0.smithi046.stdout:9/636: write d11/d5b/fbe [484422,108276] 0 2024-09-21T12:47:17.435 INFO:tasks.workunit.client.0.smithi046.stdout:5/523: getdents d4/d22/d10 0 2024-09-21T12:47:17.438 INFO:tasks.workunit.client.0.smithi046.stdout:3/461: mknod d5/dc/d26/d3c/d44/ca1 0 2024-09-21T12:47:17.438 INFO:tasks.workunit.client.0.smithi046.stdout:1/553: link d4/d13/l33 d4/d13/d38/lb4 0 2024-09-21T12:47:17.440 INFO:tasks.workunit.client.0.smithi046.stdout:9/637: unlink d11/d5b/d6f/db0/c4a 0 2024-09-21T12:47:17.447 INFO:tasks.workunit.client.0.smithi046.stdout:3/462: rename d5/d5e/f86 to d5/d16/d5f/fa2 0 2024-09-21T12:47:17.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/638: dwrite d11/d19/d93/d26/fa9 [0,4194304] 0 2024-09-21T12:47:17.450 INFO:tasks.workunit.client.0.smithi046.stdout:1/554: unlink d4/d13/c24 0 2024-09-21T12:47:17.452 INFO:tasks.workunit.client.0.smithi046.stdout:8/591: creat d1/d12/d46/fd5 x:0 0 0 2024-09-21T12:47:17.464 INFO:tasks.workunit.client.0.smithi046.stdout:8/592: mkdir d1/d12/d46/d35/d5b/dd6 0 2024-09-21T12:47:17.468 INFO:tasks.workunit.client.0.smithi046.stdout:4/601: truncate d1/d13/f16 3676220 0 2024-09-21T12:47:17.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/524: truncate d4/dc/d13/d5b/d2d/d3b/fa1 1106035 0 2024-09-21T12:47:17.477 INFO:tasks.workunit.client.0.smithi046.stdout:5/525: chown d4/d22/d10/d1a/l44 5180 1 2024-09-21T12:47:17.478 INFO:tasks.workunit.client.0.smithi046.stdout:1/555: write d4/d29/f41 [1268175,9579] 0 2024-09-21T12:47:17.479 INFO:tasks.workunit.client.0.smithi046.stdout:3/463: dwrite d5/dc/d28/d60/f73 [0,4194304] 0 2024-09-21T12:47:17.480 INFO:tasks.workunit.client.0.smithi046.stdout:8/593: mknod d1/d12/d53/dab/cd7 0 2024-09-21T12:47:17.482 INFO:tasks.workunit.client.0.smithi046.stdout:4/602: mkdir d1/d13/d25/d29/d33/dca 0 2024-09-21T12:47:17.483 INFO:tasks.workunit.client.0.smithi046.stdout:9/639: dwrite d11/d19/d1b/d1c/f47 [0,4194304] 0 2024-09-21T12:47:17.484 INFO:tasks.workunit.client.0.smithi046.stdout:9/640: fdatasync f4 0 2024-09-21T12:47:17.487 INFO:tasks.workunit.client.0.smithi046.stdout:5/526: chown d4/dc/d13/d5b/d2d/d43/f55 59 1 2024-09-21T12:47:17.493 INFO:tasks.workunit.client.0.smithi046.stdout:1/556: creat d4/d13/d38/d53/d80/d95/da5/fb5 x:0 0 0 2024-09-21T12:47:17.495 INFO:tasks.workunit.client.0.smithi046.stdout:1/557: write d4/d13/d38/f6f [763853,27673] 0 2024-09-21T12:47:17.496 INFO:tasks.workunit.client.0.smithi046.stdout:5/527: dread d4/d22/f73 [0,4194304] 0 2024-09-21T12:47:17.496 INFO:tasks.workunit.client.0.smithi046.stdout:8/594: mkdir d1/d12/d46/d35/d36/d51/dd8 0 2024-09-21T12:47:17.498 INFO:tasks.workunit.client.0.smithi046.stdout:5/528: write d4/dc/d13/f81 [2516988,68769] 0 2024-09-21T12:47:17.499 INFO:tasks.workunit.client.0.smithi046.stdout:4/603: symlink d1/d85/lcb 0 2024-09-21T12:47:17.499 INFO:tasks.workunit.client.0.smithi046.stdout:5/529: chown d4/dc/d6b 1 1 2024-09-21T12:47:17.500 INFO:tasks.workunit.client.0.smithi046.stdout:9/641: rmdir d11/d19 39 2024-09-21T12:47:17.501 INFO:tasks.workunit.client.0.smithi046.stdout:9/642: chown d11/d5b/d6f/db0/d30 72471 1 2024-09-21T12:47:17.501 INFO:tasks.workunit.client.0.smithi046.stdout:5/530: write d4/d22/d10/d1a/f1c [5365103,116432] 0 2024-09-21T12:47:17.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/531: write d4/dc/d13/d15/f51 [1912001,29628] 0 2024-09-21T12:47:17.505 INFO:tasks.workunit.client.0.smithi046.stdout:5/532: read d4/dc/d13/d5e/f66 [1069772,92346] 0 2024-09-21T12:47:17.505 INFO:tasks.workunit.client.0.smithi046.stdout:4/604: dread d1/f97 [0,4194304] 0 2024-09-21T12:47:17.507 INFO:tasks.workunit.client.0.smithi046.stdout:1/558: creat d4/d13/d38/d53/d80/d95/da5/fb6 x:0 0 0 2024-09-21T12:47:17.514 INFO:tasks.workunit.client.0.smithi046.stdout:4/605: rename d1/d13/d25/d3a/lc9 to d1/d13/d25/d29/d33/dca/lcc 0 2024-09-21T12:47:17.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/643: creat d11/d19/d1b/d31/d53/d84/fcd x:0 0 0 2024-09-21T12:47:17.518 INFO:tasks.workunit.client.0.smithi046.stdout:5/533: mknod d4/d22/d10/d1a/d9e/da7/ca9 0 2024-09-21T12:47:17.518 INFO:tasks.workunit.client.0.smithi046.stdout:8/595: dread d1/d12/d53/fcc [0,4194304] 0 2024-09-21T12:47:17.519 INFO:tasks.workunit.client.0.smithi046.stdout:1/559: creat d4/d13/d79/fb7 x:0 0 0 2024-09-21T12:47:17.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/534: write d4/dc/d13/d5b/d2d/d43/f55 [1051403,91911] 0 2024-09-21T12:47:17.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/560: fsync d4/d29/d32/d9e/f70 0 2024-09-21T12:47:17.521 INFO:tasks.workunit.client.0.smithi046.stdout:4/606: stat d1/f5d 0 2024-09-21T12:47:17.523 INFO:tasks.workunit.client.0.smithi046.stdout:9/644: mkdir d11/d19/d1b/d31/d53/d84/dce 0 2024-09-21T12:47:17.528 INFO:tasks.workunit.client.0.smithi046.stdout:1/561: creat d4/d13/d38/d4f/d83/fb8 x:0 0 0 2024-09-21T12:47:17.529 INFO:tasks.workunit.client.0.smithi046.stdout:4/607: mknod d1/d27/d37/d8f/d9d/ccd 0 2024-09-21T12:47:17.531 INFO:tasks.workunit.client.0.smithi046.stdout:9/645: unlink d11/d19/d1b/d31/c7a 0 2024-09-21T12:47:17.533 INFO:tasks.workunit.client.0.smithi046.stdout:5/535: dwrite d4/dc/d13/d5e/f66 [0,4194304] 0 2024-09-21T12:47:17.537 INFO:tasks.workunit.client.0.smithi046.stdout:9/646: mkdir d11/d5b/dcf 0 2024-09-21T12:47:17.540 INFO:tasks.workunit.client.0.smithi046.stdout:9/647: chown d11/d19/d36/d45/f67 376 1 2024-09-21T12:47:17.541 INFO:tasks.workunit.client.0.smithi046.stdout:4/608: unlink d1/d13/c2b 0 2024-09-21T12:47:17.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/536: dwrite d4/d22/d10/f52 [0,4194304] 0 2024-09-21T12:47:17.542 INFO:tasks.workunit.client.0.smithi046.stdout:9/648: chown d11/d19/d36/d45/lbb 429 1 2024-09-21T12:47:17.549 INFO:tasks.workunit.client.0.smithi046.stdout:9/649: dread d11/d19/d1b/d1c/f47 [0,4194304] 0 2024-09-21T12:47:17.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/596: getdents d1/d12/d46/d35/d7d/d6a 0 2024-09-21T12:47:17.549 INFO:tasks.workunit.client.0.smithi046.stdout:9/650: readlink d11/l17 0 2024-09-21T12:47:17.552 INFO:tasks.workunit.client.0.smithi046.stdout:8/597: write d1/d12/d46/d35/d36/d51/d8c/fd3 [459944,54635] 0 2024-09-21T12:47:17.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/598: read - d1/d12/d46/d35/d7d/f31 zero size 2024-09-21T12:47:17.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/599: chown d1/fa 0 1 2024-09-21T12:47:17.560 INFO:tasks.workunit.client.0.smithi046.stdout:9/651: creat d11/d19/d1b/d31/d53/d84/fd0 x:0 0 0 2024-09-21T12:47:17.561 INFO:tasks.workunit.client.0.smithi046.stdout:9/652: chown d11/d5b/d6f/db0/d30 840803 1 2024-09-21T12:47:17.564 INFO:tasks.workunit.client.0.smithi046.stdout:8/600: write d1/d12/d53/fbe [2684445,100570] 0 2024-09-21T12:47:17.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/609: getdents d1/d13/d25/d29/d43/d84 0 2024-09-21T12:47:17.570 INFO:tasks.workunit.client.0.smithi046.stdout:4/610: fsync d1/d13/d25/d29/d43/f7a 0 2024-09-21T12:47:17.571 INFO:tasks.workunit.client.0.smithi046.stdout:8/601: mknod d1/d12/d46/d35/d36/d51/d8c/cd9 0 2024-09-21T12:47:17.572 INFO:tasks.workunit.client.0.smithi046.stdout:4/611: read d1/f5d [1132380,64052] 0 2024-09-21T12:47:17.577 INFO:tasks.workunit.client.0.smithi046.stdout:4/612: rename d1/d13/d25/d29/d43/l32 to d1/d85/lce 0 2024-09-21T12:47:17.578 INFO:tasks.workunit.client.0.smithi046.stdout:8/602: dread d1/d12/d46/f37 [0,4194304] 0 2024-09-21T12:47:17.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/603: chown d1/d12/d1a/d33 30988797 1 2024-09-21T12:47:17.580 INFO:tasks.workunit.client.0.smithi046.stdout:8/604: readlink d1/d12/d1a/la4 0 2024-09-21T12:47:17.581 INFO:tasks.workunit.client.0.smithi046.stdout:4/613: unlink d1/d13/d25/f4a 0 2024-09-21T12:47:17.586 INFO:tasks.workunit.client.0.smithi046.stdout:8/605: creat d1/d12/d46/d35/d7d/d6a/dd1/fda x:0 0 0 2024-09-21T12:47:17.592 INFO:tasks.workunit.client.0.smithi046.stdout:8/606: mknod d1/d12/d46/d35/d36/dce/cdb 0 2024-09-21T12:47:17.593 INFO:tasks.workunit.client.0.smithi046.stdout:1/562: write d4/d13/d38/d53/d80/f85 [1021353,99478] 0 2024-09-21T12:47:17.593 INFO:tasks.workunit.client.0.smithi046.stdout:5/537: write d4/dc/d13/d15/f7f [1059455,119790] 0 2024-09-21T12:47:17.595 INFO:tasks.workunit.client.0.smithi046.stdout:5/538: write d4/dc/d13/f81 [1225263,19648] 0 2024-09-21T12:47:17.599 INFO:tasks.workunit.client.0.smithi046.stdout:8/607: creat d1/d12/d1a/d33/fdc x:0 0 0 2024-09-21T12:47:17.605 INFO:tasks.workunit.client.0.smithi046.stdout:1/563: dwrite d4/d13/f36 [0,4194304] 0 2024-09-21T12:47:17.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/608: write d1/d12/d46/f37 [482884,104080] 0 2024-09-21T12:47:17.608 INFO:tasks.workunit.client.0.smithi046.stdout:9/653: dwrite d11/f99 [0,4194304] 0 2024-09-21T12:47:17.611 INFO:tasks.workunit.client.0.smithi046.stdout:9/654: write d11/d5b/d6f/db0/d30/d3e/f49 [6359901,60127] 0 2024-09-21T12:47:17.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/655: fsync d11/d19/d1b/d31/d44/fa5 0 2024-09-21T12:47:17.614 INFO:tasks.workunit.client.0.smithi046.stdout:4/614: truncate d1/d27/d46/d78/f98 1085695 0 2024-09-21T12:47:17.616 INFO:tasks.workunit.client.0.smithi046.stdout:1/564: rmdir d4/d29/d32 39 2024-09-21T12:47:17.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/565: truncate d4/d13/f7d 628279 0 2024-09-21T12:47:17.621 INFO:tasks.workunit.client.0.smithi046.stdout:9/656: fdatasync d11/d19/d1b/d31/d44/f4c 0 2024-09-21T12:47:17.622 INFO:tasks.workunit.client.0.smithi046.stdout:4/615: creat d1/d27/d82/da8/fcf x:0 0 0 2024-09-21T12:47:17.623 INFO:tasks.workunit.client.0.smithi046.stdout:9/657: chown d11/d19/d1b/d1c/f2f 65987620 1 2024-09-21T12:47:17.624 INFO:tasks.workunit.client.0.smithi046.stdout:1/566: rmdir d4/d13/d38/d53/d80/d8b 39 2024-09-21T12:47:17.625 INFO:tasks.workunit.client.0.smithi046.stdout:1/567: dread - d4/d13/d38/fad zero size 2024-09-21T12:47:17.632 INFO:tasks.workunit.client.0.smithi046.stdout:5/539: dread d4/d22/d10/d1a/f59 [0,4194304] 0 2024-09-21T12:47:17.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/658: fdatasync d11/f12 0 2024-09-21T12:47:17.635 INFO:tasks.workunit.client.0.smithi046.stdout:9/659: write d11/d5b/fbe [1217226,41514] 0 2024-09-21T12:47:17.640 INFO:tasks.workunit.client.0.smithi046.stdout:4/616: write d1/d13/d25/d29/d43/f7a [9478,42233] 0 2024-09-21T12:47:17.640 INFO:tasks.workunit.client.0.smithi046.stdout:5/540: rmdir d4/dc/d45 39 2024-09-21T12:47:17.647 INFO:tasks.workunit.client.0.smithi046.stdout:5/541: rmdir d4/d22/d10/d1a 39 2024-09-21T12:47:17.648 INFO:tasks.workunit.client.0.smithi046.stdout:5/542: write d4/dc/d13/d5b/d2d/f7d [691027,57159] 0 2024-09-21T12:47:17.651 INFO:tasks.workunit.client.0.smithi046.stdout:5/543: read d4/dc/d13/d5b/d2d/f4f [412472,47176] 0 2024-09-21T12:47:17.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/560: sync 2024-09-21T12:47:17.652 INFO:tasks.workunit.client.0.smithi046.stdout:6/518: sync 2024-09-21T12:47:17.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/561: readlink d2/l8b 0 2024-09-21T12:47:17.654 INFO:tasks.workunit.client.0.smithi046.stdout:5/544: write d4/dc/fa6 [977449,128226] 0 2024-09-21T12:47:17.655 INFO:tasks.workunit.client.0.smithi046.stdout:4/617: symlink d1/d13/d25/d29/d33/ld0 0 2024-09-21T12:47:17.659 INFO:tasks.workunit.client.0.smithi046.stdout:9/660: link d11/f3c d11/d19/d36/d45/d6e/fd1 0 2024-09-21T12:47:17.660 INFO:tasks.workunit.client.0.smithi046.stdout:1/568: write d4/d29/d32/d9e/f65 [3376767,79763] 0 2024-09-21T12:47:17.662 INFO:tasks.workunit.client.0.smithi046.stdout:7/562: dwrite d2/d4/df/d6f/f76 [0,4194304] 0 2024-09-21T12:47:17.664 INFO:tasks.workunit.client.0.smithi046.stdout:6/519: rename de/d2a/d34/l4f to de/d2a/d4c/d77/d98/laa 0 2024-09-21T12:47:17.665 INFO:tasks.workunit.client.0.smithi046.stdout:7/563: write d2/dd/f2b [3995931,127380] 0 2024-09-21T12:47:17.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/661: mknod d11/d19/d1b/d4b/d91/d94/cd2 0 2024-09-21T12:47:17.668 INFO:tasks.workunit.client.0.smithi046.stdout:4/618: getdents d1/d5f 0 2024-09-21T12:47:17.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/520: stat de/d2a/d4c/d69/ca2 0 2024-09-21T12:47:17.670 INFO:tasks.workunit.client.0.smithi046.stdout:4/619: stat d1/d13/d25/d29/d43/cc3 0 2024-09-21T12:47:17.671 INFO:tasks.workunit.client.0.smithi046.stdout:7/564: fdatasync d2/d4/f9f 0 2024-09-21T12:47:17.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/662: unlink d11/d19/d1b/f3f 0 2024-09-21T12:47:17.673 INFO:tasks.workunit.client.0.smithi046.stdout:9/663: chown d11/d19/d36 0 1 2024-09-21T12:47:17.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/565: truncate d2/d4/df/d9a/fa0 785077 0 2024-09-21T12:47:17.673 INFO:tasks.workunit.client.0.smithi046.stdout:1/569: link d4/d13/d38/fa1 d4/d29/d32/d9e/d5d/fb9 0 2024-09-21T12:47:17.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/521: rmdir de/d2a/d34 39 2024-09-21T12:47:17.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/620: write d1/f74 [1414718,40647] 0 2024-09-21T12:47:17.680 INFO:tasks.workunit.client.0.smithi046.stdout:7/566: dwrite d2/d4/df/d17/f59 [0,4194304] 0 2024-09-21T12:47:17.684 INFO:tasks.workunit.client.0.smithi046.stdout:5/545: getdents d4 0 2024-09-21T12:47:17.685 INFO:tasks.workunit.client.0.smithi046.stdout:4/621: symlink d1/d27/d82/ld1 0 2024-09-21T12:47:17.688 INFO:tasks.workunit.client.0.smithi046.stdout:1/570: symlink d4/d13/d38/d53/d80/d8b/lba 0 2024-09-21T12:47:17.690 INFO:tasks.workunit.client.0.smithi046.stdout:6/522: unlink de/d2a/d34/l47 0 2024-09-21T12:47:17.692 INFO:tasks.workunit.client.0.smithi046.stdout:9/664: creat d11/d19/d1b/d31/fd3 x:0 0 0 2024-09-21T12:47:17.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/571: rmdir d4/d13 39 2024-09-21T12:47:17.698 INFO:tasks.workunit.client.0.smithi046.stdout:9/665: creat d11/d19/d1b/d31/d53/da4/fd4 x:0 0 0 2024-09-21T12:47:17.699 INFO:tasks.workunit.client.0.smithi046.stdout:4/622: creat d1/d13/d4e/fd2 x:0 0 0 2024-09-21T12:47:17.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/572: chown d4/d13/l2b 43 1 2024-09-21T12:47:17.708 INFO:tasks.workunit.client.0.smithi046.stdout:5/546: creat d4/d22/d10/faa x:0 0 0 2024-09-21T12:47:17.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/567: write d2/d37/d77/fae [287011,39151] 0 2024-09-21T12:47:17.722 INFO:tasks.workunit.client.0.smithi046.stdout:4/623: link d1/d13/d25/d29/cbc d1/d27/d46/cd3 0 2024-09-21T12:47:17.724 INFO:tasks.workunit.client.0.smithi046.stdout:1/573: creat d4/d29/d32/d9e/d5d/fbb x:0 0 0 2024-09-21T12:47:17.726 INFO:tasks.workunit.client.0.smithi046.stdout:5/547: write d4/f8 [4866507,48284] 0 2024-09-21T12:47:17.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/666: link d11/d19/f24 d11/d19/fd5 0 2024-09-21T12:47:17.728 INFO:tasks.workunit.client.0.smithi046.stdout:7/568: readlink d2/d4/d43/d58/l69 0 2024-09-21T12:47:17.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/624: dwrite d1/d13/d25/d29/f2f [0,4194304] 0 2024-09-21T12:47:17.730 INFO:tasks.workunit.client.0.smithi046.stdout:4/625: dread - d1/d13/d25/d29/d43/d84/fa6 zero size 2024-09-21T12:47:17.735 INFO:tasks.workunit.client.0.smithi046.stdout:7/569: symlink d2/d4/df/d70/d88/d34/lb7 0 2024-09-21T12:47:17.739 INFO:tasks.workunit.client.0.smithi046.stdout:4/626: unlink d1/d13/d25/d6b/f93 0 2024-09-21T12:47:17.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/667: mknod d11/d19/d36/cd6 0 2024-09-21T12:47:17.742 INFO:tasks.workunit.client.0.smithi046.stdout:9/668: chown d11/d19/d1b/d31/d53/da4 3848279 1 2024-09-21T12:47:17.744 INFO:tasks.workunit.client.0.smithi046.stdout:1/574: getdents d4/d29/d32/d9e/d5d/d8c/d92 0 2024-09-21T12:47:17.745 INFO:tasks.workunit.client.0.smithi046.stdout:5/548: getdents d4/dc/d13/d5b 0 2024-09-21T12:47:17.750 INFO:tasks.workunit.client.0.smithi046.stdout:1/575: dwrite d4/d13/f1a [0,4194304] 0 2024-09-21T12:47:17.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/669: unlink d11/d19/d1b/d31/d53/l85 0 2024-09-21T12:47:17.755 INFO:tasks.workunit.client.0.smithi046.stdout:1/576: rmdir d4/d13/d38/d48/d8a 0 2024-09-21T12:47:17.755 INFO:tasks.workunit.client.0.smithi046.stdout:9/670: truncate d11/d19/d36/d45/d6e/faf 132874 0 2024-09-21T12:47:17.757 INFO:tasks.workunit.client.0.smithi046.stdout:1/577: write d4/d13/d79/fb7 [199280,53212] 0 2024-09-21T12:47:17.759 INFO:tasks.workunit.client.0.smithi046.stdout:9/671: dread d11/d19/d36/f42 [4194304,4194304] 0 2024-09-21T12:47:17.761 INFO:tasks.workunit.client.0.smithi046.stdout:5/549: dread d4/d22/d10/d1a/f37 [0,4194304] 0 2024-09-21T12:47:17.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/578: dwrite d4/d4d/f73 [0,4194304] 0 2024-09-21T12:47:17.773 INFO:tasks.workunit.client.0.smithi046.stdout:1/579: dwrite d4/d13/d79/fb7 [0,4194304] 0 2024-09-21T12:47:17.776 INFO:tasks.workunit.client.0.smithi046.stdout:7/570: truncate d2/d4/f8c 1538702 0 2024-09-21T12:47:17.787 INFO:tasks.workunit.client.0.smithi046.stdout:7/571: getdents d2/d4/df/d6f/d92 0 2024-09-21T12:47:17.792 INFO:tasks.workunit.client.0.smithi046.stdout:9/672: write d11/d19/d1b/d31/d44/f4c [1394063,102704] 0 2024-09-21T12:47:17.793 INFO:tasks.workunit.client.0.smithi046.stdout:9/673: dread - d11/d19/d1b/d31/d44/fa3 zero size 2024-09-21T12:47:17.795 INFO:tasks.workunit.client.0.smithi046.stdout:9/674: write d11/d19/d1b/d31/d53/d84/fd0 [69390,38647] 0 2024-09-21T12:47:17.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/675: chown d11/d5b/d6f/db0/d30/d3e/c65 54 1 2024-09-21T12:47:17.798 INFO:tasks.workunit.client.0.smithi046.stdout:9/676: write d11/d19/d1b/d4b/d91/fc3 [113885,39465] 0 2024-09-21T12:47:17.800 INFO:tasks.workunit.client.0.smithi046.stdout:7/572: write d2/d4/df/d17/f3b [646035,41149] 0 2024-09-21T12:47:17.804 INFO:tasks.workunit.client.0.smithi046.stdout:7/573: creat d2/d4/df/d17/fb8 x:0 0 0 2024-09-21T12:47:17.806 INFO:tasks.workunit.client.0.smithi046.stdout:9/677: write d11/f3c [815434,48221] 0 2024-09-21T12:47:17.821 INFO:tasks.workunit.client.0.smithi046.stdout:7/574: getdents d2/d4/df/d42 0 2024-09-21T12:47:17.822 INFO:tasks.workunit.client.0.smithi046.stdout:9/678: dwrite d11/d5b/d6f/db0/d30/d3e/fae [0,4194304] 0 2024-09-21T12:47:17.831 INFO:tasks.workunit.client.0.smithi046.stdout:9/679: dread fb [0,4194304] 0 2024-09-21T12:47:17.882 INFO:tasks.workunit.client.0.smithi046.stdout:2/537: sync 2024-09-21T12:47:17.883 INFO:tasks.workunit.client.0.smithi046.stdout:2/538: mknod d16/d22/ca5 0 2024-09-21T12:47:17.886 INFO:tasks.workunit.client.0.smithi046.stdout:2/539: rename d16/d5c/d96 to d16/d22/d4e/da6 0 2024-09-21T12:47:17.888 INFO:tasks.workunit.client.0.smithi046.stdout:2/540: mknod d16/d22/d2b/d43/ca7 0 2024-09-21T12:47:17.890 INFO:tasks.workunit.client.0.smithi046.stdout:2/541: unlink d16/d22/d2b/f99 0 2024-09-21T12:47:17.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/542: write d16/d22/d38/d77/f82 [760193,57771] 0 2024-09-21T12:47:17.893 INFO:tasks.workunit.client.0.smithi046.stdout:2/543: mkdir d16/d22/d4e/da8 0 2024-09-21T12:47:17.897 INFO:tasks.workunit.client.0.smithi046.stdout:2/544: creat d16/d22/d2b/d30/d67/fa9 x:0 0 0 2024-09-21T12:47:17.986 INFO:tasks.workunit.client.0.smithi046.stdout:0/592: sync 2024-09-21T12:47:17.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/545: rmdir d16/d22/d4e 39 2024-09-21T12:47:17.996 INFO:tasks.workunit.client.0.smithi046.stdout:0/593: dread d6/d7/d13/d49/f9f [0,4194304] 0 2024-09-21T12:47:18.021 INFO:tasks.workunit.client.0.smithi046.stdout:0/594: truncate d6/d7/d13/d72/d9b/fa3 519433 0 2024-09-21T12:47:18.026 INFO:tasks.workunit.client.0.smithi046.stdout:2/546: dwrite d16/d22/d38/f8b [0,4194304] 0 2024-09-21T12:47:18.063 INFO:tasks.workunit.client.0.smithi046.stdout:0/595: write d6/d7/d13/f1d [4288311,54509] 0 2024-09-21T12:47:18.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:17 smithi176 ceph-mon[35476]: pgmap v35: 65 pgs: 65 active+clean; 3.1 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 75 MiB/s rd, 191 MiB/s wr, 408 op/s 2024-09-21T12:47:18.068 INFO:tasks.workunit.client.0.smithi046.stdout:2/547: dwrite d16/d22/d38/f35 [0,4194304] 0 2024-09-21T12:47:18.073 INFO:tasks.workunit.client.0.smithi046.stdout:0/596: dwrite d6/d2f/d32/f65 [0,4194304] 0 2024-09-21T12:47:18.078 INFO:tasks.workunit.client.0.smithi046.stdout:0/597: chown d6/d7/d9/f50 28419 1 2024-09-21T12:47:18.080 INFO:tasks.workunit.client.0.smithi046.stdout:0/598: write d6/d7/d37/d53/f7c [239067,121893] 0 2024-09-21T12:47:18.088 INFO:tasks.workunit.client.0.smithi046.stdout:0/599: dread d6/d7/d13/d43/d52/d63/d7f/f44 [0,4194304] 0 2024-09-21T12:47:18.090 INFO:tasks.workunit.client.0.smithi046.stdout:0/600: fsync d6/d7/d13/d43/d52/d63/d7f/fa7 0 2024-09-21T12:47:18.091 INFO:tasks.workunit.client.0.smithi046.stdout:0/601: chown d6/d7/d9/dc4/cdd 11 1 2024-09-21T12:47:18.092 INFO:tasks.workunit.client.0.smithi046.stdout:0/602: chown d6/d7/d13/d7b/da2/c3b 8522955 1 2024-09-21T12:47:18.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/603: dwrite d6/d2f/d32/fb2 [0,4194304] 0 2024-09-21T12:47:18.107 INFO:tasks.workunit.client.0.smithi046.stdout:0/604: dwrite d6/d7/d13/f36 [0,4194304] 0 2024-09-21T12:47:18.114 INFO:tasks.workunit.client.0.smithi046.stdout:0/605: mknod d6/d7/d13/db6/ce1 0 2024-09-21T12:47:18.120 INFO:tasks.workunit.client.0.smithi046.stdout:0/606: dread d6/d7/f9a [0,4194304] 0 2024-09-21T12:47:18.121 INFO:tasks.workunit.client.0.smithi046.stdout:0/607: creat d6/d2f/d32/fe2 x:0 0 0 2024-09-21T12:47:18.122 INFO:tasks.workunit.client.0.smithi046.stdout:0/608: unlink d6/d7/d13/d43/c73 0 2024-09-21T12:47:18.122 INFO:tasks.workunit.client.0.smithi046.stdout:0/609: readlink d6/l5d 0 2024-09-21T12:47:18.123 INFO:tasks.workunit.client.0.smithi046.stdout:0/610: fdatasync d6/f18 0 2024-09-21T12:47:18.125 INFO:tasks.workunit.client.0.smithi046.stdout:0/611: fdatasync d6/d7/d9/fb 0 2024-09-21T12:47:18.131 INFO:tasks.workunit.client.0.smithi046.stdout:0/612: dwrite d6/f40 [4194304,4194304] 0 2024-09-21T12:47:18.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/613: mknod d6/d7/d13/d43/d52/d63/ce3 0 2024-09-21T12:47:18.135 INFO:tasks.workunit.client.0.smithi046.stdout:0/614: chown d6/d7/d13/d7b/da2/l75 39899 1 2024-09-21T12:47:18.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/615: symlink d6/d7/d13/d49/le4 0 2024-09-21T12:47:18.138 INFO:tasks.workunit.client.0.smithi046.stdout:0/616: chown d6/c25 111993959 1 2024-09-21T12:47:18.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/617: chown d6/d7/d9/f57 3 1 2024-09-21T12:47:18.139 INFO:tasks.workunit.client.0.smithi046.stdout:0/618: readlink d6/d7/d13/d7b/da2/l75 0 2024-09-21T12:47:18.143 INFO:tasks.workunit.client.0.smithi046.stdout:0/619: dread d6/d60/fcb [0,4194304] 0 2024-09-21T12:47:18.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/620: mknod d6/d7/d37/d53/ce5 0 2024-09-21T12:47:18.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/621: readlink d6/d7/d13/d43/d52/l8f 0 2024-09-21T12:47:18.149 INFO:tasks.workunit.client.0.smithi046.stdout:0/622: fdatasync d6/d2f/f9e 0 2024-09-21T12:47:18.151 INFO:tasks.workunit.client.0.smithi046.stdout:0/623: read d6/d7/d13/f3d [1269653,53917] 0 2024-09-21T12:47:18.153 INFO:tasks.workunit.client.0.smithi046.stdout:0/624: creat d6/d7/d13/d43/d52/d63/d7f/d78/fe6 x:0 0 0 2024-09-21T12:47:18.158 INFO:tasks.workunit.client.0.smithi046.stdout:0/625: getdents d6/d7/d37/d53 0 2024-09-21T12:47:18.160 INFO:tasks.workunit.client.0.smithi046.stdout:0/626: dread - d6/d7/d13/d43/d52/dc0/dc3/f7e zero size 2024-09-21T12:47:18.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/464: sync 2024-09-21T12:47:18.363 INFO:tasks.workunit.client.0.smithi046.stdout:3/465: chown d5/d16/d5f/d6c/c90 291736479 1 2024-09-21T12:47:18.374 INFO:tasks.workunit.client.0.smithi046.stdout:3/466: dread f2 [0,4194304] 0 2024-09-21T12:47:18.375 INFO:tasks.workunit.client.0.smithi046.stdout:3/467: write d5/dc/d28/f7f [1581830,109892] 0 2024-09-21T12:47:18.377 INFO:tasks.workunit.client.0.smithi046.stdout:3/468: symlink d5/d5e/la3 0 2024-09-21T12:47:18.380 INFO:tasks.workunit.client.0.smithi046.stdout:3/469: mknod d5/dc/d94/ca4 0 2024-09-21T12:47:18.381 INFO:tasks.workunit.client.0.smithi046.stdout:3/470: write d5/dc/d26/f27 [4481927,125123] 0 2024-09-21T12:47:18.383 INFO:tasks.workunit.client.0.smithi046.stdout:3/471: truncate d5/d16/f65 982399 0 2024-09-21T12:47:18.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:17 smithi046 ceph-mon[27868]: pgmap v35: 65 pgs: 65 active+clean; 3.1 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 75 MiB/s rd, 191 MiB/s wr, 408 op/s 2024-09-21T12:47:18.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/472: mknod d5/dc/ca5 0 2024-09-21T12:47:18.417 INFO:tasks.workunit.client.0.smithi046.stdout:3/473: mkdir d5/dc/d94/da6 0 2024-09-21T12:47:18.419 INFO:tasks.workunit.client.0.smithi046.stdout:3/474: symlink d5/d5e/la7 0 2024-09-21T12:47:18.422 INFO:tasks.workunit.client.0.smithi046.stdout:3/475: rename d5/dc/d28/d60/c70 to d5/dc/d30/d34/ca8 0 2024-09-21T12:47:18.423 INFO:tasks.workunit.client.0.smithi046.stdout:3/476: write d5/d16/f95 [481281,124125] 0 2024-09-21T12:47:18.425 INFO:tasks.workunit.client.0.smithi046.stdout:3/477: truncate d5/d16/d5f/d6c/f6d 694292 0 2024-09-21T12:47:18.425 INFO:tasks.workunit.client.0.smithi046.stdout:3/478: fdatasync d5/f8d 0 2024-09-21T12:47:18.435 INFO:tasks.workunit.client.0.smithi046.stdout:8/609: sync 2024-09-21T12:47:18.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/523: sync 2024-09-21T12:47:18.441 INFO:tasks.workunit.client.0.smithi046.stdout:8/610: dread - d1/d12/d46/d35/f73 zero size 2024-09-21T12:47:18.443 INFO:tasks.workunit.client.0.smithi046.stdout:8/611: write d1/d12/d1a/fb7 [183359,118170] 0 2024-09-21T12:47:18.444 INFO:tasks.workunit.client.0.smithi046.stdout:6/524: creat de/d2a/d4c/d71/fab x:0 0 0 2024-09-21T12:47:18.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/479: dread d5/f85 [0,4194304] 0 2024-09-21T12:47:18.458 INFO:tasks.workunit.client.0.smithi046.stdout:3/480: dread d5/dc/d30/d34/f61 [0,4194304] 0 2024-09-21T12:47:18.459 INFO:tasks.workunit.client.0.smithi046.stdout:3/481: chown d5/dc/d30/d7c 1 1 2024-09-21T12:47:18.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/482: stat d5/dc/d30/d34/ca8 0 2024-09-21T12:47:18.468 INFO:tasks.workunit.client.0.smithi046.stdout:8/612: dwrite d1/d12/d46/d35/d5b/f6d [0,4194304] 0 2024-09-21T12:47:18.469 INFO:tasks.workunit.client.0.smithi046.stdout:6/525: dwrite de/d2a/d4c/d69/f65 [0,4194304] 0 2024-09-21T12:47:18.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/483: rename d5/dc/d28/c41 to d5/dc/d30/d34/ca9 0 2024-09-21T12:47:18.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/526: chown de/d2a/d4c/l5f 98813 1 2024-09-21T12:47:18.480 INFO:tasks.workunit.client.0.smithi046.stdout:3/484: rmdir d5/dc/d30/d9a 0 2024-09-21T12:47:18.483 INFO:tasks.workunit.client.0.smithi046.stdout:6/527: getdents de/d2a/d34 0 2024-09-21T12:47:18.488 INFO:tasks.workunit.client.0.smithi046.stdout:8/613: write d1/d12/d46/d35/f8b [1130513,68987] 0 2024-09-21T12:47:18.499 INFO:tasks.workunit.client.0.smithi046.stdout:8/614: write d1/fa [688911,25031] 0 2024-09-21T12:47:18.499 INFO:tasks.workunit.client.0.smithi046.stdout:3/485: dwrite d5/dc/f57 [0,4194304] 0 2024-09-21T12:47:18.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/615: rename d1/d12/d46/d35/d7d/fba to d1/d12/d46/d35/d5b/fdd 0 2024-09-21T12:47:18.508 INFO:tasks.workunit.client.0.smithi046.stdout:8/616: symlink d1/d12/d46/d35/d7d/lde 0 2024-09-21T12:47:18.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/486: getdents d5/d16 0 2024-09-21T12:47:18.511 INFO:tasks.workunit.client.0.smithi046.stdout:3/487: mknod d5/d16/caa 0 2024-09-21T12:47:18.511 INFO:tasks.workunit.client.0.smithi046.stdout:6/528: dread de/d2a/d4c/f67 [0,4194304] 0 2024-09-21T12:47:18.515 INFO:tasks.workunit.client.0.smithi046.stdout:3/488: rename d5/dc/d26/l2e to d5/dc/d30/d7c/lab 0 2024-09-21T12:47:18.519 INFO:tasks.workunit.client.0.smithi046.stdout:3/489: mknod d5/dc/d30/d7c/cac 0 2024-09-21T12:47:18.524 INFO:tasks.workunit.client.0.smithi046.stdout:8/617: dwrite d1/f1f [0,4194304] 0 2024-09-21T12:47:18.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/490: dwrite d5/fb [4194304,4194304] 0 2024-09-21T12:47:18.527 INFO:tasks.workunit.client.0.smithi046.stdout:3/491: stat d5/dc/d26/f37 0 2024-09-21T12:47:18.529 INFO:tasks.workunit.client.0.smithi046.stdout:8/618: mknod d1/d12/d46/d35/d79/cdf 0 2024-09-21T12:47:18.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/529: truncate de/d35/f89 1325165 0 2024-09-21T12:47:18.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/619: rename d1/d12/f3b to d1/d12/d46/d35/d5b/dd6/fe0 0 2024-09-21T12:47:18.537 INFO:tasks.workunit.client.0.smithi046.stdout:8/620: chown d1/d12/d1a/d33/d6c 14910683 1 2024-09-21T12:47:18.541 INFO:tasks.workunit.client.0.smithi046.stdout:8/621: creat d1/d12/d53/dab/fe1 x:0 0 0 2024-09-21T12:47:18.546 INFO:tasks.workunit.client.0.smithi046.stdout:8/622: link d1/d12/f72 d1/d12/d1a/d33/fe2 0 2024-09-21T12:47:18.547 INFO:tasks.workunit.client.0.smithi046.stdout:8/623: chown d1/d12/d53/d60/c88 106367 1 2024-09-21T12:47:18.549 INFO:tasks.workunit.client.0.smithi046.stdout:8/624: mknod d1/d12/d53/ce3 0 2024-09-21T12:47:18.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/492: dread d5/f20 [0,4194304] 0 2024-09-21T12:47:18.553 INFO:tasks.workunit.client.0.smithi046.stdout:3/493: read d5/dc/d26/f4c [110354,56448] 0 2024-09-21T12:47:18.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/550: sync 2024-09-21T12:47:18.554 INFO:tasks.workunit.client.0.smithi046.stdout:4/627: sync 2024-09-21T12:47:18.554 INFO:tasks.workunit.client.0.smithi046.stdout:1/580: sync 2024-09-21T12:47:18.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/625: dread d1/d12/f72 [0,4194304] 0 2024-09-21T12:47:18.557 INFO:tasks.workunit.client.0.smithi046.stdout:4/628: stat d1/f35 0 2024-09-21T12:47:18.558 INFO:tasks.workunit.client.0.smithi046.stdout:8/626: stat d1/d12/d46/d35/d36/d51/fb1 0 2024-09-21T12:47:18.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/530: dwrite de/d2a/d4c/f67 [0,4194304] 0 2024-09-21T12:47:18.559 INFO:tasks.workunit.client.0.smithi046.stdout:3/494: mkdir d5/d16/d5f/dad 0 2024-09-21T12:47:18.563 INFO:tasks.workunit.client.0.smithi046.stdout:4/629: creat d1/d13/d25/d29/d33/dca/fd4 x:0 0 0 2024-09-21T12:47:18.564 INFO:tasks.workunit.client.0.smithi046.stdout:5/551: write d4/dc/d13/d5b/d2d/d3b/f95 [910576,93250] 0 2024-09-21T12:47:18.566 INFO:tasks.workunit.client.0.smithi046.stdout:6/531: symlink de/d2a/d4c/d77/d98/lac 0 2024-09-21T12:47:18.567 INFO:tasks.workunit.client.0.smithi046.stdout:3/495: creat d5/dc/d28/d60/fae x:0 0 0 2024-09-21T12:47:18.569 INFO:tasks.workunit.client.0.smithi046.stdout:4/630: fsync d1/d27/d37/d66/fa0 0 2024-09-21T12:47:18.571 INFO:tasks.workunit.client.0.smithi046.stdout:5/552: rename d4/dc/d13/d5b/d2d/l65 to d4/dc/d13/d5b/d2d/d43/lab 0 2024-09-21T12:47:18.572 INFO:tasks.workunit.client.0.smithi046.stdout:6/532: mkdir de/d2a/d4c/d71/d7c/dad 0 2024-09-21T12:47:18.573 INFO:tasks.workunit.client.0.smithi046.stdout:3/496: creat d5/d5e/d8e/faf x:0 0 0 2024-09-21T12:47:18.575 INFO:tasks.workunit.client.0.smithi046.stdout:8/627: dread d1/d12/d46/d35/d7d/d6a/f8e [0,4194304] 0 2024-09-21T12:47:18.577 INFO:tasks.workunit.client.0.smithi046.stdout:4/631: symlink d1/d13/d25/d29/ld5 0 2024-09-21T12:47:18.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/497: fsync d5/d16/d5f/fa2 0 2024-09-21T12:47:18.579 INFO:tasks.workunit.client.0.smithi046.stdout:6/533: read de/f46 [7630380,18701] 0 2024-09-21T12:47:18.580 INFO:tasks.workunit.client.0.smithi046.stdout:4/632: read d1/d13/d25/d3a/fa1 [1883128,41024] 0 2024-09-21T12:47:18.583 INFO:tasks.workunit.client.0.smithi046.stdout:1/581: dread d4/d13/d38/f42 [0,4194304] 0 2024-09-21T12:47:18.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/582: write d4/d13/d38/d4f/fa0 [532678,22394] 0 2024-09-21T12:47:18.589 INFO:tasks.workunit.client.0.smithi046.stdout:0/627: sync 2024-09-21T12:47:18.589 INFO:tasks.workunit.client.0.smithi046.stdout:7/575: sync 2024-09-21T12:47:18.589 INFO:tasks.workunit.client.0.smithi046.stdout:9/680: sync 2024-09-21T12:47:18.589 INFO:tasks.workunit.client.0.smithi046.stdout:2/548: sync 2024-09-21T12:47:18.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/576: stat d2/d4/df/d17/f3b 0 2024-09-21T12:47:18.595 INFO:tasks.workunit.client.0.smithi046.stdout:1/583: dwrite d4/d13/d38/fad [0,4194304] 0 2024-09-21T12:47:18.598 INFO:tasks.workunit.client.0.smithi046.stdout:3/498: dwrite d5/dc/d30/d34/f8c [0,4194304] 0 2024-09-21T12:47:18.602 INFO:tasks.workunit.client.0.smithi046.stdout:0/628: unlink d6/d7/d37/c87 0 2024-09-21T12:47:18.609 INFO:tasks.workunit.client.0.smithi046.stdout:5/553: dwrite d4/d22/d10/d1a/f77 [0,4194304] 0 2024-09-21T12:47:18.611 INFO:tasks.workunit.client.0.smithi046.stdout:5/554: fdatasync d4/dc/d13/d15/f7f 0 2024-09-21T12:47:18.613 INFO:tasks.workunit.client.0.smithi046.stdout:8/628: truncate d1/d12/d53/fbe 2390143 0 2024-09-21T12:47:18.614 INFO:tasks.workunit.client.0.smithi046.stdout:0/629: symlink d6/d7/d37/d53/le7 0 2024-09-21T12:47:18.616 INFO:tasks.workunit.client.0.smithi046.stdout:6/534: getdents de/d2a/d4c/d69 0 2024-09-21T12:47:18.619 INFO:tasks.workunit.client.0.smithi046.stdout:6/535: fsync de/d2a/d4c/d77/d8f/d94/f9d 0 2024-09-21T12:47:18.619 INFO:tasks.workunit.client.0.smithi046.stdout:4/633: dwrite d1/d27/d46/d78/f98 [0,4194304] 0 2024-09-21T12:47:18.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/634: readlink d1/l1d 0 2024-09-21T12:47:18.622 INFO:tasks.workunit.client.0.smithi046.stdout:9/681: creat d11/d19/d36/fd7 x:0 0 0 2024-09-21T12:47:18.625 INFO:tasks.workunit.client.0.smithi046.stdout:5/555: symlink d4/dc/d13/d15/d90/lac 0 2024-09-21T12:47:18.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/549: dwrite d16/d22/d2b/f37 [0,4194304] 0 2024-09-21T12:47:18.631 INFO:tasks.workunit.client.0.smithi046.stdout:5/556: truncate d4/dc/d13/d15/fa0 246866 0 2024-09-21T12:47:18.633 INFO:tasks.workunit.client.0.smithi046.stdout:3/499: dwrite d5/d16/f1e [0,4194304] 0 2024-09-21T12:47:18.635 INFO:tasks.workunit.client.0.smithi046.stdout:3/500: chown d5/dc/d28/d60/d6e/f7a 6729865 1 2024-09-21T12:47:18.637 INFO:tasks.workunit.client.0.smithi046.stdout:7/577: truncate d2/f55 3757472 0 2024-09-21T12:47:18.642 INFO:tasks.workunit.client.0.smithi046.stdout:6/536: read de/d2a/d4c/d77/fa1 [2650881,21457] 0 2024-09-21T12:47:18.643 INFO:tasks.workunit.client.0.smithi046.stdout:5/557: mkdir d4/dc/d13/d5b/d2d/d43/dad 0 2024-09-21T12:47:18.651 INFO:tasks.workunit.client.0.smithi046.stdout:0/630: dwrite d6/d2f/f9e [0,4194304] 0 2024-09-21T12:47:18.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/501: creat d5/dc/d94/da6/fb0 x:0 0 0 2024-09-21T12:47:18.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/682: rename d11/d19/d1b/d31/f5a to d11/d19/fd8 0 2024-09-21T12:47:18.663 INFO:tasks.workunit.client.0.smithi046.stdout:3/502: dwrite d5/d16/d5f/fa2 [0,4194304] 0 2024-09-21T12:47:18.664 INFO:tasks.workunit.client.0.smithi046.stdout:4/635: getdents d1/d27/d37/d8f 0 2024-09-21T12:47:18.666 INFO:tasks.workunit.client.0.smithi046.stdout:8/629: dread d1/f1f [4194304,4194304] 0 2024-09-21T12:47:18.667 INFO:tasks.workunit.client.0.smithi046.stdout:6/537: rename de/d2a/d34/d4e to de/d2a/d4c/d77/dae 0 2024-09-21T12:47:18.669 INFO:tasks.workunit.client.0.smithi046.stdout:9/683: fdatasync d11/d19/d1b/d1c/f2f 0 2024-09-21T12:47:18.671 INFO:tasks.workunit.client.0.smithi046.stdout:9/684: readlink d11/d19/d93/l52 0 2024-09-21T12:47:18.671 INFO:tasks.workunit.client.0.smithi046.stdout:8/630: dread d1/d12/d46/d35/d7d/d6a/f8e [0,4194304] 0 2024-09-21T12:47:18.672 INFO:tasks.workunit.client.0.smithi046.stdout:9/685: stat d11/d19/d1b/d4b/d91/f7c 0 2024-09-21T12:47:18.673 INFO:tasks.workunit.client.0.smithi046.stdout:7/578: read d2/f55 [1778898,19060] 0 2024-09-21T12:47:18.675 INFO:tasks.workunit.client.0.smithi046.stdout:6/538: dread de/d2a/d4c/d69/f65 [0,4194304] 0 2024-09-21T12:47:18.677 INFO:tasks.workunit.client.0.smithi046.stdout:3/503: creat d5/dc/d26/d3c/fb1 x:0 0 0 2024-09-21T12:47:18.680 INFO:tasks.workunit.client.0.smithi046.stdout:4/636: rename d1/d13/d25/d29/d33/ld0 to d1/d27/d37/d8f/ld6 0 2024-09-21T12:47:18.685 INFO:tasks.workunit.client.0.smithi046.stdout:5/558: truncate d4/dc/d13/d15/f51 257835 0 2024-09-21T12:47:18.687 INFO:tasks.workunit.client.0.smithi046.stdout:9/686: creat d11/d5b/d6f/fd9 x:0 0 0 2024-09-21T12:47:18.688 INFO:tasks.workunit.client.0.smithi046.stdout:0/631: write d6/d7/d13/d43/d52/d63/d7f/fa7 [969118,41616] 0 2024-09-21T12:47:18.688 INFO:tasks.workunit.client.0.smithi046.stdout:9/687: fsync d11/d19/d36/d45/d6e/faf 0 2024-09-21T12:47:18.696 INFO:tasks.workunit.client.0.smithi046.stdout:5/559: creat d4/dc/d13/d5b/d2d/d3b/fae x:0 0 0 2024-09-21T12:47:18.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/688: dwrite d11/d19/f89 [0,4194304] 0 2024-09-21T12:47:18.710 INFO:tasks.workunit.client.0.smithi046.stdout:9/689: dread d11/d19/d36/d45/d6e/f76 [0,4194304] 0 2024-09-21T12:47:18.801 INFO:tasks.workunit.client.0.smithi046.stdout:8/631: write d1/d12/f13 [1725889,85188] 0 2024-09-21T12:47:18.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/632: dread d1/d12/d1a/fb7 [0,4194304] 0 2024-09-21T12:47:18.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/504: dwrite d5/dc/d26/f3d [0,4194304] 0 2024-09-21T12:47:18.808 INFO:tasks.workunit.client.0.smithi046.stdout:7/579: creat d2/d37/fb9 x:0 0 0 2024-09-21T12:47:18.809 INFO:tasks.workunit.client.0.smithi046.stdout:6/539: truncate de/d35/f43 777645 0 2024-09-21T12:47:18.814 INFO:tasks.workunit.client.0.smithi046.stdout:3/505: dwrite d5/dc/d26/f3d [0,4194304] 0 2024-09-21T12:47:18.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/637: getdents d1/d13/d25/d29/d43/d84 0 2024-09-21T12:47:18.823 INFO:tasks.workunit.client.0.smithi046.stdout:8/633: truncate d1/d12/d46/f7e 721943 0 2024-09-21T12:47:18.828 INFO:tasks.workunit.client.0.smithi046.stdout:4/638: creat d1/d27/d82/fd7 x:0 0 0 2024-09-21T12:47:18.830 INFO:tasks.workunit.client.0.smithi046.stdout:0/632: link d6/d7/d37/d53/f56 d6/d7/d13/d43/d52/d63/d7f/d38/fe8 0 2024-09-21T12:47:18.831 INFO:tasks.workunit.client.0.smithi046.stdout:0/633: chown d6/d7/d13/d43/d52/dc0/dc3/da4/cad 31 1 2024-09-21T12:47:18.832 INFO:tasks.workunit.client.0.smithi046.stdout:7/580: symlink d2/d4/lba 0 2024-09-21T12:47:18.834 INFO:tasks.workunit.client.0.smithi046.stdout:6/540: unlink de/f76 0 2024-09-21T12:47:18.835 INFO:tasks.workunit.client.0.smithi046.stdout:6/541: write de/d2a/d34/fa9 [646585,131028] 0 2024-09-21T12:47:18.838 INFO:tasks.workunit.client.0.smithi046.stdout:5/560: link d4/dc/d13/d15/d90/lac d4/dc/d13/d5e/laf 0 2024-09-21T12:47:18.839 INFO:tasks.workunit.client.0.smithi046.stdout:4/639: symlink d1/d27/d82/ld8 0 2024-09-21T12:47:18.841 INFO:tasks.workunit.client.0.smithi046.stdout:4/640: truncate d1/d13/d4e/fd2 813132 0 2024-09-21T12:47:18.844 INFO:tasks.workunit.client.0.smithi046.stdout:0/634: mkdir d6/d2f/de9 0 2024-09-21T12:47:18.849 INFO:tasks.workunit.client.0.smithi046.stdout:8/634: truncate d1/d12/d53/fbe 89826 0 2024-09-21T12:47:18.852 INFO:tasks.workunit.client.0.smithi046.stdout:9/690: write d11/d19/d1b/d1c/f2f [3213393,109411] 0 2024-09-21T12:47:18.854 INFO:tasks.workunit.client.0.smithi046.stdout:9/691: read d11/d5b/d6f/db0/d30/d3e/f87 [566686,78976] 0 2024-09-21T12:47:18.854 INFO:tasks.workunit.client.0.smithi046.stdout:5/561: creat d4/d22/d10/d1a/fb0 x:0 0 0 2024-09-21T12:47:18.857 INFO:tasks.workunit.client.0.smithi046.stdout:0/635: fsync d6/d7/d13/d43/d52/d63/f96 0 2024-09-21T12:47:18.861 INFO:tasks.workunit.client.0.smithi046.stdout:6/542: dread de/d2a/f33 [0,4194304] 0 2024-09-21T12:47:18.866 INFO:tasks.workunit.client.0.smithi046.stdout:9/692: dwrite d11/d5b/d6f/db0/d30/d3e/f87 [0,4194304] 0 2024-09-21T12:47:18.868 INFO:tasks.workunit.client.0.smithi046.stdout:0/636: creat d6/d7/d13/d43/fea x:0 0 0 2024-09-21T12:47:18.872 INFO:tasks.workunit.client.0.smithi046.stdout:5/562: creat d4/d22/d10/d1a/d9e/d9a/fb1 x:0 0 0 2024-09-21T12:47:18.873 INFO:tasks.workunit.client.0.smithi046.stdout:9/693: dwrite d11/d5b/d6f/db0/d30/d90/fb9 [0,4194304] 0 2024-09-21T12:47:18.873 INFO:tasks.workunit.client.0.smithi046.stdout:6/543: mkdir de/d2a/d34/daf 0 2024-09-21T12:47:18.876 INFO:tasks.workunit.client.0.smithi046.stdout:6/544: stat de/d2a/d4c/d77/dae/d55/l7b 0 2024-09-21T12:47:18.881 INFO:tasks.workunit.client.0.smithi046.stdout:0/637: creat d6/d7/d13/d43/d52/dc0/dc3/feb x:0 0 0 2024-09-21T12:47:18.883 INFO:tasks.workunit.client.0.smithi046.stdout:5/563: creat d4/d22/d10/d1a/fb2 x:0 0 0 2024-09-21T12:47:18.884 INFO:tasks.workunit.client.0.smithi046.stdout:9/694: chown d11/d19/d1b/d31/d53/d58/c5c 8043 1 2024-09-21T12:47:18.884 INFO:tasks.workunit.client.0.smithi046.stdout:0/638: write d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf [19874,99216] 0 2024-09-21T12:47:18.886 INFO:tasks.workunit.client.0.smithi046.stdout:6/545: creat de/d2a/d4c/d77/fb0 x:0 0 0 2024-09-21T12:47:18.887 INFO:tasks.workunit.client.0.smithi046.stdout:8/635: getdents d1/d12/d46/d35/d79 0 2024-09-21T12:47:18.889 INFO:tasks.workunit.client.0.smithi046.stdout:5/564: mknod d4/d22/d10/d1a/d9e/d9a/cb3 0 2024-09-21T12:47:18.893 INFO:tasks.workunit.client.0.smithi046.stdout:9/695: rename d11/d19/d93/d26 to d11/d5b/d6f/dda 0 2024-09-21T12:47:18.894 INFO:tasks.workunit.client.0.smithi046.stdout:6/546: creat de/d35/fb1 x:0 0 0 2024-09-21T12:47:18.896 INFO:tasks.workunit.client.0.smithi046.stdout:8/636: mknod d1/d12/d46/d35/d79/ce4 0 2024-09-21T12:47:18.896 INFO:tasks.workunit.client.0.smithi046.stdout:5/565: dwrite d4/d22/d10/d1a/f77 [0,4194304] 0 2024-09-21T12:47:18.897 INFO:tasks.workunit.client.0.smithi046.stdout:5/566: fdatasync d4/d22/d10/faa 0 2024-09-21T12:47:18.898 INFO:tasks.workunit.client.0.smithi046.stdout:0/639: mknod d6/d2f/de9/cec 0 2024-09-21T12:47:18.900 INFO:tasks.workunit.client.0.smithi046.stdout:5/567: read d4/dc/d13/d15/f7f [2212728,88085] 0 2024-09-21T12:47:18.902 INFO:tasks.workunit.client.0.smithi046.stdout:9/696: mknod d11/d5b/d6f/db0/d30/d90/cdb 0 2024-09-21T12:47:18.904 INFO:tasks.workunit.client.0.smithi046.stdout:6/547: mkdir de/d35/db2 0 2024-09-21T12:47:18.907 INFO:tasks.workunit.client.0.smithi046.stdout:0/640: rename d6/d7/d13/d7b/da2/c3b to d6/d7/d13/d43/d52/dc0/dc3/ced 0 2024-09-21T12:47:18.910 INFO:tasks.workunit.client.0.smithi046.stdout:5/568: rmdir d4/dc/d13/d15/d5c 39 2024-09-21T12:47:18.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/637: getdents d1/d12/d46/d35/d36/d51/dd8 0 2024-09-21T12:47:18.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/548: symlink de/d2a/d4c/d77/d8f/lb3 0 2024-09-21T12:47:18.919 INFO:tasks.workunit.client.0.smithi046.stdout:0/641: creat d6/d7/d13/fee x:0 0 0 2024-09-21T12:47:18.920 INFO:tasks.workunit.client.0.smithi046.stdout:7/581: dwrite d2/d4/df/d17/f56 [0,4194304] 0 2024-09-21T12:47:18.922 INFO:tasks.workunit.client.0.smithi046.stdout:9/697: symlink d11/d5b/dcf/ldc 0 2024-09-21T12:47:18.922 INFO:tasks.workunit.client.0.smithi046.stdout:5/569: fsync d4/dc/d13/f35 0 2024-09-21T12:47:18.924 INFO:tasks.workunit.client.0.smithi046.stdout:5/570: dread - d4/dc/d13/d15/f92 zero size 2024-09-21T12:47:18.925 INFO:tasks.workunit.client.0.smithi046.stdout:9/698: dread - d11/d19/d1b/d31/d53/da4/fd4 zero size 2024-09-21T12:47:18.925 INFO:tasks.workunit.client.0.smithi046.stdout:9/699: fdatasync d11/d19/d1b/d31/d44/f4c 0 2024-09-21T12:47:18.928 INFO:tasks.workunit.client.0.smithi046.stdout:8/638: mknod d1/d12/d46/d35/d5b/ce5 0 2024-09-21T12:47:18.929 INFO:tasks.workunit.client.0.smithi046.stdout:8/639: readlink d1/d12/d53/l54 0 2024-09-21T12:47:18.930 INFO:tasks.workunit.client.0.smithi046.stdout:6/549: chown de/d35/c36 1819074 1 2024-09-21T12:47:18.934 INFO:tasks.workunit.client.0.smithi046.stdout:9/700: dwrite d11/d19/d1b/d31/d44/fa5 [0,4194304] 0 2024-09-21T12:47:18.934 INFO:tasks.workunit.client.0.smithi046.stdout:8/640: dread d1/d12/d46/f37 [0,4194304] 0 2024-09-21T12:47:18.936 INFO:tasks.workunit.client.0.smithi046.stdout:8/641: chown d1/d12/d46/d35/d36/d51/d8c 101 1 2024-09-21T12:47:18.948 INFO:tasks.workunit.client.0.smithi046.stdout:9/701: creat d11/d19/d1b/fdd x:0 0 0 2024-09-21T12:47:18.949 INFO:tasks.workunit.client.0.smithi046.stdout:8/642: mknod d1/d12/d53/d80/da1/ce6 0 2024-09-21T12:47:18.953 INFO:tasks.workunit.client.0.smithi046.stdout:6/550: truncate de/f4b 364563 0 2024-09-21T12:47:18.957 INFO:tasks.workunit.client.0.smithi046.stdout:8/643: chown d1/d12/d46/d35/d36/dc6 31387 1 2024-09-21T12:47:18.957 INFO:tasks.workunit.client.0.smithi046.stdout:7/582: dwrite d2/d4/f9c [0,4194304] 0 2024-09-21T12:47:18.958 INFO:tasks.workunit.client.0.smithi046.stdout:7/583: dread - d2/d37/f82 zero size 2024-09-21T12:47:18.959 INFO:tasks.workunit.client.0.smithi046.stdout:5/571: unlink d4/dc/d13/d15/d5c/c8f 0 2024-09-21T12:47:18.960 INFO:tasks.workunit.client.0.smithi046.stdout:5/572: chown d4/d22/f73 0 1 2024-09-21T12:47:18.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/573: fdatasync d4/fa 0 2024-09-21T12:47:18.961 INFO:tasks.workunit.client.0.smithi046.stdout:6/551: fsync de/d2a/d4c/d69/f65 0 2024-09-21T12:47:18.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/702: dread d11/d19/d36/d45/d6e/fd1 [0,4194304] 0 2024-09-21T12:47:18.963 INFO:tasks.workunit.client.0.smithi046.stdout:8/644: mkdir d1/d12/d46/d35/d7d/d6a/dd1/de7 0 2024-09-21T12:47:18.965 INFO:tasks.workunit.client.0.smithi046.stdout:7/584: mknod d2/d4/d97/cbb 0 2024-09-21T12:47:18.965 INFO:tasks.workunit.client.0.smithi046.stdout:7/585: stat d2/d4/d43/d58 0 2024-09-21T12:47:18.966 INFO:tasks.workunit.client.0.smithi046.stdout:9/703: truncate d11/d5b/d6f/db0/d30/d90/fb9 5177919 0 2024-09-21T12:47:18.968 INFO:tasks.workunit.client.0.smithi046.stdout:9/704: read f4 [6045422,63972] 0 2024-09-21T12:47:18.970 INFO:tasks.workunit.client.0.smithi046.stdout:6/552: creat de/d2a/d4c/d77/fb4 x:0 0 0 2024-09-21T12:47:18.971 INFO:tasks.workunit.client.0.smithi046.stdout:8/645: rmdir d1/d12/d46/d35/d36/dc6 39 2024-09-21T12:47:18.972 INFO:tasks.workunit.client.0.smithi046.stdout:7/586: mknod d2/d4/d97/cbc 0 2024-09-21T12:47:18.977 INFO:tasks.workunit.client.0.smithi046.stdout:6/553: creat de/d35/fb5 x:0 0 0 2024-09-21T12:47:18.978 INFO:tasks.workunit.client.0.smithi046.stdout:8/646: mknod d1/d12/d46/d35/d36/dce/ce8 0 2024-09-21T12:47:18.980 INFO:tasks.workunit.client.0.smithi046.stdout:7/587: mkdir d2/d4/df/d42/dbd 0 2024-09-21T12:47:18.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/574: link d4/f8 d4/d22/d10/fb4 0 2024-09-21T12:47:18.987 INFO:tasks.workunit.client.0.smithi046.stdout:6/554: rmdir de/d2a/d4c/d77/d98 39 2024-09-21T12:47:18.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/575: symlink d4/dc/d13/d5b/d2d/d43/d7a/lb5 0 2024-09-21T12:47:18.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/642: dread d6/d7/d13/d43/d52/d63/d7f/f5f [4194304,4194304] 0 2024-09-21T12:47:18.993 INFO:tasks.workunit.client.0.smithi046.stdout:9/705: creat d11/d19/fde x:0 0 0 2024-09-21T12:47:18.994 INFO:tasks.workunit.client.0.smithi046.stdout:6/555: rename de/d2a/d34/daf to de/d2a/d34/db6 0 2024-09-21T12:47:18.995 INFO:tasks.workunit.client.0.smithi046.stdout:7/588: fdatasync d2/d4/f54 0 2024-09-21T12:47:18.995 INFO:tasks.workunit.client.0.smithi046.stdout:8/647: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T12:47:18.998 INFO:tasks.workunit.client.0.smithi046.stdout:8/648: chown d1/d12/d46/d35/d36/d51/d8c/fa3 147 1 2024-09-21T12:47:19.006 INFO:tasks.workunit.client.0.smithi046.stdout:0/643: dread d6/d7/d13/d43/d52/d63/d7f/d38/fe8 [0,4194304] 0 2024-09-21T12:47:19.013 INFO:tasks.workunit.client.0.smithi046.stdout:9/706: mkdir d11/d5b/d6f/db0/ddf 0 2024-09-21T12:47:19.014 INFO:tasks.workunit.client.0.smithi046.stdout:8/649: rename d1/d12/d46/d35/d36/d86/fbf to d1/d12/d46/d35/d7d/d6a/dd1/fe9 0 2024-09-21T12:47:19.017 INFO:tasks.workunit.client.0.smithi046.stdout:6/556: write de/d2a/d4d/f7d [3995062,121567] 0 2024-09-21T12:47:19.019 INFO:tasks.workunit.client.0.smithi046.stdout:7/589: unlink d2/dd/c2e 0 2024-09-21T12:47:19.026 INFO:tasks.workunit.client.0.smithi046.stdout:0/644: mknod d6/d7/d13/d49/cef 0 2024-09-21T12:47:19.027 INFO:tasks.workunit.client.0.smithi046.stdout:7/590: chown d2/l50 75567 1 2024-09-21T12:47:19.028 INFO:tasks.workunit.client.0.smithi046.stdout:5/576: dwrite d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:19.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/577: chown d4/dc/d13/d15/f92 5 1 2024-09-21T12:47:19.048 INFO:tasks.workunit.client.0.smithi046.stdout:6/557: symlink de/d2a/d4c/da6/lb7 0 2024-09-21T12:47:19.048 INFO:tasks.workunit.client.0.smithi046.stdout:9/707: rmdir d11/d5b/d6f/db0/ddf 0 2024-09-21T12:47:19.051 INFO:tasks.workunit.client.0.smithi046.stdout:5/578: chown d4/dc/d13/d5b/d2d/d3b/fa1 370 1 2024-09-21T12:47:19.053 INFO:tasks.workunit.client.0.smithi046.stdout:6/558: mknod de/d2a/d4c/d77/dae/d55/cb8 0 2024-09-21T12:47:19.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/591: fsync d2/d4/f2f 0 2024-09-21T12:47:19.056 INFO:tasks.workunit.client.0.smithi046.stdout:5/579: stat d4/dc/d13/d15/f51 0 2024-09-21T12:47:19.058 INFO:tasks.workunit.client.0.smithi046.stdout:8/650: getdents d1 0 2024-09-21T12:47:19.059 INFO:tasks.workunit.client.0.smithi046.stdout:6/559: fdatasync de/d2a/d4d/f60 0 2024-09-21T12:47:19.061 INFO:tasks.workunit.client.0.smithi046.stdout:0/645: rename d6/d7/d13/cbc to d6/d7/d13/d72/d9b/cf0 0 2024-09-21T12:47:19.062 INFO:tasks.workunit.client.0.smithi046.stdout:8/651: dread d1/d12/f18 [0,4194304] 0 2024-09-21T12:47:19.064 INFO:tasks.workunit.client.0.smithi046.stdout:7/592: unlink d2/d4/df/d17/f59 0 2024-09-21T12:47:19.069 INFO:tasks.workunit.client.0.smithi046.stdout:6/560: creat de/d2a/d4c/d69/fb9 x:0 0 0 2024-09-21T12:47:19.071 INFO:tasks.workunit.client.0.smithi046.stdout:8/652: creat d1/d12/d46/d35/d7d/fea x:0 0 0 2024-09-21T12:47:19.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/561: chown de/f2c 56614 1 2024-09-21T12:47:19.075 INFO:tasks.workunit.client.0.smithi046.stdout:6/562: chown de/d35/l5b 12904641 1 2024-09-21T12:47:19.076 INFO:tasks.workunit.client.0.smithi046.stdout:5/580: rename d4/dc/d13/d15/l75 to d4/dc/d13/da2/lb6 0 2024-09-21T12:47:19.079 INFO:tasks.workunit.client.0.smithi046.stdout:7/593: mkdir d2/d37/d8a/d99/dbe 0 2024-09-21T12:47:19.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/594: fsync d2/d37/f82 0 2024-09-21T12:47:19.083 INFO:tasks.workunit.client.0.smithi046.stdout:8/653: dwrite d1/d12/d1a/f1b [0,4194304] 0 2024-09-21T12:47:19.090 INFO:tasks.workunit.client.0.smithi046.stdout:5/581: dread d4/dc/d13/d15/d90/f36 [4194304,4194304] 0 2024-09-21T12:47:19.092 INFO:tasks.workunit.client.0.smithi046.stdout:8/654: symlink d1/d12/d1a/d33/d6c/leb 0 2024-09-21T12:47:19.093 INFO:tasks.workunit.client.0.smithi046.stdout:7/595: dwrite d2/d4/f89 [0,4194304] 0 2024-09-21T12:47:19.094 INFO:tasks.workunit.client.0.smithi046.stdout:0/646: mkdir d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1 0 2024-09-21T12:47:19.096 INFO:tasks.workunit.client.0.smithi046.stdout:7/596: chown d2/d4/df/d6f/fb3 81 1 2024-09-21T12:47:19.100 INFO:tasks.workunit.client.0.smithi046.stdout:5/582: symlink d4/dc/d13/d5b/d2d/lb7 0 2024-09-21T12:47:19.101 INFO:tasks.workunit.client.0.smithi046.stdout:5/583: chown d4/dc/d13/d15/f7f 0 1 2024-09-21T12:47:19.102 INFO:tasks.workunit.client.0.smithi046.stdout:0/647: symlink d6/d7/d13/d43/d52/d63/d7f/d38/da6/lf2 0 2024-09-21T12:47:19.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/563: write fb [4984354,41961] 0 2024-09-21T12:47:19.103 INFO:tasks.workunit.client.0.smithi046.stdout:7/597: symlink d2/d4/d97/lbf 0 2024-09-21T12:47:19.104 INFO:tasks.workunit.client.0.smithi046.stdout:6/564: stat de/d2a/d4c/d77/f8c 0 2024-09-21T12:47:19.109 INFO:tasks.workunit.client.0.smithi046.stdout:7/598: creat d2/d37/d8a/d99/fc0 x:0 0 0 2024-09-21T12:47:19.110 INFO:tasks.workunit.client.0.smithi046.stdout:6/565: chown de/f15 0 1 2024-09-21T12:47:19.111 INFO:tasks.workunit.client.0.smithi046.stdout:5/584: mknod d4/dc/d13/cb8 0 2024-09-21T12:47:19.112 INFO:tasks.workunit.client.0.smithi046.stdout:8/655: dwrite d1/d12/d1a/d33/fa5 [0,4194304] 0 2024-09-21T12:47:19.113 INFO:tasks.workunit.client.0.smithi046.stdout:0/648: mkdir d6/d7/df3 0 2024-09-21T12:47:19.118 INFO:tasks.workunit.client.0.smithi046.stdout:7/599: creat d2/d4/df/d17/fc1 x:0 0 0 2024-09-21T12:47:19.121 INFO:tasks.workunit.client.0.smithi046.stdout:8/656: dwrite d1/d12/d46/d35/f8b [0,4194304] 0 2024-09-21T12:47:19.123 INFO:tasks.workunit.client.0.smithi046.stdout:6/566: creat de/d48/fba x:0 0 0 2024-09-21T12:47:19.125 INFO:tasks.workunit.client.0.smithi046.stdout:6/567: chown de/d2a/d4c/d77/dae/d55/f95 1507145 1 2024-09-21T12:47:19.127 INFO:tasks.workunit.client.0.smithi046.stdout:8/657: rmdir d1/d12/d46 39 2024-09-21T12:47:19.135 INFO:tasks.workunit.client.0.smithi046.stdout:5/585: write d4/dc/d13/d5b/d2d/f4f [4425469,18547] 0 2024-09-21T12:47:19.136 INFO:tasks.workunit.client.0.smithi046.stdout:8/658: creat d1/d12/d46/d35/d79/fec x:0 0 0 2024-09-21T12:47:19.137 INFO:tasks.workunit.client.0.smithi046.stdout:0/649: write d6/f18 [1212692,73161] 0 2024-09-21T12:47:19.139 INFO:tasks.workunit.client.0.smithi046.stdout:6/568: creat de/d2a/fbb x:0 0 0 2024-09-21T12:47:19.142 INFO:tasks.workunit.client.0.smithi046.stdout:5/586: dread d4/d22/d10/fb4 [4194304,4194304] 0 2024-09-21T12:47:19.144 INFO:tasks.workunit.client.0.smithi046.stdout:0/650: creat d6/d7/d9/dca/ff4 x:0 0 0 2024-09-21T12:47:19.145 INFO:tasks.workunit.client.0.smithi046.stdout:7/600: dwrite d2/d4/d43/f6e [0,4194304] 0 2024-09-21T12:47:19.146 INFO:tasks.workunit.client.0.smithi046.stdout:0/651: read d6/d7/f5b [2408219,78902] 0 2024-09-21T12:47:19.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/652: chown d6/d7/d13/d43/d52/d63/d7f 1 1 2024-09-21T12:47:19.150 INFO:tasks.workunit.client.0.smithi046.stdout:8/659: write d1/fd [2533546,126264] 0 2024-09-21T12:47:19.151 INFO:tasks.workunit.client.0.smithi046.stdout:8/660: chown d1/d12/d46/fd5 1572 1 2024-09-21T12:47:19.152 INFO:tasks.workunit.client.0.smithi046.stdout:7/601: symlink d2/d4/df/d70/d88/d34/d7f/lc2 0 2024-09-21T12:47:19.153 INFO:tasks.workunit.client.0.smithi046.stdout:7/602: dread - d2/d4/df/d6f/d92/f9d zero size 2024-09-21T12:47:19.155 INFO:tasks.workunit.client.0.smithi046.stdout:6/569: write de/d2a/d4d/f60 [645529,31383] 0 2024-09-21T12:47:19.156 INFO:tasks.workunit.client.0.smithi046.stdout:6/570: chown de/d2a/d34/l38 15756 1 2024-09-21T12:47:19.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/661: fsync d1/d12/d46/d35/d7d/d6a/dd1/fe9 0 2024-09-21T12:47:19.158 INFO:tasks.workunit.client.0.smithi046.stdout:7/603: mkdir d2/d4/df/d9a/dc3 0 2024-09-21T12:47:19.161 INFO:tasks.workunit.client.0.smithi046.stdout:6/571: creat de/d2a/d4c/d69/fbc x:0 0 0 2024-09-21T12:47:19.167 INFO:tasks.workunit.client.0.smithi046.stdout:0/653: getdents d6/d7 0 2024-09-21T12:47:19.168 INFO:tasks.workunit.client.0.smithi046.stdout:7/604: mkdir d2/d4/df/d9a/dc3/dc4 0 2024-09-21T12:47:19.169 INFO:tasks.workunit.client.0.smithi046.stdout:7/605: write d2/dd/f3d [6881524,20748] 0 2024-09-21T12:47:19.170 INFO:tasks.workunit.client.0.smithi046.stdout:7/606: chown d2/d4/df/d17/f3b 1561 1 2024-09-21T12:47:19.171 INFO:tasks.workunit.client.0.smithi046.stdout:0/654: truncate d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf 803481 0 2024-09-21T12:47:19.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/572: creat de/d2a/d4c/d71/d7c/dad/fbd x:0 0 0 2024-09-21T12:47:19.176 INFO:tasks.workunit.client.0.smithi046.stdout:6/573: dread - de/d2a/d4c/f58 zero size 2024-09-21T12:47:19.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/607: mkdir d2/d4/df/d70/db2/dc5 0 2024-09-21T12:47:19.178 INFO:tasks.workunit.client.0.smithi046.stdout:0/655: fsync d6/d7/d13/d7b/da2/f5a 0 2024-09-21T12:47:19.178 INFO:tasks.workunit.client.0.smithi046.stdout:8/662: dwrite d1/d12/d1a/f2c [0,4194304] 0 2024-09-21T12:47:19.179 INFO:tasks.workunit.client.0.smithi046.stdout:7/608: fsync d2/d4/df/d70/d88/d34/d7f/fb5 0 2024-09-21T12:47:19.179 INFO:tasks.workunit.client.0.smithi046.stdout:6/574: stat de/f6c 0 2024-09-21T12:47:19.180 INFO:tasks.workunit.client.0.smithi046.stdout:7/609: stat d2/dd/c53 0 2024-09-21T12:47:19.181 INFO:tasks.workunit.client.0.smithi046.stdout:7/610: fdatasync d2/fa4 0 2024-09-21T12:47:19.183 INFO:tasks.workunit.client.0.smithi046.stdout:0/656: symlink d6/d7/d9/d54/db1/lf5 0 2024-09-21T12:47:19.184 INFO:tasks.workunit.client.0.smithi046.stdout:6/575: dread - de/d2a/d4d/f79 zero size 2024-09-21T12:47:19.185 INFO:tasks.workunit.client.0.smithi046.stdout:8/663: dread d1/d12/d1a/d33/fa5 [0,4194304] 0 2024-09-21T12:47:19.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/657: unlink d6/d7/d13/d43/d52/l8f 0 2024-09-21T12:47:19.193 INFO:tasks.workunit.client.0.smithi046.stdout:8/664: mknod d1/d12/d46/d35/d7d/d6a/ced 0 2024-09-21T12:47:19.195 INFO:tasks.workunit.client.0.smithi046.stdout:6/576: symlink de/d35/db2/lbe 0 2024-09-21T12:47:19.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/577: chown de/d2a/d4c/d69/f64 80033823 1 2024-09-21T12:47:19.196 INFO:tasks.workunit.client.0.smithi046.stdout:6/578: dread - de/d48/fba zero size 2024-09-21T12:47:19.198 INFO:tasks.workunit.client.0.smithi046.stdout:7/611: write d2/d4/df/d42/f87 [705330,95079] 0 2024-09-21T12:47:19.205 INFO:tasks.workunit.client.0.smithi046.stdout:7/612: dwrite d2/d4/df/f10 [0,4194304] 0 2024-09-21T12:47:19.206 INFO:tasks.workunit.client.0.smithi046.stdout:0/658: truncate d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf 65061 0 2024-09-21T12:47:19.207 INFO:tasks.workunit.client.0.smithi046.stdout:1/584: sync 2024-09-21T12:47:19.208 INFO:tasks.workunit.client.0.smithi046.stdout:8/665: getdents d1/d12/d46/d35 0 2024-09-21T12:47:19.210 INFO:tasks.workunit.client.0.smithi046.stdout:8/666: chown d1/d12/d46/d35/d7d/d6a/dd1/de7 5538 1 2024-09-21T12:47:19.211 INFO:tasks.workunit.client.0.smithi046.stdout:0/659: creat d6/d7/d37/ff6 x:0 0 0 2024-09-21T12:47:19.214 INFO:tasks.workunit.client.0.smithi046.stdout:6/579: dwrite de/d2a/d4c/f54 [0,4194304] 0 2024-09-21T12:47:19.215 INFO:tasks.workunit.client.0.smithi046.stdout:7/613: rename d2/d4/cc to d2/d4/df/d70/cc6 0 2024-09-21T12:47:19.218 INFO:tasks.workunit.client.0.smithi046.stdout:1/585: fdatasync d4/d4d/f57 0 2024-09-21T12:47:19.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/586: stat d4/d13/f6e 0 2024-09-21T12:47:19.219 INFO:tasks.workunit.client.0.smithi046.stdout:7/614: chown d2/d4/df/d17/l1e 83816 1 2024-09-21T12:47:19.219 INFO:tasks.workunit.client.0.smithi046.stdout:0/660: fsync d6/d60/fcb 0 2024-09-21T12:47:19.221 INFO:tasks.workunit.client.0.smithi046.stdout:8/667: mkdir d1/d12/d46/d35/d36/d51/d8c/dee 0 2024-09-21T12:47:19.224 INFO:tasks.workunit.client.0.smithi046.stdout:1/587: write d4/d29/d32/d9e/f99 [1589846,88] 0 2024-09-21T12:47:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:7/615: fdatasync d2/d4/df/d17/f63 0 2024-09-21T12:47:19.226 INFO:tasks.workunit.client.0.smithi046.stdout:0/661: creat d6/dac/ff7 x:0 0 0 2024-09-21T12:47:19.227 INFO:tasks.workunit.client.0.smithi046.stdout:7/616: stat d2/l8b 0 2024-09-21T12:47:19.228 INFO:tasks.workunit.client.0.smithi046.stdout:6/580: dwrite de/d2a/d4c/d71/d7c/f87 [0,4194304] 0 2024-09-21T12:47:19.231 INFO:tasks.workunit.client.0.smithi046.stdout:7/617: write d2/d4/df/d17/f56 [756723,82020] 0 2024-09-21T12:47:19.237 INFO:tasks.workunit.client.0.smithi046.stdout:1/588: rename d4/d13/d38/d4f/f69 to d4/d29/d32/d9e/d5d/d8c/d94/fbc 0 2024-09-21T12:47:19.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/589: dread - d4/d13/d38/fa1 zero size 2024-09-21T12:47:19.242 INFO:tasks.workunit.client.0.smithi046.stdout:7/618: rename d2/dd/f3f to d2/d4/df/d42/fc7 0 2024-09-21T12:47:19.250 INFO:tasks.workunit.client.0.smithi046.stdout:8/668: getdents d1/d12/d46/d35/d36/d86 0 2024-09-21T12:47:19.254 INFO:tasks.workunit.client.0.smithi046.stdout:0/662: dwrite d6/d7/d9/d54/f9d [0,4194304] 0 2024-09-21T12:47:19.254 INFO:tasks.workunit.client.0.smithi046.stdout:7/619: symlink d2/d4/df/d9a/dc3/dc4/lc8 0 2024-09-21T12:47:19.260 INFO:tasks.workunit.client.0.smithi046.stdout:7/620: mknod d2/d4/df/d6f/d92/cc9 0 2024-09-21T12:47:19.261 INFO:tasks.workunit.client.0.smithi046.stdout:8/669: dwrite d1/d12/fae [0,4194304] 0 2024-09-21T12:47:19.263 INFO:tasks.workunit.client.0.smithi046.stdout:6/581: dread de/f15 [0,4194304] 0 2024-09-21T12:47:19.263 INFO:tasks.workunit.client.0.smithi046.stdout:7/621: dread - d2/d4/df/d17/f7c zero size 2024-09-21T12:47:19.264 INFO:tasks.workunit.client.0.smithi046.stdout:8/670: dread - d1/d12/d53/fd4 zero size 2024-09-21T12:47:19.265 INFO:tasks.workunit.client.0.smithi046.stdout:6/582: dread - de/f20 zero size 2024-09-21T12:47:19.266 INFO:tasks.workunit.client.0.smithi046.stdout:8/671: fdatasync d1/d12/d46/d35/d36/d51/d8c/fd3 0 2024-09-21T12:47:19.268 INFO:tasks.workunit.client.0.smithi046.stdout:0/663: dread d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf [0,4194304] 0 2024-09-21T12:47:19.269 INFO:tasks.workunit.client.0.smithi046.stdout:7/622: mkdir d2/d4/df/d42/dca 0 2024-09-21T12:47:19.270 INFO:tasks.workunit.client.0.smithi046.stdout:0/664: dread - d6/d7/d13/d43/d52/d63/f96 zero size 2024-09-21T12:47:19.271 INFO:tasks.workunit.client.0.smithi046.stdout:1/590: dread d4/d13/d38/faf [0,4194304] 0 2024-09-21T12:47:19.274 INFO:tasks.workunit.client.0.smithi046.stdout:1/591: truncate d4/d13/d38/d53/fa2 1937016 0 2024-09-21T12:47:19.275 INFO:tasks.workunit.client.0.smithi046.stdout:1/592: write d4/d29/d32/d9e/d5d/d8c/d92/fb1 [288305,77917] 0 2024-09-21T12:47:19.276 INFO:tasks.workunit.client.0.smithi046.stdout:1/593: write d4/d29/d32/d9e/f7c [710290,13746] 0 2024-09-21T12:47:19.277 INFO:tasks.workunit.client.0.smithi046.stdout:6/583: creat de/d2a/d4c/fbf x:0 0 0 2024-09-21T12:47:19.278 INFO:tasks.workunit.client.0.smithi046.stdout:8/672: mkdir d1/d12/d53/d80/da1/def 0 2024-09-21T12:47:19.284 INFO:tasks.workunit.client.0.smithi046.stdout:7/623: creat d2/d37/d8a/fcb x:0 0 0 2024-09-21T12:47:19.285 INFO:tasks.workunit.client.0.smithi046.stdout:7/624: truncate d2/d4/fac 356046 0 2024-09-21T12:47:19.285 INFO:tasks.workunit.client.0.smithi046.stdout:0/665: symlink d6/d60/lf8 0 2024-09-21T12:47:19.287 INFO:tasks.workunit.client.0.smithi046.stdout:0/666: read d6/d7/d13/d7b/da2/f26 [929143,114058] 0 2024-09-21T12:47:19.288 INFO:tasks.workunit.client.0.smithi046.stdout:6/584: fdatasync de/f2c 0 2024-09-21T12:47:19.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/667: chown d6/d7/d37/l69 1977332251 1 2024-09-21T12:47:19.289 INFO:tasks.workunit.client.0.smithi046.stdout:6/585: chown de/d2a/d4c/d71 3714967 1 2024-09-21T12:47:19.289 INFO:tasks.workunit.client.0.smithi046.stdout:0/668: fdatasync d6/d2f/d32/fba 0 2024-09-21T12:47:19.294 INFO:tasks.workunit.client.0.smithi046.stdout:7/625: mknod d2/d4/d43/ccc 0 2024-09-21T12:47:19.297 INFO:tasks.workunit.client.0.smithi046.stdout:0/669: rmdir d6/d7/d13/d72 39 2024-09-21T12:47:19.299 INFO:tasks.workunit.client.0.smithi046.stdout:6/586: read de/f13 [196188,79586] 0 2024-09-21T12:47:19.301 INFO:tasks.workunit.client.0.smithi046.stdout:8/673: dwrite d1/d12/d46/d35/d36/d51/f89 [0,4194304] 0 2024-09-21T12:47:19.304 INFO:tasks.workunit.client.0.smithi046.stdout:7/626: dwrite d2/d4/df/d6f/f76 [0,4194304] 0 2024-09-21T12:47:19.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/674: chown d1/d12/d53/fcc 232 1 2024-09-21T12:47:19.307 INFO:tasks.workunit.client.0.smithi046.stdout:7/627: readlink d2/d37/l67 0 2024-09-21T12:47:19.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/587: dread de/d2a/d4c/d71/d7c/f87 [0,4194304] 0 2024-09-21T12:47:19.313 INFO:tasks.workunit.client.0.smithi046.stdout:8/675: creat d1/d12/d53/dab/ff0 x:0 0 0 2024-09-21T12:47:19.314 INFO:tasks.workunit.client.0.smithi046.stdout:8/676: readlink d1/lc 0 2024-09-21T12:47:19.315 INFO:tasks.workunit.client.0.smithi046.stdout:7/628: creat d2/d4/df/d70/db2/fcd x:0 0 0 2024-09-21T12:47:19.318 INFO:tasks.workunit.client.0.smithi046.stdout:0/670: rmdir d6/d7/d13/d43/d52/d63 39 2024-09-21T12:47:19.322 INFO:tasks.workunit.client.0.smithi046.stdout:7/629: dwrite d2/fa4 [0,4194304] 0 2024-09-21T12:47:19.326 INFO:tasks.workunit.client.0.smithi046.stdout:7/630: creat d2/d4/df/d70/fce x:0 0 0 2024-09-21T12:47:19.328 INFO:tasks.workunit.client.0.smithi046.stdout:7/631: write d2/dd/f3d [6433443,95466] 0 2024-09-21T12:47:19.329 INFO:tasks.workunit.client.0.smithi046.stdout:7/632: rename d2 to d2/d4/df/d42/dbd/dcf 22 2024-09-21T12:47:19.336 INFO:tasks.workunit.client.0.smithi046.stdout:8/677: truncate d1/ff 5415598 0 2024-09-21T12:47:19.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/671: write d6/d7/d13/d43/d52/dc0/dc3/f7e [563642,90089] 0 2024-09-21T12:47:19.341 INFO:tasks.workunit.client.0.smithi046.stdout:0/672: creat d6/d7/d9/dca/ff9 x:0 0 0 2024-09-21T12:47:19.343 INFO:tasks.workunit.client.0.smithi046.stdout:0/673: mkdir d6/d60/dfa 0 2024-09-21T12:47:19.344 INFO:tasks.workunit.client.0.smithi046.stdout:0/674: dread - d6/d7/d13/fee zero size 2024-09-21T12:47:19.348 INFO:tasks.workunit.client.0.smithi046.stdout:8/678: dread d1/d12/d53/f98 [0,4194304] 0 2024-09-21T12:47:19.349 INFO:tasks.workunit.client.0.smithi046.stdout:0/675: rename d6/d7/d9/d54/db1/dd6 to d6/d7/d9/d54/d97/dfb 0 2024-09-21T12:47:19.354 INFO:tasks.workunit.client.0.smithi046.stdout:0/676: truncate d6/d7/d9/dc4/fdc 4351909 0 2024-09-21T12:47:19.354 INFO:tasks.workunit.client.0.smithi046.stdout:7/633: dread d2/d4/df/d70/d88/d34/f38 [4194304,4194304] 0 2024-09-21T12:47:19.355 INFO:tasks.workunit.client.0.smithi046.stdout:8/679: mkdir d1/d12/d46/d35/d36/dc6/df1 0 2024-09-21T12:47:19.356 INFO:tasks.workunit.client.0.smithi046.stdout:7/634: chown d2/d4/df/d70/d88/d34/f4b 5 1 2024-09-21T12:47:19.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/677: rename d6/d2f/l74 to d6/d2f/de9/lfc 0 2024-09-21T12:47:19.358 INFO:tasks.workunit.client.0.smithi046.stdout:0/678: fdatasync d6/d7/fc7 0 2024-09-21T12:47:19.358 INFO:tasks.workunit.client.0.smithi046.stdout:8/680: creat d1/d12/d53/dab/ff2 x:0 0 0 2024-09-21T12:47:19.362 INFO:tasks.workunit.client.0.smithi046.stdout:8/681: getdents d1/d12/d53/d80/da1/def 0 2024-09-21T12:47:19.363 INFO:tasks.workunit.client.0.smithi046.stdout:7/635: dwrite d2/d4/df/d6f/f76 [0,4194304] 0 2024-09-21T12:47:19.365 INFO:tasks.workunit.client.0.smithi046.stdout:0/679: truncate d6/d7/d9/ff 1879627 0 2024-09-21T12:47:19.366 INFO:tasks.workunit.client.0.smithi046.stdout:0/680: dread - d6/d7/fc7 zero size 2024-09-21T12:47:19.369 INFO:tasks.workunit.client.0.smithi046.stdout:8/682: truncate d1/fa 877119 0 2024-09-21T12:47:19.373 INFO:tasks.workunit.client.0.smithi046.stdout:0/681: dwrite d6/d7/d37/d53/f7c [0,4194304] 0 2024-09-21T12:47:19.374 INFO:tasks.workunit.client.0.smithi046.stdout:0/682: readlink d6/l5d 0 2024-09-21T12:47:19.378 INFO:tasks.workunit.client.0.smithi046.stdout:0/683: mkdir d6/d7/dfd 0 2024-09-21T12:47:19.419 INFO:tasks.workunit.client.0.smithi046.stdout:3/506: sync 2024-09-21T12:47:19.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/550: sync 2024-09-21T12:47:19.419 INFO:tasks.workunit.client.0.smithi046.stdout:9/708: sync 2024-09-21T12:47:19.419 INFO:tasks.workunit.client.0.smithi046.stdout:4/641: sync 2024-09-21T12:47:19.448 INFO:tasks.workunit.client.0.smithi046.stdout:8/683: mknod d1/d12/d53/d80/da1/def/cf3 0 2024-09-21T12:47:19.450 INFO:tasks.workunit.client.0.smithi046.stdout:7/636: truncate d2/fa4 4034048 0 2024-09-21T12:47:19.451 INFO:tasks.workunit.client.0.smithi046.stdout:4/642: chown d1/d27/d46/d78/c7f 1023 1 2024-09-21T12:47:19.452 INFO:tasks.workunit.client.0.smithi046.stdout:3/507: creat d5/dc/d26/fb2 x:0 0 0 2024-09-21T12:47:19.452 INFO:tasks.workunit.client.0.smithi046.stdout:9/709: truncate d11/d19/d1b/d1c/fc8 301840 0 2024-09-21T12:47:19.453 INFO:tasks.workunit.client.0.smithi046.stdout:0/684: symlink d6/d7/df3/lfe 0 2024-09-21T12:47:19.454 INFO:tasks.workunit.client.0.smithi046.stdout:9/710: stat d11/d5b/d6f/db0/d30/l41 0 2024-09-21T12:47:19.455 INFO:tasks.workunit.client.0.smithi046.stdout:9/711: readlink d11/l15 0 2024-09-21T12:47:19.455 INFO:tasks.workunit.client.0.smithi046.stdout:7/637: chown d2/d4/d43/l5f 7439 1 2024-09-21T12:47:19.456 INFO:tasks.workunit.client.0.smithi046.stdout:7/638: read - d2/d4/df/d17/fc1 zero size 2024-09-21T12:47:19.458 INFO:tasks.workunit.client.0.smithi046.stdout:4/643: link d1/ff d1/d27/d37/fd9 0 2024-09-21T12:47:19.461 INFO:tasks.workunit.client.0.smithi046.stdout:2/551: getdents d16/d22/d2b 0 2024-09-21T12:47:19.462 INFO:tasks.workunit.client.0.smithi046.stdout:0/685: symlink d6/d7/d13/d43/d52/d63/d7f/d38/db7/lff 0 2024-09-21T12:47:19.464 INFO:tasks.workunit.client.0.smithi046.stdout:4/644: rmdir d1/d27/d82 39 2024-09-21T12:47:19.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/684: link d1/d12/d46/d35/f73 d1/d12/d46/d35/d36/d51/d8c/ff4 0 2024-09-21T12:47:19.465 INFO:tasks.workunit.client.0.smithi046.stdout:4/645: dread - d1/d13/d4e/f91 zero size 2024-09-21T12:47:19.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/646: fsync d1/d27/d46/d78/f98 0 2024-09-21T12:47:19.469 INFO:tasks.workunit.client.0.smithi046.stdout:2/552: mknod d16/caa 0 2024-09-21T12:47:19.472 INFO:tasks.workunit.client.0.smithi046.stdout:8/685: dwrite d1/d12/d46/fd5 [0,4194304] 0 2024-09-21T12:47:19.480 INFO:tasks.workunit.client.0.smithi046.stdout:4/647: truncate d1/d27/f61 659857 0 2024-09-21T12:47:19.480 INFO:tasks.workunit.client.0.smithi046.stdout:9/712: dwrite d11/d19/d1b/d1c/f47 [0,4194304] 0 2024-09-21T12:47:19.485 INFO:tasks.workunit.client.0.smithi046.stdout:7/639: truncate d2/d4/f9c 2575874 0 2024-09-21T12:47:19.486 INFO:tasks.workunit.client.0.smithi046.stdout:7/640: fsync d2/d4/df/d70/db2/fcd 0 2024-09-21T12:47:19.486 INFO:tasks.workunit.client.0.smithi046.stdout:2/553: creat d16/d22/d2b/d30/d67/fab x:0 0 0 2024-09-21T12:47:19.486 INFO:tasks.workunit.client.0.smithi046.stdout:0/686: mkdir d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100 0 2024-09-21T12:47:19.490 INFO:tasks.workunit.client.0.smithi046.stdout:8/686: truncate d1/d12/d46/d35/d5b/f85 5156018 0 2024-09-21T12:47:19.497 INFO:tasks.workunit.client.0.smithi046.stdout:9/713: creat d11/d19/d1b/d4b/d91/fe0 x:0 0 0 2024-09-21T12:47:19.497 INFO:tasks.workunit.client.0.smithi046.stdout:2/554: mkdir d16/d22/d38/dac 0 2024-09-21T12:47:19.500 INFO:tasks.workunit.client.0.smithi046.stdout:0/687: rename d6/dac/fbd to d6/d2f/de9/f101 0 2024-09-21T12:47:19.501 INFO:tasks.workunit.client.0.smithi046.stdout:8/687: unlink d1/d12/d1a/c68 0 2024-09-21T12:47:19.502 INFO:tasks.workunit.client.0.smithi046.stdout:8/688: dread - d1/d12/d53/d80/da1/fcb zero size 2024-09-21T12:47:19.503 INFO:tasks.workunit.client.0.smithi046.stdout:4/648: mkdir d1/dda 0 2024-09-21T12:47:19.504 INFO:tasks.workunit.client.0.smithi046.stdout:4/649: chown d1/d27/d46 59 1 2024-09-21T12:47:19.504 INFO:tasks.workunit.client.0.smithi046.stdout:9/714: mkdir d11/d19/d36/d45/d6e/de1 0 2024-09-21T12:47:19.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/641: creat d2/d4/df/d70/d88/d34/d7f/db4/fd0 x:0 0 0 2024-09-21T12:47:19.507 INFO:tasks.workunit.client.0.smithi046.stdout:0/688: chown d6/d7/d13/d49/cef 348533 1 2024-09-21T12:47:19.508 INFO:tasks.workunit.client.0.smithi046.stdout:7/642: dread - d2/d4/df/d70/d88/d34/d7f/db4/fd0 zero size 2024-09-21T12:47:19.508 INFO:tasks.workunit.client.0.smithi046.stdout:0/689: dread - d6/d7/d37/faa zero size 2024-09-21T12:47:19.509 INFO:tasks.workunit.client.0.smithi046.stdout:8/689: creat d1/d12/d46/d35/d7d/d6a/dd1/ff5 x:0 0 0 2024-09-21T12:47:19.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/650: mkdir d1/d27/d46/ddb 0 2024-09-21T12:47:19.511 INFO:tasks.workunit.client.0.smithi046.stdout:2/555: creat d16/d22/d4e/fad x:0 0 0 2024-09-21T12:47:19.513 INFO:tasks.workunit.client.0.smithi046.stdout:0/690: write d6/d7/d13/f1d [2878927,14503] 0 2024-09-21T12:47:19.513 INFO:tasks.workunit.client.0.smithi046.stdout:7/643: mkdir d2/d4/df/d42/dd1 0 2024-09-21T12:47:19.518 INFO:tasks.workunit.client.0.smithi046.stdout:2/556: rename d16/d5c/d63/f79 to d16/d22/d4e/d90/fae 0 2024-09-21T12:47:19.521 INFO:tasks.workunit.client.0.smithi046.stdout:0/691: creat d6/d7/d13/d43/d52/d8c/f102 x:0 0 0 2024-09-21T12:47:19.523 INFO:tasks.workunit.client.0.smithi046.stdout:4/651: dwrite d1/d27/d82/da8/fcf [0,4194304] 0 2024-09-21T12:47:19.527 INFO:tasks.workunit.client.0.smithi046.stdout:7/644: rename d2/d4/df/d6f/d92/cc9 to d2/d4/df/d70/d88/d34/d7f/cd2 0 2024-09-21T12:47:19.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/557: creat d16/d22/d2b/d43/faf x:0 0 0 2024-09-21T12:47:19.532 INFO:tasks.workunit.client.0.smithi046.stdout:2/558: stat d16/d22/d2b/d30/d67/l68 0 2024-09-21T12:47:19.540 INFO:tasks.workunit.client.0.smithi046.stdout:7/645: rename d2/d4/df/d70/fce to d2/d4/df/d6f/d92/fd3 0 2024-09-21T12:47:19.543 INFO:tasks.workunit.client.0.smithi046.stdout:2/559: mknod d16/d22/d75/cb0 0 2024-09-21T12:47:19.547 INFO:tasks.workunit.client.0.smithi046.stdout:7/646: dwrite d2/d37/f82 [0,4194304] 0 2024-09-21T12:47:19.597 INFO:tasks.workunit.client.0.smithi046.stdout:5/587: sync 2024-09-21T12:47:19.608 INFO:tasks.workunit.client.0.smithi046.stdout:2/560: mknod d16/d22/d4e/d90/cb1 0 2024-09-21T12:47:19.608 INFO:tasks.workunit.client.0.smithi046.stdout:9/715: write d11/d5b/d6f/db0/d30/d3e/dbf/fc9 [1331283,86781] 0 2024-09-21T12:47:19.609 INFO:tasks.workunit.client.0.smithi046.stdout:9/716: read - d11/d5b/d6f/db0/d74/fa1 zero size 2024-09-21T12:47:19.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/561: mknod d16/d5c/d63/cb2 0 2024-09-21T12:47:19.614 INFO:tasks.workunit.client.0.smithi046.stdout:5/588: mknod d4/dc/d45/d94/cb9 0 2024-09-21T12:47:19.614 INFO:tasks.workunit.client.0.smithi046.stdout:9/717: read - d11/d19/d1b/d4b/d91/f7c zero size 2024-09-21T12:47:19.616 INFO:tasks.workunit.client.0.smithi046.stdout:2/562: truncate d16/d22/d38/f4f 1200235 0 2024-09-21T12:47:19.618 INFO:tasks.workunit.client.0.smithi046.stdout:5/589: creat d4/dc/d13/d5b/d2d/d43/d7a/fba x:0 0 0 2024-09-21T12:47:19.620 INFO:tasks.workunit.client.0.smithi046.stdout:9/718: unlink d11/d19/fde 0 2024-09-21T12:47:19.620 INFO:tasks.workunit.client.0.smithi046.stdout:0/692: truncate d6/d7/d37/d53/f7c 2122597 0 2024-09-21T12:47:19.716 INFO:tasks.workunit.client.0.smithi046.stdout:4/652: write d1/d13/f16 [935026,122135] 0 2024-09-21T12:47:19.717 INFO:tasks.workunit.client.0.smithi046.stdout:7/647: truncate d2/dd/f3d 8051467 0 2024-09-21T12:47:19.718 INFO:tasks.workunit.client.0.smithi046.stdout:9/719: mknod d11/d19/d1b/d4b/d91/ce2 0 2024-09-21T12:47:19.720 INFO:tasks.workunit.client.0.smithi046.stdout:7/648: write d2/d37/fb9 [643983,52892] 0 2024-09-21T12:47:19.724 INFO:tasks.workunit.client.0.smithi046.stdout:2/563: rename d16/d22/d38/f4f to d16/d22/d38/d77/fb3 0 2024-09-21T12:47:19.725 INFO:tasks.workunit.client.0.smithi046.stdout:4/653: dwrite d1/d27/d37/d8f/fad [0,4194304] 0 2024-09-21T12:47:19.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/564: read d16/d22/d2b/f37 [2885283,27383] 0 2024-09-21T12:47:19.727 INFO:tasks.workunit.client.0.smithi046.stdout:9/720: symlink d11/d19/d1b/d31/d53/da4/le3 0 2024-09-21T12:47:19.730 INFO:tasks.workunit.client.0.smithi046.stdout:0/693: rename d6/f18 to d6/d2f/de9/f103 0 2024-09-21T12:47:19.732 INFO:tasks.workunit.client.0.smithi046.stdout:2/565: mkdir d16/d5c/d63/db4 0 2024-09-21T12:47:19.732 INFO:tasks.workunit.client.0.smithi046.stdout:2/566: chown d16/d22/d2b/d43/f5a 203 1 2024-09-21T12:47:19.735 INFO:tasks.workunit.client.0.smithi046.stdout:4/654: symlink d1/d13/d25/d29/d43/d84/daa/ldc 0 2024-09-21T12:47:19.736 INFO:tasks.workunit.client.0.smithi046.stdout:5/590: link d4/dc/d13/c17 d4/dc/d45/d94/cbb 0 2024-09-21T12:47:19.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/649: truncate d2/d4/f47 3093295 0 2024-09-21T12:47:19.745 INFO:tasks.workunit.client.0.smithi046.stdout:2/567: creat d16/d5c/fb5 x:0 0 0 2024-09-21T12:47:19.752 INFO:tasks.workunit.client.0.smithi046.stdout:2/568: symlink d16/d5c/lb6 0 2024-09-21T12:47:19.753 INFO:tasks.workunit.client.0.smithi046.stdout:9/721: dwrite d11/d19/d36/d45/d6e/f76 [0,4194304] 0 2024-09-21T12:47:19.754 INFO:tasks.workunit.client.0.smithi046.stdout:2/569: dread - d16/d22/d2b/d43/faf zero size 2024-09-21T12:47:19.755 INFO:tasks.workunit.client.0.smithi046.stdout:0/694: creat d6/d7/d13/d43/d52/f104 x:0 0 0 2024-09-21T12:47:19.757 INFO:tasks.workunit.client.0.smithi046.stdout:2/570: write d16/d22/d2b/d30/d67/fab [602699,33738] 0 2024-09-21T12:47:19.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/695: read d6/d7/d13/d7b/da2/f46 [2302271,101781] 0 2024-09-21T12:47:19.763 INFO:tasks.workunit.client.0.smithi046.stdout:9/722: rename d11/d19/d1b/d4b/d91/d8c/c96 to d11/d5b/d6f/db0/d30/d3e/dbf/ce4 0 2024-09-21T12:47:19.765 INFO:tasks.workunit.client.0.smithi046.stdout:9/723: fdatasync d11/d5b/d6f/db0/d30/d3e/f87 0 2024-09-21T12:47:19.768 INFO:tasks.workunit.client.0.smithi046.stdout:4/655: getdents d1/d13/d25/d29/d43/d84/daa 0 2024-09-21T12:47:19.770 INFO:tasks.workunit.client.0.smithi046.stdout:4/656: stat d1/d5f/c64 0 2024-09-21T12:47:19.771 INFO:tasks.workunit.client.0.smithi046.stdout:0/696: dwrite d6/d2f/fc8 [0,4194304] 0 2024-09-21T12:47:19.780 INFO:tasks.workunit.client.0.smithi046.stdout:0/697: dwrite d6/f40 [4194304,4194304] 0 2024-09-21T12:47:19.782 INFO:tasks.workunit.client.0.smithi046.stdout:9/724: rename d11/d19/d36/d45/f67 to d11/d19/d1b/d31/d53/d58/fe5 0 2024-09-21T12:47:19.783 INFO:tasks.workunit.client.0.smithi046.stdout:7/650: write d2/d4/f47 [595409,98958] 0 2024-09-21T12:47:19.790 INFO:tasks.workunit.client.0.smithi046.stdout:9/725: creat d11/d19/d1b/d31/d53/d84/fe6 x:0 0 0 2024-09-21T12:47:19.800 INFO:tasks.workunit.client.0.smithi046.stdout:0/698: creat d6/d7/d13/db6/f105 x:0 0 0 2024-09-21T12:47:19.802 INFO:tasks.workunit.client.0.smithi046.stdout:9/726: unlink d11/d19/d1b/d31/d53/d84/fd0 0 2024-09-21T12:47:19.805 INFO:tasks.workunit.client.0.smithi046.stdout:0/699: fsync d6/d7/d13/fb3 0 2024-09-21T12:47:19.808 INFO:tasks.workunit.client.0.smithi046.stdout:4/657: dwrite d1/f35 [0,4194304] 0 2024-09-21T12:47:19.808 INFO:tasks.workunit.client.0.smithi046.stdout:0/700: write d6/d2f/d32/fba [672817,115761] 0 2024-09-21T12:47:19.813 INFO:tasks.workunit.client.0.smithi046.stdout:4/658: creat d1/d13/d25/d3a/fdd x:0 0 0 2024-09-21T12:47:19.817 INFO:tasks.workunit.client.0.smithi046.stdout:4/659: symlink d1/d27/d82/da8/lde 0 2024-09-21T12:47:19.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/660: stat d1/d27/d37/d8f/fad 0 2024-09-21T12:47:19.818 INFO:tasks.workunit.client.0.smithi046.stdout:9/727: dread d11/d5b/fbe [0,4194304] 0 2024-09-21T12:47:19.819 INFO:tasks.workunit.client.0.smithi046.stdout:9/728: fdatasync d11/d19/d1b/fc1 0 2024-09-21T12:47:19.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/701: truncate d6/d7/d13/d7b/da2/f27 720845 0 2024-09-21T12:47:19.820 INFO:tasks.workunit.client.0.smithi046.stdout:4/661: rmdir d1/d5f 39 2024-09-21T12:47:19.821 INFO:tasks.workunit.client.0.smithi046.stdout:0/702: chown d6/d7/d13/d7b/da2/c20 63424 1 2024-09-21T12:47:19.822 INFO:tasks.workunit.client.0.smithi046.stdout:0/703: stat d6/d7/d13/d43/d52/d63/d7f/d38/db7/fc5 0 2024-09-21T12:47:19.822 INFO:tasks.workunit.client.0.smithi046.stdout:9/729: readlink d11/d19/d1b/d31/d53/d58/lb2 0 2024-09-21T12:47:19.823 INFO:tasks.workunit.client.0.smithi046.stdout:9/730: readlink d11/l17 0 2024-09-21T12:47:19.824 INFO:tasks.workunit.client.0.smithi046.stdout:0/704: write d6/d7/d13/d43/d52/d63/fd2 [799667,117365] 0 2024-09-21T12:47:19.827 INFO:tasks.workunit.client.0.smithi046.stdout:9/731: unlink d11/d19/d1b/d4b/d91/dc6/lc7 0 2024-09-21T12:47:19.835 INFO:tasks.workunit.client.0.smithi046.stdout:9/732: rmdir d11/d19/d36/d45/d6e/de1 0 2024-09-21T12:47:19.838 INFO:tasks.workunit.client.0.smithi046.stdout:0/705: dread d6/d7/d13/d49/f9f [0,4194304] 0 2024-09-21T12:47:19.839 INFO:tasks.workunit.client.0.smithi046.stdout:9/733: mknod d11/d19/d1b/d4b/ce7 0 2024-09-21T12:47:19.840 INFO:tasks.workunit.client.0.smithi046.stdout:0/706: readlink d6/d7/d13/d43/d52/d63/d7f/d38/l98 0 2024-09-21T12:47:19.846 INFO:tasks.workunit.client.0.smithi046.stdout:0/707: rename d6/d7/d13/d43/d52/d63/d7f/d38/l98 to d6/d7/d13/d43/d52/d63/d7f/d78/d8a/l106 0 2024-09-21T12:47:19.850 INFO:tasks.workunit.client.0.smithi046.stdout:4/662: dwrite d1/d27/d46/f86 [0,4194304] 0 2024-09-21T12:47:19.852 INFO:tasks.workunit.client.0.smithi046.stdout:0/708: mkdir d6/d7/d9/dc4/d107 0 2024-09-21T12:47:19.853 INFO:tasks.workunit.client.0.smithi046.stdout:9/734: dread d11/d19/d1b/d31/d53/da4/f7f [0,4194304] 0 2024-09-21T12:47:19.855 INFO:tasks.workunit.client.0.smithi046.stdout:0/709: fdatasync d6/d7/d13/d43/d52/d63/d7f/d38/f93 0 2024-09-21T12:47:19.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/594: sync 2024-09-21T12:47:19.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/595: rename d4/d13/d38/d48 to d4/d13/d79/dbd 0 2024-09-21T12:47:19.959 INFO:tasks.workunit.client.0.smithi046.stdout:1/596: fdatasync d4/d29/d32/d9e/d5d/fa8 0 2024-09-21T12:47:19.990 INFO:tasks.workunit.client.0.smithi046.stdout:0/710: symlink d6/d7/dfd/l108 0 2024-09-21T12:47:19.997 INFO:tasks.workunit.client.0.smithi046.stdout:0/711: fsync d6/d7/d9/ff 0 2024-09-21T12:47:19.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/712: dread - d6/d2f/d32/fbb zero size 2024-09-21T12:47:20.001 INFO:tasks.workunit.client.0.smithi046.stdout:0/713: dread - d6/d7/d13/d43/d52/f5e zero size 2024-09-21T12:47:20.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/714: mknod d6/d7/d13/d43/d52/d63/d7f/c109 0 2024-09-21T12:47:20.004 INFO:tasks.workunit.client.0.smithi046.stdout:0/715: chown d6/d7/d9/cd5 335394434 1 2024-09-21T12:47:20.007 INFO:tasks.workunit.client.0.smithi046.stdout:0/716: mkdir d6/d7/d13/d72/d10a 0 2024-09-21T12:47:20.013 INFO:tasks.workunit.client.0.smithi046.stdout:4/663: dwrite d1/d13/d25/d29/d43/f6c [0,4194304] 0 2024-09-21T12:47:20.017 INFO:tasks.workunit.client.0.smithi046.stdout:0/717: creat d6/d7/d13/d72/d10a/f10b x:0 0 0 2024-09-21T12:47:20.018 INFO:tasks.workunit.client.0.smithi046.stdout:9/735: dwrite d11/d19/d1b/d4b/d91/f7c [0,4194304] 0 2024-09-21T12:47:20.019 INFO:tasks.workunit.client.0.smithi046.stdout:9/736: dread - d11/d19/d1b/d31/d44/fa3 zero size 2024-09-21T12:47:20.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/664: rename d1/d27/d37/d8f/d9d to d1/d27/d37/d8f/ddf 0 2024-09-21T12:47:20.032 INFO:tasks.workunit.client.0.smithi046.stdout:1/597: truncate d4/d13/f1d 2423560 0 2024-09-21T12:47:20.033 INFO:tasks.workunit.client.0.smithi046.stdout:4/665: creat d1/d27/d37/d8f/ddf/fe0 x:0 0 0 2024-09-21T12:47:20.068 INFO:tasks.workunit.client.0.smithi046.stdout:1/598: creat d4/d13/d38/d4f/d83/fbe x:0 0 0 2024-09-21T12:47:20.070 INFO:tasks.workunit.client.0.smithi046.stdout:4/666: symlink d1/d13/d25/d29/d43/d84/daa/le1 0 2024-09-21T12:47:20.071 INFO:tasks.workunit.client.0.smithi046.stdout:4/667: fsync d1/d13/f16 0 2024-09-21T12:47:20.072 INFO:tasks.workunit.client.0.smithi046.stdout:4/668: dread - d1/d27/d82/fb4 zero size 2024-09-21T12:47:20.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/599: creat d4/d29/d32/d9e/d5d/d8c/d94/fbf x:0 0 0 2024-09-21T12:47:20.074 INFO:tasks.workunit.client.0.smithi046.stdout:3/508: sync 2024-09-21T12:47:20.074 INFO:tasks.workunit.client.0.smithi046.stdout:6/588: sync 2024-09-21T12:47:20.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/669: dread d1/d27/d37/f49 [0,4194304] 0 2024-09-21T12:47:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:4/670: write d1/d27/d82/fd7 [109465,46235] 0 2024-09-21T12:47:20.077 INFO:tasks.workunit.client.0.smithi046.stdout:1/600: mkdir d4/d13/dc0 0 2024-09-21T12:47:20.080 INFO:tasks.workunit.client.0.smithi046.stdout:0/718: write d6/d7/d9/f50 [3668464,29159] 0 2024-09-21T12:47:20.081 INFO:tasks.workunit.client.0.smithi046.stdout:3/509: read d5/dc/f1b [3088164,71381] 0 2024-09-21T12:47:20.083 INFO:tasks.workunit.client.0.smithi046.stdout:4/671: readlink d1/d13/l22 0 2024-09-21T12:47:20.086 INFO:tasks.workunit.client.0.smithi046.stdout:6/589: mkdir de/d2a/d4c/d77/dc0 0 2024-09-21T12:47:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:0/719: fsync d6/d7/d13/d72/d9b/faf 0 2024-09-21T12:47:20.087 INFO:tasks.workunit.client.0.smithi046.stdout:3/510: rmdir d5/dc/d28/d60/d6e 39 2024-09-21T12:47:20.088 INFO:tasks.workunit.client.0.smithi046.stdout:0/720: fdatasync d6/d60/f92 0 2024-09-21T12:47:20.089 INFO:tasks.workunit.client.0.smithi046.stdout:0/721: chown d6/d2f/d32/fe2 6 1 2024-09-21T12:47:20.090 INFO:tasks.workunit.client.0.smithi046.stdout:0/722: dread - d6/d2f/d32/fbb zero size 2024-09-21T12:47:20.091 INFO:tasks.workunit.client.0.smithi046.stdout:6/590: creat de/d2a/d4c/d69/fc1 x:0 0 0 2024-09-21T12:47:20.092 INFO:tasks.workunit.client.0.smithi046.stdout:0/723: write d6/dac/ff7 [153052,106512] 0 2024-09-21T12:47:20.095 INFO:tasks.workunit.client.0.smithi046.stdout:0/724: write d6/d7/d9/f50 [1290416,102961] 0 2024-09-21T12:47:20.099 INFO:tasks.workunit.client.0.smithi046.stdout:6/591: unlink de/d35/f61 0 2024-09-21T12:47:20.100 INFO:tasks.workunit.client.0.smithi046.stdout:4/672: dread d1/d27/d46/f3e [0,4194304] 0 2024-09-21T12:47:20.104 INFO:tasks.workunit.client.0.smithi046.stdout:0/725: read d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd3 [3539592,72255] 0 2024-09-21T12:47:20.105 INFO:tasks.workunit.client.0.smithi046.stdout:0/726: fsync d6/d2f/d32/f65 0 2024-09-21T12:47:20.107 INFO:tasks.workunit.client.0.smithi046.stdout:6/592: rename de/d2a/d4d/c91 to de/d2a/d4c/d77/d8f/d94/cc2 0 2024-09-21T12:47:20.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/593: write de/d2a/d4c/d71/d7c/dad/fbd [616330,54689] 0 2024-09-21T12:47:20.109 INFO:tasks.workunit.client.0.smithi046.stdout:0/727: mkdir d6/d7/d13/d43/d52/d63/d7f/d78/d10c 0 2024-09-21T12:47:20.111 INFO:tasks.workunit.client.0.smithi046.stdout:6/594: unlink de/d2a/f5e 0 2024-09-21T12:47:20.115 INFO:tasks.workunit.client.0.smithi046.stdout:0/728: unlink d6/d7/d13/d43/d52/dc0/dc3/ced 0 2024-09-21T12:47:20.118 INFO:tasks.workunit.client.0.smithi046.stdout:0/729: unlink d6/f23 0 2024-09-21T12:47:20.121 INFO:tasks.workunit.client.0.smithi046.stdout:9/737: truncate d11/d5b/d6f/db0/d30/f5d 16462 0 2024-09-21T12:47:20.122 INFO:tasks.workunit.client.0.smithi046.stdout:9/738: chown d11/d19/d1b/d1c 29811208 1 2024-09-21T12:47:20.124 INFO:tasks.workunit.client.0.smithi046.stdout:9/739: creat d11/d19/d93/fe8 x:0 0 0 2024-09-21T12:47:20.127 INFO:tasks.workunit.client.0.smithi046.stdout:9/740: mknod d11/d5b/d6f/db0/ce9 0 2024-09-21T12:47:20.128 INFO:tasks.workunit.client.0.smithi046.stdout:9/741: chown d11/cc5 1121649 1 2024-09-21T12:47:20.131 INFO:tasks.workunit.client.0.smithi046.stdout:3/511: write d5/dc/d30/f39 [539285,117786] 0 2024-09-21T12:47:20.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/742: dwrite d11/d19/d36/f42 [4194304,4194304] 0 2024-09-21T12:47:20.137 INFO:tasks.workunit.client.0.smithi046.stdout:6/595: write de/d2a/d4c/d69/f65 [454969,10970] 0 2024-09-21T12:47:20.139 INFO:tasks.workunit.client.0.smithi046.stdout:9/743: write d11/d19/d36/f42 [4975426,16395] 0 2024-09-21T12:47:20.142 INFO:tasks.workunit.client.0.smithi046.stdout:4/673: dwrite d1/d13/d25/d29/d33/f76 [0,4194304] 0 2024-09-21T12:47:20.143 INFO:tasks.workunit.client.0.smithi046.stdout:6/596: chown de/c10 2 1 2024-09-21T12:47:20.152 INFO:tasks.workunit.client.0.smithi046.stdout:9/744: truncate d11/d19/d1b/f25 3773843 0 2024-09-21T12:47:20.153 INFO:tasks.workunit.client.0.smithi046.stdout:3/512: dread d5/dc/d28/d60/d6e/f74 [0,4194304] 0 2024-09-21T12:47:20.156 INFO:tasks.workunit.client.0.smithi046.stdout:4/674: dwrite d1/d13/d25/d3a/f4d [0,4194304] 0 2024-09-21T12:47:20.158 INFO:tasks.workunit.client.0.smithi046.stdout:9/745: creat d11/d19/d1b/d4b/fea x:0 0 0 2024-09-21T12:47:20.159 INFO:tasks.workunit.client.0.smithi046.stdout:9/746: chown d11/d19/d1b/d31/f7d 10973 1 2024-09-21T12:47:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:9/747: fsync d11/d19/d1b/d1c/f2f 0 2024-09-21T12:47:20.160 INFO:tasks.workunit.client.0.smithi046.stdout:3/513: rename d5/d16/l2a to d5/dc/d94/da6/lb3 0 2024-09-21T12:47:20.161 INFO:tasks.workunit.client.0.smithi046.stdout:3/514: chown d5/d16/f95 15445 1 2024-09-21T12:47:20.163 INFO:tasks.workunit.client.0.smithi046.stdout:3/515: chown d5/dc/d28/d60/d6e/f74 69998 1 2024-09-21T12:47:20.167 INFO:tasks.workunit.client.0.smithi046.stdout:3/516: dread d5/dc/d26/f4c [0,4194304] 0 2024-09-21T12:47:20.167 INFO:tasks.workunit.client.0.smithi046.stdout:6/597: truncate de/d2a/d4c/fbf 381586 0 2024-09-21T12:47:20.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/517: creat d5/dc/d28/fb4 x:0 0 0 2024-09-21T12:47:20.176 INFO:tasks.workunit.client.0.smithi046.stdout:4/675: getdents d1/d13/d25/d6b 0 2024-09-21T12:47:20.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/676: chown d1/d13/d25/d29/f2f 230419 1 2024-09-21T12:47:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:6/598: unlink de/l2d 0 2024-09-21T12:47:20.178 INFO:tasks.workunit.client.0.smithi046.stdout:3/518: dread - d5/d16/d5f/f8b zero size 2024-09-21T12:47:20.180 INFO:tasks.workunit.client.0.smithi046.stdout:4/677: creat d1/d27/d46/d78/fe2 x:0 0 0 2024-09-21T12:47:20.184 INFO:tasks.workunit.client.0.smithi046.stdout:3/519: dwrite d5/dc/d26/f3d [4194304,4194304] 0 2024-09-21T12:47:20.186 INFO:tasks.workunit.client.0.smithi046.stdout:3/520: mkdir d5/d5e/d8e/db5 0 2024-09-21T12:47:20.189 INFO:tasks.workunit.client.0.smithi046.stdout:3/521: rmdir d5/dc/d94/da6 39 2024-09-21T12:47:20.195 INFO:tasks.workunit.client.0.smithi046.stdout:3/522: rename d5/d16/d5f/d6c/f6d to d5/dc/d30/fb6 0 2024-09-21T12:47:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:3/523: mknod d5/d16/d5f/d6c/cb7 0 2024-09-21T12:47:20.197 INFO:tasks.workunit.client.0.smithi046.stdout:9/748: dread f10 [0,4194304] 0 2024-09-21T12:47:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/749: creat d11/d19/d1b/d31/feb x:0 0 0 2024-09-21T12:47:20.200 INFO:tasks.workunit.client.0.smithi046.stdout:9/750: write f2 [5529665,39326] 0 2024-09-21T12:47:20.202 INFO:tasks.workunit.client.0.smithi046.stdout:9/751: mknod d11/d19/d1b/d31/d53/d84/cec 0 2024-09-21T12:47:20.206 INFO:tasks.workunit.client.0.smithi046.stdout:9/752: dread d11/d19/d36/d45/d6e/fd1 [0,4194304] 0 2024-09-21T12:47:20.217 INFO:tasks.workunit.client.0.smithi046.stdout:9/753: dread f4 [0,4194304] 0 2024-09-21T12:47:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/591: sync 2024-09-21T12:47:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:7/651: sync 2024-09-21T12:47:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:8/690: sync 2024-09-21T12:47:20.220 INFO:tasks.workunit.client.0.smithi046.stdout:2/571: sync 2024-09-21T12:47:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:8/691: stat d1/d12/d53/fcc 0 2024-09-21T12:47:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/592: chown d4/l11 389223920 1 2024-09-21T12:47:20.221 INFO:tasks.workunit.client.0.smithi046.stdout:7/652: readlink d2/d4/df/d9a/lb1 0 2024-09-21T12:47:20.224 INFO:tasks.workunit.client.0.smithi046.stdout:2/572: rename d16/f59 to d16/d22/d38/dac/fb7 0 2024-09-21T12:47:20.226 INFO:tasks.workunit.client.0.smithi046.stdout:7/653: chown d2/c41 24294737 1 2024-09-21T12:47:20.232 INFO:tasks.workunit.client.0.smithi046.stdout:2/573: dwrite d16/d22/d2b/f6e [0,4194304] 0 2024-09-21T12:47:20.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/692: symlink d1/d12/d46/d35/d36/d86/lf6 0 2024-09-21T12:47:20.234 INFO:tasks.workunit.client.0.smithi046.stdout:8/693: read d1/d12/d53/f97 [22305,37794] 0 2024-09-21T12:47:20.241 INFO:tasks.workunit.client.0.smithi046.stdout:9/754: write f10 [4389068,4873] 0 2024-09-21T12:47:20.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/574: rename d16/d22/d4e/d90/cb1 to d16/d22/d4e/da6/cb8 0 2024-09-21T12:47:20.251 INFO:tasks.workunit.client.0.smithi046.stdout:5/593: dwrite d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:20.257 INFO:tasks.workunit.client.0.smithi046.stdout:9/755: chown d11/d19/fd5 15 1 2024-09-21T12:47:20.261 INFO:tasks.workunit.client.0.smithi046.stdout:8/694: getdents d1/d12/d46/d35/d36/dc6/df1 0 2024-09-21T12:47:20.262 INFO:tasks.workunit.client.0.smithi046.stdout:7/654: dwrite d2/d4/f33 [0,4194304] 0 2024-09-21T12:47:20.264 INFO:tasks.workunit.client.0.smithi046.stdout:5/594: symlink d4/dc/d45/d94/lbc 0 2024-09-21T12:47:20.271 INFO:tasks.workunit.client.0.smithi046.stdout:9/756: creat d11/d19/d36/d95/fed x:0 0 0 2024-09-21T12:47:20.273 INFO:tasks.workunit.client.0.smithi046.stdout:5/595: dwrite d4/d22/d10/d1a/d9e/d9a/fb1 [0,4194304] 0 2024-09-21T12:47:20.274 INFO:tasks.workunit.client.0.smithi046.stdout:9/757: chown d11/d5b/d6f/db0/d30/d90/cdb 0 1 2024-09-21T12:47:20.277 INFO:tasks.workunit.client.0.smithi046.stdout:2/575: write d16/d22/f31 [5133819,93532] 0 2024-09-21T12:47:20.278 INFO:tasks.workunit.client.0.smithi046.stdout:5/596: creat d4/dc/d13/d15/d54/fbd x:0 0 0 2024-09-21T12:47:20.281 INFO:tasks.workunit.client.0.smithi046.stdout:7/655: creat d2/d37/fd4 x:0 0 0 2024-09-21T12:47:20.282 INFO:tasks.workunit.client.0.smithi046.stdout:9/758: dwrite d11/d19/d1b/d4b/f5f [0,4194304] 0 2024-09-21T12:47:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:8/695: getdents d1 0 2024-09-21T12:47:20.284 INFO:tasks.workunit.client.0.smithi046.stdout:2/576: unlink fa 0 2024-09-21T12:47:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:2/577: stat d16/d5c/f5d 0 2024-09-21T12:47:20.285 INFO:tasks.workunit.client.0.smithi046.stdout:8/696: stat d1/d12/d1a/fb7 0 2024-09-21T12:47:20.286 INFO:tasks.workunit.client.0.smithi046.stdout:5/597: rename d4/dc/d13/d5b/d2d/d3b/f95 to d4/fbe 0 2024-09-21T12:47:20.290 INFO:tasks.workunit.client.0.smithi046.stdout:9/759: mknod d11/d5b/d6f/db0/d30/d90/cee 0 2024-09-21T12:47:20.293 INFO:tasks.workunit.client.0.smithi046.stdout:2/578: mknod d16/d22/d38/d77/cb9 0 2024-09-21T12:47:20.295 INFO:tasks.workunit.client.0.smithi046.stdout:7/656: fsync d2/dd/f3d 0 2024-09-21T12:47:20.296 INFO:tasks.workunit.client.0.smithi046.stdout:7/657: chown d2/c41 3 1 2024-09-21T12:47:20.297 INFO:tasks.workunit.client.0.smithi046.stdout:9/760: mknod d11/d19/d1b/d31/d53/da4/cef 0 2024-09-21T12:47:20.298 INFO:tasks.workunit.client.0.smithi046.stdout:2/579: mknod d16/d22/d38/cba 0 2024-09-21T12:47:20.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/580: fsync d16/f8d 0 2024-09-21T12:47:20.303 INFO:tasks.workunit.client.0.smithi046.stdout:7/658: symlink d2/d37/ld5 0 2024-09-21T12:47:20.304 INFO:tasks.workunit.client.0.smithi046.stdout:7/659: chown d2/d4/df/d9a/dc3 533795555 1 2024-09-21T12:47:20.309 INFO:tasks.workunit.client.0.smithi046.stdout:7/660: chown d2/d4/d43/l4a 1285323338 1 2024-09-21T12:47:20.311 INFO:tasks.workunit.client.0.smithi046.stdout:2/581: rename d16/d22/d38/d77/f82 to d16/d22/d7f/fbb 0 2024-09-21T12:47:20.312 INFO:tasks.workunit.client.0.smithi046.stdout:5/598: write d4/fa [1153600,100004] 0 2024-09-21T12:47:20.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/761: dread d11/d19/f89 [0,4194304] 0 2024-09-21T12:47:20.315 INFO:tasks.workunit.client.0.smithi046.stdout:9/762: write d11/d19/d1b/d4b/f5f [2543385,3375] 0 2024-09-21T12:47:20.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:19 smithi176 ceph-mon[35476]: pgmap v36: 65 pgs: 65 active+clean; 3.0 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 87 MiB/s rd, 224 MiB/s wr, 519 op/s 2024-09-21T12:47:20.316 INFO:tasks.workunit.client.0.smithi046.stdout:9/763: fdatasync f10 0 2024-09-21T12:47:20.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/661: mkdir d2/d4/d43/dd6 0 2024-09-21T12:47:20.319 INFO:tasks.workunit.client.0.smithi046.stdout:8/697: truncate d1/d12/d46/d35/d5b/f70 1603294 0 2024-09-21T12:47:20.319 INFO:tasks.workunit.client.0.smithi046.stdout:7/662: dread d2/d4/fac [0,4194304] 0 2024-09-21T12:47:20.320 INFO:tasks.workunit.client.0.smithi046.stdout:5/599: write d4/dc/d13/d5b/d2d/d3b/fae [468853,43657] 0 2024-09-21T12:47:20.321 INFO:tasks.workunit.client.0.smithi046.stdout:8/698: readlink d1/d12/d46/d35/d36/d51/l84 0 2024-09-21T12:47:20.326 INFO:tasks.workunit.client.0.smithi046.stdout:9/764: dwrite d11/d19/d1b/d1c/fc8 [0,4194304] 0 2024-09-21T12:47:20.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/600: fsync d4/dc/d13/d15/d54/f70 0 2024-09-21T12:47:20.340 INFO:tasks.workunit.client.0.smithi046.stdout:8/699: mknod d1/d12/d46/d35/d36/d51/cf7 0 2024-09-21T12:47:20.343 INFO:tasks.workunit.client.0.smithi046.stdout:9/765: mknod d11/d19/d1b/d31/d53/cf0 0 2024-09-21T12:47:20.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/601: creat d4/dc/d13/d5b/fbf x:0 0 0 2024-09-21T12:47:20.353 INFO:tasks.workunit.client.0.smithi046.stdout:8/700: creat d1/d12/d46/d35/d36/d51/ff8 x:0 0 0 2024-09-21T12:47:20.353 INFO:tasks.workunit.client.0.smithi046.stdout:8/701: readlink d1/d12/d1a/d33/lc7 0 2024-09-21T12:47:20.355 INFO:tasks.workunit.client.0.smithi046.stdout:2/582: link d16/d22/f2a d16/d22/d2b/d30/d67/fbc 0 2024-09-21T12:47:20.361 INFO:tasks.workunit.client.0.smithi046.stdout:5/602: readlink d4/l53 0 2024-09-21T12:47:20.363 INFO:tasks.workunit.client.0.smithi046.stdout:8/702: dread - d1/d12/d46/d35/d36/d51/fb0 zero size 2024-09-21T12:47:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:7/663: dwrite d2/d4/d43/fb0 [0,4194304] 0 2024-09-21T12:47:20.367 INFO:tasks.workunit.client.0.smithi046.stdout:8/703: dread - d1/d12/d46/d35/d7d/fea zero size 2024-09-21T12:47:20.369 INFO:tasks.workunit.client.0.smithi046.stdout:5/603: dread d4/fa [0,4194304] 0 2024-09-21T12:47:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:2/583: dread d16/d22/f31 [0,4194304] 0 2024-09-21T12:47:20.370 INFO:tasks.workunit.client.0.smithi046.stdout:7/664: write d2/d4/df/d70/d88/d34/f48 [4851491,107410] 0 2024-09-21T12:47:20.371 INFO:tasks.workunit.client.0.smithi046.stdout:7/665: write d2/d4/f89 [1926522,67844] 0 2024-09-21T12:47:20.373 INFO:tasks.workunit.client.0.smithi046.stdout:9/766: rmdir d11/d19/d1b/d4b/d91/dc6 0 2024-09-21T12:47:20.375 INFO:tasks.workunit.client.0.smithi046.stdout:9/767: chown d11/d19/d36/cd6 7 1 2024-09-21T12:47:20.377 INFO:tasks.workunit.client.0.smithi046.stdout:7/666: dread d2/d4/d43/fb0 [0,4194304] 0 2024-09-21T12:47:20.377 INFO:tasks.workunit.client.0.smithi046.stdout:8/704: symlink d1/d12/d46/d35/d7d/d6a/dd1/lf9 0 2024-09-21T12:47:20.379 INFO:tasks.workunit.client.0.smithi046.stdout:5/604: dread - d4/d22/f9b zero size 2024-09-21T12:47:20.380 INFO:tasks.workunit.client.0.smithi046.stdout:8/705: truncate d1/d12/d46/d35/d7d/d6a/fbd 603226 0 2024-09-21T12:47:20.385 INFO:tasks.workunit.client.0.smithi046.stdout:5/605: creat d4/d22/fc0 x:0 0 0 2024-09-21T12:47:20.392 INFO:tasks.workunit.client.0.smithi046.stdout:9/768: mknod d11/d19/d1b/d31/d53/d84/dce/cf1 0 2024-09-21T12:47:20.395 INFO:tasks.workunit.client.0.smithi046.stdout:7/667: symlink d2/d4/df/d42/dd1/ld7 0 2024-09-21T12:47:20.404 INFO:tasks.workunit.client.0.smithi046.stdout:7/668: dwrite d2/d4/df/d6f/d92/f9d [0,4194304] 0 2024-09-21T12:47:20.407 INFO:tasks.workunit.client.0.smithi046.stdout:9/769: mkdir d11/d19/df2 0 2024-09-21T12:47:20.410 INFO:tasks.workunit.client.0.smithi046.stdout:2/584: dwrite d16/d22/f2a [0,4194304] 0 2024-09-21T12:47:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:19 smithi046 ceph-mon[27868]: pgmap v36: 65 pgs: 65 active+clean; 3.0 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 87 MiB/s rd, 224 MiB/s wr, 519 op/s 2024-09-21T12:47:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:8/706: dwrite d1/d12/d53/d60/f81 [0,4194304] 0 2024-09-21T12:47:20.413 INFO:tasks.workunit.client.0.smithi046.stdout:9/770: dread - d11/d19/d1b/d31/feb zero size 2024-09-21T12:47:20.416 INFO:tasks.workunit.client.0.smithi046.stdout:2/585: symlink d16/d22/d4e/d9d/lbd 0 2024-09-21T12:47:20.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/586: write d16/d22/d38/d77/d7a/f98 [343794,88081] 0 2024-09-21T12:47:20.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/669: rename d2/d4/df/d70/d88/d34/lb7 to d2/d4/df/d70/d88/ld8 0 2024-09-21T12:47:20.421 INFO:tasks.workunit.client.0.smithi046.stdout:7/670: write d2/d37/d77/fae [1599756,47846] 0 2024-09-21T12:47:20.423 INFO:tasks.workunit.client.0.smithi046.stdout:7/671: dread - d2/d4/f9f zero size 2024-09-21T12:47:20.424 INFO:tasks.workunit.client.0.smithi046.stdout:5/606: dread d4/dc/d13/d5b/d2d/d3b/f72 [0,4194304] 0 2024-09-21T12:47:20.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/672: write d2/d4/df/d70/db2/fcd [867887,26809] 0 2024-09-21T12:47:20.426 INFO:tasks.workunit.client.0.smithi046.stdout:9/771: mkdir d11/d19/df2/df3 0 2024-09-21T12:47:20.427 INFO:tasks.workunit.client.0.smithi046.stdout:7/673: chown d2/d4/f47 188 1 2024-09-21T12:47:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:5/607: symlink d4/dc/d13/d5b/d2d/d43/d7a/lc1 0 2024-09-21T12:47:20.430 INFO:tasks.workunit.client.0.smithi046.stdout:7/674: write d2/d4/df/d70/d88/d34/f38 [8792336,9197] 0 2024-09-21T12:47:20.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/675: fsync d2/d37/d8a/fcb 0 2024-09-21T12:47:20.433 INFO:tasks.workunit.client.0.smithi046.stdout:9/772: creat d11/d19/d1b/d4b/d91/ff4 x:0 0 0 2024-09-21T12:47:20.435 INFO:tasks.workunit.client.0.smithi046.stdout:9/773: chown d11/d19/d1b/d31/c71 207741937 1 2024-09-21T12:47:20.437 INFO:tasks.workunit.client.0.smithi046.stdout:7/676: symlink d2/d37/d8a/d99/ld9 0 2024-09-21T12:47:20.440 INFO:tasks.workunit.client.0.smithi046.stdout:7/677: write d2/d4/df/d9a/fa0 [1743448,40831] 0 2024-09-21T12:47:20.443 INFO:tasks.workunit.client.0.smithi046.stdout:9/774: dwrite d11/d5b/fc0 [0,4194304] 0 2024-09-21T12:47:20.451 INFO:tasks.workunit.client.0.smithi046.stdout:5/608: dwrite d4/dc/d13/d5b/f3f [0,4194304] 0 2024-09-21T12:47:20.452 INFO:tasks.workunit.client.0.smithi046.stdout:7/678: creat d2/d4/df/d6f/d92/fda x:0 0 0 2024-09-21T12:47:20.455 INFO:tasks.workunit.client.0.smithi046.stdout:8/707: dwrite d1/d12/d46/d35/f73 [0,4194304] 0 2024-09-21T12:47:20.458 INFO:tasks.workunit.client.0.smithi046.stdout:5/609: chown d4/dc/d13/d5b/d2d/d3b/f68 7236374 1 2024-09-21T12:47:20.459 INFO:tasks.workunit.client.0.smithi046.stdout:9/775: dwrite d11/d19/d1b/fdd [0,4194304] 0 2024-09-21T12:47:20.463 INFO:tasks.workunit.client.0.smithi046.stdout:9/776: chown d11/d19/d1b/d31/d53/da4/cef 1149539 1 2024-09-21T12:47:20.465 INFO:tasks.workunit.client.0.smithi046.stdout:8/708: symlink d1/d12/d46/d35/d5b/dd6/lfa 0 2024-09-21T12:47:20.470 INFO:tasks.workunit.client.0.smithi046.stdout:5/610: creat d4/dc/d6b/fc2 x:0 0 0 2024-09-21T12:47:20.472 INFO:tasks.workunit.client.0.smithi046.stdout:9/777: rmdir d11/d5b/d6f/db0/d30 39 2024-09-21T12:47:20.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/778: stat d11/d19/d1b/d31/d53 0 2024-09-21T12:47:20.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/709: dwrite d1/d12/d46/d35/d36/d51/f5a [0,4194304] 0 2024-09-21T12:47:20.479 INFO:tasks.workunit.client.0.smithi046.stdout:5/611: mknod d4/dc/d13/cc3 0 2024-09-21T12:47:20.480 INFO:tasks.workunit.client.0.smithi046.stdout:5/612: stat d4/dc/d13/da2 0 2024-09-21T12:47:20.482 INFO:tasks.workunit.client.0.smithi046.stdout:8/710: fsync d1/ff 0 2024-09-21T12:47:20.482 INFO:tasks.workunit.client.0.smithi046.stdout:5/613: dread d4/dc/d13/d15/d54/f70 [0,4194304] 0 2024-09-21T12:47:20.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/601: sync 2024-09-21T12:47:20.486 INFO:tasks.workunit.client.0.smithi046.stdout:5/614: write d4/dc/d13/d5b/d2d/d3b/f68 [3137769,100745] 0 2024-09-21T12:47:20.488 INFO:tasks.workunit.client.0.smithi046.stdout:5/615: write d4/dc/d13/d15/d90/f46 [2851337,63094] 0 2024-09-21T12:47:20.489 INFO:tasks.workunit.client.0.smithi046.stdout:9/779: dread d11/d19/d1b/d31/d53/d58/fe5 [0,4194304] 0 2024-09-21T12:47:20.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/602: fdatasync d4/d13/f7a 0 2024-09-21T12:47:20.493 INFO:tasks.workunit.client.0.smithi046.stdout:8/711: mkdir d1/d12/d46/d35/d36/d51/d8c/dee/dfb 0 2024-09-21T12:47:20.498 INFO:tasks.workunit.client.0.smithi046.stdout:7/679: dread d2/dd/f3d [4194304,4194304] 0 2024-09-21T12:47:20.561 INFO:tasks.workunit.client.0.smithi046.stdout:5/616: stat d4/l11 0 2024-09-21T12:47:20.562 INFO:tasks.workunit.client.0.smithi046.stdout:9/780: mknod d11/d19/d1b/d31/d53/da4/cf5 0 2024-09-21T12:47:20.563 INFO:tasks.workunit.client.0.smithi046.stdout:8/712: creat d1/d12/d53/d80/ffc x:0 0 0 2024-09-21T12:47:20.566 INFO:tasks.workunit.client.0.smithi046.stdout:7/680: creat d2/d4/df/d42/fdb x:0 0 0 2024-09-21T12:47:20.567 INFO:tasks.workunit.client.0.smithi046.stdout:5/617: creat d4/dc/d13/d5b/d2d/d3b/fc4 x:0 0 0 2024-09-21T12:47:20.570 INFO:tasks.workunit.client.0.smithi046.stdout:5/618: write d4/dc/d13/d5b/d2d/d43/f55 [3753764,75688] 0 2024-09-21T12:47:20.576 INFO:tasks.workunit.client.0.smithi046.stdout:9/781: dread d11/d19/d1b/d1c/f2f [0,4194304] 0 2024-09-21T12:47:20.577 INFO:tasks.workunit.client.0.smithi046.stdout:5/619: mknod d4/cc5 0 2024-09-21T12:47:20.579 INFO:tasks.workunit.client.0.smithi046.stdout:9/782: fdatasync d11/f54 0 2024-09-21T12:47:20.586 INFO:tasks.workunit.client.0.smithi046.stdout:1/603: dwrite d4/d13/d6b/f7b [0,4194304] 0 2024-09-21T12:47:20.588 INFO:tasks.workunit.client.0.smithi046.stdout:9/783: creat d11/d5b/d6f/db0/d30/d79/ff6 x:0 0 0 2024-09-21T12:47:20.588 INFO:tasks.workunit.client.0.smithi046.stdout:1/604: write d4/d13/d38/d53/fa2 [1263058,102497] 0 2024-09-21T12:47:20.589 INFO:tasks.workunit.client.0.smithi046.stdout:9/784: readlink d11/d19/d36/l78 0 2024-09-21T12:47:20.590 INFO:tasks.workunit.client.0.smithi046.stdout:5/620: creat d4/d22/d99/fc6 x:0 0 0 2024-09-21T12:47:20.591 INFO:tasks.workunit.client.0.smithi046.stdout:8/713: dwrite d1/d12/d53/fbe [0,4194304] 0 2024-09-21T12:47:20.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/785: rename d11/d5b/d6f/db0/d30/d3e/dbf/lc2 to d11/lf7 0 2024-09-21T12:47:20.600 INFO:tasks.workunit.client.0.smithi046.stdout:8/714: creat d1/d12/d46/d35/d7d/d6a/dd1/de7/ffd x:0 0 0 2024-09-21T12:47:20.602 INFO:tasks.workunit.client.0.smithi046.stdout:9/786: rmdir d11/d5b/d6f/db0/d30/d3e 39 2024-09-21T12:47:20.603 INFO:tasks.workunit.client.0.smithi046.stdout:8/715: write d1/d12/d46/d35/d36/d51/f5a [14377,71177] 0 2024-09-21T12:47:20.604 INFO:tasks.workunit.client.0.smithi046.stdout:8/716: write d1/d12/d53/dab/ff0 [523176,69920] 0 2024-09-21T12:47:20.606 INFO:tasks.workunit.client.0.smithi046.stdout:5/621: getdents d4/dc/d13/d15/d54 0 2024-09-21T12:47:20.607 INFO:tasks.workunit.client.0.smithi046.stdout:9/787: rmdir d11/d19/d1b/d31/d53 39 2024-09-21T12:47:20.610 INFO:tasks.workunit.client.0.smithi046.stdout:5/622: rename d4/dc/d13/d5e to d4/d22/d99/dc7 0 2024-09-21T12:47:20.611 INFO:tasks.workunit.client.0.smithi046.stdout:8/717: truncate d1/d12/d46/d35/d36/d51/d8c/fa3 658991 0 2024-09-21T12:47:20.615 INFO:tasks.workunit.client.0.smithi046.stdout:9/788: mknod d11/d19/d1b/d31/d53/d84/d8f/cf8 0 2024-09-21T12:47:20.620 INFO:tasks.workunit.client.0.smithi046.stdout:9/789: mknod d11/d19/d36/d45/d6e/cf9 0 2024-09-21T12:47:20.621 INFO:tasks.workunit.client.0.smithi046.stdout:5/623: dread d4/dc/d13/d5b/f3f [4194304,4194304] 0 2024-09-21T12:47:20.623 INFO:tasks.workunit.client.0.smithi046.stdout:9/790: write d11/d19/d1b/d31/d53/da4/fd4 [828222,24079] 0 2024-09-21T12:47:20.625 INFO:tasks.workunit.client.0.smithi046.stdout:0/730: sync 2024-09-21T12:47:20.626 INFO:tasks.workunit.client.0.smithi046.stdout:8/718: write d1/d12/d46/f91 [484240,116936] 0 2024-09-21T12:47:20.628 INFO:tasks.workunit.client.0.smithi046.stdout:5/624: write d4/d22/d10/d1a/f77 [4205859,913] 0 2024-09-21T12:47:20.629 INFO:tasks.workunit.client.0.smithi046.stdout:8/719: chown d1/d12/d46/d35/d36/d51/d8c/fd0 1156 1 2024-09-21T12:47:20.635 INFO:tasks.workunit.client.0.smithi046.stdout:8/720: creat d1/d12/d53/ffe x:0 0 0 2024-09-21T12:47:20.636 INFO:tasks.workunit.client.0.smithi046.stdout:5/625: write d4/dc/d13/d5b/d2d/d3b/f72 [52450,13224] 0 2024-09-21T12:47:20.640 INFO:tasks.workunit.client.0.smithi046.stdout:0/731: dwrite d6/d7/d13/d49/f9f [0,4194304] 0 2024-09-21T12:47:20.640 INFO:tasks.workunit.client.0.smithi046.stdout:9/791: creat d11/d5b/d6f/db0/d30/ffa x:0 0 0 2024-09-21T12:47:20.641 INFO:tasks.workunit.client.0.smithi046.stdout:5/626: write d4/dc/d13/d15/f84 [2011801,43448] 0 2024-09-21T12:47:20.642 INFO:tasks.workunit.client.0.smithi046.stdout:0/732: write d6/d7/d37/faa [246146,23639] 0 2024-09-21T12:47:20.643 INFO:tasks.workunit.client.0.smithi046.stdout:9/792: fsync f4 0 2024-09-21T12:47:20.644 INFO:tasks.workunit.client.0.smithi046.stdout:8/721: truncate d1/d12/d46/d35/d7d/f42 2112573 0 2024-09-21T12:47:20.646 INFO:tasks.workunit.client.0.smithi046.stdout:5/627: creat d4/dc/d45/d94/fc8 x:0 0 0 2024-09-21T12:47:20.649 INFO:tasks.workunit.client.0.smithi046.stdout:0/733: unlink d6/d2f/fc8 0 2024-09-21T12:47:20.652 INFO:tasks.workunit.client.0.smithi046.stdout:0/734: dread - d6/d7/d13/d43/d52/d63/f96 zero size 2024-09-21T12:47:20.652 INFO:tasks.workunit.client.0.smithi046.stdout:8/722: dread d1/d12/d46/f7e [0,4194304] 0 2024-09-21T12:47:20.653 INFO:tasks.workunit.client.0.smithi046.stdout:9/793: dwrite d11/d19/d1b/d31/d53/d84/fe6 [0,4194304] 0 2024-09-21T12:47:20.653 INFO:tasks.workunit.client.0.smithi046.stdout:5/628: write d4/d22/d10/fb4 [948678,87585] 0 2024-09-21T12:47:20.655 INFO:tasks.workunit.client.0.smithi046.stdout:0/735: write d6/f3c [362369,83610] 0 2024-09-21T12:47:20.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/794: chown d11/d19/d1b/d31/d53 5998 1 2024-09-21T12:47:20.659 INFO:tasks.workunit.client.0.smithi046.stdout:8/723: read d1/d12/d53/dab/ff0 [481479,86041] 0 2024-09-21T12:47:20.662 INFO:tasks.workunit.client.0.smithi046.stdout:0/736: creat d6/d2f/f10d x:0 0 0 2024-09-21T12:47:20.668 INFO:tasks.workunit.client.0.smithi046.stdout:8/724: creat d1/d12/d46/d35/d7d/d6a/dd1/fff x:0 0 0 2024-09-21T12:47:20.671 INFO:tasks.workunit.client.0.smithi046.stdout:0/737: creat d6/f10e x:0 0 0 2024-09-21T12:47:20.678 INFO:tasks.workunit.client.0.smithi046.stdout:9/795: creat d11/d19/d36/d45/ffb x:0 0 0 2024-09-21T12:47:20.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/738: dwrite d6/d2f/f10d [0,4194304] 0 2024-09-21T12:47:20.680 INFO:tasks.workunit.client.0.smithi046.stdout:5/629: truncate d4/d22/d10/f52 1659774 0 2024-09-21T12:47:20.687 INFO:tasks.workunit.client.0.smithi046.stdout:8/725: dwrite d1/d12/d46/d35/d36/dc6/fa7 [0,4194304] 0 2024-09-21T12:47:20.690 INFO:tasks.workunit.client.0.smithi046.stdout:0/739: rename d6/d7/d13/d43/d52/d8c/f102 to d6/f10f 0 2024-09-21T12:47:20.691 INFO:tasks.workunit.client.0.smithi046.stdout:0/740: write d6/d7/d13/d72/d10a/f10b [95143,32012] 0 2024-09-21T12:47:20.703 INFO:tasks.workunit.client.0.smithi046.stdout:9/796: dwrite d11/d19/f24 [4194304,4194304] 0 2024-09-21T12:47:20.711 INFO:tasks.workunit.client.0.smithi046.stdout:5/630: getdents d4/d22 0 2024-09-21T12:47:20.712 INFO:tasks.workunit.client.0.smithi046.stdout:0/741: write d6/d7/d13/d7b/da2/f27 [529075,120439] 0 2024-09-21T12:47:20.715 INFO:tasks.workunit.client.0.smithi046.stdout:9/797: unlink d11/d19/d1b/d4b/f8d 0 2024-09-21T12:47:20.716 INFO:tasks.workunit.client.0.smithi046.stdout:8/726: getdents d1/d12/d46/d35/d7d/d6a/dd1/de7 0 2024-09-21T12:47:20.716 INFO:tasks.workunit.client.0.smithi046.stdout:9/798: write fb [1440112,15885] 0 2024-09-21T12:47:20.722 INFO:tasks.workunit.client.0.smithi046.stdout:5/631: mknod d4/dc/d13/d5b/cc9 0 2024-09-21T12:47:20.726 INFO:tasks.workunit.client.0.smithi046.stdout:9/799: dwrite d11/d5b/d6f/db0/d74/fa1 [0,4194304] 0 2024-09-21T12:47:20.728 INFO:tasks.workunit.client.0.smithi046.stdout:5/632: symlink d4/d22/d99/lca 0 2024-09-21T12:47:20.728 INFO:tasks.workunit.client.0.smithi046.stdout:8/727: write d1/d12/d46/d35/d36/d51/d8c/fa3 [228657,32077] 0 2024-09-21T12:47:20.730 INFO:tasks.workunit.client.0.smithi046.stdout:8/728: fsync d1/d12/d53/fd4 0 2024-09-21T12:47:20.731 INFO:tasks.workunit.client.0.smithi046.stdout:0/742: dread d6/d60/f89 [0,4194304] 0 2024-09-21T12:47:20.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/743: mkdir d6/d7/d13/d43/d52/d63/d7f/d110 0 2024-09-21T12:47:20.741 INFO:tasks.workunit.client.0.smithi046.stdout:0/744: chown d6/d7/d13/d7b/da2/f33 110111026 1 2024-09-21T12:47:20.742 INFO:tasks.workunit.client.0.smithi046.stdout:9/800: link d11/d19/d1b/d31/d53/d5e/c7e d11/d5b/d6f/db0/d74/cfc 0 2024-09-21T12:47:20.742 INFO:tasks.workunit.client.0.smithi046.stdout:8/729: getdents d1/d12/d46/d35/d36 0 2024-09-21T12:47:20.744 INFO:tasks.workunit.client.0.smithi046.stdout:8/730: chown d1/d12/d46/d35/d5b/dd6/lfa 41 1 2024-09-21T12:47:20.746 INFO:tasks.workunit.client.0.smithi046.stdout:8/731: write d1/d12/d53/dab/ff0 [1077443,94991] 0 2024-09-21T12:47:20.748 INFO:tasks.workunit.client.0.smithi046.stdout:9/801: mkdir d11/d19/d36/d45/dfd 0 2024-09-21T12:47:20.749 INFO:tasks.workunit.client.0.smithi046.stdout:8/732: write d1/d12/d46/d35/d36/f4e [1893832,115606] 0 2024-09-21T12:47:20.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/745: creat d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f111 x:0 0 0 2024-09-21T12:47:20.752 INFO:tasks.workunit.client.0.smithi046.stdout:5/633: dread d4/d22/d10/d1a/f77 [0,4194304] 0 2024-09-21T12:47:20.755 INFO:tasks.workunit.client.0.smithi046.stdout:5/634: mknod d4/dc/d45/ccb 0 2024-09-21T12:47:20.756 INFO:tasks.workunit.client.0.smithi046.stdout:5/635: readlink d4/dc/d13/d5b/d2d/d43/d7a/lc1 0 2024-09-21T12:47:20.762 INFO:tasks.workunit.client.0.smithi046.stdout:5/636: rename d4/d22/d10/fb4 to d4/dc/d13/d5b/d2d/fcc 0 2024-09-21T12:47:20.763 INFO:tasks.workunit.client.0.smithi046.stdout:5/637: chown d4/dc/d13/d15/f7f 2016 1 2024-09-21T12:47:20.766 INFO:tasks.workunit.client.0.smithi046.stdout:5/638: rename d4/dc/d13/d15/d54/fbd to d4/d22/d99/d9d/fcd 0 2024-09-21T12:47:20.773 INFO:tasks.workunit.client.0.smithi046.stdout:5/639: dwrite d4/dc/d13/d15/fa0 [0,4194304] 0 2024-09-21T12:47:20.774 INFO:tasks.workunit.client.0.smithi046.stdout:5/640: dread - d4/dc/d13/d15/d90/f93 zero size 2024-09-21T12:47:20.777 INFO:tasks.workunit.client.0.smithi046.stdout:5/641: mkdir d4/dc/d13/da2/dce 0 2024-09-21T12:47:20.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/642: symlink d4/dc/d13/lcf 0 2024-09-21T12:47:20.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/643: chown d4/dc/d45/f49 2802 1 2024-09-21T12:47:20.783 INFO:tasks.workunit.client.0.smithi046.stdout:5/644: creat d4/fd0 x:0 0 0 2024-09-21T12:47:20.791 INFO:tasks.workunit.client.0.smithi046.stdout:5/645: dwrite d4/dc/d13/d5b/d2d/fcc [0,4194304] 0 2024-09-21T12:47:20.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/646: rename d4/dc/d13/d5b/d2d/d3b/c6f to d4/d22/d99/dc7/cd1 0 2024-09-21T12:47:20.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/647: creat d4/d22/fd2 x:0 0 0 2024-09-21T12:47:20.822 INFO:tasks.workunit.client.0.smithi046.stdout:5/648: fsync d4/d22/d10/d1a/f1c 0 2024-09-21T12:47:20.823 INFO:tasks.workunit.client.0.smithi046.stdout:5/649: stat d4/d22/d10/d1a/f1c 0 2024-09-21T12:47:20.826 INFO:tasks.workunit.client.0.smithi046.stdout:5/650: creat d4/dc/d45/fd3 x:0 0 0 2024-09-21T12:47:20.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/651: unlink d4/dc/d13/da2/lb6 0 2024-09-21T12:47:20.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/652: readlink d4/dc/d13/d5b/d2d/d43/d7a/l74 0 2024-09-21T12:47:20.837 INFO:tasks.workunit.client.0.smithi046.stdout:5/653: unlink d4/dc/d13/cb8 0 2024-09-21T12:47:20.842 INFO:tasks.workunit.client.0.smithi046.stdout:5/654: rename d4/dc/d13/d5b/d2d/fcc to d4/dc/d13/da2/fd4 0 2024-09-21T12:47:20.852 INFO:tasks.workunit.client.0.smithi046.stdout:5/655: getdents d4/d22/d99/dc7 0 2024-09-21T12:47:20.853 INFO:tasks.workunit.client.0.smithi046.stdout:5/656: chown d4/l11 155681383 1 2024-09-21T12:47:20.854 INFO:tasks.workunit.client.0.smithi046.stdout:5/657: dread - d4/d22/d10/faa zero size 2024-09-21T12:47:20.855 INFO:tasks.workunit.client.0.smithi046.stdout:5/658: chown d4/dc/d13/d15/d54 6128 1 2024-09-21T12:47:20.856 INFO:tasks.workunit.client.0.smithi046.stdout:5/659: chown d4/dc/fa6 1360340964 1 2024-09-21T12:47:20.865 INFO:tasks.workunit.client.0.smithi046.stdout:5/660: link d4/dc/d45/ccb d4/dc/d13/d5b/d2d/d43/d7a/cd5 0 2024-09-21T12:47:20.867 INFO:tasks.workunit.client.0.smithi046.stdout:5/661: write d4/dc/d13/d15/f7f [4598187,120062] 0 2024-09-21T12:47:20.868 INFO:tasks.workunit.client.0.smithi046.stdout:5/662: chown d4/dc/d45/f49 156472 1 2024-09-21T12:47:20.917 INFO:tasks.workunit.client.0.smithi046.stdout:3/524: sync 2024-09-21T12:47:20.917 INFO:tasks.workunit.client.0.smithi046.stdout:4/678: sync 2024-09-21T12:47:20.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/587: sync 2024-09-21T12:47:20.917 INFO:tasks.workunit.client.0.smithi046.stdout:6/599: sync 2024-09-21T12:47:20.918 INFO:tasks.workunit.client.0.smithi046.stdout:6/600: stat de/d2a/d4d/f79 0 2024-09-21T12:47:20.918 INFO:tasks.workunit.client.0.smithi046.stdout:2/588: stat d16/d22/d2b/d30/d8f/f9c 0 2024-09-21T12:47:20.918 INFO:tasks.workunit.client.0.smithi046.stdout:4/679: stat d1/d13/d25/d29/d33/f41 0 2024-09-21T12:47:20.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/680: write d1/d13/d25/d29/d43/f6c [2340754,94906] 0 2024-09-21T12:47:20.925 INFO:tasks.workunit.client.0.smithi046.stdout:6/601: creat de/d2a/d4c/d69/fc3 x:0 0 0 2024-09-21T12:47:20.926 INFO:tasks.workunit.client.0.smithi046.stdout:6/602: chown de/d2a/f9c 16726943 1 2024-09-21T12:47:20.926 INFO:tasks.workunit.client.0.smithi046.stdout:3/525: dwrite d5/dc/d26/d3c/d44/f4b [4194304,4194304] 0 2024-09-21T12:47:20.928 INFO:tasks.workunit.client.0.smithi046.stdout:2/589: link d16/d22/d2b/d30/f58 d16/d22/d38/d77/d9e/fbe 0 2024-09-21T12:47:20.930 INFO:tasks.workunit.client.0.smithi046.stdout:4/681: mknod d1/d13/d25/d29/d33/ce3 0 2024-09-21T12:47:20.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/526: rmdir d5/dc/d28 39 2024-09-21T12:47:20.934 INFO:tasks.workunit.client.0.smithi046.stdout:2/590: creat d16/d5c/d63/fbf x:0 0 0 2024-09-21T12:47:20.937 INFO:tasks.workunit.client.0.smithi046.stdout:6/603: creat de/d2a/d4c/d77/dae/fc4 x:0 0 0 2024-09-21T12:47:20.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/591: dread - d16/d5c/d63/f6b zero size 2024-09-21T12:47:20.944 INFO:tasks.workunit.client.0.smithi046.stdout:4/682: rename d1/d13/c28 to d1/d13/d25/d29/d43/d84/daa/ce4 0 2024-09-21T12:47:20.945 INFO:tasks.workunit.client.0.smithi046.stdout:2/592: symlink d16/d22/d7f/lc0 0 2024-09-21T12:47:20.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/527: dwrite d5/dc/d28/d60/fae [0,4194304] 0 2024-09-21T12:47:20.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/528: mknod d5/dc/d30/d7c/cb8 0 2024-09-21T12:47:20.951 INFO:tasks.workunit.client.0.smithi046.stdout:2/593: dread d16/d22/d2b/d30/d67/fab [0,4194304] 0 2024-09-21T12:47:20.957 INFO:tasks.workunit.client.0.smithi046.stdout:4/683: link d1/l8 d1/d27/d82/le5 0 2024-09-21T12:47:20.958 INFO:tasks.workunit.client.0.smithi046.stdout:4/684: chown d1/d27/d58/db7 33841 1 2024-09-21T12:47:20.959 INFO:tasks.workunit.client.0.smithi046.stdout:4/685: fsync d1/d27/d37/fb3 0 2024-09-21T12:47:20.967 INFO:tasks.workunit.client.0.smithi046.stdout:4/686: mkdir d1/d85/de6 0 2024-09-21T12:47:20.976 INFO:tasks.workunit.client.0.smithi046.stdout:4/687: getdents d1/d27/d82/da8 0 2024-09-21T12:47:20.977 INFO:tasks.workunit.client.0.smithi046.stdout:4/688: fsync d1/f5d 0 2024-09-21T12:47:20.980 INFO:tasks.workunit.client.0.smithi046.stdout:4/689: symlink d1/d13/d25/d29/d43/d84/daa/le7 0 2024-09-21T12:47:20.981 INFO:tasks.workunit.client.0.smithi046.stdout:6/604: write de/d2a/f68 [1045977,38554] 0 2024-09-21T12:47:20.984 INFO:tasks.workunit.client.0.smithi046.stdout:2/594: getdents d16/d22/d7f 0 2024-09-21T12:47:20.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/690: mknod d1/d27/d82/da8/ce8 0 2024-09-21T12:47:20.985 INFO:tasks.workunit.client.0.smithi046.stdout:2/595: read - d16/d22/d2b/d30/d67/fa9 zero size 2024-09-21T12:47:20.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/691: stat d1/d13/d25/c1f 0 2024-09-21T12:47:20.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/605: mknod de/d2a/d4d/cc5 0 2024-09-21T12:47:20.987 INFO:tasks.workunit.client.0.smithi046.stdout:4/692: fdatasync d1/d27/d37/d66/fa0 0 2024-09-21T12:47:20.988 INFO:tasks.workunit.client.0.smithi046.stdout:2/596: mkdir d16/d22/d7f/dc1 0 2024-09-21T12:47:20.989 INFO:tasks.workunit.client.0.smithi046.stdout:3/529: write d5/dc/d26/d3c/d44/f5d [1384892,27862] 0 2024-09-21T12:47:20.994 INFO:tasks.workunit.client.0.smithi046.stdout:4/693: dread d1/d13/d25/d29/d43/f6c [0,4194304] 0 2024-09-21T12:47:20.995 INFO:tasks.workunit.client.0.smithi046.stdout:6/606: creat de/d2a/d4c/d71/fc6 x:0 0 0 2024-09-21T12:47:20.996 INFO:tasks.workunit.client.0.smithi046.stdout:2/597: dwrite d16/d22/d2b/d30/d8f/f9c [0,4194304] 0 2024-09-21T12:47:20.999 INFO:tasks.workunit.client.0.smithi046.stdout:4/694: symlink d1/d27/d82/da8/le9 0 2024-09-21T12:47:21.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/530: link d5/f85 d5/dc/d28/d63/fb9 0 2024-09-21T12:47:21.006 INFO:tasks.workunit.client.0.smithi046.stdout:2/598: dread - d16/d22/d2b/d30/d67/f69 zero size 2024-09-21T12:47:21.009 INFO:tasks.workunit.client.0.smithi046.stdout:3/531: unlink d5/d16/d5f/d6c/f8f 0 2024-09-21T12:47:21.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/532: mknod d5/dc/d30/d7c/cba 0 2024-09-21T12:47:21.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/607: write de/f20 [651376,13872] 0 2024-09-21T12:47:21.017 INFO:tasks.workunit.client.0.smithi046.stdout:2/599: getdents d16/d22/d2b/d30/d67 0 2024-09-21T12:47:21.019 INFO:tasks.workunit.client.0.smithi046.stdout:4/695: dread d1/d13/d25/f1e [0,4194304] 0 2024-09-21T12:47:21.022 INFO:tasks.workunit.client.0.smithi046.stdout:3/533: rename d5/f6f to d5/dc/d30/d34/fbb 0 2024-09-21T12:47:21.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/608: write de/d2a/d4d/f74 [425155,93943] 0 2024-09-21T12:47:21.029 INFO:tasks.workunit.client.0.smithi046.stdout:2/600: rename d16/d22/c28 to d16/d22/d7f/cc2 0 2024-09-21T12:47:21.031 INFO:tasks.workunit.client.0.smithi046.stdout:3/534: link d5/dc/d30/f39 d5/dc/d26/d3c/fbc 0 2024-09-21T12:47:21.031 INFO:tasks.workunit.client.0.smithi046.stdout:4/696: truncate d1/d13/d25/d29/f2f 2445849 0 2024-09-21T12:47:21.031 INFO:tasks.workunit.client.0.smithi046.stdout:3/535: fsync d5/dc/d26/d3c/f51 0 2024-09-21T12:47:21.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/609: truncate de/d2a/f9c 268489 0 2024-09-21T12:47:21.037 INFO:tasks.workunit.client.0.smithi046.stdout:6/610: dread - de/d2a/d4c/d69/f64 zero size 2024-09-21T12:47:21.040 INFO:tasks.workunit.client.0.smithi046.stdout:4/697: dread d1/d13/d25/d29/d43/f6c [0,4194304] 0 2024-09-21T12:47:21.046 INFO:tasks.workunit.client.0.smithi046.stdout:4/698: dread d1/d13/d25/d29/d33/f76 [0,4194304] 0 2024-09-21T12:47:21.050 INFO:tasks.workunit.client.0.smithi046.stdout:6/611: dread de/d2a/d4c/d69/f65 [0,4194304] 0 2024-09-21T12:47:21.058 INFO:tasks.workunit.client.0.smithi046.stdout:4/699: dread d1/f26 [0,4194304] 0 2024-09-21T12:47:21.058 INFO:tasks.workunit.client.0.smithi046.stdout:3/536: mknod d5/d16/cbd 0 2024-09-21T12:47:21.063 INFO:tasks.workunit.client.0.smithi046.stdout:6/612: unlink de/d2a/d4c/d71/d7c/c8b 0 2024-09-21T12:47:21.067 INFO:tasks.workunit.client.0.smithi046.stdout:4/700: dread d1/d27/d58/f4f [0,4194304] 0 2024-09-21T12:47:21.071 INFO:tasks.workunit.client.0.smithi046.stdout:3/537: mknod d5/dc/d30/cbe 0 2024-09-21T12:47:21.073 INFO:tasks.workunit.client.0.smithi046.stdout:4/701: dread - d1/d27/f9f zero size 2024-09-21T12:47:21.075 INFO:tasks.workunit.client.0.smithi046.stdout:4/702: stat d1/d13/d25/d29/d33/c8d 0 2024-09-21T12:47:21.076 INFO:tasks.workunit.client.0.smithi046.stdout:4/703: write d1/d13/d25/d29/f54 [3357329,16629] 0 2024-09-21T12:47:21.077 INFO:tasks.workunit.client.0.smithi046.stdout:3/538: symlink d5/lbf 0 2024-09-21T12:47:21.080 INFO:tasks.workunit.client.0.smithi046.stdout:6/613: rename de/d2a/d4c/d77/d98/ca3 to de/d2a/d4c/cc7 0 2024-09-21T12:47:21.083 INFO:tasks.workunit.client.0.smithi046.stdout:4/704: rename d1/d27/f61 to d1/d13/d25/d29/d45/fea 0 2024-09-21T12:47:21.086 INFO:tasks.workunit.client.0.smithi046.stdout:6/614: mkdir de/d2a/d4c/d77/dc0/dc8 0 2024-09-21T12:47:21.088 INFO:tasks.workunit.client.0.smithi046.stdout:3/539: rename d5/dc/d26/d3c/f9b to d5/dc/d30/d34/fc0 0 2024-09-21T12:47:21.089 INFO:tasks.workunit.client.0.smithi046.stdout:3/540: truncate d5/d16/f1e 4999081 0 2024-09-21T12:47:21.090 INFO:tasks.workunit.client.0.smithi046.stdout:3/541: dread - d5/d5e/d8e/f9c zero size 2024-09-21T12:47:21.092 INFO:tasks.workunit.client.0.smithi046.stdout:6/615: symlink de/d2a/lc9 0 2024-09-21T12:47:21.093 INFO:tasks.workunit.client.0.smithi046.stdout:6/616: fsync de/d2a/d4c/d77/d8f/fa8 0 2024-09-21T12:47:21.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/705: getdents d1/d13 0 2024-09-21T12:47:21.097 INFO:tasks.workunit.client.0.smithi046.stdout:4/706: chown d1/d27/d82 4125 1 2024-09-21T12:47:21.097 INFO:tasks.workunit.client.0.smithi046.stdout:6/617: rename de/d2a/d4c/d77/dae/d55/f9f to de/d2a/d4c/d77/d8f/fca 0 2024-09-21T12:47:21.099 INFO:tasks.workunit.client.0.smithi046.stdout:3/542: creat d5/dc/fc1 x:0 0 0 2024-09-21T12:47:21.100 INFO:tasks.workunit.client.0.smithi046.stdout:3/543: fsync d5/dc/d28/d60/d6e/f7a 0 2024-09-21T12:47:21.107 INFO:tasks.workunit.client.0.smithi046.stdout:6/618: read de/d2a/d4c/d71/f93 [3995633,84038] 0 2024-09-21T12:47:21.107 INFO:tasks.workunit.client.0.smithi046.stdout:3/544: mknod d5/d5e/d8e/db5/cc2 0 2024-09-21T12:47:21.108 INFO:tasks.workunit.client.0.smithi046.stdout:3/545: chown d5/dc/d26 3 1 2024-09-21T12:47:21.108 INFO:tasks.workunit.client.0.smithi046.stdout:6/619: chown de/d2a/f2f 10475710 1 2024-09-21T12:47:21.110 INFO:tasks.workunit.client.0.smithi046.stdout:3/546: rmdir d5/dc/d30/d34 39 2024-09-21T12:47:21.111 INFO:tasks.workunit.client.0.smithi046.stdout:6/620: creat de/d48/fcb x:0 0 0 2024-09-21T12:47:21.112 INFO:tasks.workunit.client.0.smithi046.stdout:3/547: read d5/dc/d26/f4f [479554,5405] 0 2024-09-21T12:47:21.113 INFO:tasks.workunit.client.0.smithi046.stdout:4/707: dwrite d1/d27/d46/f77 [4194304,4194304] 0 2024-09-21T12:47:21.114 INFO:tasks.workunit.client.0.smithi046.stdout:6/621: dread de/f4b [0,4194304] 0 2024-09-21T12:47:21.119 INFO:tasks.workunit.client.0.smithi046.stdout:3/548: mknod d5/dc/d26/d3c/d44/cc3 0 2024-09-21T12:47:21.121 INFO:tasks.workunit.client.0.smithi046.stdout:3/549: write d5/dc/d26/f78 [1380863,32240] 0 2024-09-21T12:47:21.121 INFO:tasks.workunit.client.0.smithi046.stdout:4/708: dwrite d1/d27/d82/da8/fcf [0,4194304] 0 2024-09-21T12:47:21.125 INFO:tasks.workunit.client.0.smithi046.stdout:3/550: creat d5/d16/d5f/d6c/fc4 x:0 0 0 2024-09-21T12:47:21.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/709: dwrite d1/d27/d46/d78/fa4 [0,4194304] 0 2024-09-21T12:47:21.135 INFO:tasks.workunit.client.0.smithi046.stdout:4/710: dread d1/d27/d82/fd7 [0,4194304] 0 2024-09-21T12:47:21.137 INFO:tasks.workunit.client.0.smithi046.stdout:3/551: link d5/dc/d30/fb6 d5/dc/d30/fc5 0 2024-09-21T12:47:21.138 INFO:tasks.workunit.client.0.smithi046.stdout:4/711: rmdir d1/d13/d25/d29/d33 39 2024-09-21T12:47:21.143 INFO:tasks.workunit.client.0.smithi046.stdout:3/552: rename d5/dc/d30/fc5 to d5/dc/d28/fc6 0 2024-09-21T12:47:21.148 INFO:tasks.workunit.client.0.smithi046.stdout:6/622: dread de/d2a/d4c/d77/fa1 [0,4194304] 0 2024-09-21T12:47:21.149 INFO:tasks.workunit.client.0.smithi046.stdout:4/712: dwrite d1/d13/d25/d29/d43/f7a [0,4194304] 0 2024-09-21T12:47:21.154 INFO:tasks.workunit.client.0.smithi046.stdout:3/553: dwrite d5/dc/d26/f3d [4194304,4194304] 0 2024-09-21T12:47:21.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/554: chown d5/dc/d28/d63/c72 35502 1 2024-09-21T12:47:21.156 INFO:tasks.workunit.client.0.smithi046.stdout:4/713: symlink d1/d27/d82/da8/leb 0 2024-09-21T12:47:21.159 INFO:tasks.workunit.client.0.smithi046.stdout:3/555: dread - d5/dc/d30/d34/fc0 zero size 2024-09-21T12:47:21.163 INFO:tasks.workunit.client.0.smithi046.stdout:6/623: link de/d2a/d4c/d77/d98/lac de/d2a/d4c/d77/dc0/lcc 0 2024-09-21T12:47:21.167 INFO:tasks.workunit.client.0.smithi046.stdout:4/714: write d1/f35 [3674032,11268] 0 2024-09-21T12:47:21.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/715: dread d1/d27/d37/f63 [0,4194304] 0 2024-09-21T12:47:21.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/716: mkdir d1/d13/d25/d3a/dec 0 2024-09-21T12:47:21.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/717: write d1/f39 [1675708,26938] 0 2024-09-21T12:47:21.181 INFO:tasks.workunit.client.0.smithi046.stdout:4/718: stat d1/d13/d25/d29/d33/f76 0 2024-09-21T12:47:21.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/719: mknod d1/d13/d25/d29/d33/ced 0 2024-09-21T12:47:21.185 INFO:tasks.workunit.client.0.smithi046.stdout:4/720: mkdir d1/d27/d37/d66/dee 0 2024-09-21T12:47:21.185 INFO:tasks.workunit.client.0.smithi046.stdout:4/721: stat d1/f5d 0 2024-09-21T12:47:21.189 INFO:tasks.workunit.client.0.smithi046.stdout:4/722: getdents d1/d27/d37/d8f 0 2024-09-21T12:47:21.195 INFO:tasks.workunit.client.0.smithi046.stdout:4/723: write d1/d27/d37/f49 [700212,123495] 0 2024-09-21T12:47:21.197 INFO:tasks.workunit.client.0.smithi046.stdout:4/724: mkdir d1/d27/d37/d8f/def 0 2024-09-21T12:47:21.199 INFO:tasks.workunit.client.0.smithi046.stdout:4/725: symlink d1/d85/lf0 0 2024-09-21T12:47:21.201 INFO:tasks.workunit.client.0.smithi046.stdout:4/726: symlink d1/d13/d25/d29/d33/dca/lf1 0 2024-09-21T12:47:21.204 INFO:tasks.workunit.client.0.smithi046.stdout:4/727: symlink d1/d13/d25/d29/d43/d84/daa/lf2 0 2024-09-21T12:47:21.208 INFO:tasks.workunit.client.0.smithi046.stdout:4/728: getdents d1/d27/d46/d78 0 2024-09-21T12:47:21.217 INFO:tasks.workunit.client.0.smithi046.stdout:4/729: write d1/d13/d25/d29/d45/fea [174859,35433] 0 2024-09-21T12:47:21.218 INFO:tasks.workunit.client.0.smithi046.stdout:4/730: dread - d1/d13/d25/d3a/fdd zero size 2024-09-21T12:47:21.219 INFO:tasks.workunit.client.0.smithi046.stdout:4/731: readlink d1/d27/d82/ld8 0 2024-09-21T12:47:21.221 INFO:tasks.workunit.client.0.smithi046.stdout:4/732: mkdir d1/d27/d37/d66/df3 0 2024-09-21T12:47:21.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/733: chown d1/d13/d25/d29/d43/d84/fa6 176478 1 2024-09-21T12:47:21.227 INFO:tasks.workunit.client.0.smithi046.stdout:4/734: dwrite d1/f26 [0,4194304] 0 2024-09-21T12:47:21.229 INFO:tasks.workunit.client.0.smithi046.stdout:4/735: read d1/d13/d25/d29/f42 [375366,37297] 0 2024-09-21T12:47:21.231 INFO:tasks.workunit.client.0.smithi046.stdout:4/736: chown d1/d85/ca5 46484 1 2024-09-21T12:47:21.232 INFO:tasks.workunit.client.0.smithi046.stdout:4/737: chown d1/d13/d25/d3a/fa1 616 1 2024-09-21T12:47:21.234 INFO:tasks.workunit.client.0.smithi046.stdout:4/738: dread d1/d13/d4e/fd2 [0,4194304] 0 2024-09-21T12:47:21.236 INFO:tasks.workunit.client.0.smithi046.stdout:4/739: truncate d1/d27/d46/f77 8407509 0 2024-09-21T12:47:21.243 INFO:tasks.workunit.client.0.smithi046.stdout:4/740: write d1/ff [5949015,89890] 0 2024-09-21T12:47:21.245 INFO:tasks.workunit.client.0.smithi046.stdout:4/741: write d1/d27/d46/d78/fa4 [2023429,8303] 0 2024-09-21T12:47:21.247 INFO:tasks.workunit.client.0.smithi046.stdout:4/742: rmdir d1/d27/d46/d78/d8a 39 2024-09-21T12:47:21.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/743: unlink d1/d13/d25/d3a/f3c 0 2024-09-21T12:47:21.257 INFO:tasks.workunit.client.0.smithi046.stdout:4/744: link d1/d13/d25/d29/d33/f62 d1/d27/d37/d66/dee/ff4 0 2024-09-21T12:47:21.260 INFO:tasks.workunit.client.0.smithi046.stdout:4/745: unlink d1/d27/d58/f5c 0 2024-09-21T12:47:21.262 INFO:tasks.workunit.client.0.smithi046.stdout:4/746: mknod d1/d13/d25/d29/d43/cf5 0 2024-09-21T12:47:21.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/681: sync 2024-09-21T12:47:21.504 INFO:tasks.workunit.client.0.smithi046.stdout:7/682: chown d2/d4/df/d70/db2/fcd 56256554 1 2024-09-21T12:47:21.509 INFO:tasks.workunit.client.0.smithi046.stdout:7/683: unlink d2/d4/d97/fab 0 2024-09-21T12:47:21.526 INFO:tasks.workunit.client.0.smithi046.stdout:7/684: dwrite d2/d4/f3c [4194304,4194304] 0 2024-09-21T12:47:21.531 INFO:tasks.workunit.client.0.smithi046.stdout:7/685: symlink d2/d4/df/d6f/ldc 0 2024-09-21T12:47:21.545 INFO:tasks.workunit.client.0.smithi046.stdout:7/686: dwrite d2/d37/f4d [0,4194304] 0 2024-09-21T12:47:21.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/687: write d2/fa4 [129260,73225] 0 2024-09-21T12:47:21.555 INFO:tasks.workunit.client.0.smithi046.stdout:7/688: truncate d2/d4/df/d42/f49 4428272 0 2024-09-21T12:47:21.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/689: link d2/d4/df/d70/d88/d34/d7f/cd2 d2/d4/df/d70/db2/dc5/cdd 0 2024-09-21T12:47:21.579 INFO:tasks.workunit.client.0.smithi046.stdout:7/690: dread d2/d4/df/d42/f49 [0,4194304] 0 2024-09-21T12:47:21.582 INFO:tasks.workunit.client.0.smithi046.stdout:7/691: creat d2/d37/d77/fde x:0 0 0 2024-09-21T12:47:21.583 INFO:tasks.workunit.client.0.smithi046.stdout:7/692: write d2/d4/df/d70/d88/d34/f48 [501405,125600] 0 2024-09-21T12:47:21.584 INFO:tasks.workunit.client.0.smithi046.stdout:7/693: chown d2/d4/df/d70/d88/d34 678 1 2024-09-21T12:47:21.595 INFO:tasks.workunit.client.0.smithi046.stdout:7/694: dread d2/d4/df/d70/d88/d34/f38 [0,4194304] 0 2024-09-21T12:47:21.598 INFO:tasks.workunit.client.0.smithi046.stdout:7/695: rmdir d2/d4/d43 39 2024-09-21T12:47:21.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/696: dread d2/d4/f3c [0,4194304] 0 2024-09-21T12:47:21.616 INFO:tasks.workunit.client.0.smithi046.stdout:7/697: rename d2/d4/df/d70/d88/d34/d7f/db4 to d2/d37/d8a/ddf 0 2024-09-21T12:47:21.619 INFO:tasks.workunit.client.0.smithi046.stdout:7/698: unlink d2/d4/df/d17/c36 0 2024-09-21T12:47:21.622 INFO:tasks.workunit.client.0.smithi046.stdout:7/699: getdents d2/d37/d8a/d99/dbe 0 2024-09-21T12:47:21.623 INFO:tasks.workunit.client.0.smithi046.stdout:7/700: dread - d2/d4/f9f zero size 2024-09-21T12:47:21.680 INFO:tasks.workunit.client.0.smithi046.stdout:7/701: truncate d2/dd/f2b 2746994 0 2024-09-21T12:47:21.692 INFO:tasks.workunit.client.0.smithi046.stdout:7/702: symlink d2/d4/df/d42/dbd/le0 0 2024-09-21T12:47:21.693 INFO:tasks.workunit.client.0.smithi046.stdout:7/703: chown d2/d37/f4d 90989 1 2024-09-21T12:47:21.698 INFO:tasks.workunit.client.0.smithi046.stdout:7/704: creat d2/d4/df/d9a/dc3/fe1 x:0 0 0 2024-09-21T12:47:21.698 INFO:tasks.workunit.client.0.smithi046.stdout:7/705: fsync d2/fa4 0 2024-09-21T12:47:21.753 INFO:tasks.workunit.client.0.smithi046.stdout:9/802: sync 2024-09-21T12:47:21.753 INFO:tasks.workunit.client.0.smithi046.stdout:1/605: sync 2024-09-21T12:47:21.755 INFO:tasks.workunit.client.0.smithi046.stdout:1/606: dread d4/f6a [4194304,4194304] 0 2024-09-21T12:47:21.762 INFO:tasks.workunit.client.0.smithi046.stdout:1/607: dwrite d4/d13/d79/fb7 [0,4194304] 0 2024-09-21T12:47:21.764 INFO:tasks.workunit.client.0.smithi046.stdout:9/803: link d11/f54 d11/d19/d1b/d31/d53/d84/dce/ffe 0 2024-09-21T12:47:21.768 INFO:tasks.workunit.client.0.smithi046.stdout:9/804: mkdir d11/d19/d1b/d31/d44/dff 0 2024-09-21T12:47:21.776 INFO:tasks.workunit.client.0.smithi046.stdout:7/706: symlink d2/d4/df/d70/d88/le2 0 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:8/733: sync 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:0/746: sync 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:6/624: sync 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:3/556: sync 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:5/663: sync 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:2/601: sync 2024-09-21T12:47:21.787 INFO:tasks.workunit.client.0.smithi046.stdout:4/747: sync 2024-09-21T12:47:21.793 INFO:tasks.workunit.client.0.smithi046.stdout:2/602: dread d16/f20 [0,4194304] 0 2024-09-21T12:47:21.795 INFO:tasks.workunit.client.0.smithi046.stdout:5/664: creat d4/d22/d10/d1a/d9e/fd6 x:0 0 0 2024-09-21T12:47:21.795 INFO:tasks.workunit.client.0.smithi046.stdout:9/805: write d11/f54 [3814124,102045] 0 2024-09-21T12:47:21.795 INFO:tasks.workunit.client.0.smithi046.stdout:4/748: symlink d1/d13/d25/d29/d33/dca/lf6 0 2024-09-21T12:47:21.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/608: mknod d4/d29/d32/cc1 0 2024-09-21T12:47:21.797 INFO:tasks.workunit.client.0.smithi046.stdout:4/749: fdatasync d1/d27/d46/d78/fa4 0 2024-09-21T12:47:21.798 INFO:tasks.workunit.client.0.smithi046.stdout:0/747: creat d6/d7/d9/d54/d97/dfb/f112 x:0 0 0 2024-09-21T12:47:21.799 INFO:tasks.workunit.client.0.smithi046.stdout:5/665: read d4/d22/d10/d1a/f1c [1106398,124668] 0 2024-09-21T12:47:21.799 INFO:tasks.workunit.client.0.smithi046.stdout:1/609: write d4/d13/f84 [1303210,32570] 0 2024-09-21T12:47:21.801 INFO:tasks.workunit.client.0.smithi046.stdout:1/610: chown d4/d13/d79/fb7 101810 1 2024-09-21T12:47:21.803 INFO:tasks.workunit.client.0.smithi046.stdout:4/750: read d1/d27/d37/fd9 [1172212,21111] 0 2024-09-21T12:47:21.803 INFO:tasks.workunit.client.0.smithi046.stdout:5/666: chown d4/d22/d99/dc7/l80 127567313 1 2024-09-21T12:47:21.804 INFO:tasks.workunit.client.0.smithi046.stdout:9/806: mknod d11/d5b/d6f/dda/c100 0 2024-09-21T12:47:21.806 INFO:tasks.workunit.client.0.smithi046.stdout:9/807: dread - d11/d19/d1b/d4b/fea zero size 2024-09-21T12:47:21.809 INFO:tasks.workunit.client.0.smithi046.stdout:7/707: dwrite d2/d37/f81 [0,4194304] 0 2024-09-21T12:47:21.812 INFO:tasks.workunit.client.0.smithi046.stdout:3/557: write d5/dc/d26/f4c [742245,59541] 0 2024-09-21T12:47:21.814 INFO:tasks.workunit.client.0.smithi046.stdout:3/558: write d5/fa0 [136647,78390] 0 2024-09-21T12:47:21.818 INFO:tasks.workunit.client.0.smithi046.stdout:3/559: write d5/dc/d26/d3c/f51 [5015336,3973] 0 2024-09-21T12:47:21.818 INFO:tasks.workunit.client.0.smithi046.stdout:5/667: dread d4/dc/d13/d5b/d2d/d3b/fa1 [0,4194304] 0 2024-09-21T12:47:21.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/748: creat d6/d7/d13/d49/d51/f113 x:0 0 0 2024-09-21T12:47:21.823 INFO:tasks.workunit.client.0.smithi046.stdout:0/749: chown d6/d7/f9a 6 1 2024-09-21T12:47:21.823 INFO:tasks.workunit.client.0.smithi046.stdout:8/734: dwrite d1/d12/f95 [0,4194304] 0 2024-09-21T12:47:21.825 INFO:tasks.workunit.client.0.smithi046.stdout:0/750: dread - d6/f10e zero size 2024-09-21T12:47:21.827 INFO:tasks.workunit.client.0.smithi046.stdout:8/735: read d1/d12/d53/f97 [434388,80442] 0 2024-09-21T12:47:21.829 INFO:tasks.workunit.client.0.smithi046.stdout:0/751: readlink d6/d7/d13/d43/d52/d63/d7f/d38/db7/lff 0 2024-09-21T12:47:21.830 INFO:tasks.workunit.client.0.smithi046.stdout:9/808: rename d11/d19/d1b/d4b/ce7 to d11/d19/d93/c101 0 2024-09-21T12:47:21.831 INFO:tasks.workunit.client.0.smithi046.stdout:2/603: dwrite d16/d22/d2b/f83 [0,4194304] 0 2024-09-21T12:47:21.834 INFO:tasks.workunit.client.0.smithi046.stdout:7/708: mkdir d2/d4/df/d70/d88/d34/d7f/de3 0 2024-09-21T12:47:21.834 INFO:tasks.workunit.client.0.smithi046.stdout:7/709: stat d2/d4/df/f4c 0 2024-09-21T12:47:21.842 INFO:tasks.workunit.client.0.smithi046.stdout:5/668: mkdir d4/dc/d45/dd7 0 2024-09-21T12:47:21.848 INFO:tasks.workunit.client.0.smithi046.stdout:8/736: mknod d1/d12/d46/d35/d5b/dd6/c100 0 2024-09-21T12:47:21.850 INFO:tasks.workunit.client.0.smithi046.stdout:8/737: fdatasync d1/d12/d46/d35/d7d/d6a/dd1/de7/ffd 0 2024-09-21T12:47:21.851 INFO:tasks.workunit.client.0.smithi046.stdout:7/710: write d2/d4/df/d42/fc7 [1464294,70220] 0 2024-09-21T12:47:21.852 INFO:tasks.workunit.client.0.smithi046.stdout:8/738: readlink d1/d12/d46/d35/d36/d86/lf6 0 2024-09-21T12:47:21.853 INFO:tasks.workunit.client.0.smithi046.stdout:7/711: dread d2/d4/f86 [0,4194304] 0 2024-09-21T12:47:21.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/560: symlink d5/d16/d5f/dad/lc7 0 2024-09-21T12:47:21.858 INFO:tasks.workunit.client.0.smithi046.stdout:0/752: creat d6/d7/d9/dc4/d107/f114 x:0 0 0 2024-09-21T12:47:21.859 INFO:tasks.workunit.client.0.smithi046.stdout:9/809: mknod d11/d19/d1b/d31/d44/dff/c102 0 2024-09-21T12:47:21.859 INFO:tasks.workunit.client.0.smithi046.stdout:8/739: dwrite d1/d12/d46/d35/d79/fec [0,4194304] 0 2024-09-21T12:47:21.869 INFO:tasks.workunit.client.0.smithi046.stdout:8/740: dread d1/d12/f95 [0,4194304] 0 2024-09-21T12:47:21.871 INFO:tasks.workunit.client.0.smithi046.stdout:0/753: dwrite d6/d7/d13/d49/d51/f113 [0,4194304] 0 2024-09-21T12:47:21.871 INFO:tasks.workunit.client.0.smithi046.stdout:5/669: mknod d4/dc/d13/d5b/d2d/d43/dad/cd8 0 2024-09-21T12:47:21.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/754: rmdir d6/d7/df3 39 2024-09-21T12:47:21.882 INFO:tasks.workunit.client.0.smithi046.stdout:4/751: dwrite d1/d13/d25/d29/d43/f7a [4194304,4194304] 0 2024-09-21T12:47:21.884 INFO:tasks.workunit.client.0.smithi046.stdout:5/670: creat d4/dc/d13/d15/d90/fd9 x:0 0 0 2024-09-21T12:47:21.889 INFO:tasks.workunit.client.0.smithi046.stdout:8/741: fdatasync d1/fa 0 2024-09-21T12:47:21.893 INFO:tasks.workunit.client.0.smithi046.stdout:9/810: dread d11/d5b/d6f/db0/d30/d3e/dbf/fc9 [0,4194304] 0 2024-09-21T12:47:21.893 INFO:tasks.workunit.client.0.smithi046.stdout:4/752: mkdir d1/d27/d82/da8/df7 0 2024-09-21T12:47:21.895 INFO:tasks.workunit.client.0.smithi046.stdout:0/755: rmdir d6/d60 39 2024-09-21T12:47:21.896 INFO:tasks.workunit.client.0.smithi046.stdout:7/712: creat d2/d4/d43/fe4 x:0 0 0 2024-09-21T12:47:21.900 INFO:tasks.workunit.client.0.smithi046.stdout:8/742: rmdir d1/d12/d46/d35/d7d/d6a/dd1 39 2024-09-21T12:47:21.903 INFO:tasks.workunit.client.0.smithi046.stdout:9/811: chown d11/d19/d36/c82 117272 1 2024-09-21T12:47:21.903 INFO:tasks.workunit.client.0.smithi046.stdout:1/611: write d4/f77 [6568576,23821] 0 2024-09-21T12:47:21.905 INFO:tasks.workunit.client.0.smithi046.stdout:1/612: chown d4/d13/d38/l88 32501101 1 2024-09-21T12:47:21.909 INFO:tasks.workunit.client.0.smithi046.stdout:7/713: rmdir d2/d4/df/d70 39 2024-09-21T12:47:21.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/753: mkdir d1/d85/de6/df8 0 2024-09-21T12:47:21.916 INFO:tasks.workunit.client.0.smithi046.stdout:8/743: creat d1/d12/d46/d35/d5b/f101 x:0 0 0 2024-09-21T12:47:21.924 INFO:tasks.workunit.client.0.smithi046.stdout:4/754: rmdir d1/d13/d25/d29/d43 39 2024-09-21T12:47:21.937 INFO:tasks.workunit.client.0.smithi046.stdout:8/744: dread d1/d12/d46/d35/d7d/f30 [0,4194304] 0 2024-09-21T12:47:21.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/604: dwrite d16/d22/d38/d77/fb3 [0,4194304] 0 2024-09-21T12:47:21.945 INFO:tasks.workunit.client.0.smithi046.stdout:2/605: rename d16/caa to d16/d22/d75/cc3 0 2024-09-21T12:47:21.952 INFO:tasks.workunit.client.0.smithi046.stdout:5/671: truncate d4/dc/d13/d5b/f3f 1930842 0 2024-09-21T12:47:21.953 INFO:tasks.workunit.client.0.smithi046.stdout:8/745: link d1/d12/d46/d35/d79/ce4 d1/d12/d1a/c102 0 2024-09-21T12:47:21.954 INFO:tasks.workunit.client.0.smithi046.stdout:8/746: write d1/f20 [1607773,54687] 0 2024-09-21T12:47:21.955 INFO:tasks.workunit.client.0.smithi046.stdout:2/606: creat d16/d22/fc4 x:0 0 0 2024-09-21T12:47:21.957 INFO:tasks.workunit.client.0.smithi046.stdout:0/756: write d6/d7/d37/f71 [1803716,46807] 0 2024-09-21T12:47:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:0/757: stat d6/d7/d13/fee 0 2024-09-21T12:47:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:8/747: creat d1/f103 x:0 0 0 2024-09-21T12:47:21.958 INFO:tasks.workunit.client.0.smithi046.stdout:1/613: write d4/d13/d79/dbd/f86 [242978,63209] 0 2024-09-21T12:47:21.960 INFO:tasks.workunit.client.0.smithi046.stdout:5/672: mknod d4/d22/d99/d9d/cda 0 2024-09-21T12:47:21.962 INFO:tasks.workunit.client.0.smithi046.stdout:4/755: write d1/f5d [4080046,90306] 0 2024-09-21T12:47:21.967 INFO:tasks.workunit.client.0.smithi046.stdout:0/758: write d6/d60/f92 [317904,115322] 0 2024-09-21T12:47:21.968 INFO:tasks.workunit.client.0.smithi046.stdout:4/756: write d1/d13/d25/d6b/fbd [604240,126840] 0 2024-09-21T12:47:21.970 INFO:tasks.workunit.client.0.smithi046.stdout:7/714: dwrite d2/d4/df/d6f/d92/f95 [0,4194304] 0 2024-09-21T12:47:21.971 INFO:tasks.workunit.client.0.smithi046.stdout:5/673: unlink d4/dc/d13/d5b/d2d/d43/f55 0 2024-09-21T12:47:21.975 INFO:tasks.workunit.client.0.smithi046.stdout:7/715: write d2/d37/d8a/d99/fc0 [37330,87219] 0 2024-09-21T12:47:21.975 INFO:tasks.workunit.client.0.smithi046.stdout:8/748: dread d1/d12/f2a [0,4194304] 0 2024-09-21T12:47:21.982 INFO:tasks.workunit.client.0.smithi046.stdout:2/607: write d16/f1a [8487076,33556] 0 2024-09-21T12:47:21.984 INFO:tasks.workunit.client.0.smithi046.stdout:4/757: mkdir d1/d27/d82/df9 0 2024-09-21T12:47:21.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/749: mknod d1/d12/d53/d60/c104 0 2024-09-21T12:47:21.990 INFO:tasks.workunit.client.0.smithi046.stdout:8/750: fdatasync d1/f11 0 2024-09-21T12:47:21.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/759: mknod d6/d60/dfa/c115 0 2024-09-21T12:47:21.992 INFO:tasks.workunit.client.0.smithi046.stdout:0/760: chown d6/d7/c35 427335375 1 2024-09-21T12:47:21.994 INFO:tasks.workunit.client.0.smithi046.stdout:1/614: getdents d4/d13/d38/d4f/d83 0 2024-09-21T12:47:21.997 INFO:tasks.workunit.client.0.smithi046.stdout:4/758: mknod d1/d27/d46/ddb/cfa 0 2024-09-21T12:47:21.998 INFO:tasks.workunit.client.0.smithi046.stdout:0/761: mkdir d6/d2f/de9/d116 0 2024-09-21T12:47:21.999 INFO:tasks.workunit.client.0.smithi046.stdout:0/762: chown d6/d7/d37/l69 1609149449 1 2024-09-21T12:47:22.066 INFO:tasks.workunit.client.0.smithi046.stdout:5/674: truncate d4/dc/d13/d15/f84 736843 0 2024-09-21T12:47:22.071 INFO:tasks.workunit.client.0.smithi046.stdout:4/759: creat d1/d13/d4e/ffb x:0 0 0 2024-09-21T12:47:22.072 INFO:tasks.workunit.client.0.smithi046.stdout:1/615: chown d4/f37 47267049 1 2024-09-21T12:47:22.088 INFO:tasks.workunit.client.0.smithi046.stdout:2/608: getdents d16/d22/d4e/d9d 0 2024-09-21T12:47:22.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/675: mkdir d4/dc/d13/d5b/d2d/d43/ddb 0 2024-09-21T12:47:22.090 INFO:tasks.workunit.client.0.smithi046.stdout:0/763: symlink d6/d7/d13/d43/d52/dc0/dc3/l117 0 2024-09-21T12:47:22.091 INFO:tasks.workunit.client.0.smithi046.stdout:1/616: symlink d4/d13/d6b/lc2 0 2024-09-21T12:47:22.093 INFO:tasks.workunit.client.0.smithi046.stdout:4/760: unlink d1/d13/d25/d29/d45/fea 0 2024-09-21T12:47:22.094 INFO:tasks.workunit.client.0.smithi046.stdout:7/716: getdents d2/d4/df/d70/d88/d34/d7f 0 2024-09-21T12:47:22.098 INFO:tasks.workunit.client.0.smithi046.stdout:1/617: mkdir d4/d13/d38/d53/d80/d8b/dc3 0 2024-09-21T12:47:22.099 INFO:tasks.workunit.client.0.smithi046.stdout:5/676: truncate d4/dc/d13/d5b/d2d/f91 467682 0 2024-09-21T12:47:22.101 INFO:tasks.workunit.client.0.smithi046.stdout:2/609: symlink d16/d5c/d63/db4/lc5 0 2024-09-21T12:47:22.103 INFO:tasks.workunit.client.0.smithi046.stdout:0/764: creat d6/d7/df3/f118 x:0 0 0 2024-09-21T12:47:22.104 INFO:tasks.workunit.client.0.smithi046.stdout:0/765: fsync d6/d7/d13/d7b/da2/f27 0 2024-09-21T12:47:22.104 INFO:tasks.workunit.client.0.smithi046.stdout:1/618: unlink d4/d13/l4c 0 2024-09-21T12:47:22.110 INFO:tasks.workunit.client.0.smithi046.stdout:2/610: mkdir d16/d22/d4e/d90/dc6 0 2024-09-21T12:47:22.117 INFO:tasks.workunit.client.0.smithi046.stdout:0/766: rename d6/d7/df3/lfe to d6/d7/d13/d49/l119 0 2024-09-21T12:47:22.119 INFO:tasks.workunit.client.0.smithi046.stdout:5/677: symlink d4/dc/d13/da2/dce/ldc 0 2024-09-21T12:47:22.119 INFO:tasks.workunit.client.0.smithi046.stdout:0/767: truncate d6/d7/d13/d43/fea 561521 0 2024-09-21T12:47:22.119 INFO:tasks.workunit.client.0.smithi046.stdout:7/717: link d2/d4/df/d17/l21 d2/d4/d43/dd6/le5 0 2024-09-21T12:47:22.120 INFO:tasks.workunit.client.0.smithi046.stdout:2/611: rmdir d16/d22/d75 39 2024-09-21T12:47:22.121 INFO:tasks.workunit.client.0.smithi046.stdout:7/718: dread - d2/d4/df/d42/fdb zero size 2024-09-21T12:47:22.122 INFO:tasks.workunit.client.0.smithi046.stdout:1/619: creat d4/d13/d38/d4f/d83/da9/fc4 x:0 0 0 2024-09-21T12:47:22.122 INFO:tasks.workunit.client.0.smithi046.stdout:2/612: chown d16/d22/f2a 1 1 2024-09-21T12:47:22.123 INFO:tasks.workunit.client.0.smithi046.stdout:4/761: getdents d1/d13/d25/d29/d33/dca 0 2024-09-21T12:47:22.124 INFO:tasks.workunit.client.0.smithi046.stdout:5/678: rmdir d4/dc/d13/d15/d54 39 2024-09-21T12:47:22.125 INFO:tasks.workunit.client.0.smithi046.stdout:0/768: unlink d6/d7/d13/d43/d52/d63/d7f/d38/c77 0 2024-09-21T12:47:22.126 INFO:tasks.workunit.client.0.smithi046.stdout:7/719: readlink d2/d37/l7d 0 2024-09-21T12:47:22.128 INFO:tasks.workunit.client.0.smithi046.stdout:2/613: rmdir d16 39 2024-09-21T12:47:22.131 INFO:tasks.workunit.client.0.smithi046.stdout:4/762: rmdir d1/d27/d58/db7 39 2024-09-21T12:47:22.132 INFO:tasks.workunit.client.0.smithi046.stdout:0/769: dwrite d6/d7/d13/d43/d52/d63/d7f/d78/fe6 [0,4194304] 0 2024-09-21T12:47:22.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/679: readlink d4/d22/l1f 0 2024-09-21T12:47:22.141 INFO:tasks.workunit.client.0.smithi046.stdout:0/770: dread - d6/d7/d13/d43/d52/fb0 zero size 2024-09-21T12:47:22.147 INFO:tasks.workunit.client.0.smithi046.stdout:4/763: creat d1/d27/d82/da8/df7/ffc x:0 0 0 2024-09-21T12:47:22.148 INFO:tasks.workunit.client.0.smithi046.stdout:0/771: rmdir d6/d2f 39 2024-09-21T12:47:22.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/680: dwrite d4/d22/f9b [0,4194304] 0 2024-09-21T12:47:22.151 INFO:tasks.workunit.client.0.smithi046.stdout:1/620: link d4/c1e d4/d13/d38/d53/d80/d8b/dc3/cc5 0 2024-09-21T12:47:22.152 INFO:tasks.workunit.client.0.smithi046.stdout:7/720: write d2/d37/d77/fae [2672342,3155] 0 2024-09-21T12:47:22.154 INFO:tasks.workunit.client.0.smithi046.stdout:4/764: creat d1/d13/d25/d6b/ffd x:0 0 0 2024-09-21T12:47:22.157 INFO:tasks.workunit.client.0.smithi046.stdout:7/721: symlink d2/d37/d8a/ddf/le6 0 2024-09-21T12:47:22.163 INFO:tasks.workunit.client.0.smithi046.stdout:5/681: dread d4/fbe [0,4194304] 0 2024-09-21T12:47:22.165 INFO:tasks.workunit.client.0.smithi046.stdout:1/621: dread d4/d4d/f68 [0,4194304] 0 2024-09-21T12:47:22.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/682: write d4/dc/d13/d5b/d2d/d3b/fc4 [319186,30108] 0 2024-09-21T12:47:22.167 INFO:tasks.workunit.client.0.smithi046.stdout:2/614: dread d16/d22/d2b/d30/f58 [4194304,4194304] 0 2024-09-21T12:47:22.171 INFO:tasks.workunit.client.0.smithi046.stdout:1/622: rename d4/d13/c30 to d4/d29/d32/d9e/d5d/d8c/cc6 0 2024-09-21T12:47:22.172 INFO:tasks.workunit.client.0.smithi046.stdout:4/765: write d1/d13/d25/d29/d33/f41 [316527,91212] 0 2024-09-21T12:47:22.173 INFO:tasks.workunit.client.0.smithi046.stdout:7/722: write d2/d4/df/d17/f35 [997557,100451] 0 2024-09-21T12:47:22.175 INFO:tasks.workunit.client.0.smithi046.stdout:2/615: rename d16/d22/d2b/d30/f4a to d16/d22/d4e/fc7 0 2024-09-21T12:47:22.175 INFO:tasks.workunit.client.0.smithi046.stdout:0/772: dread d6/d2f/d32/f65 [0,4194304] 0 2024-09-21T12:47:22.176 INFO:tasks.workunit.client.0.smithi046.stdout:1/623: mknod d4/cc7 0 2024-09-21T12:47:22.177 INFO:tasks.workunit.client.0.smithi046.stdout:4/766: mknod d1/d27/d37/cfe 0 2024-09-21T12:47:22.178 INFO:tasks.workunit.client.0.smithi046.stdout:1/624: read - d4/d29/d32/d9e/d5d/d8c/d94/fbf zero size 2024-09-21T12:47:22.179 INFO:tasks.workunit.client.0.smithi046.stdout:7/723: creat d2/d4/df/d9a/dc3/fe7 x:0 0 0 2024-09-21T12:47:22.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/767: chown d1/d27/d37/d66/c67 185 1 2024-09-21T12:47:22.180 INFO:tasks.workunit.client.0.smithi046.stdout:0/773: symlink d6/l11a 0 2024-09-21T12:47:22.180 INFO:tasks.workunit.client.0.smithi046.stdout:1/625: truncate d4/d13/f1a 4439301 0 2024-09-21T12:47:22.182 INFO:tasks.workunit.client.0.smithi046.stdout:4/768: dread d1/d27/d37/f63 [0,4194304] 0 2024-09-21T12:47:22.182 INFO:tasks.workunit.client.0.smithi046.stdout:1/626: dread d4/d4d/f57 [0,4194304] 0 2024-09-21T12:47:22.186 INFO:tasks.workunit.client.0.smithi046.stdout:7/724: mknod d2/d4/df/d70/db2/ce8 0 2024-09-21T12:47:22.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/725: read d2/d4/f33 [3598411,118417] 0 2024-09-21T12:47:22.191 INFO:tasks.workunit.client.0.smithi046.stdout:0/774: dread d6/d7/d9/ff [0,4194304] 0 2024-09-21T12:47:22.193 INFO:tasks.workunit.client.0.smithi046.stdout:1/627: rename d4/d13/d38/d4f/f5e to d4/d13/d38/d53/d80/d95/da5/fc8 0 2024-09-21T12:47:22.194 INFO:tasks.workunit.client.0.smithi046.stdout:7/726: dwrite d2/d4/df/d17/f63 [0,4194304] 0 2024-09-21T12:47:22.198 INFO:tasks.workunit.client.0.smithi046.stdout:4/769: symlink d1/d27/d46/d78/lff 0 2024-09-21T12:47:22.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/770: write d1/d13/d4e/ffb [640502,11943] 0 2024-09-21T12:47:22.202 INFO:tasks.workunit.client.0.smithi046.stdout:4/771: dread d1/d27/d37/f63 [0,4194304] 0 2024-09-21T12:47:22.203 INFO:tasks.workunit.client.0.smithi046.stdout:2/616: truncate d16/d22/d2b/d30/d8f/f9c 2771741 0 2024-09-21T12:47:22.205 INFO:tasks.workunit.client.0.smithi046.stdout:0/775: mknod d6/d7/d13/d7b/c11b 0 2024-09-21T12:47:22.206 INFO:tasks.workunit.client.0.smithi046.stdout:0/776: stat d6/d2f/d32 0 2024-09-21T12:47:22.207 INFO:tasks.workunit.client.0.smithi046.stdout:7/727: rename d2/d4/d97/lbf to d2/d37/d8a/le9 0 2024-09-21T12:47:22.213 INFO:tasks.workunit.client.0.smithi046.stdout:4/772: dwrite d1/d13/d4e/ffb [0,4194304] 0 2024-09-21T12:47:22.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/628: dread d4/d13/d38/d53/d80/d95/da5/fc8 [0,4194304] 0 2024-09-21T12:47:22.221 INFO:tasks.workunit.client.0.smithi046.stdout:0/777: dwrite d6/f40 [8388608,4194304] 0 2024-09-21T12:47:22.226 INFO:tasks.workunit.client.0.smithi046.stdout:1/629: unlink d4/d29/d32/c75 0 2024-09-21T12:47:22.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/617: dread d16/d22/d75/f74 [0,4194304] 0 2024-09-21T12:47:22.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/778: mkdir d6/d7/d11c 0 2024-09-21T12:47:22.235 INFO:tasks.workunit.client.0.smithi046.stdout:7/728: dread d2/d4/df/d70/d88/d34/f48 [0,4194304] 0 2024-09-21T12:47:22.238 INFO:tasks.workunit.client.0.smithi046.stdout:7/729: chown d2/c11 5266991 1 2024-09-21T12:47:22.245 INFO:tasks.workunit.client.0.smithi046.stdout:7/730: rename d2/f3 to d2/fea 0 2024-09-21T12:47:22.247 INFO:tasks.workunit.client.0.smithi046.stdout:4/773: dread d1/d13/d25/d29/d33/f41 [0,4194304] 0 2024-09-21T12:47:22.248 INFO:tasks.workunit.client.0.smithi046.stdout:0/779: dread d6/d2f/de9/f103 [0,4194304] 0 2024-09-21T12:47:22.251 INFO:tasks.workunit.client.0.smithi046.stdout:7/731: creat d2/d37/d8a/d99/dbe/feb x:0 0 0 2024-09-21T12:47:22.255 INFO:tasks.workunit.client.0.smithi046.stdout:0/780: truncate d6/d7/d13/d43/d52/d63/d7f/d38/da6/f6e 954254 0 2024-09-21T12:47:22.255 INFO:tasks.workunit.client.0.smithi046.stdout:2/618: write d16/d22/d38/f53 [1164970,56609] 0 2024-09-21T12:47:22.257 INFO:tasks.workunit.client.0.smithi046.stdout:7/732: mkdir d2/d4/df/d70/d88/d34/d7f/dec 0 2024-09-21T12:47:22.260 INFO:tasks.workunit.client.0.smithi046.stdout:0/781: dread - d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f111 zero size 2024-09-21T12:47:22.260 INFO:tasks.workunit.client.0.smithi046.stdout:1/630: dwrite d4/f2c [0,4194304] 0 2024-09-21T12:47:22.261 INFO:tasks.workunit.client.0.smithi046.stdout:2/619: creat d16/fc8 x:0 0 0 2024-09-21T12:47:22.262 INFO:tasks.workunit.client.0.smithi046.stdout:0/782: write d6/d7/d37/faa [955738,44716] 0 2024-09-21T12:47:22.262 INFO:tasks.workunit.client.0.smithi046.stdout:4/774: link d1/d27/d37/d8f/ddf/cc1 d1/d27/d82/da8/df7/c100 0 2024-09-21T12:47:22.268 INFO:tasks.workunit.client.0.smithi046.stdout:1/631: creat d4/d13/d38/d53/d80/d95/da5/fc9 x:0 0 0 2024-09-21T12:47:22.269 INFO:tasks.workunit.client.0.smithi046.stdout:0/783: dread - d6/d7/d13/d43/d52/f64 zero size 2024-09-21T12:47:22.270 INFO:tasks.workunit.client.0.smithi046.stdout:0/784: dread - d6/f62 zero size 2024-09-21T12:47:22.270 INFO:tasks.workunit.client.0.smithi046.stdout:2/620: getdents d16/d22/d4e/d9d 0 2024-09-21T12:47:22.272 INFO:tasks.workunit.client.0.smithi046.stdout:1/632: symlink d4/d13/d38/d4f/d83/lca 0 2024-09-21T12:47:22.272 INFO:tasks.workunit.client.0.smithi046.stdout:1/633: chown d4/f37 5249 1 2024-09-21T12:47:22.273 INFO:tasks.workunit.client.0.smithi046.stdout:7/733: rename d2/d4/d43/l5f to d2/d37/led 0 2024-09-21T12:47:22.275 INFO:tasks.workunit.client.0.smithi046.stdout:2/621: creat d16/d22/d38/dac/fc9 x:0 0 0 2024-09-21T12:47:22.275 INFO:tasks.workunit.client.0.smithi046.stdout:1/634: creat d4/d4d/fcb x:0 0 0 2024-09-21T12:47:22.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/775: getdents d1/d27/d37/d8f 0 2024-09-21T12:47:22.278 INFO:tasks.workunit.client.0.smithi046.stdout:0/785: mknod d6/d7/d13/c11d 0 2024-09-21T12:47:22.281 INFO:tasks.workunit.client.0.smithi046.stdout:2/622: rename d16/d22/d7f to d16/d5c/d63/db4/dca 0 2024-09-21T12:47:22.284 INFO:tasks.workunit.client.0.smithi046.stdout:1/635: mkdir d4/d29/d32/d9e/d5d/d8c/d92/dcc 0 2024-09-21T12:47:22.288 INFO:tasks.workunit.client.0.smithi046.stdout:0/786: symlink d6/d7/d13/d43/d52/d63/d7f/d38/l11e 0 2024-09-21T12:47:22.290 INFO:tasks.workunit.client.0.smithi046.stdout:2/623: mknod d16/d5c/d63/db4/dca/ccb 0 2024-09-21T12:47:22.290 INFO:tasks.workunit.client.0.smithi046.stdout:2/624: chown d16/d5c/f5d 44 1 2024-09-21T12:47:22.291 INFO:tasks.workunit.client.0.smithi046.stdout:1/636: mknod d4/d13/d38/d53/d80/d95/da5/ccd 0 2024-09-21T12:47:22.299 INFO:tasks.workunit.client.0.smithi046.stdout:4/776: creat d1/d27/d58/f101 x:0 0 0 2024-09-21T12:47:22.299 INFO:tasks.workunit.client.0.smithi046.stdout:7/734: dwrite d2/d4/f54 [0,4194304] 0 2024-09-21T12:47:22.300 INFO:tasks.workunit.client.0.smithi046.stdout:2/625: dwrite d16/d22/f97 [0,4194304] 0 2024-09-21T12:47:22.302 INFO:tasks.workunit.client.0.smithi046.stdout:2/626: chown d16/d22/d38/d77/d7a/f98 536421494 1 2024-09-21T12:47:22.304 INFO:tasks.workunit.client.0.smithi046.stdout:4/777: read d1/d27/d37/f49 [641995,60223] 0 2024-09-21T12:47:22.307 INFO:tasks.workunit.client.0.smithi046.stdout:7/735: symlink d2/d4/df/d6f/d92/lee 0 2024-09-21T12:47:22.309 INFO:tasks.workunit.client.0.smithi046.stdout:4/778: write d1/d27/d46/f77 [1163477,24193] 0 2024-09-21T12:47:22.310 INFO:tasks.workunit.client.0.smithi046.stdout:1/637: rename d4/d13/d38/d4f/d83/lca to d4/d13/d38/d53/lce 0 2024-09-21T12:47:22.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/787: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf [0,4194304] 0 2024-09-21T12:47:22.314 INFO:tasks.workunit.client.0.smithi046.stdout:7/736: truncate d2/d4/f33 967516 0 2024-09-21T12:47:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:21 smithi176 ceph-mon[35476]: pgmap v37: 65 pgs: 65 active+clean; 3.0 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 72 MiB/s rd, 189 MiB/s wr, 409 op/s 2024-09-21T12:47:22.317 INFO:tasks.workunit.client.0.smithi046.stdout:7/737: fsync d2/d4/df/d9a/dc3/fe7 0 2024-09-21T12:47:22.318 INFO:tasks.workunit.client.0.smithi046.stdout:2/627: rename d16/d22/f2a to d16/d22/d38/d77/d9e/fcc 0 2024-09-21T12:47:22.321 INFO:tasks.workunit.client.0.smithi046.stdout:0/788: mknod d6/d7/c11f 0 2024-09-21T12:47:22.322 INFO:tasks.workunit.client.0.smithi046.stdout:0/789: dread - d6/d7/d9/dc4/d107/f114 zero size 2024-09-21T12:47:22.325 INFO:tasks.workunit.client.0.smithi046.stdout:4/779: rename d1/d27/d46/d78/lff to d1/d13/l102 0 2024-09-21T12:47:22.326 INFO:tasks.workunit.client.0.smithi046.stdout:4/780: chown d1/f5d 1 1 2024-09-21T12:47:22.333 INFO:tasks.workunit.client.0.smithi046.stdout:4/781: mknod d1/d5f/c103 0 2024-09-21T12:47:22.335 INFO:tasks.workunit.client.0.smithi046.stdout:7/738: getdents d2/d4/df/d6f/d92 0 2024-09-21T12:47:22.337 INFO:tasks.workunit.client.0.smithi046.stdout:7/739: chown d2/d4/df/d70/d88/d34/d7f/l84 10866249 1 2024-09-21T12:47:22.338 INFO:tasks.workunit.client.0.smithi046.stdout:7/740: dread - d2/d4/df/d17/fb8 zero size 2024-09-21T12:47:22.340 INFO:tasks.workunit.client.0.smithi046.stdout:1/638: write d4/d13/d38/f42 [150334,25412] 0 2024-09-21T12:47:22.341 INFO:tasks.workunit.client.0.smithi046.stdout:7/741: mknod d2/d4/d97/cef 0 2024-09-21T12:47:22.343 INFO:tasks.workunit.client.0.smithi046.stdout:1/639: fsync d4/d13/d38/d53/d80/d95/da5/fc8 0 2024-09-21T12:47:22.345 INFO:tasks.workunit.client.0.smithi046.stdout:0/790: write d6/d60/f89 [610637,29640] 0 2024-09-21T12:47:22.346 INFO:tasks.workunit.client.0.smithi046.stdout:7/742: dread - d2/d4/df/d70/d88/d34/f68 zero size 2024-09-21T12:47:22.349 INFO:tasks.workunit.client.0.smithi046.stdout:0/791: chown d6/d7/d13/d43/d52/d63/d7f/d38/da6 0 1 2024-09-21T12:47:22.350 INFO:tasks.workunit.client.0.smithi046.stdout:1/640: rename d4/d13/d38/fad to d4/d29/d32/d9e/d5d/d8c/fcf 0 2024-09-21T12:47:22.351 INFO:tasks.workunit.client.0.smithi046.stdout:4/782: dread d1/d13/d25/d29/f42 [4194304,4194304] 0 2024-09-21T12:47:22.354 INFO:tasks.workunit.client.0.smithi046.stdout:2/628: dwrite d16/d22/f41 [4194304,4194304] 0 2024-09-21T12:47:22.355 INFO:tasks.workunit.client.0.smithi046.stdout:1/641: creat d4/d29/d32/fd0 x:0 0 0 2024-09-21T12:47:22.357 INFO:tasks.workunit.client.0.smithi046.stdout:0/792: mknod d6/d7/d13/d43/d52/d63/d7f/d38/db7/c120 0 2024-09-21T12:47:22.362 INFO:tasks.workunit.client.0.smithi046.stdout:2/629: symlink d16/d22/d4e/lcd 0 2024-09-21T12:47:22.362 INFO:tasks.workunit.client.0.smithi046.stdout:1/642: dwrite d4/d13/d38/d53/d80/f85 [0,4194304] 0 2024-09-21T12:47:22.367 INFO:tasks.workunit.client.0.smithi046.stdout:4/783: unlink d1/d13/d25/d29/d45/l7e 0 2024-09-21T12:47:22.369 INFO:tasks.workunit.client.0.smithi046.stdout:2/630: readlink d16/d22/d2b/l3c 0 2024-09-21T12:47:22.371 INFO:tasks.workunit.client.0.smithi046.stdout:2/631: read d16/d22/d38/d77/d9e/fbe [4743788,55676] 0 2024-09-21T12:47:22.372 INFO:tasks.workunit.client.0.smithi046.stdout:1/643: dwrite d4/d13/d38/f42 [4194304,4194304] 0 2024-09-21T12:47:22.381 INFO:tasks.workunit.client.0.smithi046.stdout:0/793: getdents d6 0 2024-09-21T12:47:22.382 INFO:tasks.workunit.client.0.smithi046.stdout:1/644: truncate d4/f10 908018 0 2024-09-21T12:47:22.384 INFO:tasks.workunit.client.0.smithi046.stdout:2/632: dwrite d16/d5c/d63/db4/dca/fbb [4194304,4194304] 0 2024-09-21T12:47:22.385 INFO:tasks.workunit.client.0.smithi046.stdout:4/784: write d1/ff [3734074,77412] 0 2024-09-21T12:47:22.389 INFO:tasks.workunit.client.0.smithi046.stdout:1/645: creat d4/d29/d32/d9e/fd1 x:0 0 0 2024-09-21T12:47:22.394 INFO:tasks.workunit.client.0.smithi046.stdout:4/785: fsync d1/d13/d25/d3a/fa1 0 2024-09-21T12:47:22.395 INFO:tasks.workunit.client.0.smithi046.stdout:2/633: read d16/d22/d75/f91 [1196340,83950] 0 2024-09-21T12:47:22.396 INFO:tasks.workunit.client.0.smithi046.stdout:1/646: fdatasync d4/d4d/f68 0 2024-09-21T12:47:22.397 INFO:tasks.workunit.client.0.smithi046.stdout:0/794: creat d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100/f121 x:0 0 0 2024-09-21T12:47:22.404 INFO:tasks.workunit.client.0.smithi046.stdout:0/795: dwrite d6/d7/d13/d7b/da2/f5a [0,4194304] 0 2024-09-21T12:47:22.404 INFO:tasks.workunit.client.0.smithi046.stdout:4/786: symlink d1/d27/d82/da8/l104 0 2024-09-21T12:47:22.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:21 smithi046 ceph-mon[27868]: pgmap v37: 65 pgs: 65 active+clean; 3.0 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 72 MiB/s rd, 189 MiB/s wr, 409 op/s 2024-09-21T12:47:22.413 INFO:tasks.workunit.client.0.smithi046.stdout:0/796: fsync d6/d7/f5b 0 2024-09-21T12:47:22.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/634: dwrite d16/d22/d2b/d30/f58 [0,4194304] 0 2024-09-21T12:47:22.415 INFO:tasks.workunit.client.0.smithi046.stdout:4/787: mkdir d1/d27/d37/d66/d105 0 2024-09-21T12:47:22.416 INFO:tasks.workunit.client.0.smithi046.stdout:0/797: truncate d6/d7/d13/db6/f105 955289 0 2024-09-21T12:47:22.417 INFO:tasks.workunit.client.0.smithi046.stdout:0/798: dread - d6/d2f/d32/f47 zero size 2024-09-21T12:47:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:4/788: mknod d1/d27/d82/c106 0 2024-09-21T12:47:22.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/635: write d16/d22/d2b/d30/d67/fab [388496,5476] 0 2024-09-21T12:47:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/799: symlink d6/d7/d13/d43/d52/d63/d7f/d78/d8a/l122 0 2024-09-21T12:47:22.463 INFO:tasks.workunit.client.0.smithi046.stdout:4/789: chown d1/d27/d82/ld1 237 1 2024-09-21T12:47:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:0/800: stat d6/d7/d9/l28 0 2024-09-21T12:47:22.464 INFO:tasks.workunit.client.0.smithi046.stdout:1/647: link d4/d13/d38/d53/lce d4/d29/d32/d9e/d5d/ld2 0 2024-09-21T12:47:22.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/636: symlink d16/d22/d38/d77/d9e/lce 0 2024-09-21T12:47:22.467 INFO:tasks.workunit.client.0.smithi046.stdout:4/790: write d1/d27/d46/f3e [175768,100132] 0 2024-09-21T12:47:22.467 INFO:tasks.workunit.client.0.smithi046.stdout:2/637: fsync d16/d22/d2b/f6e 0 2024-09-21T12:47:22.469 INFO:tasks.workunit.client.0.smithi046.stdout:2/638: dread - d16/d22/d2b/d30/d67/f7b zero size 2024-09-21T12:47:22.470 INFO:tasks.workunit.client.0.smithi046.stdout:1/648: mknod d4/d13/d38/d4f/d83/cd3 0 2024-09-21T12:47:22.474 INFO:tasks.workunit.client.0.smithi046.stdout:4/791: dwrite d1/d27/d82/da8/fcf [0,4194304] 0 2024-09-21T12:47:22.474 INFO:tasks.workunit.client.0.smithi046.stdout:2/639: unlink d16/l1c 0 2024-09-21T12:47:22.475 INFO:tasks.workunit.client.0.smithi046.stdout:4/792: readlink d1/d85/lcb 0 2024-09-21T12:47:22.479 INFO:tasks.workunit.client.0.smithi046.stdout:2/640: dread d16/d22/d2b/d30/f58 [0,4194304] 0 2024-09-21T12:47:22.481 INFO:tasks.workunit.client.0.smithi046.stdout:4/793: readlink d1/d13/d25/d29/d43/d84/daa/lf2 0 2024-09-21T12:47:22.484 INFO:tasks.workunit.client.0.smithi046.stdout:1/649: dwrite d4/f1b [8388608,4194304] 0 2024-09-21T12:47:22.487 INFO:tasks.workunit.client.0.smithi046.stdout:2/641: creat d16/d22/d75/fcf x:0 0 0 2024-09-21T12:47:22.493 INFO:tasks.workunit.client.0.smithi046.stdout:0/801: truncate d6/d7/d9/fb 3939420 0 2024-09-21T12:47:22.496 INFO:tasks.workunit.client.0.smithi046.stdout:1/650: dwrite d4/f1b [4194304,4194304] 0 2024-09-21T12:47:22.498 INFO:tasks.workunit.client.0.smithi046.stdout:2/642: dwrite d16/d22/d38/d77/f9a [0,4194304] 0 2024-09-21T12:47:22.501 INFO:tasks.workunit.client.0.smithi046.stdout:1/651: write d4/d13/d79/fb7 [2697463,8223] 0 2024-09-21T12:47:22.513 INFO:tasks.workunit.client.0.smithi046.stdout:2/643: creat d16/d22/d4e/d90/dc6/fd0 x:0 0 0 2024-09-21T12:47:22.515 INFO:tasks.workunit.client.0.smithi046.stdout:1/652: creat d4/d29/d32/d9e/d5d/d8c/d92/fd4 x:0 0 0 2024-09-21T12:47:22.515 INFO:tasks.workunit.client.0.smithi046.stdout:4/794: dwrite d1/d13/d25/d3a/fa1 [4194304,4194304] 0 2024-09-21T12:47:22.518 INFO:tasks.workunit.client.0.smithi046.stdout:1/653: write d4/d13/f1a [1859620,83175] 0 2024-09-21T12:47:22.522 INFO:tasks.workunit.client.0.smithi046.stdout:2/644: fsync d16/d22/d4e/f55 0 2024-09-21T12:47:22.522 INFO:tasks.workunit.client.0.smithi046.stdout:0/802: dwrite d6/d7/f45 [0,4194304] 0 2024-09-21T12:47:22.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/795: creat d1/d13/d25/d3a/d92/f107 x:0 0 0 2024-09-21T12:47:22.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/803: fsync d6/f3c 0 2024-09-21T12:47:22.538 INFO:tasks.workunit.client.0.smithi046.stdout:1/654: unlink d4/c17 0 2024-09-21T12:47:22.539 INFO:tasks.workunit.client.0.smithi046.stdout:0/804: write d6/d7/d13/d43/d52/dc0/dc3/feb [214189,7542] 0 2024-09-21T12:47:22.539 INFO:tasks.workunit.client.0.smithi046.stdout:2/645: dread d16/d22/d38/f53 [0,4194304] 0 2024-09-21T12:47:22.539 INFO:tasks.workunit.client.0.smithi046.stdout:4/796: mkdir d1/d13/d25/d3a/d108 0 2024-09-21T12:47:22.545 INFO:tasks.workunit.client.0.smithi046.stdout:1/655: unlink d4/d29/d32/d9e/f99 0 2024-09-21T12:47:22.547 INFO:tasks.workunit.client.0.smithi046.stdout:4/797: fsync d1/d13/d4e/ffb 0 2024-09-21T12:47:22.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/646: dwrite d16/d22/d2b/f83 [0,4194304] 0 2024-09-21T12:47:22.627 INFO:tasks.workunit.client.0.smithi046.stdout:0/805: symlink d6/d7/d9/d54/l123 0 2024-09-21T12:47:22.628 INFO:tasks.workunit.client.0.smithi046.stdout:0/806: readlink d6/d7/d13/d43/d52/d63/d7f/d78/d8a/lc9 0 2024-09-21T12:47:22.632 INFO:tasks.workunit.client.0.smithi046.stdout:2/647: mknod d16/d5c/d63/cd1 0 2024-09-21T12:47:22.636 INFO:tasks.workunit.client.0.smithi046.stdout:4/798: rename d1/d27/d58/lb0 to d1/d27/d37/d8f/l109 0 2024-09-21T12:47:22.637 INFO:tasks.workunit.client.0.smithi046.stdout:0/807: unlink d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd7 0 2024-09-21T12:47:22.638 INFO:tasks.workunit.client.0.smithi046.stdout:0/808: chown d6/d7/c66 3374745 1 2024-09-21T12:47:22.641 INFO:tasks.workunit.client.0.smithi046.stdout:2/648: rmdir d16/d22/d4e/d9d 39 2024-09-21T12:47:22.649 INFO:tasks.workunit.client.0.smithi046.stdout:0/809: dread d6/d60/f89 [0,4194304] 0 2024-09-21T12:47:22.652 INFO:tasks.workunit.client.0.smithi046.stdout:4/799: unlink d1/d27/d46/d78/lae 0 2024-09-21T12:47:22.658 INFO:tasks.workunit.client.0.smithi046.stdout:4/800: dwrite d1/d27/d37/d8f/fad [0,4194304] 0 2024-09-21T12:47:22.664 INFO:tasks.workunit.client.0.smithi046.stdout:0/810: rename d6/d7/d37/d53/c90 to d6/d60/dfa/c124 0 2024-09-21T12:47:22.666 INFO:tasks.workunit.client.0.smithi046.stdout:1/656: getdents d4/d13/d38/d53/d80/d8b 0 2024-09-21T12:47:22.666 INFO:tasks.workunit.client.0.smithi046.stdout:0/811: write d6/d7/d9/dca/ff4 [647559,21870] 0 2024-09-21T12:47:22.666 INFO:tasks.workunit.client.0.smithi046.stdout:4/801: truncate d1/d27/f9f 1020733 0 2024-09-21T12:47:22.668 INFO:tasks.workunit.client.0.smithi046.stdout:2/649: mknod d16/d22/d4e/d9d/cd2 0 2024-09-21T12:47:22.671 INFO:tasks.workunit.client.0.smithi046.stdout:4/802: rmdir d1/d27/d37/d8f/ddf 39 2024-09-21T12:47:22.674 INFO:tasks.workunit.client.0.smithi046.stdout:2/650: symlink d16/d5c/d63/db4/dca/ld3 0 2024-09-21T12:47:22.675 INFO:tasks.workunit.client.0.smithi046.stdout:2/651: dread - d16/f8d zero size 2024-09-21T12:47:22.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/803: symlink d1/d13/d25/d29/d43/d84/daa/l10a 0 2024-09-21T12:47:22.676 INFO:tasks.workunit.client.0.smithi046.stdout:1/657: dread - d4/d13/d38/d4f/d83/da9/fc4 zero size 2024-09-21T12:47:22.677 INFO:tasks.workunit.client.0.smithi046.stdout:2/652: read d16/d22/d38/f8b [1573253,69354] 0 2024-09-21T12:47:22.677 INFO:tasks.workunit.client.0.smithi046.stdout:0/812: symlink d6/d7/d13/d43/d52/d63/d7f/l125 0 2024-09-21T12:47:22.684 INFO:tasks.workunit.client.0.smithi046.stdout:0/813: chown d6/d7/d37/d53/f7c 38 1 2024-09-21T12:47:22.684 INFO:tasks.workunit.client.0.smithi046.stdout:2/653: mkdir d16/d5c/d63/db4/dd4 0 2024-09-21T12:47:22.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/658: dwrite d4/d13/d6b/f7b [4194304,4194304] 0 2024-09-21T12:47:22.686 INFO:tasks.workunit.client.0.smithi046.stdout:2/654: stat d16/d22/d38/d77 0 2024-09-21T12:47:22.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/655: write d16/d22/d75/fcf [542666,127856] 0 2024-09-21T12:47:22.692 INFO:tasks.workunit.client.0.smithi046.stdout:0/814: symlink d6/d7/d13/d43/d52/d63/d7f/d78/l126 0 2024-09-21T12:47:22.694 INFO:tasks.workunit.client.0.smithi046.stdout:1/659: mkdir d4/d13/d38/d4f/d83/dd5 0 2024-09-21T12:47:22.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/656: dwrite d16/d22/d38/d77/f9a [0,4194304] 0 2024-09-21T12:47:22.698 INFO:tasks.workunit.client.0.smithi046.stdout:2/657: fsync d16/d22/d38/f35 0 2024-09-21T12:47:22.699 INFO:tasks.workunit.client.0.smithi046.stdout:0/815: fdatasync d6/d7/d13/d43/d52/dc0/dc3/fbe 0 2024-09-21T12:47:22.701 INFO:tasks.workunit.client.0.smithi046.stdout:1/660: symlink d4/d29/d32/ld6 0 2024-09-21T12:47:22.702 INFO:tasks.workunit.client.0.smithi046.stdout:4/804: truncate d1/f26 1151240 0 2024-09-21T12:47:22.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/816: mkdir d6/d2f/de9/d127 0 2024-09-21T12:47:22.713 INFO:tasks.workunit.client.0.smithi046.stdout:1/661: mknod d4/d13/d38/d53/d80/d95/da5/cd7 0 2024-09-21T12:47:22.714 INFO:tasks.workunit.client.0.smithi046.stdout:1/662: write d4/d4d/fcb [221265,89275] 0 2024-09-21T12:47:22.717 INFO:tasks.workunit.client.0.smithi046.stdout:2/658: dread d16/d22/f2d [0,4194304] 0 2024-09-21T12:47:22.718 INFO:tasks.workunit.client.0.smithi046.stdout:4/805: truncate d1/d13/d4e/ffb 352120 0 2024-09-21T12:47:22.719 INFO:tasks.workunit.client.0.smithi046.stdout:1/663: chown d4/d13/d38/d53/d80/d8b/dc3/cc5 5 1 2024-09-21T12:47:22.720 INFO:tasks.workunit.client.0.smithi046.stdout:1/664: chown d4/d13/d79/c87 2 1 2024-09-21T12:47:22.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/659: rename d16/f20 to d16/d22/d38/fd5 0 2024-09-21T12:47:22.725 INFO:tasks.workunit.client.0.smithi046.stdout:2/660: readlink d16/d22/d2b/d43/l44 0 2024-09-21T12:47:22.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/661: chown d16/d22/d38/f35 266972 1 2024-09-21T12:47:22.727 INFO:tasks.workunit.client.0.smithi046.stdout:2/662: chown d16/fc8 8 1 2024-09-21T12:47:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:2/663: write d16/fc8 [850891,101255] 0 2024-09-21T12:47:22.728 INFO:tasks.workunit.client.0.smithi046.stdout:4/806: write d1/d27/d58/db7/fbb [6464036,48834] 0 2024-09-21T12:47:22.732 INFO:tasks.workunit.client.0.smithi046.stdout:0/817: dread d6/d7/d9/d54/f9d [0,4194304] 0 2024-09-21T12:47:22.733 INFO:tasks.workunit.client.0.smithi046.stdout:2/664: rmdir d16/d22/d38/dac 39 2024-09-21T12:47:22.733 INFO:tasks.workunit.client.0.smithi046.stdout:2/665: dread - d16/d22/d2b/d30/d67/f7b zero size 2024-09-21T12:47:22.734 INFO:tasks.workunit.client.0.smithi046.stdout:4/807: mkdir d1/d13/d25/d29/d43/d10b 0 2024-09-21T12:47:22.735 INFO:tasks.workunit.client.0.smithi046.stdout:4/808: dread - d1/d27/d82/da8/df7/ffc zero size 2024-09-21T12:47:22.739 INFO:tasks.workunit.client.0.smithi046.stdout:2/666: creat d16/d22/d2b/d30/d67/fd6 x:0 0 0 2024-09-21T12:47:22.741 INFO:tasks.workunit.client.0.smithi046.stdout:4/809: dread d1/d27/d82/da8/fcf [0,4194304] 0 2024-09-21T12:47:22.742 INFO:tasks.workunit.client.0.smithi046.stdout:0/818: truncate d6/d2f/de9/f101 654170 0 2024-09-21T12:47:22.743 INFO:tasks.workunit.client.0.smithi046.stdout:0/819: fdatasync d6/d7/d13/d43/d52/d63/fd2 0 2024-09-21T12:47:22.744 INFO:tasks.workunit.client.0.smithi046.stdout:2/667: mknod d16/d22/d2b/d30/d8f/cd7 0 2024-09-21T12:47:22.745 INFO:tasks.workunit.client.0.smithi046.stdout:0/820: read d6/d7/d13/d49/f9f [2229245,79712] 0 2024-09-21T12:47:22.747 INFO:tasks.workunit.client.0.smithi046.stdout:1/665: dread d4/d4d/f9d [0,4194304] 0 2024-09-21T12:47:22.751 INFO:tasks.workunit.client.0.smithi046.stdout:2/668: mknod d16/d5c/d63/db4/dca/dc1/cd8 0 2024-09-21T12:47:22.755 INFO:tasks.workunit.client.0.smithi046.stdout:1/666: creat d4/d13/d38/d53/d80/d8b/fd8 x:0 0 0 2024-09-21T12:47:22.759 INFO:tasks.workunit.client.0.smithi046.stdout:1/667: dread - d4/d13/f7f zero size 2024-09-21T12:47:22.760 INFO:tasks.workunit.client.0.smithi046.stdout:4/810: write d1/d27/d58/f53 [1893621,54713] 0 2024-09-21T12:47:22.766 INFO:tasks.workunit.client.0.smithi046.stdout:4/811: chown d1/d13/d4e/c6a 4280 1 2024-09-21T12:47:22.766 INFO:tasks.workunit.client.0.smithi046.stdout:1/668: symlink d4/d13/d38/d53/d80/d95/da5/ld9 0 2024-09-21T12:47:22.767 INFO:tasks.workunit.client.0.smithi046.stdout:4/812: rename d1/d27/d37/f63 to d1/d27/d37/d66/f10c 0 2024-09-21T12:47:22.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/669: write d16/d22/d38/d77/d7a/fa1 [368572,89377] 0 2024-09-21T12:47:22.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/669: mkdir d4/d4d/dda 0 2024-09-21T12:47:22.770 INFO:tasks.workunit.client.0.smithi046.stdout:6/625: sync 2024-09-21T12:47:22.771 INFO:tasks.workunit.client.0.smithi046.stdout:4/813: creat d1/d27/d37/f10d x:0 0 0 2024-09-21T12:47:22.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/821: dwrite d6/d7/d13/f3d [4194304,4194304] 0 2024-09-21T12:47:22.774 INFO:tasks.workunit.client.0.smithi046.stdout:1/670: unlink d4/d13/d38/d4f/fa0 0 2024-09-21T12:47:22.775 INFO:tasks.workunit.client.0.smithi046.stdout:0/822: stat d6/d7/d13/d43/d52/d63 0 2024-09-21T12:47:22.778 INFO:tasks.workunit.client.0.smithi046.stdout:6/626: symlink de/d2a/d34/db6/lcd 0 2024-09-21T12:47:22.782 INFO:tasks.workunit.client.0.smithi046.stdout:2/670: rename d16/d22/d2b/d30/c3a to d16/d5c/d63/db4/dca/cd9 0 2024-09-21T12:47:22.792 INFO:tasks.workunit.client.0.smithi046.stdout:6/627: chown de/l24 6578 1 2024-09-21T12:47:22.794 INFO:tasks.workunit.client.0.smithi046.stdout:2/671: rename d16/d22/d2b/d30/l76 to d16/d22/d2b/lda 0 2024-09-21T12:47:22.795 INFO:tasks.workunit.client.0.smithi046.stdout:4/814: dread d1/d13/d25/d3a/f4d [0,4194304] 0 2024-09-21T12:47:22.799 INFO:tasks.workunit.client.0.smithi046.stdout:0/823: write d6/d2f/d32/fbb [311723,125331] 0 2024-09-21T12:47:22.802 INFO:tasks.workunit.client.0.smithi046.stdout:6/628: dread de/d2a/d4c/d77/dae/f72 [0,4194304] 0 2024-09-21T12:47:22.802 INFO:tasks.workunit.client.0.smithi046.stdout:2/672: mkdir d16/d5c/d63/db4/dd4/ddb 0 2024-09-21T12:47:22.804 INFO:tasks.workunit.client.0.smithi046.stdout:1/671: dwrite d4/f6a [0,4194304] 0 2024-09-21T12:47:22.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/673: write d16/d22/d2b/f6e [7419071,20319] 0 2024-09-21T12:47:22.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/824: chown d6/d7/d13/d43/d52/d63/d7f/d38/da6/f6e 1903898039 1 2024-09-21T12:47:22.811 INFO:tasks.workunit.client.0.smithi046.stdout:3/561: sync 2024-09-21T12:47:22.811 INFO:tasks.workunit.client.0.smithi046.stdout:8/751: sync 2024-09-21T12:47:22.811 INFO:tasks.workunit.client.0.smithi046.stdout:9/812: sync 2024-09-21T12:47:22.812 INFO:tasks.workunit.client.0.smithi046.stdout:5/683: sync 2024-09-21T12:47:22.812 INFO:tasks.workunit.client.0.smithi046.stdout:7/743: sync 2024-09-21T12:47:22.813 INFO:tasks.workunit.client.0.smithi046.stdout:4/815: dwrite d1/d27/d58/f4f [0,4194304] 0 2024-09-21T12:47:22.814 INFO:tasks.workunit.client.0.smithi046.stdout:5/684: chown d4/d22/d99 1501 1 2024-09-21T12:47:22.820 INFO:tasks.workunit.client.0.smithi046.stdout:5/685: dread - d4/dc/d45/fd3 zero size 2024-09-21T12:47:22.827 INFO:tasks.workunit.client.0.smithi046.stdout:7/744: mknod d2/d4/df/d42/dd1/cf0 0 2024-09-21T12:47:22.827 INFO:tasks.workunit.client.0.smithi046.stdout:0/825: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/f93 [8388608,4194304] 0 2024-09-21T12:47:22.829 INFO:tasks.workunit.client.0.smithi046.stdout:1/672: dwrite d4/d13/d38/faf [0,4194304] 0 2024-09-21T12:47:22.831 INFO:tasks.workunit.client.0.smithi046.stdout:8/752: symlink d1/d12/l105 0 2024-09-21T12:47:22.832 INFO:tasks.workunit.client.0.smithi046.stdout:1/673: chown d4/d13/f2f 73236 1 2024-09-21T12:47:22.839 INFO:tasks.workunit.client.0.smithi046.stdout:6/629: truncate de/d2a/d4d/f7d 1943333 0 2024-09-21T12:47:22.842 INFO:tasks.workunit.client.0.smithi046.stdout:0/826: dwrite d6/d7/d13/d7b/da2/f5a [4194304,4194304] 0 2024-09-21T12:47:22.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/816: rename d1/d27/d37/fa7 to d1/d27/d37/d8f/f10e 0 2024-09-21T12:47:22.844 INFO:tasks.workunit.client.0.smithi046.stdout:8/753: read - d1/d12/f52 zero size 2024-09-21T12:47:22.845 INFO:tasks.workunit.client.0.smithi046.stdout:4/817: fdatasync d1/f74 0 2024-09-21T12:47:22.847 INFO:tasks.workunit.client.0.smithi046.stdout:2/674: dwrite d16/f27 [0,4194304] 0 2024-09-21T12:47:22.849 INFO:tasks.workunit.client.0.smithi046.stdout:8/754: write d1/fd [3346121,5232] 0 2024-09-21T12:47:22.851 INFO:tasks.workunit.client.0.smithi046.stdout:8/755: read - d1/d12/d53/d80/da1/fc8 zero size 2024-09-21T12:47:22.851 INFO:tasks.workunit.client.0.smithi046.stdout:6/630: unlink de/d2a/d4c/d77/fa1 0 2024-09-21T12:47:22.854 INFO:tasks.workunit.client.0.smithi046.stdout:1/674: creat d4/d13/dc0/fdb x:0 0 0 2024-09-21T12:47:22.859 INFO:tasks.workunit.client.0.smithi046.stdout:7/745: dread d2/d4/df/f4c [0,4194304] 0 2024-09-21T12:47:22.865 INFO:tasks.workunit.client.0.smithi046.stdout:1/675: mknod d4/d4d/cdc 0 2024-09-21T12:47:22.868 INFO:tasks.workunit.client.0.smithi046.stdout:9/813: truncate d11/d19/d36/d45/d6e/f76 3034482 0 2024-09-21T12:47:22.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/686: dread d4/d22/d10/d1a/f1c [0,4194304] 0 2024-09-21T12:47:22.870 INFO:tasks.workunit.client.0.smithi046.stdout:6/631: read de/f26 [7099900,55561] 0 2024-09-21T12:47:22.873 INFO:tasks.workunit.client.0.smithi046.stdout:2/675: rmdir d16/d22/d38/dac 39 2024-09-21T12:47:22.877 INFO:tasks.workunit.client.0.smithi046.stdout:6/632: creat de/d2a/d34/fce x:0 0 0 2024-09-21T12:47:22.883 INFO:tasks.workunit.client.0.smithi046.stdout:1/676: link d4/d13/d38/d53/d80/d95/da5/fc8 d4/d29/d32/d9e/d5d/d8c/d94/fdd 0 2024-09-21T12:47:22.887 INFO:tasks.workunit.client.0.smithi046.stdout:8/756: getdents d1/d12/d1a 0 2024-09-21T12:47:22.888 INFO:tasks.workunit.client.0.smithi046.stdout:1/677: mknod d4/d13/d38/cde 0 2024-09-21T12:47:22.888 INFO:tasks.workunit.client.0.smithi046.stdout:9/814: link d11/d19/d1b/c23 d11/d19/d1b/d4b/d91/c103 0 2024-09-21T12:47:22.888 INFO:tasks.workunit.client.0.smithi046.stdout:8/757: stat d1/d12/d46/f7e 0 2024-09-21T12:47:22.889 INFO:tasks.workunit.client.0.smithi046.stdout:9/815: write f10 [872943,35711] 0 2024-09-21T12:47:22.890 INFO:tasks.workunit.client.0.smithi046.stdout:8/758: chown d1/d12/d53/ce3 1 1 2024-09-21T12:47:22.894 INFO:tasks.workunit.client.0.smithi046.stdout:1/678: rename d4/f6a to d4/d29/d32/d9e/d5d/d8c/d92/fdf 0 2024-09-21T12:47:22.895 INFO:tasks.workunit.client.0.smithi046.stdout:8/759: symlink d1/d12/d53/d60/l106 0 2024-09-21T12:47:22.897 INFO:tasks.workunit.client.0.smithi046.stdout:0/827: dwrite d6/d7/d9/dc4/fdc [4194304,4194304] 0 2024-09-21T12:47:22.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/760: write d1/d12/f13 [4331520,85034] 0 2024-09-21T12:47:22.901 INFO:tasks.workunit.client.0.smithi046.stdout:9/816: dwrite d11/d19/d36/fd7 [0,4194304] 0 2024-09-21T12:47:22.904 INFO:tasks.workunit.client.0.smithi046.stdout:0/828: chown d6/d7/d13/d43/d52/d63/d7f/d78/d8a/lc9 1 1 2024-09-21T12:47:22.907 INFO:tasks.workunit.client.0.smithi046.stdout:0/829: read d6/d2f/d32/fbb [389565,122582] 0 2024-09-21T12:47:22.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/818: write d1/d27/d37/d66/f10c [776822,123105] 0 2024-09-21T12:47:22.909 INFO:tasks.workunit.client.0.smithi046.stdout:0/830: readlink d6/d7/d13/d43/d52/d63/d7f/d38/da6/lf2 0 2024-09-21T12:47:22.912 INFO:tasks.workunit.client.0.smithi046.stdout:1/679: getdents d4/d13 0 2024-09-21T12:47:22.913 INFO:tasks.workunit.client.0.smithi046.stdout:9/817: creat d11/d19/df2/df3/f104 x:0 0 0 2024-09-21T12:47:22.916 INFO:tasks.workunit.client.0.smithi046.stdout:7/746: write d2/d4/f8c [1357177,98853] 0 2024-09-21T12:47:22.921 INFO:tasks.workunit.client.0.smithi046.stdout:1/680: dwrite d4/d13/d38/d53/d80/f82 [0,4194304] 0 2024-09-21T12:47:22.924 INFO:tasks.workunit.client.0.smithi046.stdout:5/687: write d4/dc/d13/f23 [3522946,68941] 0 2024-09-21T12:47:22.926 INFO:tasks.workunit.client.0.smithi046.stdout:0/831: dread d6/d7/d13/d43/d52/dc0/dc3/f82 [0,4194304] 0 2024-09-21T12:47:22.927 INFO:tasks.workunit.client.0.smithi046.stdout:2/676: write d16/f21 [2073364,91108] 0 2024-09-21T12:47:22.929 INFO:tasks.workunit.client.0.smithi046.stdout:7/747: rmdir d2/d37/d8a/ddf 39 2024-09-21T12:47:22.931 INFO:tasks.workunit.client.0.smithi046.stdout:4/819: unlink d1/d27/d82/da8/df7/c100 0 2024-09-21T12:47:22.933 INFO:tasks.workunit.client.0.smithi046.stdout:9/818: dwrite d11/d19/d1b/d31/d53/da4/f7f [0,4194304] 0 2024-09-21T12:47:22.936 INFO:tasks.workunit.client.0.smithi046.stdout:1/681: unlink d4/d29/d32/d9e/d5d/d8c/fcf 0 2024-09-21T12:47:22.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/682: dread - d4/fb2 zero size 2024-09-21T12:47:22.937 INFO:tasks.workunit.client.0.smithi046.stdout:5/688: truncate d4/dc/d13/f50 4730335 0 2024-09-21T12:47:22.938 INFO:tasks.workunit.client.0.smithi046.stdout:1/683: fsync d4/d13/d38/d53/fa2 0 2024-09-21T12:47:22.943 INFO:tasks.workunit.client.0.smithi046.stdout:2/677: mknod d16/d22/d2b/d30/d8f/cdc 0 2024-09-21T12:47:22.944 INFO:tasks.workunit.client.0.smithi046.stdout:0/832: mknod d6/d7/d13/d43/d52/d63/d7f/d78/d8a/c128 0 2024-09-21T12:47:22.944 INFO:tasks.workunit.client.0.smithi046.stdout:6/633: write de/d48/f88 [3408178,51809] 0 2024-09-21T12:47:22.944 INFO:tasks.workunit.client.0.smithi046.stdout:7/748: dread - d2/d4/df/d6f/fb3 zero size 2024-09-21T12:47:22.946 INFO:tasks.workunit.client.0.smithi046.stdout:0/833: chown d6/d2f/d32/f47 1653 1 2024-09-21T12:47:22.950 INFO:tasks.workunit.client.0.smithi046.stdout:7/749: write d2/d37/d77/fae [2242000,67781] 0 2024-09-21T12:47:22.950 INFO:tasks.workunit.client.0.smithi046.stdout:9/819: rmdir d11/d19/d1b/d31/d44 39 2024-09-21T12:47:22.952 INFO:tasks.workunit.client.0.smithi046.stdout:7/750: write d2/d37/fd4 [631992,82152] 0 2024-09-21T12:47:22.953 INFO:tasks.workunit.client.0.smithi046.stdout:6/634: unlink de/d35/c36 0 2024-09-21T12:47:22.955 INFO:tasks.workunit.client.0.smithi046.stdout:0/834: dread d6/f3c [0,4194304] 0 2024-09-21T12:47:22.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/635: write de/d2a/d34/fce [60721,8318] 0 2024-09-21T12:47:22.958 INFO:tasks.workunit.client.0.smithi046.stdout:4/820: rmdir d1/d27/d37/d8f/def 0 2024-09-21T12:47:22.960 INFO:tasks.workunit.client.0.smithi046.stdout:4/821: read - d1/d27/d37/fb3 zero size 2024-09-21T12:47:22.961 INFO:tasks.workunit.client.0.smithi046.stdout:9/820: rename d11/d5b/d6f/db0/d30/d3e/cb7 to d11/d19/d36/d45/dfd/c105 0 2024-09-21T12:47:22.965 INFO:tasks.workunit.client.0.smithi046.stdout:7/751: creat d2/d4/df/d42/dd1/ff1 x:0 0 0 2024-09-21T12:47:22.967 INFO:tasks.workunit.client.0.smithi046.stdout:2/678: creat d16/d22/d38/fdd x:0 0 0 2024-09-21T12:47:22.969 INFO:tasks.workunit.client.0.smithi046.stdout:0/835: creat d6/d7/d9/d54/d97/f129 x:0 0 0 2024-09-21T12:47:22.969 INFO:tasks.workunit.client.0.smithi046.stdout:2/679: fsync d16/d22/d38/d77/d7a/fa1 0 2024-09-21T12:47:22.972 INFO:tasks.workunit.client.0.smithi046.stdout:4/822: creat d1/d27/d37/f10f x:0 0 0 2024-09-21T12:47:22.975 INFO:tasks.workunit.client.0.smithi046.stdout:5/689: getdents d4/dc/d45/d94 0 2024-09-21T12:47:22.980 INFO:tasks.workunit.client.0.smithi046.stdout:0/836: fsync d6/d7/d13/d43/d52/fb0 0 2024-09-21T12:47:22.981 INFO:tasks.workunit.client.0.smithi046.stdout:2/680: fsync d16/d22/d2b/d30/f58 0 2024-09-21T12:47:22.983 INFO:tasks.workunit.client.0.smithi046.stdout:2/681: read - d16/d5c/d63/fbf zero size 2024-09-21T12:47:22.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/823: mknod d1/d13/d4e/c110 0 2024-09-21T12:47:22.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/761: truncate d1/d12/d53/dab/ff0 588673 0 2024-09-21T12:47:22.987 INFO:tasks.workunit.client.0.smithi046.stdout:5/690: mknod d4/dc/d6b/cdd 0 2024-09-21T12:47:22.995 INFO:tasks.workunit.client.0.smithi046.stdout:0/837: rmdir d6/d7/d13/d49 39 2024-09-21T12:47:22.999 INFO:tasks.workunit.client.0.smithi046.stdout:4/824: mkdir d1/d13/d25/d3a/d111 0 2024-09-21T12:47:23.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/636: link de/d2a/d4c/d77/ca5 de/d2a/d4c/d71/d7c/ccf 0 2024-09-21T12:47:23.002 INFO:tasks.workunit.client.0.smithi046.stdout:6/637: dread - de/f6c zero size 2024-09-21T12:47:23.005 INFO:tasks.workunit.client.0.smithi046.stdout:9/821: link d11/d19/d1b/d31/d53/da4/fd4 d11/d19/d1b/d31/d44/da7/f106 0 2024-09-21T12:47:23.006 INFO:tasks.workunit.client.0.smithi046.stdout:7/752: creat d2/d4/ff2 x:0 0 0 2024-09-21T12:47:23.010 INFO:tasks.workunit.client.0.smithi046.stdout:8/762: mkdir d1/d12/d46/d107 0 2024-09-21T12:47:23.015 INFO:tasks.workunit.client.0.smithi046.stdout:6/638: creat de/d2a/d34/fd0 x:0 0 0 2024-09-21T12:47:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:7/753: creat d2/d4/d97/ff3 x:0 0 0 2024-09-21T12:47:23.018 INFO:tasks.workunit.client.0.smithi046.stdout:4/825: dwrite d1/d13/d25/d3a/f4d [4194304,4194304] 0 2024-09-21T12:47:23.019 INFO:tasks.workunit.client.0.smithi046.stdout:7/754: stat d2/d4 0 2024-09-21T12:47:23.044 INFO:tasks.workunit.client.0.smithi046.stdout:4/826: write d1/d13/d25/d6b/fbd [1047400,34876] 0 2024-09-21T12:47:23.044 INFO:tasks.workunit.client.0.smithi046.stdout:7/755: chown d2/d4/df/d70/d88/d34/f48 3023 1 2024-09-21T12:47:23.047 INFO:tasks.workunit.client.0.smithi046.stdout:2/682: write d16/d22/d38/fd5 [1233839,121795] 0 2024-09-21T12:47:23.047 INFO:tasks.workunit.client.0.smithi046.stdout:5/691: truncate d4/dc/d13/f23 4584072 0 2024-09-21T12:47:23.048 INFO:tasks.workunit.client.0.smithi046.stdout:7/756: readlink d2/d4/df/d70/d88/le2 0 2024-09-21T12:47:23.050 INFO:tasks.workunit.client.0.smithi046.stdout:8/763: write d1/d12/d46/d35/d36/d51/d8c/fa3 [1198324,105908] 0 2024-09-21T12:47:23.055 INFO:tasks.workunit.client.0.smithi046.stdout:9/822: getdents d11/d19/df2 0 2024-09-21T12:47:23.056 INFO:tasks.workunit.client.0.smithi046.stdout:7/757: write d2/d4/d43/fe4 [381065,67337] 0 2024-09-21T12:47:23.057 INFO:tasks.workunit.client.0.smithi046.stdout:5/692: symlink d4/dc/d45/lde 0 2024-09-21T12:47:23.057 INFO:tasks.workunit.client.0.smithi046.stdout:0/838: dwrite d6/d7/d37/f67 [0,4194304] 0 2024-09-21T12:47:23.057 INFO:tasks.workunit.client.0.smithi046.stdout:4/827: truncate d1/f26 714790 0 2024-09-21T12:47:23.066 INFO:tasks.workunit.client.0.smithi046.stdout:6/639: dwrite de/d2a/d4c/d71/f93 [0,4194304] 0 2024-09-21T12:47:23.066 INFO:tasks.workunit.client.0.smithi046.stdout:7/758: mkdir d2/d4/df/d42/dd1/df4 0 2024-09-21T12:47:23.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/828: dread d1/d27/f9f [0,4194304] 0 2024-09-21T12:47:23.070 INFO:tasks.workunit.client.0.smithi046.stdout:2/683: creat d16/d5c/d63/db4/dd4/ddb/fde x:0 0 0 2024-09-21T12:47:23.079 INFO:tasks.workunit.client.0.smithi046.stdout:9/823: symlink d11/d5b/d6f/db0/d74/l107 0 2024-09-21T12:47:23.080 INFO:tasks.workunit.client.0.smithi046.stdout:6/640: stat de/d2a/d4c/d69/ca2 0 2024-09-21T12:47:23.080 INFO:tasks.workunit.client.0.smithi046.stdout:7/759: fdatasync d2/d4/f8 0 2024-09-21T12:47:23.089 INFO:tasks.workunit.client.0.smithi046.stdout:7/760: dwrite d2/d37/d77/fde [0,4194304] 0 2024-09-21T12:47:23.094 INFO:tasks.workunit.client.0.smithi046.stdout:4/829: dread d1/d27/d58/f53 [0,4194304] 0 2024-09-21T12:47:23.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/830: write d1/d27/d37/d66/fa0 [1758617,91559] 0 2024-09-21T12:47:23.103 INFO:tasks.workunit.client.0.smithi046.stdout:4/831: dwrite d1/d13/d25/d6b/fbd [0,4194304] 0 2024-09-21T12:47:23.122 INFO:tasks.workunit.client.0.smithi046.stdout:8/764: rename d1/d12/d46/d35/d7d/d6a/dd1/de7 to d1/d12/d46/d108 0 2024-09-21T12:47:23.125 INFO:tasks.workunit.client.0.smithi046.stdout:7/761: creat d2/d4/df/d6f/d92/ff5 x:0 0 0 2024-09-21T12:47:23.125 INFO:tasks.workunit.client.0.smithi046.stdout:9/824: dwrite d11/f3c [0,4194304] 0 2024-09-21T12:47:23.126 INFO:tasks.workunit.client.0.smithi046.stdout:8/765: write d1/d12/d46/d35/d36/d51/d8c/fa3 [1655741,22561] 0 2024-09-21T12:47:23.134 INFO:tasks.workunit.client.0.smithi046.stdout:0/839: rename d6/d7/d13/d43/d52/dc0/dc3/f7e to d6/d7/d13/d43/d52/d63/d7f/d38/f12a 0 2024-09-21T12:47:23.138 INFO:tasks.workunit.client.0.smithi046.stdout:9/825: mknod d11/d19/df2/df3/c108 0 2024-09-21T12:47:23.139 INFO:tasks.workunit.client.0.smithi046.stdout:7/762: dread d2/dd/f29 [0,4194304] 0 2024-09-21T12:47:23.140 INFO:tasks.workunit.client.0.smithi046.stdout:8/766: unlink d1/d12/d46/d35/d36/dc6/fa7 0 2024-09-21T12:47:23.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/840: creat d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f12b x:0 0 0 2024-09-21T12:47:23.142 INFO:tasks.workunit.client.0.smithi046.stdout:0/841: fsync d6/f10e 0 2024-09-21T12:47:23.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/767: chown d1/d12/d1a/c40 1148210094 1 2024-09-21T12:47:23.145 INFO:tasks.workunit.client.0.smithi046.stdout:8/768: stat d1/d12/d46/d107 0 2024-09-21T12:47:23.146 INFO:tasks.workunit.client.0.smithi046.stdout:7/763: unlink d2/d4/df/d42/c90 0 2024-09-21T12:47:23.147 INFO:tasks.workunit.client.0.smithi046.stdout:8/769: truncate d1/d12/d53/d80/ffc 972389 0 2024-09-21T12:47:23.147 INFO:tasks.workunit.client.0.smithi046.stdout:0/842: rmdir d6/d7/d13/d43/d52/dc0/dc3 39 2024-09-21T12:47:23.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/770: chown d1/d12/d46/d35/fcf 66521937 1 2024-09-21T12:47:23.148 INFO:tasks.workunit.client.0.smithi046.stdout:8/771: chown d1/d12/d53/d80 1532337817 1 2024-09-21T12:47:23.154 INFO:tasks.workunit.client.0.smithi046.stdout:8/772: dread d1/d12/f2a [0,4194304] 0 2024-09-21T12:47:23.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/773: creat d1/d12/d53/d60/f109 x:0 0 0 2024-09-21T12:47:23.158 INFO:tasks.workunit.client.0.smithi046.stdout:5/693: truncate d4/dc/d45/f49 1333520 0 2024-09-21T12:47:23.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/774: rename d1/d12/d46/d35/d7d/f4a to d1/d12/d46/d35/d36/d51/d8c/f10a 0 2024-09-21T12:47:23.163 INFO:tasks.workunit.client.0.smithi046.stdout:8/775: mknod d1/d12/d46/d35/d36/dce/c10b 0 2024-09-21T12:47:23.164 INFO:tasks.workunit.client.0.smithi046.stdout:2/684: truncate d16/d22/d38/f42 551691 0 2024-09-21T12:47:23.166 INFO:tasks.workunit.client.0.smithi046.stdout:2/685: mkdir d16/d22/d4e/d9d/ddf 0 2024-09-21T12:47:23.167 INFO:tasks.workunit.client.0.smithi046.stdout:4/832: write d1/d13/d25/d29/d33/f62 [233238,104333] 0 2024-09-21T12:47:23.169 INFO:tasks.workunit.client.0.smithi046.stdout:8/776: dwrite d1/d12/d46/d35/d5b/f6d [0,4194304] 0 2024-09-21T12:47:23.171 INFO:tasks.workunit.client.0.smithi046.stdout:2/686: mknod d16/d5c/d63/db4/dd4/ddb/ce0 0 2024-09-21T12:47:23.173 INFO:tasks.workunit.client.0.smithi046.stdout:2/687: chown d16/d22/d2b/d43/f73 0 1 2024-09-21T12:47:23.175 INFO:tasks.workunit.client.0.smithi046.stdout:2/688: write d16/d22/d2b/d30/d67/fab [490536,10546] 0 2024-09-21T12:47:23.175 INFO:tasks.workunit.client.0.smithi046.stdout:4/833: creat d1/d13/d8b/f112 x:0 0 0 2024-09-21T12:47:23.176 INFO:tasks.workunit.client.0.smithi046.stdout:9/826: write d11/d19/d1b/d4b/f56 [4810793,2576] 0 2024-09-21T12:47:23.176 INFO:tasks.workunit.client.0.smithi046.stdout:2/689: dread - d16/d22/fc4 zero size 2024-09-21T12:47:23.179 INFO:tasks.workunit.client.0.smithi046.stdout:4/834: fdatasync d1/d13/d25/d29/f42 0 2024-09-21T12:47:23.179 INFO:tasks.workunit.client.0.smithi046.stdout:0/843: write d6/d7/d13/d72/f79 [1432960,121741] 0 2024-09-21T12:47:23.179 INFO:tasks.workunit.client.0.smithi046.stdout:2/690: readlink d16/d22/d4e/lcd 0 2024-09-21T12:47:23.182 INFO:tasks.workunit.client.0.smithi046.stdout:8/777: link d1/d12/d1a/la4 d1/d12/d46/l10c 0 2024-09-21T12:47:23.183 INFO:tasks.workunit.client.0.smithi046.stdout:4/835: chown d1/d13/d25/f1e 2297427 1 2024-09-21T12:47:23.185 INFO:tasks.workunit.client.0.smithi046.stdout:2/691: mkdir d16/d5c/de1 0 2024-09-21T12:47:23.187 INFO:tasks.workunit.client.0.smithi046.stdout:7/764: dwrite d2/d4/df/faa [0,4194304] 0 2024-09-21T12:47:23.189 INFO:tasks.workunit.client.0.smithi046.stdout:0/844: read d6/d7/d13/d43/d52/d63/d7f/d38/db7/fd3 [3258616,104632] 0 2024-09-21T12:47:23.196 INFO:tasks.workunit.client.0.smithi046.stdout:2/692: creat d16/d5c/d63/db4/dca/fe2 x:0 0 0 2024-09-21T12:47:23.197 INFO:tasks.workunit.client.0.smithi046.stdout:5/694: dwrite d4/dc/d13/f35 [0,4194304] 0 2024-09-21T12:47:23.198 INFO:tasks.workunit.client.0.smithi046.stdout:4/836: dread d1/d27/d37/f49 [0,4194304] 0 2024-09-21T12:47:23.200 INFO:tasks.workunit.client.0.smithi046.stdout:4/837: fsync d1/d27/d82/fb4 0 2024-09-21T12:47:23.207 INFO:tasks.workunit.client.0.smithi046.stdout:2/693: mknod d16/d5c/ce3 0 2024-09-21T12:47:23.208 INFO:tasks.workunit.client.0.smithi046.stdout:5/695: dwrite d4/dc/d13/f35 [0,4194304] 0 2024-09-21T12:47:23.210 INFO:tasks.workunit.client.0.smithi046.stdout:2/694: write d16/d5c/d63/db4/dca/fe2 [134161,68989] 0 2024-09-21T12:47:23.211 INFO:tasks.workunit.client.0.smithi046.stdout:2/695: chown d16/d22/d2b/d30/l81 163729033 1 2024-09-21T12:47:23.213 INFO:tasks.workunit.client.0.smithi046.stdout:9/827: dread d11/d19/d1b/d31/f7d [0,4194304] 0 2024-09-21T12:47:23.214 INFO:tasks.workunit.client.0.smithi046.stdout:4/838: write d1/d27/d37/d8f/ddf/fe0 [682359,98238] 0 2024-09-21T12:47:23.215 INFO:tasks.workunit.client.0.smithi046.stdout:8/778: write d1/d12/d53/d60/fac [549812,37894] 0 2024-09-21T12:47:23.216 INFO:tasks.workunit.client.0.smithi046.stdout:7/765: dread d2/d4/df/d70/d88/d34/f4b [0,4194304] 0 2024-09-21T12:47:23.220 INFO:tasks.workunit.client.0.smithi046.stdout:2/696: truncate d16/f25 724435 0 2024-09-21T12:47:23.221 INFO:tasks.workunit.client.0.smithi046.stdout:0/845: write d6/d7/d13/d43/d52/dc0/dc3/fbe [3118149,90658] 0 2024-09-21T12:47:23.223 INFO:tasks.workunit.client.0.smithi046.stdout:4/839: dread d1/f35 [0,4194304] 0 2024-09-21T12:47:23.225 INFO:tasks.workunit.client.0.smithi046.stdout:8/779: creat d1/dc1/f10d x:0 0 0 2024-09-21T12:47:23.231 INFO:tasks.workunit.client.0.smithi046.stdout:0/846: write d6/f21 [1160582,76747] 0 2024-09-21T12:47:23.232 INFO:tasks.workunit.client.0.smithi046.stdout:8/780: symlink d1/d12/d46/d35/d36/d51/d8c/l10e 0 2024-09-21T12:47:23.232 INFO:tasks.workunit.client.0.smithi046.stdout:0/847: readlink d6/d60/lc1 0 2024-09-21T12:47:23.233 INFO:tasks.workunit.client.0.smithi046.stdout:4/840: mknod d1/d27/d37/d66/df3/c113 0 2024-09-21T12:47:23.235 INFO:tasks.workunit.client.0.smithi046.stdout:5/696: dwrite d4/dc/d13/d15/f84 [0,4194304] 0 2024-09-21T12:47:23.235 INFO:tasks.workunit.client.0.smithi046.stdout:7/766: rename d2/d4/df/d6f/d92/f95 to d2/d4/df/ff6 0 2024-09-21T12:47:23.236 INFO:tasks.workunit.client.0.smithi046.stdout:9/828: link d11/d19/d1b/d31/d53/da4/cf5 d11/d19/c109 0 2024-09-21T12:47:23.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/848: symlink d6/d7/d13/d43/d52/d63/l12c 0 2024-09-21T12:47:23.239 INFO:tasks.workunit.client.0.smithi046.stdout:5/697: fdatasync d4/d22/d10/d1a/d9e/fd6 0 2024-09-21T12:47:23.239 INFO:tasks.workunit.client.0.smithi046.stdout:7/767: write d2/d37/d77/fae [1877395,117914] 0 2024-09-21T12:47:23.242 INFO:tasks.workunit.client.0.smithi046.stdout:2/697: rename d16/d22/f2d to d16/d22/d4e/d90/dc6/fe4 0 2024-09-21T12:47:23.247 INFO:tasks.workunit.client.0.smithi046.stdout:9/829: truncate f4 2086828 0 2024-09-21T12:47:23.249 INFO:tasks.workunit.client.0.smithi046.stdout:2/698: dwrite d16/d22/f41 [0,4194304] 0 2024-09-21T12:47:23.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/698: creat d4/d22/d99/dc7/fdf x:0 0 0 2024-09-21T12:47:23.254 INFO:tasks.workunit.client.0.smithi046.stdout:8/781: rename d1/d12/d46/d35/d5b/dd6/c100 to d1/d12/d53/c10f 0 2024-09-21T12:47:23.254 INFO:tasks.workunit.client.0.smithi046.stdout:5/699: rename d4/d22/d10 to d4/d22/d10/d1a/d9e/de0 22 2024-09-21T12:47:23.257 INFO:tasks.workunit.client.0.smithi046.stdout:5/700: dread - d4/d22/d99/dc7/fdf zero size 2024-09-21T12:47:23.257 INFO:tasks.workunit.client.0.smithi046.stdout:8/782: truncate d1/d12/d53/fd4 1004331 0 2024-09-21T12:47:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:9/830: symlink d11/d19/df2/df3/l10a 0 2024-09-21T12:47:23.258 INFO:tasks.workunit.client.0.smithi046.stdout:5/701: chown d4/d22/d99/d9d/la5 70 1 2024-09-21T12:47:23.259 INFO:tasks.workunit.client.0.smithi046.stdout:7/768: symlink d2/d4/df/d42/dca/lf7 0 2024-09-21T12:47:23.259 INFO:tasks.workunit.client.0.smithi046.stdout:5/702: read - d4/fd0 zero size 2024-09-21T12:47:23.271 INFO:tasks.workunit.client.0.smithi046.stdout:0/849: write d6/d60/fcb [628050,7911] 0 2024-09-21T12:47:23.272 INFO:tasks.workunit.client.0.smithi046.stdout:4/841: dread d1/d27/d37/fd9 [0,4194304] 0 2024-09-21T12:47:23.273 INFO:tasks.workunit.client.0.smithi046.stdout:0/850: write d6/f3c [3925303,47545] 0 2024-09-21T12:47:23.277 INFO:tasks.workunit.client.0.smithi046.stdout:4/842: truncate d1/d13/d25/d6b/ffd 32702 0 2024-09-21T12:47:23.277 INFO:tasks.workunit.client.0.smithi046.stdout:9/831: link d11/d19/d36/f42 d11/d5b/d6f/db0/d30/d90/f10b 0 2024-09-21T12:47:23.279 INFO:tasks.workunit.client.0.smithi046.stdout:4/843: stat d1/d27/d37/d8f/ddf/ccd 0 2024-09-21T12:47:23.281 INFO:tasks.workunit.client.0.smithi046.stdout:7/769: link d2/d4/d43/fb0 d2/d4/df/d42/dd1/ff8 0 2024-09-21T12:47:23.281 INFO:tasks.workunit.client.0.smithi046.stdout:4/844: chown d1/d13/d25/f19 59141031 1 2024-09-21T12:47:23.281 INFO:tasks.workunit.client.0.smithi046.stdout:5/703: dwrite d4/dc/d13/da2/fd4 [0,4194304] 0 2024-09-21T12:47:23.285 INFO:tasks.workunit.client.0.smithi046.stdout:5/704: fsync d4/d22/d10/d1a/d9e/d9a/fb1 0 2024-09-21T12:47:23.286 INFO:tasks.workunit.client.0.smithi046.stdout:9/832: dwrite d11/d19/d1b/d4b/f5f [0,4194304] 0 2024-09-21T12:47:23.286 INFO:tasks.workunit.client.0.smithi046.stdout:0/851: rename d6/d2f/d32/fb2 to d6/d7/d13/d72/d10a/f12d 0 2024-09-21T12:47:23.291 INFO:tasks.workunit.client.0.smithi046.stdout:7/770: rmdir d2/d4/df 39 2024-09-21T12:47:23.294 INFO:tasks.workunit.client.0.smithi046.stdout:9/833: dwrite d11/d19/d1b/d1c/fc8 [0,4194304] 0 2024-09-21T12:47:23.295 INFO:tasks.workunit.client.0.smithi046.stdout:8/783: write d1/d12/d46/d35/d36/d51/d8c/f10a [1690836,81302] 0 2024-09-21T12:47:23.303 INFO:tasks.workunit.client.0.smithi046.stdout:5/705: unlink d4/dc/d13/d5b/d2d/d43/d7a/f88 0 2024-09-21T12:47:23.304 INFO:tasks.workunit.client.0.smithi046.stdout:5/706: dread - d4/d22/d99/d9d/fcd zero size 2024-09-21T12:47:23.306 INFO:tasks.workunit.client.0.smithi046.stdout:4/845: symlink d1/d27/d82/df9/l114 0 2024-09-21T12:47:23.315 INFO:tasks.workunit.client.0.smithi046.stdout:5/707: readlink d4/dc/d45/l6e 0 2024-09-21T12:47:23.317 INFO:tasks.workunit.client.0.smithi046.stdout:0/852: dread d6/d7/d13/f36 [0,4194304] 0 2024-09-21T12:47:23.320 INFO:tasks.workunit.client.0.smithi046.stdout:9/834: write d11/d19/d1b/d31/d53/d5e/fb8 [607355,24195] 0 2024-09-21T12:47:23.321 INFO:tasks.workunit.client.0.smithi046.stdout:8/784: write d1/fd2 [428209,41618] 0 2024-09-21T12:47:23.322 INFO:tasks.workunit.client.0.smithi046.stdout:7/771: mknod d2/d4/df/d70/d88/d34/d7f/de3/cf9 0 2024-09-21T12:47:23.324 INFO:tasks.workunit.client.0.smithi046.stdout:5/708: creat d4/d22/d99/d9d/fe1 x:0 0 0 2024-09-21T12:47:23.325 INFO:tasks.workunit.client.0.smithi046.stdout:4/846: mkdir d1/d13/d25/d29/d33/d115 0 2024-09-21T12:47:23.327 INFO:tasks.workunit.client.0.smithi046.stdout:0/853: creat d6/d7/d13/d43/d52/d63/d7f/d38/da6/f12e x:0 0 0 2024-09-21T12:47:23.329 INFO:tasks.workunit.client.0.smithi046.stdout:4/847: mkdir d1/d13/d25/d29/d43/d116 0 2024-09-21T12:47:23.330 INFO:tasks.workunit.client.0.smithi046.stdout:4/848: fsync d1/f74 0 2024-09-21T12:47:23.331 INFO:tasks.workunit.client.0.smithi046.stdout:4/849: fsync d1/f39 0 2024-09-21T12:47:23.332 INFO:tasks.workunit.client.0.smithi046.stdout:5/709: rename d4/dc/d13/d15/fa0 to d4/dc/d45/dd7/fe2 0 2024-09-21T12:47:23.334 INFO:tasks.workunit.client.0.smithi046.stdout:9/835: dread d11/d19/d1b/d4b/f56 [0,4194304] 0 2024-09-21T12:47:23.334 INFO:tasks.workunit.client.0.smithi046.stdout:9/836: chown d11/d19/d1b/d4b/d91/d94 399 1 2024-09-21T12:47:23.343 INFO:tasks.workunit.client.0.smithi046.stdout:9/837: mkdir d11/d5b/d10c 0 2024-09-21T12:47:23.344 INFO:tasks.workunit.client.0.smithi046.stdout:8/785: link d1/d12/d46/d35/d36/dce/c10b d1/d12/d46/d35/d36/d51/d8c/dee/c110 0 2024-09-21T12:47:23.344 INFO:tasks.workunit.client.0.smithi046.stdout:9/838: dread - d11/d19/d1b/d4b/d91/fe0 zero size 2024-09-21T12:47:23.350 INFO:tasks.workunit.client.0.smithi046.stdout:7/772: getdents d2/dd 0 2024-09-21T12:47:23.351 INFO:tasks.workunit.client.0.smithi046.stdout:7/773: write d2/d37/d77/fae [525758,83216] 0 2024-09-21T12:47:23.353 INFO:tasks.workunit.client.0.smithi046.stdout:8/786: mknod d1/d12/d53/c111 0 2024-09-21T12:47:23.355 INFO:tasks.workunit.client.0.smithi046.stdout:9/839: symlink d11/d19/d1b/d31/d53/da4/l10d 0 2024-09-21T12:47:23.360 INFO:tasks.workunit.client.0.smithi046.stdout:8/787: dwrite d1/d12/d46/d35/d79/fec [0,4194304] 0 2024-09-21T12:47:23.360 INFO:tasks.workunit.client.0.smithi046.stdout:0/854: link d6/d7/d13/d7b/da2/c24 d6/d7/d13/c12f 0 2024-09-21T12:47:23.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/710: getdents d4/d22/d10/d1a/d9e/d9a 0 2024-09-21T12:47:23.364 INFO:tasks.workunit.client.0.smithi046.stdout:7/774: symlink d2/d37/d8a/ddf/lfa 0 2024-09-21T12:47:23.364 INFO:tasks.workunit.client.0.smithi046.stdout:8/788: chown d1/d12/d46/d35/d5b/c61 738477 1 2024-09-21T12:47:23.367 INFO:tasks.workunit.client.0.smithi046.stdout:0/855: read - d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100/f121 zero size 2024-09-21T12:47:23.368 INFO:tasks.workunit.client.0.smithi046.stdout:4/850: dwrite d1/d13/d25/d29/d33/f65 [0,4194304] 0 2024-09-21T12:47:23.370 INFO:tasks.workunit.client.0.smithi046.stdout:5/711: mkdir d4/dc/d45/dd7/de3 0 2024-09-21T12:47:23.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/789: creat d1/d12/d46/d35/d5b/f112 x:0 0 0 2024-09-21T12:47:23.375 INFO:tasks.workunit.client.0.smithi046.stdout:7/775: truncate d2/d4/df/d6f/f85 293533 0 2024-09-21T12:47:23.376 INFO:tasks.workunit.client.0.smithi046.stdout:7/776: dread - d2/d37/d8a/ddf/fd0 zero size 2024-09-21T12:47:23.379 INFO:tasks.workunit.client.0.smithi046.stdout:0/856: unlink d6/d7/d13/d49/d51/f113 0 2024-09-21T12:47:23.383 INFO:tasks.workunit.client.0.smithi046.stdout:4/851: truncate d1/d27/d46/d78/f98 1696203 0 2024-09-21T12:47:23.385 INFO:tasks.workunit.client.0.smithi046.stdout:7/777: unlink d2/d4/df/d70/d88/d34/f38 0 2024-09-21T12:47:23.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/790: dread d1/d12/d46/d35/d5b/f69 [0,4194304] 0 2024-09-21T12:47:23.387 INFO:tasks.workunit.client.0.smithi046.stdout:5/712: creat d4/fe4 x:0 0 0 2024-09-21T12:47:23.388 INFO:tasks.workunit.client.0.smithi046.stdout:5/713: write d4/dc/d45/fd3 [409043,122907] 0 2024-09-21T12:47:23.392 INFO:tasks.workunit.client.0.smithi046.stdout:7/778: fsync d2/d4/f2f 0 2024-09-21T12:47:23.397 INFO:tasks.workunit.client.0.smithi046.stdout:5/714: write d4/d22/d10/d1a/f77 [4686226,17760] 0 2024-09-21T12:47:23.402 INFO:tasks.workunit.client.0.smithi046.stdout:8/791: dread d1/d12/d53/fcc [0,4194304] 0 2024-09-21T12:47:23.405 INFO:tasks.workunit.client.0.smithi046.stdout:8/792: read d1/d12/d46/d35/d36/d51/f5a [3195847,57615] 0 2024-09-21T12:47:23.405 INFO:tasks.workunit.client.0.smithi046.stdout:0/857: link d6/f62 d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f130 0 2024-09-21T12:47:23.406 INFO:tasks.workunit.client.0.smithi046.stdout:8/793: read d1/d12/f13 [597630,6213] 0 2024-09-21T12:47:23.410 INFO:tasks.workunit.client.0.smithi046.stdout:4/852: rename d1/d13/d25/d3a/l60 to d1/d27/d46/d78/l117 0 2024-09-21T12:47:23.412 INFO:tasks.workunit.client.0.smithi046.stdout:8/794: dwrite d1/d12/d46/d35/d79/fec [0,4194304] 0 2024-09-21T12:47:23.415 INFO:tasks.workunit.client.0.smithi046.stdout:7/779: write d2/d4/df/d6f/f85 [1077732,21753] 0 2024-09-21T12:47:23.418 INFO:tasks.workunit.client.0.smithi046.stdout:5/715: rename d4/dc/c58 to d4/d22/d99/d9d/ce5 0 2024-09-21T12:47:23.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/795: rename d1/d12/d46/d35/d7d/d6a/dd1 to d1/d12/d46/d35/d5b/dd6/d113 0 2024-09-21T12:47:23.425 INFO:tasks.workunit.client.0.smithi046.stdout:7/780: mknod d2/d4/cfb 0 2024-09-21T12:47:23.426 INFO:tasks.workunit.client.0.smithi046.stdout:7/781: chown d2/d4/df/d70/d88/d34/d7f/c98 74 1 2024-09-21T12:47:23.430 INFO:tasks.workunit.client.0.smithi046.stdout:0/858: getdents d6/d7/dfd 0 2024-09-21T12:47:23.433 INFO:tasks.workunit.client.0.smithi046.stdout:8/796: dread d1/d12/d46/d35/d36/f4b [0,4194304] 0 2024-09-21T12:47:23.434 INFO:tasks.workunit.client.0.smithi046.stdout:7/782: mknod d2/d4/cfc 0 2024-09-21T12:47:23.436 INFO:tasks.workunit.client.0.smithi046.stdout:5/716: getdents d4/dc 0 2024-09-21T12:47:23.437 INFO:tasks.workunit.client.0.smithi046.stdout:4/853: dwrite d1/d27/d46/d78/f98 [0,4194304] 0 2024-09-21T12:47:23.437 INFO:tasks.workunit.client.0.smithi046.stdout:0/859: creat d6/d7/d13/d7b/da2/f131 x:0 0 0 2024-09-21T12:47:23.439 INFO:tasks.workunit.client.0.smithi046.stdout:5/717: write d4/dc/d13/f35 [544893,34402] 0 2024-09-21T12:47:23.439 INFO:tasks.workunit.client.0.smithi046.stdout:8/797: mkdir d1/d12/d46/d35/d5b/dd6/d113/d114 0 2024-09-21T12:47:23.440 INFO:tasks.workunit.client.0.smithi046.stdout:0/860: chown d6/d7/d37/ff6 186 1 2024-09-21T12:47:23.440 INFO:tasks.workunit.client.0.smithi046.stdout:5/718: fdatasync d4/d22/d10/d1a/f1c 0 2024-09-21T12:47:23.441 INFO:tasks.workunit.client.0.smithi046.stdout:8/798: chown d1/d12/d1a/d33/fdc 215 1 2024-09-21T12:47:23.442 INFO:tasks.workunit.client.0.smithi046.stdout:0/861: write d6/d2f/f9e [3425205,127213] 0 2024-09-21T12:47:23.443 INFO:tasks.workunit.client.0.smithi046.stdout:7/783: mkdir d2/d4/df/d42/dd1/dfd 0 2024-09-21T12:47:23.444 INFO:tasks.workunit.client.0.smithi046.stdout:8/799: chown d1/d12/d46/d35/d36/d86/fc0 12048959 1 2024-09-21T12:47:23.449 INFO:tasks.workunit.client.0.smithi046.stdout:0/862: mkdir d6/d7/d9/d54/d132 0 2024-09-21T12:47:23.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/800: creat d1/d12/d46/d108/f115 x:0 0 0 2024-09-21T12:47:23.456 INFO:tasks.workunit.client.0.smithi046.stdout:4/854: write d1/f26 [1185761,54491] 0 2024-09-21T12:47:23.458 INFO:tasks.workunit.client.0.smithi046.stdout:0/863: fdatasync d6/d7/f9a 0 2024-09-21T12:47:23.460 INFO:tasks.workunit.client.0.smithi046.stdout:7/784: rename d2/l19 to d2/d4/df/d42/lfe 0 2024-09-21T12:47:23.461 INFO:tasks.workunit.client.0.smithi046.stdout:8/801: write d1/d12/d46/d35/d5b/fdd [321075,59390] 0 2024-09-21T12:47:23.462 INFO:tasks.workunit.client.0.smithi046.stdout:5/719: link d4/dc/d45/l6e d4/dc/d13/da2/dce/le6 0 2024-09-21T12:47:23.467 INFO:tasks.workunit.client.0.smithi046.stdout:0/864: rename d6/d7/d13/fb3 to d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f133 0 2024-09-21T12:47:23.468 INFO:tasks.workunit.client.0.smithi046.stdout:0/865: write d6/d2f/d32/fba [10100936,48015] 0 2024-09-21T12:47:23.469 INFO:tasks.workunit.client.0.smithi046.stdout:4/855: creat d1/d13/d25/d29/d43/d116/f118 x:0 0 0 2024-09-21T12:47:23.482 INFO:tasks.workunit.client.0.smithi046.stdout:4/856: dread d1/d13/d25/d29/d33/f62 [0,4194304] 0 2024-09-21T12:47:23.484 INFO:tasks.workunit.client.0.smithi046.stdout:7/785: creat d2/d4/d43/fff x:0 0 0 2024-09-21T12:47:23.484 INFO:tasks.workunit.client.0.smithi046.stdout:5/720: write d4/dc/d13/d15/d54/f70 [74368,9618] 0 2024-09-21T12:47:23.486 INFO:tasks.workunit.client.0.smithi046.stdout:5/721: fdatasync d4/dc/d13/d5b/fbf 0 2024-09-21T12:47:23.487 INFO:tasks.workunit.client.0.smithi046.stdout:8/802: link d1/d12/d46/d35/d5b/f70 d1/d12/d46/d35/d36/d51/f116 0 2024-09-21T12:47:23.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/786: truncate d2/d4/df/d9a/dc3/fe7 285203 0 2024-09-21T12:47:23.488 INFO:tasks.workunit.client.0.smithi046.stdout:4/857: mknod d1/d27/d37/d8f/c119 0 2024-09-21T12:47:23.488 INFO:tasks.workunit.client.0.smithi046.stdout:0/866: getdents d6/d7/d13/db6 0 2024-09-21T12:47:23.489 INFO:tasks.workunit.client.0.smithi046.stdout:8/803: chown d1/d12/d1a/d33/d6c/ca9 1643030 1 2024-09-21T12:47:23.490 INFO:tasks.workunit.client.0.smithi046.stdout:7/787: write d2/d4/df/d17/fc1 [390477,30901] 0 2024-09-21T12:47:23.498 INFO:tasks.workunit.client.0.smithi046.stdout:4/858: dwrite d1/d13/d25/d29/f54 [0,4194304] 0 2024-09-21T12:47:23.499 INFO:tasks.workunit.client.0.smithi046.stdout:0/867: dread d6/d2f/d32/f65 [0,4194304] 0 2024-09-21T12:47:23.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/788: creat d2/d4/df/d9a/dc3/f100 x:0 0 0 2024-09-21T12:47:23.504 INFO:tasks.workunit.client.0.smithi046.stdout:5/722: dread d4/d22/d10/d1a/f27 [0,4194304] 0 2024-09-21T12:47:23.506 INFO:tasks.workunit.client.0.smithi046.stdout:8/804: rename d1/d12/d46/d35/d7d/d6a/f9a to d1/d12/d46/d35/d36/d51/d8c/dee/f117 0 2024-09-21T12:47:23.510 INFO:tasks.workunit.client.0.smithi046.stdout:4/859: unlink d1/f97 0 2024-09-21T12:47:23.515 INFO:tasks.workunit.client.0.smithi046.stdout:7/789: creat d2/d4/df/d42/dd1/f101 x:0 0 0 2024-09-21T12:47:23.520 INFO:tasks.workunit.client.0.smithi046.stdout:5/723: rename d4/dc/d13/d15/d90 to d4/d22/d99/de7 0 2024-09-21T12:47:23.524 INFO:tasks.workunit.client.0.smithi046.stdout:4/860: write d1/d27/d82/fd7 [199522,66440] 0 2024-09-21T12:47:23.527 INFO:tasks.workunit.client.0.smithi046.stdout:0/868: dwrite d6/d7/f5b [0,4194304] 0 2024-09-21T12:47:23.530 INFO:tasks.workunit.client.0.smithi046.stdout:0/869: write d6/d7/d9/dca/ff4 [908476,124311] 0 2024-09-21T12:47:23.534 INFO:tasks.workunit.client.0.smithi046.stdout:8/805: dwrite d1/fa [0,4194304] 0 2024-09-21T12:47:23.534 INFO:tasks.workunit.client.0.smithi046.stdout:5/724: write d4/d22/d99/d9d/fcd [333429,12065] 0 2024-09-21T12:47:23.535 INFO:tasks.workunit.client.0.smithi046.stdout:4/861: fdatasync d1/d13/d25/f1e 0 2024-09-21T12:47:23.535 INFO:tasks.workunit.client.0.smithi046.stdout:0/870: dread d6/d7/d13/d72/d10a/f10b [0,4194304] 0 2024-09-21T12:47:23.542 INFO:tasks.workunit.client.0.smithi046.stdout:7/790: mknod d2/d4/d43/c102 0 2024-09-21T12:47:23.546 INFO:tasks.workunit.client.0.smithi046.stdout:4/862: creat d1/d13/d4e/f11a x:0 0 0 2024-09-21T12:47:23.548 INFO:tasks.workunit.client.0.smithi046.stdout:5/725: creat d4/dc/d13/d5b/d2d/d43/d7a/fe8 x:0 0 0 2024-09-21T12:47:23.550 INFO:tasks.workunit.client.0.smithi046.stdout:4/863: chown d1/d27/d82/da8/le9 29407 1 2024-09-21T12:47:23.551 INFO:tasks.workunit.client.0.smithi046.stdout:7/791: dwrite d2/d37/f82 [4194304,4194304] 0 2024-09-21T12:47:23.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/792: readlink d2/d4/df/d6f/l73 0 2024-09-21T12:47:23.552 INFO:tasks.workunit.client.0.smithi046.stdout:4/864: mknod d1/d5f/c11b 0 2024-09-21T12:47:23.554 INFO:tasks.workunit.client.0.smithi046.stdout:3/562: sync 2024-09-21T12:47:23.554 INFO:tasks.workunit.client.0.smithi046.stdout:4/865: stat d1/lac 0 2024-09-21T12:47:23.555 INFO:tasks.workunit.client.0.smithi046.stdout:5/726: creat d4/dc/d13/d5b/d2d/d43/ddb/fe9 x:0 0 0 2024-09-21T12:47:23.559 INFO:tasks.workunit.client.0.smithi046.stdout:8/806: dread d1/d12/d46/d35/d7d/f42 [0,4194304] 0 2024-09-21T12:47:23.560 INFO:tasks.workunit.client.0.smithi046.stdout:3/563: rename d5/c82 to d5/d16/d5f/d6c/cc8 0 2024-09-21T12:47:23.561 INFO:tasks.workunit.client.0.smithi046.stdout:8/807: read - d1/d12/d53/d80/da1/fc8 zero size 2024-09-21T12:47:23.561 INFO:tasks.workunit.client.0.smithi046.stdout:7/793: symlink d2/d4/df/d70/d88/d34/d7f/l103 0 2024-09-21T12:47:23.570 INFO:tasks.workunit.client.0.smithi046.stdout:0/871: dwrite d6/d7/d13/d7b/da2/f33 [4194304,4194304] 0 2024-09-21T12:47:23.573 INFO:tasks.workunit.client.0.smithi046.stdout:5/727: rename d4/dc/d13/d15/l69 to d4/d22/d99/dc7/lea 0 2024-09-21T12:47:23.575 INFO:tasks.workunit.client.0.smithi046.stdout:8/808: symlink d1/d12/d46/d35/d7d/d6a/l118 0 2024-09-21T12:47:23.577 INFO:tasks.workunit.client.0.smithi046.stdout:7/794: mkdir d2/d4/d43/dd6/d104 0 2024-09-21T12:47:23.578 INFO:tasks.workunit.client.0.smithi046.stdout:7/795: dread - d2/d4/df/d42/dd1/f101 zero size 2024-09-21T12:47:23.579 INFO:tasks.workunit.client.0.smithi046.stdout:4/866: getdents d1/d27/d58/db7 0 2024-09-21T12:47:23.584 INFO:tasks.workunit.client.0.smithi046.stdout:5/728: creat d4/dc/d13/d5b/d2d/d3b/feb x:0 0 0 2024-09-21T12:47:23.586 INFO:tasks.workunit.client.0.smithi046.stdout:7/796: mkdir d2/d37/d77/d105 0 2024-09-21T12:47:23.587 INFO:tasks.workunit.client.0.smithi046.stdout:4/867: dwrite d1/d27/d37/fb3 [0,4194304] 0 2024-09-21T12:47:23.591 INFO:tasks.workunit.client.0.smithi046.stdout:8/809: symlink d1/d12/d46/d107/l119 0 2024-09-21T12:47:23.594 INFO:tasks.workunit.client.0.smithi046.stdout:0/872: dread d6/d7/d13/d72/d10a/f12d [0,4194304] 0 2024-09-21T12:47:23.596 INFO:tasks.workunit.client.0.smithi046.stdout:7/797: dwrite d2/d4/f54 [4194304,4194304] 0 2024-09-21T12:47:23.597 INFO:tasks.workunit.client.0.smithi046.stdout:0/873: fdatasync d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100/f121 0 2024-09-21T12:47:23.598 INFO:tasks.workunit.client.0.smithi046.stdout:5/729: creat d4/dc/d13/d15/d54/fec x:0 0 0 2024-09-21T12:47:23.606 INFO:tasks.workunit.client.0.smithi046.stdout:8/810: read - d1/d12/d53/d80/da1/fc3 zero size 2024-09-21T12:47:23.606 INFO:tasks.workunit.client.0.smithi046.stdout:3/564: link d5/dc/d30/l7b d5/dc/d26/d3c/d44/lc9 0 2024-09-21T12:47:23.607 INFO:tasks.workunit.client.0.smithi046.stdout:5/730: dwrite d4/dc/d13/d15/d54/fec [0,4194304] 0 2024-09-21T12:47:23.608 INFO:tasks.workunit.client.0.smithi046.stdout:7/798: rename d2/d4/df/d70/d88/d34/f4b to d2/d4/df/d70/d88/d34/f106 0 2024-09-21T12:47:23.609 INFO:tasks.workunit.client.0.smithi046.stdout:8/811: write d1/d12/d46/d35/d5b/dd6/d113/ff5 [322913,105570] 0 2024-09-21T12:47:23.610 INFO:tasks.workunit.client.0.smithi046.stdout:0/874: mkdir d6/d7/d13/d43/d52/d63/d7f/d78/d8a/d134 0 2024-09-21T12:47:23.614 INFO:tasks.workunit.client.0.smithi046.stdout:4/868: getdents d1/d13/d25/d29/d33/dca 0 2024-09-21T12:47:23.614 INFO:tasks.workunit.client.0.smithi046.stdout:4/869: chown d1/f39 0 1 2024-09-21T12:47:23.617 INFO:tasks.workunit.client.0.smithi046.stdout:6/641: sync 2024-09-21T12:47:23.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/684: sync 2024-09-21T12:47:23.617 INFO:tasks.workunit.client.0.smithi046.stdout:1/685: stat d4/d13/f7f 0 2024-09-21T12:47:23.621 INFO:tasks.workunit.client.0.smithi046.stdout:1/686: dwrite d4/d13/f84 [0,4194304] 0 2024-09-21T12:47:23.709 INFO:tasks.workunit.client.0.smithi046.stdout:5/731: rmdir d4/d22/d99/dc7 39 2024-09-21T12:47:23.709 INFO:tasks.workunit.client.0.smithi046.stdout:0/875: readlink d6/d60/lb9 0 2024-09-21T12:47:23.710 INFO:tasks.workunit.client.0.smithi046.stdout:0/876: chown d6/d7/d9/d54/c84 11840 1 2024-09-21T12:47:23.711 INFO:tasks.workunit.client.0.smithi046.stdout:4/870: symlink d1/d5f/l11c 0 2024-09-21T12:47:23.715 INFO:tasks.workunit.client.0.smithi046.stdout:8/812: creat d1/d12/d46/d35/d36/dc6/df1/f11a x:0 0 0 2024-09-21T12:47:23.719 INFO:tasks.workunit.client.0.smithi046.stdout:1/687: write d4/d29/d32/d9e/d5d/fb9 [945443,116670] 0 2024-09-21T12:47:23.720 INFO:tasks.workunit.client.0.smithi046.stdout:8/813: mknod d1/d12/d53/d80/c11b 0 2024-09-21T12:47:23.720 INFO:tasks.workunit.client.0.smithi046.stdout:5/732: write d4/dc/d13/da2/fd4 [3427818,91825] 0 2024-09-21T12:47:23.723 INFO:tasks.workunit.client.0.smithi046.stdout:3/565: getdents d5/dc/d26/d3c/d44 0 2024-09-21T12:47:23.724 INFO:tasks.workunit.client.0.smithi046.stdout:0/877: dread d6/d2f/de9/f103 [0,4194304] 0 2024-09-21T12:47:23.725 INFO:tasks.workunit.client.0.smithi046.stdout:4/871: creat d1/d27/d58/f11d x:0 0 0 2024-09-21T12:47:23.726 INFO:tasks.workunit.client.0.smithi046.stdout:8/814: symlink d1/d12/d53/dab/l11c 0 2024-09-21T12:47:23.727 INFO:tasks.workunit.client.0.smithi046.stdout:4/872: read d1/d13/d25/d6b/fbd [2521590,87615] 0 2024-09-21T12:47:23.728 INFO:tasks.workunit.client.0.smithi046.stdout:5/733: unlink d4/dc/d13/d5b/d2d/d43/l4e 0 2024-09-21T12:47:23.730 INFO:tasks.workunit.client.0.smithi046.stdout:1/688: link d4/d13/d79/fb7 d4/d29/d32/fe0 0 2024-09-21T12:47:23.734 INFO:tasks.workunit.client.0.smithi046.stdout:8/815: rename d1/fd2 to d1/d12/d46/d35/d5b/f11d 0 2024-09-21T12:47:23.736 INFO:tasks.workunit.client.0.smithi046.stdout:8/816: stat d1/d12/d46/d35/d36/dce/cdb 0 2024-09-21T12:47:23.737 INFO:tasks.workunit.client.0.smithi046.stdout:0/878: dwrite d6/d2f/de9/f103 [0,4194304] 0 2024-09-21T12:47:23.737 INFO:tasks.workunit.client.0.smithi046.stdout:4/873: rmdir d1/d27/d37/d66 39 2024-09-21T12:47:23.749 INFO:tasks.workunit.client.0.smithi046.stdout:8/817: rename d1/d12/d46/d35/d7d/d6a/fbd to d1/d12/d53/f11e 0 2024-09-21T12:47:23.750 INFO:tasks.workunit.client.0.smithi046.stdout:3/566: dwrite d5/d16/f65 [0,4194304] 0 2024-09-21T12:47:23.752 INFO:tasks.workunit.client.0.smithi046.stdout:5/734: unlink d4/d22/d99/de7/lac 0 2024-09-21T12:47:23.754 INFO:tasks.workunit.client.0.smithi046.stdout:4/874: symlink d1/d27/d37/d66/l11e 0 2024-09-21T12:47:23.756 INFO:tasks.workunit.client.0.smithi046.stdout:4/875: write d1/d13/d25/d29/d33/f41 [6452499,117361] 0 2024-09-21T12:47:23.760 INFO:tasks.workunit.client.0.smithi046.stdout:3/567: dread d5/dc/d28/f7f [0,4194304] 0 2024-09-21T12:47:23.760 INFO:tasks.workunit.client.0.smithi046.stdout:8/818: creat d1/d12/d46/d35/d5b/dd6/d113/f11f x:0 0 0 2024-09-21T12:47:23.769 INFO:tasks.workunit.client.0.smithi046.stdout:1/689: dwrite d4/f10 [0,4194304] 0 2024-09-21T12:47:23.777 INFO:tasks.workunit.client.0.smithi046.stdout:0/879: getdents d6/d7/d13/d43/d52 0 2024-09-21T12:47:23.778 INFO:tasks.workunit.client.0.smithi046.stdout:4/876: write d1/d27/d37/f49 [1611870,62363] 0 2024-09-21T12:47:23.781 INFO:tasks.workunit.client.0.smithi046.stdout:8/819: write d1/d12/d53/d80/da1/fc3 [771776,107372] 0 2024-09-21T12:47:23.787 INFO:tasks.workunit.client.0.smithi046.stdout:1/690: rmdir d4/d13/d38/d4f 39 2024-09-21T12:47:23.789 INFO:tasks.workunit.client.0.smithi046.stdout:3/568: rename d5/f6 to d5/dc/d26/fca 0 2024-09-21T12:47:23.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/735: truncate d4/dc/d13/d5b/d2d/d3b/f68 883671 0 2024-09-21T12:47:23.792 INFO:tasks.workunit.client.0.smithi046.stdout:5/736: write d4/dc/d45/d94/fc8 [748013,13447] 0 2024-09-21T12:47:23.794 INFO:tasks.workunit.client.0.smithi046.stdout:0/880: truncate d6/d7/d13/d43/d52/fb0 143170 0 2024-09-21T12:47:23.796 INFO:tasks.workunit.client.0.smithi046.stdout:1/691: read - d4/d13/d38/d4f/d83/fbe zero size 2024-09-21T12:47:23.797 INFO:tasks.workunit.client.0.smithi046.stdout:4/877: rename d1/d13/d4e/l88 to d1/d13/d25/d29/d43/d116/l11f 0 2024-09-21T12:47:23.797 INFO:tasks.workunit.client.0.smithi046.stdout:1/692: chown d4/d13/d38/d4f/d83/da9 2 1 2024-09-21T12:47:23.798 INFO:tasks.workunit.client.0.smithi046.stdout:3/569: symlink d5/d16/d5f/dad/lcb 0 2024-09-21T12:47:23.801 INFO:tasks.workunit.client.0.smithi046.stdout:0/881: rename d6/d7/d13/d49/fe0 to d6/d7/d9/f135 0 2024-09-21T12:47:23.802 INFO:tasks.workunit.client.0.smithi046.stdout:1/693: dread - d4/f22 zero size 2024-09-21T12:47:23.802 INFO:tasks.workunit.client.0.smithi046.stdout:0/882: dread - d6/d7/d13/d43/d52/d63/f96 zero size 2024-09-21T12:47:23.803 INFO:tasks.workunit.client.0.smithi046.stdout:1/694: chown d4/d13/d38/d53/d80/d8b/dc3/cc5 6512 1 2024-09-21T12:47:23.806 INFO:tasks.workunit.client.0.smithi046.stdout:8/820: getdents d1/d12/d46/d35/d7d/d6a 0 2024-09-21T12:47:23.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/570: mkdir d5/dc/d94/dcc 0 2024-09-21T12:47:23.807 INFO:tasks.workunit.client.0.smithi046.stdout:8/821: readlink d1/d12/d53/d60/l106 0 2024-09-21T12:47:23.809 INFO:tasks.workunit.client.0.smithi046.stdout:0/883: dwrite d6/d7/df3/f118 [0,4194304] 0 2024-09-21T12:47:23.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/695: truncate d4/d29/d32/f40 538994 0 2024-09-21T12:47:23.811 INFO:tasks.workunit.client.0.smithi046.stdout:0/884: chown d6/d7/cc 178709 1 2024-09-21T12:47:23.813 INFO:tasks.workunit.client.0.smithi046.stdout:8/822: rmdir d1/d12/d46/d35 39 2024-09-21T12:47:23.818 INFO:tasks.workunit.client.0.smithi046.stdout:4/878: getdents d1/d13/d25/d29 0 2024-09-21T12:47:23.822 INFO:tasks.workunit.client.0.smithi046.stdout:3/571: dread d5/dc/d26/d3c/d44/f4b [0,4194304] 0 2024-09-21T12:47:23.824 INFO:tasks.workunit.client.0.smithi046.stdout:3/572: write d5/dc/d26/f3d [5656423,82678] 0 2024-09-21T12:47:23.826 INFO:tasks.workunit.client.0.smithi046.stdout:3/573: write d5/dc/f57 [3982180,69534] 0 2024-09-21T12:47:23.826 INFO:tasks.workunit.client.0.smithi046.stdout:1/696: creat d4/d13/d38/d53/d80/d95/fe1 x:0 0 0 2024-09-21T12:47:23.835 INFO:tasks.workunit.client.0.smithi046.stdout:8/823: truncate d1/d12/d1a/fb7 166627 0 2024-09-21T12:47:23.837 INFO:tasks.workunit.client.0.smithi046.stdout:4/879: mkdir d1/d13/d25/d29/d43/d84/d120 0 2024-09-21T12:47:23.842 INFO:tasks.workunit.client.0.smithi046.stdout:3/574: mknod d5/dc/d30/d34/ccd 0 2024-09-21T12:47:23.845 INFO:tasks.workunit.client.0.smithi046.stdout:8/824: mknod d1/d12/d53/d80/da1/def/c120 0 2024-09-21T12:47:23.846 INFO:tasks.workunit.client.0.smithi046.stdout:8/825: write d1/dc1/f10d [679690,43111] 0 2024-09-21T12:47:23.852 INFO:tasks.workunit.client.0.smithi046.stdout:1/697: creat d4/d13/d38/d53/d80/fe2 x:0 0 0 2024-09-21T12:47:23.853 INFO:tasks.workunit.client.0.smithi046.stdout:0/885: write d6/d7/d13/d43/d52/d63/d7f/d38/da6/f6e [757424,55394] 0 2024-09-21T12:47:23.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/575: creat d5/dc/d30/fce x:0 0 0 2024-09-21T12:47:23.863 INFO:tasks.workunit.client.0.smithi046.stdout:0/886: mknod d6/d7/d13/d43/d52/d63/d7f/d38/da6/c136 0 2024-09-21T12:47:23.866 INFO:tasks.workunit.client.0.smithi046.stdout:8/826: dwrite d1/d12/d46/d35/d5b/dd6/fe0 [0,4194304] 0 2024-09-21T12:47:23.870 INFO:tasks.workunit.client.0.smithi046.stdout:0/887: dread d6/d7/d13/f36 [0,4194304] 0 2024-09-21T12:47:23.875 INFO:tasks.workunit.client.0.smithi046.stdout:8/827: dwrite d1/d12/d53/d60/f64 [0,4194304] 0 2024-09-21T12:47:23.878 INFO:tasks.workunit.client.0.smithi046.stdout:4/880: write d1/d13/d4e/ffb [138366,100307] 0 2024-09-21T12:47:23.882 INFO:tasks.workunit.client.0.smithi046.stdout:0/888: getdents d6/d7/d13/d7b 0 2024-09-21T12:47:23.883 INFO:tasks.workunit.client.0.smithi046.stdout:4/881: dread d1/ff [4194304,4194304] 0 2024-09-21T12:47:23.885 INFO:tasks.workunit.client.0.smithi046.stdout:4/882: readlink d1/d85/lcb 0 2024-09-21T12:47:23.886 INFO:tasks.workunit.client.0.smithi046.stdout:8/828: dwrite d1/d12/d46/d35/d5b/dd6/fe0 [0,4194304] 0 2024-09-21T12:47:23.887 INFO:tasks.workunit.client.0.smithi046.stdout:4/883: fsync d1/d13/d25/d29/f42 0 2024-09-21T12:47:23.888 INFO:tasks.workunit.client.0.smithi046.stdout:4/884: readlink d1/d27/d37/d66/lbe 0 2024-09-21T12:47:23.889 INFO:tasks.workunit.client.0.smithi046.stdout:0/889: truncate d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100/f121 275269 0 2024-09-21T12:47:23.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/885: chown d1/d27/d82/da8/fcf 207892053 1 2024-09-21T12:47:23.893 INFO:tasks.workunit.client.0.smithi046.stdout:8/829: dread - d1/d12/d46/d35/d36/d51/fb1 zero size 2024-09-21T12:47:23.896 INFO:tasks.workunit.client.0.smithi046.stdout:0/890: truncate d6/d7/d37/f48 1855097 0 2024-09-21T12:47:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/830: unlink d1/d12/d1a/d33/cb9 0 2024-09-21T12:47:23.899 INFO:tasks.workunit.client.0.smithi046.stdout:1/698: write d4/d13/d38/d53/d80/d95/da5/fb5 [497711,42984] 0 2024-09-21T12:47:23.900 INFO:tasks.workunit.client.0.smithi046.stdout:1/699: stat d4/d13/d6b/l91 0 2024-09-21T12:47:23.902 INFO:tasks.workunit.client.0.smithi046.stdout:1/700: write d4/d13/d38/d53/d80/f85 [3120673,110076] 0 2024-09-21T12:47:23.903 INFO:tasks.workunit.client.0.smithi046.stdout:0/891: creat d6/d7/d13/d49/f137 x:0 0 0 2024-09-21T12:47:23.910 INFO:tasks.workunit.client.0.smithi046.stdout:8/831: creat d1/d12/d46/d35/d5b/dd6/d113/d114/f121 x:0 0 0 2024-09-21T12:47:23.910 INFO:tasks.workunit.client.0.smithi046.stdout:3/576: dwrite d5/dc/d26/f4f [0,4194304] 0 2024-09-21T12:47:23.911 INFO:tasks.workunit.client.0.smithi046.stdout:8/832: fdatasync d1/d12/d46/d35/d36/f4e 0 2024-09-21T12:47:23.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/577: mkdir d5/d5e/d8e/dcf 0 2024-09-21T12:47:23.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/701: truncate d4/d13/d38/d53/d80/d95/da5/fc8 1646648 0 2024-09-21T12:47:23.919 INFO:tasks.workunit.client.0.smithi046.stdout:8/833: dread d1/d12/f72 [0,4194304] 0 2024-09-21T12:47:23.921 INFO:tasks.workunit.client.0.smithi046.stdout:8/834: read d1/d12/d46/fd5 [2756705,29533] 0 2024-09-21T12:47:23.921 INFO:tasks.workunit.client.0.smithi046.stdout:3/578: mknod d5/d16/cd0 0 2024-09-21T12:47:23.927 INFO:tasks.workunit.client.0.smithi046.stdout:3/579: rmdir d5/dc/d28/d63 39 2024-09-21T12:47:23.934 INFO:tasks.workunit.client.0.smithi046.stdout:8/835: creat d1/d12/d46/d35/d36/d51/dd8/f122 x:0 0 0 2024-09-21T12:47:23.935 INFO:tasks.workunit.client.0.smithi046.stdout:8/836: readlink d1/d12/d53/l54 0 2024-09-21T12:47:23.940 INFO:tasks.workunit.client.0.smithi046.stdout:2/699: sync 2024-09-21T12:47:23.940 INFO:tasks.workunit.client.0.smithi046.stdout:9/840: sync 2024-09-21T12:47:23.940 INFO:tasks.workunit.client.0.smithi046.stdout:3/580: getdents d5/dc/d94 0 2024-09-21T12:47:23.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/581: truncate d5/d5e/d8e/faf 143303 0 2024-09-21T12:47:23.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/837: unlink d1/d12/d46/d35/d36/d51/d8c/ff4 0 2024-09-21T12:47:23.943 INFO:tasks.workunit.client.0.smithi046.stdout:9/841: write d11/d19/d1b/fdd [5033908,65710] 0 2024-09-21T12:47:23.946 INFO:tasks.workunit.client.0.smithi046.stdout:3/582: read d5/d16/d5f/fa2 [2217691,58666] 0 2024-09-21T12:47:23.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/700: link d16/d22/ca5 d16/d5c/ce5 0 2024-09-21T12:47:23.956 INFO:tasks.workunit.client.0.smithi046.stdout:3/583: rmdir d5/dc/d28/d63 39 2024-09-21T12:47:23.962 INFO:tasks.workunit.client.0.smithi046.stdout:9/842: rename d11/d5b/d6f/db0/d30/d3e/f87 to d11/d19/d36/f10e 0 2024-09-21T12:47:23.965 INFO:tasks.workunit.client.0.smithi046.stdout:4/886: dwrite d1/d27/d37/d8f/f10e [0,4194304] 0 2024-09-21T12:47:23.967 INFO:tasks.workunit.client.0.smithi046.stdout:2/701: fdatasync d16/d22/f2e 0 2024-09-21T12:47:23.967 INFO:tasks.workunit.client.0.smithi046.stdout:4/887: chown d1/d27/l68 126848969 1 2024-09-21T12:47:23.969 INFO:tasks.workunit.client.0.smithi046.stdout:3/584: rename d5/dc/d28/d60/d6e to d5/dc/d30/d34/dd1 0 2024-09-21T12:47:23.974 INFO:tasks.workunit.client.0.smithi046.stdout:0/892: truncate d6/d2f/f10d 3498683 0 2024-09-21T12:47:23.976 INFO:tasks.workunit.client.0.smithi046.stdout:9/843: dwrite d11/d19/d1b/d31/d44/fa3 [0,4194304] 0 2024-09-21T12:47:23.977 INFO:tasks.workunit.client.0.smithi046.stdout:1/702: write d4/d13/d38/d53/d80/d95/da5/fb6 [471204,21285] 0 2024-09-21T12:47:23.983 INFO:tasks.workunit.client.0.smithi046.stdout:3/585: dread d5/f62 [0,4194304] 0 2024-09-21T12:47:23.989 INFO:tasks.workunit.client.0.smithi046.stdout:9/844: dwrite d11/d19/d1b/fdd [4194304,4194304] 0 2024-09-21T12:47:23.990 INFO:tasks.workunit.client.0.smithi046.stdout:2/702: dwrite d16/d22/d38/fdd [0,4194304] 0 2024-09-21T12:47:23.994 INFO:tasks.workunit.client.0.smithi046.stdout:1/703: creat d4/d13/d79/fe3 x:0 0 0 2024-09-21T12:47:23.998 INFO:tasks.workunit.client.0.smithi046.stdout:4/888: symlink d1/d13/d25/d3a/d111/l121 0 2024-09-21T12:47:23.998 INFO:tasks.workunit.client.0.smithi046.stdout:3/586: rename d5/dc/d26/f4f to d5/dc/d26/fd2 0 2024-09-21T12:47:24.000 INFO:tasks.workunit.client.0.smithi046.stdout:8/838: write d1/d12/d46/d35/d36/d51/fb1 [967571,15785] 0 2024-09-21T12:47:24.006 INFO:tasks.workunit.client.0.smithi046.stdout:8/839: chown d1/d12/d1a/c55 1013 1 2024-09-21T12:47:24.008 INFO:tasks.workunit.client.0.smithi046.stdout:2/703: dwrite d16/d22/d38/d77/d7a/f98 [0,4194304] 0 2024-09-21T12:47:24.009 INFO:tasks.workunit.client.0.smithi046.stdout:2/704: chown d16/d22/f31 179988122 1 2024-09-21T12:47:24.010 INFO:tasks.workunit.client.0.smithi046.stdout:2/705: readlink d16/d22/d4e/lcd 0 2024-09-21T12:47:24.016 INFO:tasks.workunit.client.0.smithi046.stdout:3/587: creat d5/dc/d30/d34/fd3 x:0 0 0 2024-09-21T12:47:24.016 INFO:tasks.workunit.client.0.smithi046.stdout:3/588: chown d5/dc/d26/f37 374513454 1 2024-09-21T12:47:24.017 INFO:tasks.workunit.client.0.smithi046.stdout:4/889: symlink d1/d27/d46/ddb/l122 0 2024-09-21T12:47:24.017 INFO:tasks.workunit.client.0.smithi046.stdout:3/589: dread - d5/d16/d5f/f8b zero size 2024-09-21T12:47:24.019 INFO:tasks.workunit.client.0.smithi046.stdout:8/840: mkdir d1/d12/d46/d35/d36/dce/d123 0 2024-09-21T12:47:24.019 INFO:tasks.workunit.client.0.smithi046.stdout:0/893: write d6/d7/d13/d43/d52/f5e [800441,36674] 0 2024-09-21T12:47:24.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/706: creat d16/d22/d2b/d30/d67/fe6 x:0 0 0 2024-09-21T12:47:24.022 INFO:tasks.workunit.client.0.smithi046.stdout:0/894: chown d6/d7/d9/dca 921659298 1 2024-09-21T12:47:24.023 INFO:tasks.workunit.client.0.smithi046.stdout:1/704: creat d4/d13/d38/d53/fe4 x:0 0 0 2024-09-21T12:47:24.024 INFO:tasks.workunit.client.0.smithi046.stdout:4/890: creat d1/d13/d25/d29/d43/d84/daa/f123 x:0 0 0 2024-09-21T12:47:24.026 INFO:tasks.workunit.client.0.smithi046.stdout:8/841: mkdir d1/d12/d46/d35/d124 0 2024-09-21T12:47:24.028 INFO:tasks.workunit.client.0.smithi046.stdout:9/845: dread d11/d19/d1b/d4b/d91/f7c [0,4194304] 0 2024-09-21T12:47:24.029 INFO:tasks.workunit.client.0.smithi046.stdout:0/895: fsync d6/d7/f9a 0 2024-09-21T12:47:24.029 INFO:tasks.workunit.client.0.smithi046.stdout:4/891: rmdir d1/d27/d46 39 2024-09-21T12:47:24.031 INFO:tasks.workunit.client.0.smithi046.stdout:2/707: symlink d16/d22/d38/le7 0 2024-09-21T12:47:24.032 INFO:tasks.workunit.client.0.smithi046.stdout:3/590: dwrite d5/dc/d94/da6/fb0 [0,4194304] 0 2024-09-21T12:47:24.035 INFO:tasks.workunit.client.0.smithi046.stdout:3/591: stat d5/d16/f42 0 2024-09-21T12:47:24.036 INFO:tasks.workunit.client.0.smithi046.stdout:8/842: dwrite d1/f8 [4194304,4194304] 0 2024-09-21T12:47:24.037 INFO:tasks.workunit.client.0.smithi046.stdout:1/705: mknod d4/d4d/dda/ce5 0 2024-09-21T12:47:24.038 INFO:tasks.workunit.client.0.smithi046.stdout:9/846: chown d11/d5b/d6f/db0/d30/f5d 949037207 1 2024-09-21T12:47:24.049 INFO:tasks.workunit.client.0.smithi046.stdout:8/843: symlink d1/d12/d53/d80/l125 0 2024-09-21T12:47:24.053 INFO:tasks.workunit.client.0.smithi046.stdout:9/847: dread d11/f99 [0,4194304] 0 2024-09-21T12:47:24.055 INFO:tasks.workunit.client.0.smithi046.stdout:7/799: sync 2024-09-21T12:47:24.055 INFO:tasks.workunit.client.0.smithi046.stdout:6/642: sync 2024-09-21T12:47:24.055 INFO:tasks.workunit.client.0.smithi046.stdout:5/737: sync 2024-09-21T12:47:24.055 INFO:tasks.workunit.client.0.smithi046.stdout:1/706: rename d4/d13/c67 to d4/d29/d32/d9e/d5d/d8c/d92/dcc/ce6 0 2024-09-21T12:47:24.056 INFO:tasks.workunit.client.0.smithi046.stdout:7/800: write d2/d37/f4d [4070264,105441] 0 2024-09-21T12:47:24.057 INFO:tasks.workunit.client.0.smithi046.stdout:9/848: read d11/d19/f89 [1189381,40877] 0 2024-09-21T12:47:24.060 INFO:tasks.workunit.client.0.smithi046.stdout:6/643: chown de/l1e 52972498 1 2024-09-21T12:47:24.063 INFO:tasks.workunit.client.0.smithi046.stdout:5/738: rename d4/d22/d99/de7/f93 to d4/dc/d13/d5b/d2d/d43/fed 0 2024-09-21T12:47:24.064 INFO:tasks.workunit.client.0.smithi046.stdout:5/739: dread - d4/d22/d99/fc6 zero size 2024-09-21T12:47:24.065 INFO:tasks.workunit.client.0.smithi046.stdout:9/849: creat d11/d5b/d6f/f10f x:0 0 0 2024-09-21T12:47:24.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/644: mknod de/d2a/d4c/d71/cd1 0 2024-09-21T12:47:24.069 INFO:tasks.workunit.client.0.smithi046.stdout:4/892: getdents d1/d13/d25/d29/d43/d116 0 2024-09-21T12:47:24.070 INFO:tasks.workunit.client.0.smithi046.stdout:7/801: symlink d2/d4/df/d42/dd1/dfd/l107 0 2024-09-21T12:47:24.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/592: dread d5/f10 [0,4194304] 0 2024-09-21T12:47:24.072 INFO:tasks.workunit.client.0.smithi046.stdout:9/850: rename d11/d5b/d6f/db0/l2d to d11/d19/d93/l110 0 2024-09-21T12:47:24.074 INFO:tasks.workunit.client.0.smithi046.stdout:3/593: chown d5/dc/d26/fb2 139 1 2024-09-21T12:47:24.075 INFO:tasks.workunit.client.0.smithi046.stdout:6/645: mkdir de/d2a/d4c/d77/d8f/d94/dd2 0 2024-09-21T12:47:24.085 INFO:tasks.workunit.client.0.smithi046.stdout:4/893: mknod d1/d27/d46/c124 0 2024-09-21T12:47:24.085 INFO:tasks.workunit.client.0.smithi046.stdout:9/851: dread - d11/d5b/f97 zero size 2024-09-21T12:47:24.086 INFO:tasks.workunit.client.0.smithi046.stdout:3/594: fdatasync d5/d16/d5f/f8b 0 2024-09-21T12:47:24.087 INFO:tasks.workunit.client.0.smithi046.stdout:2/708: dwrite d16/d22/d75/f91 [0,4194304] 0 2024-09-21T12:47:24.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/844: write d1/d12/f19 [3675044,33663] 0 2024-09-21T12:47:24.088 INFO:tasks.workunit.client.0.smithi046.stdout:5/740: rename d4/dc/d13/d15/f7f to d4/dc/d13/d15/fee 0 2024-09-21T12:47:24.088 INFO:tasks.workunit.client.0.smithi046.stdout:9/852: chown d11/d19/d93/c21 574935 1 2024-09-21T12:47:24.096 INFO:tasks.workunit.client.0.smithi046.stdout:4/894: write d1/d27/d37/f10f [342420,65555] 0 2024-09-21T12:47:24.099 INFO:tasks.workunit.client.0.smithi046.stdout:0/896: dwrite d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f130 [0,4194304] 0 2024-09-21T12:47:24.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/646: creat de/d2a/d4c/d77/d98/fd3 x:0 0 0 2024-09-21T12:47:24.106 INFO:tasks.workunit.client.0.smithi046.stdout:9/853: dwrite d11/d5b/d6f/db0/d74/fa1 [4194304,4194304] 0 2024-09-21T12:47:24.109 INFO:tasks.workunit.client.0.smithi046.stdout:7/802: truncate d2/d37/d77/fae 2832024 0 2024-09-21T12:47:24.134 INFO:tasks.workunit.client.0.smithi046.stdout:2/709: dread - d16/d22/d38/dac/fb7 zero size 2024-09-21T12:47:24.136 INFO:tasks.workunit.client.0.smithi046.stdout:2/710: write d16/d22/d2b/d30/d67/fe6 [908895,127280] 0 2024-09-21T12:47:24.137 INFO:tasks.workunit.client.0.smithi046.stdout:2/711: readlink d16/d5c/d63/db4/dca/lc0 0 2024-09-21T12:47:24.140 INFO:tasks.workunit.client.0.smithi046.stdout:0/897: rename d6/d7/d13/d7b/da2/l75 to d6/d2f/de9/l138 0 2024-09-21T12:47:24.141 INFO:tasks.workunit.client.0.smithi046.stdout:6/647: creat de/d2a/d4c/d71/d7c/fd4 x:0 0 0 2024-09-21T12:47:24.144 INFO:tasks.workunit.client.0.smithi046.stdout:7/803: chown d2/d4/d43/d58/l69 243 1 2024-09-21T12:47:24.147 INFO:tasks.workunit.client.0.smithi046.stdout:3/595: symlink d5/dc/ld4 0 2024-09-21T12:47:24.148 INFO:tasks.workunit.client.0.smithi046.stdout:3/596: write d5/fa0 [651351,37423] 0 2024-09-21T12:47:24.149 INFO:tasks.workunit.client.0.smithi046.stdout:5/741: rmdir d4/d22/d99/dc7 39 2024-09-21T12:47:24.150 INFO:tasks.workunit.client.0.smithi046.stdout:3/597: chown d5/d5e/l75 1331308 1 2024-09-21T12:47:24.155 INFO:tasks.workunit.client.0.smithi046.stdout:4/895: creat d1/d13/d25/d29/d33/d115/f125 x:0 0 0 2024-09-21T12:47:24.158 INFO:tasks.workunit.client.0.smithi046.stdout:0/898: mkdir d6/d7/d13/d72/d10a/d139 0 2024-09-21T12:47:24.159 INFO:tasks.workunit.client.0.smithi046.stdout:6/648: creat de/d2a/d4c/d77/dc0/fd5 x:0 0 0 2024-09-21T12:47:24.159 INFO:tasks.workunit.client.0.smithi046.stdout:7/804: mknod d2/d4/df/d6f/d92/c108 0 2024-09-21T12:47:24.160 INFO:tasks.workunit.client.0.smithi046.stdout:7/805: chown d2/d37/d8a/fcb 23 1 2024-09-21T12:47:24.160 INFO:tasks.workunit.client.0.smithi046.stdout:1/707: mknod d4/d13/d38/d4f/d83/dd5/ce7 0 2024-09-21T12:47:24.162 INFO:tasks.workunit.client.0.smithi046.stdout:7/806: write d2/d4/df/d17/f35 [1536283,22720] 0 2024-09-21T12:47:24.227 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:23 smithi176 ceph-mon[35476]: pgmap v38: 65 pgs: 65 active+clean; 3.0 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 55 MiB/s rd, 130 MiB/s wr, 323 op/s 2024-09-21T12:47:24.289 INFO:tasks.workunit.client.0.smithi046.stdout:2/712: symlink d16/d22/le8 0 2024-09-21T12:47:24.289 INFO:tasks.workunit.client.0.smithi046.stdout:7/807: truncate d2/d4/df/d6f/d92/fd3 962702 0 2024-09-21T12:47:24.289 INFO:tasks.workunit.client.0.smithi046.stdout:6/649: dwrite de/d2a/d4c/d71/fc6 [0,4194304] 0 2024-09-21T12:47:24.290 INFO:tasks.workunit.client.0.smithi046.stdout:7/808: fdatasync d2/d4/f47 0 2024-09-21T12:47:24.290 INFO:tasks.workunit.client.0.smithi046.stdout:9/854: rename d11/d19/d1b/d31/d53/d5e/c7e to d11/d5b/d6f/db0/d30/d3e/dbf/c111 0 2024-09-21T12:47:24.295 INFO:tasks.workunit.client.0.smithi046.stdout:9/855: chown d11/d19/d1b/d31/d53/d84/d8f/cf8 2530 1 2024-09-21T12:47:24.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/742: creat d4/dc/d45/dd7/de3/fef x:0 0 0 2024-09-21T12:47:24.297 INFO:tasks.workunit.client.0.smithi046.stdout:1/708: mknod d4/d13/d38/d4f/ce8 0 2024-09-21T12:47:24.297 INFO:tasks.workunit.client.0.smithi046.stdout:5/743: stat d4/dc/d13/d5b/d2d/d43 0 2024-09-21T12:47:24.300 INFO:tasks.workunit.client.0.smithi046.stdout:3/598: mkdir d5/dc/dd5 0 2024-09-21T12:47:24.300 INFO:tasks.workunit.client.0.smithi046.stdout:9/856: dread d11/d19/d1b/d4b/d91/f7c [0,4194304] 0 2024-09-21T12:47:24.305 INFO:tasks.workunit.client.0.smithi046.stdout:2/713: rename d16/d22/d38/l46 to d16/d22/d2b/d30/d67/le9 0 2024-09-21T12:47:24.307 INFO:tasks.workunit.client.0.smithi046.stdout:8/845: write d1/d12/d46/fd5 [358479,98453] 0 2024-09-21T12:47:24.309 INFO:tasks.workunit.client.0.smithi046.stdout:5/744: creat d4/dc/d13/d15/d54/ff0 x:0 0 0 2024-09-21T12:47:24.311 INFO:tasks.workunit.client.0.smithi046.stdout:5/745: write d4/d22/d10/d1a/d9e/fd6 [559510,70059] 0 2024-09-21T12:47:24.312 INFO:tasks.workunit.client.0.smithi046.stdout:3/599: fsync d5/dc/d28/d60/f73 0 2024-09-21T12:47:24.314 INFO:tasks.workunit.client.0.smithi046.stdout:9/857: mknod d11/d19/df2/df3/c112 0 2024-09-21T12:47:24.319 INFO:tasks.workunit.client.0.smithi046.stdout:2/714: fdatasync d16/d22/d2b/d30/d67/fa4 0 2024-09-21T12:47:24.319 INFO:tasks.workunit.client.0.smithi046.stdout:3/600: dwrite d5/dc/d26/d3c/f51 [0,4194304] 0 2024-09-21T12:47:24.324 INFO:tasks.workunit.client.0.smithi046.stdout:3/601: dread d5/dc/d94/da6/fb0 [0,4194304] 0 2024-09-21T12:47:24.331 INFO:tasks.workunit.client.0.smithi046.stdout:9/858: creat d11/d19/d1b/d31/d53/d84/f113 x:0 0 0 2024-09-21T12:47:24.336 INFO:tasks.workunit.client.0.smithi046.stdout:0/899: truncate d6/d7/d37/f67 627376 0 2024-09-21T12:47:24.338 INFO:tasks.workunit.client.0.smithi046.stdout:2/715: symlink d16/d5c/d63/db4/dd4/ddb/lea 0 2024-09-21T12:47:24.341 INFO:tasks.workunit.client.0.smithi046.stdout:8/846: link d1/d12/fae d1/d12/d46/d35/d36/d51/d8c/dee/dfb/f126 0 2024-09-21T12:47:24.343 INFO:tasks.workunit.client.0.smithi046.stdout:3/602: mkdir d5/dc/d94/dd6 0 2024-09-21T12:47:24.344 INFO:tasks.workunit.client.0.smithi046.stdout:8/847: chown d1/d12/d46/d35/d5b/dd6/lfa 224 1 2024-09-21T12:47:24.344 INFO:tasks.workunit.client.0.smithi046.stdout:7/809: dwrite d2/d4/df/d17/f3b [0,4194304] 0 2024-09-21T12:47:24.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/650: write de/f39 [2810141,38945] 0 2024-09-21T12:47:24.353 INFO:tasks.workunit.client.0.smithi046.stdout:0/900: rename d6/c25 to d6/d7/d13/d43/d52/d63/d7f/d110/c13a 0 2024-09-21T12:47:24.353 INFO:tasks.workunit.client.0.smithi046.stdout:1/709: write d4/f1f [850402,70239] 0 2024-09-21T12:47:24.355 INFO:tasks.workunit.client.0.smithi046.stdout:2/716: stat d16/d22/f29 0 2024-09-21T12:47:24.356 INFO:tasks.workunit.client.0.smithi046.stdout:3/603: creat d5/d5e/d8e/fd7 x:0 0 0 2024-09-21T12:47:24.358 INFO:tasks.workunit.client.0.smithi046.stdout:8/848: mkdir d1/d127 0 2024-09-21T12:47:24.365 INFO:tasks.workunit.client.0.smithi046.stdout:1/710: dread - d4/d13/d38/d53/fb3 zero size 2024-09-21T12:47:24.371 INFO:tasks.workunit.client.0.smithi046.stdout:5/746: dwrite d4/dc/d13/d5b/d2d/d3b/f68 [0,4194304] 0 2024-09-21T12:47:24.374 INFO:tasks.workunit.client.0.smithi046.stdout:9/859: link d11/d5b/d6f/db0/d30/c3d d11/d19/d36/d95/c114 0 2024-09-21T12:47:24.375 INFO:tasks.workunit.client.0.smithi046.stdout:6/651: symlink de/ld6 0 2024-09-21T12:47:24.379 INFO:tasks.workunit.client.0.smithi046.stdout:1/711: mkdir d4/d29/d32/d9e/de9 0 2024-09-21T12:47:24.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/712: fsync d4/d13/d38/d4f/d83/da9/fc4 0 2024-09-21T12:47:24.382 INFO:tasks.workunit.client.0.smithi046.stdout:8/849: mkdir d1/d127/d128 0 2024-09-21T12:47:24.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/810: creat d2/d4/df/f109 x:0 0 0 2024-09-21T12:47:24.387 INFO:tasks.workunit.client.0.smithi046.stdout:3/604: dwrite d5/dc/d26/d3c/fb1 [0,4194304] 0 2024-09-21T12:47:24.389 INFO:tasks.workunit.client.0.smithi046.stdout:9/860: unlink d11/d5b/d6f/db0/d30/d3e/fae 0 2024-09-21T12:47:24.393 INFO:tasks.workunit.client.0.smithi046.stdout:2/717: link d16/d22/d2b/f51 d16/d5c/d63/db4/dca/dc1/feb 0 2024-09-21T12:47:24.398 INFO:tasks.workunit.client.0.smithi046.stdout:0/901: mkdir d6/d7/d13/d7b/d13b 0 2024-09-21T12:47:24.398 INFO:tasks.workunit.client.0.smithi046.stdout:1/713: dread d4/d13/f19 [0,4194304] 0 2024-09-21T12:47:24.401 INFO:tasks.workunit.client.0.smithi046.stdout:8/850: rename d1/d12/d53/c111 to d1/d12/d1a/c129 0 2024-09-21T12:47:24.403 INFO:tasks.workunit.client.0.smithi046.stdout:9/861: creat d11/d19/df2/f115 x:0 0 0 2024-09-21T12:47:24.403 INFO:tasks.workunit.client.0.smithi046.stdout:6/652: dread de/d2a/d4c/d69/f65 [0,4194304] 0 2024-09-21T12:47:24.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/718: rmdir d16/d5c/d63/db4/dd4 39 2024-09-21T12:47:24.405 INFO:tasks.workunit.client.0.smithi046.stdout:2/719: chown d16/d22/d4e/d9d/lbd 24 1 2024-09-21T12:47:24.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/720: stat d16/d22/d2b/d43/faf 0 2024-09-21T12:47:24.408 INFO:tasks.workunit.client.0.smithi046.stdout:0/902: chown d6/d2f/de9/d127 0 1 2024-09-21T12:47:24.409 INFO:tasks.workunit.client.0.smithi046.stdout:1/714: rename d4/d13/d38/d53/d80/d8b/fd8 to d4/d13/d38/d53/d80/d95/fea 0 2024-09-21T12:47:24.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:23 smithi046 ceph-mon[27868]: pgmap v38: 65 pgs: 65 active+clean; 3.0 GiB data, 9.0 GiB used, 527 GiB / 536 GiB avail; 55 MiB/s rd, 130 MiB/s wr, 323 op/s 2024-09-21T12:47:24.413 INFO:tasks.workunit.client.0.smithi046.stdout:8/851: mkdir d1/d12/d1a/d33/d6c/d12a 0 2024-09-21T12:47:24.414 INFO:tasks.workunit.client.0.smithi046.stdout:3/605: write d5/f62 [1303578,53054] 0 2024-09-21T12:47:24.415 INFO:tasks.workunit.client.0.smithi046.stdout:8/852: readlink d1/d12/d1a/d33/lc7 0 2024-09-21T12:47:24.416 INFO:tasks.workunit.client.0.smithi046.stdout:6/653: creat de/d2a/d34/db6/fd7 x:0 0 0 2024-09-21T12:47:24.417 INFO:tasks.workunit.client.0.smithi046.stdout:9/862: creat d11/d19/d1b/d31/d44/dff/f116 x:0 0 0 2024-09-21T12:47:24.417 INFO:tasks.workunit.client.0.smithi046.stdout:5/747: dwrite d4/d22/d10/d1a/f59 [0,4194304] 0 2024-09-21T12:47:24.417 INFO:tasks.workunit.client.0.smithi046.stdout:7/811: dread d2/d4/df/d42/f49 [0,4194304] 0 2024-09-21T12:47:24.419 INFO:tasks.workunit.client.0.smithi046.stdout:2/721: mknod d16/d22/d2b/d30/cec 0 2024-09-21T12:47:24.420 INFO:tasks.workunit.client.0.smithi046.stdout:2/722: chown d16/d22/c8e 766037858 1 2024-09-21T12:47:24.421 INFO:tasks.workunit.client.0.smithi046.stdout:0/903: rename d6/d7/d9/dc4/d107 to d6/d7/d13/d43/d52/dc0/dc3/da4/d13c 0 2024-09-21T12:47:24.422 INFO:tasks.workunit.client.0.smithi046.stdout:6/654: readlink de/d2a/d4c/d77/dae/d55/l7b 0 2024-09-21T12:47:24.422 INFO:tasks.workunit.client.0.smithi046.stdout:0/904: chown d6/d2f/c68 152 1 2024-09-21T12:47:24.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/853: mknod d1/d12/d46/d107/c12b 0 2024-09-21T12:47:24.434 INFO:tasks.workunit.client.0.smithi046.stdout:6/655: readlink de/d2a/d4c/d77/dae/l62 0 2024-09-21T12:47:24.435 INFO:tasks.workunit.client.0.smithi046.stdout:9/863: dread d11/d19/d1b/d4b/d91/d94/fb4 [0,4194304] 0 2024-09-21T12:47:24.437 INFO:tasks.workunit.client.0.smithi046.stdout:1/715: creat d4/feb x:0 0 0 2024-09-21T12:47:24.438 INFO:tasks.workunit.client.0.smithi046.stdout:2/723: dwrite d16/d5c/d63/db4/dd4/ddb/fde [0,4194304] 0 2024-09-21T12:47:24.439 INFO:tasks.workunit.client.0.smithi046.stdout:0/905: dread d6/d7/d13/d7b/da2/f5a [0,4194304] 0 2024-09-21T12:47:24.441 INFO:tasks.workunit.client.0.smithi046.stdout:3/606: rename d5/l3a to d5/d16/d5f/ld8 0 2024-09-21T12:47:24.443 INFO:tasks.workunit.client.0.smithi046.stdout:5/748: truncate d4/d22/d10/d1a/d9e/d9a/fb1 1933499 0 2024-09-21T12:47:24.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/656: dread - de/d2a/d4c/d71/d7c/f99 zero size 2024-09-21T12:47:24.447 INFO:tasks.workunit.client.0.smithi046.stdout:9/864: rmdir d11/d5b/dcf 39 2024-09-21T12:47:24.449 INFO:tasks.workunit.client.0.smithi046.stdout:8/854: read d1/d12/d46/d35/d7d/f29 [1273153,33225] 0 2024-09-21T12:47:24.450 INFO:tasks.workunit.client.0.smithi046.stdout:2/724: mkdir d16/d22/d75/ded 0 2024-09-21T12:47:24.451 INFO:tasks.workunit.client.0.smithi046.stdout:2/725: read - d16/d22/d2b/d30/d67/fd6 zero size 2024-09-21T12:47:24.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/607: unlink d5/dc/d30/d7c/cac 0 2024-09-21T12:47:24.455 INFO:tasks.workunit.client.0.smithi046.stdout:5/749: truncate d4/dc/d13/d15/f51 157276 0 2024-09-21T12:47:24.455 INFO:tasks.workunit.client.0.smithi046.stdout:7/812: getdents d2/d4/df/d42/dd1/dfd 0 2024-09-21T12:47:24.457 INFO:tasks.workunit.client.0.smithi046.stdout:5/750: truncate d4/dc/d13/d5b/d2d/d43/d7a/fe8 53944 0 2024-09-21T12:47:24.458 INFO:tasks.workunit.client.0.smithi046.stdout:9/865: creat d11/d5b/d6f/db0/d30/d90/f117 x:0 0 0 2024-09-21T12:47:24.460 INFO:tasks.workunit.client.0.smithi046.stdout:8/855: fdatasync d1/d12/f2a 0 2024-09-21T12:47:24.463 INFO:tasks.workunit.client.0.smithi046.stdout:0/906: mknod d6/d7/d13/d43/d52/dc0/c13d 0 2024-09-21T12:47:24.465 INFO:tasks.workunit.client.0.smithi046.stdout:5/751: dwrite d4/d22/d99/d9d/fcd [0,4194304] 0 2024-09-21T12:47:24.471 INFO:tasks.workunit.client.0.smithi046.stdout:3/608: symlink d5/d5e/d8e/ld9 0 2024-09-21T12:47:24.472 INFO:tasks.workunit.client.0.smithi046.stdout:1/716: write d4/d13/f27 [2936704,127703] 0 2024-09-21T12:47:24.476 INFO:tasks.workunit.client.0.smithi046.stdout:9/866: unlink d11/d19/d1b/d4b/d91/fe0 0 2024-09-21T12:47:24.477 INFO:tasks.workunit.client.0.smithi046.stdout:9/867: chown d11/d19/df2/f115 9148257 1 2024-09-21T12:47:24.478 INFO:tasks.workunit.client.0.smithi046.stdout:8/856: mknod d1/d12/d46/d108/c12c 0 2024-09-21T12:47:24.481 INFO:tasks.workunit.client.0.smithi046.stdout:0/907: creat d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/f13e x:0 0 0 2024-09-21T12:47:24.482 INFO:tasks.workunit.client.0.smithi046.stdout:2/726: dwrite d16/d22/d2b/d30/d67/f72 [0,4194304] 0 2024-09-21T12:47:24.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/813: mknod d2/d4/d43/dd6/d104/c10a 0 2024-09-21T12:47:24.485 INFO:tasks.workunit.client.0.smithi046.stdout:6/657: creat de/d2a/fd8 x:0 0 0 2024-09-21T12:47:24.491 INFO:tasks.workunit.client.0.smithi046.stdout:8/857: mkdir d1/d12/d53/d12d 0 2024-09-21T12:47:24.492 INFO:tasks.workunit.client.0.smithi046.stdout:2/727: dread d16/d22/f2e [0,4194304] 0 2024-09-21T12:47:24.493 INFO:tasks.workunit.client.0.smithi046.stdout:2/728: write d16/d22/d38/d77/f9a [265449,106911] 0 2024-09-21T12:47:24.495 INFO:tasks.workunit.client.0.smithi046.stdout:0/908: rename d6/d7/d13/d49/d51 to d6/d7/d9/d54/d97/d13f 0 2024-09-21T12:47:24.498 INFO:tasks.workunit.client.0.smithi046.stdout:1/717: rmdir d4/d13/dc0 39 2024-09-21T12:47:24.501 INFO:tasks.workunit.client.0.smithi046.stdout:6/658: symlink de/d2a/d4c/d77/d8f/d94/ld9 0 2024-09-21T12:47:24.502 INFO:tasks.workunit.client.0.smithi046.stdout:9/868: symlink d11/d19/d36/d45/l118 0 2024-09-21T12:47:24.503 INFO:tasks.workunit.client.0.smithi046.stdout:5/752: dwrite d4/dc/d13/d5b/d2d/f7d [0,4194304] 0 2024-09-21T12:47:24.505 INFO:tasks.workunit.client.0.smithi046.stdout:9/869: chown d11/d5b/d6f/db0/d74 10081 1 2024-09-21T12:47:24.506 INFO:tasks.workunit.client.0.smithi046.stdout:8/858: creat d1/d12/d1a/d33/f12e x:0 0 0 2024-09-21T12:47:24.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/814: mkdir d2/d4/df/d10b 0 2024-09-21T12:47:24.510 INFO:tasks.workunit.client.0.smithi046.stdout:3/609: dwrite d5/dc/d30/d34/f61 [0,4194304] 0 2024-09-21T12:47:24.517 INFO:tasks.workunit.client.0.smithi046.stdout:5/753: mkdir d4/dc/d13/da2/dce/df1 0 2024-09-21T12:47:24.517 INFO:tasks.workunit.client.0.smithi046.stdout:2/729: dwrite d16/d22/d38/d77/d9e/fcc [0,4194304] 0 2024-09-21T12:47:24.522 INFO:tasks.workunit.client.0.smithi046.stdout:9/870: fsync d11/d19/d1b/d4b/d91/f7c 0 2024-09-21T12:47:24.525 INFO:tasks.workunit.client.0.smithi046.stdout:7/815: rename d2/d4/df/d17/f56 to d2/d4/d97/f10c 0 2024-09-21T12:47:24.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/871: rmdir d11/d19/d36/d45 39 2024-09-21T12:47:24.538 INFO:tasks.workunit.client.0.smithi046.stdout:1/718: creat d4/d13/d6b/fec x:0 0 0 2024-09-21T12:47:24.538 INFO:tasks.workunit.client.0.smithi046.stdout:9/872: dwrite d11/d19/d1b/d4b/f5f [4194304,4194304] 0 2024-09-21T12:47:24.538 INFO:tasks.workunit.client.0.smithi046.stdout:2/730: mknod d16/d22/cee 0 2024-09-21T12:47:24.541 INFO:tasks.workunit.client.0.smithi046.stdout:9/873: write d11/d5b/d6f/db0/d30/d90/f117 [453596,113234] 0 2024-09-21T12:47:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:3/610: rename d5/d16/f65 to d5/dc/d28/d60/fda 0 2024-09-21T12:47:24.543 INFO:tasks.workunit.client.0.smithi046.stdout:9/874: write d11/d19/d1b/d4b/f5f [6754919,1494] 0 2024-09-21T12:47:24.545 INFO:tasks.workunit.client.0.smithi046.stdout:1/719: chown d4/d29/d32/f46 0 1 2024-09-21T12:47:24.547 INFO:tasks.workunit.client.0.smithi046.stdout:2/731: symlink d16/d22/d38/d77/d7a/lef 0 2024-09-21T12:47:24.548 INFO:tasks.workunit.client.0.smithi046.stdout:7/816: link d2/d4/df/d70/d88/d34/d7f/c98 d2/d4/df/d9a/c10d 0 2024-09-21T12:47:24.550 INFO:tasks.workunit.client.0.smithi046.stdout:7/817: write d2/fa4 [641035,29806] 0 2024-09-21T12:47:24.552 INFO:tasks.workunit.client.0.smithi046.stdout:5/754: dread d4/dc/d45/dd7/fe2 [0,4194304] 0 2024-09-21T12:47:24.557 INFO:tasks.workunit.client.0.smithi046.stdout:9/875: symlink d11/d5b/dcf/l119 0 2024-09-21T12:47:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:7/818: write d2/d4/df/d70/d88/d34/d7f/fb5 [392308,29584] 0 2024-09-21T12:47:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:5/755: write d4/dc/d13/d5b/fbf [373301,21223] 0 2024-09-21T12:47:24.558 INFO:tasks.workunit.client.0.smithi046.stdout:2/732: dwrite d16/d22/d38/d77/d9e/fcc [0,4194304] 0 2024-09-21T12:47:24.560 INFO:tasks.workunit.client.0.smithi046.stdout:7/819: fdatasync d2/d37/f81 0 2024-09-21T12:47:24.562 INFO:tasks.workunit.client.0.smithi046.stdout:8/859: write d1/d12/f95 [182526,36388] 0 2024-09-21T12:47:24.566 INFO:tasks.workunit.client.0.smithi046.stdout:2/733: chown d16/d22/d4e/l62 16 1 2024-09-21T12:47:24.567 INFO:tasks.workunit.client.0.smithi046.stdout:9/876: mkdir d11/d19/d93/d11a 0 2024-09-21T12:47:24.568 INFO:tasks.workunit.client.0.smithi046.stdout:0/909: write d6/d7/d13/f4b [5111052,54046] 0 2024-09-21T12:47:24.568 INFO:tasks.workunit.client.0.smithi046.stdout:7/820: write d2/d4/df/d6f/d92/fda [437551,65440] 0 2024-09-21T12:47:24.568 INFO:tasks.workunit.client.0.smithi046.stdout:5/756: mknod d4/dc/d45/dd7/de3/cf2 0 2024-09-21T12:47:24.574 INFO:tasks.workunit.client.0.smithi046.stdout:2/734: mkdir d16/d22/d4e/d90/dc6/df0 0 2024-09-21T12:47:24.574 INFO:tasks.workunit.client.0.smithi046.stdout:1/720: dwrite d4/d13/d38/d53/d80/d95/da5/fc9 [0,4194304] 0 2024-09-21T12:47:24.575 INFO:tasks.workunit.client.0.smithi046.stdout:0/910: chown d6/d60/f89 117178 1 2024-09-21T12:47:24.576 INFO:tasks.workunit.client.0.smithi046.stdout:5/757: chown d4/dc/d13/d5b/d2d/d3b/fc4 6 1 2024-09-21T12:47:24.579 INFO:tasks.workunit.client.0.smithi046.stdout:8/860: dwrite d1/d12/d46/d108/ffd [0,4194304] 0 2024-09-21T12:47:24.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/721: read d4/f77 [1157536,69993] 0 2024-09-21T12:47:24.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/735: symlink d16/d22/d2b/d43/lf1 0 2024-09-21T12:47:24.586 INFO:tasks.workunit.client.0.smithi046.stdout:7/821: mknod d2/d4/df/d70/db2/dc5/c10e 0 2024-09-21T12:47:24.587 INFO:tasks.workunit.client.0.smithi046.stdout:7/822: readlink d2/d37/d8a/ddf/le6 0 2024-09-21T12:47:24.590 INFO:tasks.workunit.client.0.smithi046.stdout:5/758: mkdir d4/d22/d99/de7/df3 0 2024-09-21T12:47:24.591 INFO:tasks.workunit.client.0.smithi046.stdout:0/911: symlink d6/d7/d13/d72/d10a/l140 0 2024-09-21T12:47:24.597 INFO:tasks.workunit.client.0.smithi046.stdout:8/861: mknod d1/d12/d46/d35/d5b/dd6/c12f 0 2024-09-21T12:47:24.598 INFO:tasks.workunit.client.0.smithi046.stdout:9/877: write d11/d19/d1b/d31/f7d [1695519,103318] 0 2024-09-21T12:47:24.600 INFO:tasks.workunit.client.0.smithi046.stdout:1/722: read d4/d29/d32/d9e/f8f [242838,7625] 0 2024-09-21T12:47:24.601 INFO:tasks.workunit.client.0.smithi046.stdout:1/723: fdatasync d4/d13/d38/d53/d80/d95/da5/fb5 0 2024-09-21T12:47:24.602 INFO:tasks.workunit.client.0.smithi046.stdout:2/736: rename d16/c3b to d16/d22/d2b/cf2 0 2024-09-21T12:47:24.602 INFO:tasks.workunit.client.0.smithi046.stdout:7/823: mknod d2/d4/df/d70/d88/d34/d7f/c10f 0 2024-09-21T12:47:24.603 INFO:tasks.workunit.client.0.smithi046.stdout:1/724: dread - d4/d13/d6b/fec zero size 2024-09-21T12:47:24.604 INFO:tasks.workunit.client.0.smithi046.stdout:2/737: chown d16/d22/d38/f53 2687969 1 2024-09-21T12:47:24.604 INFO:tasks.workunit.client.0.smithi046.stdout:5/759: symlink d4/dc/d13/d15/d5c/lf4 0 2024-09-21T12:47:24.605 INFO:tasks.workunit.client.0.smithi046.stdout:0/912: fsync d6/d7/d13/d43/d52/d63/d7f/f5f 0 2024-09-21T12:47:24.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/738: dwrite d16/f21 [4194304,4194304] 0 2024-09-21T12:47:24.613 INFO:tasks.workunit.client.0.smithi046.stdout:8/862: rename d1/d12/d46/d35/d7d/l27 to d1/d12/d46/d35/d5b/l130 0 2024-09-21T12:47:24.616 INFO:tasks.workunit.client.0.smithi046.stdout:1/725: mkdir d4/d29/d32/d9e/ded 0 2024-09-21T12:47:24.622 INFO:tasks.workunit.client.0.smithi046.stdout:8/863: dwrite d1/d12/d46/d35/d5b/dd6/d113/d114/f121 [0,4194304] 0 2024-09-21T12:47:24.626 INFO:tasks.workunit.client.0.smithi046.stdout:9/878: creat d11/d5b/d10c/f11b x:0 0 0 2024-09-21T12:47:24.626 INFO:tasks.workunit.client.0.smithi046.stdout:8/864: chown d1/d12/d53/ffe 201993 1 2024-09-21T12:47:24.631 INFO:tasks.workunit.client.0.smithi046.stdout:1/726: dwrite d4/d29/d32/d9e/d5d/d8c/d94/fbf [0,4194304] 0 2024-09-21T12:47:24.644 INFO:tasks.workunit.client.0.smithi046.stdout:7/824: dwrite d2/d4/df/f10 [0,4194304] 0 2024-09-21T12:47:24.644 INFO:tasks.workunit.client.0.smithi046.stdout:8/865: fsync d1/d12/d46/d35/d36/d51/f5a 0 2024-09-21T12:47:24.647 INFO:tasks.workunit.client.0.smithi046.stdout:8/866: fdatasync d1/d12/d46/d35/d36/dc6/df1/f11a 0 2024-09-21T12:47:24.649 INFO:tasks.workunit.client.0.smithi046.stdout:8/867: dread - d1/d12/d46/f44 zero size 2024-09-21T12:47:24.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/727: chown d4/c93 7568 1 2024-09-21T12:47:24.651 INFO:tasks.workunit.client.0.smithi046.stdout:5/760: creat d4/d22/d10/ff5 x:0 0 0 2024-09-21T12:47:24.657 INFO:tasks.workunit.client.0.smithi046.stdout:7/825: mkdir d2/d4/df/d9a/dc3/dc4/d110 0 2024-09-21T12:47:24.657 INFO:tasks.workunit.client.0.smithi046.stdout:2/739: dwrite d16/d22/d2b/d43/f73 [0,4194304] 0 2024-09-21T12:47:24.659 INFO:tasks.workunit.client.0.smithi046.stdout:0/913: getdents d6/d7/d9/d54 0 2024-09-21T12:47:24.659 INFO:tasks.workunit.client.0.smithi046.stdout:2/740: stat d16/c2c 0 2024-09-21T12:47:24.660 INFO:tasks.workunit.client.0.smithi046.stdout:5/761: chown d4/dc/d6b/ca8 18254267 1 2024-09-21T12:47:24.661 INFO:tasks.workunit.client.0.smithi046.stdout:7/826: read d2/d37/f4d [3355151,71979] 0 2024-09-21T12:47:24.665 INFO:tasks.workunit.client.0.smithi046.stdout:0/914: fsync d6/f62 0 2024-09-21T12:47:24.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/741: mknod d16/d22/d4e/d9d/cf3 0 2024-09-21T12:47:24.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/742: stat d16 0 2024-09-21T12:47:24.668 INFO:tasks.workunit.client.0.smithi046.stdout:9/879: dread d11/d19/d1b/d31/d53/d84/dce/ffe [0,4194304] 0 2024-09-21T12:47:24.669 INFO:tasks.workunit.client.0.smithi046.stdout:1/728: mknod d4/d13/d38/d53/d80/d8b/dc3/cee 0 2024-09-21T12:47:24.669 INFO:tasks.workunit.client.0.smithi046.stdout:2/743: chown d16/d22/d2b/d30/d67/c94 4420465 1 2024-09-21T12:47:24.670 INFO:tasks.workunit.client.0.smithi046.stdout:7/827: mkdir d2/d37/d8a/ddf/d111 0 2024-09-21T12:47:24.673 INFO:tasks.workunit.client.0.smithi046.stdout:8/868: link d1/d12/d46/d35/d5b/f6d d1/d12/d53/d80/f131 0 2024-09-21T12:47:24.680 INFO:tasks.workunit.client.0.smithi046.stdout:0/915: rename d6/d7/d13/d43/d52/d63/d7f/f44 to d6/d2f/f141 0 2024-09-21T12:47:24.681 INFO:tasks.workunit.client.0.smithi046.stdout:9/880: dread d11/d5b/d6f/db0/d30/d3e/dbf/fc9 [0,4194304] 0 2024-09-21T12:47:24.684 INFO:tasks.workunit.client.0.smithi046.stdout:1/729: write d4/d29/d32/d9e/d5d/d8c/d92/fdf [4386765,74241] 0 2024-09-21T12:47:24.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/730: fdatasync d4/d13/d38/d53/d80/f85 0 2024-09-21T12:47:24.690 INFO:tasks.workunit.client.0.smithi046.stdout:2/744: symlink d16/d22/d38/lf4 0 2024-09-21T12:47:24.692 INFO:tasks.workunit.client.0.smithi046.stdout:8/869: dread d1/d12/d46/d35/d36/d51/f116 [0,4194304] 0 2024-09-21T12:47:24.694 INFO:tasks.workunit.client.0.smithi046.stdout:7/828: symlink d2/d4/d43/l112 0 2024-09-21T12:47:24.695 INFO:tasks.workunit.client.0.smithi046.stdout:5/762: write d4/dc/d13/d15/f51 [208760,13466] 0 2024-09-21T12:47:24.696 INFO:tasks.workunit.client.0.smithi046.stdout:7/829: read d2/d4/df/d17/f3b [3468876,29499] 0 2024-09-21T12:47:24.697 INFO:tasks.workunit.client.0.smithi046.stdout:2/745: mkdir d16/d22/d2b/d30/df5 0 2024-09-21T12:47:24.697 INFO:tasks.workunit.client.0.smithi046.stdout:7/830: stat d2/dd/f3d 0 2024-09-21T12:47:24.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/746: write d16/d22/d4e/fad [682154,108765] 0 2024-09-21T12:47:24.701 INFO:tasks.workunit.client.0.smithi046.stdout:8/870: rename d1/d12/d46/d35/d5b/dd6/d113/fff to d1/d12/d53/f132 0 2024-09-21T12:47:24.701 INFO:tasks.workunit.client.0.smithi046.stdout:7/831: truncate d2/d4/df/d42/dd1/f101 819797 0 2024-09-21T12:47:24.702 INFO:tasks.workunit.client.0.smithi046.stdout:8/871: write d1/f20 [1067940,92341] 0 2024-09-21T12:47:24.705 INFO:tasks.workunit.client.0.smithi046.stdout:5/763: creat d4/dc/d45/d94/ff6 x:0 0 0 2024-09-21T12:47:24.706 INFO:tasks.workunit.client.0.smithi046.stdout:1/731: write d4/d29/d32/d9e/f8f [399547,35899] 0 2024-09-21T12:47:24.707 INFO:tasks.workunit.client.0.smithi046.stdout:1/732: write d4/f10 [1750149,126921] 0 2024-09-21T12:47:24.711 INFO:tasks.workunit.client.0.smithi046.stdout:1/733: truncate d4/d13/d38/d53/d80/d95/fea 737919 0 2024-09-21T12:47:24.715 INFO:tasks.workunit.client.0.smithi046.stdout:5/764: symlink d4/dc/d13/da2/dce/lf7 0 2024-09-21T12:47:24.716 INFO:tasks.workunit.client.0.smithi046.stdout:0/916: getdents d6/d7/d13 0 2024-09-21T12:47:24.721 INFO:tasks.workunit.client.0.smithi046.stdout:2/747: creat d16/d22/d75/ded/ff6 x:0 0 0 2024-09-21T12:47:24.721 INFO:tasks.workunit.client.0.smithi046.stdout:8/872: write d1/d12/d46/d35/d7d/d6a/f9c [339778,8319] 0 2024-09-21T12:47:24.724 INFO:tasks.workunit.client.0.smithi046.stdout:0/917: truncate d6/f10f 1009364 0 2024-09-21T12:47:24.726 INFO:tasks.workunit.client.0.smithi046.stdout:0/918: chown d6/d7/d13/d43/d52/d63/d7f/d78/d8a/la0 453 1 2024-09-21T12:47:24.727 INFO:tasks.workunit.client.0.smithi046.stdout:1/734: creat d4/d13/dc0/fef x:0 0 0 2024-09-21T12:47:24.728 INFO:tasks.workunit.client.0.smithi046.stdout:8/873: mknod d1/d12/d53/d60/c133 0 2024-09-21T12:47:24.729 INFO:tasks.workunit.client.0.smithi046.stdout:1/735: write d4/f1f [1157954,101949] 0 2024-09-21T12:47:24.732 INFO:tasks.workunit.client.0.smithi046.stdout:7/832: dwrite d2/d4/d43/f5d [0,4194304] 0 2024-09-21T12:47:24.733 INFO:tasks.workunit.client.0.smithi046.stdout:8/874: write d1/d12/d53/d60/fac [3518818,104714] 0 2024-09-21T12:47:24.733 INFO:tasks.workunit.client.0.smithi046.stdout:0/919: mknod d6/d2f/d32/c142 0 2024-09-21T12:47:24.737 INFO:tasks.workunit.client.0.smithi046.stdout:8/875: chown d1/d12/d46/d35/d5b/ce5 201808 1 2024-09-21T12:47:24.737 INFO:tasks.workunit.client.0.smithi046.stdout:1/736: read d4/d13/f36 [3816505,58485] 0 2024-09-21T12:47:24.739 INFO:tasks.workunit.client.0.smithi046.stdout:7/833: creat d2/d37/d8a/d99/f113 x:0 0 0 2024-09-21T12:47:24.739 INFO:tasks.workunit.client.0.smithi046.stdout:8/876: write d1/d12/d53/d60/f64 [4153437,128056] 0 2024-09-21T12:47:24.741 INFO:tasks.workunit.client.0.smithi046.stdout:5/765: truncate d4/d22/f9b 206314 0 2024-09-21T12:47:24.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/834: creat d2/d4/df/d70/d88/d34/d7f/f114 x:0 0 0 2024-09-21T12:47:24.749 INFO:tasks.workunit.client.0.smithi046.stdout:2/748: dwrite d16/d22/d4e/d90/fae [0,4194304] 0 2024-09-21T12:47:24.751 INFO:tasks.workunit.client.0.smithi046.stdout:8/877: creat d1/d127/d128/f134 x:0 0 0 2024-09-21T12:47:24.754 INFO:tasks.workunit.client.0.smithi046.stdout:1/737: rename d4/d13/d38/c63 to d4/d29/d32/d9e/de9/cf0 0 2024-09-21T12:47:24.759 INFO:tasks.workunit.client.0.smithi046.stdout:0/920: creat d6/d7/d13/d43/d52/dc0/f143 x:0 0 0 2024-09-21T12:47:24.759 INFO:tasks.workunit.client.0.smithi046.stdout:7/835: dwrite d2/f55 [0,4194304] 0 2024-09-21T12:47:24.763 INFO:tasks.workunit.client.0.smithi046.stdout:0/921: chown d6/d7/d13/d7b/da2/c20 88 1 2024-09-21T12:47:24.763 INFO:tasks.workunit.client.0.smithi046.stdout:8/878: dread d1/fa [0,4194304] 0 2024-09-21T12:47:24.763 INFO:tasks.workunit.client.0.smithi046.stdout:2/749: creat d16/d22/d4e/d90/ff7 x:0 0 0 2024-09-21T12:47:24.765 INFO:tasks.workunit.client.0.smithi046.stdout:1/738: symlink d4/d13/d38/d53/d80/d8b/lf1 0 2024-09-21T12:47:24.767 INFO:tasks.workunit.client.0.smithi046.stdout:7/836: dread d2/d4/df/d17/f3b [0,4194304] 0 2024-09-21T12:47:24.769 INFO:tasks.workunit.client.0.smithi046.stdout:0/922: write d6/d7/d13/d7b/da2/f5a [3160847,99430] 0 2024-09-21T12:47:24.772 INFO:tasks.workunit.client.0.smithi046.stdout:0/923: readlink d6/d7/d13/d43/d52/d63/d7f/d38/db7/lff 0 2024-09-21T12:47:24.774 INFO:tasks.workunit.client.0.smithi046.stdout:8/879: mkdir d1/d12/d46/d35/d36/d51/d135 0 2024-09-21T12:47:24.775 INFO:tasks.workunit.client.0.smithi046.stdout:8/880: fdatasync d1/d12/d46/d35/d7d/fea 0 2024-09-21T12:47:24.778 INFO:tasks.workunit.client.0.smithi046.stdout:2/750: rename d16/d22/d75/c65 to d16/d22/d75/cf8 0 2024-09-21T12:47:24.780 INFO:tasks.workunit.client.0.smithi046.stdout:7/837: unlink d2/d4/d43/l4a 0 2024-09-21T12:47:24.788 INFO:tasks.workunit.client.0.smithi046.stdout:0/924: mkdir d6/d2f/de9/d127/d144 0 2024-09-21T12:47:24.788 INFO:tasks.workunit.client.0.smithi046.stdout:7/838: dwrite d2/d4/df/d6f/d92/fda [0,4194304] 0 2024-09-21T12:47:24.790 INFO:tasks.workunit.client.0.smithi046.stdout:7/839: fdatasync d2/d4/df/d42/dd1/ff1 0 2024-09-21T12:47:24.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/766: write d4/d22/d99/dc7/f66 [478813,95066] 0 2024-09-21T12:47:24.795 INFO:tasks.workunit.client.0.smithi046.stdout:0/925: symlink d6/d7/d9/d54/db1/l145 0 2024-09-21T12:47:24.797 INFO:tasks.workunit.client.0.smithi046.stdout:5/767: dread d4/d22/d10/d1a/f59 [0,4194304] 0 2024-09-21T12:47:24.798 INFO:tasks.workunit.client.0.smithi046.stdout:4/896: sync 2024-09-21T12:47:24.798 INFO:tasks.workunit.client.0.smithi046.stdout:1/739: dread d4/d13/d38/faf [0,4194304] 0 2024-09-21T12:47:24.799 INFO:tasks.workunit.client.0.smithi046.stdout:7/840: symlink d2/d4/df/d70/d88/d34/l115 0 2024-09-21T12:47:24.803 INFO:tasks.workunit.client.0.smithi046.stdout:8/881: write d1/d12/d1a/d33/fa5 [5123808,93622] 0 2024-09-21T12:47:24.806 INFO:tasks.workunit.client.0.smithi046.stdout:0/926: symlink d6/d7/df3/l146 0 2024-09-21T12:47:24.806 INFO:tasks.workunit.client.0.smithi046.stdout:1/740: chown d4/d13/l33 1571 1 2024-09-21T12:47:24.810 INFO:tasks.workunit.client.0.smithi046.stdout:1/741: dread - d4/d29/d32/d9e/d5d/d8c/d92/fd4 zero size 2024-09-21T12:47:24.810 INFO:tasks.workunit.client.0.smithi046.stdout:0/927: read d6/d7/d13/f1d [81440,25829] 0 2024-09-21T12:47:24.810 INFO:tasks.workunit.client.0.smithi046.stdout:5/768: rmdir d4/dc/d13/da2/dce 39 2024-09-21T12:47:24.810 INFO:tasks.workunit.client.0.smithi046.stdout:4/897: dread - d1/d13/d25/d29/d43/d84/fa6 zero size 2024-09-21T12:47:24.811 INFO:tasks.workunit.client.0.smithi046.stdout:4/898: fsync d1/d27/d37/d8f/f10e 0 2024-09-21T12:47:24.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/751: getdents d16/d22/d38 0 2024-09-21T12:47:24.819 INFO:tasks.workunit.client.0.smithi046.stdout:0/928: truncate d6/d7/d13/d7b/da2/f46 4909011 0 2024-09-21T12:47:24.820 INFO:tasks.workunit.client.0.smithi046.stdout:0/929: stat d6/d7/d9/dc4 0 2024-09-21T12:47:24.821 INFO:tasks.workunit.client.0.smithi046.stdout:4/899: creat d1/d13/d25/d29/d43/d84/f126 x:0 0 0 2024-09-21T12:47:24.823 INFO:tasks.workunit.client.0.smithi046.stdout:5/769: dread d4/d22/d99/de7/f46 [0,4194304] 0 2024-09-21T12:47:24.824 INFO:tasks.workunit.client.0.smithi046.stdout:4/900: write d1/d27/d46/d78/fe2 [1031542,44672] 0 2024-09-21T12:47:24.826 INFO:tasks.workunit.client.0.smithi046.stdout:4/901: write d1/d13/d25/d29/d33/f41 [3646009,95107] 0 2024-09-21T12:47:24.834 INFO:tasks.workunit.client.0.smithi046.stdout:0/930: chown d6/d7/d13/d43/d52/fb0 10 1 2024-09-21T12:47:24.840 INFO:tasks.workunit.client.0.smithi046.stdout:0/931: dread d6/d7/d13/d7b/da2/f5a [4194304,4194304] 0 2024-09-21T12:47:24.840 INFO:tasks.workunit.client.0.smithi046.stdout:8/882: write d1/d12/d53/dab/ff0 [1601299,71115] 0 2024-09-21T12:47:24.843 INFO:tasks.workunit.client.0.smithi046.stdout:8/883: write d1/d12/d46/d35/d5b/dd6/fe0 [10599972,39748] 0 2024-09-21T12:47:24.845 INFO:tasks.workunit.client.0.smithi046.stdout:8/884: readlink d1/d12/d53/dab/l11c 0 2024-09-21T12:47:24.847 INFO:tasks.workunit.client.0.smithi046.stdout:5/770: rename d4/fa to d4/dc/d45/d94/ff8 0 2024-09-21T12:47:24.851 INFO:tasks.workunit.client.0.smithi046.stdout:1/742: dwrite d4/d13/f7f [0,4194304] 0 2024-09-21T12:47:24.853 INFO:tasks.workunit.client.0.smithi046.stdout:0/932: dwrite d6/d7/d13/d43/d52/d63/d7f/d78/fe6 [4194304,4194304] 0 2024-09-21T12:47:24.855 INFO:tasks.workunit.client.0.smithi046.stdout:4/902: creat d1/f127 x:0 0 0 2024-09-21T12:47:24.855 INFO:tasks.workunit.client.0.smithi046.stdout:5/771: truncate d4/d22/d10/d1a/d9e/fd6 1347304 0 2024-09-21T12:47:24.857 INFO:tasks.workunit.client.0.smithi046.stdout:5/772: readlink d4/dc/d13/d15/l85 0 2024-09-21T12:47:24.858 INFO:tasks.workunit.client.0.smithi046.stdout:2/752: truncate d16/d22/d2b/d30/d67/fab 564712 0 2024-09-21T12:47:24.864 INFO:tasks.workunit.client.0.smithi046.stdout:0/933: unlink d6/d7/d13/d43/d52/dc0/dc3/da4/d13c/f114 0 2024-09-21T12:47:24.869 INFO:tasks.workunit.client.0.smithi046.stdout:1/743: mkdir d4/d13/d38/d53/df2 0 2024-09-21T12:47:24.876 INFO:tasks.workunit.client.0.smithi046.stdout:0/934: rmdir d6/d7/d13/d43/d52/d63/d7f/d78 39 2024-09-21T12:47:24.881 INFO:tasks.workunit.client.0.smithi046.stdout:4/903: rename d1/d27/l68 to d1/d27/d37/l128 0 2024-09-21T12:47:24.882 INFO:tasks.workunit.client.0.smithi046.stdout:5/773: creat d4/dc/d13/ff9 x:0 0 0 2024-09-21T12:47:24.883 INFO:tasks.workunit.client.0.smithi046.stdout:5/774: stat d4/dc/d13/d5b/d2d/d43/d7a/lb5 0 2024-09-21T12:47:24.884 INFO:tasks.workunit.client.0.smithi046.stdout:2/753: link d16/d22/c4c d16/d5c/d63/db4/dd4/cf9 0 2024-09-21T12:47:24.885 INFO:tasks.workunit.client.0.smithi046.stdout:2/754: dread - d16/d5c/d63/f6b zero size 2024-09-21T12:47:24.885 INFO:tasks.workunit.client.0.smithi046.stdout:4/904: mkdir d1/d13/d25/d3a/dec/d129 0 2024-09-21T12:47:24.886 INFO:tasks.workunit.client.0.smithi046.stdout:2/755: readlink d16/d5c/d63/db4/dd4/ddb/lea 0 2024-09-21T12:47:24.888 INFO:tasks.workunit.client.0.smithi046.stdout:1/744: rename d4/d29/d32/d9e/f70 to d4/ff3 0 2024-09-21T12:47:24.891 INFO:tasks.workunit.client.0.smithi046.stdout:2/756: creat d16/d22/d38/d77/ffa x:0 0 0 2024-09-21T12:47:24.892 INFO:tasks.workunit.client.0.smithi046.stdout:2/757: readlink d16/d22/d38/l93 0 2024-09-21T12:47:24.894 INFO:tasks.workunit.client.0.smithi046.stdout:0/935: rename d6/d7/d13/d49/cef to d6/d7/d13/d43/d52/dc0/dc3/c147 0 2024-09-21T12:47:24.896 INFO:tasks.workunit.client.0.smithi046.stdout:1/745: mknod d4/d13/d38/cf4 0 2024-09-21T12:47:24.897 INFO:tasks.workunit.client.0.smithi046.stdout:1/746: stat d4/d13/d6b/l91 0 2024-09-21T12:47:24.898 INFO:tasks.workunit.client.0.smithi046.stdout:8/885: dread d1/d12/d46/d35/d36/d51/f5a [0,4194304] 0 2024-09-21T12:47:24.899 INFO:tasks.workunit.client.0.smithi046.stdout:8/886: chown d1/dc1 1235 1 2024-09-21T12:47:24.900 INFO:tasks.workunit.client.0.smithi046.stdout:4/905: creat d1/d13/d25/d29/d33/f12a x:0 0 0 2024-09-21T12:47:24.900 INFO:tasks.workunit.client.0.smithi046.stdout:0/936: fdatasync d6/d7/d13/f1d 0 2024-09-21T12:47:24.903 INFO:tasks.workunit.client.0.smithi046.stdout:8/887: read d1/d12/d46/d35/d36/d51/d8c/dee/dfb/f126 [414868,4045] 0 2024-09-21T12:47:24.903 INFO:tasks.workunit.client.0.smithi046.stdout:2/758: mkdir d16/d22/dfb 0 2024-09-21T12:47:24.908 INFO:tasks.workunit.client.0.smithi046.stdout:4/906: creat d1/d13/d25/d3a/d111/f12b x:0 0 0 2024-09-21T12:47:24.911 INFO:tasks.workunit.client.0.smithi046.stdout:2/759: mknod d16/d22/d38/d77/d9e/cfc 0 2024-09-21T12:47:24.912 INFO:tasks.workunit.client.0.smithi046.stdout:0/937: mknod d6/dac/c148 0 2024-09-21T12:47:24.914 INFO:tasks.workunit.client.0.smithi046.stdout:0/938: write d6/d7/d13/d43/d52/d63/d7f/d38/da6/f12e [225383,92087] 0 2024-09-21T12:47:24.914 INFO:tasks.workunit.client.0.smithi046.stdout:8/888: symlink d1/d12/d46/d35/d36/dce/d123/l136 0 2024-09-21T12:47:24.916 INFO:tasks.workunit.client.0.smithi046.stdout:2/760: truncate f15 1549920 0 2024-09-21T12:47:24.917 INFO:tasks.workunit.client.0.smithi046.stdout:2/761: fdatasync d16/d22/d75/ded/ff6 0 2024-09-21T12:47:24.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/907: creat d1/d13/d25/f12c x:0 0 0 2024-09-21T12:47:24.920 INFO:tasks.workunit.client.0.smithi046.stdout:4/908: chown d1/d5f 1526830 1 2024-09-21T12:47:24.925 INFO:tasks.workunit.client.0.smithi046.stdout:2/762: mknod d16/d22/d38/dac/cfd 0 2024-09-21T12:47:24.932 INFO:tasks.workunit.client.0.smithi046.stdout:0/939: dread d6/d7/d37/f48 [0,4194304] 0 2024-09-21T12:47:24.935 INFO:tasks.workunit.client.0.smithi046.stdout:4/909: symlink d1/d85/de6/df8/l12d 0 2024-09-21T12:47:24.935 INFO:tasks.workunit.client.0.smithi046.stdout:2/763: getdents d16/d5c/de1 0 2024-09-21T12:47:24.936 INFO:tasks.workunit.client.0.smithi046.stdout:2/764: dread - d16/f8d zero size 2024-09-21T12:47:24.939 INFO:tasks.workunit.client.0.smithi046.stdout:2/765: read - d16/d22/d2b/d30/f5f zero size 2024-09-21T12:47:24.942 INFO:tasks.workunit.client.0.smithi046.stdout:5/775: write d4/dc/d45/f87 [1866424,105051] 0 2024-09-21T12:47:24.943 INFO:tasks.workunit.client.0.smithi046.stdout:0/940: dwrite d6/d7/df3/f118 [4194304,4194304] 0 2024-09-21T12:47:24.947 INFO:tasks.workunit.client.0.smithi046.stdout:2/766: creat d16/d22/d2b/d30/d8f/ffe x:0 0 0 2024-09-21T12:47:24.952 INFO:tasks.workunit.client.0.smithi046.stdout:0/941: dread - d6/d7/d13/d43/d52/d63/d7f/d38/fd0 zero size 2024-09-21T12:47:24.954 INFO:tasks.workunit.client.0.smithi046.stdout:2/767: mknod d16/d22/d2b/d30/d8f/cff 0 2024-09-21T12:47:24.956 INFO:tasks.workunit.client.0.smithi046.stdout:4/910: getdents d1/d5f 0 2024-09-21T12:47:24.958 INFO:tasks.workunit.client.0.smithi046.stdout:4/911: chown d1/d85/ca5 399 1 2024-09-21T12:47:24.961 INFO:tasks.workunit.client.0.smithi046.stdout:2/768: creat d16/d22/d4e/d9d/f100 x:0 0 0 2024-09-21T12:47:24.963 INFO:tasks.workunit.client.0.smithi046.stdout:0/942: link d6/d7/f5b d6/d7/d13/d43/d52/f149 0 2024-09-21T12:47:24.964 INFO:tasks.workunit.client.0.smithi046.stdout:1/747: write d4/f9 [7938948,11584] 0 2024-09-21T12:47:24.969 INFO:tasks.workunit.client.0.smithi046.stdout:2/769: rename d16/d22/d4e/d9d/f100 to d16/d22/d2b/d30/d8f/f101 0 2024-09-21T12:47:24.972 INFO:tasks.workunit.client.0.smithi046.stdout:4/912: symlink d1/d27/l12e 0 2024-09-21T12:47:24.976 INFO:tasks.workunit.client.0.smithi046.stdout:2/770: symlink d16/d22/d75/ded/l102 0 2024-09-21T12:47:24.982 INFO:tasks.workunit.client.0.smithi046.stdout:2/771: creat d16/d22/d2b/f103 x:0 0 0 2024-09-21T12:47:24.982 INFO:tasks.workunit.client.0.smithi046.stdout:0/943: dwrite d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f12b [0,4194304] 0 2024-09-21T12:47:24.985 INFO:tasks.workunit.client.0.smithi046.stdout:8/889: truncate d1/d12/d53/fbe 4143773 0 2024-09-21T12:47:24.987 INFO:tasks.workunit.client.0.smithi046.stdout:0/944: chown d6/d7/d9/dc4/cdd 5729836 1 2024-09-21T12:47:24.987 INFO:tasks.workunit.client.0.smithi046.stdout:4/913: link d1/d13/d25/d3a/d92/f107 d1/d27/d82/df9/f12f 0 2024-09-21T12:47:24.990 INFO:tasks.workunit.client.0.smithi046.stdout:2/772: symlink d16/d22/d2b/d30/l104 0 2024-09-21T12:47:24.991 INFO:tasks.workunit.client.0.smithi046.stdout:0/945: write d6/f10e [486492,92701] 0 2024-09-21T12:47:24.992 INFO:tasks.workunit.client.0.smithi046.stdout:8/890: truncate d1/d12/d46/d35/d5b/f69 307955 0 2024-09-21T12:47:24.996 INFO:tasks.workunit.client.0.smithi046.stdout:4/914: creat d1/d27/d37/d66/dee/f130 x:0 0 0 2024-09-21T12:47:24.999 INFO:tasks.workunit.client.0.smithi046.stdout:8/891: creat d1/d12/d1a/d33/f137 x:0 0 0 2024-09-21T12:47:25.001 INFO:tasks.workunit.client.0.smithi046.stdout:2/773: dwrite d16/d22/d38/d77/d7a/f98 [0,4194304] 0 2024-09-21T12:47:25.003 INFO:tasks.workunit.client.0.smithi046.stdout:5/776: write d4/dc/d13/d5b/d2d/f91 [703289,73296] 0 2024-09-21T12:47:25.008 INFO:tasks.workunit.client.0.smithi046.stdout:0/946: link d6/d7/df3/l146 d6/d7/d13/d43/d52/d63/d7f/d78/d10c/l14a 0 2024-09-21T12:47:25.013 INFO:tasks.workunit.client.0.smithi046.stdout:6/659: sync 2024-09-21T12:47:25.014 INFO:tasks.workunit.client.0.smithi046.stdout:4/915: dread d1/d13/d25/d29/d43/f6c [0,4194304] 0 2024-09-21T12:47:25.015 INFO:tasks.workunit.client.0.smithi046.stdout:1/748: write d4/d13/d38/d53/fb3 [478212,7055] 0 2024-09-21T12:47:25.016 INFO:tasks.workunit.client.0.smithi046.stdout:4/916: chown d1/l1c 1056112619 1 2024-09-21T12:47:25.020 INFO:tasks.workunit.client.0.smithi046.stdout:4/917: write d1/d13/d25/d29/d33/f65 [2952910,10651] 0 2024-09-21T12:47:25.022 INFO:tasks.workunit.client.0.smithi046.stdout:4/918: chown d1/d27/d46/d78/lbf 460 1 2024-09-21T12:47:25.030 INFO:tasks.workunit.client.0.smithi046.stdout:8/892: dread d1/d12/d53/d60/fac [0,4194304] 0 2024-09-21T12:47:25.034 INFO:tasks.workunit.client.0.smithi046.stdout:1/749: symlink d4/d13/d38/d53/d80/d95/lf5 0 2024-09-21T12:47:25.050 INFO:tasks.workunit.client.0.smithi046.stdout:8/893: mknod d1/d12/d46/d35/d36/c138 0 2024-09-21T12:47:25.051 INFO:tasks.workunit.client.0.smithi046.stdout:0/947: dread d6/d7/d13/d43/d52/d63/d7f/d38/f93 [4194304,4194304] 0 2024-09-21T12:47:25.052 INFO:tasks.workunit.client.0.smithi046.stdout:1/750: rmdir d4/d29/d32/d9e/d5d 39 2024-09-21T12:47:25.059 INFO:tasks.workunit.client.0.smithi046.stdout:2/774: getdents d16/d5c/d63/db4/dca 0 2024-09-21T12:47:25.060 INFO:tasks.workunit.client.0.smithi046.stdout:2/775: fsync d16/fc8 0 2024-09-21T12:47:25.063 INFO:tasks.workunit.client.0.smithi046.stdout:4/919: rename d1/d13/d25/d29/f2f to d1/d27/d46/d78/f131 0 2024-09-21T12:47:25.064 INFO:tasks.workunit.client.0.smithi046.stdout:6/660: dwrite de/f15 [0,4194304] 0 2024-09-21T12:47:25.064 INFO:tasks.workunit.client.0.smithi046.stdout:8/894: creat d1/d12/d1a/d33/d6c/d12a/f139 x:0 0 0 2024-09-21T12:47:25.065 INFO:tasks.workunit.client.0.smithi046.stdout:4/920: stat d1/f35 0 2024-09-21T12:47:25.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/777: link d4/dc/d13/d15/d5c/c8e d4/dc/d13/d5b/d2d/cfa 0 2024-09-21T12:47:25.068 INFO:tasks.workunit.client.0.smithi046.stdout:0/948: dwrite d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f111 [0,4194304] 0 2024-09-21T12:47:25.071 INFO:tasks.workunit.client.0.smithi046.stdout:0/949: read d6/d7/d13/f4b [3310588,114757] 0 2024-09-21T12:47:25.077 INFO:tasks.workunit.client.0.smithi046.stdout:3/611: sync 2024-09-21T12:47:25.077 INFO:tasks.workunit.client.0.smithi046.stdout:9/881: sync 2024-09-21T12:47:25.077 INFO:tasks.workunit.client.0.smithi046.stdout:7/841: sync 2024-09-21T12:47:25.083 INFO:tasks.workunit.client.0.smithi046.stdout:0/950: dwrite d6/d7/d37/faa [0,4194304] 0 2024-09-21T12:47:25.092 INFO:tasks.workunit.client.0.smithi046.stdout:3/612: creat d5/d16/d5f/d6c/fdb x:0 0 0 2024-09-21T12:47:25.092 INFO:tasks.workunit.client.0.smithi046.stdout:0/951: chown d6/d7/d13/d43/d52/d63 1722 1 2024-09-21T12:47:25.093 INFO:tasks.workunit.client.0.smithi046.stdout:6/661: creat de/fda x:0 0 0 2024-09-21T12:47:25.093 INFO:tasks.workunit.client.0.smithi046.stdout:5/778: dwrite d4/dc/d13/d5b/d2d/d43/fed [0,4194304] 0 2024-09-21T12:47:25.094 INFO:tasks.workunit.client.0.smithi046.stdout:9/882: unlink d11/d19/d1b/d31/d53/d58/fe5 0 2024-09-21T12:47:25.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/779: dwrite d4/fe4 [0,4194304] 0 2024-09-21T12:47:25.112 INFO:tasks.workunit.client.0.smithi046.stdout:1/751: dwrite d4/f9c [0,4194304] 0 2024-09-21T12:47:25.117 INFO:tasks.workunit.client.0.smithi046.stdout:8/895: dwrite d1/d12/d46/d35/fcf [0,4194304] 0 2024-09-21T12:47:25.118 INFO:tasks.workunit.client.0.smithi046.stdout:8/896: write d1/f8 [4832319,28903] 0 2024-09-21T12:47:25.140 INFO:tasks.workunit.client.0.smithi046.stdout:2/776: getdents d16/d22/d4e/d90 0 2024-09-21T12:47:25.141 INFO:tasks.workunit.client.0.smithi046.stdout:2/777: write d16/fc8 [782408,125708] 0 2024-09-21T12:47:25.143 INFO:tasks.workunit.client.0.smithi046.stdout:3/613: stat d5/c23 0 2024-09-21T12:47:25.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/778: write d16/d22/f97 [3435702,88821] 0 2024-09-21T12:47:25.148 INFO:tasks.workunit.client.0.smithi046.stdout:1/752: symlink d4/d4d/lf6 0 2024-09-21T12:47:25.157 INFO:tasks.workunit.client.0.smithi046.stdout:8/897: dwrite d1/d12/d1a/d33/fe2 [0,4194304] 0 2024-09-21T12:47:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:3/614: mknod d5/dc/d26/d3c/cdc 0 2024-09-21T12:47:25.159 INFO:tasks.workunit.client.0.smithi046.stdout:2/779: symlink d16/d22/d2b/d43/l105 0 2024-09-21T12:47:25.162 INFO:tasks.workunit.client.0.smithi046.stdout:9/883: mknod d11/d19/d36/d45/d6e/c11c 0 2024-09-21T12:47:25.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/884: chown d11/d19/d1b/d4b/d91/f7c 1795139 1 2024-09-21T12:47:25.166 INFO:tasks.workunit.client.0.smithi046.stdout:8/898: dwrite d1/d12/d46/fd5 [0,4194304] 0 2024-09-21T12:47:25.177 INFO:tasks.workunit.client.0.smithi046.stdout:8/899: dwrite d1/d12/d46/f91 [0,4194304] 0 2024-09-21T12:47:25.185 INFO:tasks.workunit.client.0.smithi046.stdout:6/662: creat de/d2a/d4c/d77/fdb x:0 0 0 2024-09-21T12:47:25.186 INFO:tasks.workunit.client.0.smithi046.stdout:5/780: truncate d4/dc/d13/da2/fd4 2855691 0 2024-09-21T12:47:25.196 INFO:tasks.workunit.client.0.smithi046.stdout:1/753: dwrite d4/f77 [4194304,4194304] 0 2024-09-21T12:47:25.197 INFO:tasks.workunit.client.0.smithi046.stdout:9/885: mknod d11/d19/d1b/d31/d53/d58/c11d 0 2024-09-21T12:47:25.199 INFO:tasks.workunit.client.0.smithi046.stdout:9/886: dread - d11/d19/d1b/d31/d44/dff/f116 zero size 2024-09-21T12:47:25.202 INFO:tasks.workunit.client.0.smithi046.stdout:0/952: getdents d6/d7 0 2024-09-21T12:47:25.206 INFO:tasks.workunit.client.0.smithi046.stdout:4/921: link d1/d13/d25/d29/d33/f12a d1/d27/f132 0 2024-09-21T12:47:25.218 INFO:tasks.workunit.client.0.smithi046.stdout:3/615: dwrite d5/dc/d30/d34/f8c [0,4194304] 0 2024-09-21T12:47:25.222 INFO:tasks.workunit.client.0.smithi046.stdout:4/922: rename d1/d5f/l11c to d1/d13/d25/d29/d33/d115/l133 0 2024-09-21T12:47:25.227 INFO:tasks.workunit.client.0.smithi046.stdout:8/900: write d1/d12/d46/d35/d5b/dd6/d113/fda [1000460,29424] 0 2024-09-21T12:47:25.228 INFO:tasks.workunit.client.0.smithi046.stdout:6/663: write f3 [498783,108824] 0 2024-09-21T12:47:25.232 INFO:tasks.workunit.client.0.smithi046.stdout:9/887: dwrite d11/f54 [4194304,4194304] 0 2024-09-21T12:47:25.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/754: truncate d4/d13/f2e 642261 0 2024-09-21T12:47:25.235 INFO:tasks.workunit.client.0.smithi046.stdout:9/888: chown d11/d5b/d6f/dda/fa9 0 1 2024-09-21T12:47:25.240 INFO:tasks.workunit.client.0.smithi046.stdout:8/901: mknod d1/d12/d46/d35/d7d/c13a 0 2024-09-21T12:47:25.240 INFO:tasks.workunit.client.0.smithi046.stdout:9/889: read - d11/d19/d36/d45/ffb zero size 2024-09-21T12:47:25.240 INFO:tasks.workunit.client.0.smithi046.stdout:5/781: dwrite d4/dc/fa6 [0,4194304] 0 2024-09-21T12:47:25.242 INFO:tasks.workunit.client.0.smithi046.stdout:6/664: truncate de/d2a/d4c/d77/dae/d55/f95 4888734 0 2024-09-21T12:47:25.251 INFO:tasks.workunit.client.0.smithi046.stdout:5/782: dwrite d4/d22/d99/fc6 [0,4194304] 0 2024-09-21T12:47:25.253 INFO:tasks.workunit.client.0.smithi046.stdout:2/780: getdents d16/d22/d38/d77 0 2024-09-21T12:47:25.256 INFO:tasks.workunit.client.0.smithi046.stdout:4/923: mkdir d1/dda/d134 0 2024-09-21T12:47:25.256 INFO:tasks.workunit.client.0.smithi046.stdout:3/616: dread d5/dc/f1b [0,4194304] 0 2024-09-21T12:47:25.265 INFO:tasks.workunit.client.0.smithi046.stdout:0/953: truncate d6/d7/d37/faa 39710 0 2024-09-21T12:47:25.267 INFO:tasks.workunit.client.0.smithi046.stdout:3/617: unlink d5/d16/f1e 0 2024-09-21T12:47:25.270 INFO:tasks.workunit.client.0.smithi046.stdout:6/665: mkdir de/d2a/d4c/d77/d8f/ddc 0 2024-09-21T12:47:25.272 INFO:tasks.workunit.client.0.smithi046.stdout:2/781: mkdir d16/d5c/d63/db4/dca/dc1/d106 0 2024-09-21T12:47:25.272 INFO:tasks.workunit.client.0.smithi046.stdout:4/924: dread d1/f74 [0,4194304] 0 2024-09-21T12:47:25.274 INFO:tasks.workunit.client.0.smithi046.stdout:4/925: write d1/d27/d46/f77 [6488494,2789] 0 2024-09-21T12:47:25.276 INFO:tasks.workunit.client.0.smithi046.stdout:9/890: symlink d11/d19/d1b/d31/d53/d84/d8f/l11e 0 2024-09-21T12:47:25.277 INFO:tasks.workunit.client.0.smithi046.stdout:1/755: write d4/d29/d32/f46 [105429,108771] 0 2024-09-21T12:47:25.281 INFO:tasks.workunit.client.0.smithi046.stdout:9/891: dread d11/d19/d1b/d31/d53/d5e/fb8 [0,4194304] 0 2024-09-21T12:47:25.286 INFO:tasks.workunit.client.0.smithi046.stdout:0/954: mkdir d6/d7/d13/d7b/d14b 0 2024-09-21T12:47:25.287 INFO:tasks.workunit.client.0.smithi046.stdout:0/955: dread - d6/d7/d13/d49/f137 zero size 2024-09-21T12:47:25.293 INFO:tasks.workunit.client.0.smithi046.stdout:3/618: dwrite d5/dc/d26/fd2 [0,4194304] 0 2024-09-21T12:47:25.298 INFO:tasks.workunit.client.0.smithi046.stdout:2/782: symlink d16/d22/d4e/d90/l107 0 2024-09-21T12:47:25.312 INFO:tasks.workunit.client.0.smithi046.stdout:0/956: mkdir d6/d7/d13/d14c 0 2024-09-21T12:47:25.312 INFO:tasks.workunit.client.0.smithi046.stdout:6/666: mknod de/cdd 0 2024-09-21T12:47:25.318 INFO:tasks.workunit.client.0.smithi046.stdout:9/892: write d11/d19/d1b/d4b/d91/d94/fb4 [819131,113417] 0 2024-09-21T12:47:25.321 INFO:tasks.workunit.client.0.smithi046.stdout:4/926: rename d1/d13/d25/d29/d43/d84/daa/f123 to d1/d13/d25/d29/d43/d84/f135 0 2024-09-21T12:47:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:1/756: creat d4/d29/d32/d9e/d5d/ff7 x:0 0 0 2024-09-21T12:47:25.322 INFO:tasks.workunit.client.0.smithi046.stdout:4/927: read - d1/d13/d25/d29/d33/f12a zero size 2024-09-21T12:47:25.324 INFO:tasks.workunit.client.0.smithi046.stdout:5/783: getdents d4/dc/d13/d5b/d2d/d43 0 2024-09-21T12:47:25.325 INFO:tasks.workunit.client.0.smithi046.stdout:1/757: chown d4/d13/d38/d53/d80/d8b/dc3/cee 2163 1 2024-09-21T12:47:25.327 INFO:tasks.workunit.client.0.smithi046.stdout:5/784: chown d4/dc/d13/d5b/d2d/f91 852 1 2024-09-21T12:47:25.328 INFO:tasks.workunit.client.0.smithi046.stdout:9/893: truncate d11/d5b/d6f/db0/d30/d3e/f81 4465757 0 2024-09-21T12:47:25.333 INFO:tasks.workunit.client.0.smithi046.stdout:3/619: rename d5/dc/d30/d34/fc0 to d5/dc/d28/d63/fdd 0 2024-09-21T12:47:25.334 INFO:tasks.workunit.client.0.smithi046.stdout:4/928: dwrite d1/d13/d25/d29/d43/d84/f126 [0,4194304] 0 2024-09-21T12:47:25.336 INFO:tasks.workunit.client.0.smithi046.stdout:3/620: chown d5/d16/d5f/l91 3377 1 2024-09-21T12:47:25.338 INFO:tasks.workunit.client.0.smithi046.stdout:0/957: symlink d6/d7/d13/d43/d52/d63/d7f/d78/d8a/d134/l14d 0 2024-09-21T12:47:25.340 INFO:tasks.workunit.client.0.smithi046.stdout:3/621: chown d5/d16/d5f/d6c/c90 44373 1 2024-09-21T12:47:25.342 INFO:tasks.workunit.client.0.smithi046.stdout:3/622: write d5/dc/d26/fd2 [18884,8663] 0 2024-09-21T12:47:25.344 INFO:tasks.workunit.client.0.smithi046.stdout:4/929: read d1/d13/d25/d3a/fa1 [1650060,26103] 0 2024-09-21T12:47:25.348 INFO:tasks.workunit.client.0.smithi046.stdout:6/667: dread fb [0,4194304] 0 2024-09-21T12:47:25.349 INFO:tasks.workunit.client.0.smithi046.stdout:2/783: creat d16/d22/d4e/f108 x:0 0 0 2024-09-21T12:47:25.350 INFO:tasks.workunit.client.0.smithi046.stdout:5/785: dread - d4/d22/d10/d1a/fb0 zero size 2024-09-21T12:47:25.351 INFO:tasks.workunit.client.0.smithi046.stdout:9/894: symlink d11/d19/d1b/d31/d53/d84/l11f 0 2024-09-21T12:47:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:9/895: chown d11/d19/d1b/c3b 13211 1 2024-09-21T12:47:25.352 INFO:tasks.workunit.client.0.smithi046.stdout:9/896: fdatasync f2 0 2024-09-21T12:47:25.358 INFO:tasks.workunit.client.0.smithi046.stdout:3/623: rename d5/dc/d30/d34/ca8 to d5/dc/d26/d3c/cde 0 2024-09-21T12:47:25.360 INFO:tasks.workunit.client.0.smithi046.stdout:0/958: dread d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f133 [4194304,4194304] 0 2024-09-21T12:47:25.361 INFO:tasks.workunit.client.0.smithi046.stdout:1/758: dwrite d4/d29/f6c [0,4194304] 0 2024-09-21T12:47:25.362 INFO:tasks.workunit.client.0.smithi046.stdout:6/668: mkdir de/d2a/d4c/d71/dde 0 2024-09-21T12:47:25.374 INFO:tasks.workunit.client.0.smithi046.stdout:4/930: mknod d1/d27/d58/c136 0 2024-09-21T12:47:25.375 INFO:tasks.workunit.client.0.smithi046.stdout:0/959: creat d6/d7/f14e x:0 0 0 2024-09-21T12:47:25.385 INFO:tasks.workunit.client.0.smithi046.stdout:9/897: symlink d11/d19/d1b/d31/l120 0 2024-09-21T12:47:25.389 INFO:tasks.workunit.client.0.smithi046.stdout:4/931: creat d1/d27/d82/f137 x:0 0 0 2024-09-21T12:47:25.395 INFO:tasks.workunit.client.0.smithi046.stdout:6/669: write de/d2a/f33 [223246,124365] 0 2024-09-21T12:47:25.398 INFO:tasks.workunit.client.0.smithi046.stdout:2/784: write d16/d22/d2b/d30/d8f/f9c [1794368,125105] 0 2024-09-21T12:47:25.399 INFO:tasks.workunit.client.0.smithi046.stdout:6/670: readlink de/d2a/d4c/d77/d98/laa 0 2024-09-21T12:47:25.400 INFO:tasks.workunit.client.0.smithi046.stdout:3/624: write d5/fb [2879585,65913] 0 2024-09-21T12:47:25.403 INFO:tasks.workunit.client.0.smithi046.stdout:1/759: dwrite d4/d13/f36 [0,4194304] 0 2024-09-21T12:47:25.404 INFO:tasks.workunit.client.0.smithi046.stdout:2/785: chown d16/d22/d38/f42 131 1 2024-09-21T12:47:25.406 INFO:tasks.workunit.client.0.smithi046.stdout:3/625: chown d5/dc/d30/d34/dd1/f74 142 1 2024-09-21T12:47:25.411 INFO:tasks.workunit.client.0.smithi046.stdout:5/786: getdents d4/dc/d45 0 2024-09-21T12:47:25.412 INFO:tasks.workunit.client.0.smithi046.stdout:4/932: rename d1/d13/d25/d29/c5e to d1/d27/d37/d66/d105/c138 0 2024-09-21T12:47:25.414 INFO:tasks.workunit.client.0.smithi046.stdout:6/671: mknod de/d2a/d4d/cdf 0 2024-09-21T12:47:25.414 INFO:tasks.workunit.client.0.smithi046.stdout:2/786: rename d16/d5c/lb6 to d16/d5c/l109 0 2024-09-21T12:47:25.416 INFO:tasks.workunit.client.0.smithi046.stdout:9/898: dwrite d11/d19/f1a [0,4194304] 0 2024-09-21T12:47:25.417 INFO:tasks.workunit.client.0.smithi046.stdout:0/960: mknod d6/d7/d13/d7b/c14f 0 2024-09-21T12:47:25.418 INFO:tasks.workunit.client.0.smithi046.stdout:1/760: creat d4/d29/d32/d9e/d5d/d8c/d92/ff8 x:0 0 0 2024-09-21T12:47:25.420 INFO:tasks.workunit.client.0.smithi046.stdout:5/787: chown d4/dc/d13/d5b/d2d/d43/d7a/cd5 0 1 2024-09-21T12:47:25.425 INFO:tasks.workunit.client.0.smithi046.stdout:5/788: chown d4/d22/d10/d1a/d9e/d9a 134 1 2024-09-21T12:47:25.426 INFO:tasks.workunit.client.0.smithi046.stdout:6/672: mknod de/d2a/d4c/d77/dc0/ce0 0 2024-09-21T12:47:25.427 INFO:tasks.workunit.client.0.smithi046.stdout:9/899: symlink d11/d19/d1b/d4b/l121 0 2024-09-21T12:47:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:1/761: dread - d4/d29/d32/d9e/d5d/fbb zero size 2024-09-21T12:47:25.430 INFO:tasks.workunit.client.0.smithi046.stdout:9/900: truncate d11/d19/d1b/d4b/d91/ff4 522985 0 2024-09-21T12:47:25.433 INFO:tasks.workunit.client.0.smithi046.stdout:6/673: creat de/d2a/d4c/d77/d8f/fe1 x:0 0 0 2024-09-21T12:47:25.435 INFO:tasks.workunit.client.0.smithi046.stdout:5/789: symlink d4/dc/d13/d5b/d2d/d43/lfb 0 2024-09-21T12:47:25.437 INFO:tasks.workunit.client.0.smithi046.stdout:0/961: dwrite d6/d7/d9/dc4/fdc [0,4194304] 0 2024-09-21T12:47:25.439 INFO:tasks.workunit.client.0.smithi046.stdout:3/626: rename d5/dc/d26/l93 to d5/dc/d28/d60/ldf 0 2024-09-21T12:47:25.444 INFO:tasks.workunit.client.0.smithi046.stdout:9/901: dwrite d11/d19/f24 [0,4194304] 0 2024-09-21T12:47:25.445 INFO:tasks.workunit.client.0.smithi046.stdout:3/627: chown d5/dc/d30/d34/dd1 990168574 1 2024-09-21T12:47:25.446 INFO:tasks.workunit.client.0.smithi046.stdout:1/762: symlink d4/d29/d32/d9e/de9/lf9 0 2024-09-21T12:47:25.449 INFO:tasks.workunit.client.0.smithi046.stdout:6/674: creat de/d2a/d4d/fe2 x:0 0 0 2024-09-21T12:47:25.449 INFO:tasks.workunit.client.0.smithi046.stdout:4/933: creat d1/d13/d25/d29/d43/f139 x:0 0 0 2024-09-21T12:47:25.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/790: creat d4/d22/d10/d1a/d9e/ffc x:0 0 0 2024-09-21T12:47:25.451 INFO:tasks.workunit.client.0.smithi046.stdout:6/675: stat de/d48/l66 0 2024-09-21T12:47:25.457 INFO:tasks.workunit.client.0.smithi046.stdout:7/842: sync 2024-09-21T12:47:25.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/791: symlink d4/dc/d13/d15/d54/lfd 0 2024-09-21T12:47:25.462 INFO:tasks.workunit.client.0.smithi046.stdout:1/763: symlink d4/d29/lfa 0 2024-09-21T12:47:25.462 INFO:tasks.workunit.client.0.smithi046.stdout:5/792: truncate d4/d22/d10/d1a/f27 4788558 0 2024-09-21T12:47:25.464 INFO:tasks.workunit.client.0.smithi046.stdout:3/628: creat d5/fe0 x:0 0 0 2024-09-21T12:47:25.465 INFO:tasks.workunit.client.0.smithi046.stdout:3/629: readlink d5/dc/l13 0 2024-09-21T12:47:25.466 INFO:tasks.workunit.client.0.smithi046.stdout:4/934: rename d1/d13/d25/l55 to d1/d13/d25/d29/d43/d84/l13a 0 2024-09-21T12:47:25.467 INFO:tasks.workunit.client.0.smithi046.stdout:6/676: truncate de/d2a/d4c/f54 1524440 0 2024-09-21T12:47:25.469 INFO:tasks.workunit.client.0.smithi046.stdout:1/764: rmdir d4/d13/d38/d53/d80/d8b 39 2024-09-21T12:47:25.475 INFO:tasks.workunit.client.0.smithi046.stdout:3/630: chown d5/c5b 15825433 1 2024-09-21T12:47:25.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/631: readlink d5/lbf 0 2024-09-21T12:47:25.476 INFO:tasks.workunit.client.0.smithi046.stdout:0/962: truncate d6/d7/d13/f3d 3277239 0 2024-09-21T12:47:25.478 INFO:tasks.workunit.client.0.smithi046.stdout:6/677: dwrite de/d2a/f68 [0,4194304] 0 2024-09-21T12:47:25.480 INFO:tasks.workunit.client.0.smithi046.stdout:7/843: unlink d2/d4/df/d70/d88/d34/f106 0 2024-09-21T12:47:25.482 INFO:tasks.workunit.client.0.smithi046.stdout:9/902: getdents d11/d19/d1b 0 2024-09-21T12:47:25.483 INFO:tasks.workunit.client.0.smithi046.stdout:7/844: readlink d2/d4/df/d9a/lb1 0 2024-09-21T12:47:25.486 INFO:tasks.workunit.client.0.smithi046.stdout:4/935: dread d1/d27/d58/db7/fbb [0,4194304] 0 2024-09-21T12:47:25.489 INFO:tasks.workunit.client.0.smithi046.stdout:0/963: unlink d6/d7/d13/d43/d52/d63/d7f/d78/d10c/f12b 0 2024-09-21T12:47:25.491 INFO:tasks.workunit.client.0.smithi046.stdout:5/793: rename d4/dc/d13/d15/d54 to d4/dc/d13/da2/dce/dfe 0 2024-09-21T12:47:25.492 INFO:tasks.workunit.client.0.smithi046.stdout:6/678: creat de/d48/fe3 x:0 0 0 2024-09-21T12:47:25.497 INFO:tasks.workunit.client.0.smithi046.stdout:9/903: creat d11/d5b/d6f/dda/f122 x:0 0 0 2024-09-21T12:47:25.498 INFO:tasks.workunit.client.0.smithi046.stdout:9/904: readlink d11/d5b/dcf/l119 0 2024-09-21T12:47:25.507 INFO:tasks.workunit.client.0.smithi046.stdout:4/936: unlink d1/d27/d82/da8/cc0 0 2024-09-21T12:47:25.509 INFO:tasks.workunit.client.0.smithi046.stdout:0/964: dread d6/d2f/de9/f101 [0,4194304] 0 2024-09-21T12:47:25.511 INFO:tasks.workunit.client.0.smithi046.stdout:1/765: rename d4/d13/d38/d53/d80/d95/da5/fb5 to d4/d4d/dda/ffb 0 2024-09-21T12:47:25.511 INFO:tasks.workunit.client.0.smithi046.stdout:7/845: rename d2/d4 to d2/d4/df/d9a/dc3/dc4/d110/d116 22 2024-09-21T12:47:25.513 INFO:tasks.workunit.client.0.smithi046.stdout:5/794: rmdir d4/dc/d13/da2/dce/dfe 39 2024-09-21T12:47:25.515 INFO:tasks.workunit.client.0.smithi046.stdout:9/905: mknod d11/d19/d1b/d31/d53/d84/c123 0 2024-09-21T12:47:25.516 INFO:tasks.workunit.client.0.smithi046.stdout:9/906: stat d11/d19/df2/df3/f104 0 2024-09-21T12:47:25.517 INFO:tasks.workunit.client.0.smithi046.stdout:3/632: creat d5/dc/d28/fe1 x:0 0 0 2024-09-21T12:47:25.519 INFO:tasks.workunit.client.0.smithi046.stdout:9/907: read - d11/d5b/d10c/f11b zero size 2024-09-21T12:47:25.519 INFO:tasks.workunit.client.0.smithi046.stdout:4/937: chown d1/d27/d46/d78/f131 247 1 2024-09-21T12:47:25.524 INFO:tasks.workunit.client.0.smithi046.stdout:7/846: creat d2/d4/df/d70/d88/d34/d7f/de3/f117 x:0 0 0 2024-09-21T12:47:25.525 INFO:tasks.workunit.client.0.smithi046.stdout:5/795: fsync d4/dc/d13/da2/dce/dfe/f70 0 2024-09-21T12:47:25.526 INFO:tasks.workunit.client.0.smithi046.stdout:4/938: dread d1/d27/d37/f49 [0,4194304] 0 2024-09-21T12:47:25.528 INFO:tasks.workunit.client.0.smithi046.stdout:5/796: truncate d4/d22/d10/faa 393501 0 2024-09-21T12:47:25.529 INFO:tasks.workunit.client.0.smithi046.stdout:3/633: mkdir d5/dc/d28/d63/de2 0 2024-09-21T12:47:25.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/908: mkdir d11/d19/d1b/d31/d53/d5e/d124 0 2024-09-21T12:47:25.541 INFO:tasks.workunit.client.0.smithi046.stdout:5/797: creat d4/d22/d10/d1a/d9e/da7/fff x:0 0 0 2024-09-21T12:47:25.542 INFO:tasks.workunit.client.0.smithi046.stdout:6/679: dwrite de/d2a/d4d/f7d [0,4194304] 0 2024-09-21T12:47:25.552 INFO:tasks.workunit.client.0.smithi046.stdout:4/939: write d1/d13/d4e/f91 [2400537,76266] 0 2024-09-21T12:47:25.556 INFO:tasks.workunit.client.0.smithi046.stdout:0/965: symlink d6/d7/d11c/l150 0 2024-09-21T12:47:25.561 INFO:tasks.workunit.client.0.smithi046.stdout:0/966: dread d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100/f121 [0,4194304] 0 2024-09-21T12:47:25.562 INFO:tasks.workunit.client.0.smithi046.stdout:9/909: dwrite d11/d19/d1b/d31/d53/d58/f62 [4194304,4194304] 0 2024-09-21T12:47:25.564 INFO:tasks.workunit.client.0.smithi046.stdout:7/847: truncate d2/d37/d8a/d99/fc0 96350 0 2024-09-21T12:47:25.565 INFO:tasks.workunit.client.0.smithi046.stdout:4/940: symlink d1/d13/d25/d29/d43/d84/l13b 0 2024-09-21T12:47:25.571 INFO:tasks.workunit.client.0.smithi046.stdout:4/941: dwrite d1/d27/d58/f4f [0,4194304] 0 2024-09-21T12:47:25.571 INFO:tasks.workunit.client.0.smithi046.stdout:3/634: creat d5/dc/d94/da6/fe3 x:0 0 0 2024-09-21T12:47:25.576 INFO:tasks.workunit.client.0.smithi046.stdout:6/680: rename de/c1a to de/d2a/d4c/d71/ce4 0 2024-09-21T12:47:25.577 INFO:tasks.workunit.client.0.smithi046.stdout:6/681: dread - de/d48/fe3 zero size 2024-09-21T12:47:25.579 INFO:tasks.workunit.client.0.smithi046.stdout:7/848: creat d2/d4/df/d42/dd1/f118 x:0 0 0 2024-09-21T12:47:25.584 INFO:tasks.workunit.client.0.smithi046.stdout:4/942: mkdir d1/d85/d13c 0 2024-09-21T12:47:25.592 INFO:tasks.workunit.client.0.smithi046.stdout:6/682: creat de/d48/fe5 x:0 0 0 2024-09-21T12:47:25.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/849: mknod d2/dd/c119 0 2024-09-21T12:47:25.596 INFO:tasks.workunit.client.0.smithi046.stdout:3/635: symlink d5/dc/d28/d63/de2/le4 0 2024-09-21T12:47:25.600 INFO:tasks.workunit.client.0.smithi046.stdout:9/910: dwrite d11/d19/d1b/d31/d53/d5e/fb8 [0,4194304] 0 2024-09-21T12:47:25.604 INFO:tasks.workunit.client.0.smithi046.stdout:3/636: rmdir d5/dc/d26 39 2024-09-21T12:47:25.605 INFO:tasks.workunit.client.0.smithi046.stdout:7/850: dread d2/d4/f8c [0,4194304] 0 2024-09-21T12:47:25.606 INFO:tasks.workunit.client.0.smithi046.stdout:4/943: dwrite d1/d13/d25/d29/f54 [0,4194304] 0 2024-09-21T12:47:25.609 INFO:tasks.workunit.client.0.smithi046.stdout:9/911: unlink d11/d19/d1b/d31/fd3 0 2024-09-21T12:47:25.609 INFO:tasks.workunit.client.0.smithi046.stdout:6/683: link de/f6c de/d2a/d34/fe6 0 2024-09-21T12:47:25.612 INFO:tasks.workunit.client.0.smithi046.stdout:4/944: symlink d1/d13/d4e/l13d 0 2024-09-21T12:47:25.612 INFO:tasks.workunit.client.0.smithi046.stdout:9/912: dread - d11/d19/d1b/fc1 zero size 2024-09-21T12:47:25.614 INFO:tasks.workunit.client.0.smithi046.stdout:3/637: mknod d5/dc/dd5/ce5 0 2024-09-21T12:47:25.615 INFO:tasks.workunit.client.0.smithi046.stdout:6/684: mkdir de/d2a/d4c/d77/d8f/d94/de7 0 2024-09-21T12:47:25.617 INFO:tasks.workunit.client.0.smithi046.stdout:3/638: dread d5/d5e/d8e/faf [0,4194304] 0 2024-09-21T12:47:25.618 INFO:tasks.workunit.client.0.smithi046.stdout:3/639: stat d5/d16/caa 0 2024-09-21T12:47:25.619 INFO:tasks.workunit.client.0.smithi046.stdout:7/851: rename d2/fea to d2/d4/df/d70/d88/d34/d7f/f11a 0 2024-09-21T12:47:25.620 INFO:tasks.workunit.client.0.smithi046.stdout:4/945: creat d1/d13/d25/d29/d43/d84/d120/f13e x:0 0 0 2024-09-21T12:47:25.621 INFO:tasks.workunit.client.0.smithi046.stdout:4/946: dread - d1/d27/d37/d66/dee/f130 zero size 2024-09-21T12:47:25.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/685: creat de/d2a/d4c/d77/dae/d55/fe8 x:0 0 0 2024-09-21T12:47:25.632 INFO:tasks.workunit.client.0.smithi046.stdout:4/947: mknod d1/d27/d37/d8f/c13f 0 2024-09-21T12:47:25.637 INFO:tasks.workunit.client.0.smithi046.stdout:3/640: getdents d5/dc/d94/da6 0 2024-09-21T12:47:25.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/913: write d11/d5b/fbe [417046,14397] 0 2024-09-21T12:47:25.638 INFO:tasks.workunit.client.0.smithi046.stdout:3/641: read d5/fa0 [116810,6231] 0 2024-09-21T12:47:25.646 INFO:tasks.workunit.client.0.smithi046.stdout:4/948: mkdir d1/d13/d25/d29/d33/d140 0 2024-09-21T12:47:25.653 INFO:tasks.workunit.client.0.smithi046.stdout:6/686: dwrite de/d2a/d4c/d71/d7c/f99 [0,4194304] 0 2024-09-21T12:47:25.654 INFO:tasks.workunit.client.0.smithi046.stdout:3/642: unlink d5/dc/d26/d3c/d44/l46 0 2024-09-21T12:47:25.656 INFO:tasks.workunit.client.0.smithi046.stdout:6/687: truncate de/d2a/d4c/d69/fc3 684992 0 2024-09-21T12:47:25.658 INFO:tasks.workunit.client.0.smithi046.stdout:4/949: getdents d1/d27/d82/df9 0 2024-09-21T12:47:25.663 INFO:tasks.workunit.client.0.smithi046.stdout:4/950: rename d1/d27/d46/d78/f98 to d1/dda/d134/f141 0 2024-09-21T12:47:25.667 INFO:tasks.workunit.client.0.smithi046.stdout:4/951: creat d1/d85/de6/df8/f142 x:0 0 0 2024-09-21T12:47:25.674 INFO:tasks.workunit.client.0.smithi046.stdout:4/952: creat d1/d13/d25/d29/d33/f143 x:0 0 0 2024-09-21T12:47:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:3/643: dread d5/f10 [0,4194304] 0 2024-09-21T12:47:25.676 INFO:tasks.workunit.client.0.smithi046.stdout:4/953: unlink d1/d27/d37/cfe 0 2024-09-21T12:47:25.677 INFO:tasks.workunit.client.0.smithi046.stdout:3/644: fsync d5/dc/d26/f78 0 2024-09-21T12:47:25.679 INFO:tasks.workunit.client.0.smithi046.stdout:4/954: read - d1/d13/d25/d29/d33/dca/fd4 zero size 2024-09-21T12:47:25.680 INFO:tasks.workunit.client.0.smithi046.stdout:3/645: creat d5/d5e/fe6 x:0 0 0 2024-09-21T12:47:25.685 INFO:tasks.workunit.client.0.smithi046.stdout:4/955: mknod d1/d27/c144 0 2024-09-21T12:47:25.687 INFO:tasks.workunit.client.0.smithi046.stdout:3/646: dwrite d5/d16/d5f/d6c/fc4 [0,4194304] 0 2024-09-21T12:47:25.689 INFO:tasks.workunit.client.0.smithi046.stdout:3/647: dread - d5/dc/d94/da6/fe3 zero size 2024-09-21T12:47:25.691 INFO:tasks.workunit.client.0.smithi046.stdout:4/956: read d1/d13/f81 [3735933,59149] 0 2024-09-21T12:47:25.692 INFO:tasks.workunit.client.0.smithi046.stdout:3/648: chown d5/dc/d26/d3c/d44/lc9 10334812 1 2024-09-21T12:47:25.697 INFO:tasks.workunit.client.0.smithi046.stdout:4/957: fsync d1/d13/d25/d29/d43/f6c 0 2024-09-21T12:47:25.703 INFO:tasks.workunit.client.0.smithi046.stdout:4/958: symlink d1/l145 0 2024-09-21T12:47:25.705 INFO:tasks.workunit.client.0.smithi046.stdout:4/959: chown d1/d85/lce 58 1 2024-09-21T12:47:25.707 INFO:tasks.workunit.client.0.smithi046.stdout:4/960: symlink d1/d27/d46/ddb/l146 0 2024-09-21T12:47:25.715 INFO:tasks.workunit.client.0.smithi046.stdout:4/961: dwrite d1/d27/d82/da8/fcf [0,4194304] 0 2024-09-21T12:47:25.718 INFO:tasks.workunit.client.0.smithi046.stdout:3/649: dread d5/dc/d28/d60/fae [0,4194304] 0 2024-09-21T12:47:25.719 INFO:tasks.workunit.client.0.smithi046.stdout:4/962: symlink d1/d5f/l147 0 2024-09-21T12:47:25.729 INFO:tasks.workunit.client.0.smithi046.stdout:4/963: dwrite d1/dda/d134/f141 [4194304,4194304] 0 2024-09-21T12:47:25.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/650: dread d5/dc/f1d [0,4194304] 0 2024-09-21T12:47:25.752 INFO:tasks.workunit.client.0.smithi046.stdout:3/651: chown d5/dc/d30/d34/dd1/f7a 21976 1 2024-09-21T12:47:25.759 INFO:tasks.workunit.client.0.smithi046.stdout:4/964: dread d1/dda/d134/f141 [0,4194304] 0 2024-09-21T12:47:25.762 INFO:tasks.workunit.client.0.smithi046.stdout:4/965: unlink d1/d27/d46/d78/lab 0 2024-09-21T12:47:25.765 INFO:tasks.workunit.client.0.smithi046.stdout:3/652: dread d5/dc/fe [0,4194304] 0 2024-09-21T12:47:25.765 INFO:tasks.workunit.client.0.smithi046.stdout:4/966: mkdir d1/d13/d148 0 2024-09-21T12:47:25.768 INFO:tasks.workunit.client.0.smithi046.stdout:3/653: creat d5/dc/d30/d34/dd1/fe7 x:0 0 0 2024-09-21T12:47:25.768 INFO:tasks.workunit.client.0.smithi046.stdout:4/967: truncate d1/d13/d8b/f112 663821 0 2024-09-21T12:47:25.771 INFO:tasks.workunit.client.0.smithi046.stdout:3/654: mkdir d5/d5e/d8e/de8 0 2024-09-21T12:47:25.772 INFO:tasks.workunit.client.0.smithi046.stdout:4/968: creat d1/d13/d25/d3a/d92/f149 x:0 0 0 2024-09-21T12:47:25.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/655: rmdir d5/dc/d30/d7c 39 2024-09-21T12:47:25.777 INFO:tasks.workunit.client.0.smithi046.stdout:3/656: rename d5/fe0 to d5/dc/dd5/fe9 0 2024-09-21T12:47:25.779 INFO:tasks.workunit.client.0.smithi046.stdout:3/657: write d5/dc/d30/d34/f8c [3764848,7765] 0 2024-09-21T12:47:25.790 INFO:tasks.workunit.client.0.smithi046.stdout:3/658: fdatasync d5/dc/d30/fb6 0 2024-09-21T12:47:25.797 INFO:tasks.workunit.client.0.smithi046.stdout:4/969: truncate d1/d27/d37/d8f/fad 2372664 0 2024-09-21T12:47:25.801 INFO:tasks.workunit.client.0.smithi046.stdout:4/970: rename d1/d13/d25/d29/d43/d84/d120 to d1/dda/d14a 0 2024-09-21T12:47:25.804 INFO:tasks.workunit.client.0.smithi046.stdout:4/971: symlink d1/d27/d46/d78/l14b 0 2024-09-21T12:47:25.805 INFO:tasks.workunit.client.0.smithi046.stdout:8/902: sync 2024-09-21T12:47:25.807 INFO:tasks.workunit.client.0.smithi046.stdout:3/659: write d5/f6b [245546,101541] 0 2024-09-21T12:47:25.813 INFO:tasks.workunit.client.0.smithi046.stdout:8/903: dwrite d1/d12/d1a/d33/fe2 [0,4194304] 0 2024-09-21T12:47:25.816 INFO:tasks.workunit.client.0.smithi046.stdout:3/660: write d5/dc/d26/d3c/d44/f4b [4027462,40171] 0 2024-09-21T12:47:25.822 INFO:tasks.workunit.client.0.smithi046.stdout:4/972: dwrite d1/d13/f16 [0,4194304] 0 2024-09-21T12:47:25.835 INFO:tasks.workunit.client.0.smithi046.stdout:3/661: write d5/dc/d28/d60/f73 [497644,71292] 0 2024-09-21T12:47:25.838 INFO:tasks.workunit.client.0.smithi046.stdout:3/662: truncate d5/d5e/d8e/fd7 820836 0 2024-09-21T12:47:25.838 INFO:tasks.workunit.client.0.smithi046.stdout:4/973: creat d1/d27/d37/f14c x:0 0 0 2024-09-21T12:47:25.842 INFO:tasks.workunit.client.0.smithi046.stdout:4/974: unlink d1/d27/d37/f49 0 2024-09-21T12:47:25.844 INFO:tasks.workunit.client.0.smithi046.stdout:4/975: mkdir d1/dda/d14d 0 2024-09-21T12:47:25.848 INFO:tasks.workunit.client.0.smithi046.stdout:3/663: write d5/f10 [479395,40726] 0 2024-09-21T12:47:25.850 INFO:tasks.workunit.client.0.smithi046.stdout:8/904: dread d1/fd [0,4194304] 0 2024-09-21T12:47:25.851 INFO:tasks.workunit.client.0.smithi046.stdout:8/905: write d1/d12/d46/d35/d5b/fdd [497449,72150] 0 2024-09-21T12:47:25.853 INFO:tasks.workunit.client.0.smithi046.stdout:3/664: mknod d5/d16/d5f/cea 0 2024-09-21T12:47:25.854 INFO:tasks.workunit.client.0.smithi046.stdout:3/665: chown d5/dc/d26/d3c/d44/c5c 3 1 2024-09-21T12:47:25.856 INFO:tasks.workunit.client.0.smithi046.stdout:3/666: truncate d5/dc/d26/f4c 1571377 0 2024-09-21T12:47:25.856 INFO:tasks.workunit.client.0.smithi046.stdout:8/906: dread - d1/d12/d53/dab/ff2 zero size 2024-09-21T12:47:25.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/667: dwrite d5/d5e/d8e/f9c [0,4194304] 0 2024-09-21T12:47:25.864 INFO:tasks.workunit.client.0.smithi046.stdout:3/668: dread - d5/dc/d30/fce zero size 2024-09-21T12:47:25.867 INFO:tasks.workunit.client.0.smithi046.stdout:4/976: truncate d1/d13/d25/d29/d43/d84/f126 1067083 0 2024-09-21T12:47:25.868 INFO:tasks.workunit.client.0.smithi046.stdout:8/907: dread d1/d12/d46/d35/d36/d51/d8c/fa3 [0,4194304] 0 2024-09-21T12:47:25.871 INFO:tasks.workunit.client.0.smithi046.stdout:4/977: fsync d1/d13/d25/d29/d33/f62 0 2024-09-21T12:47:25.873 INFO:tasks.workunit.client.0.smithi046.stdout:8/908: creat d1/d12/d46/d35/d36/d51/f13b x:0 0 0 2024-09-21T12:47:25.874 INFO:tasks.workunit.client.0.smithi046.stdout:3/669: getdents d5/dc/d94/dd6 0 2024-09-21T12:47:25.879 INFO:tasks.workunit.client.0.smithi046.stdout:3/670: unlink d5/lbf 0 2024-09-21T12:47:25.880 INFO:tasks.workunit.client.0.smithi046.stdout:3/671: chown d5/d5e/d8e/db5 39 1 2024-09-21T12:47:25.880 INFO:tasks.workunit.client.0.smithi046.stdout:4/978: dwrite d1/d13/d25/d29/f42 [0,4194304] 0 2024-09-21T12:47:25.891 INFO:tasks.workunit.client.0.smithi046.stdout:4/979: dread d1/d13/d25/d29/d43/f7a [0,4194304] 0 2024-09-21T12:47:25.896 INFO:tasks.workunit.client.0.smithi046.stdout:2/787: sync 2024-09-21T12:47:25.897 INFO:tasks.workunit.client.0.smithi046.stdout:8/909: creat d1/d12/d53/d12d/f13c x:0 0 0 2024-09-21T12:47:25.898 INFO:tasks.workunit.client.0.smithi046.stdout:2/788: fsync d16/d22/d2b/d30/d8f/f9c 0 2024-09-21T12:47:25.900 INFO:tasks.workunit.client.0.smithi046.stdout:3/672: rmdir d5/dc/d94/da6 39 2024-09-21T12:47:25.901 INFO:tasks.workunit.client.0.smithi046.stdout:3/673: stat d5/dc/d30/d34/f61 0 2024-09-21T12:47:25.902 INFO:tasks.workunit.client.0.smithi046.stdout:3/674: chown d5/dc/d28/f7f 7655 1 2024-09-21T12:47:25.904 INFO:tasks.workunit.client.0.smithi046.stdout:4/980: stat d1/d13/c51 0 2024-09-21T12:47:25.908 INFO:tasks.workunit.client.0.smithi046.stdout:8/910: unlink d1/d12/d46/d35/d5b/f101 0 2024-09-21T12:47:25.909 INFO:tasks.workunit.client.0.smithi046.stdout:2/789: creat d16/d22/d75/f10a x:0 0 0 2024-09-21T12:47:25.911 INFO:tasks.workunit.client.0.smithi046.stdout:2/790: rename d16 to d16/d5c/d63/db4/dd4/ddb/d10b 22 2024-09-21T12:47:25.914 INFO:tasks.workunit.client.0.smithi046.stdout:3/675: creat d5/d5e/d8e/db5/feb x:0 0 0 2024-09-21T12:47:25.915 INFO:tasks.workunit.client.0.smithi046.stdout:4/981: creat d1/d27/d37/d66/f14e x:0 0 0 2024-09-21T12:47:25.917 INFO:tasks.workunit.client.0.smithi046.stdout:4/982: stat d1/d13/d25/d29/d43/f6c 0 2024-09-21T12:47:25.918 INFO:tasks.workunit.client.0.smithi046.stdout:8/911: mkdir d1/d12/d46/d107/d13d 0 2024-09-21T12:47:25.918 INFO:tasks.workunit.client.0.smithi046.stdout:4/983: fdatasync d1/d27/d46/d78/fa4 0 2024-09-21T12:47:25.919 INFO:tasks.workunit.client.0.smithi046.stdout:2/791: symlink d16/d22/d75/ded/l10c 0 2024-09-21T12:47:25.921 INFO:tasks.workunit.client.0.smithi046.stdout:2/792: chown d16/d22/d4e/l62 177 1 2024-09-21T12:47:25.928 INFO:tasks.workunit.client.0.smithi046.stdout:3/676: dwrite d5/dc/d28/f33 [4194304,4194304] 0 2024-09-21T12:47:25.929 INFO:tasks.workunit.client.0.smithi046.stdout:3/677: chown d5/f85 8960 1 2024-09-21T12:47:25.933 INFO:tasks.workunit.client.0.smithi046.stdout:3/678: symlink d5/dc/d26/d3c/lec 0 2024-09-21T12:47:25.934 INFO:tasks.workunit.client.0.smithi046.stdout:3/679: read d5/d5e/d8e/f9c [3637257,36649] 0 2024-09-21T12:47:25.935 INFO:tasks.workunit.client.0.smithi046.stdout:2/793: creat d16/d5c/d63/db4/f10d x:0 0 0 2024-09-21T12:47:25.940 INFO:tasks.workunit.client.0.smithi046.stdout:8/912: rename d1/d12/d46/d35/d36/d86/cc2 to d1/d12/d53/d80/c13e 0 2024-09-21T12:47:25.942 INFO:tasks.workunit.client.0.smithi046.stdout:8/913: read - d1/d12/d53/d60/f109 zero size 2024-09-21T12:47:25.944 INFO:tasks.workunit.client.0.smithi046.stdout:3/680: dwrite d5/dc/d26/f4c [0,4194304] 0 2024-09-21T12:47:25.948 INFO:tasks.workunit.client.0.smithi046.stdout:8/914: creat d1/d127/f13f x:0 0 0 2024-09-21T12:47:25.957 INFO:tasks.workunit.client.0.smithi046.stdout:8/915: dwrite d1/d12/d46/d35/d36/d51/ff8 [0,4194304] 0 2024-09-21T12:47:25.961 INFO:tasks.workunit.client.0.smithi046.stdout:8/916: truncate d1/d12/f2a 1731815 0 2024-09-21T12:47:25.966 INFO:tasks.workunit.client.0.smithi046.stdout:4/984: write d1/d13/d25/d29/d33/f12a [38161,121605] 0 2024-09-21T12:47:25.972 INFO:tasks.workunit.client.0.smithi046.stdout:4/985: symlink d1/d27/d37/d66/l14f 0 2024-09-21T12:47:25.973 INFO:tasks.workunit.client.0.smithi046.stdout:4/986: read - d1/d13/d25/d29/d33/dca/fd4 zero size 2024-09-21T12:47:25.979 INFO:tasks.workunit.client.0.smithi046.stdout:3/681: write d5/d16/d5f/f8b [344057,97220] 0 2024-09-21T12:47:25.982 INFO:tasks.workunit.client.0.smithi046.stdout:3/682: fdatasync d5/dc/d30/d34/f8c 0 2024-09-21T12:47:25.985 INFO:tasks.workunit.client.0.smithi046.stdout:4/987: dwrite d1/d27/d37/fd9 [0,4194304] 0 2024-09-21T12:47:25.986 INFO:tasks.workunit.client.0.smithi046.stdout:8/917: write d1/d12/d53/dab/ff2 [760773,114106] 0 2024-09-21T12:47:25.986 INFO:tasks.workunit.client.0.smithi046.stdout:2/794: dwrite fc [4194304,4194304] 0 2024-09-21T12:47:25.987 INFO:tasks.workunit.client.0.smithi046.stdout:3/683: creat d5/d16/d5f/d6c/fed x:0 0 0 2024-09-21T12:47:25.993 INFO:tasks.workunit.client.0.smithi046.stdout:3/684: fsync d5/dc/d28/d60/fae 0 2024-09-21T12:47:25.995 INFO:tasks.workunit.client.0.smithi046.stdout:4/988: symlink d1/d27/d46/ddb/l150 0 2024-09-21T12:47:25.999 INFO:tasks.workunit.client.0.smithi046.stdout:8/918: mknod d1/d12/d46/c140 0 2024-09-21T12:47:26.002 INFO:tasks.workunit.client.0.smithi046.stdout:3/685: unlink d5/dc/d26/d3c/fb1 0 2024-09-21T12:47:26.004 INFO:tasks.workunit.client.0.smithi046.stdout:4/989: chown d1/d27/d37/d8f/ddf/cc1 0 1 2024-09-21T12:47:26.012 INFO:tasks.workunit.client.0.smithi046.stdout:4/990: mknod d1/d27/d82/c151 0 2024-09-21T12:47:26.013 INFO:tasks.workunit.client.0.smithi046.stdout:2/795: link d16/d22/d75/ded/l102 d16/d22/d2b/l10e 0 2024-09-21T12:47:26.014 INFO:tasks.workunit.client.0.smithi046.stdout:2/796: stat d16/d22/d2b/d30/d67/fa9 0 2024-09-21T12:47:26.014 INFO:tasks.workunit.client.0.smithi046.stdout:8/919: symlink d1/d12/d46/d35/d36/dc6/l141 0 2024-09-21T12:47:26.014 INFO:tasks.workunit.client.0.smithi046.stdout:4/991: write d1/d27/d82/fd7 [1107520,45556] 0 2024-09-21T12:47:26.021 INFO:tasks.workunit.client.0.smithi046.stdout:2/797: dwrite d16/d22/d2b/f83 [0,4194304] 0 2024-09-21T12:47:26.026 INFO:tasks.workunit.client.0.smithi046.stdout:4/992: unlink d1/d27/d82/da8/l104 0 2024-09-21T12:47:26.030 INFO:tasks.workunit.client.0.smithi046.stdout:8/920: rename d1/d12/d53/d60/fbb to d1/d12/d46/d35/d36/d51/d8c/f142 0 2024-09-21T12:47:26.034 INFO:tasks.workunit.client.0.smithi046.stdout:3/686: dwrite d5/dc/d30/fb6 [0,4194304] 0 2024-09-21T12:47:26.035 INFO:tasks.workunit.client.0.smithi046.stdout:2/798: creat d16/d22/d4e/d90/dc6/df0/f10f x:0 0 0 2024-09-21T12:47:26.036 INFO:tasks.workunit.client.0.smithi046.stdout:3/687: write d5/d16/d5f/f8b [1348695,13180] 0 2024-09-21T12:47:26.038 INFO:tasks.workunit.client.0.smithi046.stdout:8/921: unlink d1/f20 0 2024-09-21T12:47:26.038 INFO:tasks.workunit.client.0.smithi046.stdout:3/688: chown d5/dc/f1d 675 1 2024-09-21T12:47:26.042 INFO:tasks.workunit.client.0.smithi046.stdout:2/799: truncate d16/d22/d2b/d43/f6d 293137 0 2024-09-21T12:47:26.042 INFO:tasks.workunit.client.0.smithi046.stdout:2/800: dread - d16/f8d zero size 2024-09-21T12:47:26.044 INFO:tasks.workunit.client.0.smithi046.stdout:8/922: symlink d1/d12/d53/d80/da1/l143 0 2024-09-21T12:47:26.046 INFO:tasks.workunit.client.0.smithi046.stdout:8/923: chown d1/d12/d46/d35/d5b/dd6/d113/f11f 914323 1 2024-09-21T12:47:26.051 INFO:tasks.workunit.client.0.smithi046.stdout:2/801: dread d16/d5c/d63/db4/dca/fe2 [0,4194304] 0 2024-09-21T12:47:26.055 INFO:tasks.workunit.client.0.smithi046.stdout:8/924: truncate d1/d12/d46/d35/d36/d51/d8c/f142 2831391 0 2024-09-21T12:47:26.058 INFO:tasks.workunit.client.0.smithi046.stdout:2/802: dwrite d16/d22/f97 [4194304,4194304] 0 2024-09-21T12:47:26.059 INFO:tasks.workunit.client.0.smithi046.stdout:4/993: dread d1/d27/d46/d78/fa4 [0,4194304] 0 2024-09-21T12:47:26.061 INFO:tasks.workunit.client.0.smithi046.stdout:8/925: write d1/d12/d46/d35/d5b/dd6/d113/fda [193729,89095] 0 2024-09-21T12:47:26.063 INFO:tasks.workunit.client.0.smithi046.stdout:4/994: fsync d1/d27/d37/d66/fa0 0 2024-09-21T12:47:26.063 INFO:tasks.workunit.client.0.smithi046.stdout:4/995: stat d1/d27/d58/f4f 0 2024-09-21T12:47:26.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/689: dwrite d5/f7 [0,4194304] 0 2024-09-21T12:47:26.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/690: read d5/dc/f1d [6675296,87712] 0 2024-09-21T12:47:26.073 INFO:tasks.workunit.client.0.smithi046.stdout:2/803: dread d16/d22/d38/f35 [0,4194304] 0 2024-09-21T12:47:26.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/804: chown d16/d22/d38/f42 36 1 2024-09-21T12:47:26.076 INFO:tasks.workunit.client.0.smithi046.stdout:3/691: unlink d5/dc/d26/fca 0 2024-09-21T12:47:26.077 INFO:tasks.workunit.client.0.smithi046.stdout:2/805: dread - d16/d22/d2b/d30/d67/fd6 zero size 2024-09-21T12:47:26.077 INFO:tasks.workunit.client.0.smithi046.stdout:3/692: stat d5/d5e/la7 0 2024-09-21T12:47:26.079 INFO:tasks.workunit.client.0.smithi046.stdout:2/806: fsync d16/d22/d38/d77/d9e/fbe 0 2024-09-21T12:47:26.084 INFO:tasks.workunit.client.0.smithi046.stdout:2/807: creat d16/d22/d38/d77/d9e/f110 x:0 0 0 2024-09-21T12:47:26.087 INFO:tasks.workunit.client.0.smithi046.stdout:8/926: write d1/d12/d46/d35/d36/d51/f89 [414488,34318] 0 2024-09-21T12:47:26.089 INFO:tasks.workunit.client.0.smithi046.stdout:2/808: truncate d16/d5c/d63/f6b 1028084 0 2024-09-21T12:47:26.099 INFO:tasks.workunit.client.0.smithi046.stdout:3/693: dread d5/dc/d28/d60/f73 [0,4194304] 0 2024-09-21T12:47:26.107 INFO:tasks.workunit.client.0.smithi046.stdout:3/694: dread d5/dc/d26/d3c/fbc [0,4194304] 0 2024-09-21T12:47:26.108 INFO:tasks.workunit.client.0.smithi046.stdout:3/695: chown d5/dc/dd5 0 1 2024-09-21T12:47:26.119 INFO:tasks.workunit.client.0.smithi046.stdout:3/696: dread d5/dc/d28/f2c [0,4194304] 0 2024-09-21T12:47:26.124 INFO:tasks.workunit.client.0.smithi046.stdout:2/809: truncate d16/d22/d2b/d30/d67/fab 1132055 0 2024-09-21T12:47:26.127 INFO:tasks.workunit.client.0.smithi046.stdout:3/697: fsync d5/dc/d30/d34/dd1/f74 0 2024-09-21T12:47:26.129 INFO:tasks.workunit.client.0.smithi046.stdout:8/927: dwrite d1/fd [0,4194304] 0 2024-09-21T12:47:26.130 INFO:tasks.workunit.client.0.smithi046.stdout:2/810: read f15 [554071,56917] 0 2024-09-21T12:47:26.131 INFO:tasks.workunit.client.0.smithi046.stdout:8/928: chown d1/d12/d46/d35/d36/d51/l84 323 1 2024-09-21T12:47:26.133 INFO:tasks.workunit.client.0.smithi046.stdout:3/698: mknod d5/dc/d30/d7c/cee 0 2024-09-21T12:47:26.135 INFO:tasks.workunit.client.0.smithi046.stdout:8/929: mknod d1/d12/d46/d35/d36/dc6/c144 0 2024-09-21T12:47:26.137 INFO:tasks.workunit.client.0.smithi046.stdout:8/930: chown d1/d12/d53/d80/lca 0 1 2024-09-21T12:47:26.141 INFO:tasks.workunit.client.0.smithi046.stdout:2/811: rename d16/d22/d2b/d43/ca7 to d16/d5c/d63/db4/c111 0 2024-09-21T12:47:26.141 INFO:tasks.workunit.client.0.smithi046.stdout:2/812: readlink d16/d22/d4e/l5b 0 2024-09-21T12:47:26.143 INFO:tasks.workunit.client.0.smithi046.stdout:2/813: write d16/d22/d2b/d30/d67/f72 [1876133,73932] 0 2024-09-21T12:47:26.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/814: creat d16/d5c/d63/db4/dd4/f112 x:0 0 0 2024-09-21T12:47:26.149 INFO:tasks.workunit.client.0.smithi046.stdout:2/815: stat d16/d22/d4e/d9d/cf3 0 2024-09-21T12:47:26.151 INFO:tasks.workunit.client.0.smithi046.stdout:3/699: getdents d5 0 2024-09-21T12:47:26.152 INFO:tasks.workunit.client.0.smithi046.stdout:2/816: fsync d16/d22/d2b/d43/faf 0 2024-09-21T12:47:26.153 INFO:tasks.workunit.client.0.smithi046.stdout:2/817: dread - d16/d22/d4e/f108 zero size 2024-09-21T12:47:26.155 INFO:tasks.workunit.client.0.smithi046.stdout:3/700: unlink d5/d16/d5f/d6c/cb7 0 2024-09-21T12:47:26.157 INFO:tasks.workunit.client.0.smithi046.stdout:3/701: write d5/dc/d26/d3c/d44/f5d [1766096,57072] 0 2024-09-21T12:47:26.160 INFO:tasks.workunit.client.0.smithi046.stdout:3/702: creat d5/d16/d5f/dad/fef x:0 0 0 2024-09-21T12:47:26.164 INFO:tasks.workunit.client.0.smithi046.stdout:3/703: getdents d5/dc/dd5 0 2024-09-21T12:47:26.165 INFO:tasks.workunit.client.0.smithi046.stdout:3/704: write d5/d16/d5f/fa2 [2861460,100061] 0 2024-09-21T12:47:26.169 INFO:tasks.workunit.client.0.smithi046.stdout:3/705: creat d5/dc/d26/d3c/ff0 x:0 0 0 2024-09-21T12:47:26.170 INFO:tasks.workunit.client.0.smithi046.stdout:3/706: chown d5/d16/d5f/d6c/c90 6343607 1 2024-09-21T12:47:26.172 INFO:tasks.workunit.client.0.smithi046.stdout:8/931: write d1/d12/d46/d35/d36/f99 [612707,44623] 0 2024-09-21T12:47:26.173 INFO:tasks.workunit.client.0.smithi046.stdout:3/707: symlink d5/d5e/d8e/db5/lf1 0 2024-09-21T12:47:26.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/932: chown d1/d12/d53/d80/da1 3124 1 2024-09-21T12:47:26.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/708: dread d5/f7 [0,4194304] 0 2024-09-21T12:47:26.176 INFO:tasks.workunit.client.0.smithi046.stdout:8/933: symlink d1/d12/d53/dab/l145 0 2024-09-21T12:47:26.177 INFO:tasks.workunit.client.0.smithi046.stdout:2/818: write f15 [1669058,79675] 0 2024-09-21T12:47:26.181 INFO:tasks.workunit.client.0.smithi046.stdout:8/934: dread d1/f11 [0,4194304] 0 2024-09-21T12:47:26.182 INFO:tasks.workunit.client.0.smithi046.stdout:8/935: chown d1/d12/c2b 92328 1 2024-09-21T12:47:26.183 INFO:tasks.workunit.client.0.smithi046.stdout:8/936: write d1/d12/d1a/d33/f4c [1004575,111076] 0 2024-09-21T12:47:26.185 INFO:tasks.workunit.client.0.smithi046.stdout:8/937: fdatasync d1/d12/d46/d35/d5b/fdd 0 2024-09-21T12:47:26.189 INFO:tasks.workunit.client.0.smithi046.stdout:3/709: dwrite d5/dc/d28/d60/f73 [0,4194304] 0 2024-09-21T12:47:26.191 INFO:tasks.workunit.client.0.smithi046.stdout:2/819: unlink d16/d22/d2b/d43/f6d 0 2024-09-21T12:47:26.192 INFO:tasks.workunit.client.0.smithi046.stdout:8/938: rmdir d1/d12/d46/d35/d79 39 2024-09-21T12:47:26.194 INFO:tasks.workunit.client.0.smithi046.stdout:3/710: fdatasync d5/dc/fe 0 2024-09-21T12:47:26.198 INFO:tasks.workunit.client.0.smithi046.stdout:8/939: creat d1/d12/d46/d35/d5b/dd6/d113/f146 x:0 0 0 2024-09-21T12:47:26.202 INFO:tasks.workunit.client.0.smithi046.stdout:3/711: rename d5/dc/d26 to d5/d16/d5f/df2 0 2024-09-21T12:47:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:3/712: creat d5/dc/d94/dd6/ff3 x:0 0 0 2024-09-21T12:47:26.208 INFO:tasks.workunit.client.0.smithi046.stdout:2/820: dread d16/d22/d38/d77/f89 [0,4194304] 0 2024-09-21T12:47:26.209 INFO:tasks.workunit.client.0.smithi046.stdout:8/940: creat d1/d12/f147 x:0 0 0 2024-09-21T12:47:26.210 INFO:tasks.workunit.client.0.smithi046.stdout:8/941: chown d1/d12/d53/d80/c11b 4 1 2024-09-21T12:47:26.211 INFO:tasks.workunit.client.0.smithi046.stdout:3/713: unlink d5/c5b 0 2024-09-21T12:47:26.213 INFO:tasks.workunit.client.0.smithi046.stdout:8/942: rename d1/d12/d53/f132 to d1/f148 0 2024-09-21T12:47:26.215 INFO:tasks.workunit.client.0.smithi046.stdout:2/821: dwrite d16/d22/d38/f35 [0,4194304] 0 2024-09-21T12:47:26.218 INFO:tasks.workunit.client.0.smithi046.stdout:2/822: chown d16/d22/d38/d77/d9e/lce 977 1 2024-09-21T12:47:26.221 INFO:tasks.workunit.client.0.smithi046.stdout:8/943: dwrite d1/d12/d46/d35/fcf [0,4194304] 0 2024-09-21T12:47:26.223 INFO:tasks.workunit.client.0.smithi046.stdout:2/823: symlink d16/d22/d4e/d90/dc6/df0/l113 0 2024-09-21T12:47:26.223 INFO:tasks.workunit.client.0.smithi046.stdout:8/944: dread - d1/d12/d46/d35/d5b/f112 zero size 2024-09-21T12:47:26.230 INFO:tasks.workunit.client.0.smithi046.stdout:2/824: symlink d16/d22/d2b/d30/d67/l114 0 2024-09-21T12:47:26.233 INFO:tasks.workunit.client.0.smithi046.stdout:2/825: write d16/d22/d4e/d90/dc6/fd0 [460859,108248] 0 2024-09-21T12:47:26.233 INFO:tasks.workunit.client.0.smithi046.stdout:8/945: chown d1/d12/d46/d35/d79/ce4 1 1 2024-09-21T12:47:26.236 INFO:tasks.workunit.client.0.smithi046.stdout:3/714: unlink d5/d5e/d8e/db5/lf1 0 2024-09-21T12:47:26.237 INFO:tasks.workunit.client.0.smithi046.stdout:2/826: creat d16/d22/d38/dac/f115 x:0 0 0 2024-09-21T12:47:26.239 INFO:tasks.workunit.client.0.smithi046.stdout:2/827: truncate d16/d22/d38/d77/d9e/fcc 4236863 0 2024-09-21T12:47:26.240 INFO:tasks.workunit.client.0.smithi046.stdout:3/715: chown d5/dc/d94/ca4 7 1 2024-09-21T12:47:26.241 INFO:tasks.workunit.client.0.smithi046.stdout:8/946: creat d1/d12/d46/f149 x:0 0 0 2024-09-21T12:47:26.242 INFO:tasks.workunit.client.0.smithi046.stdout:3/716: truncate d5/dc/d30/fce 307298 0 2024-09-21T12:47:26.242 INFO:tasks.workunit.client.0.smithi046.stdout:8/947: fdatasync d1/d12/d53/d80/ffc 0 2024-09-21T12:47:26.245 INFO:tasks.workunit.client.0.smithi046.stdout:2/828: rename d16/d22/d2b/d30/d67 to d16/d5c/d63/db4/dca/d116 0 2024-09-21T12:47:26.250 INFO:tasks.workunit.client.0.smithi046.stdout:8/948: symlink d1/d12/d46/d35/d36/dce/d123/l14a 0 2024-09-21T12:47:26.251 INFO:tasks.workunit.client.0.smithi046.stdout:3/717: rename d5/d16/d5f/df2/d3c/l9f to d5/d16/d5f/df2/d3c/d44/lf4 0 2024-09-21T12:47:26.253 INFO:tasks.workunit.client.0.smithi046.stdout:8/949: creat d1/d127/d128/f14b x:0 0 0 2024-09-21T12:47:26.254 INFO:tasks.workunit.client.0.smithi046.stdout:3/718: mknod d5/d5e/d8e/cf5 0 2024-09-21T12:47:26.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/829: getdents d16/d5c 0 2024-09-21T12:47:26.262 INFO:tasks.workunit.client.0.smithi046.stdout:2/830: unlink d16/d22/d2b/d43/l44 0 2024-09-21T12:47:26.265 INFO:tasks.workunit.client.0.smithi046.stdout:3/719: getdents d5/dc 0 2024-09-21T12:47:26.270 INFO:tasks.workunit.client.0.smithi046.stdout:3/720: fsync d5/d5e/d8e/faf 0 2024-09-21T12:47:26.274 INFO:tasks.workunit.client.0.smithi046.stdout:8/950: dwrite d1/d12/d46/f37 [0,4194304] 0 2024-09-21T12:47:26.274 INFO:tasks.workunit.client.0.smithi046.stdout:2/831: dwrite d16/d5c/d63/db4/dca/d116/fd6 [0,4194304] 0 2024-09-21T12:47:26.283 INFO:tasks.workunit.client.0.smithi046.stdout:2/832: write d16/d22/d2b/d43/faf [923967,65565] 0 2024-09-21T12:47:26.283 INFO:tasks.workunit.client.0.smithi046.stdout:8/951: rename d1/fd to d1/d12/d53/f14c 0 2024-09-21T12:47:26.287 INFO:tasks.workunit.client.0.smithi046.stdout:3/721: dread f2 [0,4194304] 0 2024-09-21T12:47:26.288 INFO:tasks.workunit.client.0.smithi046.stdout:2/833: mkdir d16/d22/d2b/d30/df5/d117 0 2024-09-21T12:47:26.305 INFO:tasks.workunit.client.0.smithi046.stdout:8/952: dwrite d1/d12/d53/f98 [4194304,4194304] 0 2024-09-21T12:47:26.308 INFO:tasks.workunit.client.0.smithi046.stdout:8/953: mkdir d1/d12/d46/d108/d14d 0 2024-09-21T12:47:26.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:25 smithi176 ceph-mon[35476]: pgmap v39: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 77 MiB/s rd, 184 MiB/s wr, 470 op/s 2024-09-21T12:47:26.358 INFO:tasks.workunit.client.0.smithi046.stdout:1/766: sync 2024-09-21T12:47:26.368 INFO:tasks.workunit.client.0.smithi046.stdout:8/954: dwrite d1/d12/d46/d35/d36/d51/d8c/f10a [0,4194304] 0 2024-09-21T12:47:26.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/767: dwrite d4/d29/d32/d9e/d5d/d8c/d92/fdf [0,4194304] 0 2024-09-21T12:47:26.372 INFO:tasks.workunit.client.0.smithi046.stdout:8/955: write d1/d127/f13f [275681,111873] 0 2024-09-21T12:47:26.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/768: symlink d4/d4d/lfc 0 2024-09-21T12:47:26.377 INFO:tasks.workunit.client.0.smithi046.stdout:8/956: truncate d1/d12/d46/d35/f8b 632266 0 2024-09-21T12:47:26.380 INFO:tasks.workunit.client.0.smithi046.stdout:8/957: fsync d1/d127/d128/f14b 0 2024-09-21T12:47:26.382 INFO:tasks.workunit.client.0.smithi046.stdout:1/769: truncate d4/d13/f1d 3265645 0 2024-09-21T12:47:26.386 INFO:tasks.workunit.client.0.smithi046.stdout:8/958: mkdir d1/d12/d46/d35/d5b/dd6/d113/d14e 0 2024-09-21T12:47:26.387 INFO:tasks.workunit.client.0.smithi046.stdout:2/834: dread d16/d22/d38/d77/d9e/fcc [0,4194304] 0 2024-09-21T12:47:26.390 INFO:tasks.workunit.client.0.smithi046.stdout:8/959: chown d1/f11 12239 1 2024-09-21T12:47:26.391 INFO:tasks.workunit.client.0.smithi046.stdout:2/835: write d16/d22/d2b/d30/d8f/f101 [846279,46152] 0 2024-09-21T12:47:26.392 INFO:tasks.workunit.client.0.smithi046.stdout:1/770: unlink d4/f2c 0 2024-09-21T12:47:26.392 INFO:tasks.workunit.client.0.smithi046.stdout:2/836: fdatasync d16/d22/d38/d77/d9e/f110 0 2024-09-21T12:47:26.394 INFO:tasks.workunit.client.0.smithi046.stdout:8/960: truncate d1/d12/d1a/d33/d6c/d12a/f139 2219 0 2024-09-21T12:47:26.396 INFO:tasks.workunit.client.0.smithi046.stdout:2/837: mkdir d16/d22/d38/d118 0 2024-09-21T12:47:26.397 INFO:tasks.workunit.client.0.smithi046.stdout:8/961: dread - d1/d12/d53/ffe zero size 2024-09-21T12:47:26.401 INFO:tasks.workunit.client.0.smithi046.stdout:1/771: creat d4/d13/d38/d53/ffd x:0 0 0 2024-09-21T12:47:26.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/838: symlink d16/d5c/d63/db4/dca/l119 0 2024-09-21T12:47:26.402 INFO:tasks.workunit.client.0.smithi046.stdout:2/839: readlink d16/d22/d2b/d43/l105 0 2024-09-21T12:47:26.405 INFO:tasks.workunit.client.0.smithi046.stdout:8/962: read d1/d12/d1a/f2c [3618797,27321] 0 2024-09-21T12:47:26.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/840: read d16/d5c/d63/f6b [254243,31522] 0 2024-09-21T12:47:26.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/841: write d16/d22/d38/d77/d7a/f98 [2846354,72534] 0 2024-09-21T12:47:26.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:25 smithi046 ceph-mon[27868]: pgmap v39: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 77 MiB/s rd, 184 MiB/s wr, 470 op/s 2024-09-21T12:47:26.412 INFO:tasks.workunit.client.0.smithi046.stdout:2/842: truncate d16/d22/d38/dac/fc9 267748 0 2024-09-21T12:47:26.413 INFO:tasks.workunit.client.0.smithi046.stdout:1/772: dwrite d4/d13/d38/faf [0,4194304] 0 2024-09-21T12:47:26.415 INFO:tasks.workunit.client.0.smithi046.stdout:2/843: truncate d16/d22/d38/d77/d7a/f98 4909601 0 2024-09-21T12:47:26.419 INFO:tasks.workunit.client.0.smithi046.stdout:8/963: link d1/d12/d46/d35/d5b/f69 d1/d12/d46/d35/f14f 0 2024-09-21T12:47:26.421 INFO:tasks.workunit.client.0.smithi046.stdout:1/773: mknod d4/d13/d38/d53/d80/d8b/cfe 0 2024-09-21T12:47:26.422 INFO:tasks.workunit.client.0.smithi046.stdout:1/774: fsync d4/f9 0 2024-09-21T12:47:26.423 INFO:tasks.workunit.client.0.smithi046.stdout:8/964: fsync d1/f148 0 2024-09-21T12:47:26.424 INFO:tasks.workunit.client.0.smithi046.stdout:2/844: symlink d16/d22/dfb/l11a 0 2024-09-21T12:47:26.427 INFO:tasks.workunit.client.0.smithi046.stdout:2/845: read fc [2017994,83740] 0 2024-09-21T12:47:26.427 INFO:tasks.workunit.client.0.smithi046.stdout:1/775: creat d4/d29/d32/d9e/d5d/fff x:0 0 0 2024-09-21T12:47:26.429 INFO:tasks.workunit.client.0.smithi046.stdout:1/776: dread d4/d4d/f57 [0,4194304] 0 2024-09-21T12:47:26.436 INFO:tasks.workunit.client.0.smithi046.stdout:1/777: creat d4/d13/d38/d4f/d83/da9/f100 x:0 0 0 2024-09-21T12:47:26.439 INFO:tasks.workunit.client.0.smithi046.stdout:2/846: truncate d16/f25 1317165 0 2024-09-21T12:47:26.440 INFO:tasks.workunit.client.0.smithi046.stdout:2/847: truncate d16/d22/d38/d77/ffa 811857 0 2024-09-21T12:47:26.441 INFO:tasks.workunit.client.0.smithi046.stdout:1/778: creat d4/d13/d38/d53/d80/d8b/dc3/f101 x:0 0 0 2024-09-21T12:47:26.447 INFO:tasks.workunit.client.0.smithi046.stdout:2/848: rename d16/d22/d2b/f6e to d16/d22/d75/ded/f11b 0 2024-09-21T12:47:26.447 INFO:tasks.workunit.client.0.smithi046.stdout:2/849: fdatasync d16/fc8 0 2024-09-21T12:47:26.449 INFO:tasks.workunit.client.0.smithi046.stdout:1/779: dwrite d4/f1b [4194304,4194304] 0 2024-09-21T12:47:26.455 INFO:tasks.workunit.client.0.smithi046.stdout:2/850: dwrite d16/fc8 [0,4194304] 0 2024-09-21T12:47:26.458 INFO:tasks.workunit.client.0.smithi046.stdout:2/851: read d16/d22/d2b/f6f [523842,16586] 0 2024-09-21T12:47:26.459 INFO:tasks.workunit.client.0.smithi046.stdout:8/965: write d1/d12/fae [1191327,44634] 0 2024-09-21T12:47:26.459 INFO:tasks.workunit.client.0.smithi046.stdout:1/780: mkdir d4/d29/d32/d9e/d5d/d8c/d92/dcc/d102 0 2024-09-21T12:47:26.460 INFO:tasks.workunit.client.0.smithi046.stdout:1/781: chown d4/d29/d32/d9e/d5d/d8c/d92/dcc/d102 1886246 1 2024-09-21T12:47:26.461 INFO:tasks.workunit.client.0.smithi046.stdout:1/782: chown d4/d13/d6b/f76 62 1 2024-09-21T12:47:26.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/852: creat d16/d22/d4e/da6/f11c x:0 0 0 2024-09-21T12:47:26.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/966: rename d1/d12/d46/d35/d5b/c61 to d1/d12/d46/d35/d7d/c150 0 2024-09-21T12:47:26.471 INFO:tasks.workunit.client.0.smithi046.stdout:2/853: dwrite d16/d22/d4e/d90/dc6/fd0 [0,4194304] 0 2024-09-21T12:47:26.473 INFO:tasks.workunit.client.0.smithi046.stdout:1/783: fsync d4/d13/f2e 0 2024-09-21T12:47:26.474 INFO:tasks.workunit.client.0.smithi046.stdout:1/784: chown d4/d4d/lfc 5 1 2024-09-21T12:47:26.475 INFO:tasks.workunit.client.0.smithi046.stdout:8/967: mknod d1/d12/d46/d35/d36/d86/c151 0 2024-09-21T12:47:26.476 INFO:tasks.workunit.client.0.smithi046.stdout:2/854: mkdir d16/d5c/d63/d11d 0 2024-09-21T12:47:26.479 INFO:tasks.workunit.client.0.smithi046.stdout:8/968: rmdir d1/d12/d46/d35/d36/dce 39 2024-09-21T12:47:26.480 INFO:tasks.workunit.client.0.smithi046.stdout:1/785: dwrite d4/ff3 [0,4194304] 0 2024-09-21T12:47:26.491 INFO:tasks.workunit.client.0.smithi046.stdout:1/786: getdents d4/d13/d79/dbd 0 2024-09-21T12:47:26.492 INFO:tasks.workunit.client.0.smithi046.stdout:1/787: readlink d4/d29/d32/d9e/d5d/ld2 0 2024-09-21T12:47:26.497 INFO:tasks.workunit.client.0.smithi046.stdout:1/788: dwrite d4/d4d/f7e [0,4194304] 0 2024-09-21T12:47:26.505 INFO:tasks.workunit.client.0.smithi046.stdout:1/789: dwrite d4/d13/d38/fa1 [0,4194304] 0 2024-09-21T12:47:26.511 INFO:tasks.workunit.client.0.smithi046.stdout:1/790: dwrite d4/d29/f6c [0,4194304] 0 2024-09-21T12:47:26.534 INFO:tasks.workunit.client.0.smithi046.stdout:1/791: write d4/d29/d32/d9e/d5d/d8c/d92/fb1 [251599,110161] 0 2024-09-21T12:47:26.535 INFO:tasks.workunit.client.0.smithi046.stdout:1/792: chown d4 40998079 1 2024-09-21T12:47:26.537 INFO:tasks.workunit.client.0.smithi046.stdout:1/793: mknod d4/d29/d32/d9e/d5d/d8c/d92/dcc/d102/c103 0 2024-09-21T12:47:26.539 INFO:tasks.workunit.client.0.smithi046.stdout:1/794: creat d4/d4d/dda/f104 x:0 0 0 2024-09-21T12:47:26.552 INFO:tasks.workunit.client.0.smithi046.stdout:1/795: dread d4/f37 [0,4194304] 0 2024-09-21T12:47:26.555 INFO:tasks.workunit.client.0.smithi046.stdout:1/796: rename d4/d4d/f73 to d4/d13/d38/d53/d80/d95/f105 0 2024-09-21T12:47:26.556 INFO:tasks.workunit.client.0.smithi046.stdout:1/797: rmdir d4/d13/d38/d4f 39 2024-09-21T12:47:26.557 INFO:tasks.workunit.client.0.smithi046.stdout:1/798: symlink d4/d13/d38/d53/d80/d95/da5/l106 0 2024-09-21T12:47:26.560 INFO:tasks.workunit.client.0.smithi046.stdout:1/799: creat d4/d13/d38/d4f/d83/da9/f107 x:0 0 0 2024-09-21T12:47:26.575 INFO:tasks.workunit.client.0.smithi046.stdout:1/800: write d4/d13/f6e [4117328,107064] 0 2024-09-21T12:47:26.585 INFO:tasks.workunit.client.0.smithi046.stdout:1/801: dread d4/f10 [0,4194304] 0 2024-09-21T12:47:26.587 INFO:tasks.workunit.client.0.smithi046.stdout:1/802: mknod d4/d4d/c108 0 2024-09-21T12:47:26.594 INFO:tasks.workunit.client.0.smithi046.stdout:1/803: link d4/d13/d38/d4f/c6d d4/d13/d38/d4f/d83/dd5/c109 0 2024-09-21T12:47:26.596 INFO:tasks.workunit.client.0.smithi046.stdout:1/804: mkdir d4/d13/d38/d4f/d83/da9/d10a 0 2024-09-21T12:47:26.598 INFO:tasks.workunit.client.0.smithi046.stdout:1/805: mkdir d4/d29/d32/d10b 0 2024-09-21T12:47:26.600 INFO:tasks.workunit.client.0.smithi046.stdout:1/806: symlink d4/d29/d32/d9e/l10c 0 2024-09-21T12:47:26.737 INFO:tasks.workunit.client.0.smithi046.stdout:1/807: creat d4/d29/d32/d10b/f10d x:0 0 0 2024-09-21T12:47:26.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/808: mknod d4/d13/d38/d53/c10e 0 2024-09-21T12:47:26.746 INFO:tasks.workunit.client.0.smithi046.stdout:1/809: link d4/d13/d38/cae d4/d13/d38/d53/d80/d95/da5/c10f 0 2024-09-21T12:47:26.829 INFO:tasks.workunit.client.0.smithi046.stdout:1/810: dwrite d4/d13/f1d [0,4194304] 0 2024-09-21T12:47:26.831 INFO:tasks.workunit.client.0.smithi046.stdout:1/811: creat d4/d13/d38/d4f/d83/f110 x:0 0 0 2024-09-21T12:47:26.834 INFO:tasks.workunit.client.0.smithi046.stdout:1/812: symlink d4/d29/d32/d9e/d5d/d8c/l111 0 2024-09-21T12:47:26.842 INFO:tasks.workunit.client.0.smithi046.stdout:1/813: symlink d4/d29/d32/d9e/l112 0 2024-09-21T12:47:26.845 INFO:tasks.workunit.client.0.smithi046.stdout:1/814: unlink d4/d29/d32/d9e/d5d/c81 0 2024-09-21T12:47:26.847 INFO:tasks.workunit.client.0.smithi046.stdout:1/815: creat d4/d13/d38/d53/f113 x:0 0 0 2024-09-21T12:47:26.849 INFO:tasks.workunit.client.0.smithi046.stdout:1/816: write d4/d13/d38/d4f/d83/da9/f107 [1038361,13477] 0 2024-09-21T12:47:26.851 INFO:tasks.workunit.client.0.smithi046.stdout:1/817: mknod d4/d13/d38/d53/d80/d95/da5/c114 0 2024-09-21T12:47:26.852 INFO:tasks.workunit.client.0.smithi046.stdout:1/818: write d4/d29/d32/d10b/f10d [112786,22025] 0 2024-09-21T12:47:26.856 INFO:tasks.workunit.client.0.smithi046.stdout:1/819: write d4/d13/f84 [3552212,90019] 0 2024-09-21T12:47:26.862 INFO:tasks.workunit.client.0.smithi046.stdout:1/820: creat d4/d13/d38/d4f/d83/f115 x:0 0 0 2024-09-21T12:47:26.865 INFO:tasks.workunit.client.0.smithi046.stdout:1/821: mkdir d4/d4d/dda/d116 0 2024-09-21T12:47:26.867 INFO:tasks.workunit.client.0.smithi046.stdout:1/822: write d4/d13/d38/d4f/d83/da9/f107 [1972269,90653] 0 2024-09-21T12:47:26.871 INFO:tasks.workunit.client.0.smithi046.stdout:1/823: creat d4/d29/d32/f117 x:0 0 0 2024-09-21T12:47:26.873 INFO:tasks.workunit.client.0.smithi046.stdout:1/824: rmdir d4/d13/d38/d4f/d83 39 2024-09-21T12:47:26.878 INFO:tasks.workunit.client.0.smithi046.stdout:1/825: creat d4/d13/d38/d53/df2/f118 x:0 0 0 2024-09-21T12:47:26.893 INFO:tasks.workunit.client.0.smithi046.stdout:1/826: write d4/d13/d6b/f76 [1316597,59666] 0 2024-09-21T12:47:26.908 INFO:tasks.workunit.client.0.smithi046.stdout:1/827: dread d4/d13/f27 [0,4194304] 0 2024-09-21T12:47:26.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/828: write d4/feb [660737,26182] 0 2024-09-21T12:47:26.910 INFO:tasks.workunit.client.0.smithi046.stdout:1/829: chown d4/d13/d79/fe3 12898 1 2024-09-21T12:47:26.917 INFO:tasks.workunit.client.0.smithi046.stdout:1/830: creat d4/d13/f119 x:0 0 0 2024-09-21T12:47:26.919 INFO:tasks.workunit.client.0.smithi046.stdout:1/831: creat d4/d29/d32/d9e/d5d/d8c/d92/f11a x:0 0 0 2024-09-21T12:47:26.921 INFO:tasks.workunit.client.0.smithi046.stdout:1/832: write d4/d13/f1a [1580123,76426] 0 2024-09-21T12:47:26.923 INFO:tasks.workunit.client.0.smithi046.stdout:1/833: write d4/d29/d32/d9e/d5d/d8c/d92/fdf [2851467,6199] 0 2024-09-21T12:47:26.926 INFO:tasks.workunit.client.0.smithi046.stdout:1/834: rmdir d4/d13/d38/d53/d80/d95/da5 39 2024-09-21T12:47:26.929 INFO:tasks.workunit.client.0.smithi046.stdout:1/835: mknod d4/d13/d38/d53/d80/d95/da5/c11b 0 2024-09-21T12:47:26.932 INFO:tasks.workunit.client.0.smithi046.stdout:1/836: creat d4/f11c x:0 0 0 2024-09-21T12:47:26.933 INFO:tasks.workunit.client.0.smithi046.stdout:1/837: creat d4/d13/d79/dbd/f11d x:0 0 0 2024-09-21T12:47:26.935 INFO:tasks.workunit.client.0.smithi046.stdout:1/838: write d4/d29/d32/d9e/d5d/d8c/d92/f11a [640586,42887] 0 2024-09-21T12:47:26.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/839: mknod d4/d13/dc0/c11e 0 2024-09-21T12:47:26.937 INFO:tasks.workunit.client.0.smithi046.stdout:1/840: truncate d4/f11c 385839 0 2024-09-21T12:47:26.946 INFO:tasks.workunit.client.0.smithi046.stdout:1/841: rename d4/d13/d38 to d4/d29/d32/d9e/d11f 0 2024-09-21T12:47:26.947 INFO:tasks.workunit.client.0.smithi046.stdout:1/842: fsync d4/d29/d32/d9e/d5d/d8c/d94/fbf 0 2024-09-21T12:47:26.952 INFO:tasks.workunit.client.0.smithi046.stdout:1/843: mknod d4/d29/d32/d9e/d11f/d53/d80/c120 0 2024-09-21T12:47:26.954 INFO:tasks.workunit.client.0.smithi046.stdout:1/844: chown d4/d13/f2f 1585 1 2024-09-21T12:47:26.957 INFO:tasks.workunit.client.0.smithi046.stdout:1/845: dread d4/d29/d32/d9e/d5d/d8c/d92/fb1 [0,4194304] 0 2024-09-21T12:47:26.960 INFO:tasks.workunit.client.0.smithi046.stdout:1/846: creat d4/d29/f121 x:0 0 0 2024-09-21T12:47:26.965 INFO:tasks.workunit.client.0.smithi046.stdout:1/847: write d4/d13/d79/fb7 [1155331,117257] 0 2024-09-21T12:47:26.965 INFO:tasks.workunit.client.0.smithi046.stdout:5/798: sync 2024-09-21T12:47:26.969 INFO:tasks.workunit.client.0.smithi046.stdout:1/848: rename d4/d29/d32/d9e/d5d/d8c/d92/fdf to d4/d4d/f122 0 2024-09-21T12:47:26.970 INFO:tasks.workunit.client.0.smithi046.stdout:1/849: stat d4/d29/d32/d9e/d11f/d4f/c97 0 2024-09-21T12:47:26.970 INFO:tasks.workunit.client.0.smithi046.stdout:5/799: symlink d4/dc/d13/d5b/d2d/l100 0 2024-09-21T12:47:26.974 INFO:tasks.workunit.client.0.smithi046.stdout:5/800: rename d4/dc/d45/dd7/de3 to d4/d22/d99/de7/df3/d101 0 2024-09-21T12:47:26.974 INFO:tasks.workunit.client.0.smithi046.stdout:1/850: dread d4/d29/d32/d9e/f8f [0,4194304] 0 2024-09-21T12:47:26.978 INFO:tasks.workunit.client.0.smithi046.stdout:1/851: creat d4/d29/d32/d9e/d11f/d53/d80/d8b/dc3/f123 x:0 0 0 2024-09-21T12:47:26.979 INFO:tasks.workunit.client.0.smithi046.stdout:5/801: link d4/dc/d13/ff9 d4/dc/d13/da2/dce/df1/f102 0 2024-09-21T12:47:26.981 INFO:tasks.workunit.client.0.smithi046.stdout:1/852: chown d4/d29/d32/d9e/d11f/d4f/d83/da9/f100 115886294 1 2024-09-21T12:47:26.985 INFO:tasks.workunit.client.0.smithi046.stdout:1/853: rename d4/d29/d32/d9e/d11f/d53/d80/d95/da5/fc9 to d4/d4d/dda/d116/f124 0 2024-09-21T12:47:26.986 INFO:tasks.workunit.client.0.smithi046.stdout:1/854: write d4/d4d/dda/f104 [222531,28972] 0 2024-09-21T12:47:26.991 INFO:tasks.workunit.client.0.smithi046.stdout:1/855: dwrite d4/d29/d32/d9e/d5d/ff7 [0,4194304] 0 2024-09-21T12:47:26.995 INFO:tasks.workunit.client.0.smithi046.stdout:1/856: rename d4/d29/d32/d9e/d5d/d8c/d92/f11a to d4/d29/d32/d9e/d11f/d4f/d83/f125 0 2024-09-21T12:47:26.996 INFO:tasks.workunit.client.0.smithi046.stdout:1/857: dread - d4/d29/d32/f117 zero size 2024-09-21T12:47:27.000 INFO:tasks.workunit.client.0.smithi046.stdout:1/858: rename d4/d29/d32/f117 to d4/d29/d32/d9e/d5d/d8c/d92/dcc/f126 0 2024-09-21T12:47:27.000 INFO:tasks.workunit.client.0.smithi046.stdout:5/802: write d4/dc/d13/f50 [3312761,96198] 0 2024-09-21T12:47:27.002 INFO:tasks.workunit.client.0.smithi046.stdout:1/859: read d4/d29/d32/f46 [68587,30529] 0 2024-09-21T12:47:27.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/803: rmdir d4/dc/d6b 39 2024-09-21T12:47:27.007 INFO:tasks.workunit.client.0.smithi046.stdout:5/804: write d4/dc/d13/f35 [1037365,66888] 0 2024-09-21T12:47:27.008 INFO:tasks.workunit.client.0.smithi046.stdout:1/860: write d4/d4d/dda/ffb [611573,71182] 0 2024-09-21T12:47:27.009 INFO:tasks.workunit.client.0.smithi046.stdout:1/861: fsync d4/feb 0 2024-09-21T12:47:27.010 INFO:tasks.workunit.client.0.smithi046.stdout:5/805: dread d4/dc/d13/f50 [4194304,4194304] 0 2024-09-21T12:47:27.017 INFO:tasks.workunit.client.0.smithi046.stdout:5/806: dwrite d4/d22/d99/d9d/fe1 [0,4194304] 0 2024-09-21T12:47:27.022 INFO:tasks.workunit.client.0.smithi046.stdout:5/807: dread d4/dc/d45/fd3 [0,4194304] 0 2024-09-21T12:47:27.023 INFO:tasks.workunit.client.0.smithi046.stdout:1/862: truncate d4/d4d/dda/d116/f124 1030334 0 2024-09-21T12:47:27.025 INFO:tasks.workunit.client.0.smithi046.stdout:5/808: creat d4/dc/d13/d5b/d2d/f103 x:0 0 0 2024-09-21T12:47:27.030 INFO:tasks.workunit.client.0.smithi046.stdout:5/809: rename d4/d22/d10/d1a/f37 to d4/d22/d99/dc7/f104 0 2024-09-21T12:47:27.035 INFO:tasks.workunit.client.0.smithi046.stdout:5/810: dwrite d4/dc/d45/f87 [0,4194304] 0 2024-09-21T12:47:27.039 INFO:tasks.workunit.client.0.smithi046.stdout:5/811: readlink d4/d22/d99/dc7/laf 0 2024-09-21T12:47:27.040 INFO:tasks.workunit.client.0.smithi046.stdout:5/812: fsync d4/d22/d10/d1a/f77 0 2024-09-21T12:47:27.041 INFO:tasks.workunit.client.0.smithi046.stdout:5/813: dread - d4/d22/d10/d1a/d9e/ffc zero size 2024-09-21T12:47:27.048 INFO:tasks.workunit.client.0.smithi046.stdout:5/814: link d4/dc/d13/d5b/d2d/d43/ddb/fe9 d4/dc/d13/da2/dce/dfe/f105 0 2024-09-21T12:47:27.055 INFO:tasks.workunit.client.0.smithi046.stdout:5/815: dwrite d4/dc/d45/fd3 [0,4194304] 0 2024-09-21T12:47:27.059 INFO:tasks.workunit.client.0.smithi046.stdout:5/816: unlink d4/d22/d10/d1a/f77 0 2024-09-21T12:47:27.060 INFO:tasks.workunit.client.0.smithi046.stdout:5/817: fdatasync d4/d22/d10/ff5 0 2024-09-21T12:47:27.064 INFO:tasks.workunit.client.0.smithi046.stdout:5/818: mknod d4/d22/d10/d1a/d9e/da7/c106 0 2024-09-21T12:47:27.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/819: truncate d4/dc/d13/da2/dce/df1/f102 934343 0 2024-09-21T12:47:27.068 INFO:tasks.workunit.client.0.smithi046.stdout:5/820: write d4/dc/d13/d5b/d2d/f7d [807328,82096] 0 2024-09-21T12:47:27.070 INFO:tasks.workunit.client.0.smithi046.stdout:5/821: creat d4/dc/d13/d5b/d2d/d43/f107 x:0 0 0 2024-09-21T12:47:27.075 INFO:tasks.workunit.client.0.smithi046.stdout:5/822: link d4/dc/l64 d4/d22/d99/de7/df3/d101/l108 0 2024-09-21T12:47:27.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/823: rename d4/d22/d10 to d4/dc/d13/da2/dce/d109 0 2024-09-21T12:47:27.081 INFO:tasks.workunit.client.0.smithi046.stdout:5/824: creat d4/dc/d13/d5b/d2d/d43/d7a/f10a x:0 0 0 2024-09-21T12:47:27.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/825: getdents d4/dc/d13/da2/dce/d109 0 2024-09-21T12:47:27.092 INFO:tasks.workunit.client.0.smithi046.stdout:5/826: chown d4/d22/d99/lca 205 1 2024-09-21T12:47:27.095 INFO:tasks.workunit.client.0.smithi046.stdout:5/827: chown d4/dc/d13/d15/d5c/c8e 52197 1 2024-09-21T12:47:27.096 INFO:tasks.workunit.client.0.smithi046.stdout:5/828: mknod d4/d22/d99/de7/c10b 0 2024-09-21T12:47:27.110 INFO:tasks.workunit.client.0.smithi046.stdout:5/829: getdents d4 0 2024-09-21T12:47:27.114 INFO:tasks.workunit.client.0.smithi046.stdout:5/830: link d4/dc/d13/da2/dce/df1/f102 d4/d22/d99/de7/df3/d101/f10c 0 2024-09-21T12:47:27.115 INFO:tasks.workunit.client.0.smithi046.stdout:5/831: chown d4/dc/d13/da2/dce/d109/d1a/d9e/ffc 99 1 2024-09-21T12:47:27.121 INFO:tasks.workunit.client.0.smithi046.stdout:5/832: dwrite d4/dc/d13/d5b/d2d/d43/fed [0,4194304] 0 2024-09-21T12:47:27.125 INFO:tasks.workunit.client.0.smithi046.stdout:5/833: chown d4/dc/d13/d5b/l47 3464 1 2024-09-21T12:47:27.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/834: mkdir d4/d22/d99/d10d 0 2024-09-21T12:47:27.129 INFO:tasks.workunit.client.0.smithi046.stdout:5/835: fsync d4/dc/d13/d5b/d2d/d43/d7a/fe8 0 2024-09-21T12:47:27.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/836: mkdir d4/dc/d13/da2/d10e 0 2024-09-21T12:47:27.134 INFO:tasks.workunit.client.0.smithi046.stdout:5/837: stat d4/dc/d13/d5b/d2d/d43/lab 0 2024-09-21T12:47:27.136 INFO:tasks.workunit.client.0.smithi046.stdout:5/838: write d4/dc/d13/d5b/d2d/d43/f107 [837230,81924] 0 2024-09-21T12:47:27.157 INFO:tasks.workunit.client.0.smithi046.stdout:5/839: dread d4/d22/d99/dc7/f66 [0,4194304] 0 2024-09-21T12:47:27.164 INFO:tasks.workunit.client.0.smithi046.stdout:5/840: dwrite d4/d22/d99/dc7/f66 [4194304,4194304] 0 2024-09-21T12:47:27.167 INFO:tasks.workunit.client.0.smithi046.stdout:5/841: read d4/dc/d13/d5b/d2d/d3b/f68 [1241554,79457] 0 2024-09-21T12:47:27.170 INFO:tasks.workunit.client.0.smithi046.stdout:5/842: dread d4/dc/d13/d15/f51 [0,4194304] 0 2024-09-21T12:47:27.171 INFO:tasks.workunit.client.0.smithi046.stdout:5/843: stat d4/fe4 0 2024-09-21T12:47:27.172 INFO:tasks.workunit.client.0.smithi046.stdout:5/844: chown d4/d22/d99/de7/df3/d101/cf2 78 1 2024-09-21T12:47:27.186 INFO:tasks.workunit.client.0.smithi046.stdout:5/845: dwrite d4/dc/d13/d15/f92 [0,4194304] 0 2024-09-21T12:47:27.188 INFO:tasks.workunit.client.0.smithi046.stdout:5/846: truncate d4/dc/d13/d5b/d2d/d43/fed 4656048 0 2024-09-21T12:47:27.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/847: fsync d4/dc/d13/da2/dce/d109/f62 0 2024-09-21T12:47:27.193 INFO:tasks.workunit.client.0.smithi046.stdout:5/848: creat d4/dc/d13/da2/dce/d109/d1a/d9e/da7/f10f x:0 0 0 2024-09-21T12:47:27.196 INFO:tasks.workunit.client.0.smithi046.stdout:5/849: mkdir d4/dc/d13/da2/d110 0 2024-09-21T12:47:27.205 INFO:tasks.workunit.client.0.smithi046.stdout:0/967: sync 2024-09-21T12:47:27.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/850: write d4/dc/d13/d5b/d2d/d3b/fae [715133,106644] 0 2024-09-21T12:47:27.209 INFO:tasks.workunit.client.0.smithi046.stdout:5/851: unlink d4/dc/d13/da2/dce/df1/f102 0 2024-09-21T12:47:27.212 INFO:tasks.workunit.client.0.smithi046.stdout:5/852: symlink d4/dc/d13/l111 0 2024-09-21T12:47:27.215 INFO:tasks.workunit.client.0.smithi046.stdout:5/853: mkdir d4/dc/d13/d5b/d2d/d43/d112 0 2024-09-21T12:47:27.215 INFO:tasks.workunit.client.0.smithi046.stdout:0/968: link d6/d7/d37/faa d6/d7/d13/d43/d52/d63/d7f/d38/f151 0 2024-09-21T12:47:27.219 INFO:tasks.workunit.client.0.smithi046.stdout:0/969: symlink d6/d7/d13/d43/d52/d63/d7f/d78/l152 0 2024-09-21T12:47:27.219 INFO:tasks.workunit.client.0.smithi046.stdout:5/854: truncate d4/dc/d13/d5b/d2d/f4f 1889268 0 2024-09-21T12:47:27.220 INFO:tasks.workunit.client.0.smithi046.stdout:5/855: stat d4/dc/d13/da2/dce/d109 0 2024-09-21T12:47:27.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/970: truncate d6/d7/d13/d7b/da2/f26 4504527 0 2024-09-21T12:47:27.222 INFO:tasks.workunit.client.0.smithi046.stdout:0/971: stat d6/d60 0 2024-09-21T12:47:27.230 INFO:tasks.workunit.client.0.smithi046.stdout:5/856: link d4/dc/d45/l6e d4/dc/d13/da2/l113 0 2024-09-21T12:47:27.238 INFO:tasks.workunit.client.0.smithi046.stdout:0/972: write d6/d7/d13/d43/d52/d63/d7f/d38/db7/fc5 [197521,105248] 0 2024-09-21T12:47:27.244 INFO:tasks.workunit.client.0.smithi046.stdout:6/688: sync 2024-09-21T12:47:27.244 INFO:tasks.workunit.client.0.smithi046.stdout:4/996: sync 2024-09-21T12:47:27.244 INFO:tasks.workunit.client.0.smithi046.stdout:7/852: sync 2024-09-21T12:47:27.244 INFO:tasks.workunit.client.0.smithi046.stdout:9/914: sync 2024-09-21T12:47:27.244 INFO:tasks.workunit.client.0.smithi046.stdout:2/855: sync 2024-09-21T12:47:27.245 INFO:tasks.workunit.client.0.smithi046.stdout:8/969: sync 2024-09-21T12:47:27.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/863: sync 2024-09-21T12:47:27.245 INFO:tasks.workunit.client.0.smithi046.stdout:3/722: sync 2024-09-21T12:47:27.245 INFO:tasks.workunit.client.0.smithi046.stdout:0/973: link d6/d7/c11f d6/d7/d13/c153 0 2024-09-21T12:47:27.246 INFO:tasks.workunit.client.0.smithi046.stdout:1/864: readlink d4/d4d/lf6 0 2024-09-21T12:47:27.248 INFO:tasks.workunit.client.0.smithi046.stdout:6/689: chown de/d2a/d4c/d69/f86 1066014116 1 2024-09-21T12:47:27.251 INFO:tasks.workunit.client.0.smithi046.stdout:4/997: mkdir d1/d13/d25/d29/d43/d152 0 2024-09-21T12:47:27.251 INFO:tasks.workunit.client.0.smithi046.stdout:9/915: stat d11/d19/d1b/d31/d53/d5e/d124 0 2024-09-21T12:47:27.252 INFO:tasks.workunit.client.0.smithi046.stdout:5/857: dwrite d4/dc/d13/da2/dce/d109/f62 [0,4194304] 0 2024-09-21T12:47:27.253 INFO:tasks.workunit.client.0.smithi046.stdout:3/723: rmdir d5/d16/d5f/d6c 39 2024-09-21T12:47:27.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/916: fdatasync f2 0 2024-09-21T12:47:27.256 INFO:tasks.workunit.client.0.smithi046.stdout:4/998: stat d1/d27/d37/d8f/c119 0 2024-09-21T12:47:27.257 INFO:tasks.workunit.client.0.smithi046.stdout:3/724: fsync d5/d16/d5f/df2/d3c/d44/f4b 0 2024-09-21T12:47:27.258 INFO:tasks.workunit.client.0.smithi046.stdout:2/856: fdatasync d16/d22/d4e/fc7 0 2024-09-21T12:47:27.259 INFO:tasks.workunit.client.0.smithi046.stdout:5/858: chown d4/dc/d13/f38 1539584 1 2024-09-21T12:47:27.261 INFO:tasks.workunit.client.0.smithi046.stdout:8/970: dwrite d1/d12/f72 [0,4194304] 0 2024-09-21T12:47:27.262 INFO:tasks.workunit.client.0.smithi046.stdout:9/917: truncate d11/d19/df2/df3/f104 538939 0 2024-09-21T12:47:27.262 INFO:tasks.workunit.client.0.smithi046.stdout:5/859: write d4/dc/d45/f87 [4175523,72206] 0 2024-09-21T12:47:27.263 INFO:tasks.workunit.client.0.smithi046.stdout:1/865: rmdir d4/d29/d32/d9e/d5d/d8c/d92/dcc/d102 39 2024-09-21T12:47:27.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/690: symlink de/d2a/le9 0 2024-09-21T12:47:27.406 INFO:tasks.workunit.client.0.smithi046.stdout:0/974: getdents d6/d7/d13/d7b/d13b 0 2024-09-21T12:47:27.412 INFO:tasks.workunit.client.0.smithi046.stdout:3/725: creat d5/d5e/d8e/de8/ff6 x:0 0 0 2024-09-21T12:47:27.413 INFO:tasks.workunit.client.0.smithi046.stdout:8/971: rename d1/d12/f72 to d1/d12/d46/d35/d36/dc6/f152 0 2024-09-21T12:47:27.417 INFO:tasks.workunit.client.0.smithi046.stdout:5/860: mkdir d4/dc/d13/da2/d10e/d114 0 2024-09-21T12:47:27.419 INFO:tasks.workunit.client.0.smithi046.stdout:7/853: dread d2/d4/d97/f10c [0,4194304] 0 2024-09-21T12:47:27.424 INFO:tasks.workunit.client.0.smithi046.stdout:3/726: rmdir d5/dc 39 2024-09-21T12:47:27.425 INFO:tasks.workunit.client.0.smithi046.stdout:1/866: dwrite d4/d4d/f7e [0,4194304] 0 2024-09-21T12:47:27.427 INFO:tasks.workunit.client.0.smithi046.stdout:2/857: dread d16/f48 [0,4194304] 0 2024-09-21T12:47:27.432 INFO:tasks.workunit.client.0.smithi046.stdout:0/975: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/da6/f6e [0,4194304] 0 2024-09-21T12:47:27.435 INFO:tasks.workunit.client.0.smithi046.stdout:7/854: write d2/dd/f2b [802242,78928] 0 2024-09-21T12:47:27.438 INFO:tasks.workunit.client.0.smithi046.stdout:9/918: dread d11/d19/d1b/d1c/f47 [0,4194304] 0 2024-09-21T12:47:27.438 INFO:tasks.workunit.client.0.smithi046.stdout:8/972: creat d1/d12/d46/d35/d36/dce/d123/f153 x:0 0 0 2024-09-21T12:47:27.443 INFO:tasks.workunit.client.0.smithi046.stdout:1/867: creat d4/d29/d32/d9e/d5d/d8c/d94/f127 x:0 0 0 2024-09-21T12:47:27.445 INFO:tasks.workunit.client.0.smithi046.stdout:7/855: unlink d2/d4/d43/c102 0 2024-09-21T12:47:27.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/691: dwrite de/d2a/d4c/d69/f65 [0,4194304] 0 2024-09-21T12:47:27.447 INFO:tasks.workunit.client.0.smithi046.stdout:0/976: rmdir d6/d7/d13/d43/d52/d63/d7f/d38/db7 39 2024-09-21T12:47:27.448 INFO:tasks.workunit.client.0.smithi046.stdout:7/856: chown d2/d4/df/d6f/d92/fd3 20751 1 2024-09-21T12:47:27.448 INFO:tasks.workunit.client.0.smithi046.stdout:9/919: mkdir d11/d19/d1b/d4b/d91/d94/d125 0 2024-09-21T12:47:27.450 INFO:tasks.workunit.client.0.smithi046.stdout:5/861: dread d4/dc/d13/d15/f84 [0,4194304] 0 2024-09-21T12:47:27.450 INFO:tasks.workunit.client.0.smithi046.stdout:1/868: mknod d4/d4d/c128 0 2024-09-21T12:47:27.454 INFO:tasks.workunit.client.0.smithi046.stdout:8/973: mknod d1/d12/d46/d35/c154 0 2024-09-21T12:47:27.456 INFO:tasks.workunit.client.0.smithi046.stdout:6/692: symlink de/d2a/d34/lea 0 2024-09-21T12:47:27.457 INFO:tasks.workunit.client.0.smithi046.stdout:6/693: write de/f15 [1822838,80794] 0 2024-09-21T12:47:27.459 INFO:tasks.workunit.client.0.smithi046.stdout:0/977: dread d6/d7/d13/d43/d52/f5e [0,4194304] 0 2024-09-21T12:47:27.460 INFO:tasks.workunit.client.0.smithi046.stdout:5/862: symlink d4/dc/d13/d5b/d2d/d3b/l115 0 2024-09-21T12:47:27.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/857: creat d2/d4/d43/dd6/d104/f11b x:0 0 0 2024-09-21T12:47:27.466 INFO:tasks.workunit.client.0.smithi046.stdout:1/869: mknod d4/d29/d32/d9e/d11f/d53/d80/d8b/dc3/c129 0 2024-09-21T12:47:27.467 INFO:tasks.workunit.client.0.smithi046.stdout:8/974: mknod d1/d12/d46/d35/d36/dc6/df1/c155 0 2024-09-21T12:47:27.468 INFO:tasks.workunit.client.0.smithi046.stdout:2/858: dwrite d16/d5c/f5d [0,4194304] 0 2024-09-21T12:47:27.468 INFO:tasks.workunit.client.0.smithi046.stdout:6/694: fsync de/d2a/d4c/d71/fab 0 2024-09-21T12:47:27.473 INFO:tasks.workunit.client.0.smithi046.stdout:9/920: dread d11/d19/d36/d45/d6e/f76 [0,4194304] 0 2024-09-21T12:47:27.473 INFO:tasks.workunit.client.0.smithi046.stdout:3/727: rename d5/d5e/d8e/fd7 to d5/d16/d5f/ff7 0 2024-09-21T12:47:27.475 INFO:tasks.workunit.client.0.smithi046.stdout:5/863: symlink d4/dc/d45/l116 0 2024-09-21T12:47:27.475 INFO:tasks.workunit.client.0.smithi046.stdout:9/921: write d11/d19/d1b/d4b/d91/f7c [1663081,37277] 0 2024-09-21T12:47:27.484 INFO:tasks.workunit.client.0.smithi046.stdout:2/859: fdatasync d16/f1a 0 2024-09-21T12:47:27.491 INFO:tasks.workunit.client.0.smithi046.stdout:7/858: rename d2/d4/df/d6f/d92/c108 to d2/d4/df/d9a/dc3/dc4/d110/c11c 0 2024-09-21T12:47:27.496 INFO:tasks.workunit.client.0.smithi046.stdout:9/922: chown d11/d19/d93/l2b 296259962 1 2024-09-21T12:47:27.497 INFO:tasks.workunit.client.0.smithi046.stdout:0/978: mkdir d6/d7/d13/d7b/d14b/d154 0 2024-09-21T12:47:27.503 INFO:tasks.workunit.client.0.smithi046.stdout:8/975: mkdir d1/d12/d46/d35/d124/d156 0 2024-09-21T12:47:27.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/695: dwrite de/d2a/d4d/f60 [0,4194304] 0 2024-09-21T12:47:27.505 INFO:tasks.workunit.client.0.smithi046.stdout:8/976: write d1/d127/d128/f134 [360147,72495] 0 2024-09-21T12:47:27.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/870: link d4/d13/d79/fb7 d4/d4d/dda/d116/f12a 0 2024-09-21T12:47:27.507 INFO:tasks.workunit.client.0.smithi046.stdout:7/859: mknod d2/d4/df/d70/d88/c11d 0 2024-09-21T12:47:27.508 INFO:tasks.workunit.client.0.smithi046.stdout:3/728: dread - d5/dc/d28/d63/f96 zero size 2024-09-21T12:47:27.510 INFO:tasks.workunit.client.0.smithi046.stdout:9/923: creat d11/d19/d36/d95/f126 x:0 0 0 2024-09-21T12:47:27.511 INFO:tasks.workunit.client.0.smithi046.stdout:0/979: unlink d6/d7/d13/d43/d52/f104 0 2024-09-21T12:47:27.511 INFO:tasks.workunit.client.0.smithi046.stdout:4/999: sync 2024-09-21T12:47:27.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/696: symlink de/d2a/d4c/d77/d8f/leb 0 2024-09-21T12:47:27.514 INFO:tasks.workunit.client.0.smithi046.stdout:6/697: stat de/d35/l3d 0 2024-09-21T12:47:27.515 INFO:tasks.workunit.client.0.smithi046.stdout:2/860: truncate d16/d22/d38/d77/d9e/fbe 3475408 0 2024-09-21T12:47:27.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/861: chown c14 3769 1 2024-09-21T12:47:27.516 INFO:tasks.workunit.client.0.smithi046.stdout:2/862: readlink d16/d22/d2b/l3d 0 2024-09-21T12:47:27.517 INFO:tasks.workunit.client.0.smithi046.stdout:8/977: mknod d1/c157 0 2024-09-21T12:47:27.519 INFO:tasks.workunit.client.0.smithi046.stdout:7/860: mkdir d2/d4/df/d42/dd1/d11e 0 2024-09-21T12:47:27.521 INFO:tasks.workunit.client.0.smithi046.stdout:7/861: read d2/dd/f29 [235584,36664] 0 2024-09-21T12:47:27.522 INFO:tasks.workunit.client.0.smithi046.stdout:9/924: mknod d11/d19/d36/d45/d6e/c127 0 2024-09-21T12:47:27.523 INFO:tasks.workunit.client.0.smithi046.stdout:9/925: stat d11/d19/d1b/d31/d53/d84/d8f/cf8 0 2024-09-21T12:47:27.525 INFO:tasks.workunit.client.0.smithi046.stdout:0/980: rename d6/d7/d13/d7b/da2/lc6 to d6/d2f/l155 0 2024-09-21T12:47:27.526 INFO:tasks.workunit.client.0.smithi046.stdout:6/698: readlink de/d2a/d4c/d77/d98/lac 0 2024-09-21T12:47:27.528 INFO:tasks.workunit.client.0.smithi046.stdout:8/978: creat d1/d12/d46/d35/d7d/f158 x:0 0 0 2024-09-21T12:47:27.530 INFO:tasks.workunit.client.0.smithi046.stdout:5/864: getdents d4/dc 0 2024-09-21T12:47:27.532 INFO:tasks.workunit.client.0.smithi046.stdout:9/926: fdatasync d11/d19/d36/d45/d6e/f76 0 2024-09-21T12:47:27.533 INFO:tasks.workunit.client.0.smithi046.stdout:0/981: dwrite d6/f10e [0,4194304] 0 2024-09-21T12:47:27.536 INFO:tasks.workunit.client.0.smithi046.stdout:1/871: creat d4/d13/f12b x:0 0 0 2024-09-21T12:47:27.539 INFO:tasks.workunit.client.0.smithi046.stdout:5/865: creat d4/dc/d45/f117 x:0 0 0 2024-09-21T12:47:27.545 INFO:tasks.workunit.client.0.smithi046.stdout:5/866: dread d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:27.552 INFO:tasks.workunit.client.0.smithi046.stdout:7/862: dwrite d2/d4/d43/f6e [4194304,4194304] 0 2024-09-21T12:47:27.554 INFO:tasks.workunit.client.0.smithi046.stdout:8/979: mkdir d1/d12/d46/d35/d124/d156/d159 0 2024-09-21T12:47:27.557 INFO:tasks.workunit.client.0.smithi046.stdout:2/863: rename d16/d22/d2b/d30/d8f/cdc to d16/d5c/d63/db4/c11e 0 2024-09-21T12:47:27.561 INFO:tasks.workunit.client.0.smithi046.stdout:8/980: dwrite d1/d127/d128/f14b [0,4194304] 0 2024-09-21T12:47:27.562 INFO:tasks.workunit.client.0.smithi046.stdout:9/927: write d11/d5b/d6f/db0/d30/ffa [458966,36923] 0 2024-09-21T12:47:27.563 INFO:tasks.workunit.client.0.smithi046.stdout:2/864: truncate d16/d5c/d63/db4/dd4/ddb/fde 4897344 0 2024-09-21T12:47:27.572 INFO:tasks.workunit.client.0.smithi046.stdout:7/863: symlink d2/d4/df/d42/dbd/l11f 0 2024-09-21T12:47:27.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/867: creat d4/dc/d13/da2/d110/f118 x:0 0 0 2024-09-21T12:47:27.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/729: rename d5/dc/d30/d34/ccd to d5/dc/d94/dcc/cf8 0 2024-09-21T12:47:27.579 INFO:tasks.workunit.client.0.smithi046.stdout:0/982: dwrite d6/d7/fc7 [0,4194304] 0 2024-09-21T12:47:27.581 INFO:tasks.workunit.client.0.smithi046.stdout:9/928: mknod d11/d5b/d6f/c128 0 2024-09-21T12:47:27.582 INFO:tasks.workunit.client.0.smithi046.stdout:2/865: symlink d16/d22/d2b/d30/d8f/l11f 0 2024-09-21T12:47:27.582 INFO:tasks.workunit.client.0.smithi046.stdout:9/929: chown d11/d19/d1b/d31/d44/fa5 8067379 1 2024-09-21T12:47:27.585 INFO:tasks.workunit.client.0.smithi046.stdout:8/981: symlink d1/d12/d1a/d33/d6c/d12a/l15a 0 2024-09-21T12:47:27.586 INFO:tasks.workunit.client.0.smithi046.stdout:6/699: getdents de/d2a/d4c 0 2024-09-21T12:47:27.586 INFO:tasks.workunit.client.0.smithi046.stdout:9/930: chown d11/d19/d1b/d31/d53/d84/d8f/l11e 101926957 1 2024-09-21T12:47:27.588 INFO:tasks.workunit.client.0.smithi046.stdout:5/868: mkdir d4/dc/d45/dd7/d119 0 2024-09-21T12:47:27.594 INFO:tasks.workunit.client.0.smithi046.stdout:0/983: rename d6/d7/d9/l19 to d6/d7/d37/l156 0 2024-09-21T12:47:27.595 INFO:tasks.workunit.client.0.smithi046.stdout:9/931: dwrite d11/d19/d1b/d31/d44/dff/f116 [0,4194304] 0 2024-09-21T12:47:27.596 INFO:tasks.workunit.client.0.smithi046.stdout:2/866: symlink d16/d22/d2b/d30/df5/l120 0 2024-09-21T12:47:27.600 INFO:tasks.workunit.client.0.smithi046.stdout:7/864: creat d2/d37/d8a/ddf/d111/f120 x:0 0 0 2024-09-21T12:47:27.601 INFO:tasks.workunit.client.0.smithi046.stdout:8/982: creat d1/d12/d46/d35/d5b/dd6/d113/f15b x:0 0 0 2024-09-21T12:47:27.603 INFO:tasks.workunit.client.0.smithi046.stdout:8/983: fsync d1/d12/d46/d35/d36/d51/dd8/f122 0 2024-09-21T12:47:27.603 INFO:tasks.workunit.client.0.smithi046.stdout:6/700: creat de/d2a/d4c/d77/dae/d55/fec x:0 0 0 2024-09-21T12:47:27.605 INFO:tasks.workunit.client.0.smithi046.stdout:3/730: write d5/dc/f1d [9357923,111158] 0 2024-09-21T12:47:27.608 INFO:tasks.workunit.client.0.smithi046.stdout:0/984: unlink d6/d2f/de9/f103 0 2024-09-21T12:47:27.608 INFO:tasks.workunit.client.0.smithi046.stdout:9/932: dread - d11/d5b/d6f/fcb zero size 2024-09-21T12:47:27.611 INFO:tasks.workunit.client.0.smithi046.stdout:2/867: rename d16/d22/d38/d77/d7a/fa1 to d16/d22/d75/ded/f121 0 2024-09-21T12:47:27.612 INFO:tasks.workunit.client.0.smithi046.stdout:7/865: symlink d2/d37/d8a/d99/l121 0 2024-09-21T12:47:27.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/868: fdatasync d16/d22/d2b/d30/d8f/f101 0 2024-09-21T12:47:27.616 INFO:tasks.workunit.client.0.smithi046.stdout:6/701: fsync fb 0 2024-09-21T12:47:27.620 INFO:tasks.workunit.client.0.smithi046.stdout:3/731: symlink d5/dc/lf9 0 2024-09-21T12:47:27.621 INFO:tasks.workunit.client.0.smithi046.stdout:3/732: chown d5/d5e/d8e/db5/feb 0 1 2024-09-21T12:47:27.622 INFO:tasks.workunit.client.0.smithi046.stdout:3/733: stat d5/d16/d5f/df2/d3c/d44/ca1 0 2024-09-21T12:47:27.624 INFO:tasks.workunit.client.0.smithi046.stdout:0/985: read d6/d60/f92 [156899,7369] 0 2024-09-21T12:47:27.625 INFO:tasks.workunit.client.0.smithi046.stdout:7/866: symlink d2/d37/d8a/ddf/d111/l122 0 2024-09-21T12:47:27.627 INFO:tasks.workunit.client.0.smithi046.stdout:2/869: mknod d16/d5c/d63/db4/dca/d116/c122 0 2024-09-21T12:47:27.628 INFO:tasks.workunit.client.0.smithi046.stdout:2/870: write d16/d22/f97 [8097392,114812] 0 2024-09-21T12:47:27.629 INFO:tasks.workunit.client.0.smithi046.stdout:2/871: chown d16/d5c/d63/fbf 208031540 1 2024-09-21T12:47:27.630 INFO:tasks.workunit.client.0.smithi046.stdout:5/869: link d4/dc/d6b/cdd d4/dc/d13/da2/dce/d109/d1a/d9e/d9a/c11a 0 2024-09-21T12:47:27.631 INFO:tasks.workunit.client.0.smithi046.stdout:5/870: chown d4/dc/d13/da2/dce/d109/d1a/f59 1172 1 2024-09-21T12:47:27.632 INFO:tasks.workunit.client.0.smithi046.stdout:8/984: mknod d1/d12/d46/d35/d124/d156/d159/c15c 0 2024-09-21T12:47:27.632 INFO:tasks.workunit.client.0.smithi046.stdout:5/871: fsync d4/dc/d13/da2/dce/dfe/f70 0 2024-09-21T12:47:27.633 INFO:tasks.workunit.client.0.smithi046.stdout:8/985: fdatasync d1/d12/d46/fd5 0 2024-09-21T12:47:27.634 INFO:tasks.workunit.client.0.smithi046.stdout:5/872: fdatasync d4/dc/d13/d5b/d2d/d43/d7a/f10a 0 2024-09-21T12:47:27.636 INFO:tasks.workunit.client.0.smithi046.stdout:6/702: write de/d48/fcb [446885,74665] 0 2024-09-21T12:47:27.636 INFO:tasks.workunit.client.0.smithi046.stdout:9/933: symlink d11/d19/d1b/d1c/l129 0 2024-09-21T12:47:27.638 INFO:tasks.workunit.client.0.smithi046.stdout:0/986: creat d6/d7/d11c/f157 x:0 0 0 2024-09-21T12:47:27.638 INFO:tasks.workunit.client.0.smithi046.stdout:9/934: chown d11/d5b/d6f/db0/d30/d90 18201111 1 2024-09-21T12:47:27.639 INFO:tasks.workunit.client.0.smithi046.stdout:7/867: mknod d2/d4/df/d42/dd1/c123 0 2024-09-21T12:47:27.641 INFO:tasks.workunit.client.0.smithi046.stdout:9/935: write d11/f3c [539348,90357] 0 2024-09-21T12:47:27.646 INFO:tasks.workunit.client.0.smithi046.stdout:9/936: readlink d11/d5b/d6f/db0/d30/l41 0 2024-09-21T12:47:27.647 INFO:tasks.workunit.client.0.smithi046.stdout:6/703: dwrite de/d2a/d4c/d69/fc3 [0,4194304] 0 2024-09-21T12:47:27.650 INFO:tasks.workunit.client.0.smithi046.stdout:8/986: creat d1/d12/d1a/f15d x:0 0 0 2024-09-21T12:47:27.651 INFO:tasks.workunit.client.0.smithi046.stdout:9/937: chown d11/d5b/d6f/db0/d30/d3e/c65 3453726 1 2024-09-21T12:47:27.652 INFO:tasks.workunit.client.0.smithi046.stdout:5/873: symlink d4/dc/d13/d15/d5c/l11b 0 2024-09-21T12:47:27.654 INFO:tasks.workunit.client.0.smithi046.stdout:9/938: chown d11/d19/d36/d45/d6e/c11c 200771263 1 2024-09-21T12:47:27.655 INFO:tasks.workunit.client.0.smithi046.stdout:9/939: stat d11/f99 0 2024-09-21T12:47:27.655 INFO:tasks.workunit.client.0.smithi046.stdout:7/868: dwrite d2/d4/df/d42/dd1/ff1 [0,4194304] 0 2024-09-21T12:47:27.662 INFO:tasks.workunit.client.0.smithi046.stdout:6/704: rmdir de 39 2024-09-21T12:47:27.665 INFO:tasks.workunit.client.0.smithi046.stdout:8/987: rename d1/d12/d46/d35/d36/d51/l84 to d1/d12/d46/d35/d36/dce/d123/l15e 0 2024-09-21T12:47:27.666 INFO:tasks.workunit.client.0.smithi046.stdout:9/940: truncate d11/d19/d1b/f25 2636823 0 2024-09-21T12:47:27.669 INFO:tasks.workunit.client.0.smithi046.stdout:6/705: fdatasync de/d2a/d4c/d77/dae/d55/fe8 0 2024-09-21T12:47:27.671 INFO:tasks.workunit.client.0.smithi046.stdout:5/874: rename d4/dc/d13/d5b/f3f to d4/dc/d13/da2/dce/dfe/f11c 0 2024-09-21T12:47:27.673 INFO:tasks.workunit.client.0.smithi046.stdout:3/734: write d5/dc/d30/d34/dd1/f7e [543783,63375] 0 2024-09-21T12:47:27.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/869: link d2/d37/d77/cad d2/dd/c124 0 2024-09-21T12:47:27.677 INFO:tasks.workunit.client.0.smithi046.stdout:5/875: mkdir d4/dc/d13/d5b/d2d/d43/ddb/d11d 0 2024-09-21T12:47:27.678 INFO:tasks.workunit.client.0.smithi046.stdout:0/987: getdents d6/d2f/de9/d127 0 2024-09-21T12:47:27.687 INFO:tasks.workunit.client.0.smithi046.stdout:0/988: write d6/f21 [1180116,106996] 0 2024-09-21T12:47:27.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/706: dwrite de/d2a/fbb [0,4194304] 0 2024-09-21T12:47:27.689 INFO:tasks.workunit.client.0.smithi046.stdout:3/735: write d5/d16/d5f/df2/f37 [998905,91217] 0 2024-09-21T12:47:27.691 INFO:tasks.workunit.client.0.smithi046.stdout:5/876: rename d4/dc/d13/d5b/cc9 to d4/dc/d13/da2/dce/dfe/c11e 0 2024-09-21T12:47:27.694 INFO:tasks.workunit.client.0.smithi046.stdout:7/870: symlink d2/d4/df/d6f/l125 0 2024-09-21T12:47:27.696 INFO:tasks.workunit.client.0.smithi046.stdout:0/989: mknod d6/d7/d13/d43/d52/d8c/c158 0 2024-09-21T12:47:27.699 INFO:tasks.workunit.client.0.smithi046.stdout:6/707: mknod de/d2a/d4c/d71/d7c/dad/ced 0 2024-09-21T12:47:27.700 INFO:tasks.workunit.client.0.smithi046.stdout:6/708: dread - de/d2a/d34/db6/fd7 zero size 2024-09-21T12:47:27.702 INFO:tasks.workunit.client.0.smithi046.stdout:9/941: getdents d11/d19/d1b/d31/d53 0 2024-09-21T12:47:27.702 INFO:tasks.workunit.client.0.smithi046.stdout:9/942: fsync f2 0 2024-09-21T12:47:27.703 INFO:tasks.workunit.client.0.smithi046.stdout:5/877: mknod d4/dc/d13/da2/dce/d109/d1a/d9e/d9a/c11f 0 2024-09-21T12:47:27.705 INFO:tasks.workunit.client.0.smithi046.stdout:7/871: dread - d2/d4/f9f zero size 2024-09-21T12:47:27.706 INFO:tasks.workunit.client.0.smithi046.stdout:0/990: rename d6/d7/d13/d43/d52/d63/d7f/d38/l11e to d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/l159 0 2024-09-21T12:47:27.708 INFO:tasks.workunit.client.0.smithi046.stdout:9/943: truncate d11/d19/d1b/d31/d53/d84/fe6 1970123 0 2024-09-21T12:47:27.709 INFO:tasks.workunit.client.0.smithi046.stdout:9/944: readlink d11/d19/d36/d45/l118 0 2024-09-21T12:47:27.709 INFO:tasks.workunit.client.0.smithi046.stdout:7/872: symlink d2/d37/d8a/ddf/l126 0 2024-09-21T12:47:27.712 INFO:tasks.workunit.client.0.smithi046.stdout:3/736: symlink d5/dc/d28/lfa 0 2024-09-21T12:47:27.713 INFO:tasks.workunit.client.0.smithi046.stdout:6/709: mknod de/d2a/d4c/d77/d8f/d94/de7/cee 0 2024-09-21T12:47:27.713 INFO:tasks.workunit.client.0.smithi046.stdout:3/737: fsync d5/d16/d5f/df2/d3c/d44/f4b 0 2024-09-21T12:47:27.714 INFO:tasks.workunit.client.0.smithi046.stdout:3/738: write d5/dc/d28/fc6 [3663064,115259] 0 2024-09-21T12:47:27.715 INFO:tasks.workunit.client.0.smithi046.stdout:3/739: chown d5/dc/d28/f33 27 1 2024-09-21T12:47:27.715 INFO:tasks.workunit.client.0.smithi046.stdout:9/945: rename d11/d19/f4d to d11/d19/d1b/d31/d44/f12a 0 2024-09-21T12:47:27.719 INFO:tasks.workunit.client.0.smithi046.stdout:6/710: fdatasync de/d2a/d4c/d69/fc1 0 2024-09-21T12:47:27.723 INFO:tasks.workunit.client.0.smithi046.stdout:3/740: unlink d5/dc/d28/d60/c92 0 2024-09-21T12:47:27.725 INFO:tasks.workunit.client.0.smithi046.stdout:3/741: write d5/d16/d5f/df2/d3c/d44/f4b [6449821,72670] 0 2024-09-21T12:47:27.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/873: link d2/d4/f8c d2/d4/df/d17/f127 0 2024-09-21T12:47:27.729 INFO:tasks.workunit.client.0.smithi046.stdout:3/742: read d5/d16/d5f/df2/d3c/d44/f5d [1066155,29313] 0 2024-09-21T12:47:27.729 INFO:tasks.workunit.client.0.smithi046.stdout:0/991: dwrite d6/d7/d13/d43/d52/d63/f96 [0,4194304] 0 2024-09-21T12:47:27.730 INFO:tasks.workunit.client.0.smithi046.stdout:3/743: chown d5/d5e/d8e/db5 103586701 1 2024-09-21T12:47:27.736 INFO:tasks.workunit.client.0.smithi046.stdout:0/992: mknod d6/d7/d13/d7b/da2/c15a 0 2024-09-21T12:47:27.738 INFO:tasks.workunit.client.0.smithi046.stdout:3/744: read d5/d16/f95 [563026,101881] 0 2024-09-21T12:47:27.742 INFO:tasks.workunit.client.0.smithi046.stdout:7/874: dread d2/d4/f33 [0,4194304] 0 2024-09-21T12:47:27.745 INFO:tasks.workunit.client.0.smithi046.stdout:3/745: symlink d5/dc/d28/d63/de2/lfb 0 2024-09-21T12:47:27.745 INFO:tasks.workunit.client.0.smithi046.stdout:0/993: dwrite d6/d7/d13/d43/d52/d63/d7f/d38/db7/fbf [0,4194304] 0 2024-09-21T12:47:27.749 INFO:tasks.workunit.client.0.smithi046.stdout:0/994: mkdir d6/d7/d11c/d15b 0 2024-09-21T12:47:27.751 INFO:tasks.workunit.client.0.smithi046.stdout:3/746: mkdir d5/dc/dfc 0 2024-09-21T12:47:27.829 INFO:tasks.workunit.client.0.smithi046.stdout:7/875: creat d2/d37/d8a/f128 x:0 0 0 2024-09-21T12:47:27.829 INFO:tasks.workunit.client.0.smithi046.stdout:0/995: symlink d6/d7/d13/l15c 0 2024-09-21T12:47:27.830 INFO:tasks.workunit.client.0.smithi046.stdout:7/876: stat d2/d37/c9e 0 2024-09-21T12:47:27.830 INFO:tasks.workunit.client.0.smithi046.stdout:3/747: dread - d5/dc/fc1 zero size 2024-09-21T12:47:27.831 INFO:tasks.workunit.client.0.smithi046.stdout:7/877: fsync d2/d4/f9f 0 2024-09-21T12:47:27.832 INFO:tasks.workunit.client.0.smithi046.stdout:3/748: dread d5/f24 [0,4194304] 0 2024-09-21T12:47:27.836 INFO:tasks.workunit.client.0.smithi046.stdout:0/996: truncate d6/d7/d13/d43/d52/d63/d7f/d78/d8a/df1/d100/f121 902156 0 2024-09-21T12:47:27.839 INFO:tasks.workunit.client.0.smithi046.stdout:0/997: symlink d6/d7/d13/d43/d52/d63/d7f/d110/l15d 0 2024-09-21T12:47:27.846 INFO:tasks.workunit.client.0.smithi046.stdout:0/998: symlink d6/d7/l15e 0 2024-09-21T12:47:27.847 INFO:tasks.workunit.client.0.smithi046.stdout:3/749: dread d5/dc/d28/d60/fae [0,4194304] 0 2024-09-21T12:47:27.849 INFO:tasks.workunit.client.0.smithi046.stdout:0/999: chown d6/d7/d37/d53/l80 3 1 2024-09-21T12:47:27.852 INFO:tasks.workunit.client.0.smithi046.stdout:7/878: dread d2/d37/d77/f8d [0,4194304] 0 2024-09-21T12:47:27.853 INFO:tasks.workunit.client.0.smithi046.stdout:7/879: write d2/d4/d43/fff [93160,89999] 0 2024-09-21T12:47:27.856 INFO:tasks.workunit.client.0.smithi046.stdout:3/750: getdents d5/dc/d94 0 2024-09-21T12:47:27.857 INFO:tasks.workunit.client.0.smithi046.stdout:3/751: chown d5/dc/d94/da6/lb3 1360041 1 2024-09-21T12:47:27.858 INFO:tasks.workunit.client.0.smithi046.stdout:3/752: write d5/d16/d5f/df2/f37 [5054206,57944] 0 2024-09-21T12:47:27.860 INFO:tasks.workunit.client.0.smithi046.stdout:3/753: chown d5/dc/d30/d7c/lab 16 1 2024-09-21T12:47:27.863 INFO:tasks.workunit.client.0.smithi046.stdout:3/754: creat d5/d16/d5f/d6c/ffd x:0 0 0 2024-09-21T12:47:27.864 INFO:tasks.workunit.client.0.smithi046.stdout:3/755: chown d5/dc/d28/d60/fda 3797 1 2024-09-21T12:47:27.865 INFO:tasks.workunit.client.0.smithi046.stdout:3/756: chown d5/d5e/d8e/db5/feb 500 1 2024-09-21T12:47:27.865 INFO:tasks.workunit.client.0.smithi046.stdout:3/757: read d5/d16/d5f/ff7 [92199,12230] 0 2024-09-21T12:47:27.869 INFO:tasks.workunit.client.0.smithi046.stdout:3/758: rename d5/d5e/la3 to d5/dc/d30/d34/dd1/lfe 0 2024-09-21T12:47:27.870 INFO:tasks.workunit.client.0.smithi046.stdout:3/759: fdatasync d5/d16/d5f/df2/f3d 0 2024-09-21T12:47:27.898 INFO:tasks.workunit.client.0.smithi046.stdout:3/760: write d5/dc/d28/d63/fdd [957134,34765] 0 2024-09-21T12:47:27.906 INFO:tasks.workunit.client.0.smithi046.stdout:3/761: dwrite d5/d5e/d8e/db5/feb [0,4194304] 0 2024-09-21T12:47:27.907 INFO:tasks.workunit.client.0.smithi046.stdout:3/762: dread - d5/d16/d5f/dad/fef zero size 2024-09-21T12:47:27.922 INFO:tasks.workunit.client.0.smithi046.stdout:3/763: write d5/dc/f54 [3472065,116993] 0 2024-09-21T12:47:27.924 INFO:tasks.workunit.client.0.smithi046.stdout:3/764: write d5/d16/d5f/df2/f27 [4795309,65756] 0 2024-09-21T12:47:27.926 INFO:tasks.workunit.client.0.smithi046.stdout:3/765: read d5/fa0 [432190,19472] 0 2024-09-21T12:47:27.930 INFO:tasks.workunit.client.0.smithi046.stdout:3/766: link d5/l1c d5/d16/d5f/dad/lff 0 2024-09-21T12:47:27.931 INFO:tasks.workunit.client.0.smithi046.stdout:3/767: chown d5/d5e/d8e/cf5 1997 1 2024-09-21T12:47:27.932 INFO:tasks.workunit.client.0.smithi046.stdout:3/768: write d5/dc/d28/d60/f73 [1580482,27386] 0 2024-09-21T12:47:27.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/769: mknod d5/d5e/d8e/c100 0 2024-09-21T12:47:27.936 INFO:tasks.workunit.client.0.smithi046.stdout:3/770: fsync d5/d5e/d8e/db5/feb 0 2024-09-21T12:47:27.951 INFO:tasks.workunit.client.0.smithi046.stdout:3/771: dwrite d5/dc/d30/f39 [0,4194304] 0 2024-09-21T12:47:27.953 INFO:tasks.workunit.client.0.smithi046.stdout:3/772: mkdir d5/dc/d94/da6/d101 0 2024-09-21T12:47:27.960 INFO:tasks.workunit.client.0.smithi046.stdout:3/773: dwrite d5/dc/d94/da6/fe3 [0,4194304] 0 2024-09-21T12:47:27.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/774: fsync d5/fa0 0 2024-09-21T12:47:27.966 INFO:tasks.workunit.client.0.smithi046.stdout:3/775: creat d5/d16/d5f/df2/d3c/f102 x:0 0 0 2024-09-21T12:47:27.969 INFO:tasks.workunit.client.0.smithi046.stdout:3/776: mkdir d5/dc/d28/d63/de2/d103 0 2024-09-21T12:47:27.978 INFO:tasks.workunit.client.0.smithi046.stdout:3/777: rename d5/l40 to d5/dc/d28/d60/l104 0 2024-09-21T12:47:27.981 INFO:tasks.workunit.client.0.smithi046.stdout:3/778: mkdir d5/dc/dd5/d105 0 2024-09-21T12:47:27.986 INFO:tasks.workunit.client.0.smithi046.stdout:3/779: dwrite d5/dc/d94/da6/fe3 [0,4194304] 0 2024-09-21T12:47:27.991 INFO:tasks.workunit.client.0.smithi046.stdout:3/780: mknod d5/c106 0 2024-09-21T12:47:27.992 INFO:tasks.workunit.client.0.smithi046.stdout:3/781: symlink d5/d16/d5f/df2/d3c/d44/l107 0 2024-09-21T12:47:27.999 INFO:tasks.workunit.client.0.smithi046.stdout:3/782: dwrite d5/d5e/fe6 [0,4194304] 0 2024-09-21T12:47:28.001 INFO:tasks.workunit.client.0.smithi046.stdout:3/783: symlink d5/d5e/l108 0 2024-09-21T12:47:28.009 INFO:tasks.workunit.client.0.smithi046.stdout:3/784: link d5/d16/d5f/df2/d3c/cdc d5/d5e/d8e/db5/c109 0 2024-09-21T12:47:28.011 INFO:tasks.workunit.client.0.smithi046.stdout:3/785: fdatasync d5/d16/d5f/df2/d3c/d44/f4b 0 2024-09-21T12:47:28.014 INFO:tasks.workunit.client.0.smithi046.stdout:3/786: link f2 d5/d5e/d8e/dcf/f10a 0 2024-09-21T12:47:28.028 INFO:tasks.workunit.client.0.smithi046.stdout:3/787: truncate d5/dc/d28/f33 3998464 0 2024-09-21T12:47:28.042 INFO:tasks.workunit.client.0.smithi046.stdout:3/788: write d5/f8 [4018232,102590] 0 2024-09-21T12:47:28.045 INFO:tasks.workunit.client.0.smithi046.stdout:3/789: unlink d5/dc/d28/f7f 0 2024-09-21T12:47:28.048 INFO:tasks.workunit.client.0.smithi046.stdout:3/790: truncate d5/f24 227300 0 2024-09-21T12:47:28.052 INFO:tasks.workunit.client.0.smithi046.stdout:3/791: rename d5/dc/d94/da6/fb0 to d5/d16/d5f/d6c/f10b 0 2024-09-21T12:47:28.056 INFO:tasks.workunit.client.0.smithi046.stdout:3/792: dread d5/dc/d94/da6/fe3 [0,4194304] 0 2024-09-21T12:47:28.060 INFO:tasks.workunit.client.0.smithi046.stdout:3/793: mknod d5/dc/dd5/d105/c10c 0 2024-09-21T12:47:28.061 INFO:tasks.workunit.client.0.smithi046.stdout:3/794: read d5/d16/d5f/df2/d3c/d44/f4b [836134,113227] 0 2024-09-21T12:47:28.064 INFO:tasks.workunit.client.0.smithi046.stdout:3/795: fdatasync d5/dc/f1b 0 2024-09-21T12:47:28.067 INFO:tasks.workunit.client.0.smithi046.stdout:3/796: symlink d5/dc/d28/d60/l10d 0 2024-09-21T12:47:28.068 INFO:tasks.workunit.client.0.smithi046.stdout:3/797: fsync d5/d16/d5f/dad/fef 0 2024-09-21T12:47:28.069 INFO:tasks.workunit.client.0.smithi046.stdout:3/798: chown d5/dc/d30/d34/l81 202633 1 2024-09-21T12:47:28.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/799: stat d5/d16/d5f/d6c/cc8 0 2024-09-21T12:47:28.072 INFO:tasks.workunit.client.0.smithi046.stdout:3/800: write d5/dc/d28/d60/f73 [2344344,105265] 0 2024-09-21T12:47:28.109 INFO:tasks.workunit.client.0.smithi046.stdout:3/801: dwrite d5/dc/d28/f84 [0,4194304] 0 2024-09-21T12:47:28.110 INFO:tasks.workunit.client.0.smithi046.stdout:3/802: chown d5/dc/dfc 6453328 1 2024-09-21T12:47:28.118 INFO:tasks.workunit.client.0.smithi046.stdout:3/803: dwrite d5/dc/d30/d34/dd1/f7e [0,4194304] 0 2024-09-21T12:47:28.165 INFO:tasks.workunit.client.0.smithi046.stdout:3/804: write f2 [8888720,5780] 0 2024-09-21T12:47:28.166 INFO:tasks.workunit.client.0.smithi046.stdout:3/805: fsync d5/dc/d30/fb6 0 2024-09-21T12:47:28.170 INFO:tasks.workunit.client.0.smithi046.stdout:3/806: symlink d5/dc/d94/da6/d101/l10e 0 2024-09-21T12:47:28.173 INFO:tasks.workunit.client.0.smithi046.stdout:3/807: mkdir d5/dc/d28/d10f 0 2024-09-21T12:47:28.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/808: rmdir d5/dc/d94/dcc 39 2024-09-21T12:47:28.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/809: read d5/fa0 [362608,102030] 0 2024-09-21T12:47:28.177 INFO:tasks.workunit.client.0.smithi046.stdout:3/810: fdatasync d5/d16/f42 0 2024-09-21T12:47:28.183 INFO:tasks.workunit.client.0.smithi046.stdout:3/811: dwrite d5/d16/d5f/df2/f4c [0,4194304] 0 2024-09-21T12:47:28.190 INFO:tasks.workunit.client.0.smithi046.stdout:3/812: mkdir d5/d16/d5f/d110 0 2024-09-21T12:47:28.201 INFO:tasks.workunit.client.0.smithi046.stdout:3/813: symlink d5/dc/d94/l111 0 2024-09-21T12:47:28.201 INFO:tasks.workunit.client.0.smithi046.stdout:3/814: stat d5/dc/d30/cbe 0 2024-09-21T12:47:28.219 INFO:tasks.workunit.client.0.smithi046.stdout:3/815: write d5/f24 [410801,91420] 0 2024-09-21T12:47:28.220 INFO:tasks.workunit.client.0.smithi046.stdout:3/816: dread - d5/d16/d5f/d6c/ffd zero size 2024-09-21T12:47:28.228 INFO:tasks.workunit.client.0.smithi046.stdout:3/817: dwrite d5/d16/d5f/df2/d3c/d44/f5d [0,4194304] 0 2024-09-21T12:47:28.230 INFO:tasks.workunit.client.0.smithi046.stdout:3/818: write d5/dc/d30/d34/dd1/f74 [605333,82757] 0 2024-09-21T12:47:28.233 INFO:tasks.workunit.client.0.smithi046.stdout:3/819: truncate d5/dc/d94/dd6/ff3 259138 0 2024-09-21T12:47:28.239 INFO:tasks.workunit.client.0.smithi046.stdout:3/820: getdents d5/d5e/d8e/db5 0 2024-09-21T12:47:28.241 INFO:tasks.workunit.client.0.smithi046.stdout:3/821: readlink d5/dc/d30/d34/dd1/lfe 0 2024-09-21T12:47:28.245 INFO:tasks.workunit.client.0.smithi046.stdout:3/822: link d5/dc/l1f d5/dc/dd5/l112 0 2024-09-21T12:47:28.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:27 smithi176 ceph-mon[35476]: pgmap v40: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 40 MiB/s rd, 103 MiB/s wr, 282 op/s 2024-09-21T12:47:28.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:27 smithi046 ceph-mon[27868]: pgmap v40: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 40 MiB/s rd, 103 MiB/s wr, 282 op/s 2024-09-21T12:47:28.618 INFO:tasks.workunit.client.0.smithi046.stdout:1/872: sync 2024-09-21T12:47:28.633 INFO:tasks.workunit.client.0.smithi046.stdout:1/873: dwrite d4/d4d/f9d [0,4194304] 0 2024-09-21T12:47:28.639 INFO:tasks.workunit.client.0.smithi046.stdout:1/874: creat d4/d29/d32/d9e/d11f/d53/d80/f12c x:0 0 0 2024-09-21T12:47:28.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/875: creat d4/d29/d32/d9e/d5d/d8c/d94/f12d x:0 0 0 2024-09-21T12:47:28.647 INFO:tasks.workunit.client.0.smithi046.stdout:1/876: mkdir d4/d29/d32/d9e/d11f/d4f/d83/da9/d10a/d12e 0 2024-09-21T12:47:28.650 INFO:tasks.workunit.client.0.smithi046.stdout:1/877: mknod d4/d13/d79/c12f 0 2024-09-21T12:47:28.656 INFO:tasks.workunit.client.0.smithi046.stdout:1/878: write d4/d29/d32/fd0 [369379,122138] 0 2024-09-21T12:47:28.665 INFO:tasks.workunit.client.0.smithi046.stdout:1/879: dwrite d4/d4d/dda/d116/f12a [0,4194304] 0 2024-09-21T12:47:28.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/880: dread d4/ff3 [4194304,4194304] 0 2024-09-21T12:47:28.687 INFO:tasks.workunit.client.0.smithi046.stdout:1/881: chown d4/d13/f84 8418941 1 2024-09-21T12:47:28.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/882: creat d4/d29/d32/d9e/d11f/f130 x:0 0 0 2024-09-21T12:47:28.691 INFO:tasks.workunit.client.0.smithi046.stdout:1/883: dread - d4/d13/f12b zero size 2024-09-21T12:47:28.693 INFO:tasks.workunit.client.0.smithi046.stdout:1/884: fdatasync d4/d29/d32/d9e/d11f/d53/d80/d95/da5/fb6 0 2024-09-21T12:47:28.696 INFO:tasks.workunit.client.0.smithi046.stdout:1/885: creat d4/d29/d32/d9e/d11f/d53/d80/d95/da5/f131 x:0 0 0 2024-09-21T12:47:28.701 INFO:tasks.workunit.client.0.smithi046.stdout:1/886: dwrite d4/d29/d32/d9e/d11f/d53/d80/d95/da5/fb6 [0,4194304] 0 2024-09-21T12:47:28.709 INFO:tasks.workunit.client.0.smithi046.stdout:1/887: creat d4/d29/d32/d9e/d5d/d8c/d92/dcc/d102/f132 x:0 0 0 2024-09-21T12:47:28.709 INFO:tasks.workunit.client.0.smithi046.stdout:1/888: chown d4/d29/d32/cc1 106 1 2024-09-21T12:47:28.724 INFO:tasks.workunit.client.0.smithi046.stdout:1/889: dwrite d4/d29/d32/d9e/d11f/d53/fa2 [0,4194304] 0 2024-09-21T12:47:28.728 INFO:tasks.workunit.client.0.smithi046.stdout:1/890: mknod d4/d29/d32/d9e/d11f/d53/d80/d95/da5/c133 0 2024-09-21T12:47:28.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/891: fdatasync d4/fb2 0 2024-09-21T12:47:28.736 INFO:tasks.workunit.client.0.smithi046.stdout:1/892: dread d4/d4d/f9d [0,4194304] 0 2024-09-21T12:47:28.739 INFO:tasks.workunit.client.0.smithi046.stdout:1/893: rename d4/d29/d32/d9e/d11f/d4f/l78 to d4/d13/dc0/l134 0 2024-09-21T12:47:28.777 INFO:tasks.workunit.client.0.smithi046.stdout:2/872: sync 2024-09-21T12:47:28.787 INFO:tasks.workunit.client.0.smithi046.stdout:2/873: dread d16/f27 [0,4194304] 0 2024-09-21T12:47:28.790 INFO:tasks.workunit.client.0.smithi046.stdout:2/874: creat d16/d22/d4e/d90/dc6/df0/f123 x:0 0 0 2024-09-21T12:47:28.792 INFO:tasks.workunit.client.0.smithi046.stdout:2/875: rmdir d16/d22/d4e/da6 39 2024-09-21T12:47:28.793 INFO:tasks.workunit.client.0.smithi046.stdout:2/876: write d16/d22/d4e/da6/f11c [184892,102185] 0 2024-09-21T12:47:28.809 INFO:tasks.workunit.client.0.smithi046.stdout:2/877: dwrite d16/f8d [0,4194304] 0 2024-09-21T12:47:28.815 INFO:tasks.workunit.client.0.smithi046.stdout:2/878: getdents d16/d5c/d63/d11d 0 2024-09-21T12:47:28.819 INFO:tasks.workunit.client.0.smithi046.stdout:2/879: rename d16/d22/d4e/d90/dc6/df0/f123 to d16/d5c/d63/db4/dca/dc1/d106/f124 0 2024-09-21T12:47:28.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/880: rmdir d16/d22/d4e/d9d 39 2024-09-21T12:47:28.823 INFO:tasks.workunit.client.0.smithi046.stdout:2/881: rename d16/d22/d2b/ca0 to d16/d5c/d63/db4/dca/c125 0 2024-09-21T12:47:28.832 INFO:tasks.workunit.client.0.smithi046.stdout:2/882: dread d16/d22/d38/d77/d9e/fcc [0,4194304] 0 2024-09-21T12:47:28.834 INFO:tasks.workunit.client.0.smithi046.stdout:2/883: fdatasync d16/d5c/d63/db4/dca/d116/f69 0 2024-09-21T12:47:28.836 INFO:tasks.workunit.client.0.smithi046.stdout:2/884: fsync d16/d22/d4e/d90/dc6/fe4 0 2024-09-21T12:47:29.100 INFO:tasks.workunit.client.0.smithi046.stdout:8/988: sync 2024-09-21T12:47:29.105 INFO:tasks.workunit.client.0.smithi046.stdout:8/989: dwrite d1/d12/d46/d35/d7d/fea [0,4194304] 0 2024-09-21T12:47:29.117 INFO:tasks.workunit.client.0.smithi046.stdout:8/990: dwrite d1/d12/d46/f49 [0,4194304] 0 2024-09-21T12:47:29.151 INFO:tasks.workunit.client.0.smithi046.stdout:9/946: sync 2024-09-21T12:47:29.151 INFO:tasks.workunit.client.0.smithi046.stdout:5/878: sync 2024-09-21T12:47:29.152 INFO:tasks.workunit.client.0.smithi046.stdout:6/711: sync 2024-09-21T12:47:29.160 INFO:tasks.workunit.client.0.smithi046.stdout:8/991: write d1/d12/d46/d108/f115 [1040150,53202] 0 2024-09-21T12:47:29.161 INFO:tasks.workunit.client.0.smithi046.stdout:8/992: chown d1/d12/d53/d60/f64 3 1 2024-09-21T12:47:29.162 INFO:tasks.workunit.client.0.smithi046.stdout:8/993: readlink d1/d12/d1a/d33/lc7 0 2024-09-21T12:47:29.164 INFO:tasks.workunit.client.0.smithi046.stdout:9/947: dread d11/d5b/d6f/db0/d30/d90/f10b [4194304,4194304] 0 2024-09-21T12:47:29.166 INFO:tasks.workunit.client.0.smithi046.stdout:8/994: stat d1/d12/d46/d35/d36/d51/d8c/dee/f117 0 2024-09-21T12:47:29.168 INFO:tasks.workunit.client.0.smithi046.stdout:5/879: rmdir d4/dc/d13/da2/d10e/d114 0 2024-09-21T12:47:29.172 INFO:tasks.workunit.client.0.smithi046.stdout:9/948: write d11/d5b/d6f/f10f [827692,50246] 0 2024-09-21T12:47:29.173 INFO:tasks.workunit.client.0.smithi046.stdout:8/995: mkdir d1/d12/d46/d35/d5b/dd6/d113/d114/d15f 0 2024-09-21T12:47:29.178 INFO:tasks.workunit.client.0.smithi046.stdout:9/949: truncate d11/d19/d1b/d31/d44/f4c 704039 0 2024-09-21T12:47:29.179 INFO:tasks.workunit.client.0.smithi046.stdout:8/996: chown d1/d12/d46/c34 232780 1 2024-09-21T12:47:29.181 INFO:tasks.workunit.client.0.smithi046.stdout:9/950: fsync d11/d19/d1b/fdd 0 2024-09-21T12:47:29.182 INFO:tasks.workunit.client.0.smithi046.stdout:8/997: rmdir d1/d12/d46/d35/d5b 39 2024-09-21T12:47:29.184 INFO:tasks.workunit.client.0.smithi046.stdout:9/951: mknod d11/d5b/d6f/c12b 0 2024-09-21T12:47:29.186 INFO:tasks.workunit.client.0.smithi046.stdout:8/998: creat d1/d12/d46/d35/d7d/d6a/f160 x:0 0 0 2024-09-21T12:47:29.188 INFO:tasks.workunit.client.0.smithi046.stdout:9/952: creat d11/d19/d36/d95/f12c x:0 0 0 2024-09-21T12:47:29.190 INFO:tasks.workunit.client.0.smithi046.stdout:8/999: read d1/d12/d46/d35/d36/d51/d8c/f142 [2531806,45555] 0 2024-09-21T12:47:29.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/880: write d4/dc/d13/da2/dce/d109/f52 [986956,106930] 0 2024-09-21T12:47:29.204 INFO:tasks.workunit.client.0.smithi046.stdout:5/881: symlink d4/dc/d45/l120 0 2024-09-21T12:47:29.206 INFO:tasks.workunit.client.0.smithi046.stdout:5/882: chown d4/dc/d13/d5b/c82 119263 1 2024-09-21T12:47:29.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/883: getdents d4/dc/d45 0 2024-09-21T12:47:29.305 INFO:tasks.workunit.client.0.smithi046.stdout:2/885: sync 2024-09-21T12:47:29.305 INFO:tasks.workunit.client.0.smithi046.stdout:3/823: sync 2024-09-21T12:47:29.306 INFO:tasks.workunit.client.0.smithi046.stdout:1/894: sync 2024-09-21T12:47:29.306 INFO:tasks.workunit.client.0.smithi046.stdout:7/880: sync 2024-09-21T12:47:29.306 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:28 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:47:29.311 INFO:tasks.workunit.client.0.smithi046.stdout:1/895: creat d4/d29/d32/d9e/d5d/d8c/d94/f135 x:0 0 0 2024-09-21T12:47:29.312 INFO:tasks.workunit.client.0.smithi046.stdout:7/881: rename d2/d4/df/d6f/d92/fd3 to d2/d37/d8a/d99/dbe/f129 0 2024-09-21T12:47:29.314 INFO:tasks.workunit.client.0.smithi046.stdout:3/824: symlink d5/dc/d28/d60/l113 0 2024-09-21T12:47:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:28 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:47:29.316 INFO:tasks.workunit.client.0.smithi046.stdout:1/896: write d4/d29/d32/d9e/d5d/d8c/d92/dcc/f126 [100842,5985] 0 2024-09-21T12:47:29.318 INFO:tasks.workunit.client.0.smithi046.stdout:7/882: rename d2/d4/df/d17/f30 to d2/d37/d77/d105/f12a 0 2024-09-21T12:47:29.325 INFO:tasks.workunit.client.0.smithi046.stdout:2/886: dwrite d16/f1d [0,4194304] 0 2024-09-21T12:47:29.352 INFO:tasks.workunit.client.0.smithi046.stdout:1/897: creat d4/d29/d32/d9e/d5d/d8c/d92/f136 x:0 0 0 2024-09-21T12:47:29.355 INFO:tasks.workunit.client.0.smithi046.stdout:7/883: mkdir d2/d4/df/d70/d12b 0 2024-09-21T12:47:29.357 INFO:tasks.workunit.client.0.smithi046.stdout:3/825: dread f2 [0,4194304] 0 2024-09-21T12:47:29.357 INFO:tasks.workunit.client.0.smithi046.stdout:7/884: chown d2/d4/df/d6f/d92/fda 0 1 2024-09-21T12:47:29.361 INFO:tasks.workunit.client.0.smithi046.stdout:3/826: dread - d5/dc/d28/d63/f96 zero size 2024-09-21T12:47:29.364 INFO:tasks.workunit.client.0.smithi046.stdout:3/827: write d5/dc/d30/d34/dd1/f7e [3057574,53155] 0 2024-09-21T12:47:29.365 INFO:tasks.workunit.client.0.smithi046.stdout:1/898: dwrite d4/d29/d32/d9e/d11f/d4f/d83/da9/fc4 [0,4194304] 0 2024-09-21T12:47:29.365 INFO:tasks.workunit.client.0.smithi046.stdout:2/887: rename d16/d22/d2b/d30/df5 to d16/d22/d126 0 2024-09-21T12:47:29.367 INFO:tasks.workunit.client.0.smithi046.stdout:1/899: readlink d4/d29/d32/d9e/d11f/d53/d80/l9f 0 2024-09-21T12:47:29.369 INFO:tasks.workunit.client.0.smithi046.stdout:3/828: fsync d5/f85 0 2024-09-21T12:47:29.371 INFO:tasks.workunit.client.0.smithi046.stdout:7/885: rename d2/d4/df/d17/f3b to d2/d4/df/d70/db2/f12c 0 2024-09-21T12:47:29.375 INFO:tasks.workunit.client.0.smithi046.stdout:1/900: mknod d4/d29/d32/d9e/d5d/d8c/d92/c137 0 2024-09-21T12:47:29.376 INFO:tasks.workunit.client.0.smithi046.stdout:1/901: stat d4/d29/d32/d9e/d11f/d4f/ca6 0 2024-09-21T12:47:29.378 INFO:tasks.workunit.client.0.smithi046.stdout:3/829: read - d5/d16/d5f/df2/fb2 zero size 2024-09-21T12:47:29.379 INFO:tasks.workunit.client.0.smithi046.stdout:3/830: fsync d5/d16/d5f/df2/d3c/f51 0 2024-09-21T12:47:29.382 INFO:tasks.workunit.client.0.smithi046.stdout:1/902: mkdir d4/d29/d32/d9e/d5d/d8c/d94/d138 0 2024-09-21T12:47:29.384 INFO:tasks.workunit.client.0.smithi046.stdout:2/888: creat d16/d22/f127 x:0 0 0 2024-09-21T12:47:29.386 INFO:tasks.workunit.client.0.smithi046.stdout:7/886: dwrite d2/d4/df/d70/db2/f12c [4194304,4194304] 0 2024-09-21T12:47:29.386 INFO:tasks.workunit.client.0.smithi046.stdout:3/831: creat d5/d5e/d8e/f114 x:0 0 0 2024-09-21T12:47:29.388 INFO:tasks.workunit.client.0.smithi046.stdout:3/832: stat d5/dc/d30/d34/dd1/f7e 0 2024-09-21T12:47:29.392 INFO:tasks.workunit.client.0.smithi046.stdout:7/887: fsync d2/d37/fd4 0 2024-09-21T12:47:29.394 INFO:tasks.workunit.client.0.smithi046.stdout:2/889: mknod d16/d22/d38/d118/c128 0 2024-09-21T12:47:29.400 INFO:tasks.workunit.client.0.smithi046.stdout:2/890: mknod d16/d22/d4e/d90/c129 0 2024-09-21T12:47:29.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/891: stat d16/d22/f41 0 2024-09-21T12:47:29.401 INFO:tasks.workunit.client.0.smithi046.stdout:2/892: stat d16/d22/d2b/d43/f5a 0 2024-09-21T12:47:29.403 INFO:tasks.workunit.client.0.smithi046.stdout:3/833: mknod d5/dc/d28/d60/c115 0 2024-09-21T12:47:29.404 INFO:tasks.workunit.client.0.smithi046.stdout:3/834: read d5/dc/d30/d34/f8c [1761819,41863] 0 2024-09-21T12:47:29.407 INFO:tasks.workunit.client.0.smithi046.stdout:2/893: creat d16/d5c/d63/d11d/f12a x:0 0 0 2024-09-21T12:47:29.408 INFO:tasks.workunit.client.0.smithi046.stdout:7/888: write d2/d37/d8a/d99/dbe/feb [698954,89728] 0 2024-09-21T12:47:29.409 INFO:tasks.workunit.client.0.smithi046.stdout:2/894: read d16/fc8 [2734990,73549] 0 2024-09-21T12:47:29.412 INFO:tasks.workunit.client.0.smithi046.stdout:7/889: mkdir d2/d37/d8a/ddf/d12d 0 2024-09-21T12:47:29.415 INFO:tasks.workunit.client.0.smithi046.stdout:3/835: getdents d5/d16/d5f/df2/d3c 0 2024-09-21T12:47:29.418 INFO:tasks.workunit.client.0.smithi046.stdout:7/890: creat d2/d4/df/d6f/d92/f12e x:0 0 0 2024-09-21T12:47:29.420 INFO:tasks.workunit.client.0.smithi046.stdout:3/836: unlink d5/d5e/d8e/dcf/f10a 0 2024-09-21T12:47:29.422 INFO:tasks.workunit.client.0.smithi046.stdout:2/895: creat d16/d22/d4e/f12b x:0 0 0 2024-09-21T12:47:29.422 INFO:tasks.workunit.client.0.smithi046.stdout:7/891: rmdir d2/d4/df/d9a 39 2024-09-21T12:47:29.423 INFO:tasks.workunit.client.0.smithi046.stdout:7/892: write d2/d4/df/f109 [787741,3078] 0 2024-09-21T12:47:29.426 INFO:tasks.workunit.client.0.smithi046.stdout:3/837: truncate d5/d16/f95 520072 0 2024-09-21T12:47:29.429 INFO:tasks.workunit.client.0.smithi046.stdout:7/893: rmdir d2/d4/df/d9a 39 2024-09-21T12:47:29.431 INFO:tasks.workunit.client.0.smithi046.stdout:2/896: creat d16/d22/d4e/d9d/ddf/f12c x:0 0 0 2024-09-21T12:47:29.432 INFO:tasks.workunit.client.0.smithi046.stdout:7/894: dread - d2/d4/ff2 zero size 2024-09-21T12:47:29.436 INFO:tasks.workunit.client.0.smithi046.stdout:7/895: mkdir d2/d4/d43/dd6/d12f 0 2024-09-21T12:47:29.439 INFO:tasks.workunit.client.0.smithi046.stdout:3/838: getdents d5/dc/d94/dcc 0 2024-09-21T12:47:29.443 INFO:tasks.workunit.client.0.smithi046.stdout:2/897: write d16/d22/d38/d77/f89 [3801212,68162] 0 2024-09-21T12:47:29.444 INFO:tasks.workunit.client.0.smithi046.stdout:3/839: mkdir d5/d16/d5f/df2/d3c/d116 0 2024-09-21T12:47:29.449 INFO:tasks.workunit.client.0.smithi046.stdout:3/840: rename d5/d16/d5f/dad/lc7 to d5/d5e/d8e/de8/l117 0 2024-09-21T12:47:29.450 INFO:tasks.workunit.client.0.smithi046.stdout:7/896: getdents d2/d37/d8a/d99 0 2024-09-21T12:47:29.451 INFO:tasks.workunit.client.0.smithi046.stdout:2/898: dwrite d16/d22/d2b/d30/d8f/f101 [0,4194304] 0 2024-09-21T12:47:29.458 INFO:tasks.workunit.client.0.smithi046.stdout:3/841: symlink d5/d5e/d8e/de8/l118 0 2024-09-21T12:47:29.461 INFO:tasks.workunit.client.0.smithi046.stdout:3/842: dread d5/d16/d5f/df2/f4c [0,4194304] 0 2024-09-21T12:47:29.462 INFO:tasks.workunit.client.0.smithi046.stdout:2/899: creat d16/d5c/d63/db4/dd4/f12d x:0 0 0 2024-09-21T12:47:29.464 INFO:tasks.workunit.client.0.smithi046.stdout:7/897: write d2/d4/df/faa [1260330,81154] 0 2024-09-21T12:47:29.466 INFO:tasks.workunit.client.0.smithi046.stdout:2/900: mkdir d16/d5c/d63/db4/dca/d12e 0 2024-09-21T12:47:29.470 INFO:tasks.workunit.client.0.smithi046.stdout:7/898: mkdir d2/d4/df/d42/dca/d130 0 2024-09-21T12:47:29.471 INFO:tasks.workunit.client.0.smithi046.stdout:7/899: chown d2/d4/df/d6f/f76 207029758 1 2024-09-21T12:47:29.472 INFO:tasks.workunit.client.0.smithi046.stdout:2/901: mkdir d16/d5c/d63/db4/dd4/d12f 0 2024-09-21T12:47:29.473 INFO:tasks.workunit.client.0.smithi046.stdout:2/902: chown d16/d22/d38/lf4 93122 1 2024-09-21T12:47:29.474 INFO:tasks.workunit.client.0.smithi046.stdout:7/900: truncate d2/d4/f3c 8240262 0 2024-09-21T12:47:29.479 INFO:tasks.workunit.client.0.smithi046.stdout:3/843: truncate d5/f10 2950601 0 2024-09-21T12:47:29.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/903: dwrite d16/d22/d4e/fad [0,4194304] 0 2024-09-21T12:47:29.482 INFO:tasks.workunit.client.0.smithi046.stdout:7/901: creat d2/d4/df/d6f/f131 x:0 0 0 2024-09-21T12:47:29.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/844: write d5/dc/f1d [9333139,81758] 0 2024-09-21T12:47:29.485 INFO:tasks.workunit.client.0.smithi046.stdout:3/845: dread - d5/d16/f42 zero size 2024-09-21T12:47:29.487 INFO:tasks.workunit.client.0.smithi046.stdout:7/902: read d2/d37/d8a/d99/dbe/feb [303976,30880] 0 2024-09-21T12:47:29.488 INFO:tasks.workunit.client.0.smithi046.stdout:7/903: chown d2/d4/df/d70/d88 29799 1 2024-09-21T12:47:29.502 INFO:tasks.workunit.client.0.smithi046.stdout:2/904: dread d16/d22/d2b/f37 [0,4194304] 0 2024-09-21T12:47:29.503 INFO:tasks.workunit.client.0.smithi046.stdout:7/904: dread d2/d4/df/d70/db2/f12c [0,4194304] 0 2024-09-21T12:47:29.506 INFO:tasks.workunit.client.0.smithi046.stdout:7/905: readlink d2/d4/df/d42/lfe 0 2024-09-21T12:47:29.508 INFO:tasks.workunit.client.0.smithi046.stdout:3/846: dread d5/d16/d5f/df2/f78 [0,4194304] 0 2024-09-21T12:47:29.510 INFO:tasks.workunit.client.0.smithi046.stdout:2/905: link d16/d22/d4e/d90/c129 d16/d22/d4e/d90/c130 0 2024-09-21T12:47:29.512 INFO:tasks.workunit.client.0.smithi046.stdout:2/906: symlink d16/d22/d4e/d9d/ddf/l131 0 2024-09-21T12:47:29.513 INFO:tasks.workunit.client.0.smithi046.stdout:3/847: link d5/d16/d5f/d6c/fc4 d5/dc/dd5/f119 0 2024-09-21T12:47:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:7/906: dread d2/d4/df/d9a/fa0 [0,4194304] 0 2024-09-21T12:47:29.516 INFO:tasks.workunit.client.0.smithi046.stdout:3/848: read d5/dc/d30/d34/dd1/f74 [2118048,125960] 0 2024-09-21T12:47:29.517 INFO:tasks.workunit.client.0.smithi046.stdout:3/849: fdatasync d5/d16/d5f/df2/fd2 0 2024-09-21T12:47:29.518 INFO:tasks.workunit.client.0.smithi046.stdout:2/907: creat d16/d22/d4e/f132 x:0 0 0 2024-09-21T12:47:29.522 INFO:tasks.workunit.client.0.smithi046.stdout:2/908: creat d16/d22/d38/d118/f133 x:0 0 0 2024-09-21T12:47:29.524 INFO:tasks.workunit.client.0.smithi046.stdout:3/850: rename d5/dc/d28/f84 to d5/dc/d30/d34/dd1/f11a 0 2024-09-21T12:47:29.534 INFO:tasks.workunit.client.0.smithi046.stdout:2/909: link d16/d22/d75/f10a d16/d22/d38/d118/f134 0 2024-09-21T12:47:29.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/910: rename d16/d22/d38/c54 to d16/d22/d4e/da8/c135 0 2024-09-21T12:47:29.537 INFO:tasks.workunit.client.0.smithi046.stdout:2/911: dread - d16/d5c/d63/db4/f10d zero size 2024-09-21T12:47:29.539 INFO:tasks.workunit.client.0.smithi046.stdout:3/851: creat d5/d16/d5f/f11b x:0 0 0 2024-09-21T12:47:29.546 INFO:tasks.workunit.client.0.smithi046.stdout:3/852: creat d5/d16/d5f/d6c/f11c x:0 0 0 2024-09-21T12:47:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:7/907: dwrite d2/d4/df/d70/db2/fcd [0,4194304] 0 2024-09-21T12:47:29.553 INFO:tasks.workunit.client.0.smithi046.stdout:3/853: rename d5/dc/d94/da6/d101/l10e to d5/d16/d5f/d6c/l11d 0 2024-09-21T12:47:29.555 INFO:tasks.workunit.client.0.smithi046.stdout:2/912: getdents d16/d22/d4e/d90/dc6 0 2024-09-21T12:47:29.561 INFO:tasks.workunit.client.0.smithi046.stdout:7/908: write d2/d4/df/ff6 [1751938,77230] 0 2024-09-21T12:47:29.563 INFO:tasks.workunit.client.0.smithi046.stdout:7/909: dread - d2/d4/d43/dd6/d104/f11b zero size 2024-09-21T12:47:29.571 INFO:tasks.workunit.client.0.smithi046.stdout:3/854: link d5/dc/c87 d5/d5e/c11e 0 2024-09-21T12:47:29.575 INFO:tasks.workunit.client.0.smithi046.stdout:3/855: creat d5/dc/d94/f11f x:0 0 0 2024-09-21T12:47:29.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/856: mkdir d5/dc/d94/da6/d101/d120 0 2024-09-21T12:47:29.581 INFO:tasks.workunit.client.0.smithi046.stdout:2/913: truncate d16/d5c/d63/db4/dca/d116/fbc 19970 0 2024-09-21T12:47:29.582 INFO:tasks.workunit.client.0.smithi046.stdout:3/857: dread d5/d5e/d8e/db5/feb [0,4194304] 0 2024-09-21T12:47:29.585 INFO:tasks.workunit.client.0.smithi046.stdout:2/914: dread d16/f8d [0,4194304] 0 2024-09-21T12:47:29.586 INFO:tasks.workunit.client.0.smithi046.stdout:2/915: readlink d16/d22/d38/l86 0 2024-09-21T12:47:29.587 INFO:tasks.workunit.client.0.smithi046.stdout:7/910: truncate d2/d4/df/d70/db2/fcd 2393191 0 2024-09-21T12:47:29.593 INFO:tasks.workunit.client.0.smithi046.stdout:7/911: rmdir d2/d4/df/d70/d88/d34/d7f/de3 39 2024-09-21T12:47:29.594 INFO:tasks.workunit.client.0.smithi046.stdout:7/912: readlink d2/d4/df/d70/d88/l93 0 2024-09-21T12:47:29.595 INFO:tasks.workunit.client.0.smithi046.stdout:7/913: chown d2/dd/l18 0 1 2024-09-21T12:47:29.599 INFO:tasks.workunit.client.0.smithi046.stdout:6/712: sync 2024-09-21T12:47:29.599 INFO:tasks.workunit.client.0.smithi046.stdout:9/953: sync 2024-09-21T12:47:29.600 INFO:tasks.workunit.client.0.smithi046.stdout:7/914: unlink d2/d4/df/d42/lfe 0 2024-09-21T12:47:29.601 INFO:tasks.workunit.client.0.smithi046.stdout:6/713: read de/d2a/d4c/d71/d7c/f7e [3008514,28461] 0 2024-09-21T12:47:29.603 INFO:tasks.workunit.client.0.smithi046.stdout:7/915: write d2/d4/df/d17/f35 [2244039,85350] 0 2024-09-21T12:47:29.604 INFO:tasks.workunit.client.0.smithi046.stdout:3/858: dread d5/f10 [0,4194304] 0 2024-09-21T12:47:29.605 INFO:tasks.workunit.client.0.smithi046.stdout:2/916: write d16/d22/d4e/d90/dc6/fe4 [3999152,3187] 0 2024-09-21T12:47:29.610 INFO:tasks.workunit.client.0.smithi046.stdout:7/916: symlink d2/d4/df/d70/db2/dc5/l132 0 2024-09-21T12:47:29.612 INFO:tasks.workunit.client.0.smithi046.stdout:2/917: mknod d16/d22/d4e/da8/c136 0 2024-09-21T12:47:29.614 INFO:tasks.workunit.client.0.smithi046.stdout:7/917: fdatasync d2/d37/fb9 0 2024-09-21T12:47:29.616 INFO:tasks.workunit.client.0.smithi046.stdout:3/859: creat d5/dc/d28/d63/de2/d103/f121 x:0 0 0 2024-09-21T12:47:29.616 INFO:tasks.workunit.client.0.smithi046.stdout:7/918: write d2/d4/df/f109 [1196705,107754] 0 2024-09-21T12:47:29.617 INFO:tasks.workunit.client.0.smithi046.stdout:9/954: rename d11/d19/d1b/d31/d53/d84/d8f/cf8 to d11/d19/d1b/d31/c12d 0 2024-09-21T12:47:29.624 INFO:tasks.workunit.client.0.smithi046.stdout:9/955: dwrite d11/d19/d1b/d4b/f5f [4194304,4194304] 0 2024-09-21T12:47:29.629 INFO:tasks.workunit.client.0.smithi046.stdout:2/918: write d16/d5c/d63/db4/dca/dc1/feb [1176130,90724] 0 2024-09-21T12:47:29.633 INFO:tasks.workunit.client.0.smithi046.stdout:9/956: chown d11/d5b/d6f/db0/d30/c3d 250 1 2024-09-21T12:47:29.634 INFO:tasks.workunit.client.0.smithi046.stdout:9/957: chown d11/d5b/d6f/db0/d30/d90/cee 268122870 1 2024-09-21T12:47:29.637 INFO:tasks.workunit.client.0.smithi046.stdout:2/919: creat d16/d22/d38/d77/f137 x:0 0 0 2024-09-21T12:47:29.638 INFO:tasks.workunit.client.0.smithi046.stdout:2/920: chown d16/d5c/ce3 15365614 1 2024-09-21T12:47:29.639 INFO:tasks.workunit.client.0.smithi046.stdout:2/921: dread - d16/d22/d4e/d9d/ddf/f12c zero size 2024-09-21T12:47:29.641 INFO:tasks.workunit.client.0.smithi046.stdout:6/714: rename de/d2a/d4c/d77/d8f/d94/de7/cee to de/d2a/cef 0 2024-09-21T12:47:29.643 INFO:tasks.workunit.client.0.smithi046.stdout:9/958: mknod d11/d5b/d6f/dda/c12e 0 2024-09-21T12:47:29.644 INFO:tasks.workunit.client.0.smithi046.stdout:3/860: link d5/dc/f57 d5/dc/d30/d34/f122 0 2024-09-21T12:47:29.645 INFO:tasks.workunit.client.0.smithi046.stdout:3/861: read d5/d16/d5f/df2/f78 [2470076,60013] 0 2024-09-21T12:47:29.645 INFO:tasks.workunit.client.0.smithi046.stdout:7/919: getdents d2/d4/df/d70 0 2024-09-21T12:47:29.647 INFO:tasks.workunit.client.0.smithi046.stdout:2/922: mknod d16/d22/d4e/da6/c138 0 2024-09-21T12:47:29.648 INFO:tasks.workunit.client.0.smithi046.stdout:2/923: write d16/d5c/d63/db4/dd4/f112 [760954,94190] 0 2024-09-21T12:47:29.649 INFO:tasks.workunit.client.0.smithi046.stdout:6/715: unlink de/d2a/d34/fa9 0 2024-09-21T12:47:29.650 INFO:tasks.workunit.client.0.smithi046.stdout:9/959: unlink d11/d19/d36/d95/fed 0 2024-09-21T12:47:29.652 INFO:tasks.workunit.client.0.smithi046.stdout:7/920: fsync d2/d4/df/d17/f63 0 2024-09-21T12:47:29.653 INFO:tasks.workunit.client.0.smithi046.stdout:3/862: mkdir d5/d5e/d8e/dcf/d123 0 2024-09-21T12:47:29.656 INFO:tasks.workunit.client.0.smithi046.stdout:6/716: fdatasync de/d2a/d4d/f74 0 2024-09-21T12:47:29.666 INFO:tasks.workunit.client.0.smithi046.stdout:2/924: fsync d16/d22/d38/d77/d9e/fbe 0 2024-09-21T12:47:29.667 INFO:tasks.workunit.client.0.smithi046.stdout:2/925: fdatasync d16/d5c/f5d 0 2024-09-21T12:47:29.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/717: rmdir de/d2a/d4c 39 2024-09-21T12:47:29.675 INFO:tasks.workunit.client.0.smithi046.stdout:7/921: dread d2/d4/f3c [4194304,4194304] 0 2024-09-21T12:47:29.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/922: fsync d2/d37/f81 0 2024-09-21T12:47:29.676 INFO:tasks.workunit.client.0.smithi046.stdout:7/923: readlink d2/l50 0 2024-09-21T12:47:29.677 INFO:tasks.workunit.client.0.smithi046.stdout:9/960: fdatasync d11/d19/d1b/d31/d44/f12a 0 2024-09-21T12:47:29.678 INFO:tasks.workunit.client.0.smithi046.stdout:7/924: chown d2/d4/df/d70/d88/c11d 1917108530 1 2024-09-21T12:47:29.682 INFO:tasks.workunit.client.0.smithi046.stdout:2/926: creat d16/d22/d2b/d43/f139 x:0 0 0 2024-09-21T12:47:29.685 INFO:tasks.workunit.client.0.smithi046.stdout:6/718: mknod de/d35/cf0 0 2024-09-21T12:47:29.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/927: symlink d16/d22/d4e/d90/l13a 0 2024-09-21T12:47:29.688 INFO:tasks.workunit.client.0.smithi046.stdout:2/928: chown d16/d22/d4e 0 1 2024-09-21T12:47:29.690 INFO:tasks.workunit.client.0.smithi046.stdout:6/719: chown de/d2a/d4c/d77/dc0/lcc 11387 1 2024-09-21T12:47:29.691 INFO:tasks.workunit.client.0.smithi046.stdout:2/929: symlink d16/d22/d2b/d30/l13b 0 2024-09-21T12:47:29.692 INFO:tasks.workunit.client.0.smithi046.stdout:2/930: readlink d16/d22/d2b/d30/l104 0 2024-09-21T12:47:29.694 INFO:tasks.workunit.client.0.smithi046.stdout:2/931: read - d16/d22/d2b/d43/f139 zero size 2024-09-21T12:47:29.696 INFO:tasks.workunit.client.0.smithi046.stdout:6/720: truncate de/f1d 969199 0 2024-09-21T12:47:29.696 INFO:tasks.workunit.client.0.smithi046.stdout:2/932: fsync d16/f8d 0 2024-09-21T12:47:29.697 INFO:tasks.workunit.client.0.smithi046.stdout:9/961: dread d11/d5b/d6f/db0/d74/fa1 [0,4194304] 0 2024-09-21T12:47:29.698 INFO:tasks.workunit.client.0.smithi046.stdout:6/721: mknod de/d2a/d34/cf1 0 2024-09-21T12:47:29.698 INFO:tasks.workunit.client.0.smithi046.stdout:2/933: rmdir d16/d5c/d63/db4/dd4 39 2024-09-21T12:47:29.699 INFO:tasks.workunit.client.0.smithi046.stdout:2/934: readlink d16/d5c/d63/db4/dca/lc0 0 2024-09-21T12:47:29.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/722: symlink de/d35/lf2 0 2024-09-21T12:47:29.704 INFO:tasks.workunit.client.0.smithi046.stdout:2/935: mknod d16/d22/d2b/c13c 0 2024-09-21T12:47:29.707 INFO:tasks.workunit.client.0.smithi046.stdout:2/936: mkdir d16/d22/d4e/d9d/ddf/d13d 0 2024-09-21T12:47:29.711 INFO:tasks.workunit.client.0.smithi046.stdout:6/723: mknod de/d2a/d4c/d77/cf3 0 2024-09-21T12:47:29.713 INFO:tasks.workunit.client.0.smithi046.stdout:2/937: rename d16/d22/d38/d77/f9a to d16/d22/d38/f13e 0 2024-09-21T12:47:29.713 INFO:tasks.workunit.client.0.smithi046.stdout:2/938: chown d16/d22/d4e/d9d/ddf 263 1 2024-09-21T12:47:29.714 INFO:tasks.workunit.client.0.smithi046.stdout:9/962: write d11/d19/d1b/d31/d44/fa5 [1565503,20443] 0 2024-09-21T12:47:29.716 INFO:tasks.workunit.client.0.smithi046.stdout:9/963: write d11/d19/d1b/d31/f7d [2938203,125364] 0 2024-09-21T12:47:29.719 INFO:tasks.workunit.client.0.smithi046.stdout:2/939: mknod d16/d5c/de1/c13f 0 2024-09-21T12:47:29.720 INFO:tasks.workunit.client.0.smithi046.stdout:9/964: truncate d11/d19/d36/f42 154850 0 2024-09-21T12:47:29.723 INFO:tasks.workunit.client.0.smithi046.stdout:2/940: symlink d16/d5c/d63/db4/dca/dc1/l140 0 2024-09-21T12:47:29.726 INFO:tasks.workunit.client.0.smithi046.stdout:2/941: mknod d16/d22/d75/ded/c141 0 2024-09-21T12:47:29.727 INFO:tasks.workunit.client.0.smithi046.stdout:2/942: write d16/d22/d2b/d30/d8f/ffe [684533,50143] 0 2024-09-21T12:47:29.729 INFO:tasks.workunit.client.0.smithi046.stdout:2/943: mknod d16/c142 0 2024-09-21T12:47:29.734 INFO:tasks.workunit.client.0.smithi046.stdout:2/944: creat d16/d22/d126/f143 x:0 0 0 2024-09-21T12:47:29.735 INFO:tasks.workunit.client.0.smithi046.stdout:6/724: dwrite de/d2a/d4c/d71/d7c/f87 [4194304,4194304] 0 2024-09-21T12:47:29.736 INFO:tasks.workunit.client.0.smithi046.stdout:2/945: fsync d16/d22/d4e/d90/dc6/df0/f10f 0 2024-09-21T12:47:29.741 INFO:tasks.workunit.client.0.smithi046.stdout:9/965: write f4 [1204710,125958] 0 2024-09-21T12:47:29.745 INFO:tasks.workunit.client.0.smithi046.stdout:6/725: dread de/d2a/d4c/d69/fc3 [0,4194304] 0 2024-09-21T12:47:29.750 INFO:tasks.workunit.client.0.smithi046.stdout:9/966: dwrite d11/f12 [0,4194304] 0 2024-09-21T12:47:29.752 INFO:tasks.workunit.client.0.smithi046.stdout:9/967: chown d11/d5b/d6f/db0/d30/d3e/dbf 0 1 2024-09-21T12:47:29.755 INFO:tasks.workunit.client.0.smithi046.stdout:2/946: dread d16/d22/d2b/d30/f58 [0,4194304] 0 2024-09-21T12:47:29.758 INFO:tasks.workunit.client.0.smithi046.stdout:2/947: mknod d16/d5c/d63/d11d/c144 0 2024-09-21T12:47:29.759 INFO:tasks.workunit.client.0.smithi046.stdout:2/948: stat d16/d22/d4e/da6/la2 0 2024-09-21T12:47:29.762 INFO:tasks.workunit.client.0.smithi046.stdout:2/949: truncate d16/d22/d38/dac/f115 938775 0 2024-09-21T12:47:29.767 INFO:tasks.workunit.client.0.smithi046.stdout:6/726: dwrite de/d2a/d4c/f67 [0,4194304] 0 2024-09-21T12:47:29.768 INFO:tasks.workunit.client.0.smithi046.stdout:2/950: chown d16/d22/d4e/d90/c129 1804 1 2024-09-21T12:47:29.772 INFO:tasks.workunit.client.0.smithi046.stdout:9/968: dwrite d11/d19/f89 [4194304,4194304] 0 2024-09-21T12:47:29.774 INFO:tasks.workunit.client.0.smithi046.stdout:2/951: creat d16/d22/d38/d77/d9e/f145 x:0 0 0 2024-09-21T12:47:29.775 INFO:tasks.workunit.client.0.smithi046.stdout:2/952: chown d16/f21 153773559 1 2024-09-21T12:47:29.777 INFO:tasks.workunit.client.0.smithi046.stdout:6/727: dread de/d2a/d4c/d77/dae/d55/f95 [4194304,4194304] 0 2024-09-21T12:47:29.779 INFO:tasks.workunit.client.0.smithi046.stdout:6/728: mknod de/d2a/d4c/cf4 0 2024-09-21T12:47:29.780 INFO:tasks.workunit.client.0.smithi046.stdout:2/953: fdatasync d16/f25 0 2024-09-21T12:47:29.796 INFO:tasks.workunit.client.0.smithi046.stdout:9/969: dwrite f10 [0,4194304] 0 2024-09-21T12:47:29.798 INFO:tasks.workunit.client.0.smithi046.stdout:2/954: write d16/d5c/d63/db4/dca/fbb [9066360,11987] 0 2024-09-21T12:47:29.800 INFO:tasks.workunit.client.0.smithi046.stdout:9/970: mknod d11/d19/d1b/d31/c12f 0 2024-09-21T12:47:29.801 INFO:tasks.workunit.client.0.smithi046.stdout:9/971: chown d11/d19/d36/d45 42545881 1 2024-09-21T12:47:29.805 INFO:tasks.workunit.client.0.smithi046.stdout:2/955: truncate d16/d5c/d63/db4/dca/d116/f69 490473 0 2024-09-21T12:47:29.805 INFO:tasks.workunit.client.0.smithi046.stdout:6/729: link de/d48/f4a de/d2a/d4c/da6/ff5 0 2024-09-21T12:47:29.806 INFO:tasks.workunit.client.0.smithi046.stdout:2/956: readlink d16/d22/le8 0 2024-09-21T12:47:29.809 INFO:tasks.workunit.client.0.smithi046.stdout:6/730: mknod de/d48/cf6 0 2024-09-21T12:47:29.810 INFO:tasks.workunit.client.0.smithi046.stdout:2/957: fsync d16/d22/d38/dac/fb7 0 2024-09-21T12:47:29.813 INFO:tasks.workunit.client.0.smithi046.stdout:2/958: symlink d16/d5c/d63/d11d/l146 0 2024-09-21T12:47:29.815 INFO:tasks.workunit.client.0.smithi046.stdout:6/731: mkdir de/df7 0 2024-09-21T12:47:29.817 INFO:tasks.workunit.client.0.smithi046.stdout:6/732: chown de/d2a/d4d/cdf 1347 1 2024-09-21T12:47:29.820 INFO:tasks.workunit.client.0.smithi046.stdout:2/959: dwrite d16/d22/d4e/d90/dc6/fe4 [0,4194304] 0 2024-09-21T12:47:29.828 INFO:tasks.workunit.client.0.smithi046.stdout:2/960: creat d16/d22/d38/f147 x:0 0 0 2024-09-21T12:47:29.831 INFO:tasks.workunit.client.0.smithi046.stdout:2/961: creat d16/d22/d75/f148 x:0 0 0 2024-09-21T12:47:29.837 INFO:tasks.workunit.client.0.smithi046.stdout:6/733: dwrite de/d2a/d34/fd0 [0,4194304] 0 2024-09-21T12:47:29.839 INFO:tasks.workunit.client.0.smithi046.stdout:2/962: dread d16/d22/d2b/d30/d8f/f101 [0,4194304] 0 2024-09-21T12:47:29.847 INFO:tasks.workunit.client.0.smithi046.stdout:2/963: rename d16/d5c/d63/db4/dd4/f112 to d16/d22/d4e/da6/f149 0 2024-09-21T12:47:29.850 INFO:tasks.workunit.client.0.smithi046.stdout:2/964: symlink d16/d22/d38/l14a 0 2024-09-21T12:47:29.855 INFO:tasks.workunit.client.0.smithi046.stdout:6/734: dwrite de/f20 [0,4194304] 0 2024-09-21T12:47:29.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/965: mknod d16/d5c/d63/db4/dd4/c14b 0 2024-09-21T12:47:29.864 INFO:tasks.workunit.client.0.smithi046.stdout:2/966: dread - d16/d22/d126/f143 zero size 2024-09-21T12:47:29.866 INFO:tasks.workunit.client.0.smithi046.stdout:2/967: dread d16/d5c/d63/f6b [0,4194304] 0 2024-09-21T12:47:29.867 INFO:tasks.workunit.client.0.smithi046.stdout:2/968: readlink d16/d22/d2b/d43/l4d 0 2024-09-21T12:47:29.871 INFO:tasks.workunit.client.0.smithi046.stdout:2/969: creat d16/d22/d4e/d9d/ddf/f14c x:0 0 0 2024-09-21T12:47:29.875 INFO:tasks.workunit.client.0.smithi046.stdout:2/970: rename d16/d5c/d63/db4/dca/d116/fe6 to d16/d5c/de1/f14d 0 2024-09-21T12:47:29.880 INFO:tasks.workunit.client.0.smithi046.stdout:2/971: mkdir d16/d14e 0 2024-09-21T12:47:29.882 INFO:tasks.workunit.client.0.smithi046.stdout:2/972: mknod d16/d5c/d63/db4/dca/d116/c14f 0 2024-09-21T12:47:29.899 INFO:tasks.workunit.client.0.smithi046.stdout:2/973: write d16/d5c/d63/db4/dca/d116/f69 [1262618,121859] 0 2024-09-21T12:47:29.902 INFO:tasks.workunit.client.0.smithi046.stdout:2/974: creat d16/d22/d4e/da8/f150 x:0 0 0 2024-09-21T12:47:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:2/975: dwrite d16/f48 [0,4194304] 0 2024-09-21T12:47:29.908 INFO:tasks.workunit.client.0.smithi046.stdout:2/976: stat d16/d22/f29 0 2024-09-21T12:47:29.909 INFO:tasks.workunit.client.0.smithi046.stdout:1/903: sync 2024-09-21T12:47:29.910 INFO:tasks.workunit.client.0.smithi046.stdout:5/884: sync 2024-09-21T12:47:29.911 INFO:tasks.workunit.client.0.smithi046.stdout:1/904: readlink d4/d13/l33 0 2024-09-21T12:47:29.911 INFO:tasks.workunit.client.0.smithi046.stdout:2/977: truncate d16/d22/d38/d118/f133 654077 0 2024-09-21T12:47:29.913 INFO:tasks.workunit.client.0.smithi046.stdout:2/978: chown d16/d22/d38/dac/fc9 96570 1 2024-09-21T12:47:29.914 INFO:tasks.workunit.client.0.smithi046.stdout:1/905: read - d4/d29/d32/d9e/d5d/d8c/d92/f136 zero size 2024-09-21T12:47:29.916 INFO:tasks.workunit.client.0.smithi046.stdout:5/885: creat d4/d22/d99/de7/f121 x:0 0 0 2024-09-21T12:47:29.921 INFO:tasks.workunit.client.0.smithi046.stdout:1/906: creat d4/d13/d79/dbd/f139 x:0 0 0 2024-09-21T12:47:29.922 INFO:tasks.workunit.client.0.smithi046.stdout:2/979: dread d16/d22/d75/fcf [0,4194304] 0 2024-09-21T12:47:30.067 INFO:tasks.workunit.client.0.smithi046.stdout:5/886: rmdir d4/dc/d13/da2/dce 39 2024-09-21T12:47:30.069 INFO:tasks.workunit.client.0.smithi046.stdout:1/907: readlink d4/d29/l3a 0 2024-09-21T12:47:30.070 INFO:tasks.workunit.client.0.smithi046.stdout:2/980: mkdir d16/d22/d4e/d90/dc6/df0/d151 0 2024-09-21T12:47:30.075 INFO:tasks.workunit.client.0.smithi046.stdout:2/981: rmdir d16 39 2024-09-21T12:47:30.076 INFO:tasks.workunit.client.0.smithi046.stdout:5/887: rmdir d4/dc/d13/da2/dce/d109/d1a/d9e 39 2024-09-21T12:47:30.079 INFO:tasks.workunit.client.0.smithi046.stdout:5/888: mknod d4/dc/d13/d5b/d2d/c122 0 2024-09-21T12:47:30.086 INFO:tasks.workunit.client.0.smithi046.stdout:5/889: rename d4/dc/d13/d5b/c82 to d4/dc/d13/d5b/d2d/d43/c123 0 2024-09-21T12:47:30.090 INFO:tasks.workunit.client.0.smithi046.stdout:2/982: link d16/d22/d38/l93 d16/d5c/d63/db4/dd4/l152 0 2024-09-21T12:47:30.091 INFO:tasks.workunit.client.0.smithi046.stdout:2/983: read d16/f1d [32917,105646] 0 2024-09-21T12:47:30.094 INFO:tasks.workunit.client.0.smithi046.stdout:5/890: dread d4/dc/d13/da2/dce/d109/d1a/d9e/fd6 [0,4194304] 0 2024-09-21T12:47:30.096 INFO:tasks.workunit.client.0.smithi046.stdout:2/984: creat d16/d22/d4e/d90/f153 x:0 0 0 2024-09-21T12:47:30.098 INFO:tasks.workunit.client.0.smithi046.stdout:2/985: readlink d16/d5c/d63/d11d/l146 0 2024-09-21T12:47:30.102 INFO:tasks.workunit.client.0.smithi046.stdout:2/986: mknod d16/d22/d38/c154 0 2024-09-21T12:47:30.112 INFO:tasks.workunit.client.0.smithi046.stdout:5/891: dread d4/dc/fa6 [0,4194304] 0 2024-09-21T12:47:30.125 INFO:tasks.workunit.client.0.smithi046.stdout:1/908: dwrite d4/d13/d79/fe3 [0,4194304] 0 2024-09-21T12:47:30.127 INFO:tasks.workunit.client.0.smithi046.stdout:1/909: write d4/f11c [316679,35067] 0 2024-09-21T12:47:30.127 INFO:tasks.workunit.client.0.smithi046.stdout:1/910: symlink d4/d29/d32/d9e/d11f/d53/d80/d8b/dc3/l13a 2 2024-09-21T12:47:30.191 INFO:tasks.workunit.client.0.smithi046.stdout:5/892: mkdir d4/dc/d13/da2/d10e/d124 0 2024-09-21T12:47:30.195 INFO:tasks.workunit.client.0.smithi046.stdout:1/911: creat d4/d13/d79/dbd/f13b x:0 0 0 2024-09-21T12:47:30.196 INFO:tasks.workunit.client.0.smithi046.stdout:5/893: fdatasync d4/dc/d13/d5b/d2d/d43/ddb/fe9 0 2024-09-21T12:47:30.200 INFO:tasks.workunit.client.0.smithi046.stdout:1/912: creat d4/d29/d32/d9e/d11f/d4f/d83/f13c x:0 0 0 2024-09-21T12:47:30.200 INFO:tasks.workunit.client.0.smithi046.stdout:5/894: rmdir d4/dc/d13/d15/d5c 39 2024-09-21T12:47:30.201 INFO:tasks.workunit.client.0.smithi046.stdout:5/895: stat d4/d22/d99/de7/c10b 0 2024-09-21T12:47:30.202 INFO:tasks.workunit.client.0.smithi046.stdout:1/913: rmdir d4/d29/d32/d9e/d5d/d8c/d92 39 2024-09-21T12:47:30.206 INFO:tasks.workunit.client.0.smithi046.stdout:1/914: dread - d4/d29/d32/d9e/d5d/d8c/d92/fd4 zero size 2024-09-21T12:47:30.206 INFO:tasks.workunit.client.0.smithi046.stdout:1/915: readlink d4/d13/l33 0 2024-09-21T12:47:30.210 INFO:tasks.workunit.client.0.smithi046.stdout:1/916: rename d4/d29/lfa to d4/d29/d32/d9e/d11f/d53/d80/d95/da5/l13d 0 2024-09-21T12:47:30.213 INFO:tasks.workunit.client.0.smithi046.stdout:5/896: dread d4/dc/d13/f38 [0,4194304] 0 2024-09-21T12:47:30.214 INFO:tasks.workunit.client.0.smithi046.stdout:1/917: creat d4/d29/d32/d9e/d11f/d4f/d83/dd5/f13e x:0 0 0 2024-09-21T12:47:30.218 INFO:tasks.workunit.client.0.smithi046.stdout:1/918: truncate d4/d29/d32/d9e/d11f/d4f/d83/da9/f107 2549658 0 2024-09-21T12:47:30.219 INFO:tasks.workunit.client.0.smithi046.stdout:1/919: chown d4/d29/d32/d9e/d5d 38952 1 2024-09-21T12:47:30.221 INFO:tasks.workunit.client.0.smithi046.stdout:1/920: stat d4/d29/d32/d9e/d5d/d8c/d94/fbf 0 2024-09-21T12:47:30.221 INFO:tasks.workunit.client.0.smithi046.stdout:5/897: dwrite d4/dc/d13/d5b/d2d/d43/fed [0,4194304] 0 2024-09-21T12:47:30.225 INFO:tasks.workunit.client.0.smithi046.stdout:5/898: chown d4/dc/d13/d5b/d2d/d43/c123 167 1 2024-09-21T12:47:30.227 INFO:tasks.workunit.client.0.smithi046.stdout:1/921: creat d4/d29/d32/d9e/d11f/d4f/f13f x:0 0 0 2024-09-21T12:47:30.230 INFO:tasks.workunit.client.0.smithi046.stdout:5/899: dread d4/dc/d45/f49 [0,4194304] 0 2024-09-21T12:47:30.230 INFO:tasks.workunit.client.0.smithi046.stdout:1/922: unlink d4/d4d/fcb 0 2024-09-21T12:47:30.235 INFO:tasks.workunit.client.0.smithi046.stdout:1/923: mknod d4/d29/d32/d9e/d11f/d4f/d83/dd5/c140 0 2024-09-21T12:47:30.239 INFO:tasks.workunit.client.0.smithi046.stdout:1/924: rename d4/fb2 to d4/d29/d32/d9e/d5d/f141 0 2024-09-21T12:47:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/925: rename d4/d29/d32/d9e/d11f/d53/d80/d95/da5/fb6 to d4/d29/d32/d9e/d5d/d8c/d92/dcc/d102/f142 0 2024-09-21T12:47:30.245 INFO:tasks.workunit.client.0.smithi046.stdout:1/926: mknod d4/d4d/dda/d116/c143 0 2024-09-21T12:47:30.254 INFO:tasks.workunit.client.0.smithi046.stdout:3/863: sync 2024-09-21T12:47:30.255 INFO:tasks.workunit.client.0.smithi046.stdout:3/864: chown d5/d16/d5f/df2/d3c/fbc 0 1 2024-09-21T12:47:30.258 INFO:tasks.workunit.client.0.smithi046.stdout:1/927: dread d4/d13/f1d [0,4194304] 0 2024-09-21T12:47:30.258 INFO:tasks.workunit.client.0.smithi046.stdout:3/865: mknod d5/dc/d94/da6/c124 0 2024-09-21T12:47:30.260 INFO:tasks.workunit.client.0.smithi046.stdout:5/900: dread d4/dc/d13/da2/dce/dfe/f11c [0,4194304] 0 2024-09-21T12:47:30.272 INFO:tasks.workunit.client.0.smithi046.stdout:3/866: dwrite d5/d16/d5f/d6c/fc4 [0,4194304] 0 2024-09-21T12:47:30.273 INFO:tasks.workunit.client.0.smithi046.stdout:1/928: dwrite d4/d29/d32/d9e/d5d/d8c/d94/fbc [0,4194304] 0 2024-09-21T12:47:30.274 INFO:tasks.workunit.client.0.smithi046.stdout:5/901: rmdir d4/dc/d45/dd7/d119 0 2024-09-21T12:47:30.282 INFO:tasks.workunit.client.0.smithi046.stdout:3/867: mknod d5/dc/d30/d7c/c125 0 2024-09-21T12:47:30.287 INFO:tasks.workunit.client.0.smithi046.stdout:5/902: getdents d4/d22/d99/de7/df3/d101 0 2024-09-21T12:47:30.291 INFO:tasks.workunit.client.0.smithi046.stdout:3/868: truncate d5/dc/d28/d60/fae 3025984 0 2024-09-21T12:47:30.296 INFO:tasks.workunit.client.0.smithi046.stdout:5/903: dwrite d4/dc/d13/da2/d110/f118 [0,4194304] 0 2024-09-21T12:47:30.300 INFO:tasks.workunit.client.0.smithi046.stdout:1/929: dwrite d4/f18 [0,4194304] 0 2024-09-21T12:47:30.302 INFO:tasks.workunit.client.0.smithi046.stdout:5/904: creat d4/dc/d45/f125 x:0 0 0 2024-09-21T12:47:30.306 INFO:tasks.workunit.client.0.smithi046.stdout:3/869: getdents d5/d16/d5f/d6c 0 2024-09-21T12:47:30.307 INFO:tasks.workunit.client.0.smithi046.stdout:1/930: fdatasync d4/d13/d6b/fa3 0 2024-09-21T12:47:30.310 INFO:tasks.workunit.client.0.smithi046.stdout:3/870: fdatasync d5/d16/d5f/df2/d3c/f4e 0 2024-09-21T12:47:30.313 INFO:tasks.workunit.client.0.smithi046.stdout:1/931: creat d4/d4d/f144 x:0 0 0 2024-09-21T12:47:30.316 INFO:tasks.workunit.client.0.smithi046.stdout:3/871: chown d5/d16/d5f/ld8 10499 1 2024-09-21T12:47:30.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:29 smithi176 ceph-mon[35476]: pgmap v41: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 55 MiB/s rd, 139 MiB/s wr, 370 op/s 2024-09-21T12:47:30.317 INFO:tasks.workunit.client.0.smithi046.stdout:1/932: creat d4/d29/d32/d9e/d5d/f145 x:0 0 0 2024-09-21T12:47:30.319 INFO:tasks.workunit.client.0.smithi046.stdout:1/933: fsync d4/d29/d32/d9e/d11f/d4f/d83/f13c 0 2024-09-21T12:47:30.320 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:29 smithi046 ceph-mon[27868]: pgmap v41: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 55 MiB/s rd, 139 MiB/s wr, 370 op/s 2024-09-21T12:47:30.321 INFO:tasks.workunit.client.0.smithi046.stdout:6/735: sync 2024-09-21T12:47:30.321 INFO:tasks.workunit.client.0.smithi046.stdout:9/972: sync 2024-09-21T12:47:30.321 INFO:tasks.workunit.client.0.smithi046.stdout:7/925: sync 2024-09-21T12:47:30.321 INFO:tasks.workunit.client.0.smithi046.stdout:2/987: sync 2024-09-21T12:47:30.322 INFO:tasks.workunit.client.0.smithi046.stdout:3/872: creat d5/d5e/d8e/dcf/d123/f126 x:0 0 0 2024-09-21T12:47:30.324 INFO:tasks.workunit.client.0.smithi046.stdout:5/905: truncate d4/d22/d99/dc7/f66 7802985 0 2024-09-21T12:47:30.329 INFO:tasks.workunit.client.0.smithi046.stdout:6/736: chown de/d2a/d4c/d71/d7c/f7e 105967 1 2024-09-21T12:47:30.330 INFO:tasks.workunit.client.0.smithi046.stdout:1/934: dwrite d4/d29/d32/d9e/d11f/d4f/d83/da9/fc4 [4194304,4194304] 0 2024-09-21T12:47:30.334 INFO:tasks.workunit.client.0.smithi046.stdout:1/935: read d4/f1b [3233021,38855] 0 2024-09-21T12:47:30.336 INFO:tasks.workunit.client.0.smithi046.stdout:1/936: chown d4/d29/d32/d9e/d11f/d53/fb3 6 1 2024-09-21T12:47:30.339 INFO:tasks.workunit.client.0.smithi046.stdout:3/873: creat d5/d16/d5f/d6c/f127 x:0 0 0 2024-09-21T12:47:30.344 INFO:tasks.workunit.client.0.smithi046.stdout:2/988: write d16/d5c/fb5 [581147,68007] 0 2024-09-21T12:47:30.358 INFO:tasks.workunit.client.0.smithi046.stdout:5/906: rename d4/d22/lb to d4/dc/d13/d5b/d2d/d43/ddb/l126 0 2024-09-21T12:47:30.359 INFO:tasks.workunit.client.0.smithi046.stdout:9/973: dwrite d11/d5b/d6f/fd9 [0,4194304] 0 2024-09-21T12:47:30.359 INFO:tasks.workunit.client.0.smithi046.stdout:7/926: dwrite d2/d4/df/d6f/f76 [0,4194304] 0 2024-09-21T12:47:30.362 INFO:tasks.workunit.client.0.smithi046.stdout:7/927: chown d2/d4/df/d42/f87 83091953 1 2024-09-21T12:47:30.364 INFO:tasks.workunit.client.0.smithi046.stdout:1/937: mkdir d4/d13/d146 0 2024-09-21T12:47:30.365 INFO:tasks.workunit.client.0.smithi046.stdout:7/928: chown d2/d4/df/d9a/dc3/dc4 15076 1 2024-09-21T12:47:30.370 INFO:tasks.workunit.client.0.smithi046.stdout:5/907: dwrite d4/dc/d13/da2/dce/d109/d1a/d9e/da7/f10f [0,4194304] 0 2024-09-21T12:47:30.372 INFO:tasks.workunit.client.0.smithi046.stdout:2/989: rename d16/d22/f29 to d16/d22/d4e/d9d/ddf/d13d/f155 0 2024-09-21T12:47:30.374 INFO:tasks.workunit.client.0.smithi046.stdout:2/990: fdatasync d16/d22/d4e/fad 0 2024-09-21T12:47:30.380 INFO:tasks.workunit.client.0.smithi046.stdout:1/938: creat d4/d4d/dda/d116/f147 x:0 0 0 2024-09-21T12:47:30.383 INFO:tasks.workunit.client.0.smithi046.stdout:7/929: dread d2/d4/f2f [0,4194304] 0 2024-09-21T12:47:30.388 INFO:tasks.workunit.client.0.smithi046.stdout:6/737: dwrite de/d2a/d4c/d77/dae/fc4 [0,4194304] 0 2024-09-21T12:47:30.390 INFO:tasks.workunit.client.0.smithi046.stdout:2/991: creat d16/d22/d4e/da8/f156 x:0 0 0 2024-09-21T12:47:30.390 INFO:tasks.workunit.client.0.smithi046.stdout:3/874: getdents d5/dc/dd5 0 2024-09-21T12:47:30.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/738: chown de/d2a/d4d/f7d 7070654 1 2024-09-21T12:47:30.391 INFO:tasks.workunit.client.0.smithi046.stdout:5/908: mknod d4/dc/d13/c127 0 2024-09-21T12:47:30.393 INFO:tasks.workunit.client.0.smithi046.stdout:1/939: rename d4/d29 to d4/d13/d79/dbd/d148 0 2024-09-21T12:47:30.395 INFO:tasks.workunit.client.0.smithi046.stdout:3/875: symlink d5/dc/d94/da6/d101/l128 0 2024-09-21T12:47:30.397 INFO:tasks.workunit.client.0.smithi046.stdout:2/992: mkdir d16/d22/d2b/d43/d157 0 2024-09-21T12:47:30.401 INFO:tasks.workunit.client.0.smithi046.stdout:9/974: dread d11/f99 [0,4194304] 0 2024-09-21T12:47:30.402 INFO:tasks.workunit.client.0.smithi046.stdout:6/739: truncate de/d2a/f2f 952564 0 2024-09-21T12:47:30.403 INFO:tasks.workunit.client.0.smithi046.stdout:7/930: write d2/d37/d8a/d99/fc0 [165099,50287] 0 2024-09-21T12:47:30.404 INFO:tasks.workunit.client.0.smithi046.stdout:3/876: rmdir d5/d5e/d8e/dcf 39 2024-09-21T12:47:30.406 INFO:tasks.workunit.client.0.smithi046.stdout:2/993: write d16/d5c/d63/db4/dd4/f12d [616867,126192] 0 2024-09-21T12:47:30.407 INFO:tasks.workunit.client.0.smithi046.stdout:6/740: write de/f15 [4053899,45327] 0 2024-09-21T12:47:30.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/940: dwrite d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/ffd [0,4194304] 0 2024-09-21T12:47:30.410 INFO:tasks.workunit.client.0.smithi046.stdout:5/909: link d4/dc/d13/da2/dce/ldc d4/dc/d13/d5b/l128 0 2024-09-21T12:47:30.414 INFO:tasks.workunit.client.0.smithi046.stdout:7/931: creat d2/d4/df/d9a/dc3/f133 x:0 0 0 2024-09-21T12:47:30.415 INFO:tasks.workunit.client.0.smithi046.stdout:6/741: symlink de/d2a/d4c/da6/lf8 0 2024-09-21T12:47:30.418 INFO:tasks.workunit.client.0.smithi046.stdout:6/742: chown de/d35/l3d 28224939 1 2024-09-21T12:47:30.425 INFO:tasks.workunit.client.0.smithi046.stdout:3/877: dwrite d5/d5e/d8e/db5/feb [0,4194304] 0 2024-09-21T12:47:30.426 INFO:tasks.workunit.client.0.smithi046.stdout:2/994: dread d16/d22/d4e/d90/dc6/fe4 [0,4194304] 0 2024-09-21T12:47:30.429 INFO:tasks.workunit.client.0.smithi046.stdout:9/975: link d11/d19/l3a d11/d5b/d6f/db0/d30/d90/l130 0 2024-09-21T12:47:30.432 INFO:tasks.workunit.client.0.smithi046.stdout:2/995: fdatasync d16/f1a 0 2024-09-21T12:47:30.436 INFO:tasks.workunit.client.0.smithi046.stdout:6/743: dwrite de/d2a/d34/db6/fd7 [0,4194304] 0 2024-09-21T12:47:30.439 INFO:tasks.workunit.client.0.smithi046.stdout:9/976: mknod d11/d5b/d6f/db0/d74/c131 0 2024-09-21T12:47:30.442 INFO:tasks.workunit.client.0.smithi046.stdout:5/910: write d4/dc/d13/f81 [2557781,125331] 0 2024-09-21T12:47:30.444 INFO:tasks.workunit.client.0.smithi046.stdout:2/996: symlink d16/d22/d4e/d90/l158 0 2024-09-21T12:47:30.447 INFO:tasks.workunit.client.0.smithi046.stdout:6/744: mknod de/d2a/d4d/cf9 0 2024-09-21T12:47:30.448 INFO:tasks.workunit.client.0.smithi046.stdout:1/941: link d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d95/da5/ccd d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d92/dcc/d102/c149 0 2024-09-21T12:47:30.452 INFO:tasks.workunit.client.0.smithi046.stdout:7/932: dwrite d2/d4/f54 [4194304,4194304] 0 2024-09-21T12:47:30.453 INFO:tasks.workunit.client.0.smithi046.stdout:3/878: rename d5/l22 to d5/dc/d30/l129 0 2024-09-21T12:47:30.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/745: chown de/f16 3638 1 2024-09-21T12:47:30.463 INFO:tasks.workunit.client.0.smithi046.stdout:1/942: write d4/d13/f1d [5074633,13256] 0 2024-09-21T12:47:30.465 INFO:tasks.workunit.client.0.smithi046.stdout:7/933: symlink d2/d4/df/d17/l134 0 2024-09-21T12:47:30.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/879: mknod d5/dc/d28/d63/c12a 0 2024-09-21T12:47:30.480 INFO:tasks.workunit.client.0.smithi046.stdout:2/997: dwrite d16/d22/d38/f42 [0,4194304] 0 2024-09-21T12:47:30.481 INFO:tasks.workunit.client.0.smithi046.stdout:9/977: link d11/d19/d1b/d31/d53/d58/c11d d11/d19/df2/df3/c132 0 2024-09-21T12:47:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:2/998: dread - d16/d22/d4e/da8/f150 zero size 2024-09-21T12:47:30.483 INFO:tasks.workunit.client.0.smithi046.stdout:3/880: mknod d5/d5e/d8e/de8/c12b 0 2024-09-21T12:47:30.485 INFO:tasks.workunit.client.0.smithi046.stdout:5/911: truncate d4/dc/d13/da2/dce/d109/faa 164323 0 2024-09-21T12:47:30.486 INFO:tasks.workunit.client.0.smithi046.stdout:1/943: write d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/fe4 [249427,42849] 0 2024-09-21T12:47:30.490 INFO:tasks.workunit.client.0.smithi046.stdout:1/944: dread - d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/f13f zero size 2024-09-21T12:47:30.493 INFO:tasks.workunit.client.0.smithi046.stdout:6/746: dwrite de/fda [0,4194304] 0 2024-09-21T12:47:30.498 INFO:tasks.workunit.client.0.smithi046.stdout:5/912: creat d4/dc/d45/dd7/f129 x:0 0 0 2024-09-21T12:47:30.501 INFO:tasks.workunit.client.0.smithi046.stdout:7/934: rename d2/d4/df/d70/d88/l93 to d2/d37/l135 0 2024-09-21T12:47:30.503 INFO:tasks.workunit.client.0.smithi046.stdout:2/999: mknod d16/d22/c159 0 2024-09-21T12:47:30.506 INFO:tasks.workunit.client.0.smithi046.stdout:1/945: mkdir d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d8b/d14a 0 2024-09-21T12:47:30.509 INFO:tasks.workunit.client.0.smithi046.stdout:3/881: getdents d5/dc/d94/dcc 0 2024-09-21T12:47:30.512 INFO:tasks.workunit.client.0.smithi046.stdout:5/913: creat d4/dc/f12a x:0 0 0 2024-09-21T12:47:30.518 INFO:tasks.workunit.client.0.smithi046.stdout:9/978: link d11/d19/df2/f115 d11/d5b/dcf/f133 0 2024-09-21T12:47:30.520 INFO:tasks.workunit.client.0.smithi046.stdout:1/946: truncate d4/d13/d79/dbd/f86 162401 0 2024-09-21T12:47:30.525 INFO:tasks.workunit.client.0.smithi046.stdout:5/914: unlink d4/dc/d45/d94/fc8 0 2024-09-21T12:47:30.528 INFO:tasks.workunit.client.0.smithi046.stdout:9/979: fsync d11/d19/d1b/d31/feb 0 2024-09-21T12:47:30.538 INFO:tasks.workunit.client.0.smithi046.stdout:5/915: creat d4/dc/d13/d5b/d2d/d43/d7a/f12b x:0 0 0 2024-09-21T12:47:30.539 INFO:tasks.workunit.client.0.smithi046.stdout:7/935: dwrite d2/d37/d8a/d99/f113 [0,4194304] 0 2024-09-21T12:47:30.544 INFO:tasks.workunit.client.0.smithi046.stdout:3/882: truncate d5/d16/d5f/fa2 2994840 0 2024-09-21T12:47:30.545 INFO:tasks.workunit.client.0.smithi046.stdout:3/883: stat d5/dc/d28/d63/de2/lfb 0 2024-09-21T12:47:30.548 INFO:tasks.workunit.client.0.smithi046.stdout:9/980: creat d11/d19/d1b/d31/d44/da7/f134 x:0 0 0 2024-09-21T12:47:30.554 INFO:tasks.workunit.client.0.smithi046.stdout:5/916: unlink d4/dc/d13/f50 0 2024-09-21T12:47:30.556 INFO:tasks.workunit.client.0.smithi046.stdout:9/981: dwrite d11/d19/d1b/d31/d44/dff/f116 [0,4194304] 0 2024-09-21T12:47:30.568 INFO:tasks.workunit.client.0.smithi046.stdout:1/947: rename d4/d13/d79/dbd/d148/d32/f3f to d4/f14b 0 2024-09-21T12:47:30.568 INFO:tasks.workunit.client.0.smithi046.stdout:5/917: dread - d4/dc/d45/d94/ff6 zero size 2024-09-21T12:47:30.572 INFO:tasks.workunit.client.0.smithi046.stdout:9/982: creat d11/d19/d1b/d31/d53/f135 x:0 0 0 2024-09-21T12:47:30.573 INFO:tasks.workunit.client.0.smithi046.stdout:3/884: fsync d5/dc/f57 0 2024-09-21T12:47:30.575 INFO:tasks.workunit.client.0.smithi046.stdout:5/918: dread d4/dc/d13/d5b/d2d/d43/fed [0,4194304] 0 2024-09-21T12:47:30.577 INFO:tasks.workunit.client.0.smithi046.stdout:7/936: rename d2/d37/d8a/f128 to d2/d4/df/d9a/dc3/f136 0 2024-09-21T12:47:30.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/885: dwrite d5/d16/d5f/f11b [0,4194304] 0 2024-09-21T12:47:30.585 INFO:tasks.workunit.client.0.smithi046.stdout:9/983: rmdir d11/d19/d36/d45/dfd 39 2024-09-21T12:47:30.590 INFO:tasks.workunit.client.0.smithi046.stdout:1/948: dwrite d4/d4d/f122 [0,4194304] 0 2024-09-21T12:47:30.593 INFO:tasks.workunit.client.0.smithi046.stdout:9/984: creat d11/d19/d1b/f136 x:0 0 0 2024-09-21T12:47:30.596 INFO:tasks.workunit.client.0.smithi046.stdout:1/949: mkdir d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d92/dcc/d14c 0 2024-09-21T12:47:30.599 INFO:tasks.workunit.client.0.smithi046.stdout:9/985: rename d11/d5b/d6f/db0/d74/l88 to d11/d19/d1b/d31/d44/dff/l137 0 2024-09-21T12:47:30.604 INFO:tasks.workunit.client.0.smithi046.stdout:9/986: creat d11/d19/d93/f138 x:0 0 0 2024-09-21T12:47:30.605 INFO:tasks.workunit.client.0.smithi046.stdout:5/919: dread d4/dc/d13/f35 [0,4194304] 0 2024-09-21T12:47:30.606 INFO:tasks.workunit.client.0.smithi046.stdout:9/987: chown d11/d19/d1b/d31/d53/d58/f62 8158519 1 2024-09-21T12:47:30.611 INFO:tasks.workunit.client.0.smithi046.stdout:9/988: symlink d11/d5b/d6f/db0/d30/d3e/dbf/l139 0 2024-09-21T12:47:30.611 INFO:tasks.workunit.client.0.smithi046.stdout:7/937: write d2/d4/d43/f5d [4154123,108787] 0 2024-09-21T12:47:30.614 INFO:tasks.workunit.client.0.smithi046.stdout:5/920: read - d4/d22/fc0 zero size 2024-09-21T12:47:30.615 INFO:tasks.workunit.client.0.smithi046.stdout:5/921: write d4/dc/d45/f87 [4404724,85186] 0 2024-09-21T12:47:30.615 INFO:tasks.workunit.client.0.smithi046.stdout:7/938: symlink d2/d37/d77/l137 0 2024-09-21T12:47:30.617 INFO:tasks.workunit.client.0.smithi046.stdout:5/922: chown d4/dc/d13/f38 1 1 2024-09-21T12:47:30.623 INFO:tasks.workunit.client.0.smithi046.stdout:3/886: dwrite d5/fa0 [0,4194304] 0 2024-09-21T12:47:30.624 INFO:tasks.workunit.client.0.smithi046.stdout:7/939: truncate d2/d4/df/d9a/dc3/f133 572460 0 2024-09-21T12:47:30.625 INFO:tasks.workunit.client.0.smithi046.stdout:5/923: symlink d4/dc/d13/d15/d5c/l12c 0 2024-09-21T12:47:30.630 INFO:tasks.workunit.client.0.smithi046.stdout:1/950: dwrite d4/f22 [0,4194304] 0 2024-09-21T12:47:30.633 INFO:tasks.workunit.client.0.smithi046.stdout:7/940: truncate d2/d37/f82 8440103 0 2024-09-21T12:47:30.634 INFO:tasks.workunit.client.0.smithi046.stdout:5/924: fdatasync d4/d22/d99/fc6 0 2024-09-21T12:47:30.642 INFO:tasks.workunit.client.0.smithi046.stdout:1/951: creat d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/df2/f14d x:0 0 0 2024-09-21T12:47:30.643 INFO:tasks.workunit.client.0.smithi046.stdout:7/941: creat d2/d4/df/d9a/dc3/f138 x:0 0 0 2024-09-21T12:47:30.646 INFO:tasks.workunit.client.0.smithi046.stdout:5/925: rmdir d4/d22/d99 39 2024-09-21T12:47:30.648 INFO:tasks.workunit.client.0.smithi046.stdout:5/926: write d4/dc/d13/da2/dce/d109/f52 [872051,110176] 0 2024-09-21T12:47:30.648 INFO:tasks.workunit.client.0.smithi046.stdout:7/942: chown d2/d4/d43/ca2 119680352 1 2024-09-21T12:47:30.651 INFO:tasks.workunit.client.0.smithi046.stdout:7/943: fdatasync d2/d37/d77/fde 0 2024-09-21T12:47:30.656 INFO:tasks.workunit.client.0.smithi046.stdout:7/944: rename d2/d4/df/d70/d88/d34/l115 to d2/d37/d8a/l139 0 2024-09-21T12:47:30.658 INFO:tasks.workunit.client.0.smithi046.stdout:7/945: symlink d2/dd/l13a 0 2024-09-21T12:47:30.659 INFO:tasks.workunit.client.0.smithi046.stdout:1/952: write d4/d13/d79/dbd/d148/d32/d9e/f65 [3355033,55701] 0 2024-09-21T12:47:30.661 INFO:tasks.workunit.client.0.smithi046.stdout:7/946: chown d2/d4/df/d17/fc1 50 1 2024-09-21T12:47:30.661 INFO:tasks.workunit.client.0.smithi046.stdout:1/953: chown d4/d13/d79/dbd/d148/d32/d9e/d11f/fa1 485048237 1 2024-09-21T12:47:30.663 INFO:tasks.workunit.client.0.smithi046.stdout:1/954: dread - d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d95/da5/f131 zero size 2024-09-21T12:47:30.666 INFO:tasks.workunit.client.0.smithi046.stdout:7/947: symlink d2/d4/df/d6f/d92/l13b 0 2024-09-21T12:47:30.670 INFO:tasks.workunit.client.0.smithi046.stdout:1/955: unlink d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/fb3 0 2024-09-21T12:47:30.672 INFO:tasks.workunit.client.0.smithi046.stdout:1/956: stat d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d94/fbc 0 2024-09-21T12:47:30.674 INFO:tasks.workunit.client.0.smithi046.stdout:1/957: chown d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d95/da5/f131 13713 1 2024-09-21T12:47:30.677 INFO:tasks.workunit.client.0.smithi046.stdout:1/958: mknod d4/d13/d79/dbd/d148/d32/d9e/d5d/c14e 0 2024-09-21T12:47:30.679 INFO:tasks.workunit.client.0.smithi046.stdout:1/959: chown d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/d83/fb8 4708910 1 2024-09-21T12:47:30.686 INFO:tasks.workunit.client.0.smithi046.stdout:1/960: getdents d4 0 2024-09-21T12:47:30.686 INFO:tasks.workunit.client.0.smithi046.stdout:7/948: write d2/d37/f4d [660083,67264] 0 2024-09-21T12:47:30.701 INFO:tasks.workunit.client.0.smithi046.stdout:7/949: dwrite d2/d4/df/d17/fb8 [0,4194304] 0 2024-09-21T12:47:30.703 INFO:tasks.workunit.client.0.smithi046.stdout:7/950: chown d2/d4/df/d9a/lb1 491 1 2024-09-21T12:47:30.713 INFO:tasks.workunit.client.0.smithi046.stdout:7/951: dwrite d2/d4/d43/dd6/d104/f11b [0,4194304] 0 2024-09-21T12:47:30.721 INFO:tasks.workunit.client.0.smithi046.stdout:1/961: dread d4/d4d/dda/d116/f12a [0,4194304] 0 2024-09-21T12:47:30.722 INFO:tasks.workunit.client.0.smithi046.stdout:7/952: symlink d2/d37/l13c 0 2024-09-21T12:47:30.726 INFO:tasks.workunit.client.0.smithi046.stdout:7/953: mknod d2/d4/df/d9a/dc3/c13d 0 2024-09-21T12:47:30.727 INFO:tasks.workunit.client.0.smithi046.stdout:7/954: stat d2/d37/d77/d105 0 2024-09-21T12:47:30.731 INFO:tasks.workunit.client.0.smithi046.stdout:1/962: rename d4/d13/d146 to d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d14f 0 2024-09-21T12:47:30.733 INFO:tasks.workunit.client.0.smithi046.stdout:1/963: readlink d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d8b/lf1 0 2024-09-21T12:47:30.736 INFO:tasks.workunit.client.0.smithi046.stdout:7/955: creat d2/d4/d43/d58/f13e x:0 0 0 2024-09-21T12:47:30.740 INFO:tasks.workunit.client.0.smithi046.stdout:1/964: truncate d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d95/da5/fc8 595161 0 2024-09-21T12:47:30.743 INFO:tasks.workunit.client.0.smithi046.stdout:7/956: symlink d2/d4/df/d42/dd1/d11e/l13f 0 2024-09-21T12:47:30.744 INFO:tasks.workunit.client.0.smithi046.stdout:7/957: fsync d2/d4/df/f109 0 2024-09-21T12:47:30.744 INFO:tasks.workunit.client.0.smithi046.stdout:1/965: symlink d4/d13/dc0/l150 0 2024-09-21T12:47:30.748 INFO:tasks.workunit.client.0.smithi046.stdout:7/958: mkdir d2/d4/d43/d58/d140 0 2024-09-21T12:47:30.754 INFO:tasks.workunit.client.0.smithi046.stdout:7/959: dwrite d2/d4/f54 [0,4194304] 0 2024-09-21T12:47:30.754 INFO:tasks.workunit.client.0.smithi046.stdout:1/966: link d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d8b/dc3/cc5 d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d92/dcc/c151 0 2024-09-21T12:47:30.813 INFO:tasks.workunit.client.0.smithi046.stdout:7/960: unlink d2/d4/df/d17/l1e 0 2024-09-21T12:47:30.817 INFO:tasks.workunit.client.0.smithi046.stdout:7/961: chown d2/d4/df/d70/d88/d34/d7f/de3/f117 0 1 2024-09-21T12:47:31.023 INFO:tasks.workunit.client.0.smithi046.stdout:6/747: sync 2024-09-21T12:47:31.026 INFO:tasks.workunit.client.0.smithi046.stdout:6/748: mknod de/d2a/d4c/d71/d7c/cfa 0 2024-09-21T12:47:31.030 INFO:tasks.workunit.client.0.smithi046.stdout:6/749: dread de/f20 [0,4194304] 0 2024-09-21T12:47:31.035 INFO:tasks.workunit.client.0.smithi046.stdout:6/750: rename fb to de/d2a/d4c/d69/ffb 0 2024-09-21T12:47:31.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/751: dread de/d2a/d34/f3b [0,4194304] 0 2024-09-21T12:47:31.047 INFO:tasks.workunit.client.0.smithi046.stdout:6/752: chown de/f20 17102892 1 2024-09-21T12:47:31.050 INFO:tasks.workunit.client.0.smithi046.stdout:6/753: mknod de/d2a/d4c/d77/d8f/d94/dd2/cfc 0 2024-09-21T12:47:31.050 INFO:tasks.workunit.client.0.smithi046.stdout:6/754: readlink de/d2a/d4d/l52 0 2024-09-21T12:47:31.053 INFO:tasks.workunit.client.0.smithi046.stdout:6/755: rmdir de/d2a/d4c/d77 39 2024-09-21T12:47:31.063 INFO:tasks.workunit.client.0.smithi046.stdout:6/756: dwrite de/d2a/d4c/d69/fc3 [0,4194304] 0 2024-09-21T12:47:31.068 INFO:tasks.workunit.client.0.smithi046.stdout:6/757: rename de/d2a/d34/c5d to de/d2a/d34/cfd 0 2024-09-21T12:47:31.090 INFO:tasks.workunit.client.0.smithi046.stdout:6/758: write de/d2a/d34/fce [499752,93106] 0 2024-09-21T12:47:31.091 INFO:tasks.workunit.client.0.smithi046.stdout:6/759: rmdir de/d2a/d4c/d69 39 2024-09-21T12:47:31.094 INFO:tasks.workunit.client.0.smithi046.stdout:6/760: rmdir de/d48 39 2024-09-21T12:47:31.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/761: write de/d2a/fd8 [364335,46677] 0 2024-09-21T12:47:31.105 INFO:tasks.workunit.client.0.smithi046.stdout:6/762: dread de/d2a/d4c/fbf [0,4194304] 0 2024-09-21T12:47:31.107 INFO:tasks.workunit.client.0.smithi046.stdout:6/763: mknod de/d2a/d4d/cfe 0 2024-09-21T12:47:31.109 INFO:tasks.workunit.client.0.smithi046.stdout:6/764: symlink de/d35/lff 0 2024-09-21T12:47:31.115 INFO:tasks.workunit.client.0.smithi046.stdout:6/765: link de/d2a/d34/c3c de/d2a/d4c/da6/c100 0 2024-09-21T12:47:31.127 INFO:tasks.workunit.client.0.smithi046.stdout:6/766: rename de/d2a/d4c/d77/dae/f72 to de/d35/f101 0 2024-09-21T12:47:31.129 INFO:tasks.workunit.client.0.smithi046.stdout:1/967: sync 2024-09-21T12:47:31.130 INFO:tasks.workunit.client.0.smithi046.stdout:3/887: sync 2024-09-21T12:47:31.130 INFO:tasks.workunit.client.0.smithi046.stdout:5/927: sync 2024-09-21T12:47:31.130 INFO:tasks.workunit.client.0.smithi046.stdout:9/989: sync 2024-09-21T12:47:31.130 INFO:tasks.workunit.client.0.smithi046.stdout:7/962: sync 2024-09-21T12:47:31.135 INFO:tasks.workunit.client.0.smithi046.stdout:9/990: dwrite f10 [0,4194304] 0 2024-09-21T12:47:31.137 INFO:tasks.workunit.client.0.smithi046.stdout:9/991: dread - d11/d5b/d6f/fcb zero size 2024-09-21T12:47:31.171 INFO:tasks.workunit.client.0.smithi046.stdout:6/767: chown de/d35/f89 1812837 1 2024-09-21T12:47:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/963: dread d2/d4/f86 [0,4194304] 0 2024-09-21T12:47:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:3/888: unlink d5/d16/d5f/d6c/fc4 0 2024-09-21T12:47:31.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/964: read - d2/d4/df/d6f/f131 zero size 2024-09-21T12:47:31.175 INFO:tasks.workunit.client.0.smithi046.stdout:3/889: read - d5/d16/d5f/df2/d3c/f4e zero size 2024-09-21T12:47:31.176 INFO:tasks.workunit.client.0.smithi046.stdout:3/890: readlink d5/d5e/l108 0 2024-09-21T12:47:31.177 INFO:tasks.workunit.client.0.smithi046.stdout:5/928: unlink d4/dc/d13/da2/dce/d109/l20 0 2024-09-21T12:47:31.183 INFO:tasks.workunit.client.0.smithi046.stdout:3/891: dwrite d5/dc/d28/fc6 [0,4194304] 0 2024-09-21T12:47:31.184 INFO:tasks.workunit.client.0.smithi046.stdout:1/968: mknod d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/c152 0 2024-09-21T12:47:31.186 INFO:tasks.workunit.client.0.smithi046.stdout:9/992: mknod d11/c13a 0 2024-09-21T12:47:31.187 INFO:tasks.workunit.client.0.smithi046.stdout:5/929: mkdir d4/dc/d13/d5b/d2d/d43/d12d 0 2024-09-21T12:47:31.190 INFO:tasks.workunit.client.0.smithi046.stdout:1/969: truncate d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d94/f135 974512 0 2024-09-21T12:47:31.191 INFO:tasks.workunit.client.0.smithi046.stdout:3/892: creat d5/d5e/d8e/de8/f12c x:0 0 0 2024-09-21T12:47:31.192 INFO:tasks.workunit.client.0.smithi046.stdout:9/993: dread - d11/d19/d1b/d31/d53/d84/fcd zero size 2024-09-21T12:47:31.194 INFO:tasks.workunit.client.0.smithi046.stdout:5/930: dread - d4/dc/d13/d5b/d2d/d3b/feb zero size 2024-09-21T12:47:31.196 INFO:tasks.workunit.client.0.smithi046.stdout:7/965: dread d2/d37/f4d [0,4194304] 0 2024-09-21T12:47:31.197 INFO:tasks.workunit.client.0.smithi046.stdout:9/994: dread - d11/d5b/dcf/f133 zero size 2024-09-21T12:47:31.198 INFO:tasks.workunit.client.0.smithi046.stdout:6/768: dwrite de/d2a/d4c/d71/d7c/f7e [0,4194304] 0 2024-09-21T12:47:31.202 INFO:tasks.workunit.client.0.smithi046.stdout:7/966: symlink d2/d4/df/d70/d88/d34/l141 0 2024-09-21T12:47:31.202 INFO:tasks.workunit.client.0.smithi046.stdout:6/769: fsync de/d2a/d34/fce 0 2024-09-21T12:47:31.205 INFO:tasks.workunit.client.0.smithi046.stdout:5/931: dread d4/dc/d13/d5b/d2d/d43/f48 [0,4194304] 0 2024-09-21T12:47:31.209 INFO:tasks.workunit.client.0.smithi046.stdout:6/770: creat de/d2a/d34/db6/f102 x:0 0 0 2024-09-21T12:47:31.210 INFO:tasks.workunit.client.0.smithi046.stdout:7/967: creat d2/d37/d8a/ddf/d12d/f142 x:0 0 0 2024-09-21T12:47:31.211 INFO:tasks.workunit.client.0.smithi046.stdout:5/932: rmdir d4/dc/d13/da2/d10e 39 2024-09-21T12:47:31.213 INFO:tasks.workunit.client.0.smithi046.stdout:6/771: rename de/d2a/d34/c59 to de/d2a/d4c/d77/d8f/c103 0 2024-09-21T12:47:31.216 INFO:tasks.workunit.client.0.smithi046.stdout:9/995: getdents d11/d19/d1b/d31/d53/da4 0 2024-09-21T12:47:31.220 INFO:tasks.workunit.client.0.smithi046.stdout:7/968: dwrite d2/d4/df/d70/db2/f12c [4194304,4194304] 0 2024-09-21T12:47:31.221 INFO:tasks.workunit.client.0.smithi046.stdout:6/772: rename de/d2a/l2e to de/d2a/d4c/d77/d8f/d94/l104 0 2024-09-21T12:47:31.223 INFO:tasks.workunit.client.0.smithi046.stdout:9/996: creat d11/d19/d1b/d31/d44/f13b x:0 0 0 2024-09-21T12:47:31.225 INFO:tasks.workunit.client.0.smithi046.stdout:5/933: getdents d4/d22/d99/dc7 0 2024-09-21T12:47:31.226 INFO:tasks.workunit.client.0.smithi046.stdout:6/773: symlink de/d35/db2/l105 0 2024-09-21T12:47:31.228 INFO:tasks.workunit.client.0.smithi046.stdout:5/934: mkdir d4/dc/d13/da2/dce/dfe/d12e 0 2024-09-21T12:47:31.252 INFO:tasks.workunit.client.0.smithi046.stdout:6/774: dread - de/d2a/d4c/f58 zero size 2024-09-21T12:47:31.254 INFO:tasks.workunit.client.0.smithi046.stdout:9/997: dwrite d11/d19/d36/d95/f12c [0,4194304] 0 2024-09-21T12:47:31.258 INFO:tasks.workunit.client.0.smithi046.stdout:6/775: symlink de/d2a/d4c/d77/dae/l106 0 2024-09-21T12:47:31.260 INFO:tasks.workunit.client.0.smithi046.stdout:9/998: creat d11/d19/d36/d45/dfd/f13c x:0 0 0 2024-09-21T12:47:31.263 INFO:tasks.workunit.client.0.smithi046.stdout:9/999: fsync d11/d5b/d10c/f11b 0 2024-09-21T12:47:31.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/776: link de/d2a/d4c/d77/d8f/fca de/d2a/d34/db6/f107 0 2024-09-21T12:47:31.283 INFO:tasks.workunit.client.0.smithi046.stdout:5/935: fdatasync d4/dc/d13/da2/dce/d109/d1a/f27 0 2024-09-21T12:47:31.285 INFO:tasks.workunit.client.0.smithi046.stdout:3/893: write d5/d5e/d8e/f9c [4990885,14969] 0 2024-09-21T12:47:31.286 INFO:tasks.workunit.client.0.smithi046.stdout:3/894: readlink d5/d5e/l75 0 2024-09-21T12:47:31.287 INFO:tasks.workunit.client.0.smithi046.stdout:6/777: dread de/d48/f88 [0,4194304] 0 2024-09-21T12:47:31.288 INFO:tasks.workunit.client.0.smithi046.stdout:3/895: write d5/d16/d5f/d6c/f127 [164120,55231] 0 2024-09-21T12:47:31.290 INFO:tasks.workunit.client.0.smithi046.stdout:5/936: chown d4/dc/d13/da2/dce/d109/l1d 371 1 2024-09-21T12:47:31.291 INFO:tasks.workunit.client.0.smithi046.stdout:6/778: read de/d2a/d4d/f60 [1676257,20037] 0 2024-09-21T12:47:31.292 INFO:tasks.workunit.client.0.smithi046.stdout:3/896: write d5/dc/d94/f11f [649879,76317] 0 2024-09-21T12:47:31.296 INFO:tasks.workunit.client.0.smithi046.stdout:1/970: dwrite d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/d83/fbe [0,4194304] 0 2024-09-21T12:47:31.307 INFO:tasks.workunit.client.0.smithi046.stdout:5/937: symlink d4/dc/d13/da2/dce/l12f 0 2024-09-21T12:47:31.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/779: rename de/c1c to de/d2a/d4c/d71/d7c/c108 0 2024-09-21T12:47:31.312 INFO:tasks.workunit.client.0.smithi046.stdout:1/971: creat d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/d83/da9/d10a/d12e/f153 x:0 0 0 2024-09-21T12:47:31.319 INFO:tasks.workunit.client.0.smithi046.stdout:1/972: symlink d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d92/dcc/d102/l154 0 2024-09-21T12:47:31.322 INFO:tasks.workunit.client.0.smithi046.stdout:3/897: rename d5/d16/d5f/df2 to d5/dc/d94/d12d 0 2024-09-21T12:47:31.326 INFO:tasks.workunit.client.0.smithi046.stdout:5/938: dread d4/dc/d13/f81 [0,4194304] 0 2024-09-21T12:47:31.326 INFO:tasks.workunit.client.0.smithi046.stdout:3/898: write d5/d5e/d8e/dcf/d123/f126 [332486,53556] 0 2024-09-21T12:47:31.328 INFO:tasks.workunit.client.0.smithi046.stdout:3/899: write d5/d16/d5f/f11b [1163765,66021] 0 2024-09-21T12:47:31.329 INFO:tasks.workunit.client.0.smithi046.stdout:3/900: dread - d5/dc/d94/d12d/fb2 zero size 2024-09-21T12:47:31.330 INFO:tasks.workunit.client.0.smithi046.stdout:3/901: chown d5/d16/d5f/dad 4214602 1 2024-09-21T12:47:31.332 INFO:tasks.workunit.client.0.smithi046.stdout:6/780: write de/d2a/d4c/f58 [39060,6458] 0 2024-09-21T12:47:31.338 INFO:tasks.workunit.client.0.smithi046.stdout:1/973: write d4/d13/d6b/f7b [1538126,15758] 0 2024-09-21T12:47:31.339 INFO:tasks.workunit.client.0.smithi046.stdout:5/939: dwrite d4/dc/d13/d5b/d2d/d43/f48 [0,4194304] 0 2024-09-21T12:47:31.346 INFO:tasks.workunit.client.0.smithi046.stdout:1/974: creat d4/d13/d79/f155 x:0 0 0 2024-09-21T12:47:31.348 INFO:tasks.workunit.client.0.smithi046.stdout:5/940: unlink d4/dc/d13/d15/f84 0 2024-09-21T12:47:31.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/781: write de/d2a/d4c/d69/fbc [434899,21305] 0 2024-09-21T12:47:31.353 INFO:tasks.workunit.client.0.smithi046.stdout:5/941: mknod d4/dc/d13/d5b/d2d/c130 0 2024-09-21T12:47:31.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/782: creat de/d2a/d4c/d77/dc0/f109 x:0 0 0 2024-09-21T12:47:31.354 INFO:tasks.workunit.client.0.smithi046.stdout:5/942: write d4/dc/d13/d15/f92 [2088516,61508] 0 2024-09-21T12:47:31.355 INFO:tasks.workunit.client.0.smithi046.stdout:5/943: fdatasync d4/dc/f12a 0 2024-09-21T12:47:31.360 INFO:tasks.workunit.client.0.smithi046.stdout:6/783: symlink de/d2a/d4c/d71/dde/l10a 0 2024-09-21T12:47:31.362 INFO:tasks.workunit.client.0.smithi046.stdout:5/944: dwrite d4/dc/d13/d5b/d2d/d43/f48 [0,4194304] 0 2024-09-21T12:47:31.365 INFO:tasks.workunit.client.0.smithi046.stdout:5/945: write d4/dc/d45/f125 [510450,59510] 0 2024-09-21T12:47:31.366 INFO:tasks.workunit.client.0.smithi046.stdout:5/946: chown d4/d22/d99/de7/df3/d101 9 1 2024-09-21T12:47:31.368 INFO:tasks.workunit.client.0.smithi046.stdout:1/975: truncate d4/d13/d79/dbd/d148/d32/d9e/d11f/faf 3537601 0 2024-09-21T12:47:31.371 INFO:tasks.workunit.client.0.smithi046.stdout:1/976: dread - d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d8b/dc3/f123 zero size 2024-09-21T12:47:31.374 INFO:tasks.workunit.client.0.smithi046.stdout:1/977: truncate d4/f77 2369571 0 2024-09-21T12:47:31.374 INFO:tasks.workunit.client.0.smithi046.stdout:6/784: write de/d35/f89 [218794,122019] 0 2024-09-21T12:47:31.379 INFO:tasks.workunit.client.0.smithi046.stdout:6/785: mknod de/d35/db2/c10b 0 2024-09-21T12:47:31.384 INFO:tasks.workunit.client.0.smithi046.stdout:5/947: dwrite d4/dc/d6b/fc2 [0,4194304] 0 2024-09-21T12:47:31.390 INFO:tasks.workunit.client.0.smithi046.stdout:6/786: truncate de/d2a/d34/fe6 504438 0 2024-09-21T12:47:31.393 INFO:tasks.workunit.client.0.smithi046.stdout:5/948: fsync d4/fd0 0 2024-09-21T12:47:31.397 INFO:tasks.workunit.client.0.smithi046.stdout:6/787: truncate de/f13 3488047 0 2024-09-21T12:47:31.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/788: dread de/d2a/d4c/d69/fbc [0,4194304] 0 2024-09-21T12:47:31.402 INFO:tasks.workunit.client.0.smithi046.stdout:1/978: rename d4/d13/f2e to d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/f156 0 2024-09-21T12:47:31.408 INFO:tasks.workunit.client.0.smithi046.stdout:1/979: dread - d4/d13/d79/dbd/d148/d32/d9e/fd1 zero size 2024-09-21T12:47:31.411 INFO:tasks.workunit.client.0.smithi046.stdout:5/949: creat d4/dc/d13/da2/dce/d109/d1a/f131 x:0 0 0 2024-09-21T12:47:31.415 INFO:tasks.workunit.client.0.smithi046.stdout:6/789: rename de/d2a/d4c/d77/dae/d55/fe8 to de/d2a/d4c/f10c 0 2024-09-21T12:47:31.417 INFO:tasks.workunit.client.0.smithi046.stdout:1/980: mkdir d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/d157 0 2024-09-21T12:47:31.421 INFO:tasks.workunit.client.0.smithi046.stdout:6/790: unlink de/d2a/d4c/d77/d8f/d94/ld9 0 2024-09-21T12:47:31.424 INFO:tasks.workunit.client.0.smithi046.stdout:6/791: creat de/d2a/d4c/d71/f10d x:0 0 0 2024-09-21T12:47:31.428 INFO:tasks.workunit.client.0.smithi046.stdout:5/950: dwrite d4/d22/fd2 [0,4194304] 0 2024-09-21T12:47:31.428 INFO:tasks.workunit.client.0.smithi046.stdout:1/981: creat d4/d13/d79/dbd/d148/f158 x:0 0 0 2024-09-21T12:47:31.431 INFO:tasks.workunit.client.0.smithi046.stdout:6/792: dread de/d48/f88 [0,4194304] 0 2024-09-21T12:47:31.432 INFO:tasks.workunit.client.0.smithi046.stdout:6/793: dread - de/d2a/d4c/d69/fc1 zero size 2024-09-21T12:47:31.437 INFO:tasks.workunit.client.0.smithi046.stdout:6/794: symlink de/d2a/d4c/d77/dae/d55/l10e 0 2024-09-21T12:47:31.439 INFO:tasks.workunit.client.0.smithi046.stdout:1/982: dwrite d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/ffd [0,4194304] 0 2024-09-21T12:47:31.441 INFO:tasks.workunit.client.0.smithi046.stdout:6/795: creat de/d2a/d34/f10f x:0 0 0 2024-09-21T12:47:31.443 INFO:tasks.workunit.client.0.smithi046.stdout:1/983: creat d4/d4d/dda/d116/f159 x:0 0 0 2024-09-21T12:47:31.444 INFO:tasks.workunit.client.0.smithi046.stdout:1/984: stat d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f 0 2024-09-21T12:47:31.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/796: unlink de/d2a/d34/cf1 0 2024-09-21T12:47:31.446 INFO:tasks.workunit.client.0.smithi046.stdout:6/797: stat f3 0 2024-09-21T12:47:31.447 INFO:tasks.workunit.client.0.smithi046.stdout:1/985: chown d4/d13/l34 22937259 1 2024-09-21T12:47:31.454 INFO:tasks.workunit.client.0.smithi046.stdout:1/986: dwrite d4/feb [0,4194304] 0 2024-09-21T12:47:31.457 INFO:tasks.workunit.client.0.smithi046.stdout:1/987: write d4/d4d/f9d [474159,46984] 0 2024-09-21T12:47:31.469 INFO:tasks.workunit.client.0.smithi046.stdout:6/798: dwrite de/d2a/d4c/d71/fab [0,4194304] 0 2024-09-21T12:47:31.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/799: unlink de/d2a/d4c/d77/d8f/leb 0 2024-09-21T12:47:31.479 INFO:tasks.workunit.client.0.smithi046.stdout:1/988: dwrite d4/d13/f7f [4194304,4194304] 0 2024-09-21T12:47:31.481 INFO:tasks.workunit.client.0.smithi046.stdout:1/989: write d4/d13/d79/dbd/d148/d32/d9e/d5d/ff7 [1401132,8874] 0 2024-09-21T12:47:31.483 INFO:tasks.workunit.client.0.smithi046.stdout:1/990: chown d4/d13/d79/dbd/d148/d32/d9e/l112 87042651 1 2024-09-21T12:47:31.520 INFO:tasks.workunit.client.0.smithi046.stdout:6/800: creat de/d2a/d4c/d77/d8f/d94/de7/f110 x:0 0 0 2024-09-21T12:47:31.521 INFO:tasks.workunit.client.0.smithi046.stdout:1/991: stat d4/d13/d79/dbd/d148/d32/c43 0 2024-09-21T12:47:31.528 INFO:tasks.workunit.client.0.smithi046.stdout:6/801: write de/d48/fe5 [396890,5361] 0 2024-09-21T12:47:31.528 INFO:tasks.workunit.client.0.smithi046.stdout:1/992: write d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/f82 [2593338,125690] 0 2024-09-21T12:47:31.540 INFO:tasks.workunit.client.0.smithi046.stdout:1/993: dread d4/d13/d79/dbd/d148/d32/d9e/d5d/d8c/d94/fbf [0,4194304] 0 2024-09-21T12:47:31.544 INFO:tasks.workunit.client.0.smithi046.stdout:1/994: creat d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/d157/f15a x:0 0 0 2024-09-21T12:47:31.545 INFO:tasks.workunit.client.0.smithi046.stdout:1/995: fdatasync d4/d13/d79/dbd/d148/d32/d9e/d11f/d4f/d83/da9/d10a/d12e/f153 0 2024-09-21T12:47:31.547 INFO:tasks.workunit.client.0.smithi046.stdout:6/802: dread de/f46 [4194304,4194304] 0 2024-09-21T12:47:31.549 INFO:tasks.workunit.client.0.smithi046.stdout:6/803: unlink de/d35/db2/l105 0 2024-09-21T12:47:31.554 INFO:tasks.workunit.client.0.smithi046.stdout:1/996: getdents d4/d13/d79/dbd/d148/d32 0 2024-09-21T12:47:31.568 INFO:tasks.workunit.client.0.smithi046.stdout:6/804: dwrite de/d2a/d4d/fe2 [0,4194304] 0 2024-09-21T12:47:31.569 INFO:tasks.workunit.client.0.smithi046.stdout:1/997: dwrite d4/d13/d79/dbd/d148/d32/d9e/d11f/d53/d80/d95/fea [0,4194304] 0 2024-09-21T12:47:31.570 INFO:tasks.workunit.client.0.smithi046.stdout:1/998: chown d4/d4d/c128 0 1 2024-09-21T12:47:31.584 INFO:tasks.workunit.client.0.smithi046.stdout:1/999: dread d4/f10 [0,4194304] 0 2024-09-21T12:47:31.585 INFO:tasks.workunit.client.0.smithi046.stdout:6/805: dread de/d2a/d34/fce [0,4194304] 0 2024-09-21T12:47:31.587 INFO:tasks.workunit.client.0.smithi046.stdout:6/806: truncate de/d2a/d34/f10f 49031 0 2024-09-21T12:47:31.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/807: symlink de/d2a/d4c/d77/dae/d55/l111 0 2024-09-21T12:47:31.592 INFO:tasks.workunit.client.0.smithi046.stdout:6/808: write de/d2a/d4d/fe2 [3278662,29626] 0 2024-09-21T12:47:31.720 INFO:tasks.workunit.client.0.smithi046.stdout:6/809: link l4 de/d2a/d4c/d77/d8f/d94/l112 0 2024-09-21T12:47:31.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:31.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:31 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:31.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:31 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:47:31.800 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:31 smithi046 ceph-mon[27868]: pgmap v42: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 122 MiB/s wr, 302 op/s 2024-09-21T12:47:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:31 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:31 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:47:31.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:31 smithi176 ceph-mon[35476]: pgmap v42: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 122 MiB/s wr, 302 op/s 2024-09-21T12:47:31.891 INFO:tasks.workunit.client.0.smithi046.stdout:6/810: mknod de/d2a/d4c/d77/c113 0 2024-09-21T12:47:31.977 INFO:tasks.workunit.client.0.smithi046.stdout:3/902: sync 2024-09-21T12:47:31.977 INFO:tasks.workunit.client.0.smithi046.stdout:5/951: sync 2024-09-21T12:47:31.977 INFO:tasks.workunit.client.0.smithi046.stdout:7/969: sync 2024-09-21T12:47:31.980 INFO:tasks.workunit.client.0.smithi046.stdout:3/903: mknod d5/d5e/d8e/dcf/c12e 0 2024-09-21T12:47:31.982 INFO:tasks.workunit.client.0.smithi046.stdout:5/952: symlink d4/dc/d13/d5b/d2d/d43/d12d/l132 0 2024-09-21T12:47:31.984 INFO:tasks.workunit.client.0.smithi046.stdout:5/953: dread - d4/dc/d13/da2/dce/d109/d1a/d9e/da7/fff zero size 2024-09-21T12:47:31.986 INFO:tasks.workunit.client.0.smithi046.stdout:5/954: write d4/dc/d13/d5b/d2d/f7d [3839298,18957] 0 2024-09-21T12:47:31.989 INFO:tasks.workunit.client.0.smithi046.stdout:5/955: chown d4/d22/d99/d9d/ce5 30755157 1 2024-09-21T12:47:31.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/956: dread - d4/d22/d99/de7/fd9 zero size 2024-09-21T12:47:31.993 INFO:tasks.workunit.client.0.smithi046.stdout:5/957: fsync d4/dc/d45/fd3 0 2024-09-21T12:47:31.995 INFO:tasks.workunit.client.0.smithi046.stdout:7/970: dread d2/d4/df/d6f/d92/fda [0,4194304] 0 2024-09-21T12:47:32.000 INFO:tasks.workunit.client.0.smithi046.stdout:7/971: readlink d2/d4/l13 0 2024-09-21T12:47:32.005 INFO:tasks.workunit.client.0.smithi046.stdout:5/958: rmdir d4/dc/d13/d5b/d2d/d43/d112 0 2024-09-21T12:47:32.007 INFO:tasks.workunit.client.0.smithi046.stdout:7/972: creat d2/d4/df/d42/dd1/df4/f143 x:0 0 0 2024-09-21T12:47:32.009 INFO:tasks.workunit.client.0.smithi046.stdout:7/973: creat d2/d4/df/d9a/f144 x:0 0 0 2024-09-21T12:47:32.011 INFO:tasks.workunit.client.0.smithi046.stdout:5/959: dread d4/dc/d13/d5b/fbf [0,4194304] 0 2024-09-21T12:47:32.012 INFO:tasks.workunit.client.0.smithi046.stdout:7/974: unlink d2/d4/df/d42/dd1/df4/f143 0 2024-09-21T12:47:32.014 INFO:tasks.workunit.client.0.smithi046.stdout:5/960: fsync d4/dc/d13/da2/dce/d109/f62 0 2024-09-21T12:47:32.015 INFO:tasks.workunit.client.0.smithi046.stdout:5/961: chown d4/d22/fd2 0 1 2024-09-21T12:47:32.016 INFO:tasks.workunit.client.0.smithi046.stdout:5/962: stat d4/dc/d13/f23 0 2024-09-21T12:47:32.020 INFO:tasks.workunit.client.0.smithi046.stdout:5/963: truncate d4/dc/d13/d5b/d2d/d3b/feb 655326 0 2024-09-21T12:47:32.028 INFO:tasks.workunit.client.0.smithi046.stdout:5/964: link d4/dc/d13/d5b/d2d/d3b/c86 d4/dc/d13/d5b/d2d/c133 0 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 -- 172.21.15.46:0/653690149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c101a60 msgr2=0x7f7a8c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/653690149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c101a60 0x7f7a8c101ee0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7a74009880 tx=0x7f7a7402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 -- 172.21.15.46:0/653690149 shutdown_connections 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/653690149 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c101a60 0x7f7a8c101ee0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/653690149 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c100860 0x7f7a8c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 -- 172.21.15.46:0/653690149 >> 172.21.15.46:0/653690149 conn(0x7f7a8c0fc010 msgr2=0x7f7a8c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 -- 172.21.15.46:0/653690149 shutdown_connections 2024-09-21T12:47:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.500+0000 7f7a91fb5640 1 -- 172.21.15.46:0/653690149 wait complete. 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a91fb5640 1 Processor -- start 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a91fb5640 1 -- start start 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a91fb5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c100860 0x7f7a8c197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a91fb5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 0x7f7a8c197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a91fb5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c109680 con 0x7f7a8c100860 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a91fb5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c109500 con 0x7f7a8c101a60 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a83fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 0x7f7a8c197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a83fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 0x7f7a8c197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:40776/0 (socket says 172.21.15.46:40776) 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a83fff640 1 -- 172.21.15.46:0/1874404621 learned_addr learned my addr 172.21.15.46:0/1874404621 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:32.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.501+0000 7f7a8b7fe640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c100860 0x7f7a8c197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a83fff640 1 -- 172.21.15.46:0/1874404621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c100860 msgr2=0x7f7a8c197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a83fff640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c100860 0x7f7a8c197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a83fff640 1 -- 172.21.15.46:0/1874404621 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c1980e0 con 0x7f7a8c101a60 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a83fff640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 0x7f7a8c197a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a74006010 tx=0x7f7a74004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a7403f070 con 0x7f7a8c101a60 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a740049d0 con 0x7f7a8c101a60 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.502+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a74035030 con 0x7f7a8c101a60 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.503+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c19cac0 con 0x7f7a8c101a60 2024-09-21T12:47:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.503+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c19cf90 con 0x7f7a8c101a60 2024-09-21T12:47:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.504+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c100c60 con 0x7f7a8c101a60 2024-09-21T12:47:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.504+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f7a74042070 con 0x7f7a8c101a60 2024-09-21T12:47:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.505+0000 7f7a897fa640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f7a78074a80 0x7f7a78076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.505+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f7a740b6ea0 con 0x7f7a8c101a60 2024-09-21T12:47:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.505+0000 7f7a8b7fe640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f7a78074a80 0x7f7a78076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:32.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.506+0000 7f7a8b7fe640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f7a78074a80 0x7f7a78076f40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c1018c0 tx=0x7f7a7c005f90 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:32.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.510+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7a740823f0 con 0x7f7a8c101a60 2024-09-21T12:47:32.551 INFO:tasks.workunit.client.0.smithi046.stdout:6/811: sync 2024-09-21T12:47:32.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/812: link de/d2a/d4c/d69/fc1 de/d2a/d4c/d77/dae/f114 0 2024-09-21T12:47:32.686 INFO:tasks.workunit.client.0.smithi046.stdout:3/904: sync 2024-09-21T12:47:32.686 INFO:tasks.workunit.client.0.smithi046.stdout:7/975: sync 2024-09-21T12:47:32.688 INFO:tasks.workunit.client.0.smithi046.stdout:3/905: readlink d5/dc/d28/d63/de2/le4 0 2024-09-21T12:47:32.688 INFO:tasks.workunit.client.0.smithi046.stdout:7/976: chown d2/fe 10252 1 2024-09-21T12:47:32.689 INFO:tasks.workunit.client.0.smithi046.stdout:7/977: chown d2/d4/df/d42/fc7 62 1 2024-09-21T12:47:32.691 INFO:tasks.workunit.client.0.smithi046.stdout:3/906: mknod d5/d5e/d8e/de8/c12f 0 2024-09-21T12:47:32.693 INFO:tasks.workunit.client.0.smithi046.stdout:3/907: readlink d5/dc/d28/l9e 0 2024-09-21T12:47:32.695 INFO:tasks.workunit.client.0.smithi046.stdout:7/978: rename d2/d37/l135 to d2/d37/d8a/l145 0 2024-09-21T12:47:32.696 INFO:tasks.workunit.client.0.smithi046.stdout:7/979: dread - d2/d4/df/d6f/d92/f12e zero size 2024-09-21T12:47:32.697 INFO:tasks.workunit.client.0.smithi046.stdout:3/908: symlink d5/dc/d94/l130 0 2024-09-21T12:47:32.700 INFO:tasks.workunit.client.0.smithi046.stdout:3/909: symlink d5/d5e/d8e/de8/l131 0 2024-09-21T12:47:32.705 INFO:tasks.workunit.client.0.smithi046.stdout:3/910: read d5/d16/d5f/f8b [1284439,126497] 0 2024-09-21T12:47:32.709 INFO:tasks.workunit.client.0.smithi046.stdout:3/911: truncate d5/d5e/d8e/faf 301211 0 2024-09-21T12:47:32.709 INFO:tasks.workunit.client.0.smithi046.stdout:7/980: dwrite d2/d4/f8 [0,4194304] 0 2024-09-21T12:47:32.712 INFO:tasks.workunit.client.0.smithi046.stdout:7/981: write d2/d4/df/d70/db2/f12c [216814,14687] 0 2024-09-21T12:47:32.713 INFO:tasks.workunit.client.0.smithi046.stdout:3/912: truncate d5/d16/f47 254986 0 2024-09-21T12:47:32.719 INFO:tasks.workunit.client.0.smithi046.stdout:7/982: rename d2/d4/d43/dd6/d12f to d2/d4/df/d42/dd1/d146 0 2024-09-21T12:47:32.719 INFO:tasks.workunit.client.0.smithi046.stdout:3/913: mknod d5/dc/d28/d63/c132 0 2024-09-21T12:47:32.720 INFO:tasks.workunit.client.0.smithi046.stdout:3/914: chown d5/d5e/d8e/f114 0 1 2024-09-21T12:47:32.730 INFO:tasks.workunit.client.0.smithi046.stdout:3/915: creat d5/d16/d5f/f133 x:0 0 0 2024-09-21T12:47:32.734 INFO:tasks.workunit.client.0.smithi046.stdout:3/916: dread d5/dc/d30/fb6 [0,4194304] 0 2024-09-21T12:47:32.735 INFO:tasks.workunit.client.0.smithi046.stdout:3/917: write d5/dc/d94/d12d/f27 [8116453,115758] 0 2024-09-21T12:47:32.742 INFO:tasks.workunit.client.0.smithi046.stdout:3/918: link d5/dc/d28/d60/fda d5/d16/d5f/d110/f134 0 2024-09-21T12:47:32.744 INFO:tasks.workunit.client.0.smithi046.stdout:5/965: sync 2024-09-21T12:47:32.744 INFO:tasks.workunit.client.0.smithi046.stdout:6/813: sync 2024-09-21T12:47:32.746 INFO:tasks.workunit.client.0.smithi046.stdout:5/966: rmdir d4/d22/d99 39 2024-09-21T12:47:32.747 INFO:tasks.workunit.client.0.smithi046.stdout:5/967: chown d4/dc/d13/da2/dce/d109/d1a/d9e/da7 30809 1 2024-09-21T12:47:32.749 INFO:tasks.workunit.client.0.smithi046.stdout:6/814: creat de/df7/f115 x:0 0 0 2024-09-21T12:47:32.751 INFO:tasks.workunit.client.0.smithi046.stdout:7/983: truncate d2/d4/fac 453837 0 2024-09-21T12:47:32.760 INFO:tasks.workunit.client.0.smithi046.stdout:5/968: link d4/dc/d13/cc3 d4/dc/d13/d15/d5c/c134 0 2024-09-21T12:47:32.766 INFO:tasks.workunit.client.0.smithi046.stdout:6/815: rename de/d48/l75 to de/d2a/d4c/d77/l116 0 2024-09-21T12:47:32.770 INFO:tasks.workunit.client.0.smithi046.stdout:6/816: fdatasync de/f26 0 2024-09-21T12:47:32.772 INFO:tasks.workunit.client.0.smithi046.stdout:5/969: symlink d4/dc/d13/da2/dce/dfe/d12e/l135 0 2024-09-21T12:47:32.773 INFO:tasks.workunit.client.0.smithi046.stdout:6/817: readlink de/l1e 0 2024-09-21T12:47:32.774 INFO:tasks.workunit.client.0.smithi046.stdout:3/919: dread d5/dc/d28/d60/fda [0,4194304] 0 2024-09-21T12:47:32.775 INFO:tasks.workunit.client.0.smithi046.stdout:7/984: dwrite d2/d4/df/d70/d88/d34/f68 [0,4194304] 0 2024-09-21T12:47:32.777 INFO:tasks.workunit.client.0.smithi046.stdout:3/920: readlink d5/d5e/d8e/de8/l118 0 2024-09-21T12:47:32.780 INFO:tasks.workunit.client.0.smithi046.stdout:5/970: rmdir d4/dc/d13/da2 39 2024-09-21T12:47:32.784 INFO:tasks.workunit.client.0.smithi046.stdout:7/985: write d2/d4/df/d70/d88/d34/f48 [3802814,33005] 0 2024-09-21T12:47:32.788 INFO:tasks.workunit.client.0.smithi046.stdout:3/921: unlink d5/dc/fc1 0 2024-09-21T12:47:32.790 INFO:tasks.workunit.client.0.smithi046.stdout:5/971: dread - d4/dc/d13/da2/dce/d109/d1a/f131 zero size 2024-09-21T12:47:32.791 INFO:tasks.workunit.client.0.smithi046.stdout:5/972: readlink d4/dc/d13/d15/d5c/lf4 0 2024-09-21T12:47:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:3/922: dwrite d5/dc/f54 [0,4194304] 0 2024-09-21T12:47:32.795 INFO:tasks.workunit.client.0.smithi046.stdout:6/818: link de/d2a/d4c/d77/ca5 de/d2a/d4c/da6/c117 0 2024-09-21T12:47:32.799 INFO:tasks.workunit.client.0.smithi046.stdout:3/923: rename d5/dc/d94/l111 to d5/dc/d30/d7c/l135 0 2024-09-21T12:47:32.803 INFO:tasks.workunit.client.0.smithi046.stdout:3/924: creat d5/dc/d94/da6/d101/f136 x:0 0 0 2024-09-21T12:47:32.804 INFO:tasks.workunit.client.0.smithi046.stdout:3/925: chown d5/dc/d28/d63/c12a 11 1 2024-09-21T12:47:32.805 INFO:tasks.workunit.client.0.smithi046.stdout:3/926: chown d5/d16/d5f/d6c/f10b 890811 1 2024-09-21T12:47:32.806 INFO:tasks.workunit.client.0.smithi046.stdout:3/927: write d5/dc/d28/d60/f73 [2843724,75480] 0 2024-09-21T12:47:32.810 INFO:tasks.workunit.client.0.smithi046.stdout:3/928: read d5/dc/d94/d12d/d3c/d44/f5d [3351287,64271] 0 2024-09-21T12:47:32.815 INFO:tasks.workunit.client.0.smithi046.stdout:3/929: truncate d5/dc/f57 440552 0 2024-09-21T12:47:32.818 INFO:tasks.workunit.client.0.smithi046.stdout:3/930: symlink d5/d16/d5f/d6c/l137 0 2024-09-21T12:47:32.819 INFO:tasks.workunit.client.0.smithi046.stdout:5/973: truncate d4/dc/d13/f81 3145711 0 2024-09-21T12:47:32.821 INFO:tasks.workunit.client.0.smithi046.stdout:3/931: fdatasync d5/dc/d30/d34/dd1/fe7 0 2024-09-21T12:47:32.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.825+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7a8c06a460 con 0x7f7a78074a80 2024-09-21T12:47:32.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.826+0000 7f7a897fa640 1 -- 172.21.15.46:0/1874404621 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7f7a8c06a460 con 0x7f7a78074a80 2024-09-21T12:47:32.829 INFO:tasks.workunit.client.0.smithi046.stdout:3/932: truncate d5/d16/d5f/f8b 766454 0 2024-09-21T12:47:32.830 INFO:tasks.workunit.client.0.smithi046.stdout:6/819: dwrite de/d2a/d4c/d77/dae/f114 [0,4194304] 0 2024-09-21T12:47:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f7a78074a80 msgr2=0x7f7a78076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f7a78074a80 0x7f7a78076f40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c1018c0 tx=0x7f7a7c005f90 comp rx=0 tx=0).stop 2024-09-21T12:47:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 msgr2=0x7f7a8c197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 0x7f7a8c197a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a74006010 tx=0x7f7a74004570 comp rx=0 tx=0).stop 2024-09-21T12:47:32.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 shutdown_connections 2024-09-21T12:47:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f7a78074a80 0x7f7a78076f40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a8c101a60 0x7f7a8c197a60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 --2- 172.21.15.46:0/1874404621 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7a8c100860 0x7f7a8c197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 >> 172.21.15.46:0/1874404621 conn(0x7f7a8c0fc010 msgr2=0x7f7a8c069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 shutdown_connections 2024-09-21T12:47:32.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.830+0000 7f7a91fb5640 1 -- 172.21.15.46:0/1874404621 wait complete. 2024-09-21T12:47:32.833 INFO:tasks.workunit.client.0.smithi046.stdout:3/933: dread - d5/dc/d94/d12d/d3c/f102 zero size 2024-09-21T12:47:32.833 INFO:tasks.workunit.client.0.smithi046.stdout:5/974: dwrite d4/dc/d13/d15/fee [0,4194304] 0 2024-09-21T12:47:32.843 INFO:tasks.workunit.client.0.smithi046.stdout:6/820: mkdir de/d2a/d4c/d77/dc0/d118 0 2024-09-21T12:47:32.848 INFO:tasks.workunit.client.0.smithi046.stdout:6/821: mknod de/d2a/d4c/d77/dae/c119 0 2024-09-21T12:47:32.850 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:47:32.854 INFO:tasks.workunit.client.0.smithi046.stdout:5/975: mknod d4/d22/d99/d10d/c136 0 2024-09-21T12:47:32.865 INFO:tasks.workunit.client.0.smithi046.stdout:6/822: write de/d2a/d4c/d77/dae/d55/f85 [916854,55497] 0 2024-09-21T12:47:32.869 INFO:tasks.workunit.client.0.smithi046.stdout:3/934: dread d5/f7 [0,4194304] 0 2024-09-21T12:47:32.870 INFO:tasks.workunit.client.0.smithi046.stdout:5/976: write d4/dc/d13/da2/dce/d109/d1a/fb0 [323597,16734] 0 2024-09-21T12:47:32.871 INFO:tasks.workunit.client.0.smithi046.stdout:3/935: chown d5/d5e/d8e/f114 325 1 2024-09-21T12:47:32.873 INFO:tasks.workunit.client.0.smithi046.stdout:5/977: creat d4/f137 x:0 0 0 2024-09-21T12:47:32.877 INFO:tasks.workunit.client.0.smithi046.stdout:5/978: read d4/dc/d13/f23 [3208842,105188] 0 2024-09-21T12:47:32.881 INFO:tasks.workunit.client.0.smithi046.stdout:6/823: dwrite de/f26 [0,4194304] 0 2024-09-21T12:47:32.885 INFO:tasks.workunit.client.0.smithi046.stdout:3/936: dwrite d5/dc/f1d [8388608,4194304] 0 2024-09-21T12:47:32.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/824: dwrite de/d2a/d4c/d69/fc3 [0,4194304] 0 2024-09-21T12:47:32.896 INFO:tasks.workunit.client.0.smithi046.stdout:6/825: chown de/d2a/d4c/d69/f64 6172354 1 2024-09-21T12:47:32.897 INFO:tasks.workunit.client.0.smithi046.stdout:6/826: chown de/d2a/d4c/d71/d7c/f87 154762 1 2024-09-21T12:47:32.899 INFO:tasks.workunit.client.0.smithi046.stdout:5/979: unlink d4/dc/d13/d5b/d2d/d43/d7a/f10a 0 2024-09-21T12:47:32.899 INFO:tasks.workunit.client.0.smithi046.stdout:3/937: truncate d5/dc/d94/d12d/f4c 3073931 0 2024-09-21T12:47:32.903 INFO:tasks.workunit.client.0.smithi046.stdout:6/827: rmdir de/d2a/d4c/d77/d98 39 2024-09-21T12:47:32.906 INFO:tasks.workunit.client.0.smithi046.stdout:5/980: mkdir d4/d22/d99/d9d/d138 0 2024-09-21T12:47:32.906 INFO:tasks.workunit.client.0.smithi046.stdout:6/828: write de/d2a/fbb [1124992,55364] 0 2024-09-21T12:47:32.913 INFO:tasks.workunit.client.0.smithi046.stdout:6/829: symlink de/d2a/d4c/d77/d8f/d94/dd2/l11a 0 2024-09-21T12:47:32.915 INFO:tasks.workunit.client.0.smithi046.stdout:6/830: read de/d48/fe5 [309710,28490] 0 2024-09-21T12:47:32.916 INFO:tasks.workunit.client.0.smithi046.stdout:5/981: rename d4/dc/d45/dd7/f129 to d4/dc/d13/d5b/d2d/d43/dad/f139 0 2024-09-21T12:47:32.918 INFO:tasks.workunit.client.0.smithi046.stdout:3/938: dwrite d5/dc/d30/f39 [0,4194304] 0 2024-09-21T12:47:32.920 INFO:tasks.workunit.client.0.smithi046.stdout:3/939: write d5/d16/d5f/f133 [256028,33055] 0 2024-09-21T12:47:32.934 INFO:tasks.workunit.client.0.smithi046.stdout:3/940: read - d5/dc/d28/fb4 zero size 2024-09-21T12:47:32.938 INFO:tasks.workunit.client.0.smithi046.stdout:5/982: mkdir d4/dc/d13/da2/dce/d13a 0 2024-09-21T12:47:32.942 INFO:tasks.workunit.client.0.smithi046.stdout:3/941: chown d5/d5e/d8e/db5/c109 85994 1 2024-09-21T12:47:32.944 INFO:tasks.workunit.client.0.smithi046.stdout:5/983: dwrite d4/dc/d13/d5b/d2d/f7d [0,4194304] 0 2024-09-21T12:47:32.955 INFO:tasks.workunit.client.0.smithi046.stdout:5/984: creat d4/dc/d13/d5b/d2d/d43/ddb/d11d/f13b x:0 0 0 2024-09-21T12:47:32.955 INFO:tasks.workunit.client.0.smithi046.stdout:3/942: dwrite d5/f6b [4194304,4194304] 0 2024-09-21T12:47:32.958 INFO:tasks.workunit.client.0.smithi046.stdout:6/831: dwrite de/d2a/d4c/d69/fb9 [0,4194304] 0 2024-09-21T12:47:32.961 INFO:tasks.workunit.client.0.smithi046.stdout:5/985: mkdir d4/dc/d45/d13c 0 2024-09-21T12:47:32.963 INFO:tasks.workunit.client.0.smithi046.stdout:3/943: dread - d5/d16/d5f/d6c/fed zero size 2024-09-21T12:47:32.965 INFO:tasks.workunit.client.0.smithi046.stdout:6/832: mknod de/d2a/d4c/d77/dc0/dc8/c11b 0 2024-09-21T12:47:32.967 INFO:tasks.workunit.client.0.smithi046.stdout:3/944: read d5/dc/d94/dd6/ff3 [86745,80489] 0 2024-09-21T12:47:32.973 INFO:tasks.workunit.client.0.smithi046.stdout:6/833: rename de/d2a/d4c/d69/ca2 to de/d2a/d4c/d77/dc0/dc8/c11c 0 2024-09-21T12:47:32.981 INFO:tasks.workunit.client.0.smithi046.stdout:5/986: truncate d4/dc/d13/da2/dce/d109/f62 3165476 0 2024-09-21T12:47:32.985 INFO:tasks.workunit.client.0.smithi046.stdout:6/834: creat de/f11d x:0 0 0 2024-09-21T12:47:32.986 INFO:tasks.workunit.client.0.smithi046.stdout:6/835: dread - de/d2a/d4c/d77/dc0/f109 zero size 2024-09-21T12:47:32.987 INFO:tasks.workunit.client.0.smithi046.stdout:5/987: unlink d4/dc/d13/d15/l60 0 2024-09-21T12:47:32.988 INFO:tasks.workunit.client.0.smithi046.stdout:3/945: mkdir d5/dc/dd5/d105/d138 0 2024-09-21T12:47:32.991 INFO:tasks.workunit.client.0.smithi046.stdout:5/988: dread d4/dc/d13/ff9 [0,4194304] 0 2024-09-21T12:47:32.991 INFO:tasks.workunit.client.0.smithi046.stdout:6/836: mkdir de/d2a/d4c/d77/dc0/d118/d11e 0 2024-09-21T12:47:32.993 INFO:tasks.workunit.client.0.smithi046.stdout:6/837: truncate de/f39 796123 0 2024-09-21T12:47:32.994 INFO:tasks.workunit.client.0.smithi046.stdout:7/986: sync 2024-09-21T12:47:32.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.995+0000 7f11f6e64640 1 -- 172.21.15.46:0/4232747535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f01001e0 msgr2=0x7f11f01025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:32.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.995+0000 7f11f6e64640 1 --2- 172.21.15.46:0/4232747535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f01001e0 0x7f11f01025f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11e40097e0 tx=0x7f11e402a3f0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.996 INFO:tasks.workunit.client.0.smithi046.stdout:6/838: readlink de/d2a/d4c/d77/d8f/l96 0 2024-09-21T12:47:32.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.995+0000 7f11f6e64640 1 -- 172.21.15.46:0/4232747535 shutdown_connections 2024-09-21T12:47:32.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.995+0000 7f11f6e64640 1 --2- 172.21.15.46:0/4232747535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f0104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.995+0000 7f11f6e64640 1 --2- 172.21.15.46:0/4232747535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f01001e0 0x7f11f01025f0 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f11e40097e0 tx=0x7f11e402a3f0 comp rx=0 tx=0).stop 2024-09-21T12:47:32.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.995+0000 7f11f6e64640 1 -- 172.21.15.46:0/4232747535 >> 172.21.15.46:0/4232747535 conn(0x7f11f00fc010 msgr2=0x7f11f00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:32.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.997+0000 7f11f6e64640 1 -- 172.21.15.46:0/4232747535 shutdown_connections 2024-09-21T12:47:32.998 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.997+0000 7f11f6e64640 1 -- 172.21.15.46:0/4232747535 wait complete. 2024-09-21T12:47:32.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.998+0000 7f11f6e64640 1 Processor -- start 2024-09-21T12:47:33.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.998+0000 7f11f6e64640 1 -- start start 2024-09-21T12:47:33.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f6e64640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f019dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f6e64640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f019e1f0 0x7f11f01a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f6e64640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0110d70 con 0x7f11f0102b30 2024-09-21T12:47:33.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f6e64640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0110bf0 con 0x7f11f019e1f0 2024-09-21T12:47:33.001 INFO:tasks.workunit.client.0.smithi046.stdout:5/989: getdents d4/dc/d13/d15/d5c 0 2024-09-21T12:47:33.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f4c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f019dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f4c00640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f019dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58790/0 (socket says 172.21.15.46:58790) 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11f4c00640 1 -- 172.21.15.46:0/1379219521 learned_addr learned my addr 172.21.15.46:0/1379219521 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:32.999+0000 7f11effff640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f019e1f0 0x7f11f01a31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.000+0000 7f11f4c00640 1 -- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f019e1f0 msgr2=0x7f11f01a31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.000+0000 7f11f4c00640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f019e1f0 0x7f11f01a31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.000+0000 7f11f4c00640 1 -- 172.21.15.46:0/1379219521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f019e720 con 0x7f11f0102b30 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.000+0000 7f11effff640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f019e1f0 0x7f11f01a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:47:33.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.000+0000 7f11f4c00640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f019dcb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f11e4034000 tx=0x7f11e40043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:33.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.001+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11e4040070 con 0x7f11f0102b30 2024-09-21T12:47:33.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.001+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11e4030c00 con 0x7f11f0102b30 2024-09-21T12:47:33.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.001+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11e4003cd0 con 0x7f11f0102b30 2024-09-21T12:47:33.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.001+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f01a36f0 con 0x7f11f0102b30 2024-09-21T12:47:33.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.001+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f01a3b40 con 0x7f11f0102b30 2024-09-21T12:47:33.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.002+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f01005e0 con 0x7f11f0102b30 2024-09-21T12:47:33.004 INFO:tasks.workunit.client.0.smithi046.stdout:5/990: symlink d4/dc/d13/da2/dce/dfe/l13d 0 2024-09-21T12:47:33.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.003+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f11e4039040 con 0x7f11f0102b30 2024-09-21T12:47:33.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.004+0000 7f11edffb640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f11e0074ab0 0x7f11e0076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.004+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f11e40b7570 con 0x7f11f0102b30 2024-09-21T12:47:33.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.004+0000 7f11effff640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f11e0074ab0 0x7f11e0076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.005+0000 7f11effff640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f11e0074ab0 0x7f11e0076f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f11dc005fd0 tx=0x7f11dc009260 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:33.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.009+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f11e4031a30 con 0x7f11f0102b30 2024-09-21T12:47:33.016 INFO:tasks.workunit.client.0.smithi046.stdout:5/991: dread d4/d22/d99/fc6 [0,4194304] 0 2024-09-21T12:47:33.017 INFO:tasks.workunit.client.0.smithi046.stdout:5/992: fdatasync d4/dc/d13/d5b/d2d/d3b/fae 0 2024-09-21T12:47:33.049 INFO:tasks.workunit.client.0.smithi046.stdout:3/946: dread d5/dc/d30/d34/f89 [0,4194304] 0 2024-09-21T12:47:33.049 INFO:tasks.workunit.client.0.smithi046.stdout:3/947: stat d5/d5e/l108 0 2024-09-21T12:47:33.050 INFO:tasks.workunit.client.0.smithi046.stdout:3/948: stat d5/dc/d94/d12d/l66 0 2024-09-21T12:47:33.054 INFO:tasks.workunit.client.0.smithi046.stdout:3/949: rmdir d5/dc 39 2024-09-21T12:47:33.056 INFO:tasks.workunit.client.0.smithi046.stdout:3/950: write d5/d5e/d8e/db5/feb [3851704,121796] 0 2024-09-21T12:47:33.070 INFO:tasks.workunit.client.0.smithi046.stdout:3/951: dwrite d5/dc/d30/d34/f89 [0,4194304] 0 2024-09-21T12:47:33.072 INFO:tasks.workunit.client.0.smithi046.stdout:7/987: write d2/d4/df/d9a/dc3/fe1 [748678,70479] 0 2024-09-21T12:47:33.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/952: creat d5/dc/d94/da6/f139 x:0 0 0 2024-09-21T12:47:33.078 INFO:tasks.workunit.client.0.smithi046.stdout:7/988: dread - d2/d4/df/d42/fdb zero size 2024-09-21T12:47:33.080 INFO:tasks.workunit.client.0.smithi046.stdout:5/993: write d4/dc/d13/d5b/d2d/d3b/fc4 [637395,60003] 0 2024-09-21T12:47:33.083 INFO:tasks.workunit.client.0.smithi046.stdout:6/839: dwrite de/f4b [0,4194304] 0 2024-09-21T12:47:33.089 INFO:tasks.workunit.client.0.smithi046.stdout:5/994: read d4/dc/d13/f81 [1867383,47875] 0 2024-09-21T12:47:33.098 INFO:tasks.workunit.client.0.smithi046.stdout:5/995: truncate d4/dc/d13/d5b/d2d/d3b/fa1 1838876 0 2024-09-21T12:47:33.102 INFO:tasks.workunit.client.0.smithi046.stdout:6/840: mknod de/d2a/c11f 0 2024-09-21T12:47:33.107 INFO:tasks.workunit.client.0.smithi046.stdout:7/989: dwrite d2/d4/df/d70/d88/d34/d7f/fb5 [0,4194304] 0 2024-09-21T12:47:33.113 INFO:tasks.workunit.client.0.smithi046.stdout:6/841: dwrite de/f11d [0,4194304] 0 2024-09-21T12:47:33.114 INFO:tasks.workunit.client.0.smithi046.stdout:5/996: getdents d4/dc/d13/d5b/d2d/d43 0 2024-09-21T12:47:33.116 INFO:tasks.workunit.client.0.smithi046.stdout:6/842: truncate de/d2a/fd8 1452691 0 2024-09-21T12:47:33.121 INFO:tasks.workunit.client.0.smithi046.stdout:7/990: mknod d2/d4/df/d42/dca/d130/c147 0 2024-09-21T12:47:33.126 INFO:tasks.workunit.client.0.smithi046.stdout:5/997: fsync d4/fbe 0 2024-09-21T12:47:33.127 INFO:tasks.workunit.client.0.smithi046.stdout:5/998: stat d4/dc/d13/d5b/d2d/f91 0 2024-09-21T12:47:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:5/999: readlink d4/d22/d99/dc7/laf 0 2024-09-21T12:47:33.128 INFO:tasks.workunit.client.0.smithi046.stdout:6/843: fdatasync de/d2a/d4d/f79 0 2024-09-21T12:47:33.135 INFO:tasks.workunit.client.0.smithi046.stdout:6/844: creat de/d2a/d4d/f120 x:0 0 0 2024-09-21T12:47:33.168 INFO:tasks.workunit.client.0.smithi046.stdout:7/991: creat d2/f148 x:0 0 0 2024-09-21T12:47:33.171 INFO:tasks.workunit.client.0.smithi046.stdout:7/992: dread - d2/d4/df/d42/dd1/f118 zero size 2024-09-21T12:47:33.173 INFO:tasks.workunit.client.0.smithi046.stdout:6/845: unlink de/d2a/d4c/d77/d98/lac 0 2024-09-21T12:47:33.174 INFO:tasks.workunit.client.0.smithi046.stdout:7/993: mkdir d2/d4/df/d42/dd1/dfd/d149 0 2024-09-21T12:47:33.175 INFO:tasks.workunit.client.0.smithi046.stdout:7/994: chown d2/d4/df/d42/dd1/dfd 513051394 1 2024-09-21T12:47:33.176 INFO:tasks.workunit.client.0.smithi046.stdout:7/995: chown d2/d4/d43/d58 6634 1 2024-09-21T12:47:33.177 INFO:tasks.workunit.client.0.smithi046.stdout:7/996: dread - d2/d4/df/d42/fdb zero size 2024-09-21T12:47:33.177 INFO:tasks.workunit.client.0.smithi046.stdout:6/846: rename de/d2a/c53 to de/d35/db2/c121 0 2024-09-21T12:47:33.178 INFO:tasks.workunit.client.0.smithi046.stdout:7/997: chown d2/d37/d8a/d99/f113 2093976 1 2024-09-21T12:47:33.180 INFO:tasks.workunit.client.0.smithi046.stdout:6/847: mkdir de/d2a/d4c/d77/dc0/d118/d122 0 2024-09-21T12:47:33.183 INFO:tasks.workunit.client.0.smithi046.stdout:7/998: rename d2/d4/d43/l112 to d2/d4/df/d17/l14a 0 2024-09-21T12:47:33.184 INFO:tasks.workunit.client.0.smithi046.stdout:7/999: chown d2/d4/df/d6f/l73 211381329 1 2024-09-21T12:47:33.233 INFO:tasks.workunit.client.0.smithi046.stdout:6/848: truncate de/fda 1477172 0 2024-09-21T12:47:33.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.335+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f11f01a3d10 con 0x7f11e0074ab0 2024-09-21T12:47:33.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.336+0000 7f11edffb640 1 -- 172.21.15.46:0/1379219521 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7f11dc0098b0 con 0x7f11e0074ab0 2024-09-21T12:47:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f11e0074ab0 msgr2=0x7f11e0076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f11e0074ab0 0x7f11e0076f70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f11dc005fd0 tx=0x7f11dc009260 comp rx=0 tx=0).stop 2024-09-21T12:47:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 msgr2=0x7f11f019dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f019dcb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f11e4034000 tx=0x7f11e40043b0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 shutdown_connections 2024-09-21T12:47:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f11e0074ab0 0x7f11e0076f70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11f019e1f0 0x7f11f01a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 --2- 172.21.15.46:0/1379219521 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f11f0102b30 0x7f11f019dcb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 >> 172.21.15.46:0/1379219521 conn(0x7f11f00fc010 msgr2=0x7f11f00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:33.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 shutdown_connections 2024-09-21T12:47:33.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.338+0000 7f11f6e64640 1 -- 172.21.15.46:0/1379219521 wait complete. 2024-09-21T12:47:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 -- 172.21.15.46:0/2186088448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4102470 msgr2=0x7f8dd4104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/2186088448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4102470 0x7f8dd4104860 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8009880 tx=0x7f8dc802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 -- 172.21.15.46:0/2186088448 shutdown_connections 2024-09-21T12:47:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/2186088448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4104da0 0x7f8dd4107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/2186088448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4102470 0x7f8dd4104860 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 -- 172.21.15.46:0/2186088448 >> 172.21.15.46:0/2186088448 conn(0x7f8dd40fc010 msgr2=0x7f8dd40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 -- 172.21.15.46:0/2186088448 shutdown_connections 2024-09-21T12:47:33.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.426+0000 7f8ddb08a640 1 -- 172.21.15.46:0/2186088448 wait complete. 2024-09-21T12:47:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8ddb08a640 1 Processor -- start 2024-09-21T12:47:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8ddb08a640 1 -- start start 2024-09-21T12:47:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8ddb08a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4102470 0x7f8dd4197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8ddb08a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 0x7f8dd4197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8ddb08a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd410a7d0 con 0x7f8dd4104da0 2024-09-21T12:47:33.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8ddb08a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd410a650 con 0x7f8dd4102470 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8dd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 0x7f8dd4197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8dd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 0x7f8dd4197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58814/0 (socket says 172.21.15.46:58814) 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8dd3fff640 1 -- 172.21.15.46:0/3932180387 learned_addr learned my addr 172.21.15.46:0/3932180387 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.427+0000 7f8dd8e26640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4102470 0x7f8dd4197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd3fff640 1 -- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4102470 msgr2=0x7f8dd4197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd3fff640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4102470 0x7f8dd4197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd3fff640 1 -- 172.21.15.46:0/3932180387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd41980e0 con 0x7f8dd4104da0 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd8e26640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4102470 0x7f8dd4197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd3fff640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 0x7f8dd4197a60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000e970 tx=0x7f8dc000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dc000cac0 con 0x7f8dd4104da0 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8dc00054e0 con 0x7f8dd4104da0 2024-09-21T12:47:33.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.428+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd41002c0 con 0x7f8dd4104da0 2024-09-21T12:47:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.429+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8dc0010430 con 0x7f8dd4104da0 2024-09-21T12:47:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.429+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd4100850 con 0x7f8dd4104da0 2024-09-21T12:47:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.430+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd4102850 con 0x7f8dd4104da0 2024-09-21T12:47:33.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.430+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8dc0004ee0 con 0x7f8dd4104da0 2024-09-21T12:47:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.431+0000 7f8dd1ffb640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8dc4074a30 0x7f8dc4076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.431+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f8dc00969c0 con 0x7f8dd4104da0 2024-09-21T12:47:33.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.431+0000 7f8dd8e26640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8dc4074a30 0x7f8dc4076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.432+0000 7f8dd8e26640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8dc4074a30 0x7f8dc4076ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8000c00 tx=0x7f8dc80058d0 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:33.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.436+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8dc0061ef0 con 0x7f8dd4104da0 2024-09-21T12:47:33.463 INFO:tasks.workunit.client.0.smithi046.stdout:3/953: sync 2024-09-21T12:47:33.467 INFO:tasks.workunit.client.0.smithi046.stdout:3/954: truncate d5/dc/d94/d12d/f4c 414896 0 2024-09-21T12:47:33.468 INFO:tasks.workunit.client.0.smithi046.stdout:3/955: chown d5/dc/c87 47295 1 2024-09-21T12:47:33.469 INFO:tasks.workunit.client.0.smithi046.stdout:3/956: dread - d5/d5e/d8e/de8/f12c zero size 2024-09-21T12:47:33.470 INFO:tasks.workunit.client.0.smithi046.stdout:3/957: chown d5/dc/d28/c31 32583 1 2024-09-21T12:47:33.476 INFO:tasks.workunit.client.0.smithi046.stdout:3/958: dwrite d5/dc/d30/d34/f8c [0,4194304] 0 2024-09-21T12:47:33.484 INFO:tasks.workunit.client.0.smithi046.stdout:3/959: link d5/dc/d94/da6/d101/l128 d5/d5e/d8e/dcf/d123/l13a 0 2024-09-21T12:47:33.488 INFO:tasks.workunit.client.0.smithi046.stdout:3/960: symlink d5/dc/d30/d7c/l13b 0 2024-09-21T12:47:33.490 INFO:tasks.workunit.client.0.smithi046.stdout:3/961: creat d5/d5e/d8e/db5/f13c x:0 0 0 2024-09-21T12:47:33.491 INFO:tasks.workunit.client.0.smithi046.stdout:3/962: readlink d5/d5e/d8e/de8/l131 0 2024-09-21T12:47:33.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/963: rename d5/d5e/l75 to d5/d16/d5f/l13d 0 2024-09-21T12:47:33.496 INFO:tasks.workunit.client.0.smithi046.stdout:3/964: dread - d5/d16/d5f/d6c/fed zero size 2024-09-21T12:47:33.498 INFO:tasks.workunit.client.0.smithi046.stdout:3/965: rmdir d5/d16 39 2024-09-21T12:47:33.511 INFO:tasks.workunit.client.0.smithi046.stdout:3/966: dwrite d5/d16/d5f/dad/fef [0,4194304] 0 2024-09-21T12:47:33.512 INFO:tasks.workunit.client.0.smithi046.stdout:3/967: chown d5/dc/d94/da6/d101/d120 5262 1 2024-09-21T12:47:33.517 INFO:tasks.workunit.client.0.smithi046.stdout:3/968: mknod d5/dc/d28/d63/c13e 0 2024-09-21T12:47:33.517 INFO:tasks.workunit.client.0.smithi046.stdout:3/969: chown d5/fa0 2 1 2024-09-21T12:47:33.522 INFO:tasks.workunit.client.0.smithi046.stdout:3/970: dread d5/f6b [0,4194304] 0 2024-09-21T12:47:33.525 INFO:tasks.workunit.client.0.smithi046.stdout:3/971: truncate d5/dc/d28/f2c 3471942 0 2024-09-21T12:47:33.532 INFO:tasks.workunit.client.0.smithi046.stdout:3/972: dwrite d5/dc/d28/d60/f73 [0,4194304] 0 2024-09-21T12:47:33.533 INFO:tasks.workunit.client.0.smithi046.stdout:3/973: rmdir d5/d16 39 2024-09-21T12:47:33.536 INFO:tasks.workunit.client.0.smithi046.stdout:3/974: symlink d5/d5e/l13f 0 2024-09-21T12:47:33.542 INFO:tasks.workunit.client.0.smithi046.stdout:3/975: creat d5/d16/d5f/d110/f140 x:0 0 0 2024-09-21T12:47:33.549 INFO:tasks.workunit.client.0.smithi046.stdout:3/976: dwrite d5/d16/d5f/d110/f134 [0,4194304] 0 2024-09-21T12:47:33.554 INFO:tasks.workunit.client.0.smithi046.stdout:6/849: sync 2024-09-21T12:47:33.556 INFO:tasks.workunit.client.0.smithi046.stdout:3/977: symlink d5/dc/dfc/l141 0 2024-09-21T12:47:33.557 INFO:tasks.workunit.client.0.smithi046.stdout:3/978: readlink d5/dc/ld4 0 2024-09-21T12:47:33.559 INFO:tasks.workunit.client.0.smithi046.stdout:6/850: dread de/d2a/d4c/d71/d7c/f92 [0,4194304] 0 2024-09-21T12:47:33.563 INFO:tasks.workunit.client.0.smithi046.stdout:6/851: mkdir de/d2a/d4c/da6/d123 0 2024-09-21T12:47:33.564 INFO:tasks.workunit.client.0.smithi046.stdout:3/979: dwrite d5/dc/d94/d12d/f78 [0,4194304] 0 2024-09-21T12:47:33.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/852: write de/d35/f89 [1072311,10250] 0 2024-09-21T12:47:33.568 INFO:tasks.workunit.client.0.smithi046.stdout:3/980: read d5/d16/d5f/d6c/f10b [3532696,22856] 0 2024-09-21T12:47:33.570 INFO:tasks.workunit.client.0.smithi046.stdout:3/981: write d5/dc/d30/d34/dd1/f7e [4726345,116542] 0 2024-09-21T12:47:33.578 INFO:tasks.workunit.client.0.smithi046.stdout:3/982: dread d5/d5e/d8e/dcf/d123/f126 [0,4194304] 0 2024-09-21T12:47:33.583 INFO:tasks.workunit.client.0.smithi046.stdout:3/983: symlink d5/d5e/d8e/l142 0 2024-09-21T12:47:33.586 INFO:tasks.workunit.client.0.smithi046.stdout:3/984: read - d5/dc/d94/d12d/d3c/f4e zero size 2024-09-21T12:47:33.587 INFO:tasks.workunit.client.0.smithi046.stdout:6/853: dwrite de/d48/fcb [0,4194304] 0 2024-09-21T12:47:33.588 INFO:tasks.workunit.client.0.smithi046.stdout:3/985: readlink d5/d5e/l108 0 2024-09-21T12:47:33.595 INFO:tasks.workunit.client.0.smithi046.stdout:3/986: creat d5/d16/f143 x:0 0 0 2024-09-21T12:47:33.601 INFO:tasks.workunit.client.0.smithi046.stdout:3/987: rmdir d5/dc/d94/da6 39 2024-09-21T12:47:33.606 INFO:tasks.workunit.client.0.smithi046.stdout:6/854: rename de/d2a/d4c/d77/dc0/f109 to de/d2a/d4c/d77/d98/f124 0 2024-09-21T12:47:33.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/855: dwrite de/d2a/d4c/d69/f86 [0,4194304] 0 2024-09-21T12:47:33.627 INFO:tasks.workunit.client.0.smithi046.stdout:6/856: rmdir de/d2a/d4c/d77/d8f 39 2024-09-21T12:47:33.634 INFO:tasks.workunit.client.0.smithi046.stdout:6/857: fdatasync de/d2a/d4c/d77/dae/d55/f8e 0 2024-09-21T12:47:33.641 INFO:tasks.workunit.client.0.smithi046.stdout:6/858: fdatasync f9 0 2024-09-21T12:47:33.647 INFO:tasks.workunit.client.0.smithi046.stdout:6/859: read - de/d2a/d4c/d77/d8f/d94/de7/f110 zero size 2024-09-21T12:47:33.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/860: truncate de/d35/fb1 883190 0 2024-09-21T12:47:33.661 INFO:tasks.workunit.client.0.smithi046.stdout:6/861: write de/d2a/d4c/d71/d7c/f99 [1682526,48953] 0 2024-09-21T12:47:33.668 INFO:tasks.workunit.client.0.smithi046.stdout:6/862: dwrite de/d2a/d4c/d77/dae/f114 [0,4194304] 0 2024-09-21T12:47:33.680 INFO:tasks.workunit.client.0.smithi046.stdout:6/863: write de/d2a/d4c/d77/d8f/fca [4446446,10489] 0 2024-09-21T12:47:33.681 INFO:tasks.workunit.client.0.smithi046.stdout:6/864: chown de/d2a/d4c/d71/d7c 188645469 1 2024-09-21T12:47:33.683 INFO:tasks.workunit.client.0.smithi046.stdout:6/865: stat de/d2a/d4c/c80 0 2024-09-21T12:47:33.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/866: truncate de/d2a/d4c/d69/fbc 43659 0 2024-09-21T12:47:33.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/867: rmdir de/df7 39 2024-09-21T12:47:33.687 INFO:tasks.workunit.client.0.smithi046.stdout:6/868: chown de/d35/c50 86866 1 2024-09-21T12:47:33.688 INFO:tasks.workunit.client.0.smithi046.stdout:6/869: fdatasync de/d2a/d4c/d77/dae/f114 0 2024-09-21T12:47:33.695 INFO:tasks.workunit.client.0.smithi046.stdout:6/870: creat de/f125 x:0 0 0 2024-09-21T12:47:33.696 INFO:tasks.workunit.client.0.smithi046.stdout:6/871: readlink de/d2a/d4c/d77/d98/laa 0 2024-09-21T12:47:33.698 INFO:tasks.workunit.client.0.smithi046.stdout:6/872: creat de/d2a/d4c/d77/dae/d55/f126 x:0 0 0 2024-09-21T12:47:33.701 INFO:tasks.workunit.client.0.smithi046.stdout:6/873: truncate de/d35/f101 1468477 0 2024-09-21T12:47:33.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/874: fdatasync de/df7/f115 0 2024-09-21T12:47:33.715 INFO:tasks.workunit.client.0.smithi046.stdout:6/875: dread de/d2a/d4c/d69/f65 [0,4194304] 0 2024-09-21T12:47:33.719 INFO:tasks.workunit.client.0.smithi046.stdout:6/876: creat de/d2a/f127 x:0 0 0 2024-09-21T12:47:33.721 INFO:tasks.workunit.client.0.smithi046.stdout:6/877: rmdir de/d35 39 2024-09-21T12:47:33.722 INFO:tasks.workunit.client.0.smithi046.stdout:6/878: read de/d48/fcb [1320571,22649] 0 2024-09-21T12:47:33.728 INFO:tasks.workunit.client.0.smithi046.stdout:6/879: creat de/d2a/d4c/d77/dc0/d118/f128 x:0 0 0 2024-09-21T12:47:33.730 INFO:tasks.workunit.client.0.smithi046.stdout:6/880: symlink de/d2a/d4c/d71/l129 0 2024-09-21T12:47:33.732 INFO:tasks.workunit.client.0.smithi046.stdout:6/881: unlink de/f20 0 2024-09-21T12:47:33.733 INFO:tasks.workunit.client.0.smithi046.stdout:6/882: write de/d2a/fbb [2992364,64171] 0 2024-09-21T12:47:33.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.737+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8dd4105720 con 0x7f8dc4074a30 2024-09-21T12:47:33.742 INFO:tasks.workunit.client.0.smithi046.stdout:6/883: write de/d2a/d4c/d77/f8c [424009,41653] 0 2024-09-21T12:47:33.743 INFO:tasks.workunit.client.0.smithi046.stdout:6/884: write de/d2a/f127 [709291,72069] 0 2024-09-21T12:47:33.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/885: mkdir de/d2a/d4c/d77/d12a 0 2024-09-21T12:47:33.746 INFO:tasks.workunit.client.0.smithi046.stdout:6/886: fdatasync de/df7/f115 0 2024-09-21T12:47:33.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.749+0000 7f8dd1ffb640 1 -- 172.21.15.46:0/3932180387 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8dd4105720 con 0x7f8dc4074a30 2024-09-21T12:47:33.750 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:47:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 71s ago 8m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:47:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 starting - - - - 2024-09-21T12:47:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 starting - - - - 2024-09-21T12:47:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 71s ago 8m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:47:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (7m) 69s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:47:33.751 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 71s ago 8m 79.9M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (3m) 71s ago 3m 106M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (3m) 71s ago 3m 131M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (3m) 69s ago 3m 20.6M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (3m) 69s ago 3m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 starting - - - - 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (92s) 69s ago 7m 497M - 19.3.0-5104-g44178494 b415816db8b4 95f2eac0602f 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 71s ago 10m 51.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (7m) 69s ago 7m 45.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 71s ago 8m 15.1M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (7m) 69s ago 7m 17.4M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 71s ago 6m 77.2M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:47:33.752 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 71s ago 6m 78.0M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 71s ago 5m 65.1M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (5m) 69s ago 5m 74.2M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (4m) 69s ago 4m 69.7M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (4m) 69s ago 4m 67.7M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 starting - - - - 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.751+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8dc4074a30 msgr2=0x7f8dc4076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.751+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8dc4074a30 0x7f8dc4076ef0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8000c00 tx=0x7f8dc80058d0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.751+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 msgr2=0x7f8dd4197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.751+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 0x7f8dd4197a60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000e970 tx=0x7f8dc000ee30 comp rx=0 tx=0).stop 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 shutdown_connections 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f8dc4074a30 0x7f8dc4076ef0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8dd4104da0 0x7f8dd4197a60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 --2- 172.21.15.46:0/3932180387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8dd4102470 0x7f8dd4197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 >> 172.21.15.46:0/3932180387 conn(0x7f8dd40fc010 msgr2=0x7f8dd40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 shutdown_connections 2024-09-21T12:47:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.752+0000 7f8ddb08a640 1 -- 172.21.15.46:0/3932180387 wait complete. 2024-09-21T12:47:33.758 INFO:tasks.workunit.client.0.smithi046.stdout:6/887: dwrite de/d2a/d34/f3b [0,4194304] 0 2024-09-21T12:47:33.767 INFO:tasks.workunit.client.0.smithi046.stdout:6/888: dwrite de/d2a/d34/db6/fd7 [0,4194304] 0 2024-09-21T12:47:33.774 INFO:tasks.workunit.client.0.smithi046.stdout:6/889: mknod de/d35/db2/c12b 0 2024-09-21T12:47:33.779 INFO:tasks.workunit.client.0.smithi046.stdout:6/890: rmdir de/d2a/d4c/d77/d8f/d94 39 2024-09-21T12:47:33.794 INFO:tasks.workunit.client.0.smithi046.stdout:6/891: write de/d2a/d4c/d69/fbc [143118,130362] 0 2024-09-21T12:47:33.797 INFO:tasks.workunit.client.0.smithi046.stdout:6/892: creat de/d2a/d4c/d77/dc0/f12c x:0 0 0 2024-09-21T12:47:33.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 -- 172.21.15.46:0/1326828558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 msgr2=0x7f657c100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 --2- 172.21.15.46:0/1326828558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c100fe0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6568009880 tx=0x7f656802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 -- 172.21.15.46:0/1326828558 shutdown_connections 2024-09-21T12:47:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 --2- 172.21.15.46:0/1326828558 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c100fe0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 --2- 172.21.15.46:0/1326828558 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f657c100240 0x7f657c100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 -- 172.21.15.46:0/1326828558 >> 172.21.15.46:0/1326828558 conn(0x7f657c0fc010 msgr2=0x7f657c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:33.863 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:33 smithi046 ceph-mon[27868]: pgmap v43: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 42 MiB/s rd, 105 MiB/s wr, 278 op/s 2024-09-21T12:47:33.863 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:33 smithi046 ceph-mon[27868]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:33.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 -- 172.21.15.46:0/1326828558 shutdown_connections 2024-09-21T12:47:33.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.860+0000 7f6582e27640 1 -- 172.21.15.46:0/1326828558 wait complete. 2024-09-21T12:47:33.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.861+0000 7f6582e27640 1 Processor -- start 2024-09-21T12:47:33.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.861+0000 7f6582e27640 1 -- start start 2024-09-21T12:47:33.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.861+0000 7f6582e27640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f657c100240 0x7f657c199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.861+0000 7f6582e27640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c199b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.861+0000 7f6582e27640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f657c10c970 con 0x7f657c100b80 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.861+0000 7f6582e27640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f657c10c7f0 con 0x7f657c100240 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c199b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c199b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58830/0 (socket says 172.21.15.46:58830) 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 -- 172.21.15.46:0/1666284271 learned_addr learned my addr 172.21.15.46:0/1666284271 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f6580bc3640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f657c100240 0x7f657c199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 -- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f657c100240 msgr2=0x7f657c199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f657c100240 0x7f657c199640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 -- 172.21.15.46:0/1666284271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657c19a200 con 0x7f657c100b80 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f657bfff640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c199b80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6568006010 tx=0x7f65680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.862+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f656803f070 con 0x7f657c100b80 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.863+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6568004ac0 con 0x7f657c100b80 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.863+0000 7f6582e27640 1 -- 172.21.15.46:0/1666284271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657c19ebe0 con 0x7f657c100b80 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.863+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6568035030 con 0x7f657c100b80 2024-09-21T12:47:33.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.863+0000 7f6582e27640 1 -- 172.21.15.46:0/1666284271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f657c19f170 con 0x7f657c100b80 2024-09-21T12:47:33.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.864+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f655c005290 con 0x7f657c100b80 2024-09-21T12:47:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.865+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f6568042070 con 0x7f657c100b80 2024-09-21T12:47:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.866+0000 7f6579ffb640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f656c074a80 0x7f656c076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:33.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.866+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7f65680b6dd0 con 0x7f657c100b80 2024-09-21T12:47:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.866+0000 7f6580bc3640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f656c074a80 0x7f656c076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:33.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.867+0000 7f6580bc3640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f656c074a80 0x7f656c076f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6570005d00 tx=0x7f657000b410 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:33.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:33.873+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6568082380 con 0x7f657c100b80 2024-09-21T12:47:34.054 INFO:tasks.workunit.client.0.smithi046.stdout:3/988: sync 2024-09-21T12:47:34.064 INFO:tasks.workunit.client.0.smithi046.stdout:3/989: dwrite d5/dc/f57 [0,4194304] 0 2024-09-21T12:47:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:33 smithi176 ceph-mon[35476]: pgmap v43: 65 pgs: 65 active+clean; 2.9 GiB data, 8.8 GiB used, 528 GiB / 536 GiB avail; 42 MiB/s rd, 105 MiB/s wr, 278 op/s 2024-09-21T12:47:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:33 smithi176 ceph-mon[35476]: from='client.24457 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:34.075 INFO:tasks.workunit.client.0.smithi046.stdout:3/990: dwrite d5/dc/d30/d34/dd1/f74 [0,4194304] 0 2024-09-21T12:47:34.082 INFO:tasks.workunit.client.0.smithi046.stdout:3/991: creat d5/dc/d94/da6/d101/f144 x:0 0 0 2024-09-21T12:47:34.084 INFO:tasks.workunit.client.0.smithi046.stdout:3/992: write d5/d5e/d8e/db5/f13c [70531,84622] 0 2024-09-21T12:47:34.085 INFO:tasks.workunit.client.0.smithi046.stdout:3/993: chown d5/dc/d28/d63/c72 1 1 2024-09-21T12:47:34.087 INFO:tasks.workunit.client.0.smithi046.stdout:3/994: chown d5/dc/d94/dd6/ff3 22621329 1 2024-09-21T12:47:34.092 INFO:tasks.workunit.client.0.smithi046.stdout:3/995: rename d5/d16/d5f/ff7 to d5/dc/d28/f145 0 2024-09-21T12:47:34.109 INFO:tasks.workunit.client.0.smithi046.stdout:3/996: dread d5/dc/dd5/f119 [0,4194304] 0 2024-09-21T12:47:34.111 INFO:tasks.workunit.client.0.smithi046.stdout:3/997: symlink d5/d16/d5f/d110/l146 0 2024-09-21T12:47:34.113 INFO:tasks.workunit.client.0.smithi046.stdout:3/998: creat d5/d5e/d8e/db5/f147 x:0 0 0 2024-09-21T12:47:34.115 INFO:tasks.workunit.client.0.smithi046.stdout:3/999: mknod d5/dc/d94/d12d/d3c/d116/c148 0 2024-09-21T12:47:34.139 INFO:tasks.workunit.client.0.smithi046.stdout:6/893: sync 2024-09-21T12:47:34.153 INFO:tasks.workunit.client.0.smithi046.stdout:6/894: rmdir de/d2a/d4c/d69 39 2024-09-21T12:47:34.186 INFO:tasks.workunit.client.0.smithi046.stdout:6/895: write de/d2a/d4c/d77/dae/d55/f73 [983265,39681] 0 2024-09-21T12:47:34.187 INFO:tasks.workunit.client.0.smithi046.stdout:6/896: readlink de/d48/l66 0 2024-09-21T12:47:34.192 INFO:tasks.workunit.client.0.smithi046.stdout:6/897: creat de/d2a/d4c/d77/dc0/d118/d11e/f12d x:0 0 0 2024-09-21T12:47:34.194 INFO:tasks.workunit.client.0.smithi046.stdout:6/898: chown de/d2a/d4c/d77/dae/l8d 13258 1 2024-09-21T12:47:34.198 INFO:tasks.workunit.client.0.smithi046.stdout:6/899: rmdir de/d2a/d4c/da6/d123 0 2024-09-21T12:47:34.200 INFO:tasks.workunit.client.0.smithi046.stdout:6/900: mkdir de/d2a/d4c/d77/d98/d12e 0 2024-09-21T12:47:34.207 INFO:tasks.workunit.client.0.smithi046.stdout:6/901: dwrite de/d2a/d4c/f58 [0,4194304] 0 2024-09-21T12:47:34.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/902: dread - de/d2a/d4c/d77/dc0/fd5 zero size 2024-09-21T12:47:34.210 INFO:tasks.workunit.client.0.smithi046.stdout:6/903: read de/f4b [2367192,93482] 0 2024-09-21T12:47:34.221 INFO:tasks.workunit.client.0.smithi046.stdout:6/904: dread de/f1d [0,4194304] 0 2024-09-21T12:47:34.231 INFO:tasks.workunit.client.0.smithi046.stdout:6/905: dwrite de/d2a/d34/fe6 [0,4194304] 0 2024-09-21T12:47:34.234 INFO:tasks.workunit.client.0.smithi046.stdout:6/906: write de/d2a/d4c/d69/fb9 [202860,104737] 0 2024-09-21T12:47:34.242 INFO:tasks.workunit.client.0.smithi046.stdout:6/907: write de/d2a/d4c/d71/f93 [2002961,59100] 0 2024-09-21T12:47:34.243 INFO:tasks.workunit.client.0.smithi046.stdout:6/908: chown de/d2a/d4d/l52 0 1 2024-09-21T12:47:34.251 INFO:tasks.workunit.client.0.smithi046.stdout:6/909: dwrite de/d48/fcb [4194304,4194304] 0 2024-09-21T12:47:34.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.262+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f655c005850 con 0x7f657c100b80 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.263+0000 7f6579ffb640 1 -- 172.21.15.46:0/1666284271 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f6568087230 con 0x7f657c100b80 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:47:34.264 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:47:34.265 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:47:34.266 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:47:34.266 INFO:tasks.workunit.client.0.smithi046.stdout:6/910: dwrite de/d2a/f2f [0,4194304] 0 2024-09-21T12:47:34.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f656c074a80 msgr2=0x7f656c076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f656c074a80 0x7f656c076f40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6570005d00 tx=0x7f657000b410 comp rx=0 tx=0).stop 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 msgr2=0x7f657c199b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c199b80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6568006010 tx=0x7f65680046c0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 shutdown_connections 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7f656c074a80 0x7f656c076f40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f657c100b80 0x7f657c199b80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 --2- 172.21.15.46:0/1666284271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f657c100240 0x7f657c199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.265+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 >> 172.21.15.46:0/1666284271 conn(0x7f657c0fc010 msgr2=0x7f657c108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.266+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 shutdown_connections 2024-09-21T12:47:34.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.266+0000 7f65677fe640 1 -- 172.21.15.46:0/1666284271 wait complete. 2024-09-21T12:47:34.269 INFO:tasks.workunit.client.0.smithi046.stdout:6/911: stat de/d35/fb1 0 2024-09-21T12:47:34.275 INFO:tasks.workunit.client.0.smithi046.stdout:6/912: write de/d35/fb5 [184503,126959] 0 2024-09-21T12:47:34.277 INFO:tasks.workunit.client.0.smithi046.stdout:6/913: symlink de/d2a/d4c/d69/l12f 0 2024-09-21T12:47:34.290 INFO:tasks.workunit.client.0.smithi046.stdout:6/914: truncate de/d2a/d4c/d69/fb9 2673296 0 2024-09-21T12:47:34.292 INFO:tasks.workunit.client.0.smithi046.stdout:6/915: fdatasync de/d2a/d4c/d77/d98/fd3 0 2024-09-21T12:47:34.301 INFO:tasks.workunit.client.0.smithi046.stdout:6/916: fdatasync de/d2a/d4c/d69/fb9 0 2024-09-21T12:47:34.308 INFO:tasks.workunit.client.0.smithi046.stdout:6/917: rename de/d2a/d4c/d77/c113 to de/d2a/d4c/d77/dc0/dc8/c130 0 2024-09-21T12:47:34.309 INFO:tasks.workunit.client.0.smithi046.stdout:6/918: chown de/d2a/d4c/cf4 3648448 1 2024-09-21T12:47:34.316 INFO:tasks.workunit.client.0.smithi046.stdout:6/919: link de/d2a/d4c/d77/fb0 de/d2a/d4c/d77/d8f/d94/f131 0 2024-09-21T12:47:34.319 INFO:tasks.workunit.client.0.smithi046.stdout:6/920: read de/f44 [153086,111067] 0 2024-09-21T12:47:34.323 INFO:tasks.workunit.client.0.smithi046.stdout:6/921: rename f3 to de/d2a/d4c/d77/dae/f132 0 2024-09-21T12:47:34.324 INFO:tasks.workunit.client.0.smithi046.stdout:6/922: fsync de/d2a/d4c/d69/f65 0 2024-09-21T12:47:34.332 INFO:tasks.workunit.client.0.smithi046.stdout:6/923: dread - de/d2a/d4c/d77/d8f/d94/f131 zero size 2024-09-21T12:47:34.338 INFO:tasks.workunit.client.0.smithi046.stdout:6/924: mkdir de/d2a/d4c/da6/d133 0 2024-09-21T12:47:34.344 INFO:tasks.workunit.client.0.smithi046.stdout:6/925: dwrite de/d2a/d4c/d71/d7c/f99 [4194304,4194304] 0 2024-09-21T12:47:34.350 INFO:tasks.workunit.client.0.smithi046.stdout:6/926: dwrite de/d2a/d4c/d77/f8c [0,4194304] 0 2024-09-21T12:47:34.354 INFO:tasks.workunit.client.0.smithi046.stdout:6/927: rmdir de/d2a/d4c/d77/dae 39 2024-09-21T12:47:34.363 INFO:tasks.workunit.client.0.smithi046.stdout:6/928: link de/d35/c51 de/d2a/d4c/da6/d133/c134 0 2024-09-21T12:47:34.366 INFO:tasks.workunit.client.0.smithi046.stdout:6/929: write de/d2a/d4c/d77/dae/d55/f126 [930862,27055] 0 2024-09-21T12:47:34.372 INFO:tasks.workunit.client.0.smithi046.stdout:6/930: rename de/d2a/d4c/c6d to de/d2a/d4c/d77/d8f/d94/de7/c135 0 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.385+0000 7fc06be46640 1 -- 172.21.15.46:0/2663902472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064102450 msgr2=0x7fc064104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.385+0000 7fc06be46640 1 --2- 172.21.15.46:0/2663902472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064102450 0x7fc064104840 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fc060009880 tx=0x7fc06002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.385+0000 7fc06be46640 1 -- 172.21.15.46:0/2663902472 shutdown_connections 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.385+0000 7fc06be46640 1 --2- 172.21.15.46:0/2663902472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064104d80 0x7fc064107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.385+0000 7fc06be46640 1 --2- 172.21.15.46:0/2663902472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064102450 0x7fc064104840 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.385+0000 7fc06be46640 1 -- 172.21.15.46:0/2663902472 >> 172.21.15.46:0/2663902472 conn(0x7fc0640fc010 msgr2=0x7fc0640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.386+0000 7fc06be46640 1 -- 172.21.15.46:0/2663902472 shutdown_connections 2024-09-21T12:47:34.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.386+0000 7fc06be46640 1 -- 172.21.15.46:0/2663902472 wait complete. 2024-09-21T12:47:34.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.387+0000 7fc06be46640 1 Processor -- start 2024-09-21T12:47:34.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.387+0000 7fc06be46640 1 -- start start 2024-09-21T12:47:34.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc06be46640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064102450 0x7fc064197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:34.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc06be46640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064104d80 0x7fc064197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:34.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc069be2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064102450 0x7fc064197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:34.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc069be2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064102450 0x7fc064197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:40820/0 (socket says 172.21.15.46:40820) 2024-09-21T12:47:34.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc069be2640 1 -- 172.21.15.46:0/2457981355 learned_addr learned my addr 172.21.15.46:0/2457981355 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:47:34.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc06410a750 con 0x7fc064104d80 2024-09-21T12:47:34.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.388+0000 7fc0693e1640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064104d80 0x7fc064197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:34.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.389+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc06410a5d0 con 0x7fc064102450 2024-09-21T12:47:34.391 INFO:tasks.workunit.client.0.smithi046.stdout:6/931: dread de/d2a/d4c/d69/f84 [0,4194304] 0 2024-09-21T12:47:34.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.389+0000 7fc0693e1640 1 -- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064102450 msgr2=0x7fc064197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:34.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.389+0000 7fc0693e1640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064102450 0x7fc064197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.389+0000 7fc0693e1640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc064198010 con 0x7fc064104d80 2024-09-21T12:47:34.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.390+0000 7fc0693e1640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064104d80 0x7fc064197990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d6a0 tx=0x7fc05400db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:34.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.390+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc054017070 con 0x7fc064104d80 2024-09-21T12:47:34.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.390+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06419ca50 con 0x7fc064104d80 2024-09-21T12:47:34.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.390+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc06419cfe0 con 0x7fc064104d80 2024-09-21T12:47:34.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.390+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0540054e0 con 0x7fc064104d80 2024-09-21T12:47:34.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.390+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc054020060 con 0x7fc064104d80 2024-09-21T12:47:34.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.392+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc064102830 con 0x7fc064104d80 2024-09-21T12:47:34.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.394+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fc054005000 con 0x7fc064104d80 2024-09-21T12:47:34.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.395+0000 7fc05affd640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc050074a80 0x7fc050076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:47:34.397 INFO:tasks.workunit.client.0.smithi046.stdout:6/932: getdents de/d2a 0 2024-09-21T12:47:34.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.395+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5812+0+0 (secure 0 0 0) 0x7fc054095fc0 con 0x7fc064104d80 2024-09-21T12:47:34.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.396+0000 7fc069be2640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc050074a80 0x7fc050076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:47:34.398 INFO:tasks.workunit.client.0.smithi046.stdout:6/933: write de/d2a/d34/fe6 [2906677,96988] 0 2024-09-21T12:47:34.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.399+0000 7fc069be2640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc050074a80 0x7fc050076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc060005ab0 tx=0x7fc060005a20 comp rx=0 tx=0).ready entity=mgr.24387 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:47:34.401 INFO:tasks.workunit.client.0.smithi046.stdout:6/934: mkdir de/d2a/d4c/d77/d12a/d136 0 2024-09-21T12:47:34.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.404+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc054061610 con 0x7fc064104d80 2024-09-21T12:47:34.405 INFO:tasks.workunit.client.0.smithi046.stdout:6/935: creat de/d2a/d4c/d77/d12a/d136/f137 x:0 0 0 2024-09-21T12:47:34.411 INFO:tasks.workunit.client.0.smithi046.stdout:6/936: getdents de/d2a/d4c/d71/d7c/dad 0 2024-09-21T12:47:34.414 INFO:tasks.workunit.client.0.smithi046.stdout:6/937: unlink de/d35/c51 0 2024-09-21T12:47:34.415 INFO:tasks.workunit.client.0.smithi046.stdout:6/938: chown l4 329 1 2024-09-21T12:47:34.418 INFO:tasks.workunit.client.0.smithi046.stdout:6/939: mkdir de/d2a/d4c/d77/d12a/d136/d138 0 2024-09-21T12:47:34.423 INFO:tasks.workunit.client.0.smithi046.stdout:6/940: dread de/d2a/d4c/d71/d7c/dad/fbd [0,4194304] 0 2024-09-21T12:47:34.438 INFO:tasks.workunit.client.0.smithi046.stdout:6/941: truncate de/d2a/d4c/d69/fc3 520020 0 2024-09-21T12:47:34.438 INFO:tasks.workunit.client.0.smithi046.stdout:6/942: chown de/d2a/f33 40067612 1 2024-09-21T12:47:34.440 INFO:tasks.workunit.client.0.smithi046.stdout:6/943: read de/d2a/d4c/fa7 [941318,62206] 0 2024-09-21T12:47:34.443 INFO:tasks.workunit.client.0.smithi046.stdout:6/944: mkdir de/d2a/d4c/d77/dae/d55/d139 0 2024-09-21T12:47:34.444 INFO:tasks.workunit.client.0.smithi046.stdout:6/945: mknod de/d2a/d4c/d71/c13a 0 2024-09-21T12:47:34.448 INFO:tasks.workunit.client.0.smithi046.stdout:6/946: creat de/d2a/d4c/d77/d8f/d94/f13b x:0 0 0 2024-09-21T12:47:34.454 INFO:tasks.workunit.client.0.smithi046.stdout:6/947: rmdir de/d2a/d34 39 2024-09-21T12:47:34.460 INFO:tasks.workunit.client.0.smithi046.stdout:6/948: truncate de/d2a/d4c/d77/dae/d55/f73 1471029 0 2024-09-21T12:47:34.461 INFO:tasks.workunit.client.0.smithi046.stdout:6/949: fsync de/d2a/d4c/d77/d8f/d94/de7/f110 0 2024-09-21T12:47:34.464 INFO:tasks.workunit.client.0.smithi046.stdout:6/950: creat de/d2a/d4c/d69/f13c x:0 0 0 2024-09-21T12:47:34.477 INFO:tasks.workunit.client.0.smithi046.stdout:6/951: dread de/f46 [0,4194304] 0 2024-09-21T12:47:34.491 INFO:tasks.workunit.client.0.smithi046.stdout:6/952: dread de/d2a/d4c/d69/fc3 [0,4194304] 0 2024-09-21T12:47:34.494 INFO:tasks.workunit.client.0.smithi046.stdout:6/953: readlink de/d2a/le9 0 2024-09-21T12:47:34.495 INFO:tasks.workunit.client.0.smithi046.stdout:6/954: write de/f26 [4430195,127366] 0 2024-09-21T12:47:34.503 INFO:tasks.workunit.client.0.smithi046.stdout:6/955: dwrite de/d2a/d4c/d71/d7c/f87 [4194304,4194304] 0 2024-09-21T12:47:34.507 INFO:tasks.workunit.client.0.smithi046.stdout:6/956: write de/d2a/d34/db6/f102 [647696,116680] 0 2024-09-21T12:47:34.509 INFO:tasks.workunit.client.0.smithi046.stdout:6/957: write de/d2a/d34/db6/f107 [4794808,89074] 0 2024-09-21T12:47:34.510 INFO:tasks.workunit.client.0.smithi046.stdout:6/958: dread - de/d2a/d4c/f10c zero size 2024-09-21T12:47:34.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/959: dwrite de/f46 [0,4194304] 0 2024-09-21T12:47:34.531 INFO:tasks.workunit.client.0.smithi046.stdout:6/960: readlink de/ld6 0 2024-09-21T12:47:34.533 INFO:tasks.workunit.client.0.smithi046.stdout:6/961: symlink de/d2a/d4c/d77/dc0/d118/d122/l13d 0 2024-09-21T12:47:34.537 INFO:tasks.workunit.client.0.smithi046.stdout:6/962: mkdir de/d2a/d4c/d77/dc0/d118/d11e/d13e 0 2024-09-21T12:47:34.538 INFO:tasks.workunit.client.0.smithi046.stdout:6/963: readlink de/d2a/d4c/d77/dae/l106 0 2024-09-21T12:47:34.546 INFO:tasks.workunit.client.0.smithi046.stdout:6/964: dwrite de/d2a/f2f [0,4194304] 0 2024-09-21T12:47:34.553 INFO:tasks.workunit.client.0.smithi046.stdout:6/965: creat de/d2a/d34/db6/f13f x:0 0 0 2024-09-21T12:47:34.557 INFO:tasks.workunit.client.0.smithi046.stdout:6/966: dread de/f4b [0,4194304] 0 2024-09-21T12:47:34.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/967: rename de/d2a/f2f to de/d2a/d4c/d77/dae/d55/d139/f140 0 2024-09-21T12:47:34.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/968: truncate de/d2a/d4c/d69/f13c 962699 0 2024-09-21T12:47:34.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/969: chown de/d2a/d4c/d71/d7c/f99 1989 1 2024-09-21T12:47:34.565 INFO:tasks.workunit.client.0.smithi046.stdout:6/970: rmdir de/d48 39 2024-09-21T12:47:34.567 INFO:tasks.workunit.client.0.smithi046.stdout:6/971: creat de/d2a/d4c/d77/dae/d55/d139/f141 x:0 0 0 2024-09-21T12:47:34.569 INFO:tasks.workunit.client.0.smithi046.stdout:6/972: rmdir de/d2a/d4c/d77/d12a/d136 39 2024-09-21T12:47:34.572 INFO:tasks.workunit.client.0.smithi046.stdout:6/973: symlink de/d2a/l142 0 2024-09-21T12:47:34.573 INFO:tasks.workunit.client.0.smithi046.stdout:6/974: write de/d2a/d4c/d77/dae/d55/d139/f141 [436914,98633] 0 2024-09-21T12:47:34.574 INFO:tasks.workunit.client.0.smithi046.stdout:6/975: chown de/f26 17 1 2024-09-21T12:47:34.575 INFO:tasks.workunit.client.0.smithi046.stdout:6/976: chown de/d2a/d34/db6/fd7 223 1 2024-09-21T12:47:34.576 INFO:tasks.workunit.client.0.smithi046.stdout:6/977: dread de/f1d [0,4194304] 0 2024-09-21T12:47:34.581 INFO:tasks.workunit.client.0.smithi046.stdout:6/978: truncate de/d2a/f68 3031209 0 2024-09-21T12:47:34.584 INFO:tasks.workunit.client.0.smithi046.stdout:6/979: mkdir de/d2a/d4c/d77/dc0/dc8/d143 0 2024-09-21T12:47:34.591 INFO:tasks.workunit.client.0.smithi046.stdout:6/980: dwrite de/d2a/d34/f10f [0,4194304] 0 2024-09-21T12:47:34.613 INFO:tasks.workunit.client.0.smithi046.stdout:6/981: dread de/d2a/d4c/d71/d7c/f87 [0,4194304] 0 2024-09-21T12:47:34.616 INFO:tasks.workunit.client.0.smithi046.stdout:6/982: creat de/d2a/d4c/da6/f144 x:0 0 0 2024-09-21T12:47:34.617 INFO:tasks.workunit.client.0.smithi046.stdout:6/983: write de/d2a/d34/db6/f13f [88609,44961] 0 2024-09-21T12:47:34.621 INFO:tasks.workunit.client.0.smithi046.stdout:6/984: unlink de/d2a/d4c/f54 0 2024-09-21T12:47:34.624 INFO:tasks.workunit.client.0.smithi046.stdout:6/985: creat de/d2a/d4c/d77/dae/d55/f145 x:0 0 0 2024-09-21T12:47:34.625 INFO:tasks.workunit.client.0.smithi046.stdout:6/986: read de/d2a/d4c/d77/dae/d55/f8e [2671392,73611] 0 2024-09-21T12:47:34.627 INFO:tasks.workunit.client.0.smithi046.stdout:6/987: symlink de/d2a/d4c/da6/l146 0 2024-09-21T12:47:34.629 INFO:tasks.workunit.client.0.smithi046.stdout:6/988: dread de/d2a/d34/f6a [0,4194304] 0 2024-09-21T12:47:34.632 INFO:tasks.workunit.client.0.smithi046.stdout:6/989: dread - de/d48/fba zero size 2024-09-21T12:47:34.644 INFO:tasks.workunit.client.0.smithi046.stdout:6/990: dread de/d2a/d4c/d71/d7c/f7e [0,4194304] 0 2024-09-21T12:47:34.651 INFO:tasks.workunit.client.0.smithi046.stdout:6/991: getdents de/d2a/d4c/d77/d8f/d94 0 2024-09-21T12:47:34.652 INFO:tasks.workunit.client.0.smithi046.stdout:6/992: write de/f125 [1040308,72079] 0 2024-09-21T12:47:34.658 INFO:tasks.workunit.client.0.smithi046.stdout:6/993: dread de/d2a/d4c/d77/dae/d55/d139/f140 [0,4194304] 0 2024-09-21T12:47:34.673 INFO:tasks.workunit.client.0.smithi046.stdout:6/994: dwrite de/f2c [0,4194304] 0 2024-09-21T12:47:34.677 INFO:tasks.workunit.client.0.smithi046.stdout:6/995: write de/d2a/d4c/d77/d12a/d136/f137 [732438,23441] 0 2024-09-21T12:47:34.686 INFO:tasks.workunit.client.0.smithi046.stdout:6/996: dwrite de/d2a/d34/db6/f13f [0,4194304] 0 2024-09-21T12:47:34.691 INFO:tasks.workunit.client.0.smithi046.stdout:6/997: rmdir de/d2a/d4c/d77/dae/d55 39 2024-09-21T12:47:34.692 INFO:tasks.workunit.client.0.smithi046.stdout:6/998: dread - de/d2a/d4c/d69/f64 zero size 2024-09-21T12:47:34.702 INFO:tasks.workunit.client.0.smithi046.stdout:6/999: dread de/d2a/d4c/d77/dae/d55/f73 [0,4194304] 0 2024-09-21T12:47:34.707 INFO:tasks.workunit.client.0.smithi046.stderr:+ rm -rf -- ./tmp.utkmvJtjTl 2024-09-21T12:47:34.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.718+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 --> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc06419d2d0 con 0x7fc050074a80 2024-09-21T12:47:34.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.719+0000 7fc05affd640 1 -- 172.21.15.46:0/2457981355 <== mgr.24387 v2:172.21.15.176:6828/4102729688 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7fc06419d2d0 con 0x7fc050074a80 2024-09-21T12:47:34.721 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:47:34.721 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:47:34.721 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:47:34.722 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:47:34.722 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-09-21T12:47:34.722 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "", 2024-09-21T12:47:34.722 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:47:34.722 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:47:34.722 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:47:34.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc050074a80 msgr2=0x7fc050076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:34.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc050074a80 0x7fc050076f40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc060005ab0 tx=0x7fc060005a20 comp rx=0 tx=0).stop 2024-09-21T12:47:34.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064104d80 msgr2=0x7fc064197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:47:34.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064104d80 0x7fc064197990 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d6a0 tx=0x7fc05400db60 comp rx=0 tx=0).stop 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 shutdown_connections 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:6828/4102729688,v1:172.21.15.176:6829/4102729688] conn(0x7fc050074a80 0x7fc050076f40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc064104d80 0x7fc064197990 secure :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d6a0 tx=0x7fc05400db60 comp rx=0 tx=0).stop 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 --2- 172.21.15.46:0/2457981355 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc064102450 0x7fc064197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.722+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 >> 172.21.15.46:0/2457981355 conn(0x7fc0640fc010 msgr2=0x7fc0640fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.723+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 shutdown_connections 2024-09-21T12:47:34.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:47:34.723+0000 7fc06be46640 1 -- 172.21.15.46:0/2457981355 wait complete. 2024-09-21T12:47:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:34 smithi176 ceph-mon[35476]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:34 smithi176 ceph-mon[35476]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:34 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:35.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:34 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:35.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:34 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1666284271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:47:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:34 smithi046 ceph-mon[27868]: from='client.14750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:34 smithi046 ceph-mon[27868]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:34 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:34 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:34 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1666284271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:47:35.446 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T12:47:35.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T12:47:36.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:35 smithi176 ceph-mon[35476]: pgmap v44: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 134 MiB/s wr, 384 op/s 2024-09-21T12:47:36.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:35 smithi176 ceph-mon[35476]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:36.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:35 smithi046 ceph-mon[27868]: pgmap v44: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 54 MiB/s rd, 134 MiB/s wr, 384 op/s 2024-09-21T12:47:36.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:35 smithi046 ceph-mon[27868]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:47:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:36 smithi046 ceph-mon[27868]: Standby manager daemon smithi046.vedsjs restarted 2024-09-21T12:47:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:37 smithi046 ceph-mon[27868]: Standby manager daemon smithi046.vedsjs started 2024-09-21T12:47:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:37 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/crt"}]: dispatch 2024-09-21T12:47:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:37 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:47:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:37 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/key"}]: dispatch 2024-09-21T12:47:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:37 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:47:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:36 smithi176 ceph-mon[35476]: Standby manager daemon smithi046.vedsjs restarted 2024-09-21T12:47:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:36 smithi176 ceph-mon[35476]: Standby manager daemon smithi046.vedsjs started 2024-09-21T12:47:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:36 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/crt"}]: dispatch 2024-09-21T12:47:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:36 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:47:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:36 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi046.vedsjs/key"}]: dispatch 2024-09-21T12:47:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:36 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:47:38.270 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:38 smithi046 ceph-mon[27868]: pgmap v45: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 32 MiB/s rd, 81 MiB/s wr, 236 op/s 2024-09-21T12:47:38.270 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:38 smithi046 ceph-mon[27868]: mgrmap e26: smithi176.rmyfjh(active, since 84s), standbys: smithi046.vedsjs 2024-09-21T12:47:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:38 smithi176 ceph-mon[35476]: pgmap v45: 65 pgs: 65 active+clean; 2.5 GiB data, 7.7 GiB used, 529 GiB / 536 GiB avail; 32 MiB/s rd, 81 MiB/s wr, 236 op/s 2024-09-21T12:47:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:38 smithi176 ceph-mon[35476]: mgrmap e26: smithi176.rmyfjh(active, since 84s), standbys: smithi046.vedsjs 2024-09-21T12:47:40.055 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:39 smithi046 ceph-mon[27868]: pgmap v46: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 34 MiB/s rd, 86 MiB/s wr, 282 op/s 2024-09-21T12:47:40.055 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:39 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.055 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:39 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.055 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:39 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.055 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:39 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:39 smithi176 ceph-mon[35476]: pgmap v46: 65 pgs: 65 active+clean; 2.1 GiB data, 6.7 GiB used, 530 GiB / 536 GiB avail; 34 MiB/s rd, 86 MiB/s wr, 282 op/s 2024-09-21T12:47:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:39 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:39 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:39 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:39 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:42.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:41 smithi176 ceph-mon[35476]: pgmap v47: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 20 MiB/s rd, 53 MiB/s wr, 219 op/s 2024-09-21T12:47:42.138 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:41 smithi046 ceph-mon[27868]: pgmap v47: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 20 MiB/s rd, 53 MiB/s wr, 219 op/s 2024-09-21T12:47:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: pgmap v48: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 15 MiB/s rd, 37 MiB/s wr, 176 op/s 2024-09-21T12:47:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr fail", "who": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr fail", "who": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd='[{"prefix": "mgr fail", "who": "smithi176.rmyfjh"}]': finished 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: mgrmap e27: smithi046.vedsjs(active, starting, since 0.00605481s) 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:47:44.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:47:44.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:44 smithi046 ceph-mon[27868]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: pgmap v48: 65 pgs: 65 active+clean; 1.9 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 15 MiB/s rd, 37 MiB/s wr, 176 op/s 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 172.21.15.176:0/2162067659' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr fail", "who": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "mgr fail", "who": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:47:44.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: Activating manager daemon smithi046.vedsjs 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.24387 ' entity='mgr.smithi176.rmyfjh' cmd='[{"prefix": "mgr fail", "who": "smithi176.rmyfjh"}]': finished 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: mgrmap e27: smithi046.vedsjs(active, starting, since 0.00605481s) 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi046.vedsjs", "id": "smithi046.vedsjs"}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:47:44.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:47:44.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:47:44.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:47:44.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:47:44.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:47:44.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:47:44.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:44 smithi176 ceph-mon[35476]: Manager daemon smithi046.vedsjs is now available 2024-09-21T12:47:45.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:47:45.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:47:45.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:47:45.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:47:45.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: mgrmap e28: smithi046.vedsjs(active, since 1.01284s) 2024-09-21T12:47:45.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:47:45.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:47:45.141 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:45 smithi046 ceph-mon[27868]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:45.485 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: mgrmap e28: smithi046.vedsjs(active, since 1.01284s) 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi046.vedsjs/trash_purge_schedule"}]: dispatch 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:47:45.486 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:45 smithi176 ceph-mon[35476]: pgmap v3: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:46.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:46 smithi046 ceph-mon[27868]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:46.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:46 smithi046 ceph-mon[27868]: mgrmap e29: smithi046.vedsjs(active, since 2s) 2024-09-21T12:47:46.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:46 smithi176 ceph-mon[35476]: pgmap v4: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:46.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:46 smithi176 ceph-mon[35476]: mgrmap e29: smithi046.vedsjs(active, since 2s) 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: [21/Sep/2024:12:47:46] ENGINE Bus STARTING 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: [21/Sep/2024:12:47:46] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: [21/Sep/2024:12:47:47] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: [21/Sep/2024:12:47:47] ENGINE Bus STARTED 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: [21/Sep/2024:12:47:47] ENGINE Error in HTTPServer.serve 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Traceback (most recent call last): 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:47:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._run(expiration_interval) 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: s = self.context.wrap_socket( 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: return self.sslsocket_class._create( 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self.do_handshake() 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:47:48.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: self._sslobj.do_handshake() 2024-09-21T12:47:48.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:47:48.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:48.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: mgrmap e30: smithi046.vedsjs(active, since 4s) 2024-09-21T12:47:48.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:48.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:48 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: [21/Sep/2024:12:47:46] ENGINE Bus STARTING 2024-09-21T12:47:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: [21/Sep/2024:12:47:46] ENGINE Serving on http://172.21.15.46:8765 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: [21/Sep/2024:12:47:47] ENGINE Serving on https://172.21.15.46:7150 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: [21/Sep/2024:12:47:47] ENGINE Bus STARTED 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: [21/Sep/2024:12:47:47] ENGINE Error in HTTPServer.serve 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Traceback (most recent call last): 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._run(expiration_interval) 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:47:48.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: s = self.context.wrap_socket( 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: return self.sslsocket_class._create( 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self.do_handshake() 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: self._sslobj.do_handshake() 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: pgmap v5: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: mgrmap e30: smithi046.vedsjs(active, since 4s) 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:48.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:48 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:47:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:47:49.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:47:49.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:47:49.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:47:49.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:49 smithi176 ceph-mon[35476]: pgmap v6: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/2678046189' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:47:49.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:49 smithi046 ceph-mon[27868]: pgmap v6: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail 2024-09-21T12:47:50.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:50 smithi046 ceph-mon[27868]: mgrmap e31: smithi046.vedsjs(active, since 6s), standbys: smithi176.rmyfjh 2024-09-21T12:47:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:50 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi176.rmyfjh", "id": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:47:51.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:50 smithi176 ceph-mon[35476]: mgrmap e31: smithi046.vedsjs(active, since 6s), standbys: smithi176.rmyfjh 2024-09-21T12:47:51.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:50 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr metadata", "who": "smithi176.rmyfjh", "id": "smithi176.rmyfjh"}]: dispatch 2024-09-21T12:47:52.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:51 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:51 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:51 smithi046 ceph-mon[27868]: pgmap v7: 65 pgs: 65 active+clean; 738 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-09-21T12:47:52.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:51 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:51 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:51 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:51 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:51 smithi176 ceph-mon[35476]: pgmap v7: 65 pgs: 65 active+clean; 738 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 98 op/s 2024-09-21T12:47:52.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:51 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:51 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:47:52.995 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T12:47:52.995 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T12:47:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:53 smithi046 ceph-mon[27868]: pgmap v8: 65 pgs: 65 active+clean; 738 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1003 KiB/s rd, 905 KiB/s wr, 76 op/s 2024-09-21T12:47:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:53 smithi176 ceph-mon[35476]: pgmap v8: 65 pgs: 65 active+clean; 738 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1003 KiB/s rd, 905 KiB/s wr, 76 op/s 2024-09-21T12:47:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:55 smithi046 ceph-mon[27868]: pgmap v9: 65 pgs: 65 active+clean; 381 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 119 op/s 2024-09-21T12:47:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:55 smithi176 ceph-mon[35476]: pgmap v9: 65 pgs: 65 active+clean; 381 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 119 op/s 2024-09-21T12:47:57.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:57 smithi046 ceph-mon[27868]: pgmap v10: 65 pgs: 65 active+clean; 381 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-21T12:47:57.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:57 smithi176 ceph-mon[35476]: pgmap v10: 65 pgs: 65 active+clean; 381 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-21T12:48:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: pgmap v11: 65 pgs: 65 active+clean; 381 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:47:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:47:59 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:48:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:48:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.conf 2024-09-21T12:48:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.conf 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: pgmap v11: 65 pgs: 65 active+clean; 381 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 109 op/s 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: Updating smithi176:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:00.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:01 smithi046 ceph-mon[27868]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-21T12:48:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: Updating smithi046:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:48:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: Updating smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:48:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: Updating smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:48:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:01 smithi176 ceph-mon[35476]: Reconfiguring prometheus.smithi046 (dependencies changed)... 2024-09-21T12:48:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:02 smithi176 ceph-mon[35476]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-21T12:48:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:02 smithi176 ceph-mon[35476]: pgmap v12: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 151 op/s 2024-09-21T12:48:02.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:02 smithi046 ceph-mon[27868]: Reconfiguring daemon prometheus.smithi046 on smithi046 2024-09-21T12:48:02.317 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:02 smithi046 ceph-mon[27868]: pgmap v12: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 151 op/s 2024-09-21T12:48:03.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:03 smithi046 ceph-mon[27868]: pgmap v13: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 94 op/s 2024-09-21T12:48:03.675 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:03 smithi176 ceph-mon[35476]: pgmap v13: 65 pgs: 65 active+clean; 291 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 94 op/s 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.819+0000 7f63bd345640 1 -- 172.21.15.46:0/2385620514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 msgr2=0x7f63b8107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.819+0000 7f63bd345640 1 --2- 172.21.15.46:0/2385620514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b8107110 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f63ac0098b0 tx=0x7f63ac02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.819+0000 7f63bd345640 1 -- 172.21.15.46:0/2385620514 shutdown_connections 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.819+0000 7f63bd345640 1 --2- 172.21.15.46:0/2385620514 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b8107110 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.820+0000 7f63bd345640 1 --2- 172.21.15.46:0/2385620514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 0x7f63b81047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.820+0000 7f63bd345640 1 -- 172.21.15.46:0/2385620514 >> 172.21.15.46:0/2385620514 conn(0x7f63b80fc010 msgr2=0x7f63b80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.820+0000 7f63bd345640 1 -- 172.21.15.46:0/2385620514 shutdown_connections 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.820+0000 7f63bd345640 1 -- 172.21.15.46:0/2385620514 wait complete. 2024-09-21T12:48:04.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.820+0000 7f63bd345640 1 Processor -- start 2024-09-21T12:48:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63bd345640 1 -- start start 2024-09-21T12:48:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63bd345640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 0x7f63b8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:04.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63bd345640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63bd345640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f63b810a7b0 con 0x7f63b8104d20 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63bd345640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f63b810a630 con 0x7f63b81023f0 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63b67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63b67fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b81003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44446/0 (socket says 172.21.15.46:44446) 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.821+0000 7f63b67fc640 1 -- 172.21.15.46:0/1298884294 learned_addr learned my addr 172.21.15.46:0/1298884294 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63b6ffd640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 0x7f63b8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63b67fc640 1 -- 172.21.15.46:0/1298884294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 msgr2=0x7f63b8101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63b67fc640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 0x7f63b8101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63b67fc640 1 -- 172.21.15.46:0/1298884294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b81008e0 con 0x7f63b8104d20 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63b6ffd640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 0x7f63b8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63b67fc640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b81003a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009230 tx=0x7f63ac0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63ac03f070 con 0x7f63b8104d20 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f63ac0049d0 con 0x7f63b8104d20 2024-09-21T12:48:04.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b8100b70 con 0x7f63b8104d20 2024-09-21T12:48:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.822+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f63ac035030 con 0x7f63b8104d20 2024-09-21T12:48:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.823+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b81010a0 con 0x7f63b8104d20 2024-09-21T12:48:04.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.825+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b81027d0 con 0x7f63b8104d20 2024-09-21T12:48:04.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.826+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f63ac042070 con 0x7f63b8104d20 2024-09-21T12:48:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.827+0000 7f639ffff640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f63a007b0b0 0x7f63a007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.827+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f63ac0bed50 con 0x7f63b8104d20 2024-09-21T12:48:04.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.827+0000 7f63b6ffd640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f63a007b0b0 0x7f63a007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:04.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.828+0000 7f63b6ffd640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f63a007b0b0 0x7f63a007d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009b50 tx=0x7f63a8005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:04.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:04.836+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f63ac08a110 con 0x7f63b8104d20 2024-09-21T12:48:05.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.136+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f63b8105780 con 0x7f63a007b0b0 2024-09-21T12:48:05.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.138+0000 7f639ffff640 1 -- 172.21.15.46:0/1298884294 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7f63b8105780 con 0x7f63a007b0b0 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.140+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f63a007b0b0 msgr2=0x7f63a007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.140+0000 7f63bd345640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f63a007b0b0 0x7f63a007d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f63a8009b50 tx=0x7f63a8005f90 comp rx=0 tx=0).stop 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.140+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 msgr2=0x7f63b81003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.140+0000 7f63bd345640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b81003a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009230 tx=0x7f63ac0045e0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 shutdown_connections 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f63a007b0b0 0x7f63a007d570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f63b8104d20 0x7f63b81003a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 --2- 172.21.15.46:0/1298884294 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f63b81023f0 0x7f63b8101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 >> 172.21.15.46:0/1298884294 conn(0x7f63b80fc010 msgr2=0x7f63b80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:05.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 shutdown_connections 2024-09-21T12:48:05.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.141+0000 7f63bd345640 1 -- 172.21.15.46:0/1298884294 wait complete. 2024-09-21T12:48:05.154 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:48:05.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 -- 172.21.15.46:0/3043484112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 msgr2=0x7fa020103140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 --2- 172.21.15.46:0/3043484112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa020103140 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa010009c20 tx=0x7fa01002a970 comp rx=0 tx=0).stop 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 -- 172.21.15.46:0/3043484112 shutdown_connections 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 --2- 172.21.15.46:0/3043484112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa020103140 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 --2- 172.21.15.46:0/3043484112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0200ffc40 0x7fa020100040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 -- 172.21.15.46:0/3043484112 >> 172.21.15.46:0/3043484112 conn(0x7fa0200fb770 msgr2=0x7fa0200fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 -- 172.21.15.46:0/3043484112 shutdown_connections 2024-09-21T12:48:05.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 -- 172.21.15.46:0/3043484112 wait complete. 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.250+0000 7fa026d1c640 1 Processor -- start 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa026d1c640 1 -- start start 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa026d1c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0200ffc40 0x7fa020197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa026d1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa0201979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa026d1c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa02010a780 con 0x7fa020102cc0 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa026d1c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa02010a600 con 0x7fa0200ffc40 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa0201979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa0201979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44474/0 (socket says 172.21.15.46:44474) 2024-09-21T12:48:05.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 -- 172.21.15.46:0/4195194006 learned_addr learned my addr 172.21.15.46:0/4195194006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa024ab8640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0200ffc40 0x7fa020197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 -- 172.21.15.46:0/4195194006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0200ffc40 msgr2=0x7fa020197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0200ffc40 0x7fa020197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 -- 172.21.15.46:0/4195194006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa020197fb0 con 0x7fa020102cc0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.251+0000 7fa01ffff640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa0201979c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa01002f900 tx=0x7fa01002f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.252+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa010047070 con 0x7fa020102cc0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.252+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa010003e30 con 0x7fa020102cc0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.252+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa02019c9c0 con 0x7fa020102cc0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.252+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa010034070 con 0x7fa020102cc0 2024-09-21T12:48:05.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.252+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa02019cf40 con 0x7fa020102cc0 2024-09-21T12:48:05.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.253+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa020100040 con 0x7fa020102cc0 2024-09-21T12:48:05.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.254+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7fa01004a070 con 0x7fa020102cc0 2024-09-21T12:48:05.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.254+0000 7fa01dffb640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa00c07b050 0x7fa00c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:05.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.254+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fa0100bf060 con 0x7fa020102cc0 2024-09-21T12:48:05.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.254+0000 7fa024ab8640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa00c07b050 0x7fa00c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:05.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.255+0000 7fa024ab8640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa00c07b050 0x7fa00c07d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa020069ef0 tx=0x7fa008005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:05.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.259+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa01003f070 con 0x7fa020102cc0 2024-09-21T12:48:05.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.535+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa02002c640 con 0x7fa00c07b050 2024-09-21T12:48:05.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.536+0000 7fa01dffb640 1 -- 172.21.15.46:0/4195194006 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fa02002c640 con 0x7fa00c07b050 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa00c07b050 msgr2=0x7fa00c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa00c07b050 0x7fa00c07d510 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa020069ef0 tx=0x7fa008005f90 comp rx=0 tx=0).stop 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 msgr2=0x7fa0201979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa0201979c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa01002f900 tx=0x7fa01002f730 comp rx=0 tx=0).stop 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 shutdown_connections 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa00c07b050 0x7fa00c07d510 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa020102cc0 0x7fa0201979c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 --2- 172.21.15.46:0/4195194006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0200ffc40 0x7fa020197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.538+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 >> 172.21.15.46:0/4195194006 conn(0x7fa0200fb770 msgr2=0x7fa0201061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:05.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.539+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 shutdown_connections 2024-09-21T12:48:05.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.539+0000 7fa026d1c640 1 -- 172.21.15.46:0/4195194006 wait complete. 2024-09-21T12:48:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.641+0000 7fb6530bb640 1 -- 172.21.15.46:0/1917873949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c1091f0 msgr2=0x7fb64c109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.641+0000 7fb6530bb640 1 --2- 172.21.15.46:0/1917873949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c1091f0 0x7fb64c109670 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009880 tx=0x7fb63c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.642+0000 7fb6530bb640 1 -- 172.21.15.46:0/1917873949 shutdown_connections 2024-09-21T12:48:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.642+0000 7fb6530bb640 1 --2- 172.21.15.46:0/1917873949 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c1091f0 0x7fb64c109670 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.642+0000 7fb6530bb640 1 --2- 172.21.15.46:0/1917873949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb64c0732a0 0x7fb64c073680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.642+0000 7fb6530bb640 1 -- 172.21.15.46:0/1917873949 >> 172.21.15.46:0/1917873949 conn(0x7fb64c06ea50 msgr2=0x7fb64c070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:05.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.642+0000 7fb6530bb640 1 -- 172.21.15.46:0/1917873949 shutdown_connections 2024-09-21T12:48:05.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.642+0000 7fb6530bb640 1 -- 172.21.15.46:0/1917873949 wait complete. 2024-09-21T12:48:05.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.643+0000 7fb6530bb640 1 Processor -- start 2024-09-21T12:48:05.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.644+0000 7fb6530bb640 1 -- start start 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.644+0000 7fb6530bb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 0x7fb64c1a6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.644+0000 7fb6530bb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb64c1091f0 0x7fb64c1a67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.644+0000 7fb6530bb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c1195b0 con 0x7fb64c0732a0 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.644+0000 7fb6530bb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c119430 con 0x7fb64c1091f0 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.645+0000 7fb650e57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 0x7fb64c1a6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.645+0000 7fb650e57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 0x7fb64c1a6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44492/0 (socket says 172.21.15.46:44492) 2024-09-21T12:48:05.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.645+0000 7fb650e57640 1 -- 172.21.15.46:0/4073324999 learned_addr learned my addr 172.21.15.46:0/4073324999 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.645+0000 7fb643fff640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb64c1091f0 0x7fb64c1a67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.646+0000 7fb650e57640 1 -- 172.21.15.46:0/4073324999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb64c1091f0 msgr2=0x7fb64c1a67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.646+0000 7fb650e57640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb64c1091f0 0x7fb64c1a67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.646+0000 7fb650e57640 1 -- 172.21.15.46:0/4073324999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c1a6e50 con 0x7fb64c0732a0 2024-09-21T12:48:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.646+0000 7fb650e57640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 0x7fb64c1a6290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb64800e940 tx=0x7fb64800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:05.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:05 smithi046 ceph-mon[27868]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:05.648 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:05 smithi046 ceph-mon[27868]: pgmap v14: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 144 op/s 2024-09-21T12:48:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.647+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb64800cac0 con 0x7fb64c0732a0 2024-09-21T12:48:05.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.647+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb64800cc60 con 0x7fb64c0732a0 2024-09-21T12:48:05.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.647+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb648003de0 con 0x7fb64c0732a0 2024-09-21T12:48:05.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.647+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c1109e0 con 0x7fb64c0732a0 2024-09-21T12:48:05.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.648+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c110f40 con 0x7fb64c0732a0 2024-09-21T12:48:05.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.651+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c119d90 con 0x7fb64c0732a0 2024-09-21T12:48:05.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.651+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7fb648003fe0 con 0x7fb64c0732a0 2024-09-21T12:48:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.652+0000 7fb641ffb640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb63407b220 0x7fb63407d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.652+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fb64809e8e0 con 0x7fb64c0732a0 2024-09-21T12:48:05.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.652+0000 7fb643fff640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb63407b220 0x7fb63407d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:05.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.653+0000 7fb643fff640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb63407b220 0x7fb63407d6e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c004280 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:05.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.660+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb648069d20 con 0x7fb64c0732a0 2024-09-21T12:48:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:05 smithi176 ceph-mon[35476]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:05 smithi176 ceph-mon[35476]: pgmap v14: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 144 op/s 2024-09-21T12:48:05.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.959+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb64c02dba0 con 0x7fb63407b220 2024-09-21T12:48:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.976+0000 7fb641ffb640 1 -- 172.21.15.46:0/4073324999 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb64c02dba0 con 0x7fb63407b220 2024-09-21T12:48:05.977 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:48:05.977 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 15s ago 9m 24.4M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:48:05.977 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (91s) 15s ago 9m 8414k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (79s) 18s ago 8m 8338k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 15s ago 9m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (8m) 18s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 15s ago 8m 81.7M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (3m) 15s ago 3m 273M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (3m) 15s ago 3m 245M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (3m) 18s ago 3m 25.6M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (3m) 18s ago 3m 25.5M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (40s) 15s ago 10m 492M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (2m) 18s ago 8m 148M - 19.3.0-5104-g44178494 b415816db8b4 95f2eac0602f 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 15s ago 10m 54.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (8m) 18s ago 8m 45.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:48:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (9m) 15s ago 9m 14.9M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (8m) 18s ago 8m 17.2M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 15s ago 7m 173M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 15s ago 6m 181M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 15s ago 6m 142M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (5m) 18s ago 5m 197M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (5m) 18s ago 5m 183M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (4m) 18s ago 4m 156M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:48:05.979 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (83s) 15s ago 8m 49.0M - 2.43.0 a07b618ecd1d 8d27d56b34f6 2024-09-21T12:48:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb63407b220 msgr2=0x7fb63407d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb63407b220 0x7fb63407d6e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb63c000c00 tx=0x7fb63c004280 comp rx=0 tx=0).stop 2024-09-21T12:48:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 msgr2=0x7fb64c1a6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 0x7fb64c1a6290 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb64800e940 tx=0x7fb64800ee00 comp rx=0 tx=0).stop 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 shutdown_connections 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb63407b220 0x7fb63407d6e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb64c1091f0 0x7fb64c1a67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 --2- 172.21.15.46:0/4073324999 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb64c0732a0 0x7fb64c1a6290 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 >> 172.21.15.46:0/4073324999 conn(0x7fb64c06ea50 msgr2=0x7fb64c10c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 shutdown_connections 2024-09-21T12:48:05.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:05.979+0000 7fb6530bb640 1 -- 172.21.15.46:0/4073324999 wait complete. 2024-09-21T12:48:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 -- 172.21.15.46:0/3596804315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524104d20 msgr2=0x7f0524107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 --2- 172.21.15.46:0/3596804315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524104d20 0x7f0524107110 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05180098b0 tx=0x7f051802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 -- 172.21.15.46:0/3596804315 shutdown_connections 2024-09-21T12:48:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 --2- 172.21.15.46:0/3596804315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0524104d20 0x7f0524107110 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 --2- 172.21.15.46:0/3596804315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05241023f0 0x7f05241047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 -- 172.21.15.46:0/3596804315 >> 172.21.15.46:0/3596804315 conn(0x7f05240fc010 msgr2=0x7f05240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:06.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 -- 172.21.15.46:0/3596804315 shutdown_connections 2024-09-21T12:48:06.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.078+0000 7f052a512640 1 -- 172.21.15.46:0/3596804315 wait complete. 2024-09-21T12:48:06.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f052a512640 1 Processor -- start 2024-09-21T12:48:06.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f052a512640 1 -- start start 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f052a512640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 0x7f0524101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f052a512640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0524104d20 0x7f05241003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f052a512640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f052410a7b0 con 0x7f05241023f0 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f052a512640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f052410a630 con 0x7f0524104d20 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.079+0000 7f0523fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 0x7f0524101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f05237fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0524104d20 0x7f05241003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f0523fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 0x7f0524101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44500/0 (socket says 172.21.15.46:44500) 2024-09-21T12:48:06.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f0523fff640 1 -- 172.21.15.46:0/565256798 learned_addr learned my addr 172.21.15.46:0/565256798 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f0523fff640 1 -- 172.21.15.46:0/565256798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0524104d20 msgr2=0x7f05241003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f0523fff640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0524104d20 0x7f05241003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f0523fff640 1 -- 172.21.15.46:0/565256798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05241008e0 con 0x7f05241023f0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f05237fe640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0524104d20 0x7f05241003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f0523fff640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 0x7f0524101ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f051400e970 tx=0x7f051400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f051400cac0 con 0x7f05241023f0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05140054e0 con 0x7f05241023f0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0524100bd0 con 0x7f05241023f0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0514010430 con 0x7f05241023f0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.080+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0524101130 con 0x7f05241023f0 2024-09-21T12:48:06.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.082+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05241027d0 con 0x7f05241023f0 2024-09-21T12:48:06.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.083+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7f0514004e80 con 0x7f05241023f0 2024-09-21T12:48:06.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.084+0000 7f05217fa640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f050c07b050 0x7f050c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:06.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.084+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f051409e8b0 con 0x7f05241023f0 2024-09-21T12:48:06.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.084+0000 7f05237fe640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f050c07b050 0x7f050c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:06.086 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.085+0000 7f05237fe640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f050c07b050 0x7f050c07d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0518009880 tx=0x7f05180058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.092+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0514069c90 con 0x7f05241023f0 2024-09-21T12:48:06.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.407+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f052419f7b0 con 0x7f05241023f0 2024-09-21T12:48:06.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.408+0000 7f05217fa640 1 -- 172.21.15.46:0/565256798 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f051406ae20 con 0x7f05241023f0 2024-09-21T12:48:06.409 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:48:06.409 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:48:06.409 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:48:06.409 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:48:06.410 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:48:06.411 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:48:06.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f050c07b050 msgr2=0x7f050c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f050c07b050 0x7f050c07d510 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0518009880 tx=0x7f05180058d0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 msgr2=0x7f0524101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 0x7f0524101ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f051400e970 tx=0x7f051400ed70 comp rx=0 tx=0).stop 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 shutdown_connections 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f050c07b050 0x7f050c07d510 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0524104d20 0x7f05241003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 --2- 172.21.15.46:0/565256798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05241023f0 0x7f0524101ce0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 >> 172.21.15.46:0/565256798 conn(0x7f05240fc010 msgr2=0x7f05240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 shutdown_connections 2024-09-21T12:48:06.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.411+0000 7f052a512640 1 -- 172.21.15.46:0/565256798 wait complete. 2024-09-21T12:48:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.515+0000 7fb6b6866640 1 -- 172.21.15.46:0/3903629307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 msgr2=0x7fb6b0104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.515+0000 7fb6b6866640 1 --2- 172.21.15.46:0/3903629307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0104860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0009880 tx=0x7fb6a002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.515+0000 7fb6b6866640 1 -- 172.21.15.46:0/3903629307 shutdown_connections 2024-09-21T12:48:06.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.515+0000 7fb6b6866640 1 --2- 172.21.15.46:0/3903629307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 0x7fb6b0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.516+0000 7fb6b6866640 1 --2- 172.21.15.46:0/3903629307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0104860 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.516+0000 7fb6b6866640 1 -- 172.21.15.46:0/3903629307 >> 172.21.15.46:0/3903629307 conn(0x7fb6b00fc010 msgr2=0x7fb6b00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.516+0000 7fb6b6866640 1 -- 172.21.15.46:0/3903629307 shutdown_connections 2024-09-21T12:48:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.516+0000 7fb6b6866640 1 -- 172.21.15.46:0/3903629307 wait complete. 2024-09-21T12:48:06.518 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.516+0000 7fb6b6866640 1 Processor -- start 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.516+0000 7fb6b6866640 1 -- start start 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6b6866640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6b6866640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 0x7fb6b0197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6b6866640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b010a7d0 con 0x7fb6b0102470 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6b6866640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b010a650 con 0x7fb6b0104da0 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6affff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6affff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44520/0 (socket says 172.21.15.46:44520) 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6affff640 1 -- 172.21.15.46:0/1432875748 learned_addr learned my addr 172.21.15.46:0/1432875748 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6af7fe640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 0x7fb6b0197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6af7fe640 1 -- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 msgr2=0x7fb6b0197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6af7fe640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.517+0000 7fb6af7fe640 1 -- 172.21.15.46:0/1432875748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b01980e0 con 0x7fb6b0104da0 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.518+0000 7fb6af7fe640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 0x7fb6b0197a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e940 tx=0x7fb6a400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.518+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6a400cac0 con 0x7fb6b0104da0 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.518+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6a400cc60 con 0x7fb6b0104da0 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.518+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6a40047a0 con 0x7fb6b0104da0 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.519+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b019cb20 con 0x7fb6b0104da0 2024-09-21T12:48:06.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.519+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b019d080 con 0x7fb6b0104da0 2024-09-21T12:48:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.520+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b0102850 con 0x7fb6b0104da0 2024-09-21T12:48:06.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.521+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 31) ==== 103422+0+0 (secure 0 0 0) 0x7fb6a4004940 con 0x7fb6b0104da0 2024-09-21T12:48:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.522+0000 7fb6ad7fa640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb69807b100 0x7fb69807d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:06.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.522+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fb6a409ebb0 con 0x7fb6b0104da0 2024-09-21T12:48:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.522+0000 7fb6affff640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb69807b100 0x7fb69807d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:06.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.523+0000 7fb6affff640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb69807b100 0x7fb69807d5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0005ab0 tx=0x7fb6a0005a20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:06.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.528+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb6a401d060 con 0x7fb6b0104da0 2024-09-21T12:48:06.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:06 smithi046 ceph-mon[27868]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:06.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:06 smithi046 ceph-mon[27868]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:06.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:06 smithi176 ceph-mon[35476]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:06.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:06 smithi176 ceph-mon[35476]: from='client.14798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:06.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.821+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb6b0105720 con 0x7fb69807b100 2024-09-21T12:48:06.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.822+0000 7fb6ad7fa640 1 -- 172.21.15.46:0/1432875748 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+329 (secure 0 0 0) 0x7fb6b0105720 con 0x7fb69807b100 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:48:06.824 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:48:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb69807b100 msgr2=0x7fb69807d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb69807b100 0x7fb69807d5c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb6a0005ab0 tx=0x7fb6a0005a20 comp rx=0 tx=0).stop 2024-09-21T12:48:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 msgr2=0x7fb6b0197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 0x7fb6b0197a60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400e940 tx=0x7fb6a400ee00 comp rx=0 tx=0).stop 2024-09-21T12:48:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 shutdown_connections 2024-09-21T12:48:06.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb69807b100 0x7fb69807d5c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6b0104da0 0x7fb6b0197a60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 --2- 172.21.15.46:0/1432875748 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6b0102470 0x7fb6b0197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 >> 172.21.15.46:0/1432875748 conn(0x7fb6b00fc010 msgr2=0x7fb6b00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 shutdown_connections 2024-09-21T12:48:06.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:06.825+0000 7fb6b6866640 1 -- 172.21.15.46:0/1432875748 wait complete. 2024-09-21T12:48:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:07 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/565256798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:07 smithi046 ceph-mon[27868]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:07 smithi046 ceph-mon[27868]: pgmap v15: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2024-09-21T12:48:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:07 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/565256798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:07 smithi176 ceph-mon[35476]: from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:07 smithi176 ceph-mon[35476]: pgmap v15: 65 pgs: 65 active+clean; 291 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 91 op/s 2024-09-21T12:48:09.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:09 smithi046 ceph-mon[27868]: pgmap v16: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-09-21T12:48:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:09 smithi176 ceph-mon[35476]: pgmap v16: 65 pgs: 65 active+clean; 290 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 93 op/s 2024-09-21T12:48:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:11 smithi046 ceph-mon[27868]: pgmap v17: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 121 op/s 2024-09-21T12:48:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:11 smithi176 ceph-mon[35476]: pgmap v17: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 121 op/s 2024-09-21T12:48:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:13 smithi046 ceph-mon[27868]: pgmap v18: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 79 op/s 2024-09-21T12:48:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:13 smithi176 ceph-mon[35476]: pgmap v18: 65 pgs: 65 active+clean; 296 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 79 op/s 2024-09-21T12:48:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:14.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:15.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:15 smithi046 ceph-mon[27868]: pgmap v19: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 124 op/s 2024-09-21T12:48:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:15 smithi176 ceph-mon[35476]: pgmap v19: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.3 MiB/s wr, 124 op/s 2024-09-21T12:48:17.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:17 smithi046 ceph-mon[27868]: pgmap v20: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-21T12:48:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:17 smithi176 ceph-mon[35476]: pgmap v20: 65 pgs: 65 active+clean; 303 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 74 op/s 2024-09-21T12:48:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:19 smithi046 ceph-mon[27868]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 97 op/s 2024-09-21T12:48:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:19 smithi176 ceph-mon[35476]: pgmap v21: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 97 op/s 2024-09-21T12:48:21.518 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:21 smithi046 ceph-mon[27868]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 177 op/s 2024-09-21T12:48:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:21 smithi176 ceph-mon[35476]: pgmap v22: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.1 MiB/s wr, 177 op/s 2024-09-21T12:48:24.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:24 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:24.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:24 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:24.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:24 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:48:24.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:24 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:48:24.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:24 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:24.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:24 smithi176 ceph-mon[35476]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 149 op/s 2024-09-21T12:48:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:24 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:24 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:24 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:48:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:24 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:48:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:24 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:24 smithi046 ceph-mon[27868]: pgmap v23: 65 pgs: 65 active+clean; 308 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 149 op/s 2024-09-21T12:48:25.187 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:25 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:48:25.187 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:25 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:48:25.188 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:25 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:48:25.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:25 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi176.rmyfjh", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:48:25.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:25 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:48:25.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:25 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:48:26.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:26 smithi176 ceph-mon[35476]: Upgrade: Updating mgr.smithi176.rmyfjh 2024-09-21T12:48:26.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:26 smithi176 ceph-mon[35476]: Deploying daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:48:26.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:26 smithi176 ceph-mon[35476]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 491 op/s 2024-09-21T12:48:26.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:26 smithi046 ceph-mon[27868]: Upgrade: Updating mgr.smithi176.rmyfjh 2024-09-21T12:48:26.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:26 smithi046 ceph-mon[27868]: Deploying daemon mgr.smithi176.rmyfjh on smithi176 2024-09-21T12:48:26.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:26 smithi046 ceph-mon[27868]: pgmap v24: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 491 op/s 2024-09-21T12:48:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:27 smithi046 ceph-mon[27868]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 447 op/s 2024-09-21T12:48:27.712 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:27 smithi176 ceph-mon[35476]: pgmap v25: 65 pgs: 65 active+clean; 302 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 447 op/s 2024-09-21T12:48:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:29.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:29 smithi046 ceph-mon[27868]: pgmap v26: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:29.681 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:29 smithi176 ceph-mon[35476]: pgmap v26: 65 pgs: 65 active+clean; 305 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 477 op/s 2024-09-21T12:48:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:31 smithi046 ceph-mon[27868]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 523 op/s 2024-09-21T12:48:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:31 smithi176 ceph-mon[35476]: pgmap v27: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.6 MiB/s wr, 523 op/s 2024-09-21T12:48:34.372 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:34 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.372 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:34 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.372 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:34 smithi176 ceph-mon[35476]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-09-21T12:48:34.372 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:34 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.372 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:34 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:34 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:34 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:34 smithi046 ceph-mon[27868]: pgmap v28: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 441 op/s 2024-09-21T12:48:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:34 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:34.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:34 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:35 smithi046 ceph-mon[27868]: Standby manager daemon smithi176.rmyfjh restarted 2024-09-21T12:48:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:35 smithi046 ceph-mon[27868]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:48:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:35 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:48:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:35 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:48:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:35 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:48:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:35 smithi046 ceph-mon[27868]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:48:35.530 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:35 smithi176 ceph-mon[35476]: Standby manager daemon smithi176.rmyfjh restarted 2024-09-21T12:48:35.530 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:35 smithi176 ceph-mon[35476]: Standby manager daemon smithi176.rmyfjh started 2024-09-21T12:48:35.530 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:35 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/crt"}]: dispatch 2024-09-21T12:48:35.530 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:35 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:48:35.530 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:35 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi176.rmyfjh/key"}]: dispatch 2024-09-21T12:48:35.530 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:35 smithi176 ceph-mon[35476]: from='mgr.? 172.21.15.176:0/1350979435' entity='mgr.smithi176.rmyfjh' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:48:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:36 smithi046 ceph-mon[27868]: mgrmap e32: smithi046.vedsjs(active, since 51s), standbys: smithi176.rmyfjh 2024-09-21T12:48:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:36 smithi046 ceph-mon[27868]: pgmap v29: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 564 op/s 2024-09-21T12:48:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:36 smithi176 ceph-mon[35476]: mgrmap e32: smithi046.vedsjs(active, since 51s), standbys: smithi176.rmyfjh 2024-09-21T12:48:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:36 smithi176 ceph-mon[35476]: pgmap v29: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.6 MiB/s wr, 564 op/s 2024-09-21T12:48:36.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.955+0000 7ff53fcc3640 1 -- 172.21.15.46:0/2066295756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 msgr2=0x7ff538109670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:36.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.955+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/2066295756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 0x7ff538109670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff528009880 tx=0x7ff52802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:48:36.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.955+0000 7ff53fcc3640 1 -- 172.21.15.46:0/2066295756 shutdown_connections 2024-09-21T12:48:36.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.955+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/2066295756 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 0x7ff538109670 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:36.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.955+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/2066295756 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff538073680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:36.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.955+0000 7ff53fcc3640 1 -- 172.21.15.46:0/2066295756 >> 172.21.15.46:0/2066295756 conn(0x7ff53806ea50 msgr2=0x7ff538070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:36.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.956+0000 7ff53fcc3640 1 -- 172.21.15.46:0/2066295756 shutdown_connections 2024-09-21T12:48:36.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.956+0000 7ff53fcc3640 1 -- 172.21.15.46:0/2066295756 wait complete. 2024-09-21T12:48:36.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53fcc3640 1 Processor -- start 2024-09-21T12:48:36.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53fcc3640 1 -- start start 2024-09-21T12:48:36.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53fcc3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff5381a62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53fcc3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 0x7ff5381a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53fcc3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff5381195d0 con 0x7ff5380732a0 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53fcc3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff538119450 con 0x7ff5381091f0 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53da5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff5381a62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53da5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff5381a62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49294/0 (socket says 172.21.15.46:49294) 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.957+0000 7ff53da5f640 1 -- 172.21.15.46:0/1946815346 learned_addr learned my addr 172.21.15.46:0/1946815346 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.958+0000 7ff53da5f640 1 -- 172.21.15.46:0/1946815346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 msgr2=0x7ff5381a6810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.958+0000 7ff53da5f640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 0x7ff5381a6810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.958+0000 7ff53da5f640 1 -- 172.21.15.46:0/1946815346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5381a6e90 con 0x7ff5380732a0 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.958+0000 7ff53da5f640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff5381a62d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff53400d8d0 tx=0x7ff53400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.959+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff534017070 con 0x7ff5380732a0 2024-09-21T12:48:36.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.959+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5381ab8d0 con 0x7ff5380732a0 2024-09-21T12:48:36.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.959+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5381abe60 con 0x7ff5380732a0 2024-09-21T12:48:36.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.961+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff538073680 con 0x7ff5380732a0 2024-09-21T12:48:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.961+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff53400be10 con 0x7ff5380732a0 2024-09-21T12:48:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.961+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff534021060 con 0x7ff5380732a0 2024-09-21T12:48:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.962+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7ff53401a070 con 0x7ff5380732a0 2024-09-21T12:48:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.963+0000 7ff52effd640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff52407b0a0 0x7ff52407d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.964+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7ff534010460 con 0x7ff5380732a0 2024-09-21T12:48:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.964+0000 7ff53d25e640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff52407b0a0 0x7ff52407d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:36.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.965+0000 7ff53d25e640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff52407b0a0 0x7ff52407d560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5280096c0 tx=0x7ff528005fd0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:36.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:36.974+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff53406a1c0 con 0x7ff5380732a0 2024-09-21T12:48:37.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.291+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff5380626f0 con 0x7ff52407b0a0 2024-09-21T12:48:37.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.292+0000 7ff52effd640 1 -- 172.21.15.46:0/1946815346 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7ff5380626f0 con 0x7ff52407b0a0 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff52407b0a0 msgr2=0x7ff52407d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff52407b0a0 0x7ff52407d560 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff5280096c0 tx=0x7ff528005fd0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 msgr2=0x7ff5381a62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff5381a62d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff53400d8d0 tx=0x7ff53400dd90 comp rx=0 tx=0).stop 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 shutdown_connections 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff52407b0a0 0x7ff52407d560 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5381091f0 0x7ff5381a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 --2- 172.21.15.46:0/1946815346 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5380732a0 0x7ff5381a62d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 >> 172.21.15.46:0/1946815346 conn(0x7ff53806ea50 msgr2=0x7ff53810c720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 shutdown_connections 2024-09-21T12:48:37.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.295+0000 7ff53fcc3640 1 -- 172.21.15.46:0/1946815346 wait complete. 2024-09-21T12:48:37.308 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:48:37.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.407+0000 7f3f27ea5640 1 -- 172.21.15.46:0/3252007223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20102b60 msgr2=0x7f3f20102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.409 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.407+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/3252007223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20102b60 0x7f3f20102fe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009880 tx=0x7f3f1002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 -- 172.21.15.46:0/3252007223 shutdown_connections 2024-09-21T12:48:37.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/3252007223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20102b60 0x7f3f20102fe0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/3252007223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f20101960 0x7f3f20101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 -- 172.21.15.46:0/3252007223 >> 172.21.15.46:0/3252007223 conn(0x7f3f200fd110 msgr2=0x7f3f200ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:37.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 -- 172.21.15.46:0/3252007223 shutdown_connections 2024-09-21T12:48:37.410 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 -- 172.21.15.46:0/3252007223 wait complete. 2024-09-21T12:48:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.408+0000 7f3f27ea5640 1 Processor -- start 2024-09-21T12:48:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f27ea5640 1 -- start start 2024-09-21T12:48:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f27ea5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 0x7f3f20075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f27ea5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f20102b60 0x7f3f200745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f27ea5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2010a7a0 con 0x7f3f20101960 2024-09-21T12:48:37.411 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f27ea5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2010a620 con 0x7f3f20102b60 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 0x7f3f20075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 0x7f3f20075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60324/0 (socket says 172.21.15.46:60324) 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 -- 172.21.15.46:0/389575960 learned_addr learned my addr 172.21.15.46:0/389575960 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25440640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f20102b60 0x7f3f200745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 -- 172.21.15.46:0/389575960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f20102b60 msgr2=0x7f3f200745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f20102b60 0x7f3f200745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 -- 172.21.15.46:0/389575960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f20074b20 con 0x7f3f20101960 2024-09-21T12:48:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.409+0000 7f3f25c41640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 0x7f3f20075f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00d8d0 tx=0x7f3f1c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:37.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.410+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f1c017070 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.410+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f1c00be10 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.410+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f20074e10 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.410+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f1c021060 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.410+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f200752e0 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.411+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f040052c0 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.412+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f3f1c01a070 con 0x7f3f20101960 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.413+0000 7f3f16ffd640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f0c07b050 0x7f3f0c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:37.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.413+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3f1c09e140 con 0x7f3f20101960 2024-09-21T12:48:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.413+0000 7f3f25440640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f0c07b050 0x7f3f0c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:37.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.414+0000 7f3f25440640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f0c07b050 0x7f3f0c07d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f20075ca0 tx=0x7f3f10005a20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:37.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.419+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3f1c069480 con 0x7f3f20101960 2024-09-21T12:48:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:37 smithi046 ceph-mon[27868]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:37.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:37 smithi046 ceph-mon[27868]: pgmap v30: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-09-21T12:48:37.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.752+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3f04000bf0 con 0x7f3f0c07b050 2024-09-21T12:48:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.754+0000 7f3f16ffd640 1 -- 172.21.15.46:0/389575960 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f3f04000bf0 con 0x7f3f0c07b050 2024-09-21T12:48:37.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f0c07b050 msgr2=0x7f3f0c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f0c07b050 0x7f3f0c07d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3f20075ca0 tx=0x7f3f10005a20 comp rx=0 tx=0).stop 2024-09-21T12:48:37.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 msgr2=0x7f3f20075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 0x7f3f20075f20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c00d8d0 tx=0x7f3f1c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 shutdown_connections 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f0c07b050 0x7f3f0c07d510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f20102b60 0x7f3f200745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 --2- 172.21.15.46:0/389575960 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f20101960 0x7f3f20075f20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 >> 172.21.15.46:0/389575960 conn(0x7f3f200fd110 msgr2=0x7f3f20106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 shutdown_connections 2024-09-21T12:48:37.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.758+0000 7f3f27ea5640 1 -- 172.21.15.46:0/389575960 wait complete. 2024-09-21T12:48:37.781 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:37 smithi176 ceph-mon[35476]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:37.781 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:37 smithi176 ceph-mon[35476]: pgmap v30: 65 pgs: 65 active+clean; 281 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 221 op/s 2024-09-21T12:48:37.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1935353805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 msgr2=0x7fd3ec107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1935353805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec107110 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0098b0 tx=0x7fd3dc02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1935353805 shutdown_connections 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1935353805 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec107110 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1935353805 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 0x7fd3ec1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1935353805 >> 172.21.15.46:0/1935353805 conn(0x7fd3ec0fc010 msgr2=0x7fd3ec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1935353805 shutdown_connections 2024-09-21T12:48:37.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.877+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1935353805 wait complete. 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.878+0000 7fd3f3fb3640 1 Processor -- start 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.878+0000 7fd3f3fb3640 1 -- start start 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f3fb3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 0x7fd3ec197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f3fb3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f3fb3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec10a790 con 0x7fd3ec104d20 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f3fb3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd3ec10a610 con 0x7fd3ec1023f0 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f154e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f154e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60342/0 (socket says 172.21.15.46:60342) 2024-09-21T12:48:37.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f154e640 1 -- 172.21.15.46:0/1835618724 learned_addr learned my addr 172.21.15.46:0/1835618724 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f1d4f640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 0x7fd3ec197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f1d4f640 1 -- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 msgr2=0x7fd3ec197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f1d4f640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f1d4f640 1 -- 172.21.15.46:0/1835618724 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3ec1980d0 con 0x7fd3ec1023f0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f154e640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.879+0000 7fd3f1d4f640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 0x7fd3ec197510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009ce0 tx=0x7fd3e800b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.880+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3e8004020 con 0x7fd3ec1023f0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.880+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd3e80041c0 con 0x7fd3ec1023f0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.880+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3ec100240 con 0x7fd3ec1023f0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.880+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd3e8019640 con 0x7fd3ec1023f0 2024-09-21T12:48:37.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.880+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3ec100770 con 0x7fd3ec1023f0 2024-09-21T12:48:37.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.881+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3ec1027d0 con 0x7fd3ec1023f0 2024-09-21T12:48:37.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.882+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fd3e80035f0 con 0x7fd3ec1023f0 2024-09-21T12:48:37.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.882+0000 7fd3e2ffd640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd3d807b0a0 0x7fd3d807d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.882+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fd3e8016070 con 0x7fd3ec1023f0 2024-09-21T12:48:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.883+0000 7fd3f154e640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd3d807b0a0 0x7fd3d807d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:37.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.883+0000 7fd3f154e640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd3d807b0a0 0x7fd3d807d560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0096c0 tx=0x7fd3dc005a20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:37.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:37.887+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd3e806d4c0 con 0x7fd3ec1023f0 2024-09-21T12:48:38.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.196+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd3ec105780 con 0x7fd3d807b0a0 2024-09-21T12:48:38.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.207+0000 7fd3e2ffd640 1 -- 172.21.15.46:0/1835618724 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fd3ec105780 con 0x7fd3d807b0a0 2024-09-21T12:48:38.208 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:48:38.209 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 47s ago 9m 24.4M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:48:38.209 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (2m) 47s ago 9m 8414k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:48:38.209 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (111s) 5s ago 9m 8539k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:48:38.209 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 47s ago 9m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:48:38.209 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (8m) 5s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:48:38.209 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (8m) 47s ago 9m 81.7M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:48:38.210 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (4m) 47s ago 4m 273M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:48:38.210 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (4m) 47s ago 4m 245M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:48:38.210 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (4m) 5s ago 4m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:48:38.210 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (4m) 5s ago 4m 26.3M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:48:38.210 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (72s) 47s ago 11m 492M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:48:38.210 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (10s) 5s ago 8m 67.2M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 47s ago 11m 54.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (8m) 5s ago 8m 46.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (9m) 47s ago 9m 14.9M - 1.5.0 0da6a335fe13 4754ee8fb29e 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (8m) 5s ago 8m 17.0M - 1.5.0 0da6a335fe13 d835355a4bbf 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 47s ago 7m 173M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 47s ago 7m 181M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 47s ago 6m 142M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (6m) 5s ago 6m 218M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (5m) 5s ago 5m 196M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (5m) 5s ago 5m 176M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:48:38.211 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 starting - - - - 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd3d807b0a0 msgr2=0x7fd3d807d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd3d807b0a0 0x7fd3d807d560 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd3dc0096c0 tx=0x7fd3dc005a20 comp rx=0 tx=0).stop 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 msgr2=0x7fd3ec197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 0x7fd3ec197510 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009ce0 tx=0x7fd3e800b690 comp rx=0 tx=0).stop 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 shutdown_connections 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd3d807b0a0 0x7fd3d807d560 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd3ec104d20 0x7fd3ec197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 --2- 172.21.15.46:0/1835618724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd3ec1023f0 0x7fd3ec197510 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 >> 172.21.15.46:0/1835618724 conn(0x7fd3ec0fc010 msgr2=0x7fd3ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:38.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 shutdown_connections 2024-09-21T12:48:38.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.209+0000 7fd3f3fb3640 1 -- 172.21.15.46:0/1835618724 wait complete. 2024-09-21T12:48:38.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.332+0000 7f46d0e83640 1 -- 172.21.15.46:0/1985904404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc104d70 msgr2=0x7f46cc1051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.332+0000 7f46d0e83640 1 --2- 172.21.15.46:0/1985904404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc104d70 0x7f46cc1051f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009880 tx=0x7f46c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.332+0000 7f46d0e83640 1 -- 172.21.15.46:0/1985904404 shutdown_connections 2024-09-21T12:48:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.332+0000 7f46d0e83640 1 --2- 172.21.15.46:0/1985904404 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc104d70 0x7f46cc1051f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.332+0000 7f46d0e83640 1 --2- 172.21.15.46:0/1985904404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46cc103b70 0x7f46cc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.332+0000 7f46d0e83640 1 -- 172.21.15.46:0/1985904404 >> 172.21.15.46:0/1985904404 conn(0x7f46cc0ff320 msgr2=0x7f46cc101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.333+0000 7f46d0e83640 1 -- 172.21.15.46:0/1985904404 shutdown_connections 2024-09-21T12:48:38.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.333+0000 7f46d0e83640 1 -- 172.21.15.46:0/1985904404 wait complete. 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46d0e83640 1 Processor -- start 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46d0e83640 1 -- start start 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46d0e83640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 0x7f46cc073230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46d0e83640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46cc104d70 0x7f46cc073770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46ca59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 0x7f46cc073230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46d0e83640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10c990 con 0x7f46cc103b70 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46ca59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 0x7f46cc073230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60366/0 (socket says 172.21.15.46:60366) 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.334+0000 7f46ca59c640 1 -- 172.21.15.46:0/3696456931 learned_addr learned my addr 172.21.15.46:0/3696456931 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:38.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.335+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f46cc10c810 con 0x7f46cc104d70 2024-09-21T12:48:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.335+0000 7f46c9d9b640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46cc104d70 0x7f46cc073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:38.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.335+0000 7f46ca59c640 1 -- 172.21.15.46:0/3696456931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46cc104d70 msgr2=0x7f46cc073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.335+0000 7f46ca59c640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46cc104d70 0x7f46cc073770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.335+0000 7f46ca59c640 1 -- 172.21.15.46:0/3696456931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46cc073d60 con 0x7f46cc103b70 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.335+0000 7f46ca59c640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 0x7f46cc073230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c8f0 tx=0x7f46bc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.336+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46bc004020 con 0x7f46cc103b70 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.336+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46bc007e10 con 0x7f46cc103b70 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.336+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46bc003e10 con 0x7f46cc103b70 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.336+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46cc1a7450 con 0x7f46cc103b70 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.336+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46cc1a79b0 con 0x7f46cc103b70 2024-09-21T12:48:38.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.337+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46cc103f70 con 0x7f46cc103b70 2024-09-21T12:48:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.338+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f46bc0041c0 con 0x7f46cc103b70 2024-09-21T12:48:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.338+0000 7f46bb7fe640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46b407b0b0 0x7f46b407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:38.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.338+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f46bc09e470 con 0x7f46cc103b70 2024-09-21T12:48:38.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.338+0000 7f46c9d9b640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46b407b0b0 0x7f46b407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:38.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.339+0000 7f46c9d9b640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46b407b0b0 0x7f46b407d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46cc1a3360 tx=0x7f46c0005a20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.344+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f46bc0697b0 con 0x7f46cc103b70 2024-09-21T12:48:38.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.789+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f46cc02d8e0 con 0x7f46cc103b70 2024-09-21T12:48:38.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.790+0000 7f46bb7fe640 1 -- 172.21.15.46:0/3696456931 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f46cc02d8e0 con 0x7f46cc103b70 2024-09-21T12:48:38.791 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:48:38.791 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:48:38.791 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:48:38.791 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:38.791 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:48:38.792 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46b407b0b0 msgr2=0x7f46b407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46b407b0b0 0x7f46b407d570 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f46cc1a3360 tx=0x7f46c0005a20 comp rx=0 tx=0).stop 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 msgr2=0x7f46cc073230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 0x7f46cc073230 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00c8f0 tx=0x7f46bc00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 shutdown_connections 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46b407b0b0 0x7f46b407d570 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f46cc104d70 0x7f46cc073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 --2- 172.21.15.46:0/3696456931 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f46cc103b70 0x7f46cc073230 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.793+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 >> 172.21.15.46:0/3696456931 conn(0x7f46cc0ff320 msgr2=0x7f46cc108200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:38.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.794+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 shutdown_connections 2024-09-21T12:48:38.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.794+0000 7f46d0e83640 1 -- 172.21.15.46:0/3696456931 wait complete. 2024-09-21T12:48:38.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 -- 172.21.15.46:0/2648338102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b60104d20 msgr2=0x7f5b60107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 --2- 172.21.15.46:0/2648338102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b60104d20 0x7f5b60107110 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5b540098b0 tx=0x7f5b5402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 -- 172.21.15.46:0/2648338102 shutdown_connections 2024-09-21T12:48:38.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 --2- 172.21.15.46:0/2648338102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b60104d20 0x7f5b60107110 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 --2- 172.21.15.46:0/2648338102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b601023f0 0x7f5b601047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 -- 172.21.15.46:0/2648338102 >> 172.21.15.46:0/2648338102 conn(0x7f5b600fc010 msgr2=0x7f5b600fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:38.907 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:38 smithi046 ceph-mon[27868]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:38.907 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:38 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:38.907 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:38 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:38.907 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:38 smithi046 ceph-mon[27868]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:38.908 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:38 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3696456931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:38.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 -- 172.21.15.46:0/2648338102 shutdown_connections 2024-09-21T12:48:38.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.905+0000 7f5b66650640 1 -- 172.21.15.46:0/2648338102 wait complete. 2024-09-21T12:48:38.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.906+0000 7f5b66650640 1 Processor -- start 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.906+0000 7f5b66650640 1 -- start start 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.906+0000 7f5b66650640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 0x7f5b60101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b66650640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b60104d20 0x7f5b601003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b66650640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010a790 con 0x7f5b601023f0 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b66650640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6010a610 con 0x7f5b60104d20 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 0x7f5b60101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 0x7f5b60101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60382/0 (socket says 172.21.15.46:60382) 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5ffff640 1 -- 172.21.15.46:0/2715747044 learned_addr learned my addr 172.21.15.46:0/2715747044 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5f7fe640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b60104d20 0x7f5b601003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5ffff640 1 -- 172.21.15.46:0/2715747044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b60104d20 msgr2=0x7f5b601003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5ffff640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b60104d20 0x7f5b601003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.907+0000 7f5b5ffff640 1 -- 172.21.15.46:0/2715747044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b601008e0 con 0x7f5b601023f0 2024-09-21T12:48:38.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.908+0000 7f5b5ffff640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 0x7f5b60101ce0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000e970 tx=0x7f5b5000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:38.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.908+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b5000cac0 con 0x7f5b601023f0 2024-09-21T12:48:38.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.908+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b5000cc60 con 0x7f5b601023f0 2024-09-21T12:48:38.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.908+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b60100bd0 con 0x7f5b601023f0 2024-09-21T12:48:38.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.908+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b50018720 con 0x7f5b601023f0 2024-09-21T12:48:38.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.908+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b60101130 con 0x7f5b601023f0 2024-09-21T12:48:38.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.909+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b601027d0 con 0x7f5b601023f0 2024-09-21T12:48:38.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.911+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f5b50010430 con 0x7f5b601023f0 2024-09-21T12:48:38.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.912+0000 7f5b5d7fa640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5b4807b0b0 0x7f5b4807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:48:38.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.912+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f5b5009ec40 con 0x7f5b601023f0 2024-09-21T12:48:38.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.912+0000 7f5b5f7fe640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5b4807b0b0 0x7f5b4807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:48:38.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.912+0000 7f5b5f7fe640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5b4807b0b0 0x7f5b4807d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009880 tx=0x7f5b540058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:48:38.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:38.916+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5b5006a140 con 0x7f5b601023f0 2024-09-21T12:48:39.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:38 smithi176 ceph-mon[35476]: from='client.14818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:39.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:38 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:39.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:38 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:39.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:38 smithi176 ceph-mon[35476]: from='client.24529 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:39.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:38 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3696456931' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:39.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.253+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5b60105780 con 0x7f5b4807b0b0 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.254+0000 7f5b5d7fa640 1 -- 172.21.15.46:0/2715747044 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f5b60105780 con 0x7f5b4807b0b0 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:48:39.256 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:48:39.257 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:48:39.257 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:48:39.257 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:48:39.257 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:48:39.257 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:48:39.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5b4807b0b0 msgr2=0x7f5b4807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:39.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5b4807b0b0 0x7f5b4807d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5b54009880 tx=0x7f5b540058d0 comp rx=0 tx=0).stop 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 msgr2=0x7f5b60101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 0x7f5b60101ce0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5b5000e970 tx=0x7f5b5000ee30 comp rx=0 tx=0).stop 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 shutdown_connections 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5b4807b0b0 0x7f5b4807d570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b60104d20 0x7f5b601003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 --2- 172.21.15.46:0/2715747044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b601023f0 0x7f5b60101ce0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.257+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 >> 172.21.15.46:0/2715747044 conn(0x7f5b600fc010 msgr2=0x7f5b600fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.258+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 shutdown_connections 2024-09-21T12:48:39.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:48:39.258+0000 7f5b66650640 1 -- 172.21.15.46:0/2715747044 wait complete. 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: pgmap v31: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 245 op/s 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:48:40.102 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.vedsjs"}]: dispatch 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.vedsjs"}]': finished 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi176.rmyfjh"}]: dispatch 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi176.rmyfjh"}]': finished 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.103 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.104 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:39 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.277 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:48:40.277 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: pgmap v31: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 245 op/s 2024-09-21T12:48:40.277 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.277 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.277 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:48:40.277 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.vedsjs"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi046.vedsjs"}]': finished 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi176.rmyfjh"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi176.rmyfjh"}]': finished 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.278 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.279 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.279 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.279 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:40.279 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:48:40.279 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:39 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:41.106 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all mgr 2024-09-21T12:48:41.106 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all rgw 2024-09-21T12:48:41.106 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:48:41.106 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T12:48:41.107 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:48:41.107 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all nfs 2024-09-21T12:48:41.107 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:40 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:48:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all mgr 2024-09-21T12:48:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all rgw 2024-09-21T12:48:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:48:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T12:48:41.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:48:41.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all nfs 2024-09-21T12:48:41.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:40 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:48:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:41 smithi046 ceph-mon[27868]: Upgrade: Updating node-exporter.smithi046 (1/2) 2024-09-21T12:48:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:41 smithi046 ceph-mon[27868]: Deploying daemon node-exporter.smithi046 on smithi046 2024-09-21T12:48:41.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:41 smithi046 ceph-mon[27868]: pgmap v32: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 310 op/s 2024-09-21T12:48:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:41 smithi176 ceph-mon[35476]: Upgrade: Updating node-exporter.smithi046 (1/2) 2024-09-21T12:48:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:41 smithi176 ceph-mon[35476]: Deploying daemon node-exporter.smithi046 on smithi046 2024-09-21T12:48:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:41 smithi176 ceph-mon[35476]: pgmap v32: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 310 op/s 2024-09-21T12:48:43.645 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:43 smithi046 ceph-mon[27868]: pgmap v33: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 242 op/s 2024-09-21T12:48:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:43 smithi176 ceph-mon[35476]: pgmap v33: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 242 op/s 2024-09-21T12:48:44.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:45.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:45 smithi046 ceph-mon[27868]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 320 op/s 2024-09-21T12:48:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:45 smithi176 ceph-mon[35476]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.9 MiB/s wr, 320 op/s 2024-09-21T12:48:46.646 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-21T12:48:46.646 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T12:48:46.928 DEBUG:teuthology.parallel:result is None 2024-09-21T12:48:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:48 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:48 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:48 smithi046 ceph-mon[27868]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 197 op/s 2024-09-21T12:48:48.553 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:48 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:48.553 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:48 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:48.554 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:48 smithi176 ceph-mon[35476]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 197 op/s 2024-09-21T12:48:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:49 smithi046 ceph-mon[27868]: Upgrade: Updating node-exporter.smithi176 (2/2) 2024-09-21T12:48:49.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:49 smithi046 ceph-mon[27868]: Deploying daemon node-exporter.smithi176 on smithi176 2024-09-21T12:48:49.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:49 smithi046 ceph-mon[27868]: pgmap v36: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 212 op/s 2024-09-21T12:48:49.713 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:49 smithi176 ceph-mon[35476]: Upgrade: Updating node-exporter.smithi176 (2/2) 2024-09-21T12:48:49.714 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:49 smithi176 ceph-mon[35476]: Deploying daemon node-exporter.smithi176 on smithi176 2024-09-21T12:48:49.714 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:49 smithi176 ceph-mon[35476]: pgmap v36: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 212 op/s 2024-09-21T12:48:51.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:51 smithi046 ceph-mon[27868]: pgmap v37: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 250 op/s 2024-09-21T12:48:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:51 smithi176 ceph-mon[35476]: pgmap v37: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 250 op/s 2024-09-21T12:48:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:54 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:54 smithi046 ceph-mon[27868]: pgmap v38: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 154 op/s 2024-09-21T12:48:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:54 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:54 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:54.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:54 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:54.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:54 smithi176 ceph-mon[35476]: pgmap v38: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 154 op/s 2024-09-21T12:48:54.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:54 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:54.656 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:54 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:48:54.929 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-21T12:48:54.929 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T12:48:55.436 DEBUG:teuthology.parallel:result is None 2024-09-21T12:48:55.436 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T12:48:55.468 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T12:48:55.468 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T12:48:55.502 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T12:48:55.503 DEBUG:teuthology.parallel:result is None 2024-09-21T12:48:55.626 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:55 smithi176 ceph-mon[35476]: pgmap v39: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 237 op/s 2024-09-21T12:48:55.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:55 smithi046 ceph-mon[27868]: pgmap v39: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 237 op/s 2024-09-21T12:48:57.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:48:58.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:58 smithi176 ceph-mon[35476]: pgmap v40: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 158 op/s 2024-09-21T12:48:58.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:58 smithi046 ceph-mon[27868]: pgmap v40: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 158 op/s 2024-09-21T12:48:59.497 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:48:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:48:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:48:59 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:00.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:00 smithi046 ceph-mon[27868]: pgmap v41: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-09-21T12:49:00.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:00.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:00 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:00 smithi176 ceph-mon[35476]: pgmap v41: 65 pgs: 65 active+clean; 277 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 166 op/s 2024-09-21T12:49:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:00 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:00 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:01 smithi046 ceph-mon[27868]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 178 op/s 2024-09-21T12:49:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:01 smithi176 ceph-mon[35476]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 178 op/s 2024-09-21T12:49:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:03 smithi046 ceph-mon[27868]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 671 KiB/s rd, 621 KiB/s wr, 116 op/s 2024-09-21T12:49:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:03 smithi176 ceph-mon[35476]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 671 KiB/s rd, 621 KiB/s wr, 116 op/s 2024-09-21T12:49:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:05 smithi046 ceph-mon[27868]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 679 KiB/s rd, 628 KiB/s wr, 119 op/s 2024-09-21T12:49:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:05 smithi176 ceph-mon[35476]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 679 KiB/s rd, 628 KiB/s wr, 119 op/s 2024-09-21T12:49:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:07 smithi046 ceph-mon[27868]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 149 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-21T12:49:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:07 smithi176 ceph-mon[35476]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 149 KiB/s rd, 108 KiB/s wr, 36 op/s 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 -- 172.21.15.46:0/644724108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 msgr2=0x7f26ec1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/644724108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec1047e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26e40098b0 tx=0x7f26e402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 -- 172.21.15.46:0/644724108 shutdown_connections 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/644724108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 0x7f26ec107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/644724108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec1047e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 -- 172.21.15.46:0/644724108 >> 172.21.15.46:0/644724108 conn(0x7f26ec0fc010 msgr2=0x7f26ec0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:09.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 -- 172.21.15.46:0/644724108 shutdown_connections 2024-09-21T12:49:09.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.360+0000 7f26f0cdb640 1 -- 172.21.15.46:0/644724108 wait complete. 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.361+0000 7f26f0cdb640 1 Processor -- start 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.361+0000 7f26f0cdb640 1 -- start start 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26f0cdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26f0cdb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 0x7f26ec1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26f0cdb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec10a830 con 0x7f26ec1023f0 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26f0cdb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f26ec10a6b0 con 0x7f26ec104d20 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46348/0 (socket says 172.21.15.46:46348) 2024-09-21T12:49:09.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 -- 172.21.15.46:0/3965651878 learned_addr learned my addr 172.21.15.46:0/3965651878 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26e9d9b640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 0x7f26ec1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 -- 172.21.15.46:0/3965651878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 msgr2=0x7f26ec1003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 0x7f26ec1003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 -- 172.21.15.46:0/3965651878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec1008e0 con 0x7f26ec1023f0 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26e9d9b640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 0x7f26ec1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.362+0000 7f26ea59c640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec101ce0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f26e40099d0 tx=0x7f26e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.363+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26e403f070 con 0x7f26ec1023f0 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.363+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ec100b70 con 0x7f26ec1023f0 2024-09-21T12:49:09.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.363+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f26e4004c70 con 0x7f26ec1023f0 2024-09-21T12:49:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.363+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f26e4035030 con 0x7f26ec1023f0 2024-09-21T12:49:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.363+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ec101120 con 0x7f26ec1023f0 2024-09-21T12:49:09.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.364+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ec1027d0 con 0x7f26ec1023f0 2024-09-21T12:49:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.364+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f26e4042070 con 0x7f26ec1023f0 2024-09-21T12:49:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.365+0000 7f26e37fe640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f26d807b0b0 0x7f26d807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.365+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f26e40beea0 con 0x7f26ec1023f0 2024-09-21T12:49:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.365+0000 7f26e9d9b640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f26d807b0b0 0x7f26d807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:09.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.366+0000 7f26e9d9b640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f26d807b0b0 0x7f26d807d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f26ec101a60 tx=0x7f26d4008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:09.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.370+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f26e408a300 con 0x7f26ec1023f0 2024-09-21T12:49:09.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.624+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f26ec105680 con 0x7f26d807b0b0 2024-09-21T12:49:09.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.626+0000 7f26e37fe640 1 -- 172.21.15.46:0/3965651878 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f26ec105680 con 0x7f26d807b0b0 2024-09-21T12:49:09.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f26d807b0b0 msgr2=0x7f26d807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f26d807b0b0 0x7f26d807d570 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f26ec101a60 tx=0x7f26d4008040 comp rx=0 tx=0).stop 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 msgr2=0x7f26ec101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec101ce0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f26e40099d0 tx=0x7f26e40048f0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 shutdown_connections 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f26d807b0b0 0x7f26d807d570 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26ec104d20 0x7f26ec1003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 --2- 172.21.15.46:0/3965651878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26ec1023f0 0x7f26ec101ce0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 >> 172.21.15.46:0/3965651878 conn(0x7f26ec0fc010 msgr2=0x7f26ec0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 shutdown_connections 2024-09-21T12:49:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.629+0000 7f26f0cdb640 1 -- 172.21.15.46:0/3965651878 wait complete. 2024-09-21T12:49:09.640 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:49:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 -- 172.21.15.46:0/2393795436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498101a60 msgr2=0x7fd498101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 --2- 172.21.15.46:0/2393795436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498101a60 0x7fd498101ee0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd488009880 tx=0x7fd48802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 -- 172.21.15.46:0/2393795436 shutdown_connections 2024-09-21T12:49:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 --2- 172.21.15.46:0/2393795436 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498101a60 0x7fd498101ee0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 --2- 172.21.15.46:0/2393795436 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498100860 0x7fd498100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 -- 172.21.15.46:0/2393795436 >> 172.21.15.46:0/2393795436 conn(0x7fd4980fc010 msgr2=0x7fd4980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 -- 172.21.15.46:0/2393795436 shutdown_connections 2024-09-21T12:49:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.720+0000 7fd4a0549640 1 -- 172.21.15.46:0/2393795436 wait complete. 2024-09-21T12:49:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd4a0549640 1 Processor -- start 2024-09-21T12:49:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd4a0549640 1 -- start start 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd4a0549640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 0x7fd498104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd4a0549640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498101a60 0x7fd498102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd4a0549640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd4981096a0 con 0x7fd498100860 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd4a0549640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd498109520 con 0x7fd498101a60 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd49e2e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 0x7fd498104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd49e2e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 0x7fd498104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46366/0 (socket says 172.21.15.46:46366) 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd49e2e5640 1 -- 172.21.15.46:0/807714779 learned_addr learned my addr 172.21.15.46:0/807714779 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd49dae4640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498101a60 0x7fd498102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd49e2e5640 1 -- 172.21.15.46:0/807714779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498101a60 msgr2=0x7fd498102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.721+0000 7fd49e2e5640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498101a60 0x7fd498102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd49e2e5640 1 -- 172.21.15.46:0/807714779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd498103380 con 0x7fd498100860 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd49dae4640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498101a60 0x7fd498102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd49e2e5640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 0x7fd498104780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd49400cc30 tx=0x7fd49400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd49400cd20 con 0x7fd498100860 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd494003990 con 0x7fd498100860 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd494004740 con 0x7fd498100860 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd498103670 con 0x7fd498100860 2024-09-21T12:49:09.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.722+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd498103c00 con 0x7fd498100860 2024-09-21T12:49:09.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.723+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd498100c60 con 0x7fd498100860 2024-09-21T12:49:09.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.724+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7fd494003b40 con 0x7fd498100860 2024-09-21T12:49:09.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.724+0000 7fd48f7fe640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd48407b050 0x7fd48407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:09.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.725+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fd49409e510 con 0x7fd498100860 2024-09-21T12:49:09.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.725+0000 7fd49dae4640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd48407b050 0x7fd48407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:09.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.725+0000 7fd49dae4640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd48407b050 0x7fd48407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd498104500 tx=0x7fd488005a20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:09.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.732+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd494014030 con 0x7fd498100860 2024-09-21T12:49:09.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.944+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd49819f660 con 0x7fd48407b050 2024-09-21T12:49:09.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.945+0000 7fd48f7fe640 1 -- 172.21.15.46:0/807714779 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7fd49819f660 con 0x7fd48407b050 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd48407b050 msgr2=0x7fd48407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd48407b050 0x7fd48407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd498104500 tx=0x7fd488005a20 comp rx=0 tx=0).stop 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 msgr2=0x7fd498104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 0x7fd498104780 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd49400cc30 tx=0x7fd49400a620 comp rx=0 tx=0).stop 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 shutdown_connections 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd48407b050 0x7fd48407d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd498101a60 0x7fd498102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 --2- 172.21.15.46:0/807714779 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd498100860 0x7fd498104780 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:09.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 >> 172.21.15.46:0/807714779 conn(0x7fd4980fc010 msgr2=0x7fd498069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:09.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 shutdown_connections 2024-09-21T12:49:09.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:09.948+0000 7fd4a0549640 1 -- 172.21.15.46:0/807714779 wait complete. 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 -- 172.21.15.46:0/4013652670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e90104d20 msgr2=0x7f4e90107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 --2- 172.21.15.46:0/4013652670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e90104d20 0x7f4e90107110 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f4e840098b0 tx=0x7f4e8402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 -- 172.21.15.46:0/4013652670 shutdown_connections 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 --2- 172.21.15.46:0/4013652670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e90104d20 0x7f4e90107110 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 --2- 172.21.15.46:0/4013652670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e901023f0 0x7f4e901047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 -- 172.21.15.46:0/4013652670 >> 172.21.15.46:0/4013652670 conn(0x7f4e900fc010 msgr2=0x7f4e900fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:10.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 -- 172.21.15.46:0/4013652670 shutdown_connections 2024-09-21T12:49:10.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.045+0000 7f4e96656640 1 -- 172.21.15.46:0/4013652670 wait complete. 2024-09-21T12:49:10.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.046+0000 7f4e96656640 1 Processor -- start 2024-09-21T12:49:10.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.046+0000 7f4e96656640 1 -- start start 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.046+0000 7f4e96656640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 0x7f4e90101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.046+0000 7f4e96656640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90104d20 0x7f4e901003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.046+0000 7f4e96656640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9010a810 con 0x7f4e901023f0 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.046+0000 7f4e96656640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9010a690 con 0x7f4e90104d20 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 0x7f4e90101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 0x7f4e90101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46390/0 (socket says 172.21.15.46:46390) 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 -- 172.21.15.46:0/3398708199 learned_addr learned my addr 172.21.15.46:0/3398708199 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8f7fe640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90104d20 0x7f4e901003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 -- 172.21.15.46:0/3398708199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90104d20 msgr2=0x7f4e901003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.050 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90104d20 0x7f4e901003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 -- 172.21.15.46:0/3398708199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e901008e0 con 0x7f4e901023f0 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8f7fe640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90104d20 0x7f4e901003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8ffff640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 0x7f4e90101ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000b420 tx=0x7f4e8000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e80011630 con 0x7f4e901023f0 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e80016070 con 0x7f4e901023f0 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e80010d40 con 0x7f4e901023f0 2024-09-21T12:49:10.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.047+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e90100bd0 con 0x7f4e901023f0 2024-09-21T12:49:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.048+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e901011b0 con 0x7f4e901023f0 2024-09-21T12:49:10.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.049+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e901027d0 con 0x7f4e901023f0 2024-09-21T12:49:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.049+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f4e8001b460 con 0x7f4e901023f0 2024-09-21T12:49:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.050+0000 7f4e8d7fa640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e7807b0b0 0x7f4e7807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.050+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f4e8009da10 con 0x7f4e901023f0 2024-09-21T12:49:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.050+0000 7f4e8f7fe640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e7807b0b0 0x7f4e7807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.051+0000 7f4e8f7fe640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e7807b0b0 0x7f4e7807d570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4e84006010 tx=0x7f4e84005a20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:10.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.056+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4e80021250 con 0x7f4e901023f0 2024-09-21T12:49:10.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.252+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4e9019f740 con 0x7f4e7807b0b0 2024-09-21T12:49:10.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:10 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:10 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:10 smithi046 ceph-mon[27868]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 149 KiB/s rd, 108 KiB/s wr, 37 op/s 2024-09-21T12:49:10.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:10 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.254 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:10 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.263+0000 7f4e8d7fa640 1 -- 172.21.15.46:0/3398708199 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4e9019f740 con 0x7f4e7807b0b0 2024-09-21T12:49:10.264 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:49:10.264 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 1s ago 10m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:49:10.264 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (2m) 1s ago 10m 8568k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:49:10.264 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (2m) 14s ago 9m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:49:10.264 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 1s ago 10m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (9m) 14s ago 9m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (8m) 1s ago 9m 80.4M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (4m) 1s ago 4m 133M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (4m) 1s ago 4m 180M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (4m) 14s ago 4m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (4m) 14s ago 4m 26.7M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (104s) 1s ago 11m 512M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (42s) 14s ago 9m 455M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 1s ago 11m 58.8M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (9m) 14s ago 9m 49.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (23s) 1s ago 10m 7730k - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (17s) 14s ago 9m 3380k - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 1s ago 8m 199M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 1s ago 7m 215M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:49:10.265 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 1s ago 7m 179M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:49:10.266 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (6m) 14s ago 6m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:49:10.266 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (6m) 14s ago 6m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:49:10.266 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (5m) 14s ago 5m 187M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:49:10.266 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (47s) 1s ago 9m 51.8M - 2.43.0 a07b618ecd1d 8a7429d3a558 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e7807b0b0 msgr2=0x7f4e7807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e7807b0b0 0x7f4e7807d570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4e84006010 tx=0x7f4e84005a20 comp rx=0 tx=0).stop 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 msgr2=0x7f4e90101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 0x7f4e90101ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000b420 tx=0x7f4e8000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 shutdown_connections 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e7807b0b0 0x7f4e7807d570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e90104d20 0x7f4e901003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 --2- 172.21.15.46:0/3398708199 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e901023f0 0x7f4e90101ce0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 >> 172.21.15.46:0/3398708199 conn(0x7f4e900fc010 msgr2=0x7f4e900fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 shutdown_connections 2024-09-21T12:49:10.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.265+0000 7f4e96656640 1 -- 172.21.15.46:0/3398708199 wait complete. 2024-09-21T12:49:10.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:10 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:10 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:10 smithi176 ceph-mon[35476]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 149 KiB/s rd, 108 KiB/s wr, 37 op/s 2024-09-21T12:49:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:10 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:10 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 -- 172.21.15.46:0/3671118770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 msgr2=0x7f0b54102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 --2- 172.21.15.46:0/3671118770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54102fe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009880 tx=0x7f0b4802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 -- 172.21.15.46:0/3671118770 shutdown_connections 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 --2- 172.21.15.46:0/3671118770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54102fe0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 --2- 172.21.15.46:0/3671118770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54101960 0x7f0b54101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 -- 172.21.15.46:0/3671118770 >> 172.21.15.46:0/3671118770 conn(0x7f0b540fd0f0 msgr2=0x7f0b540ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 -- 172.21.15.46:0/3671118770 shutdown_connections 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.351+0000 7f0b59c85640 1 -- 172.21.15.46:0/3671118770 wait complete. 2024-09-21T12:49:10.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b59c85640 1 Processor -- start 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b59c85640 1 -- start start 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b59c85640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54101960 0x7f0b54197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b59c85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b59c85640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410a820 con 0x7f0b54102b60 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b59c85640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410a6a0 con 0x7f0b54101960 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b52ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b52ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46416/0 (socket says 172.21.15.46:46416) 2024-09-21T12:49:10.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b52ffd640 1 -- 172.21.15.46:0/4246093803 learned_addr learned my addr 172.21.15.46:0/4246093803 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b537fe640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54101960 0x7f0b54197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b52ffd640 1 -- 172.21.15.46:0/4246093803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54101960 msgr2=0x7f0b54197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.352+0000 7f0b52ffd640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54101960 0x7f0b54197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b52ffd640 1 -- 172.21.15.46:0/4246093803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b541980d0 con 0x7f0b54102b60 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b52ffd640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54197a50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b48006010 tx=0x7f0b480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b4803f070 con 0x7f0b54102b60 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b480044d0 con 0x7f0b54102b60 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5419cab0 con 0x7f0b54102b60 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b48035030 con 0x7f0b54102b60 2024-09-21T12:49:10.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.353+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5419d0c0 con 0x7f0b54102b60 2024-09-21T12:49:10.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.354+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b54101d40 con 0x7f0b54102b60 2024-09-21T12:49:10.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.355+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f0b48042070 con 0x7f0b54102b60 2024-09-21T12:49:10.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.355+0000 7f0b50ff9640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0b3c07b0b0 0x7f0b3c07d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.355+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f0b480bee90 con 0x7f0b54102b60 2024-09-21T12:49:10.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.355+0000 7f0b537fe640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0b3c07b0b0 0x7f0b3c07d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.356+0000 7f0b537fe640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0b3c07b0b0 0x7f0b3c07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b541029c0 tx=0x7f0b44009110 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:10.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.360+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0b4808a2f0 con 0x7f0b54102b60 2024-09-21T12:49:10.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.626+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0b54191630 con 0x7f0b54102b60 2024-09-21T12:49:10.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.626+0000 7f0b50ff9640 1 -- 172.21.15.46:0/4246093803 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f0b4808f1a0 con 0x7f0b54102b60 2024-09-21T12:49:10.628 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:49:10.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:49:10.628 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:49:10.628 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:10.628 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:49:10.629 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:49:10.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0b3c07b0b0 msgr2=0x7f0b3c07d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0b3c07b0b0 0x7f0b3c07d570 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0b541029c0 tx=0x7f0b44009110 comp rx=0 tx=0).stop 2024-09-21T12:49:10.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 msgr2=0x7f0b54197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54197a50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0b48006010 tx=0x7f0b480048f0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 shutdown_connections 2024-09-21T12:49:10.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0b3c07b0b0 0x7f0b3c07d570 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0b54102b60 0x7f0b54197a50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 --2- 172.21.15.46:0/4246093803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0b54101960 0x7f0b54197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 >> 172.21.15.46:0/4246093803 conn(0x7f0b540fd0f0 msgr2=0x7f0b54106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:10.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 shutdown_connections 2024-09-21T12:49:10.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.629+0000 7f0b59c85640 1 -- 172.21.15.46:0/4246093803 wait complete. 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 -- 172.21.15.46:0/2271657940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 msgr2=0x7f01901003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 --2- 172.21.15.46:0/2271657940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f01901003e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0180009880 tx=0x7f018002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 -- 172.21.15.46:0/2271657940 shutdown_connections 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 --2- 172.21.15.46:0/2271657940 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01901011e0 0x7f0190101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 --2- 172.21.15.46:0/2271657940 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f01901003e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 -- 172.21.15.46:0/2271657940 >> 172.21.15.46:0/2271657940 conn(0x7f01900fb770 msgr2=0x7f01900fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 -- 172.21.15.46:0/2271657940 shutdown_connections 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.716+0000 7f0195624640 1 -- 172.21.15.46:0/2271657940 wait complete. 2024-09-21T12:49:10.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f0195624640 1 Processor -- start 2024-09-21T12:49:10.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f0195624640 1 -- start start 2024-09-21T12:49:10.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f0195624640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f0190197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f0195624640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01901011e0 0x7f0190197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f0195624640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0190108590 con 0x7f01900fffe0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f0195624640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0190108410 con 0x7f01901011e0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f0190197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f0190197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46430/0 (socket says 172.21.15.46:46430) 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018effd640 1 -- 172.21.15.46:0/770832632 learned_addr learned my addr 172.21.15.46:0/770832632 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018e7fc640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01901011e0 0x7f0190197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018effd640 1 -- 172.21.15.46:0/770832632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01901011e0 msgr2=0x7f0190197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018effd640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01901011e0 0x7f0190197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.717+0000 7f018effd640 1 -- 172.21.15.46:0/770832632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01901980f0 con 0x7f01900fffe0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.718+0000 7f018effd640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f0190197530 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0180006010 tx=0x7f01800045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.718+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f018003f070 con 0x7f01900fffe0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.718+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0180004a50 con 0x7f01900fffe0 2024-09-21T12:49:10.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.718+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f019019cad0 con 0x7f01900fffe0 2024-09-21T12:49:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.718+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0180035030 con 0x7f01900fffe0 2024-09-21T12:49:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.718+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f019019d060 con 0x7f01900fffe0 2024-09-21T12:49:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.719+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01901003e0 con 0x7f01900fffe0 2024-09-21T12:49:10.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.720+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 32) ==== 103422+0+0 (secure 0 0 0) 0x7f0180042070 con 0x7f01900fffe0 2024-09-21T12:49:10.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.720+0000 7f0177fff640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f017807b0b0 0x7f017807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:10.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.720+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f01800bed20 con 0x7f01900fffe0 2024-09-21T12:49:10.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.720+0000 7f018e7fc640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f017807b0b0 0x7f017807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:10.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.721+0000 7f018e7fc640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f017807b0b0 0x7f017807d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0184005fd0 tx=0x7f0184005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:10.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.725+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0180004c00 con 0x7f01900fffe0 2024-09-21T12:49:10.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.933+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f01900626f0 con 0x7f017807b0b0 2024-09-21T12:49:10.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.934+0000 7f0177fff640 1 -- 172.21.15.46:0/770832632 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f01900626f0 con 0x7f017807b0b0 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading node-exporter daemons", 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:49:10.936 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:49:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f017807b0b0 msgr2=0x7f017807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f017807b0b0 0x7f017807d570 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f0184005fd0 tx=0x7f0184005850 comp rx=0 tx=0).stop 2024-09-21T12:49:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 msgr2=0x7f0190197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f0190197530 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f0180006010 tx=0x7f01800045e0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 shutdown_connections 2024-09-21T12:49:10.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f017807b0b0 0x7f017807d570 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01901011e0 0x7f0190197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 --2- 172.21.15.46:0/770832632 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01900fffe0 0x7f0190197530 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:10.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 >> 172.21.15.46:0/770832632 conn(0x7f01900fb770 msgr2=0x7f01901048a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:10.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 shutdown_connections 2024-09-21T12:49:10.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:10.937+0000 7f0195624640 1 -- 172.21.15.46:0/770832632 wait complete. 2024-09-21T12:49:11.237 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:11 smithi046 ceph-mon[27868]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:11.237 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:11 smithi046 ceph-mon[27868]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:11.237 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:11 smithi046 ceph-mon[27868]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:11.238 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:11 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4246093803' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:11 smithi176 ceph-mon[35476]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:11.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:11 smithi176 ceph-mon[35476]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:11.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:11 smithi176 ceph-mon[35476]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:11.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:11 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4246093803' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:12.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:12 smithi046 ceph-mon[27868]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:12.316 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:12 smithi046 ceph-mon[27868]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 149 KiB/s rd, 108 KiB/s wr, 31 op/s 2024-09-21T12:49:12.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:12 smithi176 ceph-mon[35476]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:12.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:12 smithi176 ceph-mon[35476]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 149 KiB/s rd, 108 KiB/s wr, 31 op/s 2024-09-21T12:49:14.368 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:14 smithi176 ceph-mon[35476]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:14.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:14.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:14 smithi046 ceph-mon[27868]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 8.8 KiB/s rd, 7.3 KiB/s wr, 5 op/s 2024-09-21T12:49:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:15 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:15 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:16.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:16 smithi046 ceph-mon[27868]: Upgrade: Updating prometheus.smithi046 2024-09-21T12:49:16.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:16 smithi046 ceph-mon[27868]: Deploying daemon prometheus.smithi046 on smithi046 2024-09-21T12:49:16.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:16 smithi046 ceph-mon[27868]: mgrmap e33: smithi046.vedsjs(active, since 91s), standbys: smithi176.rmyfjh 2024-09-21T12:49:16.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:16 smithi046 ceph-mon[27868]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.8 KiB/s rd, 7.7 KiB/s wr, 7 op/s 2024-09-21T12:49:16.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:16 smithi176 ceph-mon[35476]: Upgrade: Updating prometheus.smithi046 2024-09-21T12:49:16.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:16 smithi176 ceph-mon[35476]: Deploying daemon prometheus.smithi046 on smithi046 2024-09-21T12:49:16.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:16 smithi176 ceph-mon[35476]: mgrmap e33: smithi046.vedsjs(active, since 91s), standbys: smithi176.rmyfjh 2024-09-21T12:49:16.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:16 smithi176 ceph-mon[35476]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9.8 KiB/s rd, 7.7 KiB/s wr, 7 op/s 2024-09-21T12:49:17.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:17 smithi046 ceph-mon[27868]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-21T12:49:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:17 smithi176 ceph-mon[35476]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-21T12:49:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:19 smithi046 ceph-mon[27868]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-21T12:49:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:19 smithi176 ceph-mon[35476]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-21T12:49:21.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:21 smithi046 ceph-mon[27868]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T12:49:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:21 smithi176 ceph-mon[35476]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T12:49:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:23 smithi046 ceph-mon[27868]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:49:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:23 smithi176 ceph-mon[35476]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 597 B/s wr, 4 op/s 2024-09-21T12:49:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:25 smithi176 ceph-mon[35476]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T12:49:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:25 smithi046 ceph-mon[27868]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-21T12:49:28.394 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:28 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:28.395 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:28 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:28.395 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:28 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:28.395 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:28 smithi046 ceph-mon[27868]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T12:49:28.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:28 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:28.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:28 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:28.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:28 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:28.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:28 smithi176 ceph-mon[35476]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T12:49:29.457 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:30.646 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:30 smithi046 ceph-mon[27868]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T12:49:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:30 smithi176 ceph-mon[35476]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-21T12:49:32.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:32 smithi046 ceph-mon[27868]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T12:49:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:32 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:32.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:32 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:32.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:32 smithi176 ceph-mon[35476]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-21T12:49:32.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:32 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:32.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:32 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:33.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:33 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:33.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:33 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:33.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:33 smithi046 ceph-mon[27868]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:33 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:33 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:34.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:33 smithi176 ceph-mon[35476]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:35 smithi046 ceph-mon[27868]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:35 smithi176 ceph-mon[35476]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:49:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:49:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:36 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:37.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:36 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:37 smithi046 ceph-mon[27868]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:37 smithi176 ceph-mon[35476]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:39.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:38 smithi046 ceph-mon[27868]: Upgrade: Updating alertmanager.smithi046 2024-09-21T12:49:39.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:38 smithi046 ceph-mon[27868]: Deploying daemon alertmanager.smithi046 on smithi046 2024-09-21T12:49:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:38 smithi176 ceph-mon[35476]: Upgrade: Updating alertmanager.smithi046 2024-09-21T12:49:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:38 smithi176 ceph-mon[35476]: Deploying daemon alertmanager.smithi046 on smithi046 2024-09-21T12:49:40.157 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:39 smithi046 ceph-mon[27868]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:40.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:39 smithi176 ceph-mon[35476]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 -- 172.21.15.46:0/2815430483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 msgr2=0x7fe7f8103360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/2815430483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8103360 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4009880 tx=0x7fe7f402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 -- 172.21.15.46:0/2815430483 shutdown_connections 2024-09-21T12:49:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/2815430483 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 0x7fe7f80ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/2815430483 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8103360 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 -- 172.21.15.46:0/2815430483 >> 172.21.15.46:0/2815430483 conn(0x7fe7f80fb770 msgr2=0x7fe7f80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 -- 172.21.15.46:0/2815430483 shutdown_connections 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.026+0000 7fe7fffb0640 1 -- 172.21.15.46:0/2815430483 wait complete. 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fffb0640 1 Processor -- start 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fffb0640 1 -- start start 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fffb0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fffb0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 0x7fe7f8197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fffb0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f810a840 con 0x7fe7f8102f60 2024-09-21T12:49:41.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fffb0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f810a6c0 con 0x7fe7f8103930 2024-09-21T12:49:41.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fdd4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fdd4c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56590/0 (socket says 172.21.15.46:56590) 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fdd4c640 1 -- 172.21.15.46:0/1913092651 learned_addr learned my addr 172.21.15.46:0/1913092651 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fd54b640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 0x7fe7f8197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fdd4c640 1 -- 172.21.15.46:0/1913092651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 msgr2=0x7fe7f8197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fdd4c640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 0x7fe7f8197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fdd4c640 1 -- 172.21.15.46:0/1913092651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f8198140 con 0x7fe7f8102f60 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.027+0000 7fe7fd54b640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 0x7fe7f8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.028+0000 7fe7fdd4c640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8197580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4006010 tx=0x7fe7f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.028+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7f403f070 con 0x7fe7f8102f60 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.028+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7f40044d0 con 0x7fe7f8102f60 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.028+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe7f4035030 con 0x7fe7f8102f60 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.028+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f819cb20 con 0x7fe7f8102f60 2024-09-21T12:49:41.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.028+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f819d0b0 con 0x7fe7f8102f60 2024-09-21T12:49:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.029+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f8103360 con 0x7fe7f8102f60 2024-09-21T12:49:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.030+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe7f4042070 con 0x7fe7f8102f60 2024-09-21T12:49:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.030+0000 7fe7eeffd640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7e407af80 0x7fe7e407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.030+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe7f40bec10 con 0x7fe7f8102f60 2024-09-21T12:49:41.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.030+0000 7fe7fd54b640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7e407af80 0x7fe7e407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.031+0000 7fe7fd54b640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7e407af80 0x7fe7e407d440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006fd0 tx=0x7fe7e8008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.035+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe7f408a290 con 0x7fe7f8102f60 2024-09-21T12:49:41.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.241+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe7f80626f0 con 0x7fe7e407af80 2024-09-21T12:49:41.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.242+0000 7fe7eeffd640 1 -- 172.21.15.46:0/1913092651 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7fe7f80626f0 con 0x7fe7e407af80 2024-09-21T12:49:41.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7e407af80 msgr2=0x7fe7e407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7e407af80 0x7fe7e407d440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe7e8006fd0 tx=0x7fe7e8008040 comp rx=0 tx=0).stop 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 msgr2=0x7fe7f8197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8197580 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe7f4006010 tx=0x7fe7f40048f0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 shutdown_connections 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7e407af80 0x7fe7e407d440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe7f8103930 0x7fe7f8197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 --2- 172.21.15.46:0/1913092651 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe7f8102f60 0x7fe7f8197580 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.244+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 >> 172.21.15.46:0/1913092651 conn(0x7fe7f80fb770 msgr2=0x7fe7f81061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.245+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 shutdown_connections 2024-09-21T12:49:41.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.245+0000 7fe7fffb0640 1 -- 172.21.15.46:0/1913092651 wait complete. 2024-09-21T12:49:41.254 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:49:41.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2631448997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 msgr2=0x7f35c8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2631448997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8101d60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f35b8009c20 tx=0x7f35b802a970 comp rx=0 tx=0).stop 2024-09-21T12:49:41.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2631448997 shutdown_connections 2024-09-21T12:49:41.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2631448997 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35c8102b60 0x7f35c8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2631448997 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8101d60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2631448997 >> 172.21.15.46:0/2631448997 conn(0x7f35c80fd110 msgr2=0x7f35c80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2631448997 shutdown_connections 2024-09-21T12:49:41.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.330+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2631448997 wait complete. 2024-09-21T12:49:41.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35ceb2d640 1 Processor -- start 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35ceb2d640 1 -- start start 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35ceb2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35ceb2d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35c8102b60 0x7f35c80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35ceb2d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f35c810a7a0 con 0x7f35c8101960 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35ceb2d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f35c810a620 con 0x7f35c8102b60 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35cc8c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35cc8c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56620/0 (socket says 172.21.15.46:56620) 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35cc8c9640 1 -- 172.21.15.46:0/2284863012 learned_addr learned my addr 172.21.15.46:0/2284863012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35c7fff640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35c8102b60 0x7f35c80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35cc8c9640 1 -- 172.21.15.46:0/2284863012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35c8102b60 msgr2=0x7f35c80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.331+0000 7f35cc8c9640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35c8102b60 0x7f35c80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35cc8c9640 1 -- 172.21.15.46:0/2284863012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c8074b20 con 0x7f35c8101960 2024-09-21T12:49:41.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35cc8c9640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8075f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f35b8006010 tx=0x7f35b802f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35b8047070 con 0x7f35c8101960 2024-09-21T12:49:41.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f35b8003e30 con 0x7f35c8101960 2024-09-21T12:49:41.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f35b8034070 con 0x7f35c8101960 2024-09-21T12:49:41.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35c8074db0 con 0x7f35c8101960 2024-09-21T12:49:41.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.332+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35c8075360 con 0x7f35c8101960 2024-09-21T12:49:41.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.333+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35c8101d60 con 0x7f35c8101960 2024-09-21T12:49:41.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.334+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f35b804a070 con 0x7f35c8101960 2024-09-21T12:49:41.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.334+0000 7f35c5ffb640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f35b407af30 0x7f35b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.334+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f35b80bed00 con 0x7f35c8101960 2024-09-21T12:49:41.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.334+0000 7f35c7fff640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f35b407af30 0x7f35b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.335+0000 7f35c7fff640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f35b407af30 0x7f35b407d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35c8075ca0 tx=0x7f35b000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.339+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f35b80c2030 con 0x7f35c8101960 2024-09-21T12:49:41.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.550+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f35c8107130 con 0x7f35b407af30 2024-09-21T12:49:41.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.551+0000 7f35c5ffb640 1 -- 172.21.15.46:0/2284863012 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f35c8107130 con 0x7f35b407af30 2024-09-21T12:49:41.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f35b407af30 msgr2=0x7f35b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f35b407af30 0x7f35b407d3f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f35c8075ca0 tx=0x7f35b000b390 comp rx=0 tx=0).stop 2024-09-21T12:49:41.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 msgr2=0x7f35c8075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8075f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f35b8006010 tx=0x7f35b802f660 comp rx=0 tx=0).stop 2024-09-21T12:49:41.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 shutdown_connections 2024-09-21T12:49:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f35b407af30 0x7f35b407d3f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f35c8102b60 0x7f35c80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 --2- 172.21.15.46:0/2284863012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f35c8101960 0x7f35c8075f20 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 >> 172.21.15.46:0/2284863012 conn(0x7f35c80fd110 msgr2=0x7f35c80ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 shutdown_connections 2024-09-21T12:49:41.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.554+0000 7f35ceb2d640 1 -- 172.21.15.46:0/2284863012 wait complete. 2024-09-21T12:49:41.601 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:41 smithi046 ceph-mon[27868]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:41.601 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:41 smithi046 ceph-mon[27868]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.639+0000 7fe9ca611640 1 -- 172.21.15.46:0/769381488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c4104d20 msgr2=0x7fe9c4107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.639+0000 7fe9ca611640 1 --2- 172.21.15.46:0/769381488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c4104d20 0x7fe9c4107110 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe9b80098b0 tx=0x7fe9b802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.639+0000 7fe9ca611640 1 -- 172.21.15.46:0/769381488 shutdown_connections 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.639+0000 7fe9ca611640 1 --2- 172.21.15.46:0/769381488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c4104d20 0x7fe9c4107110 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.639+0000 7fe9ca611640 1 --2- 172.21.15.46:0/769381488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c41023f0 0x7fe9c41047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.639+0000 7fe9ca611640 1 -- 172.21.15.46:0/769381488 >> 172.21.15.46:0/769381488 conn(0x7fe9c40fc010 msgr2=0x7fe9c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 -- 172.21.15.46:0/769381488 shutdown_connections 2024-09-21T12:49:41.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 -- 172.21.15.46:0/769381488 wait complete. 2024-09-21T12:49:41.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 Processor -- start 2024-09-21T12:49:41.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 -- start start 2024-09-21T12:49:41.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 0x7fe9c4101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c4104d20 0x7fe9c41003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c410a7b0 con 0x7fe9c41023f0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.640+0000 7fe9ca611640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c410a630 con 0x7fe9c4104d20 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 0x7fe9c4101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 0x7fe9c4101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56650/0 (socket says 172.21.15.46:56650) 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 -- 172.21.15.46:0/758292548 learned_addr learned my addr 172.21.15.46:0/758292548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c37fe640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c4104d20 0x7fe9c41003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 -- 172.21.15.46:0/758292548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c4104d20 msgr2=0x7fe9c41003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c4104d20 0x7fe9c41003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 -- 172.21.15.46:0/758292548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c41008e0 con 0x7fe9c41023f0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c3fff640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 0x7fe9c4101ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400c8f0 tx=0x7fe9b400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9b40079b0 con 0x7fe9c41023f0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe9b40054e0 con 0x7fe9c41023f0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe9b4004dd0 con 0x7fe9c41023f0 2024-09-21T12:49:41.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.641+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c4100bd0 con 0x7fe9c41023f0 2024-09-21T12:49:41.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.642+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c4101130 con 0x7fe9c41023f0 2024-09-21T12:49:41.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.643+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c41027d0 con 0x7fe9c41023f0 2024-09-21T12:49:41.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.643+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe9b4005020 con 0x7fe9c41023f0 2024-09-21T12:49:41.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.644+0000 7fe9c17fa640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe9ac07aed0 0x7fe9ac07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.644+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe9b409df30 con 0x7fe9c41023f0 2024-09-21T12:49:41.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.644+0000 7fe9c37fe640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe9ac07aed0 0x7fe9ac07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.644+0000 7fe9c37fe640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe9ac07aed0 0x7fe9ac07d390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009880 tx=0x7fe9b80058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.648+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe9b4014030 con 0x7fe9c41023f0 2024-09-21T12:49:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:41 smithi176 ceph-mon[35476]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:41.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:41 smithi176 ceph-mon[35476]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:41.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.845+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe9c4105780 con 0x7fe9ac07aed0 2024-09-21T12:49:41.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.855+0000 7fe9c17fa640 1 -- 172.21.15.46:0/758292548 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe9c4105780 con 0x7fe9ac07aed0 2024-09-21T12:49:41.856 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (9m) 9s ago 10m 24.3M - 0.25.0 c8568f914cd2 194059d79fbe 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (3m) 9s ago 10m 8674k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (2m) 45s ago 10m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 9s ago 10m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (10m) 45s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (9m) 9s ago 10m 81.6M - 9.4.12 2bacad6d85d8 d0135cfe1b76 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (5m) 9s ago 5m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (5m) 9s ago 5m 152M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (5m) 45s ago 5m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (5m) 45s ago 5m 26.7M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (2m) 9s ago 12m 516M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:49:41.857 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (74s) 45s ago 9m 455M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 9s ago 12m 58.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (9m) 45s ago 9m 49.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (55s) 9s ago 10m 12.1M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (49s) 45s ago 9m 3380k - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 9s ago 8m 201M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 9s ago 8m 217M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 9s ago 7m 177M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (7m) 45s ago 7m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (6m) 45s ago 6m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (6m) 45s ago 6m 187M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:49:41.858 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (15s) 9s ago 10m 41.4M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:49:41.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe9ac07aed0 msgr2=0x7fe9ac07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe9ac07aed0 0x7fe9ac07d390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe9b8009880 tx=0x7fe9b80058d0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 msgr2=0x7fe9c4101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 0x7fe9c4101ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe9b400c8f0 tx=0x7fe9b400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 shutdown_connections 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe9ac07aed0 0x7fe9ac07d390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe9c4104d20 0x7fe9c41003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 --2- 172.21.15.46:0/758292548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe9c41023f0 0x7fe9c4101ce0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 >> 172.21.15.46:0/758292548 conn(0x7fe9c40fc010 msgr2=0x7fe9c40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.857+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 shutdown_connections 2024-09-21T12:49:41.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.858+0000 7fe9ca611640 1 -- 172.21.15.46:0/758292548 wait complete. 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 -- 172.21.15.46:0/857993970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc894104d20 msgr2=0x7fc894107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 --2- 172.21.15.46:0/857993970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc894104d20 0x7fc894107110 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc8840098b0 tx=0x7fc88402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 -- 172.21.15.46:0/857993970 shutdown_connections 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 --2- 172.21.15.46:0/857993970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc894104d20 0x7fc894107110 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 --2- 172.21.15.46:0/857993970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc8941023f0 0x7fc8941047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 -- 172.21.15.46:0/857993970 >> 172.21.15.46:0/857993970 conn(0x7fc8940fc010 msgr2=0x7fc8940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 -- 172.21.15.46:0/857993970 shutdown_connections 2024-09-21T12:49:41.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.942+0000 7fc89c75f640 1 -- 172.21.15.46:0/857993970 wait complete. 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89c75f640 1 Processor -- start 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89c75f640 1 -- start start 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89c75f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 0x7fc894197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89c75f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894104d20 0x7fc894197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89c75f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc89410a790 con 0x7fc8941023f0 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89c75f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc89410a610 con 0x7fc894104d20 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89a4fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 0x7fc894197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89a4fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 0x7fc894197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56674/0 (socket says 172.21.15.46:56674) 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc89a4fb640 1 -- 172.21.15.46:0/3834390517 learned_addr learned my addr 172.21.15.46:0/3834390517 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.943+0000 7fc899cfa640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894104d20 0x7fc894197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc89a4fb640 1 -- 172.21.15.46:0/3834390517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894104d20 msgr2=0x7fc894197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:41.946 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc89a4fb640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894104d20 0x7fc894197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc89a4fb640 1 -- 172.21.15.46:0/3834390517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8941980f0 con 0x7fc8941023f0 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc899cfa640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894104d20 0x7fc894197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc89a4fb640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 0x7fc894197530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc89000d8d0 tx=0x7fc89000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc890017070 con 0x7fc8941023f0 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc890010460 con 0x7fc8941023f0 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc89000f5f0 con 0x7fc8941023f0 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.944+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc89419cb30 con 0x7fc8941023f0 2024-09-21T12:49:41.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.945+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc89419d090 con 0x7fc8941023f0 2024-09-21T12:49:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.945+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8941027d0 con 0x7fc8941023f0 2024-09-21T12:49:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.946+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc890009a30 con 0x7fc8941023f0 2024-09-21T12:49:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.947+0000 7fc88b7fe640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc88007af80 0x7fc88007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.947+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc89009dda0 con 0x7fc8941023f0 2024-09-21T12:49:41.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.947+0000 7fc899cfa640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc88007af80 0x7fc88007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:41.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.948+0000 7fc899cfa640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc88007af80 0x7fc88007d440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc884009880 tx=0x7fc8840058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:41.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:41.951+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc8900694c0 con 0x7fc8941023f0 2024-09-21T12:49:42.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.213+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc89419d320 con 0x7fc8941023f0 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.213+0000 7fc88b7fe640 1 -- 172.21.15.46:0/3834390517 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fc89006e370 con 0x7fc8941023f0 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:49:42.215 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:49:42.216 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:49:42.217 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:49:42.217 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:49:42.217 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:49:42.217 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:49:42.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.215+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc88007af80 msgr2=0x7fc88007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.215+0000 7fc89c75f640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc88007af80 0x7fc88007d440 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc884009880 tx=0x7fc8840058d0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 msgr2=0x7fc894197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 0x7fc894197530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc89000d8d0 tx=0x7fc89000dd90 comp rx=0 tx=0).stop 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 shutdown_connections 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc88007af80 0x7fc88007d440 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc894104d20 0x7fc894197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 --2- 172.21.15.46:0/3834390517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc8941023f0 0x7fc894197530 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 >> 172.21.15.46:0/3834390517 conn(0x7fc8940fc010 msgr2=0x7fc8940fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 shutdown_connections 2024-09-21T12:49:42.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.216+0000 7fc89c75f640 1 -- 172.21.15.46:0/3834390517 wait complete. 2024-09-21T12:49:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 -- 172.21.15.46:0/2004948461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0102b60 msgr2=0x7f85f0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 --2- 172.21.15.46:0/2004948461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0102b60 0x7f85f0102fe0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f85e4009880 tx=0x7f85e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 -- 172.21.15.46:0/2004948461 shutdown_connections 2024-09-21T12:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 --2- 172.21.15.46:0/2004948461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0102b60 0x7f85f0102fe0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 --2- 172.21.15.46:0/2004948461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f0101960 0x7f85f0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 -- 172.21.15.46:0/2004948461 >> 172.21.15.46:0/2004948461 conn(0x7f85f00fd110 msgr2=0x7f85f00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 -- 172.21.15.46:0/2004948461 shutdown_connections 2024-09-21T12:49:42.304 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 -- 172.21.15.46:0/2004948461 wait complete. 2024-09-21T12:49:42.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.302+0000 7f85f52a7640 1 Processor -- start 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85f52a7640 1 -- start start 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85f52a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 0x7f85f01974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85f52a7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f0102b60 0x7f85f0197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85f52a7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f85f010a7a0 con 0x7f85f0101960 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85f52a7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f85f010a620 con 0x7f85f0102b60 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 0x7f85f01974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 0x7f85f01974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56694/0 (socket says 172.21.15.46:56694) 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85eeffd640 1 -- 172.21.15.46:0/3273325955 learned_addr learned my addr 172.21.15.46:0/3273325955 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85ee7fc640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f0102b60 0x7f85f0197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85eeffd640 1 -- 172.21.15.46:0/3273325955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f0102b60 msgr2=0x7f85f0197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:42.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85eeffd640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f0102b60 0x7f85f0197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.303+0000 7f85eeffd640 1 -- 172.21.15.46:0/3273325955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f01980a0 con 0x7f85f0101960 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.304+0000 7f85eeffd640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 0x7f85f01974e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f85e000d8d0 tx=0x7f85e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.304+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e0017070 con 0x7f85f0101960 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.304+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f019cae0 con 0x7f85f0101960 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.304+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85e000be10 con 0x7f85f0101960 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.304+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f85e000f3c0 con 0x7f85f0101960 2024-09-21T12:49:42.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.304+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f019d070 con 0x7f85f0101960 2024-09-21T12:49:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.305+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f0101d60 con 0x7f85f0101960 2024-09-21T12:49:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.306+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f85e001a070 con 0x7f85f0101960 2024-09-21T12:49:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.306+0000 7f85d7fff640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:49:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.307+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f85e009dc40 con 0x7f85f0101960 2024-09-21T12:49:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.307+0000 7f85ee7fc640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:49:42.308 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.307+0000 7f85ee7fc640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f85d807af30 0x7f85d807d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f85e4006010 tx=0x7f85e4000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:49:42.312 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.311+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f85e0069240 con 0x7f85f0101960 2024-09-21T12:49:42.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.517+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f85f0062630 con 0x7f85d807af30 2024-09-21T12:49:42.519 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:42 smithi046 ceph-mon[27868]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:42.519 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:42 smithi046 ceph-mon[27868]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:42.519 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:42 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/3834390517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.518+0000 7f85d7fff640 1 -- 172.21.15.46:0/3273325955 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f85f0062630 con 0x7f85d807af30 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:49:42.520 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:49:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.520+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f85d807af30 msgr2=0x7f85d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.520+0000 7f85f52a7640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f85d807af30 0x7f85d807d3f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f85e4006010 tx=0x7f85e4000bc0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 msgr2=0x7f85f01974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:49:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 0x7f85f01974e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f85e000d8d0 tx=0x7f85e000dd90 comp rx=0 tx=0).stop 2024-09-21T12:49:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 shutdown_connections 2024-09-21T12:49:42.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f85d807af30 0x7f85d807d3f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85f0102b60 0x7f85f0197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 --2- 172.21.15.46:0/3273325955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85f0101960 0x7f85f01974e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:49:42.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 >> 172.21.15.46:0/3273325955 conn(0x7f85f00fd110 msgr2=0x7f85f0106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:49:42.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 shutdown_connections 2024-09-21T12:49:42.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:49:42.521+0000 7f85f52a7640 1 -- 172.21.15.46:0/3273325955 wait complete. 2024-09-21T12:49:42.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:42 smithi176 ceph-mon[35476]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:42.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:42 smithi176 ceph-mon[35476]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:42.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:42 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/3834390517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:43.690 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:43 smithi046 ceph-mon[27868]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:43.690 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:43 smithi046 ceph-mon[27868]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:43 smithi176 ceph-mon[35476]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:49:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:43 smithi176 ceph-mon[35476]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:44.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:44.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:49:45.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:45 smithi046 ceph-mon[27868]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:45 smithi176 ceph-mon[35476]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:47.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:47 smithi046 ceph-mon[27868]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:47.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:47 smithi176 ceph-mon[35476]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:50.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:50.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:49 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:49 smithi176 ceph-mon[35476]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:50.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:50.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.091 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:49 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:50.091 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:49 smithi046 ceph-mon[27868]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:51.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:51 smithi046 ceph-mon[27868]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:51 smithi176 ceph-mon[35476]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:53.580 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:53 smithi046 ceph-mon[27868]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:53 smithi176 ceph-mon[35476]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:55.274 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:55 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.274 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:55 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.274 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:55 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.275 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:55 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:55 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:55 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:55 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:55 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:56.310 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:56 smithi046 ceph-mon[27868]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:56.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:56 smithi176 ceph-mon[35476]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:49:57.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:57 smithi176 ceph-mon[35476]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:57.838 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:57 smithi046 ceph-mon[27868]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:49:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:49:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:58.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:58 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:49:59.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:58 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:59 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:59 smithi046 ceph-mon[27868]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:00.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:49:59 smithi046 ceph-mon[27868]: Upgrade: Updating grafana.smithi046 2024-09-21T12:50:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:59 smithi176 ceph-mon[35476]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:00.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:49:59 smithi176 ceph-mon[35476]: Upgrade: Updating grafana.smithi046 2024-09-21T12:50:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:00 smithi046 ceph-mon[27868]: Deploying daemon grafana.smithi046 on smithi046 2024-09-21T12:50:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:00 smithi046 ceph-mon[27868]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:50:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:00 smithi046 ceph-mon[27868]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:50:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:00 smithi046 ceph-mon[27868]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:50:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:00 smithi176 ceph-mon[35476]: Deploying daemon grafana.smithi046 on smithi046 2024-09-21T12:50:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:00 smithi176 ceph-mon[35476]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:50:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:00 smithi176 ceph-mon[35476]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:50:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:00 smithi176 ceph-mon[35476]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:50:02.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:01 smithi046 ceph-mon[27868]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:02.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:01 smithi176 ceph-mon[35476]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:03.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:03 smithi046 ceph-mon[27868]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:03 smithi176 ceph-mon[35476]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:05.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:05 smithi046 ceph-mon[27868]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:05 smithi176 ceph-mon[35476]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:07 smithi046 ceph-mon[27868]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:07.803 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:07 smithi176 ceph-mon[35476]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:09.814 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:09 smithi046 ceph-mon[27868]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:50:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:09 smithi176 ceph-mon[35476]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:50:11.724 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:11 smithi046 ceph-mon[27868]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:11 smithi176 ceph-mon[35476]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 -- 172.21.15.46:0/2176721419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78101a60 msgr2=0x7f6d78101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 --2- 172.21.15.46:0/2176721419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78101a60 0x7f6d78101ee0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6d68009880 tx=0x7f6d6802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 -- 172.21.15.46:0/2176721419 shutdown_connections 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 --2- 172.21.15.46:0/2176721419 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78101a60 0x7f6d78101ee0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 --2- 172.21.15.46:0/2176721419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d78100860 0x7f6d78100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 -- 172.21.15.46:0/2176721419 >> 172.21.15.46:0/2176721419 conn(0x7f6d780fc010 msgr2=0x7f6d780fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.608+0000 7f6d7faab640 1 -- 172.21.15.46:0/2176721419 shutdown_connections 2024-09-21T12:50:12.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 -- 172.21.15.46:0/2176721419 wait complete. 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 Processor -- start 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 -- start start 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 0x7f6d7806a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d78101a60 0x7f6d7819e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6d781096a0 con 0x7f6d78100860 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7faab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d78109520 con 0x7f6d78101a60 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7d847640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 0x7f6d7806a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7d847640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 0x7f6d7806a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59230/0 (socket says 172.21.15.46:59230) 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.609+0000 7f6d7d847640 1 -- 172.21.15.46:0/4006149977 learned_addr learned my addr 172.21.15.46:0/4006149977 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7d046640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d78101a60 0x7f6d7819e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7d847640 1 -- 172.21.15.46:0/4006149977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d78101a60 msgr2=0x7f6d7819e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7d847640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d78101a60 0x7f6d7819e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7d847640 1 -- 172.21.15.46:0/4006149977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d7819eb80 con 0x7f6d78100860 2024-09-21T12:50:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7d847640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 0x7f6d7806a790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c8f0 tx=0x7f6d7400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d74004020 con 0x7f6d78100860 2024-09-21T12:50:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d740041c0 con 0x7f6d78100860 2024-09-21T12:50:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d7819ed50 con 0x7f6d78100860 2024-09-21T12:50:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d740047a0 con 0x7f6d78100860 2024-09-21T12:50:12.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.610+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d7819f1f0 con 0x7f6d78100860 2024-09-21T12:50:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.612+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d78100c60 con 0x7f6d78100860 2024-09-21T12:50:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.612+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6d740079b0 con 0x7f6d78100860 2024-09-21T12:50:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.612+0000 7f6d6effd640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6407af30 0x7f6d6407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.613+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f6d7409dee0 con 0x7f6d78100860 2024-09-21T12:50:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.613+0000 7f6d7d046640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6407af30 0x7f6d6407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:12.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.613+0000 7f6d7d046640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6407af30 0x7f6d6407d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d68000c00 tx=0x7f6d680058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:12.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.617+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6d74014030 con 0x7f6d78100860 2024-09-21T12:50:12.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.825+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6d78062630 con 0x7f6d6407af30 2024-09-21T12:50:12.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.826+0000 7f6d6effd640 1 -- 172.21.15.46:0/4006149977 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f6d78062630 con 0x7f6d6407af30 2024-09-21T12:50:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6407af30 msgr2=0x7f6d6407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:12.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6407af30 0x7f6d6407d3f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6d68000c00 tx=0x7f6d680058d0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 msgr2=0x7f6d7806a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 0x7f6d7806a790 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400c8f0 tx=0x7f6d7400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 shutdown_connections 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6407af30 0x7f6d6407d3f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d78101a60 0x7f6d7819e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 --2- 172.21.15.46:0/4006149977 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d78100860 0x7f6d7806a790 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 >> 172.21.15.46:0/4006149977 conn(0x7f6d780fc010 msgr2=0x7f6d78104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 shutdown_connections 2024-09-21T12:50:12.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.829+0000 7f6d7faab640 1 -- 172.21.15.46:0/4006149977 wait complete. 2024-09-21T12:50:12.840 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:50:12.905 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:12 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:12.906 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:12 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:12.906 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:12 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 -- 172.21.15.46:0/50649501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 msgr2=0x7f1d64102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 --2- 172.21.15.46:0/50649501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d64102fe0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009880 tx=0x7f1d5802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 -- 172.21.15.46:0/50649501 shutdown_connections 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 --2- 172.21.15.46:0/50649501 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d64102fe0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 --2- 172.21.15.46:0/50649501 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 0x7f1d64101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 -- 172.21.15.46:0/50649501 >> 172.21.15.46:0/50649501 conn(0x7f1d640fd0f0 msgr2=0x7f1d640ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 -- 172.21.15.46:0/50649501 shutdown_connections 2024-09-21T12:50:12.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.916+0000 7f1d69176640 1 -- 172.21.15.46:0/50649501 wait complete. 2024-09-21T12:50:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d69176640 1 Processor -- start 2024-09-21T12:50:12.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d69176640 1 -- start start 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d69176640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 0x7f1d64075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d69176640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d640745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d69176640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6410a820 con 0x7f1d64102b60 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d69176640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1d6410a6a0 con 0x7f1d64101960 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d6259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d640745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d6259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d640745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59252/0 (socket says 172.21.15.46:59252) 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d6259c640 1 -- 172.21.15.46:0/4173952622 learned_addr learned my addr 172.21.15.46:0/4173952622 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:12.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.917+0000 7f1d62d9d640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 0x7f1d64075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d6259c640 1 -- 172.21.15.46:0/4173952622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 msgr2=0x7f1d64075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d6259c640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 0x7f1d64075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d6259c640 1 -- 172.21.15.46:0/4173952622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d64074b20 con 0x7f1d64102b60 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d62d9d640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 0x7f1d64075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d6259c640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d640745e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1d58006010 tx=0x7f1d580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d5803f070 con 0x7f1d64102b60 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d64074db0 con 0x7f1d64102b60 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d580044d0 con 0x7f1d64102b60 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d58035030 con 0x7f1d64102b60 2024-09-21T12:50:12.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.918+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d64075360 con 0x7f1d64102b60 2024-09-21T12:50:12.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.919+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d64101d40 con 0x7f1d64102b60 2024-09-21T12:50:12.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.920+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1d58042070 con 0x7f1d64102b60 2024-09-21T12:50:12.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.920+0000 7f1d4bfff640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1d4c07af30 0x7f1d4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:12.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.920+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1d580bedb0 con 0x7f1d64102b60 2024-09-21T12:50:12.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.920+0000 7f1d62d9d640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1d4c07af30 0x7f1d4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:12.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.921+0000 7f1d62d9d640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1d4c07af30 0x7f1d4c07d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d641029c0 tx=0x7f1d54008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:12.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:12.925+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1d5808a3b0 con 0x7f1d64102b60 2024-09-21T12:50:13.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:13.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:13.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:13.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.140+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1d64062630 con 0x7f1d4c07af30 2024-09-21T12:50:13.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.141+0000 7f1d4bfff640 1 -- 172.21.15.46:0/4173952622 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f1d64062630 con 0x7f1d4c07af30 2024-09-21T12:50:13.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1d4c07af30 msgr2=0x7f1d4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1d4c07af30 0x7f1d4c07d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1d641029c0 tx=0x7f1d54008040 comp rx=0 tx=0).stop 2024-09-21T12:50:13.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 msgr2=0x7f1d640745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d640745e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1d58006010 tx=0x7f1d580048f0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 shutdown_connections 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1d4c07af30 0x7f1d4c07d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1d64102b60 0x7f1d640745e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 --2- 172.21.15.46:0/4173952622 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1d64101960 0x7f1d64075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 >> 172.21.15.46:0/4173952622 conn(0x7f1d640fd0f0 msgr2=0x7f1d64106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 shutdown_connections 2024-09-21T12:50:13.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.144+0000 7f1d69176640 1 -- 172.21.15.46:0/4173952622 wait complete. 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 -- 172.21.15.46:0/2293833523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 msgr2=0x7f5630101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 --2- 172.21.15.46:0/2293833523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630101ee0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f561c009880 tx=0x7f561c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 -- 172.21.15.46:0/2293833523 shutdown_connections 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 --2- 172.21.15.46:0/2293833523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630101ee0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 --2- 172.21.15.46:0/2293833523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5630100860 0x7f5630100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 -- 172.21.15.46:0/2293833523 >> 172.21.15.46:0/2293833523 conn(0x7f56300fc010 msgr2=0x7f56300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:13.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 -- 172.21.15.46:0/2293833523 shutdown_connections 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.237+0000 7f5637064640 1 -- 172.21.15.46:0/2293833523 wait complete. 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5637064640 1 Processor -- start 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5637064640 1 -- start start 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5637064640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5630100860 0x7f5630104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5637064640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5637064640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5630109720 con 0x7f5630101a60 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5637064640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f56301095a0 con 0x7f5630100860 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f562ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f562ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59284/0 (socket says 172.21.15.46:59284) 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f562ffff640 1 -- 172.21.15.46:0/4120904961 learned_addr learned my addr 172.21.15.46:0/4120904961 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.238+0000 7f5634e00640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5630100860 0x7f5630104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562ffff640 1 -- 172.21.15.46:0/4120904961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5630100860 msgr2=0x7f5630104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562ffff640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5630100860 0x7f5630104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562ffff640 1 -- 172.21.15.46:0/4120904961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5630103380 con 0x7f5630101a60 2024-09-21T12:50:13.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562ffff640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630102e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f561c006010 tx=0x7f561c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f561c03f070 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5630103610 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5630103bc0 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f561c0044d0 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.239+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f561c049060 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.241+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56140052c0 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.241+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f561c042070 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.242+0000 7f562dffb640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f562007af30 0x7f562007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.242+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f561c0be9e0 con 0x7f5630101a60 2024-09-21T12:50:13.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.242+0000 7f5634e00640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f562007af30 0x7f562007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.242+0000 7f5634e00640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f562007af30 0x7f562007d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f56301018c0 tx=0x7f5624009110 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:13.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.246+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f561c089fe0 con 0x7f5630101a60 2024-09-21T12:50:13.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.440+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5614000bf0 con 0x7f562007af30 2024-09-21T12:50:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:50:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (25s) 19s ago 11m 17.6M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:50:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (3m) 19s ago 11m 8698k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:50:13.453 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (3m) 77s ago 10m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (11m) 19s ago 11m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (10m) 77s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 starting - - - - 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (5m) 19s ago 5m 93.1M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (5m) 19s ago 5m 151M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (5m) 77s ago 5m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (5m) 77s ago 5m 26.7M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (2m) 19s ago 12m 517M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (105s) 77s ago 10m 455M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 19s ago 12m 59.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (10m) 77s ago 10m 49.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (86s) 19s ago 11m 11.5M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:50:13.454 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (80s) 77s ago 10m 3380k - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 19s ago 9m 201M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 19s ago 8m 217M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 19s ago 8m 178M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (7m) 77s ago 7m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (7m) 77s ago 7m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (6m) 77s ago 6m 187M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:50:13.455 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (46s) 19s ago 10m 41.8M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.451+0000 7f562dffb640 1 -- 172.21.15.46:0/4120904961 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f5614000bf0 con 0x7f562007af30 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f562007af30 msgr2=0x7f562007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f562007af30 0x7f562007d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f56301018c0 tx=0x7f5624009110 comp rx=0 tx=0).stop 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 msgr2=0x7f5630102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630102e40 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f561c006010 tx=0x7f561c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 shutdown_connections 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f562007af30 0x7f562007d3f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5630101a60 0x7f5630102e40 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 --2- 172.21.15.46:0/4120904961 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5630100860 0x7f5630104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 >> 172.21.15.46:0/4120904961 conn(0x7f56300fc010 msgr2=0x7f5630069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 shutdown_connections 2024-09-21T12:50:13.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.454+0000 7f5637064640 1 -- 172.21.15.46:0/4120904961 wait complete. 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 -- 172.21.15.46:0/4264630055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 msgr2=0x7fb204101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 --2- 172.21.15.46:0/4264630055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204101f00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8009880 tx=0x7fb1f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 -- 172.21.15.46:0/4264630055 shutdown_connections 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 --2- 172.21.15.46:0/4264630055 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204101f00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 --2- 172.21.15.46:0/4264630055 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb204100880 0x7fb204100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 -- 172.21.15.46:0/4264630055 >> 172.21.15.46:0/4264630055 conn(0x7fb2040fc030 msgr2=0x7fb2040fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 -- 172.21.15.46:0/4264630055 shutdown_connections 2024-09-21T12:50:13.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.539+0000 7fb208eb2640 1 -- 172.21.15.46:0/4264630055 wait complete. 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.540+0000 7fb208eb2640 1 Processor -- start 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.540+0000 7fb208eb2640 1 -- start start 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb208eb2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb204100880 0x7fb2041047a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb208eb2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204102e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb208eb2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb2041096c0 con 0x7fb204101a80 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb208eb2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb204109540 con 0x7fb204100880 2024-09-21T12:50:13.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204102e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204102e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59308/0 (socket says 172.21.15.46:59308) 2024-09-21T12:50:13.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 -- 172.21.15.46:0/98911802 learned_addr learned my addr 172.21.15.46:0/98911802 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:13.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb20259c640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb204100880 0x7fb2041047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 -- 172.21.15.46:0/98911802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb204100880 msgr2=0x7fb2041047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb204100880 0x7fb2041047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 -- 172.21.15.46:0/98911802 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2041033a0 con 0x7fb204101a80 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.541+0000 7fb201d9b640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204102e60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8006010 tx=0x7fb1f8004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.542+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1f803f070 con 0x7fb204101a80 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.542+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb204103630 con 0x7fb204101a80 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.542+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1f80035f0 con 0x7fb204101a80 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.542+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb204103b60 con 0x7fb204101a80 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.542+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1f8035030 con 0x7fb204101a80 2024-09-21T12:50:13.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.543+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1e4005290 con 0x7fb204101a80 2024-09-21T12:50:13.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.544+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb1f8042070 con 0x7fb204101a80 2024-09-21T12:50:13.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.544+0000 7fb1f37fe640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb1ec07af80 0x7fb1ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.544+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fb1f80be8f0 con 0x7fb204101a80 2024-09-21T12:50:13.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.544+0000 7fb20259c640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb1ec07af80 0x7fb1ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.545+0000 7fb20259c640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb1ec07af80 0x7fb1ec07d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2041018e0 tx=0x7fb1f4005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:13.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.549+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb1f8089f70 con 0x7fb204101a80 2024-09-21T12:50:13.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.818+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb1e4005d90 con 0x7fb204101a80 2024-09-21T12:50:13.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:13 smithi046 ceph-mon[27868]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:13.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:13 smithi046 ceph-mon[27868]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:13.820 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:13 smithi046 ceph-mon[27868]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:13.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.818+0000 7fb1f37fe640 1 -- 172.21.15.46:0/98911802 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fb1f808ee20 con 0x7fb204101a80 2024-09-21T12:50:13.820 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:50:13.820 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:50:13.820 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:50:13.821 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:50:13.822 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb1ec07af80 msgr2=0x7fb1ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb1ec07af80 0x7fb1ec07d440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2041018e0 tx=0x7fb1f4005f90 comp rx=0 tx=0).stop 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 msgr2=0x7fb204102e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204102e60 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb1f8006010 tx=0x7fb1f8004570 comp rx=0 tx=0).stop 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 shutdown_connections 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb1ec07af80 0x7fb1ec07d440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb204101a80 0x7fb204102e60 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 --2- 172.21.15.46:0/98911802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb204100880 0x7fb2041047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 >> 172.21.15.46:0/98911802 conn(0x7fb2040fc030 msgr2=0x7fb20406a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 shutdown_connections 2024-09-21T12:50:13.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.821+0000 7fb208eb2640 1 -- 172.21.15.46:0/98911802 wait complete. 2024-09-21T12:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 -- 172.21.15.46:0/2537558104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c1023f0 msgr2=0x7fbe6c1047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 --2- 172.21.15.46:0/2537558104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c1023f0 0x7fbe6c1047e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0098b0 tx=0x7fbe5c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 -- 172.21.15.46:0/2537558104 shutdown_connections 2024-09-21T12:50:13.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 --2- 172.21.15.46:0/2537558104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe6c104d20 0x7fbe6c107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 --2- 172.21.15.46:0/2537558104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c1023f0 0x7fbe6c1047e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 -- 172.21.15.46:0/2537558104 >> 172.21.15.46:0/2537558104 conn(0x7fbe6c0fc010 msgr2=0x7fbe6c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 -- 172.21.15.46:0/2537558104 shutdown_connections 2024-09-21T12:50:13.909 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.907+0000 7fbe7091e640 1 -- 172.21.15.46:0/2537558104 wait complete. 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe7091e640 1 Processor -- start 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe7091e640 1 -- start start 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe7091e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe6c1023f0 0x7fbe6c101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe7091e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 0x7fbe6c1003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe7091e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c10a7c0 con 0x7fbe6c104d20 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe7091e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c10a640 con 0x7fbe6c1023f0 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe69d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 0x7fbe6c1003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe69d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 0x7fbe6c1003a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59314/0 (socket says 172.21.15.46:59314) 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe69d9b640 1 -- 172.21.15.46:0/3734723914 learned_addr learned my addr 172.21.15.46:0/3734723914 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe6a59c640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe6c1023f0 0x7fbe6c101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe69d9b640 1 -- 172.21.15.46:0/3734723914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe6c1023f0 msgr2=0x7fbe6c101ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe69d9b640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe6c1023f0 0x7fbe6c101ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.908+0000 7fbe69d9b640 1 -- 172.21.15.46:0/3734723914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c1008e0 con 0x7fbe6c104d20 2024-09-21T12:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.909+0000 7fbe69d9b640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 0x7fbe6c1003a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c8f0 tx=0x7fbe6000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.909+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe60014070 con 0x7fbe6c104d20 2024-09-21T12:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.909+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe60007c60 con 0x7fbe6c104d20 2024-09-21T12:50:13.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.909+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6c100bd0 con 0x7fbe6c104d20 2024-09-21T12:50:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.909+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe60003c30 con 0x7fbe6c104d20 2024-09-21T12:50:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.909+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6c101160 con 0x7fbe6c104d20 2024-09-21T12:50:13.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.910+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6c1027d0 con 0x7fbe6c104d20 2024-09-21T12:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.911+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbe60017070 con 0x7fbe6c104d20 2024-09-21T12:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.912+0000 7fbe5b7fe640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe5407af30 0x7fbe5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.912+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fbe6009ddc0 con 0x7fbe6c104d20 2024-09-21T12:50:13.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.912+0000 7fbe6a59c640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe5407af30 0x7fbe5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:13.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.913+0000 7fbe6a59c640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe5407af30 0x7fbe5407d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c006010 tx=0x7fbe5c0058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:13.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:13.917+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fbe60069320 con 0x7fbe6c104d20 2024-09-21T12:50:14.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:13 smithi176 ceph-mon[35476]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:14.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:13 smithi176 ceph-mon[35476]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:14.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:13 smithi176 ceph-mon[35476]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:14.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.135+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe6c19f540 con 0x7fbe5407af30 2024-09-21T12:50:14.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.136+0000 7fbe5b7fe640 1 -- 172.21.15.46:0/3734723914 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fbe6c19f540 con 0x7fbe5407af30 2024-09-21T12:50:14.137 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:50:14.138 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.138+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe5407af30 msgr2=0x7fbe5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.138+0000 7fbe7091e640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe5407af30 0x7fbe5407d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c006010 tx=0x7fbe5c0058d0 comp rx=0 tx=0).stop 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 msgr2=0x7fbe6c1003a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 0x7fbe6c1003a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbe6000c8f0 tx=0x7fbe6000cdb0 comp rx=0 tx=0).stop 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 shutdown_connections 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe5407af30 0x7fbe5407d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe6c104d20 0x7fbe6c1003a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:14.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 --2- 172.21.15.46:0/3734723914 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe6c1023f0 0x7fbe6c101ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:14.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 >> 172.21.15.46:0/3734723914 conn(0x7fbe6c0fc010 msgr2=0x7fbe6c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:14.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 shutdown_connections 2024-09-21T12:50:14.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:14.139+0000 7fbe7091e640 1 -- 172.21.15.46:0/3734723914 wait complete. 2024-09-21T12:50:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:14 smithi176 ceph-mon[35476]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:14 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/98911802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:14 smithi176 ceph-mon[35476]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:14 smithi046 ceph-mon[27868]: from='client.14882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:14 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/98911802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:14 smithi046 ceph-mon[27868]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:15.074 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:14 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:16.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:15 smithi176 ceph-mon[35476]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:16.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:15 smithi046 ceph-mon[27868]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:18.392 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:18 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:18 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:18 smithi046 ceph-mon[27868]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:18.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:18 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.393 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:18 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:18 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:18 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:18 smithi176 ceph-mon[35476]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:18.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:18 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:18.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:18 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:19.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:19 smithi046 ceph-mon[27868]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:50:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:19 smithi176 ceph-mon[35476]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:50:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: Upgrade: Finalizing container_image settings 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:50:22.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:50:22.415 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: Upgrade: Complete! 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.416 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:50:22.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:22.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:22.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:22.417 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:22 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:50:22.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: Upgrade: Finalizing container_image settings 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:50:22.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:50:22.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: Upgrade: Complete! 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:22.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:22 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:23 smithi176 ceph-mon[35476]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:23.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:23 smithi046 ceph-mon[27868]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:25 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:25 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:26.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:26 smithi046 ceph-mon[27868]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:50:26.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:26 smithi176 ceph-mon[35476]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:50:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:27 smithi176 ceph-mon[35476]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T12:50:27.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:27 smithi046 ceph-mon[27868]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T12:50:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:29 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:29 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:30 smithi046 ceph-mon[27868]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:50:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:30 smithi176 ceph-mon[35476]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:50:31.752 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:31 smithi046 ceph-mon[27868]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-21T12:50:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:31 smithi176 ceph-mon[35476]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-21T12:50:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:33 smithi176 ceph-mon[35476]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T12:50:33.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:33 smithi046 ceph-mon[27868]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T12:50:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:35 smithi176 ceph-mon[35476]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:50:35.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:35 smithi046 ceph-mon[27868]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:50:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:37 smithi176 ceph-mon[35476]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:37 smithi046 ceph-mon[27868]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:39 smithi176 ceph-mon[35476]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:39.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:39 smithi046 ceph-mon[27868]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:41 smithi046 ceph-mon[27868]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:41 smithi176 ceph-mon[35476]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:43 smithi176 ceph-mon[35476]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:43.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:43 smithi046 ceph-mon[27868]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:44.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 -- 172.21.15.46:0/859784976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c0104d20 msgr2=0x7f60c0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:44.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 --2- 172.21.15.46:0/859784976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c0104d20 0x7f60c0107110 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f60a80098b0 tx=0x7f60a802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 -- 172.21.15.46:0/859784976 shutdown_connections 2024-09-21T12:50:44.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 --2- 172.21.15.46:0/859784976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c0104d20 0x7f60c0107110 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 --2- 172.21.15.46:0/859784976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60c01023f0 0x7f60c01047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 -- 172.21.15.46:0/859784976 >> 172.21.15.46:0/859784976 conn(0x7f60c00fc010 msgr2=0x7f60c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:44.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 -- 172.21.15.46:0/859784976 shutdown_connections 2024-09-21T12:50:44.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.237+0000 7f60c49b2640 1 -- 172.21.15.46:0/859784976 wait complete. 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60c49b2640 1 Processor -- start 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60c49b2640 1 -- start start 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60c49b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 0x7f60c0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60c49b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60c0104d20 0x7f60c0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60c49b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f60c010a790 con 0x7f60c01023f0 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60c49b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f60c010a610 con 0x7f60c0104d20 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.238+0000 7f60be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 0x7f60c0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 0x7f60c0197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55200/0 (socket says 172.21.15.46:55200) 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60be59c640 1 -- 172.21.15.46:0/2642380710 learned_addr learned my addr 172.21.15.46:0/2642380710 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60bdd9b640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60c0104d20 0x7f60c0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:44.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60be59c640 1 -- 172.21.15.46:0/2642380710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60c0104d20 msgr2=0x7f60c0197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60be59c640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60c0104d20 0x7f60c0197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60be59c640 1 -- 172.21.15.46:0/2642380710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c01980d0 con 0x7f60c01023f0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60be59c640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 0x7f60c0197510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f60b000ea30 tx=0x7f60b000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60b000cbe0 con 0x7f60c01023f0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60b000cd80 con 0x7f60c01023f0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c019cb10 con 0x7f60c01023f0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60b001a920 con 0x7f60c01023f0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.239+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c019d070 con 0x7f60c01023f0 2024-09-21T12:50:44.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.240+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c010af70 con 0x7f60c01023f0 2024-09-21T12:50:44.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.241+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f60b001abd0 con 0x7f60c01023f0 2024-09-21T12:50:44.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.242+0000 7f60b77fe640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f60ac07af30 0x7f60ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:44.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.242+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f60b009e660 con 0x7f60c01023f0 2024-09-21T12:50:44.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.242+0000 7f60bdd9b640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f60ac07af30 0x7f60ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:44.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.242+0000 7f60bdd9b640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f60ac07af30 0x7f60ac07d3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009880 tx=0x7f60a80058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:44.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.246+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f60b0016030 con 0x7f60c01023f0 2024-09-21T12:50:44.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.467+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f60c0105780 con 0x7f60ac07af30 2024-09-21T12:50:44.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.468+0000 7f60b77fe640 1 -- 172.21.15.46:0/2642380710 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f60c0105780 con 0x7f60ac07af30 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f60ac07af30 msgr2=0x7f60ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f60ac07af30 0x7f60ac07d3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009880 tx=0x7f60a80058d0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 msgr2=0x7f60c0197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 0x7f60c0197510 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f60b000ea30 tx=0x7f60b000eef0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 shutdown_connections 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f60ac07af30 0x7f60ac07d3f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f60c0104d20 0x7f60c0197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 --2- 172.21.15.46:0/2642380710 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f60c01023f0 0x7f60c0197510 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 >> 172.21.15.46:0/2642380710 conn(0x7f60c00fc010 msgr2=0x7f60c00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:44.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 shutdown_connections 2024-09-21T12:50:44.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:44.470+0000 7f60c49b2640 1 -- 172.21.15.46:0/2642380710 wait complete. 2024-09-21T12:50:44.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:44 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:44.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:44 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:45.245 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T12:50:45.550 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:45.686 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:45 smithi046 ceph-mon[27868]: from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:45.686 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:45 smithi046 ceph-mon[27868]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:45 smithi176 ceph-mon[35476]: from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:45 smithi176 ceph-mon[35476]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:46.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 -- 172.21.15.46:0/970762086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 msgr2=0x7f6778101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 --2- 172.21.15.46:0/970762086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f6778101d60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6768009880 tx=0x7f676802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 -- 172.21.15.46:0/970762086 shutdown_connections 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 --2- 172.21.15.46:0/970762086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f6778101d60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 --2- 172.21.15.46:0/970762086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6778107900 0x7f6778107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 -- 172.21.15.46:0/970762086 >> 172.21.15.46:0/970762086 conn(0x7f67780fd600 msgr2=0x7f67780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 -- 172.21.15.46:0/970762086 shutdown_connections 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.061+0000 7f678072c640 1 -- 172.21.15.46:0/970762086 wait complete. 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f678072c640 1 Processor -- start 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f678072c640 1 -- start start 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f678072c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f677819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f678072c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6778107900 0x7f677819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:46.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f678072c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f677810edd0 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f678072c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f677810ec50 con 0x7f6778107900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677e4c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f677819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677e4c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f677819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55226/0 (socket says 172.21.15.46:55226) 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677e4c8640 1 -- 172.21.15.46:0/450815658 learned_addr learned my addr 172.21.15.46:0/450815658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677dcc7640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6778107900 0x7f677819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677e4c8640 1 -- 172.21.15.46:0/450815658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6778107900 msgr2=0x7f677819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677e4c8640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6778107900 0x7f677819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.062+0000 7f677e4c8640 1 -- 172.21.15.46:0/450815658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6778197800 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.063+0000 7f677e4c8640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f677819d680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f677400d6f0 tx=0x7f677400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.063+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6774017070 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.063+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6778197af0 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.063+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f677400de00 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.063+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6774004bb0 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.063+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6778198050 con 0x7f6778101900 2024-09-21T12:50:46.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.064+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6778103040 con 0x7f6778101900 2024-09-21T12:50:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.064+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6774004e60 con 0x7f6778101900 2024-09-21T12:50:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.065+0000 7f676f7fe640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f676407af30 0x7f676407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.065+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f677409dc50 con 0x7f6778101900 2024-09-21T12:50:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.065+0000 7f677dcc7640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f676407af30 0x7f676407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.065+0000 7f677dcc7640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f676407af30 0x7f676407d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6778198b50 tx=0x7f6768031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:46.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.070+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f6774069250 con 0x7f6778101900 2024-09-21T12:50:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.329+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6778109e70 con 0x7f6778101900 2024-09-21T12:50:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.330+0000 7f676f7fe640 1 -- 172.21.15.46:0/450815658 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f677406e100 con 0x7f6778101900 2024-09-21T12:50:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f676407af30 msgr2=0x7f676407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:46.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f676407af30 0x7f676407d3f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6778198b50 tx=0x7f6768031400 comp rx=0 tx=0).stop 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 msgr2=0x7f677819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f677819d680 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f677400d6f0 tx=0x7f677400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 shutdown_connections 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f676407af30 0x7f676407d3f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6778107900 0x7f677819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 --2- 172.21.15.46:0/450815658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6778101900 0x7f677819d680 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 >> 172.21.15.46:0/450815658 conn(0x7f67780fd600 msgr2=0x7f67780fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 shutdown_connections 2024-09-21T12:50:46.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:46.332+0000 7f678072c640 1 -- 172.21.15.46:0/450815658 wait complete. 2024-09-21T12:50:46.343 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:50:46.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:46 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/450815658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:46.723 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:46 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/450815658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:47.073 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-21T12:50:47.334 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:47.777 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:47 smithi046 ceph-mon[27868]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:47.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:47 smithi176 ceph-mon[35476]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 -- 172.21.15.46:0/2238694310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634101910 msgr2=0x7f7634101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 --2- 172.21.15.46:0/2238694310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634101910 0x7f7634101d70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f761c009880 tx=0x7f761c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 -- 172.21.15.46:0/2238694310 shutdown_connections 2024-09-21T12:50:47.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 --2- 172.21.15.46:0/2238694310 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634101910 0x7f7634101d70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 --2- 172.21.15.46:0/2238694310 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7634107910 0x7f7634107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 -- 172.21.15.46:0/2238694310 >> 172.21.15.46:0/2238694310 conn(0x7f76340fd630 msgr2=0x7f76340ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 -- 172.21.15.46:0/2238694310 shutdown_connections 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.858+0000 7f763885f640 1 -- 172.21.15.46:0/2238694310 wait complete. 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f763885f640 1 Processor -- start 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f763885f640 1 -- start start 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f763885f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7634101910 0x7f76340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f763885f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 0x7f7634074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f763885f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f763410ee40 con 0x7f7634107910 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f763885f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f763410ecc0 con 0x7f7634101910 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f7631d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 0x7f7634074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f7631d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 0x7f7634074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48370/0 (socket says 172.21.15.46:48370) 2024-09-21T12:50:47.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.859+0000 7f7631d9b640 1 -- 172.21.15.46:0/1772238989 learned_addr learned my addr 172.21.15.46:0/1772238989 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f763259c640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7634101910 0x7f76340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f7631d9b640 1 -- 172.21.15.46:0/1772238989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7634101910 msgr2=0x7f76340744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f7631d9b640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7634101910 0x7f76340744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f7631d9b640 1 -- 172.21.15.46:0/1772238989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7634074f70 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f7631d9b640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 0x7f7634074a30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f761c031460 tx=0x7f761c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f761c03f070 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f761c004cf0 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7634075200 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f761c035030 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.860+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76341a3df0 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.861+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7634103050 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.862+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f761c042070 con 0x7f7634107910 2024-09-21T12:50:47.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.862+0000 7f762b7fe640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f762007af30 0x7f762007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:47.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.862+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f761c0beb00 con 0x7f7634107910 2024-09-21T12:50:47.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.863+0000 7f763259c640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f762007af30 0x7f762007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:47.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.863+0000 7f763259c640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f762007af30 0x7f762007d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7624009890 tx=0x7f7624008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:47.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:47.867+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f761c08a100 con 0x7f7634107910 2024-09-21T12:50:48.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.139+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7634075a20 con 0x7f7634107910 2024-09-21T12:50:48.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.140+0000 7f762b7fe640 1 -- 172.21.15.46:0/1772238989 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f761c08efb0 con 0x7f7634107910 2024-09-21T12:50:48.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f762007af30 msgr2=0x7f762007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:48.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f762007af30 0x7f762007d3f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7624009890 tx=0x7f7624008040 comp rx=0 tx=0).stop 2024-09-21T12:50:48.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 msgr2=0x7f7634074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:48.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 0x7f7634074a30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f761c031460 tx=0x7f761c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:50:48.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 shutdown_connections 2024-09-21T12:50:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f762007af30 0x7f762007d3f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7634107910 0x7f7634074a30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 --2- 172.21.15.46:0/1772238989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7634101910 0x7f76340744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 >> 172.21.15.46:0/1772238989 conn(0x7f76340fd630 msgr2=0x7f76340fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 shutdown_connections 2024-09-21T12:50:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:48.142+0000 7f763885f640 1 -- 172.21.15.46:0/1772238989 wait complete. 2024-09-21T12:50:48.153 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)" 2024-09-21T12:50:48.719 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:48 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/1772238989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:48.751 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-21T12:50:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:48 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/1772238989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:49.014 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:49.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 -- 172.21.15.46:0/3495969448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581067f0 msgr2=0x7f8258106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:49.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 --2- 172.21.15.46:0/3495969448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581067f0 0x7f8258106bd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f8248009880 tx=0x7f824802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 -- 172.21.15.46:0/3495969448 shutdown_connections 2024-09-21T12:50:49.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 --2- 172.21.15.46:0/3495969448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82581007f0 0x7f8258100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 --2- 172.21.15.46:0/3495969448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581067f0 0x7f8258106bd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 -- 172.21.15.46:0/3495969448 >> 172.21.15.46:0/3495969448 conn(0x7f82580fc550 msgr2=0x7f82580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 -- 172.21.15.46:0/3495969448 shutdown_connections 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.444+0000 7f825cdc4640 1 -- 172.21.15.46:0/3495969448 wait complete. 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825cdc4640 1 Processor -- start 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825cdc4640 1 -- start start 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825cdc4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 0x7f825819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825cdc4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82581067f0 0x7f825819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825cdc4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f825810dcc0 con 0x7f82581007f0 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825cdc4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f825810db40 con 0x7f82581067f0 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 0x7f825819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:49.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 0x7f825819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48384/0 (socket says 172.21.15.46:48384) 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 -- 172.21.15.46:0/2351902365 learned_addr learned my addr 172.21.15.46:0/2351902365 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f8255d9b640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82581067f0 0x7f825819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 -- 172.21.15.46:0/2351902365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82581067f0 msgr2=0x7f825819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82581067f0 0x7f825819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 -- 172.21.15.46:0/2351902365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82581977b0 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.445+0000 7f825659c640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 0x7f825819d630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8248031460 tx=0x7f82480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.446+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f824803f070 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.446+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82480035f0 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.446+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8258197a40 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.446+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8248035030 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.446+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8258197f70 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.447+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8258101f30 con 0x7f82581007f0 2024-09-21T12:50:49.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.447+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8248042070 con 0x7f82581007f0 2024-09-21T12:50:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.448+0000 7f82477fe640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f824007af80 0x7f824007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.448+0000 7f8255d9b640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f824007af80 0x7f824007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.448+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f82480be910 con 0x7f82581007f0 2024-09-21T12:50:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.449+0000 7f8255d9b640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f824007af80 0x7f824007d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f824c005fd0 tx=0x7f824c005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:49.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.453+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8248089f90 con 0x7f82581007f0 2024-09-21T12:50:49.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.713+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8258109d70 con 0x7f82581007f0 2024-09-21T12:50:49.715 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:49 smithi046 ceph-mon[27868]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:49.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.713+0000 7f82477fe640 1 -- 172.21.15.46:0/2351902365 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f824808ee40 con 0x7f82581007f0 2024-09-21T12:50:49.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f824007af80 msgr2=0x7f824007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f824007af80 0x7f824007d440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f824c005fd0 tx=0x7f824c005850 comp rx=0 tx=0).stop 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 msgr2=0x7f825819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 0x7f825819d630 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8248031460 tx=0x7f82480045e0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 shutdown_connections 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f824007af80 0x7f824007d440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82581067f0 0x7f825819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 --2- 172.21.15.46:0/2351902365 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82581007f0 0x7f825819d630 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:49.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 >> 172.21.15.46:0/2351902365 conn(0x7f82580fc550 msgr2=0x7f8258069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:49.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.715+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 shutdown_connections 2024-09-21T12:50:49.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:49.716+0000 7f825cdc4640 1 -- 172.21.15.46:0/2351902365 wait complete. 2024-09-21T12:50:49.727 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:50:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:49 smithi176 ceph-mon[35476]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:50.428 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-21T12:50:50.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:50 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2351902365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:50.702 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:50.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:50 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2351902365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:50:51.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 -- 172.21.15.46:0/3977500125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 msgr2=0x7f1c4c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3977500125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c106bd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009880 tx=0x7f1c3c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 -- 172.21.15.46:0/3977500125 shutdown_connections 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3977500125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c1007f0 0x7f1c4c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3977500125 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c106bd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 -- 172.21.15.46:0/3977500125 >> 172.21.15.46:0/3977500125 conn(0x7f1c4c0fc550 msgr2=0x7f1c4c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 -- 172.21.15.46:0/3977500125 shutdown_connections 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.203+0000 7f1c5287f640 1 -- 172.21.15.46:0/3977500125 wait complete. 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c5287f640 1 Processor -- start 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c5287f640 1 -- start start 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c5287f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c1007f0 0x7f1c4c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c5287f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:51.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c5287f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c10dca0 con 0x7f1c4c1067f0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c5287f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c10db20 con 0x7f1c4c1007f0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48396/0 (socket says 172.21.15.46:48396) 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c4b7fe640 1 -- 172.21.15.46:0/3036855573 learned_addr learned my addr 172.21.15.46:0/3036855573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.204+0000 7f1c4bfff640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c1007f0 0x7f1c4c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c4b7fe640 1 -- 172.21.15.46:0/3036855573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c1007f0 msgr2=0x7f1c4c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c4b7fe640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c1007f0 0x7f1c4c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c4b7fe640 1 -- 172.21.15.46:0/3036855573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c197750 con 0x7f1c4c1067f0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c4b7fe640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c19dbc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c8a0 tx=0x7f1c4000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c400079b0 con 0x7f1c4c1067f0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c197a40 con 0x7f1c4c1067f0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c40007b50 con 0x7f1c4c1067f0 2024-09-21T12:50:51.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c40018700 con 0x7f1c4c1067f0 2024-09-21T12:50:51.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.205+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c197fd0 con 0x7f1c4c1067f0 2024-09-21T12:50:51.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.206+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c101f30 con 0x7f1c4c1067f0 2024-09-21T12:50:51.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.207+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1c400188a0 con 0x7f1c4c1067f0 2024-09-21T12:50:51.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.207+0000 7f1c497fa640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c3407af80 0x7f1c3407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:51.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.207+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1c4009e160 con 0x7f1c4c1067f0 2024-09-21T12:50:51.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.208+0000 7f1c4bfff640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c3407af80 0x7f1c3407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:51.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.208+0000 7f1c4bfff640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c3407af80 0x7f1c3407d440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c000c00 tx=0x7f1c3c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:51.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.212+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1c40014030 con 0x7f1c4c1067f0 2024-09-21T12:50:51.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:51.418+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "target": ["mon-mgr", ""]}) -- 0x7f1c4c1982e0 con 0x7f1c3407af80 2024-09-21T12:50:51.745 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:51 smithi046 ceph-mon[27868]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:51 smithi176 ceph-mon[35476]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:52.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:52 smithi176 ceph-mon[35476]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:52.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:52 smithi046 ceph-mon[27868]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:53.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.287+0000 7f1c497fa640 1 -- 172.21.15.46:0/3036855573 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f1c4c1982e0 con 0x7f1c3407af80 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c3407af80 msgr2=0x7f1c3407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c3407af80 0x7f1c3407d440 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c000c00 tx=0x7f1c3c031400 comp rx=0 tx=0).stop 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 msgr2=0x7f1c4c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c19dbc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c8a0 tx=0x7f1c4000cd60 comp rx=0 tx=0).stop 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 shutdown_connections 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c3407af80 0x7f1c3407d440 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:53.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c4c1067f0 0x7f1c4c19dbc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 --2- 172.21.15.46:0/3036855573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c4c1007f0 0x7f1c4c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 >> 172.21.15.46:0/3036855573 conn(0x7f1c4c0fc550 msgr2=0x7f1c4c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 shutdown_connections 2024-09-21T12:50:53.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:53.290+0000 7f1c5287f640 1 -- 172.21.15.46:0/3036855573 wait complete. 2024-09-21T12:50:53.302 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:50:53.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:53 smithi046 ceph-mon[27868]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:53 smithi176 ceph-mon[35476]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:53.946 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch ps' 2024-09-21T12:50:54.212 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:54.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 -- 172.21.15.46:0/3435350272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0101900 msgr2=0x7f34c0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 --2- 172.21.15.46:0/3435350272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0101900 0x7f34c0101d60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f34b4009880 tx=0x7f34b402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 -- 172.21.15.46:0/3435350272 shutdown_connections 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 --2- 172.21.15.46:0/3435350272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0101900 0x7f34c0101d60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 --2- 172.21.15.46:0/3435350272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34c0107900 0x7f34c0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 -- 172.21.15.46:0/3435350272 >> 172.21.15.46:0/3435350272 conn(0x7f34c00fd600 msgr2=0x7f34c00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 -- 172.21.15.46:0/3435350272 shutdown_connections 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.720+0000 7f34c7571640 1 -- 172.21.15.46:0/3435350272 wait complete. 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c7571640 1 Processor -- start 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c7571640 1 -- start start 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c7571640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34c0101900 0x7f34c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:54.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c7571640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 0x7f34c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c7571640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f34c010edb0 con 0x7f34c0107900 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c7571640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f34c010ec30 con 0x7f34c0101900 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c4b0c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 0x7f34c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c4b0c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 0x7f34c0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48408/0 (socket says 172.21.15.46:48408) 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c4b0c640 1 -- 172.21.15.46:0/80895451 learned_addr learned my addr 172.21.15.46:0/80895451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.721+0000 7f34c530d640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34c0101900 0x7f34c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34c4b0c640 1 -- 172.21.15.46:0/80895451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34c0101900 msgr2=0x7f34c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34c4b0c640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34c0101900 0x7f34c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34c4b0c640 1 -- 172.21.15.46:0/80895451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c0074f70 con 0x7f34c0107900 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34c4b0c640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 0x7f34c0074a30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f34b4031460 tx=0x7f34b40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34b403f070 con 0x7f34c0107900 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f34b4004cf0 con 0x7f34c0107900 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f34b4035030 con 0x7f34c0107900 2024-09-21T12:50:54.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c0075200 con 0x7f34c0107900 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.722+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c01a3d70 con 0x7f34c0107900 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.723+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c0103040 con 0x7f34c0107900 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.724+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f34b4042070 con 0x7f34c0107900 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.724+0000 7f34b27fc640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f34ac07af30 0x7f34ac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.724+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f34b40be9e0 con 0x7f34c0107900 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.724+0000 7f34c530d640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f34ac07af30 0x7f34ac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.725+0000 7f34c530d640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f34ac07af30 0x7f34ac07d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00abe0 tx=0x7f34bc00a2d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:54.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.729+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f34b4089fe0 con 0x7f34c0107900 2024-09-21T12:50:54.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.923+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f34c0062630 con 0x7f34ac07af30 2024-09-21T12:50:54.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.933+0000 7f34b27fc640 1 -- 172.21.15.46:0/80895451 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f34c0062630 con 0x7f34ac07af30 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (66s) 37s ago 11m 18.7M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (4m) 37s ago 12m 8732k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (4m) 118s ago 11m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 37s ago 12m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (11m) 118s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (43s) 37s ago 11m 46.2M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (6m) 37s ago 6m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (6m) 37s ago 6m 152M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (6m) 118s ago 6m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (6m) 118s ago 6m 26.7M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (3m) 37s ago 13m 525M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (2m) 118s ago 11m 455M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:50:54.936 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 37s ago 13m 59.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (11m) 118s ago 11m 49.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 37s ago 12m 11.7M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (2m) 118s ago 11m 3380k - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 37s ago 9m 200M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 37s ago 9m 217M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 37s ago 8m 178M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (8m) 118s ago 8m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (8m) 118s ago 8m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (7m) 118s ago 7m 187M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:50:54.937 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (88s) 37s ago 11m 43.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:50:54.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f34ac07af30 msgr2=0x7f34ac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:54.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f34ac07af30 0x7f34ac07d3f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00abe0 tx=0x7f34bc00a2d0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 msgr2=0x7f34c0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:54.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 0x7f34c0074a30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f34b4031460 tx=0x7f34b40048f0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 shutdown_connections 2024-09-21T12:50:54.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f34ac07af30 0x7f34ac07d3f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f34c0107900 0x7f34c0074a30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 --2- 172.21.15.46:0/80895451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f34c0101900 0x7f34c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:54.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 >> 172.21.15.46:0/80895451 conn(0x7f34c00fd600 msgr2=0x7f34c00fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:54.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 shutdown_connections 2024-09-21T12:50:54.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:54.935+0000 7f34c7571640 1 -- 172.21.15.46:0/80895451 wait complete. 2024-09-21T12:50:55.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:55 smithi046 ceph-mon[27868]: from='client.14914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:55.569 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:55 smithi046 ceph-mon[27868]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:55.600 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:50:55.600 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:50:55.648 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-21T12:50:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:55 smithi176 ceph-mon[35476]: from='client.14914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:50:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:55 smithi176 ceph-mon[35476]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:50:55.910 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 -- 172.21.15.46:0/3938648690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 msgr2=0x7fc0f4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/3938648690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f4107ce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009880 tx=0x7fc0e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 -- 172.21.15.46:0/3938648690 shutdown_connections 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/3938648690 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4101900 0x7fc0f4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/3938648690 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f4107ce0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 -- 172.21.15.46:0/3938648690 >> 172.21.15.46:0/3938648690 conn(0x7fc0f40fd600 msgr2=0x7fc0f40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 -- 172.21.15.46:0/3938648690 shutdown_connections 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.381+0000 7fc0f9f60640 1 -- 172.21.15.46:0/3938648690 wait complete. 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f9f60640 1 Processor -- start 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f9f60640 1 -- start start 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f9f60640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4101900 0x7fc0f419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:56.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f9f60640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f9f60640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f410ee30 con 0x7fc0f4107900 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f9f60640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc0f410ecb0 con 0x7fc0f4101900 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48426/0 (socket says 172.21.15.46:48426) 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f2ffd640 1 -- 172.21.15.46:0/330024391 learned_addr learned my addr 172.21.15.46:0/330024391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.382+0000 7fc0f37fe640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4101900 0x7fc0f419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f2ffd640 1 -- 172.21.15.46:0/330024391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4101900 msgr2=0x7fc0f419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f2ffd640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4101900 0x7fc0f419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f2ffd640 1 -- 172.21.15.46:0/330024391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0f4197860 con 0x7fc0f4107900 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f2ffd640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f419dbe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800b420 tx=0x7fc0e800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc0e8011630 con 0x7fc0f4107900 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0e8016070 con 0x7fc0f4107900 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0f4197b50 con 0x7fc0f4107900 2024-09-21T12:50:56.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc0e8010d40 con 0x7fc0f4107900 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.383+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0f41980e0 con 0x7fc0f4107900 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.384+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0f4103040 con 0x7fc0f4107900 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.385+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc0e801b460 con 0x7fc0f4107900 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.386+0000 7fc0f0ff9640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0dc07af30 0x7fc0dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.386+0000 7fc0f37fe640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0dc07af30 0x7fc0dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.386+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fc0e809d760 con 0x7fc0f4107900 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.386+0000 7fc0f37fe640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0dc07af30 0x7fc0dc07d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4000c00 tx=0x7fc0e4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:56.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.390+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc0e8068cc0 con 0x7fc0f4107900 2024-09-21T12:50:56.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.579+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7fc0f4198d90 con 0x7fc0f4107900 2024-09-21T12:50:56.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.582+0000 7fc0f0ff9640 1 -- 172.21.15.46:0/330024391 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v61)=0 v61) ==== 125+0+0 (secure 0 0 0) 0x7fc0e806db70 con 0x7fc0f4107900 2024-09-21T12:50:56.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0dc07af30 msgr2=0x7fc0dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:56.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0dc07af30 0x7fc0dc07d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4000c00 tx=0x7fc0e4031400 comp rx=0 tx=0).stop 2024-09-21T12:50:56.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 msgr2=0x7fc0f419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f419dbe0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800b420 tx=0x7fc0e800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 shutdown_connections 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0dc07af30 0x7fc0dc07d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0f4107900 0x7fc0f419dbe0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 --2- 172.21.15.46:0/330024391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc0f4101900 0x7fc0f419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 >> 172.21.15.46:0/330024391 conn(0x7fc0f40fd600 msgr2=0x7fc0f40fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 shutdown_connections 2024-09-21T12:50:56.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:56.585+0000 7fc0f9f60640 1 -- 172.21.15.46:0/330024391 wait complete. 2024-09-21T12:50:57.238 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:50:57.238 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:50:57.239 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T12:50:57.498 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:57.888 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/330024391' entity='client.admin' 2024-09-21T12:50:57.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:57.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:57.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:57.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:57.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:50:57.889 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:50:57.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:57 smithi046 ceph-mon[27868]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 -- 172.21.15.46:0/556648539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c102ac0 msgr2=0x7fe80c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 --2- 172.21.15.46:0/556648539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c102ac0 0x7fe80c102ea0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc009880 tx=0x7fe7fc02a530 comp rx=0 tx=0).stop 2024-09-21T12:50:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 -- 172.21.15.46:0/556648539 shutdown_connections 2024-09-21T12:50:57.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 --2- 172.21.15.46:0/556648539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c1033e0 0x7fe80c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 --2- 172.21.15.46:0/556648539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c102ac0 0x7fe80c102ea0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 -- 172.21.15.46:0/556648539 >> 172.21.15.46:0/556648539 conn(0x7fe80c0fc520 msgr2=0x7fe80c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 -- 172.21.15.46:0/556648539 shutdown_connections 2024-09-21T12:50:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.974+0000 7fe811d75640 1 -- 172.21.15.46:0/556648539 wait complete. 2024-09-21T12:50:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe811d75640 1 Processor -- start 2024-09-21T12:50:57.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe811d75640 1 -- start start 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe811d75640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c102ac0 0x7fe80c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe811d75640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 0x7fe80c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe811d75640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c10ee50 con 0x7fe80c1033e0 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe811d75640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c10ecd0 con 0x7fe80c102ac0 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.975+0000 7fe80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 0x7fe80c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 0x7fe80c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42338/0 (socket says 172.21.15.46:42338) 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80affd640 1 -- 172.21.15.46:0/3946259617 learned_addr learned my addr 172.21.15.46:0/3946259617 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80b7fe640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c102ac0 0x7fe80c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:57.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80affd640 1 -- 172.21.15.46:0/3946259617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c102ac0 msgr2=0x7fe80c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80affd640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c102ac0 0x7fe80c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80affd640 1 -- 172.21.15.46:0/3946259617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c197860 con 0x7fe80c1033e0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80b7fe640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c102ac0 0x7fe80c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe80affd640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 0x7fe80c19dbe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe80000b370 tx=0x7fe80000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe800015020 con 0x7fe80c1033e0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe800011af0 con 0x7fe80c1033e0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c197b50 con 0x7fe80c1033e0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe800010d60 con 0x7fe80c1033e0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.976+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c1980e0 con 0x7fe80c1033e0 2024-09-21T12:50:57.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.978+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c06aa90 con 0x7fe80c1033e0 2024-09-21T12:50:57.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.978+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe800018020 con 0x7fe80c1033e0 2024-09-21T12:50:57.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.979+0000 7fe808ff9640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7f407af30 0x7fe7f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:57.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.979+0000 7fe80b7fe640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7f407af30 0x7fe7f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:57.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.979+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fe80009d940 con 0x7fe80c1033e0 2024-09-21T12:50:57.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.979+0000 7fe80b7fe640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7f407af30 0x7fe7f407d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000c00 tx=0x7fe7fc031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:57.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:57.984+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe80001f020 con 0x7fe80c1033e0 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/330024391' entity='client.admin' 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:50:58.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:57 smithi176 ceph-mon[35476]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:50:58.172 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.170+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7fe80c198d90 con 0x7fe80c1033e0 2024-09-21T12:50:58.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.170+0000 7fe808ff9640 1 -- 172.21.15.46:0/3946259617 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v61)=0 v61) ==== 155+0+0 (secure 0 0 0) 0x7fe800068f40 con 0x7fe80c1033e0 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7f407af30 msgr2=0x7fe7f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7f407af30 0x7fe7f407d3f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc000c00 tx=0x7fe7fc031420 comp rx=0 tx=0).stop 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 msgr2=0x7fe80c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 0x7fe80c19dbe0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe80000b370 tx=0x7fe80000b830 comp rx=0 tx=0).stop 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 shutdown_connections 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe7f407af30 0x7fe7f407d3f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe80c1033e0 0x7fe80c19dbe0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 --2- 172.21.15.46:0/3946259617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe80c102ac0 0x7fe80c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 >> 172.21.15.46:0/3946259617 conn(0x7fe80c0fc520 msgr2=0x7fe80c108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:58.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 shutdown_connections 2024-09-21T12:50:58.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:58.172+0000 7fe811d75640 1 -- 172.21.15.46:0/3946259617 wait complete. 2024-09-21T12:50:58.823 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T12:50:59.084 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:50:59.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:50:59 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:50:59 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:50:59.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 -- 172.21.15.46:0/508947014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4103440 msgr2=0x7fd9a410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/508947014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4103440 0x7fd9a410b930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0098b0 tx=0x7fd98c02a560 comp rx=0 tx=0).stop 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 -- 172.21.15.46:0/508947014 shutdown_connections 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/508947014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4103440 0x7fd9a410b930 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/508947014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9a4102b20 0x7fd9a4102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 -- 172.21.15.46:0/508947014 >> 172.21.15.46:0/508947014 conn(0x7fd9a40fc520 msgr2=0x7fd9a40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 -- 172.21.15.46:0/508947014 shutdown_connections 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.597+0000 7fd9a96ce640 1 -- 172.21.15.46:0/508947014 wait complete. 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a96ce640 1 Processor -- start 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a96ce640 1 -- start start 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a96ce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 0x7fd9a419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a96ce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9a4103440 0x7fd9a419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:59.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a96ce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a410edd0 con 0x7fd9a4102b20 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a96ce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9a410ec50 con 0x7fd9a4103440 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 0x7fd9a419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 0x7fd9a419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42360/0 (socket says 172.21.15.46:42360) 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a2ffd640 1 -- 172.21.15.46:0/1536832662 learned_addr learned my addr 172.21.15.46:0/1536832662 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd99bfff640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9a4103440 0x7fd9a419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a2ffd640 1 -- 172.21.15.46:0/1536832662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9a4103440 msgr2=0x7fd9a419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a2ffd640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9a4103440 0x7fd9a419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.598+0000 7fd9a2ffd640 1 -- 172.21.15.46:0/1536832662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9a4197840 con 0x7fd9a4102b20 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.599+0000 7fd9a2ffd640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 0x7fd9a419d6c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd99400c810 tx=0x7fd99400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.599+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd994004020 con 0x7fd9a4102b20 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.599+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9940041c0 con 0x7fd9a4102b20 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.599+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9a4197b30 con 0x7fd9a4102b20 2024-09-21T12:50:59.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.599+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9940047a0 con 0x7fd9a4102b20 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.599+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9a41980c0 con 0x7fd9a4102b20 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.600+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9a406aa30 con 0x7fd9a4102b20 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.601+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd9940079b0 con 0x7fd9a4102b20 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.601+0000 7fd9a0ff9640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd99007af30 0x7fd99007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.601+0000 7fd99bfff640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd99007af30 0x7fd99007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.601+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fd99409df00 con 0x7fd9a4102b20 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.602+0000 7fd99bfff640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd99007af30 0x7fd99007d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd98c000c00 tx=0x7fd98c031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:50:59.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.606+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd994014030 con 0x7fd9a4102b20 2024-09-21T12:50:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.791+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fd9a4106020 con 0x7fd9a4102b20 2024-09-21T12:50:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.791+0000 7fd9a0ff9640 1 -- 172.21.15.46:0/1536832662 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v61)=0 v61) ==== 163+0+0 (secure 0 0 0) 0x7fd994069500 con 0x7fd9a4102b20 2024-09-21T12:50:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd99007af30 msgr2=0x7fd99007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd99007af30 0x7fd99007d3f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd98c000c00 tx=0x7fd98c031420 comp rx=0 tx=0).stop 2024-09-21T12:50:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 msgr2=0x7fd9a419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:50:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 0x7fd9a419d6c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd99400c810 tx=0x7fd99400ccd0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 shutdown_connections 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd99007af30 0x7fd99007d3f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9a4103440 0x7fd9a419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 --2- 172.21.15.46:0/1536832662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9a4102b20 0x7fd9a419d6c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 >> 172.21.15.46:0/1536832662 conn(0x7fd9a40fc520 msgr2=0x7fd9a4103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 shutdown_connections 2024-09-21T12:50:59.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:50:59.794+0000 7fd9a96ce640 1 -- 172.21.15.46:0/1536832662 wait complete. 2024-09-21T12:51:00.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:00 smithi046 ceph-mon[27868]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:00.387 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T12:51:00.648 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:51:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:00 smithi176 ceph-mon[35476]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:01.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.149+0000 7f59e3590640 1 -- 172.21.15.46:0/4100718934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 msgr2=0x7f59dc106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.149+0000 7f59e3590640 1 --2- 172.21.15.46:0/4100718934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc106be0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009880 tx=0x7f59d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.149+0000 7f59e3590640 1 -- 172.21.15.46:0/4100718934 shutdown_connections 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.149+0000 7f59e3590640 1 --2- 172.21.15.46:0/4100718934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc100800 0x7f59dc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.149+0000 7f59e3590640 1 --2- 172.21.15.46:0/4100718934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc106be0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.149+0000 7f59e3590640 1 -- 172.21.15.46:0/4100718934 >> 172.21.15.46:0/4100718934 conn(0x7f59dc0fc520 msgr2=0x7f59dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 -- 172.21.15.46:0/4100718934 shutdown_connections 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 -- 172.21.15.46:0/4100718934 wait complete. 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 Processor -- start 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 -- start start 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc100800 0x7f59dc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:01.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc10dcd0 con 0x7f59dc106800 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e3590640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc10db50 con 0x7f59dc100800 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.150+0000 7f59e0b2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e0b2b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42380/0 (socket says 172.21.15.46:42380) 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e0b2b640 1 -- 172.21.15.46:0/2339741921 learned_addr learned my addr 172.21.15.46:0/2339741921 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e132c640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc100800 0x7f59dc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e0b2b640 1 -- 172.21.15.46:0/2339741921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc100800 msgr2=0x7f59dc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e0b2b640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc100800 0x7f59dc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e0b2b640 1 -- 172.21.15.46:0/2339741921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc1977d0 con 0x7f59dc106800 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e0b2b640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc19db90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c8f0 tx=0x7f59cc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59cc0079b0 con 0x7f59dc106800 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59cc0054e0 con 0x7f59dc106800 2024-09-21T12:51:01.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59cc004dd0 con 0x7f59dc106800 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc197ac0 con 0x7f59dc106800 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.151+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc198050 con 0x7f59dc106800 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.152+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc101f40 con 0x7f59dc106800 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.153+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f59cc005020 con 0x7f59dc106800 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.153+0000 7f59d27fc640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f59c807af30 0x7f59c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.154+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f59cc09df40 con 0x7f59dc106800 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.154+0000 7f59e132c640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f59c807af30 0x7f59c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.154+0000 7f59e132c640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f59c807af30 0x7f59c807d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59d8031460 tx=0x7f59d8005bd0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:01.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.158+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f59cc014030 con 0x7f59dc106800 2024-09-21T12:51:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.343+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f59dc198360 con 0x7f59dc106800 2024-09-21T12:51:01.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.344+0000 7f59d27fc640 1 -- 172.21.15.46:0/2339741921 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v61)=0 v61) ==== 135+0+0 (secure 0 0 0) 0x7f59cc069520 con 0x7f59dc106800 2024-09-21T12:51:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f59c807af30 msgr2=0x7f59c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f59c807af30 0x7f59c807d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f59d8031460 tx=0x7f59d8005bd0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 msgr2=0x7f59dc19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:01.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc19db90 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f59cc00c8f0 tx=0x7f59cc00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 shutdown_connections 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f59c807af30 0x7f59c807d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f59dc106800 0x7f59dc19db90 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 --2- 172.21.15.46:0/2339741921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59dc100800 0x7f59dc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 >> 172.21.15.46:0/2339741921 conn(0x7f59dc0fc520 msgr2=0x7f59dc1045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 shutdown_connections 2024-09-21T12:51:01.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:01.346+0000 7f59e3590640 1 -- 172.21.15.46:0/2339741921 wait complete. 2024-09-21T12:51:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:01 smithi046 ceph-mon[27868]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:01 smithi176 ceph-mon[35476]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:01.992 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T12:51:02.252 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:51:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.768+0000 7f06b472d640 1 -- 172.21.15.46:0/1406941732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac1006b0 msgr2=0x7f06ac100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.768+0000 7f06b472d640 1 --2- 172.21.15.46:0/1406941732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac1006b0 0x7f06ac100a90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f069c009c20 tx=0x7f069c02a960 comp rx=0 tx=0).stop 2024-09-21T12:51:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 -- 172.21.15.46:0/1406941732 shutdown_connections 2024-09-21T12:51:02.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 --2- 172.21.15.46:0/1406941732 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ac101060 0x7f06ac10dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 --2- 172.21.15.46:0/1406941732 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac1006b0 0x7f06ac100a90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 -- 172.21.15.46:0/1406941732 >> 172.21.15.46:0/1406941732 conn(0x7f06ac0fc520 msgr2=0x7f06ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 -- 172.21.15.46:0/1406941732 shutdown_connections 2024-09-21T12:51:02.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 -- 172.21.15.46:0/1406941732 wait complete. 2024-09-21T12:51:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.769+0000 7f06b472d640 1 Processor -- start 2024-09-21T12:51:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b472d640 1 -- start start 2024-09-21T12:51:02.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b472d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ac1006b0 0x7f06ac19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b472d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 0x7f06ac19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b472d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac110fa0 con 0x7f06ac101060 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b472d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06ac110e20 con 0x7f06ac1006b0 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b1cc8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 0x7f06ac19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b1cc8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 0x7f06ac19fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42392/0 (socket says 172.21.15.46:42392) 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b1cc8640 1 -- 172.21.15.46:0/3019017439 learned_addr learned my addr 172.21.15.46:0/3019017439 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b24c9640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ac1006b0 0x7f06ac19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b1cc8640 1 -- 172.21.15.46:0/3019017439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ac1006b0 msgr2=0x7f06ac19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b1cc8640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ac1006b0 0x7f06ac19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.770+0000 7f06b1cc8640 1 -- 172.21.15.46:0/3019017439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ac199a10 con 0x7f06ac101060 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.771+0000 7f06b1cc8640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 0x7f06ac19fd90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b420 tx=0x7f06a000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:02.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.771+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06a0011630 con 0x7f06ac101060 2024-09-21T12:51:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.771+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06a0016070 con 0x7f06ac101060 2024-09-21T12:51:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.771+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ac199d00 con 0x7f06ac101060 2024-09-21T12:51:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.771+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06a0010d40 con 0x7f06ac101060 2024-09-21T12:51:02.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.771+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ac19a290 con 0x7f06ac101060 2024-09-21T12:51:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.772+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ac06aa30 con 0x7f06ac101060 2024-09-21T12:51:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.772+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06a001b460 con 0x7f06ac101060 2024-09-21T12:51:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.773+0000 7f06ab7fe640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f069407af80 0x7f069407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.773+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f06a009d6f0 con 0x7f06ac101060 2024-09-21T12:51:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.773+0000 7f06b24c9640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f069407af80 0x7f069407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:02.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.774+0000 7f06b24c9640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f069407af80 0x7f069407d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f069c009430 tx=0x7f069c0093c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:02.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.778+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f06a0021250 con 0x7f06ac101060 2024-09-21T12:51:02.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.986+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "target": ["mon-mgr", ""]}) -- 0x7f06ac19af40 con 0x7f069407af80 2024-09-21T12:51:02.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.991+0000 7f06ab7fe640 1 -- 172.21.15.46:0/3019017439 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f06ac19af40 con 0x7f069407af80 2024-09-21T12:51:02.993 INFO:teuthology.orchestra.run.smithi046.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f069407af80 msgr2=0x7f069407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f069407af80 0x7f069407d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f069c009430 tx=0x7f069c0093c0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 msgr2=0x7f06ac19fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 0x7f06ac19fd90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f06a000b420 tx=0x7f06a000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 shutdown_connections 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f069407af80 0x7f069407d440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06ac101060 0x7f06ac19fd90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 --2- 172.21.15.46:0/3019017439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06ac1006b0 0x7f06ac19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:02.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 >> 172.21.15.46:0/3019017439 conn(0x7f06ac0fc520 msgr2=0x7f06ac0fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:02.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 shutdown_connections 2024-09-21T12:51:02.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:02.993+0000 7f06b472d640 1 -- 172.21.15.46:0/3019017439 wait complete. 2024-09-21T12:51:03.701 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:51:03.701 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T12:51:03.702 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-21T12:51:03.968 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T12:51:04.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:51:04.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:03 smithi176 ceph-mon[35476]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:04.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:04.332 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:441784946648ff53dd310293f9dd752afeeea72a 2024-09-21T12:51:04.333 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:03 smithi046 ceph-mon[27868]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.546+0000 7f20cea3b640 1 -- 172.21.15.46:0/4199485272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 msgr2=0x7f20c8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.546+0000 7f20cea3b640 1 --2- 172.21.15.46:0/4199485272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c8102e90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009880 tx=0x7f20b802a530 comp rx=0 tx=0).stop 2024-09-21T12:51:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.546+0000 7f20cea3b640 1 -- 172.21.15.46:0/4199485272 shutdown_connections 2024-09-21T12:51:04.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.546+0000 7f20cea3b640 1 --2- 172.21.15.46:0/4199485272 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20c81033d0 0x7f20c810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.546+0000 7f20cea3b640 1 --2- 172.21.15.46:0/4199485272 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c8102e90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.546+0000 7f20cea3b640 1 -- 172.21.15.46:0/4199485272 >> 172.21.15.46:0/4199485272 conn(0x7f20c80fc550 msgr2=0x7f20c80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.547+0000 7f20cea3b640 1 -- 172.21.15.46:0/4199485272 shutdown_connections 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.547+0000 7f20cea3b640 1 -- 172.21.15.46:0/4199485272 wait complete. 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.547+0000 7f20cea3b640 1 Processor -- start 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.547+0000 7f20cea3b640 1 -- start start 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20cea3b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20cea3b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20c81033d0 0x7f20c819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20cea3b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f20c810ee40 con 0x7f20c8102ab0 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20cea3b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f20c810ecc0 con 0x7f20c81033d0 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42410/0 (socket says 172.21.15.46:42410) 2024-09-21T12:51:04.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 -- 172.21.15.46:0/3679969852 learned_addr learned my addr 172.21.15.46:0/3679969852 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c77fe640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20c81033d0 0x7f20c819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 -- 172.21.15.46:0/3679969852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20c81033d0 msgr2=0x7f20c819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20c81033d0 0x7f20c819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 -- 172.21.15.46:0/3679969852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c8197810 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.548+0000 7f20c7fff640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c819d690 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f20b8031460 tx=0x7f20b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.549+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20b803f070 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.549+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c8197aa0 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.549+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f20b8004cf0 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.549+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f20b8035030 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.549+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c8197fd0 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.550+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c806a580 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.550+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f20b8042070 con 0x7f20c8102ab0 2024-09-21T12:51:04.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.551+0000 7f20c57fa640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f20b407af30 0x7f20b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.551+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f20b80beb00 con 0x7f20c8102ab0 2024-09-21T12:51:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.551+0000 7f20c77fe640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f20b407af30 0x7f20b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.552+0000 7f20c77fe640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f20b407af30 0x7f20b407d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20c80feff0 tx=0x7f20b0008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.556+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f20b808a100 con 0x7f20c8102ab0 2024-09-21T12:51:04.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.761+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f20c8198280 con 0x7f20b407af30 2024-09-21T12:51:04.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.762+0000 7f20c57fa640 1 -- 172.21.15.46:0/3679969852 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f20c8198280 con 0x7f20b407af30 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f20b407af30 msgr2=0x7f20b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f20b407af30 0x7f20b407d3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f20c80feff0 tx=0x7f20b0008040 comp rx=0 tx=0).stop 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 msgr2=0x7f20c819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c819d690 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f20b8031460 tx=0x7f20b80048f0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 shutdown_connections 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f20b407af30 0x7f20b407d3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20c81033d0 0x7f20c819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 --2- 172.21.15.46:0/3679969852 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f20c8102ab0 0x7f20c819d690 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.764+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 >> 172.21.15.46:0/3679969852 conn(0x7f20c80fc550 msgr2=0x7f20c8108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:04.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.765+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 shutdown_connections 2024-09-21T12:51:04.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.765+0000 7f20cea3b640 1 -- 172.21.15.46:0/3679969852 wait complete. 2024-09-21T12:51:04.776 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:51:04.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 -- 172.21.15.46:0/886958787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654109b90 msgr2=0x7f4654109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:04.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 --2- 172.21.15.46:0/886958787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654109b90 0x7f4654109f70 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4650009880 tx=0x7f465002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 -- 172.21.15.46:0/886958787 shutdown_connections 2024-09-21T12:51:04.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 --2- 172.21.15.46:0/886958787 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4654103b00 0x7f4654103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 --2- 172.21.15.46:0/886958787 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654109b90 0x7f4654109f70 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 -- 172.21.15.46:0/886958787 >> 172.21.15.46:0/886958787 conn(0x7f46540ff800 msgr2=0x7f4654101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 -- 172.21.15.46:0/886958787 shutdown_connections 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 -- 172.21.15.46:0/886958787 wait complete. 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.852+0000 7f465bedd640 1 Processor -- start 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f465bedd640 1 -- start start 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f465bedd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 0x7f465419f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f465bedd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4654109b90 0x7f465419fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f465bedd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4654111030 con 0x7f4654103b00 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f465bedd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4654110eb0 con 0x7f4654109b90 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 0x7f465419f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 0x7f465419f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42432/0 (socket says 172.21.15.46:42432) 2024-09-21T12:51:04.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 -- 172.21.15.46:0/1006735251 learned_addr learned my addr 172.21.15.46:0/1006735251 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 -- 172.21.15.46:0/1006735251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4654109b90 msgr2=0x7f465419fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4654109b90 0x7f465419fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 -- 172.21.15.46:0/1006735251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4654199a60 con 0x7f4654103b00 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f4659c79640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 0x7f465419f8a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4650031460 tx=0x7f46500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.853+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f465003f070 con 0x7f4654103b00 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.854+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4654199cf0 con 0x7f4654103b00 2024-09-21T12:51:04.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.854+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4650004cf0 con 0x7f4654103b00 2024-09-21T12:51:04.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.854+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4650035030 con 0x7f4654103b00 2024-09-21T12:51:04.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.854+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f465419a220 con 0x7f4654103b00 2024-09-21T12:51:04.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.855+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4654105200 con 0x7f4654103b00 2024-09-21T12:51:04.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.855+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4650042070 con 0x7f4654103b00 2024-09-21T12:51:04.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.856+0000 7f464affd640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f464007af30 0x7f464007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:04.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.856+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f46500beb00 con 0x7f4654103b00 2024-09-21T12:51:04.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.856+0000 7f4659478640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f464007af30 0x7f464007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:04.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.856+0000 7f4659478640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f464007af30 0x7f464007d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4654101de0 tx=0x7f4644006c90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:04.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:04.860+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f465008a100 con 0x7f4654103b00 2024-09-21T12:51:05.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.069+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f465419af90 con 0x7f464007af30 2024-09-21T12:51:05.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.070+0000 7f464affd640 1 -- 172.21.15.46:0/1006735251 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f465419af90 con 0x7f464007af30 2024-09-21T12:51:05.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f464007af30 msgr2=0x7f464007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f464007af30 0x7f464007d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4654101de0 tx=0x7f4644006c90 comp rx=0 tx=0).stop 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 msgr2=0x7f465419f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 0x7f465419f8a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f4650031460 tx=0x7f46500048f0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 shutdown_connections 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f464007af30 0x7f464007d3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4654109b90 0x7f465419fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 --2- 172.21.15.46:0/1006735251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4654103b00 0x7f465419f8a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 >> 172.21.15.46:0/1006735251 conn(0x7f46540ff800 msgr2=0x7f4654100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 shutdown_connections 2024-09-21T12:51:05.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.072+0000 7f465bedd640 1 -- 172.21.15.46:0/1006735251 wait complete. 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 -- 172.21.15.46:0/3562411548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 msgr2=0x7f0644101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 --2- 172.21.15.46:0/3562411548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f0644101d60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f062c009880 tx=0x7f062c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 -- 172.21.15.46:0/3562411548 shutdown_connections 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 --2- 172.21.15.46:0/3562411548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f0644101d60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 --2- 172.21.15.46:0/3562411548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0644107900 0x7f0644107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 -- 172.21.15.46:0/3562411548 >> 172.21.15.46:0/3562411548 conn(0x7f06440fd600 msgr2=0x7f06440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 -- 172.21.15.46:0/3562411548 shutdown_connections 2024-09-21T12:51:05.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.156+0000 7f0648c1e640 1 -- 172.21.15.46:0/3562411548 wait complete. 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f0648c1e640 1 Processor -- start 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f0648c1e640 1 -- start start 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f0648c1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f06440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f0648c1e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0644107900 0x7f0644074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f0648c1e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f064410edd0 con 0x7f0644101900 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f0648c1e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f064410ec50 con 0x7f0644107900 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f064259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f06440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f064259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f06440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42462/0 (socket says 172.21.15.46:42462) 2024-09-21T12:51:05.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.157+0000 7f064259c640 1 -- 172.21.15.46:0/480603859 learned_addr learned my addr 172.21.15.46:0/480603859 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f063bfff640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0644107900 0x7f0644074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f064259c640 1 -- 172.21.15.46:0/480603859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0644107900 msgr2=0x7f0644074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f064259c640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0644107900 0x7f0644074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f064259c640 1 -- 172.21.15.46:0/480603859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0644074f70 con 0x7f0644101900 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f064259c640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f06440744f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f063400d6f0 tx=0x7f063400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0634017070 con 0x7f0644101900 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0644075260 con 0x7f0644101900 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f063400de00 con 0x7f0644101900 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0634004bb0 con 0x7f0644101900 2024-09-21T12:51:05.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.158+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06441a3e80 con 0x7f0644101900 2024-09-21T12:51:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.159+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0644103040 con 0x7f0644101900 2024-09-21T12:51:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.160+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0634004e60 con 0x7f0644101900 2024-09-21T12:51:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.160+0000 7f063b7fe640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f063007af30 0x7f063007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.161+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f063409dcd0 con 0x7f0644101900 2024-09-21T12:51:05.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.161+0000 7f063bfff640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f063007af30 0x7f063007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.161+0000 7f063bfff640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f063007af30 0x7f063007d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0644075f80 tx=0x7f062c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:05.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.165+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0634069230 con 0x7f0644101900 2024-09-21T12:51:05.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.361+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0644062630 con 0x7f063007af30 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.371+0000 7f063b7fe640 1 -- 172.21.15.46:0/480603859 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f0644062630 con 0x7f063007af30 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (77s) 48s ago 12m 18.7M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (4m) 48s ago 12m 8732k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (4m) 2m ago 11m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 48s ago 12m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (11m) 2m ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (54s) 48s ago 11m 46.2M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (6m) 48s ago 6m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:51:05.374 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (6m) 48s ago 6m 152M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (6m) 2m ago 6m 27.1M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (6m) 2m ago 6m 26.7M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (3m) 48s ago 13m 525M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (2m) 2m ago 11m 455M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 48s ago 13m 59.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a b47534a5642e 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (11m) 2m ago 11m 49.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 2bfd33c0f1c8 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 48s ago 12m 11.7M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (2m) 2m ago 11m 3380k - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 48s ago 10m 200M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 48s ago 9m 217M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 48s ago 9m 178M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (8m) 2m ago 8m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (8m) 2m ago 8m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:51:05.375 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (7m) 2m ago 7m 187M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:51:05.376 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (98s) 48s ago 11m 43.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:51:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f063007af30 msgr2=0x7f063007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f063007af30 0x7f063007d3f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0644075f80 tx=0x7f062c031400 comp rx=0 tx=0).stop 2024-09-21T12:51:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 msgr2=0x7f06440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f06440744f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f063400d6f0 tx=0x7f063400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 shutdown_connections 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f063007af30 0x7f063007d3f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0644107900 0x7f0644074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 --2- 172.21.15.46:0/480603859 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0644101900 0x7f06440744f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 >> 172.21.15.46:0/480603859 conn(0x7f06440fd600 msgr2=0x7f06440fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 shutdown_connections 2024-09-21T12:51:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.374+0000 7f0648c1e640 1 -- 172.21.15.46:0/480603859 wait complete. 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 -- 172.21.15.46:0/2050089561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 msgr2=0x7fa44c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 --2- 172.21.15.46:0/2050089561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c10b8d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa43c009880 tx=0x7fa43c02a530 comp rx=0 tx=0).stop 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 -- 172.21.15.46:0/2050089561 shutdown_connections 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 --2- 172.21.15.46:0/2050089561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c10b8d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 --2- 172.21.15.46:0/2050089561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa44c102ac0 0x7fa44c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 -- 172.21.15.46:0/2050089561 >> 172.21.15.46:0/2050089561 conn(0x7fa44c0fc520 msgr2=0x7fa44c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 -- 172.21.15.46:0/2050089561 shutdown_connections 2024-09-21T12:51:05.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.457+0000 7fa4546d6640 1 -- 172.21.15.46:0/2050089561 wait complete. 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa4546d6640 1 Processor -- start 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa4546d6640 1 -- start start 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa4546d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa44c102ac0 0x7fa44c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa4546d6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa4546d6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c10edd0 con 0x7fa44c1033e0 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa4546d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa44c10ec50 con 0x7fa44c102ac0 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa451c71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa451c71640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42484/0 (socket says 172.21.15.46:42484) 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa451c71640 1 -- 172.21.15.46:0/4153232076 learned_addr learned my addr 172.21.15.46:0/4153232076 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.458+0000 7fa452472640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa44c102ac0 0x7fa44c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa451c71640 1 -- 172.21.15.46:0/4153232076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa44c102ac0 msgr2=0x7fa44c19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa451c71640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa44c102ac0 0x7fa44c19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa451c71640 1 -- 172.21.15.46:0/4153232076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44c1977e0 con 0x7fa44c1033e0 2024-09-21T12:51:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa451c71640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c19dba0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa43c031460 tx=0x7fa43c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa43c03f070 con 0x7fa44c1033e0 2024-09-21T12:51:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa43c004ac0 con 0x7fa44c1033e0 2024-09-21T12:51:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44c197a70 con 0x7fa44c1033e0 2024-09-21T12:51:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa43c035030 con 0x7fa44c1033e0 2024-09-21T12:51:05.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.459+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa44c197fa0 con 0x7fa44c1033e0 2024-09-21T12:51:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.460+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa44c06aa90 con 0x7fa44c1033e0 2024-09-21T12:51:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.461+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa43c042070 con 0x7fa44c1033e0 2024-09-21T12:51:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.461+0000 7fa4437fe640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa43807af80 0x7fa43807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.462+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fa43c0be950 con 0x7fa44c1033e0 2024-09-21T12:51:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.462+0000 7fa452472640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa43807af80 0x7fa43807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.462+0000 7fa452472640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa43807af80 0x7fa43807d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4480058c0 tx=0x7fa44800a2d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:05.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.467+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa43c089f30 con 0x7fa44c1033e0 2024-09-21T12:51:05.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:05 smithi046 ceph-mon[27868]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:05.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:05 smithi046 ceph-mon[27868]: from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:05.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:05 smithi046 ceph-mon[27868]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:05.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:05 smithi046 ceph-mon[27868]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:05.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.743+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa44c198d10 con 0x7fa44c1033e0 2024-09-21T12:51:05.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.744+0000 7fa4437fe640 1 -- 172.21.15.46:0/4153232076 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fa43c08ede0 con 0x7fa44c1033e0 2024-09-21T12:51:05.746 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:51:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:51:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:51:05.746 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:51:05.747 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:51:05.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa43807af80 msgr2=0x7fa43807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa43807af80 0x7fa43807d440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa4480058c0 tx=0x7fa44800a2d0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 msgr2=0x7fa44c19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c19dba0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fa43c031460 tx=0x7fa43c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 shutdown_connections 2024-09-21T12:51:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa43807af80 0x7fa43807d440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa44c1033e0 0x7fa44c19dba0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 --2- 172.21.15.46:0/4153232076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa44c102ac0 0x7fa44c19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 >> 172.21.15.46:0/4153232076 conn(0x7fa44c0fc520 msgr2=0x7fa44c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 shutdown_connections 2024-09-21T12:51:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.746+0000 7fa4546d6640 1 -- 172.21.15.46:0/4153232076 wait complete. 2024-09-21T12:51:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:05 smithi176 ceph-mon[35476]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:05 smithi176 ceph-mon[35476]: from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:05 smithi176 ceph-mon[35476]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:05 smithi176 ceph-mon[35476]: from='client.14946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:05.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 -- 172.21.15.46:0/3097385004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 msgr2=0x7f7ce4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 --2- 172.21.15.46:0/3097385004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4102ea0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009880 tx=0x7f7cd402a530 comp rx=0 tx=0).stop 2024-09-21T12:51:05.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 -- 172.21.15.46:0/3097385004 shutdown_connections 2024-09-21T12:51:05.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 --2- 172.21.15.46:0/3097385004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce41033e0 0x7f7ce410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 --2- 172.21.15.46:0/3097385004 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4102ea0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 -- 172.21.15.46:0/3097385004 >> 172.21.15.46:0/3097385004 conn(0x7f7ce40fc520 msgr2=0x7f7ce40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:05.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 -- 172.21.15.46:0/3097385004 shutdown_connections 2024-09-21T12:51:05.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.831+0000 7f7ce941f640 1 -- 172.21.15.46:0/3097385004 wait complete. 2024-09-21T12:51:05.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce941f640 1 Processor -- start 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce941f640 1 -- start start 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce941f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce941f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce41033e0 0x7f7ce4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce941f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410ee50 con 0x7f7ce4102ac0 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce941f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410ecd0 con 0x7f7ce41033e0 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42496/0 (socket says 172.21.15.46:42496) 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.832+0000 7f7ce2ffd640 1 -- 172.21.15.46:0/2906471077 learned_addr learned my addr 172.21.15.46:0/2906471077 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce27fc640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce41033e0 0x7f7ce4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce2ffd640 1 -- 172.21.15.46:0/2906471077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce41033e0 msgr2=0x7f7ce4100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce2ffd640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce41033e0 0x7f7ce4100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:05.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce2ffd640 1 -- 172.21.15.46:0/2906471077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce41011a0 con 0x7f7ce4102ac0 2024-09-21T12:51:05.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce2ffd640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4100720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4031460 tx=0x7f7cd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:05.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cd403f070 con 0x7f7ce4102ac0 2024-09-21T12:51:05.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7cd4004cf0 con 0x7f7ce4102ac0 2024-09-21T12:51:05.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce4101430 con 0x7f7ce4102ac0 2024-09-21T12:51:05.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7cd4035030 con 0x7f7ce4102ac0 2024-09-21T12:51:05.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.833+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce41a3de0 con 0x7f7ce4102ac0 2024-09-21T12:51:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.834+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce406aa90 con 0x7f7ce4102ac0 2024-09-21T12:51:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.835+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7cd4042070 con 0x7f7ce4102ac0 2024-09-21T12:51:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.835+0000 7f7ccbfff640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7ccc07af30 0x7f7ccc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.835+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f7cd40beb70 con 0x7f7ce4102ac0 2024-09-21T12:51:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.836+0000 7f7ce27fc640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7ccc07af30 0x7f7ccc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.836+0000 7f7ce27fc640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7ccc07af30 0x7f7ccc07d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ce41021b0 tx=0x7f7cd8008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:05.840+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7cd408a170 con 0x7f7ce4102ac0 2024-09-21T12:51:06.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.086+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7ce41a4150 con 0x7f7ce4102ac0 2024-09-21T12:51:06.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.086+0000 7f7ccbfff640 1 -- 172.21.15.46:0/2906471077 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f7cd408f020 con 0x7f7ce4102ac0 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:51:06.089 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:51:06.090 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:06.091 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7ccc07af30 msgr2=0x7f7ccc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7ccc07af30 0x7f7ccc07d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ce41021b0 tx=0x7f7cd8008040 comp rx=0 tx=0).stop 2024-09-21T12:51:06.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 msgr2=0x7f7ce4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4100720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4031460 tx=0x7f7cd40048f0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 shutdown_connections 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7ccc07af30 0x7f7ccc07d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ce41033e0 0x7f7ce4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 --2- 172.21.15.46:0/2906471077 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7ce4102ac0 0x7f7ce4100720 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 >> 172.21.15.46:0/2906471077 conn(0x7f7ce40fc520 msgr2=0x7f7ce410af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 shutdown_connections 2024-09-21T12:51:06.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.089+0000 7f7ce941f640 1 -- 172.21.15.46:0/2906471077 wait complete. 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.176+0000 7f2feb938640 1 -- 172.21.15.46:0/22429453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 msgr2=0x7f2fe4106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.176+0000 7f2feb938640 1 --2- 172.21.15.46:0/22429453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe4106bd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009880 tx=0x7f2fe002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 -- 172.21.15.46:0/22429453 shutdown_connections 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 --2- 172.21.15.46:0/22429453 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fe41007f0 0x7f2fe4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 --2- 172.21.15.46:0/22429453 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe4106bd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 -- 172.21.15.46:0/22429453 >> 172.21.15.46:0/22429453 conn(0x7f2fe40fc550 msgr2=0x7f2fe40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 -- 172.21.15.46:0/22429453 shutdown_connections 2024-09-21T12:51:06.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 -- 172.21.15.46:0/22429453 wait complete. 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 Processor -- start 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.177+0000 7f2feb938640 1 -- start start 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2feb938640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fe41007f0 0x7f2fe419c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2feb938640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2feb938640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe410dd20 con 0x7f2fe41067f0 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2feb938640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe410dba0 con 0x7f2fe41007f0 2024-09-21T12:51:06.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe419cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42512/0 (socket says 172.21.15.46:42512) 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 -- 172.21.15.46:0/1180069573 learned_addr learned my addr 172.21.15.46:0/1180069573 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 -- 172.21.15.46:0/1180069573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fe41007f0 msgr2=0x7f2fe419c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fe41007f0 0x7f2fe419c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 -- 172.21.15.46:0/1180069573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe4196830 con 0x7f2fe41067f0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fe8ed3640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe419cbf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400d910 tx=0x7f2fd400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd401b070 con 0x7f2fe41067f0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe4196ac0 con 0x7f2fe41067f0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fd400eb70 con 0x7f2fe41067f0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.178+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4014600 con 0x7f2fe41067f0 2024-09-21T12:51:06.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.179+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe4197050 con 0x7f2fe41067f0 2024-09-21T12:51:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.180+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe4101f30 con 0x7f2fe41067f0 2024-09-21T12:51:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.180+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2fd401e070 con 0x7f2fe41067f0 2024-09-21T12:51:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.181+0000 7f2fda7fc640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd007af90 0x7f2fd007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.181+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f2fd409f6c0 con 0x7f2fe41067f0 2024-09-21T12:51:06.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.181+0000 7f2fe96d4640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd007af90 0x7f2fd007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:06.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.181+0000 7f2fe96d4640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd007af90 0x7f2fd007d450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00096c0 tx=0x7f2fe0000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:06.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.185+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2fd406ad40 con 0x7f2fe41067f0 2024-09-21T12:51:06.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.399+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2fe4197360 con 0x7f2fd007af90 2024-09-21T12:51:06.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.400+0000 7f2fda7fc640 1 -- 172.21.15.46:0/1180069573 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7f2fe4197360 con 0x7f2fd007af90 2024-09-21T12:51:06.402 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:51:06.402 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:51:06.402 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:51:06.402 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:51:06.402 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:51:06.403 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:51:06.403 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:51:06.403 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T12:51:06.403 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T12:51:06.403 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:51:06.403 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd007af90 msgr2=0x7f2fd007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd007af90 0x7f2fd007d450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2fe00096c0 tx=0x7f2fe0000bc0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 msgr2=0x7f2fe419cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe419cbf0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400d910 tx=0x7f2fd400ddd0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 shutdown_connections 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd007af90 0x7f2fd007d450 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fe41067f0 0x7f2fe419cbf0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 --2- 172.21.15.46:0/1180069573 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fe41007f0 0x7f2fe419c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 >> 172.21.15.46:0/1180069573 conn(0x7f2fe40fc550 msgr2=0x7f2fe40fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:06.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 shutdown_connections 2024-09-21T12:51:06.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.402+0000 7f2feb938640 1 -- 172.21.15.46:0/1180069573 wait complete. 2024-09-21T12:51:06.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 -- 172.21.15.46:0/3288495728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674106800 msgr2=0x7f1674106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 --2- 172.21.15.46:0/3288495728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674106800 0x7f1674106be0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1664009880 tx=0x7f166402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 -- 172.21.15.46:0/3288495728 shutdown_connections 2024-09-21T12:51:06.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 --2- 172.21.15.46:0/3288495728 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1674100800 0x7f1674100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 --2- 172.21.15.46:0/3288495728 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674106800 0x7f1674106be0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 -- 172.21.15.46:0/3288495728 >> 172.21.15.46:0/3288495728 conn(0x7f16740fc520 msgr2=0x7f16740fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:06.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 -- 172.21.15.46:0/3288495728 shutdown_connections 2024-09-21T12:51:06.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 -- 172.21.15.46:0/3288495728 wait complete. 2024-09-21T12:51:06.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.487+0000 7f16791c9640 1 Processor -- start 2024-09-21T12:51:06.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f16791c9640 1 -- start start 2024-09-21T12:51:06.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f16791c9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 0x7f167419f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:06.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f16791c9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1674106800 0x7f167419fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:06.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f16791c9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f167410dd30 con 0x7f1674100800 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f16791c9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f167410dbb0 con 0x7f1674106800 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 0x7f167419f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 0x7f167419f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42530/0 (socket says 172.21.15.46:42530) 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 -- 172.21.15.46:0/2980365102 learned_addr learned my addr 172.21.15.46:0/2980365102 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f166bfff640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1674106800 0x7f167419fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 -- 172.21.15.46:0/2980365102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1674106800 msgr2=0x7f167419fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1674106800 0x7f167419fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 -- 172.21.15.46:0/2980365102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1674199a80 con 0x7f1674100800 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.488+0000 7f1672d9d640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 0x7f167419f8c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1664031460 tx=0x7f16640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.489+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f166403f070 con 0x7f1674100800 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.489+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1674199d10 con 0x7f1674100800 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.489+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1664004cf0 con 0x7f1674100800 2024-09-21T12:51:06.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.489+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1664035030 con 0x7f1674100800 2024-09-21T12:51:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.489+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f167419a240 con 0x7f1674100800 2024-09-21T12:51:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.490+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1674101f40 con 0x7f1674100800 2024-09-21T12:51:06.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.490+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1664042070 con 0x7f1674100800 2024-09-21T12:51:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.491+0000 7f1670d99640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f166007af30 0x7f166007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.491+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f16640beb00 con 0x7f1674100800 2024-09-21T12:51:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.491+0000 7f166bfff640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f166007af30 0x7f166007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:06.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.491+0000 7f166bfff640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f166007af30 0x7f166007d3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16740fe3f0 tx=0x7f165c008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:06.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.495+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f166408a100 con 0x7f1674100800 2024-09-21T12:51:06.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.759+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f167419afe0 con 0x7f1674100800 2024-09-21T12:51:06.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.759+0000 7f1670d99640 1 -- 172.21.15.46:0/2980365102 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f166408efb0 con 0x7f1674100800 2024-09-21T12:51:06.762 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:06.762 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:06.762 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f166007af30 msgr2=0x7f166007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f166007af30 0x7f166007d3f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f16740fe3f0 tx=0x7f165c008040 comp rx=0 tx=0).stop 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 msgr2=0x7f167419f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 0x7f167419f8c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1664031460 tx=0x7f16640048f0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 shutdown_connections 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f166007af30 0x7f166007d3f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1674106800 0x7f167419fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 --2- 172.21.15.46:0/2980365102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1674100800 0x7f167419f8c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 >> 172.21.15.46:0/2980365102 conn(0x7f16740fc520 msgr2=0x7f16740fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:06.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 shutdown_connections 2024-09-21T12:51:06.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:06.761+0000 7f16791c9640 1 -- 172.21.15.46:0/2980365102 wait complete. 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: Upgrade: Target is version 19.3.0-5104-g44178494 (squid) 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5'] 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: Upgrade: Setting container_image for all mgr 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/4153232076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:51:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:06 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2906471077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:51:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: Upgrade: Target is version 19.3.0-5104-g44178494 (squid) 2024-09-21T12:51:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, digests ['quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5'] 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: Upgrade: Setting container_image for all mgr 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/4153232076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:51:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:06 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2906471077' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:51:07.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:07.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: from='client.? 172.21.15.46:0/2980365102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T12:51:07.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: Upgrade: Updating mon.smithi046 2024-09-21T12:51:07.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:07.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:51:07.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:51:07.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:07.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: Deploying daemon mon.smithi046 on smithi046 2024-09-21T12:51:07.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:07 smithi046 ceph-mon[27868]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:08.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: from='client.14958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:08.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: from='client.? 172.21.15.46:0/2980365102' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: Upgrade: Updating mon.smithi046 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: Deploying daemon mon.smithi046 on smithi046 2024-09-21T12:51:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:07 smithi176 ceph-mon[35476]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:09.049 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:08 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:51:09.373 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[27864]: 2024-09-21T12:51:09.046+0000 7f01b1ebd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:51:09.373 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[27864]: 2024-09-21T12:51:09.046+0000 7f01b1ebd640 -1 mon.smithi046@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T12:51:09.374 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 podman[107955]: 2024-09-21 12:51:09.077829875 +0000 UTC m=+0.146777903 container died b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T12:51:09.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 podman[107955]: 2024-09-21 12:51:09.463529961 +0000 UTC m=+0.532477975 container cleanup b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T12:51:09.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 bash[107955]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046 2024-09-21T12:51:10.129 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 podman[107969]: 2024-09-21 12:51:09.715012369 +0000 UTC m=+0.641183619 container remove b47534a5642e0ddb5fd2b7f8b7fd89e08ef6bec2e8bbb58265bbc51fc12ad97f (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T12:51:10.129 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service: Deactivated successfully. 2024-09-21T12:51:10.129 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 systemd[1]: Stopped Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:51:10.129 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:09 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service: Consumed 14.521s CPU time. 2024-09-21T12:51:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 systemd[1]: Starting Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:51:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 podman[108107]: 2024-09-21 12:51:10.244097997 +0000 UTC m=+0.016518758 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:51:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 podman[108107]: 2024-09-21 12:51:10.349365079 +0000 UTC m=+0.121785820 container create 805012a2e2d14590453420b628edf132c753e19a95f48451e12a46d7e2acbae2 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T12:51:10.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 podman[108107]: 2024-09-21 12:51:10.610348928 +0000 UTC m=+0.382769684 container init 805012a2e2d14590453420b628edf132c753e19a95f48451e12a46d7e2acbae2 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T12:51:10.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 podman[108107]: 2024-09-21 12:51:10.613675616 +0000 UTC m=+0.386096359 container start 805012a2e2d14590453420b628edf132c753e19a95f48451e12a46d7e2acbae2 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T12:51:10.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev), process ceph-mon, pid 2 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: pidfile_write: ignore empty --pid-file 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: load: jerasure load: lrc 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Git sha 0 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Compile date 2024-09-21 09:24:23 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: DB SUMMARY 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: DB Session ID: 9Q3JN4E8MDDBS7RA1N3U 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:51:10.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1512 Bytes 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi046/store.db dir, Total Num: 1, files: 000032.sst 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi046/store.db: 000030.log size: 2280378 ; 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.env: 0x5597a9999120 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.info_log: 0x5597ab6fb8e0 2024-09-21T12:51:10.914 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.statistics: (nil) 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.use_fsync: 0 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:51:10.915 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.db_log_dir: 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.wal_dir: 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.write_buffer_manager: 0x5597ab6ffb80 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:51:10.916 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.unordered_write: 0 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:51:10.917 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.row_cache: None 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.wal_filter: None 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.wal_compression: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:51:10.919 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:51:10.920 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_open_files: -1 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:51:10.921 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Compression algorithms supported: 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kZSTD supported: 0 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:51:10.922 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000015 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.merge_operator: 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_filter: None 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5597ab6fb540) 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_type: 0 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_index_type: 0 2024-09-21T12:51:10.923 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_shortening: 1 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: checksum: 4 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: no_block_cache: 0 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache: 0x5597ab6ef610 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_options: 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: capacity : 536870912 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_shard_bits : 4 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: strict_capacity_limit : 0 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_cache_compressed: (nil) 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: persistent_cache: (nil) 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size: 4096 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_size_deviation: 10 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_restart_interval: 16 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: index_block_restart_interval: 1 2024-09-21T12:51:10.924 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_block_size: 4096 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: partition_filters: 0 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: use_delta_encoding: 1 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: filter_policy: bloomfilter 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: whole_key_filtering: 1 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: verify_compression: 0 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: format_version: 5 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_index_compression: 1 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: block_align: 0 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_auto_readahead_size: 262144 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: prepopulate_block_cache: 0 2024-09-21T12:51:10.925 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression: NoCompression 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.num_levels: 7 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:51:10.926 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:51:10.927 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:51:10.928 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:51:10.929 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:51:10.930 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.ttl: 2592000 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:51:10.931 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi046/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 12072, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e3fc7edd-d8ee-459f-8772-5d7d739e1dc1 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726923070641000, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726923070648867, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2013353, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12073, "largest_seqno": 13780, "table_properties": {"data_size": 2005379, "index_size": 5012, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1925, "raw_key_size": 17491, "raw_average_key_size": 23, "raw_value_size": 1989312, "raw_average_value_size": 2638, "num_data_blocks": 229, "num_entries": 754, "num_filter_entries": 754, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726923070, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e3fc7edd-d8ee-459f-8772-5d7d739e1dc1", "db_session_id": "9Q3JN4E8MDDBS7RA1N3U", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726923070648988, "job": 1, "event": "recovery_finished"} 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi046/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5597ab71ee00 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: DB pointer 0x5597ab820000 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** DB Stats ** 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:51:10.932 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L0 1/0 1.92 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 480.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: L6 1/0 7.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Sum 2/0 9.35 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 480.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 480.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** Compaction Stats [default] ** 2024-09-21T12:51:10.933 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 480.9 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Cumulative compaction: 0.00 GB write, 185.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Interval compaction: 0.00 GB write, 185.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:51:10.934 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache BinnedLRUCache@0x5597ab6ef610#2 capacity: 512.00 MB usage: 7.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.03 KB,0.00038743%) IndexBlock(1,5.08 KB,0.000968575%) Misc(1,0.00 KB,0%) 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: starting mon.smithi046 rank 0 at public addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] at bind addrs [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi046 fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???) e2 preinit fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).mds e20 new map 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).mds e20 print_map 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: e20 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: legacy client fscid: 1 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: Filesystem 'cephfs' (1) 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: fs_name cephfs 2024-09-21T12:51:10.935 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: epoch 20 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: tableserver 0 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: root 0 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: session_timeout 60 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: session_autoclose 300 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_file_size 1099511627776 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_xattr_size 65536 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: required_client_features {} 2024-09-21T12:51:10.936 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: last_failure 0 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: last_failure_osd_epoch 45 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: max_mds 2 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: in 0,1 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: up {0=14570,1=24297} 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: failed 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: damaged 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: stopped 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: data_pools [3] 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: metadata_pool 2 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: inline_data enabled 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: balancer 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: bal_rank_mask -1 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: standby_count_wanted 1 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:10.937 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: [mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout: 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 ceph-mon[108126]: mon.smithi046@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 bash[108107]: 805012a2e2d14590453420b628edf132c753e19a95f48451e12a46d7e2acbae2 2024-09-21T12:51:10.938 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:10 smithi046 systemd[1]: Started Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:51:12.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:51:12.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:51:12.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: mon.smithi046 calling monitor election 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: mon.smithi046 is new leader, mons smithi046,smithi176 in quorum (ranks 0,1) 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: monmap epoch 2 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: last_changed 2024-09-21T12:39:52.456233+0000 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: min_mon_release 19 (squid) 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: election_strategy: 1 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:51:12.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.smithi176 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: mgrmap e33: smithi046.vedsjs(active, since 3m), standbys: smithi176.rmyfjh 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='' 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:12.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:12.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi046"}]: dispatch 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "mon metadata", "id": "smithi176"}]: dispatch 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: mon.smithi046 calling monitor election 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: mon.smithi046 is new leader, mons smithi046,smithi176 in quorum (ranks 0,1) 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: monmap epoch 2 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:12.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: last_changed 2024-09-21T12:39:52.456233+0000 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: min_mon_release 19 (squid) 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: election_strategy: 1 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.smithi176 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: mgrmap e33: smithi046.vedsjs(active, since 3m), standbys: smithi176.rmyfjh 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='' 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:12.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:12 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:13 smithi046 ceph-mon[108126]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:13 smithi176 ceph-mon[35476]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:14.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:14 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:51:14.890 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:51:15.750 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:15 smithi046 ceph-mon[108126]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:15 smithi176 ceph-mon[35476]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:18.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:17 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:17 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:17 smithi046 ceph-mon[108126]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:18.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:17 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.240 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:17 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:17 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:17 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:17 smithi176 ceph-mon[35476]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:18.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:17 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:18.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:17 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:19.533 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:19 smithi046 ceph-mon[108126]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:19 smithi176 ceph-mon[35476]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:51:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:22.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:51:22.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:51:22.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:21 smithi046 ceph-mon[108126]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:51:22.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:22.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:51:22.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:51:22.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:51:22.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:21 smithi176 ceph-mon[35476]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: Upgrade: Updating mon.smithi176 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: Deploying daemon mon.smithi176 on smithi176 2024-09-21T12:51:24.016 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:23 smithi176 ceph-mon[35476]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:24.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: Upgrade: Updating mon.smithi176 2024-09-21T12:51:24.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: from='mgr.14742 ' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:24.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:51:24.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:51:24.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:51:24.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: Deploying daemon mon.smithi176 on smithi176 2024-09-21T12:51:24.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:23 smithi046 ceph-mon[108126]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:24.630 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:24 smithi176 systemd[1]: Stopping Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:51:24.630 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:24 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176[35469]: 2024-09-21T12:51:24.577+0000 7fd4e1033640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi176 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:51:24.630 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:24 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176[35469]: 2024-09-21T12:51:24.577+0000 7fd4e1033640 -1 mon.smithi176@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T12:51:24.922 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:24 smithi176 podman[79998]: 2024-09-21 12:51:24.62946878 +0000 UTC m=+0.151874549 container died 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T12:51:25.280 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 podman[79998]: 2024-09-21 12:51:25.078202471 +0000 UTC m=+0.600608281 container cleanup 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T12:51:25.281 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 bash[79998]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176 2024-09-21T12:51:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 podman[80009]: 2024-09-21 12:51:25.279976398 +0000 UTC m=+0.651466993 container remove 2bfd33c0f1c81cb6fe3df8a29f1807101d037efcca7262b7f6b09e1fb5f7877f (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-4e45e6b, CEPH_POINT_RELEASE=) 2024-09-21T12:51:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176.service: Deactivated successfully. 2024-09-21T12:51:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 systemd[1]: Stopped Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:51:25.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176.service: Consumed 7.182s CPU time. 2024-09-21T12:51:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 systemd[1]: Starting Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:51:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 podman[80143]: 2024-09-21 12:51:25.830166308 +0000 UTC m=+0.015780766 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:51:26.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:25 smithi176 podman[80143]: 2024-09-21 12:51:25.947484542 +0000 UTC m=+0.133098992 container create 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 podman[80143]: 2024-09-21 12:51:26.191535162 +0000 UTC m=+0.377149623 container init 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 podman[80143]: 2024-09-21 12:51:26.194703372 +0000 UTC m=+0.380317825 container start 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev), process ceph-mon, pid 2 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: pidfile_write: ignore empty --pid-file 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: load: jerasure load: lrc 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Git sha 0 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Compile date 2024-09-21 09:24:23 2024-09-21T12:51:26.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: DB SUMMARY 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: DB Session ID: VMMG7X2HYSRZ35YPJ3Q7 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1405 Bytes 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi176/store.db dir, Total Num: 1, files: 000027.sst 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi176/store.db: 000025.log size: 4000480 ; 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.env: 0x564effa77120 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:51:26.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.info_log: 0x564f005df8e0 2024-09-21T12:51:26.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.statistics: (nil) 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.use_fsync: 0 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:51:26.570 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.db_log_dir: 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.wal_dir: 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:51:26.571 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.write_buffer_manager: 0x564f005e3b80 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.unordered_write: 0 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.row_cache: None 2024-09-21T12:51:26.572 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.wal_filter: None 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.wal_compression: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:51:26.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_open_files: -1 2024-09-21T12:51:26.574 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Compression algorithms supported: 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kZSTD supported: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:51:26.575 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi176/store.db/MANIFEST-000010 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.merge_operator: 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_filter: None 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564f005df540) 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: index_type: 0 2024-09-21T12:51:26.576 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: data_block_index_type: 0 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: index_shortening: 1 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: checksum: 4 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: no_block_cache: 0 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache: 0x564f005d3610 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache_options: 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: capacity : 536870912 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: num_shard_bits : 4 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: strict_capacity_limit : 0 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_cache_compressed: (nil) 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: persistent_cache: (nil) 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_size: 4096 2024-09-21T12:51:26.577 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_size_deviation: 10 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_restart_interval: 16 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: index_block_restart_interval: 1 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: metadata_block_size: 4096 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: partition_filters: 0 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: use_delta_encoding: 1 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: filter_policy: bloomfilter 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: whole_key_filtering: 1 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: verify_compression: 0 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: format_version: 5 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: enable_index_compression: 1 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: block_align: 0 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: max_auto_readahead_size: 262144 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: prepopulate_block_cache: 0 2024-09-21T12:51:26.578 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression: NoCompression 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.num_levels: 7 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:51:26.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:51:26.580 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:51:26.581 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:51:26.582 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.ttl: 2592000 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:51:26.583 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi176/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12290, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b0d5d66a-e520-4051-aa99-e13e73f45bde 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726923086221495, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-21T12:51:26.584 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726923086231190, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2332439, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12295, "largest_seqno": 14471, "table_properties": {"data_size": 2323436, "index_size": 5781, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 20119, "raw_average_key_size": 23, "raw_value_size": 2304957, "raw_average_value_size": 2664, "num_data_blocks": 263, "num_entries": 865, "num_filter_entries": 865, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726923086, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b0d5d66a-e520-4051-aa99-e13e73f45bde", "db_session_id": "VMMG7X2HYSRZ35YPJ3Q7", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726923086231325, "job": 1, "event": "recovery_finished"} 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi176/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564f00602e00 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: DB pointer 0x564f00704000 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** DB Stats ** 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:51:26.585 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** Compaction Stats [default] ** 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: L0 1/0 2.22 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 588.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: L6 1/0 7.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Sum 2/0 9.65 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 588.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 588.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** Compaction Stats [default] ** 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:51:26.586 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 588.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Cumulative compaction: 0.00 GB write, 181.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Interval compaction: 0.00 GB write, 181.08 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Block cache BinnedLRUCache@0x564f005d3610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-21T12:51:26.587 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: starting mon.smithi176 rank 1 at public addrs [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] at bind addrs [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi176 fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???) e2 preinit fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).mds e20 new map 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).mds e20 print_map 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: e20 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: legacy client fscid: 1 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: Filesystem 'cephfs' (1) 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: fs_name cephfs 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: epoch 20 2024-09-21T12:51:26.588 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: tableserver 0 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: root 0 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: session_timeout 60 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: session_autoclose 300 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: max_file_size 1099511627776 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: max_xattr_size 65536 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: required_client_features {} 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: last_failure 0 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: last_failure_osd_epoch 45 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: max_mds 2 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: in 0,1 2024-09-21T12:51:26.589 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: up {0=14570,1=24297} 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: failed 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: damaged 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: stopped 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: data_pools [3] 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: metadata_pool 2 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: inline_data enabled 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: balancer 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: bal_rank_mask -1 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: standby_count_wanted 1 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: [mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: [mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: [mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: [mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:26.590 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout: 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 ceph-mon[80162]: mon.smithi176@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 bash[80143]: 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 2024-09-21T12:51:26.591 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:26 smithi176 systemd[1]: Started Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:51:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:27 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-21T12:51:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:27 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mon metadata", "id": "smithi176"} : dispatch 2024-09-21T12:51:28.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:27 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mon metadata", "id": "smithi046"} : dispatch 2024-09-21T12:51:28.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:27 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mon metadata", "id": "smithi176"} : dispatch 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: mon.smithi176 calling monitor election 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: mon.smithi046 calling monitor election 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: mon.smithi046 is new leader, mons smithi046,smithi176 in quorum (ranks 0,1) 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: monmap epoch 2 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: last_changed 2024-09-21T12:39:52.456233+0000 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:51:29.033 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: min_mon_release 19 (squid) 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: election_strategy: 1 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.smithi176 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: mgrmap e33: smithi046.vedsjs(active, since 3m), standbys: smithi176.rmyfjh 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:29.034 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: mon.smithi176 calling monitor election 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: mon.smithi046 calling monitor election 2024-09-21T12:51:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: mon.smithi046 is new leader, mons smithi046,smithi176 in quorum (ranks 0,1) 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: monmap epoch 2 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: fsid 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: last_changed 2024-09-21T12:39:52.456233+0000 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: created 2024-09-21T12:37:26.140175+0000 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: min_mon_release 19 (squid) 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: election_strategy: 1 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: 0: [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] mon.smithi046 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: 1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.smithi176 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2 up:standby-replay 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: mgrmap e33: smithi046.vedsjs(active, since 3m), standbys: smithi176.rmyfjh 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:29.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:29.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:51:29.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:29.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:29.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:51:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:29 smithi176 ceph-mon[80162]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:30.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:51:30.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:29 smithi046 ceph-mon[108126]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:31.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:31 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:31 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:31 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:31 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.602 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:31 smithi176 ceph-mon[80162]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:31 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:31 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:31 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:31 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:31 smithi046 ceph-mon[108126]: pgmap v117: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:33 smithi176 ceph-mon[80162]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:33.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:33 smithi046 ceph-mon[108126]: pgmap v118: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all mon 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"} : dispatch 2024-09-21T12:51:35.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]': finished 2024-09-21T12:51:35.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi176"} : dispatch 2024-09-21T12:51:35.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:35 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi176"}]': finished 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all mon 2024-09-21T12:51:35.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:35.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"} : dispatch 2024-09-21T12:51:35.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi046"}]': finished 2024-09-21T12:51:35.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi176"} : dispatch 2024-09-21T12:51:35.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:35 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi176"}]': finished 2024-09-21T12:51:36.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:36 smithi046 ceph-mon[108126]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:36.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:36.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:51:36.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:36.579 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:36 smithi176 ceph-mon[80162]: pgmap v119: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:36.621 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:36.621 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi046", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:51:36.621 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:36.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 -- 172.21.15.46:0/3344112866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 msgr2=0x7fd1f0106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:36.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/3344112866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f0106610 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4009880 tx=0x7fd1e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:36.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 -- 172.21.15.46:0/3344112866 shutdown_connections 2024-09-21T12:51:36.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/3344112866 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f0106610 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:36.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/3344112866 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1f0100120 0x7fd1f0100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:36.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 -- 172.21.15.46:0/3344112866 >> 172.21.15.46:0/3344112866 conn(0x7fd1f00fbc90 msgr2=0x7fd1f00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:36.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 -- 172.21.15.46:0/3344112866 shutdown_connections 2024-09-21T12:51:36.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.853+0000 7fd1f61f5640 1 -- 172.21.15.46:0/3344112866 wait complete. 2024-09-21T12:51:36.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.854+0000 7fd1f61f5640 1 Processor -- start 2024-09-21T12:51:36.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.854+0000 7fd1f61f5640 1 -- start start 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1f61f5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1f0100120 0x7fd1f01010a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1f61f5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f01015e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1f61f5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f010ee60 con 0x7fd1f0100ad0 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1f61f5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd1f010ece0 con 0x7fd1f0100120 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f01015e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f01015e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48820/0 (socket says 172.21.15.46:48820) 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 -- 172.21.15.46:0/30994106 learned_addr learned my addr 172.21.15.46:0/30994106 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1ef7fe640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1f0100120 0x7fd1f01010a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 -- 172.21.15.46:0/30994106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1f0100120 msgr2=0x7fd1f01010a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1f0100120 0x7fd1f01010a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 -- 172.21.15.46:0/30994106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1f0101b20 con 0x7fd1f0100ad0 2024-09-21T12:51:36.858 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1eeffd640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f01015e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4031460 tx=0x7fd1e40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.855+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1e403f070 con 0x7fd1f0100ad0 2024-09-21T12:51:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.856+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd1e4004cf0 con 0x7fd1f0100ad0 2024-09-21T12:51:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.856+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1f0101db0 con 0x7fd1f0100ad0 2024-09-21T12:51:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.856+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd1e4035030 con 0x7fd1f0100ad0 2024-09-21T12:51:36.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.856+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1f01a3e90 con 0x7fd1f0100ad0 2024-09-21T12:51:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.857+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f01031e0 con 0x7fd1f0100ad0 2024-09-21T12:51:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.857+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd1e4042070 con 0x7fd1f0100ad0 2024-09-21T12:51:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.858+0000 7fd1ecff9640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd1d807af30 0x7fd1d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.858+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7fd1e40bea60 con 0x7fd1f0100ad0 2024-09-21T12:51:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.858+0000 7fd1ef7fe640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd1d807af30 0x7fd1d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:36.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.858+0000 7fd1ef7fe640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd1d807af30 0x7fd1d807d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0005fd0 tx=0x7fd1e0005e20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:36.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:36.863+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd1e408a060 con 0x7fd1f0100ad0 2024-09-21T12:51:37.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.068+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd1f0062630 con 0x7fd1d807af30 2024-09-21T12:51:37.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.069+0000 7fd1ecff9640 1 -- 172.21.15.46:0/30994106 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7fd1f0062630 con 0x7fd1d807af30 2024-09-21T12:51:37.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd1d807af30 msgr2=0x7fd1d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd1d807af30 0x7fd1d807d3f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd1e0005fd0 tx=0x7fd1e0005e20 comp rx=0 tx=0).stop 2024-09-21T12:51:37.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 msgr2=0x7fd1f01015e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f01015e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4031460 tx=0x7fd1e40048f0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 shutdown_connections 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd1d807af30 0x7fd1d807d3f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1f0100ad0 0x7fd1f01015e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 --2- 172.21.15.46:0/30994106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1f0100120 0x7fd1f01010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 >> 172.21.15.46:0/30994106 conn(0x7fd1f00fbc90 msgr2=0x7fd1f00fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 shutdown_connections 2024-09-21T12:51:37.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.072+0000 7fd1f61f5640 1 -- 172.21.15.46:0/30994106 wait complete. 2024-09-21T12:51:37.082 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:51:37.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 -- 172.21.15.46:0/472455531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 msgr2=0x7f545c102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 --2- 172.21.15.46:0/472455531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c102f00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f54440098b0 tx=0x7f544402a560 comp rx=0 tx=0).stop 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 -- 172.21.15.46:0/472455531 shutdown_connections 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 --2- 172.21.15.46:0/472455531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 0x7f545c10b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 --2- 172.21.15.46:0/472455531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c102f00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 -- 172.21.15.46:0/472455531 >> 172.21.15.46:0/472455531 conn(0x7f545c0fc520 msgr2=0x7f545c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 -- 172.21.15.46:0/472455531 shutdown_connections 2024-09-21T12:51:37.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.158+0000 7f5462d1f640 1 -- 172.21.15.46:0/472455531 wait complete. 2024-09-21T12:51:37.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5462d1f640 1 Processor -- start 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5462d1f640 1 -- start start 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5462d1f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5462d1f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 0x7f545c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5462d1f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10edf0 con 0x7f545c102b20 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5462d1f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f545c10ec70 con 0x7f545c103440 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5460abb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5460abb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48834/0 (socket says 172.21.15.46:48834) 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.159+0000 7f5460abb640 1 -- 172.21.15.46:0/2556468855 learned_addr learned my addr 172.21.15.46:0/2556468855 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f545bfff640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 0x7f545c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5460abb640 1 -- 172.21.15.46:0/2556468855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 msgr2=0x7f545c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5460abb640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 0x7f545c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5460abb640 1 -- 172.21.15.46:0/2556468855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f545c197880 con 0x7f545c102b20 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f545bfff640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 0x7f545c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5460abb640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c19d6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f54440099d0 tx=0x7f54440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f544403f070 con 0x7f545c102b20 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54440035f0 con 0x7f545c102b20 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545c197b10 con 0x7f545c102b20 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5444035030 con 0x7f545c102b20 2024-09-21T12:51:37.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.160+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f545c198040 con 0x7f545c102b20 2024-09-21T12:51:37.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.161+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f545c06aa30 con 0x7f545c102b20 2024-09-21T12:51:37.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.162+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5444042070 con 0x7f545c102b20 2024-09-21T12:51:37.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.163+0000 7f5459ffb640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f544807af40 0x7f544807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.163+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f54440bea80 con 0x7f545c102b20 2024-09-21T12:51:37.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.163+0000 7f545bfff640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f544807af40 0x7f544807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.163+0000 7f545bfff640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f544807af40 0x7f544807d400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f545c108980 tx=0x7f544c009520 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:37.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.167+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f544408a080 con 0x7f545c102b20 2024-09-21T12:51:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.374+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f545c198db0 con 0x7f544807af40 2024-09-21T12:51:37.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.375+0000 7f5459ffb640 1 -- 172.21.15.46:0/2556468855 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f545c198db0 con 0x7f544807af40 2024-09-21T12:51:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.380+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f544807af40 msgr2=0x7f544807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.380+0000 7f5462d1f640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f544807af40 0x7f544807d400 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f545c108980 tx=0x7f544c009520 comp rx=0 tx=0).stop 2024-09-21T12:51:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.380+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 msgr2=0x7f545c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.380+0000 7f5462d1f640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c19d6c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f54440099d0 tx=0x7f54440045e0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 shutdown_connections 2024-09-21T12:51:37.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f544807af40 0x7f544807d400 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c103440 0x7f545c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 --2- 172.21.15.46:0/2556468855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f545c102b20 0x7f545c19d6c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 >> 172.21.15.46:0/2556468855 conn(0x7f545c0fc520 msgr2=0x7f545c107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 shutdown_connections 2024-09-21T12:51:37.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.381+0000 7f5462d1f640 1 -- 172.21.15.46:0/2556468855 wait complete. 2024-09-21T12:51:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:37 smithi046 ceph-mon[108126]: Upgrade: Updating crash.smithi046 (1/2) 2024-09-21T12:51:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:37 smithi046 ceph-mon[108126]: Deploying daemon crash.smithi046 on smithi046 2024-09-21T12:51:37.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 -- 172.21.15.46:0/2966062951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d81033d0 msgr2=0x7f78d810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 --2- 172.21.15.46:0/2966062951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d81033d0 0x7f78d810b8c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f78c8009880 tx=0x7f78c802a530 comp rx=0 tx=0).stop 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 -- 172.21.15.46:0/2966062951 shutdown_connections 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 --2- 172.21.15.46:0/2966062951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d81033d0 0x7f78d810b8c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 --2- 172.21.15.46:0/2966062951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78d8102ab0 0x7f78d8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 -- 172.21.15.46:0/2966062951 >> 172.21.15.46:0/2966062951 conn(0x7f78d80fc550 msgr2=0x7f78d80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 -- 172.21.15.46:0/2966062951 shutdown_connections 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 -- 172.21.15.46:0/2966062951 wait complete. 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.478+0000 7f78e0396640 1 Processor -- start 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78e0396640 1 -- start start 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78e0396640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 0x7f78d819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78e0396640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78d81033d0 0x7f78d819db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78e0396640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810edc0 con 0x7f78d8102ab0 2024-09-21T12:51:37.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78e0396640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78d810ec40 con 0x7f78d81033d0 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78de132640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 0x7f78d819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78de132640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 0x7f78d819d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44900/0 (socket says 172.21.15.46:44900) 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78de132640 1 -- 172.21.15.46:0/1447065076 learned_addr learned my addr 172.21.15.46:0/1447065076 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78dd931640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78d81033d0 0x7f78d819db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78de132640 1 -- 172.21.15.46:0/1447065076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78d81033d0 msgr2=0x7f78d819db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78de132640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78d81033d0 0x7f78d819db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.479+0000 7f78de132640 1 -- 172.21.15.46:0/1447065076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78d8197790 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.480+0000 7f78de132640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 0x7f78d819d610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c810 tx=0x7f78d400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.480+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78d4004020 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.480+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78d40041c0 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.480+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78d8197a80 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.480+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78d40047a0 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.481+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78d8197fe0 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.481+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78d806a580 con 0x7f78d8102ab0 2024-09-21T12:51:37.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.482+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f78d40079b0 con 0x7f78d8102ab0 2024-09-21T12:51:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.482+0000 7f78cf7fe640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78c407af80 0x7f78c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.482+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f78d409d390 con 0x7f78d8102ab0 2024-09-21T12:51:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.482+0000 7f78dd931640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78c407af80 0x7f78c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.483+0000 7f78dd931640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78c407af80 0x7f78c407d440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78d8198ae0 tx=0x7f78c8031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:37.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.487+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78d4014030 con 0x7f78d8102ab0 2024-09-21T12:51:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:37 smithi176 ceph-mon[80162]: Upgrade: Updating crash.smithi046 (1/2) 2024-09-21T12:51:37.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:37 smithi176 ceph-mon[80162]: Deploying daemon crash.smithi046 on smithi046 2024-09-21T12:51:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.713+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f78d81982f0 con 0x7f78c407af80 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.726+0000 7f78cf7fe640 1 -- 172.21.15.46:0/1447065076 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f78d81982f0 con 0x7f78c407af80 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (109s) 20s ago 12m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (5m) 20s ago 12m 8812k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (4m) 7s ago 11m 8778k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 20s ago 12m 6891k - 19.1.1-373-g4e45e6b4 164465d2334a ff83c7ee9f8a 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (11m) 7s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a 7a1a49275a9a 2024-09-21T12:51:37.728 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (86s) 20s ago 12m 75.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (7m) 20s ago 7m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (7m) 20s ago 7m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (7m) 7s ago 7m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (7m) 7s ago 7m 26.5M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (4m) 20s ago 14m 525M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (3m) 7s ago 11m 457M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (27s) 20s ago 14m 22.9M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (11s) 7s ago 11m 21.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (2m) 20s ago 12m 11.3M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (2m) 7s ago 11m 12.2M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 20s ago 10m 201M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 55bcbcc129fe 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 20s ago 10m 220M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 20s ago 9m 179M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (9m) 7s ago 9m 230M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (8m) 7s ago 8m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:51:37.729 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (8m) 7s ago 8m 190M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:51:37.730 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (2m) 20s ago 12m 50.1M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78c407af80 msgr2=0x7f78c407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78c407af80 0x7f78c407d440 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f78d8198ae0 tx=0x7f78c8031420 comp rx=0 tx=0).stop 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 msgr2=0x7f78d819d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 0x7f78d819d610 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f78d400c810 tx=0x7f78d400ccd0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 shutdown_connections 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78c407af80 0x7f78c407d440 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78d81033d0 0x7f78d819db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 --2- 172.21.15.46:0/1447065076 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78d8102ab0 0x7f78d819d610 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.729+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 >> 172.21.15.46:0/1447065076 conn(0x7f78d80fc550 msgr2=0x7f78d810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.730+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 shutdown_connections 2024-09-21T12:51:37.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.730+0000 7f78e0396640 1 -- 172.21.15.46:0/1447065076 wait complete. 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 -- 172.21.15.46:0/535466288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 msgr2=0x7f0118107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 --2- 172.21.15.46:0/535466288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118107ce0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0108009880 tx=0x7f010802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 -- 172.21.15.46:0/535466288 shutdown_connections 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 --2- 172.21.15.46:0/535466288 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0118101900 0x7f0118101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 --2- 172.21.15.46:0/535466288 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118107ce0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 -- 172.21.15.46:0/535466288 >> 172.21.15.46:0/535466288 conn(0x7f01180fd600 msgr2=0x7f01180ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 -- 172.21.15.46:0/535466288 shutdown_connections 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.821+0000 7f011e3a0640 1 -- 172.21.15.46:0/535466288 wait complete. 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f011e3a0640 1 Processor -- start 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f011e3a0640 1 -- start start 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f011e3a0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0118101900 0x7f01180744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f011e3a0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f011e3a0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f011810edb0 con 0x7f0118107900 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f011e3a0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f011810ec30 con 0x7f0118101900 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f01177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f01177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44920/0 (socket says 172.21.15.46:44920) 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f01177fe640 1 -- 172.21.15.46:0/1149304307 learned_addr learned my addr 172.21.15.46:0/1149304307 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.822+0000 7f0117fff640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0118101900 0x7f01180744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01177fe640 1 -- 172.21.15.46:0/1149304307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0118101900 msgr2=0x7f01180744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01177fe640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0118101900 0x7f01180744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:37.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01177fe640 1 -- 172.21.15.46:0/1149304307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118074f70 con 0x7f0118107900 2024-09-21T12:51:37.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01177fe640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118074a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c8a0 tx=0x7f010c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:37.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f010c0079b0 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f010c007b50 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0118075260 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f010c018700 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.823+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181a3de0 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.824+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0118103040 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.825+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f010c007d00 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.825+0000 7f01157fa640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f010007af30 0x7f010007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.825+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f010c09e260 con 0x7f0118107900 2024-09-21T12:51:37.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.825+0000 7f0117fff640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f010007af30 0x7f010007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:37.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.826+0000 7f0117fff640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f010007af30 0x7f010007d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0108000c00 tx=0x7f0108031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:37.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:37.830+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f010c014030 con 0x7f0118107900 2024-09-21T12:51:38.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.098+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0118104b10 con 0x7f0118107900 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:51:38.101 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:51:38.102 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 10, 2024-09-21T12:51:38.102 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:51:38.102 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:51:38.102 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:51:38.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.099+0000 7f01157fa640 1 -- 172.21.15.46:0/1149304307 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f010c069860 con 0x7f0118107900 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.101+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f010007af30 msgr2=0x7f010007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.101+0000 7f011e3a0640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f010007af30 0x7f010007d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0108000c00 tx=0x7f0108031400 comp rx=0 tx=0).stop 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.101+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 msgr2=0x7f0118074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.101+0000 7f011e3a0640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118074a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f010c00c8a0 tx=0x7f010c00cd60 comp rx=0 tx=0).stop 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 shutdown_connections 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f010007af30 0x7f010007d3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0118107900 0x7f0118074a30 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 --2- 172.21.15.46:0/1149304307 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0118101900 0x7f01180744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 >> 172.21.15.46:0/1149304307 conn(0x7f01180fd600 msgr2=0x7f01180ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 shutdown_connections 2024-09-21T12:51:38.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.102+0000 7f011e3a0640 1 -- 172.21.15.46:0/1149304307 wait complete. 2024-09-21T12:51:38.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 -- 172.21.15.46:0/120314563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c107900 msgr2=0x7f642c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 --2- 172.21.15.46:0/120314563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c107900 0x7f642c107ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f641c009880 tx=0x7f641c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 -- 172.21.15.46:0/120314563 shutdown_connections 2024-09-21T12:51:38.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 --2- 172.21.15.46:0/120314563 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c101900 0x7f642c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 --2- 172.21.15.46:0/120314563 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c107900 0x7f642c107ce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 -- 172.21.15.46:0/120314563 >> 172.21.15.46:0/120314563 conn(0x7f642c0fd5e0 msgr2=0x7f642c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:38.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 -- 172.21.15.46:0/120314563 shutdown_connections 2024-09-21T12:51:38.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 -- 172.21.15.46:0/120314563 wait complete. 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 Processor -- start 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.188+0000 7f6432de4640 1 -- start start 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6432de4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 0x7f642c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6432de4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c107900 0x7f642c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6432de4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10edb0 con 0x7f642c101900 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6432de4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f642c10ec30 con 0x7f642c107900 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 0x7f642c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 0x7f642c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44934/0 (socket says 172.21.15.46:44934) 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 -- 172.21.15.46:0/681826995 learned_addr learned my addr 172.21.15.46:0/681826995 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f642bfff640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c107900 0x7f642c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 -- 172.21.15.46:0/681826995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c107900 msgr2=0x7f642c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c107900 0x7f642c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 -- 172.21.15.46:0/681826995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c074f70 con 0x7f642c101900 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f642bfff640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c107900 0x7f642c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.189+0000 7f6430b80640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 0x7f642c0744f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f641c031460 tx=0x7f641c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.190+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f641c03f070 con 0x7f642c101900 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.190+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f641c0035f0 con 0x7f642c101900 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.190+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642c075200 con 0x7f642c101900 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.190+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f641c035030 con 0x7f642c101900 2024-09-21T12:51:38.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.190+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642c1a3d60 con 0x7f642c101900 2024-09-21T12:51:38.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.191+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642c103040 con 0x7f642c101900 2024-09-21T12:51:38.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.192+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f641c042070 con 0x7f642c101900 2024-09-21T12:51:38.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.192+0000 7f6429ffb640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f641407af80 0x7f641407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.193+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f641c0be910 con 0x7f642c101900 2024-09-21T12:51:38.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.193+0000 7f642bfff640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f641407af80 0x7f641407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.193+0000 7f642bfff640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f641407af80 0x7f641407d440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f642c075f80 tx=0x7f6420005e50 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:38.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.199+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f641c089f90 con 0x7f642c101900 2024-09-21T12:51:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:38 smithi046 ceph-mon[108126]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:38 smithi046 ceph-mon[108126]: pgmap v120: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:38.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:38 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1149304307' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:38.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.431+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f642c104b10 con 0x7f642c101900 2024-09-21T12:51:38.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.432+0000 7f6429ffb640 1 -- 172.21.15.46:0/681826995 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f641c08ee40 con 0x7f642c101900 2024-09-21T12:51:38.433 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:51:38.433 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:51:38.433 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:51:38.433 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:51:38.434 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:51:38.435 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:51:38.436 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f641407af80 msgr2=0x7f641407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f641407af80 0x7f641407d440 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f642c075f80 tx=0x7f6420005e50 comp rx=0 tx=0).stop 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 msgr2=0x7f642c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 0x7f642c0744f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f641c031460 tx=0x7f641c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 shutdown_connections 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f641407af80 0x7f641407d440 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f642c107900 0x7f642c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 --2- 172.21.15.46:0/681826995 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f642c101900 0x7f642c0744f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 >> 172.21.15.46:0/681826995 conn(0x7f642c0fd5e0 msgr2=0x7f642c0feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 shutdown_connections 2024-09-21T12:51:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.434+0000 7f6432de4640 1 -- 172.21.15.46:0/681826995 wait complete. 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 -- 172.21.15.46:0/172671103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88101910 msgr2=0x7f3d88101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/172671103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88101910 0x7f3d88101d70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3d78009880 tx=0x7f3d7802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 -- 172.21.15.46:0/172671103 shutdown_connections 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/172671103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88101910 0x7f3d88101d70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/172671103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88107910 0x7f3d88107cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 -- 172.21.15.46:0/172671103 >> 172.21.15.46:0/172671103 conn(0x7f3d880fd630 msgr2=0x7f3d880ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 -- 172.21.15.46:0/172671103 shutdown_connections 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.520+0000 7f3d8f25a640 1 -- 172.21.15.46:0/172671103 wait complete. 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8f25a640 1 Processor -- start 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8f25a640 1 -- start start 2024-09-21T12:51:38.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8f25a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88101910 0x7f3d8819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8f25a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 0x7f3d8819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8f25a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8810ede0 con 0x7f3d88107910 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8f25a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8810ec60 con 0x7f3d88101910 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d7ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 0x7f3d8819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d7ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 0x7f3d8819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44946/0 (socket says 172.21.15.46:44946) 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d7ffff640 1 -- 172.21.15.46:0/1322074406 learned_addr learned my addr 172.21.15.46:0/1322074406 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8cff6640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88101910 0x7f3d8819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d7ffff640 1 -- 172.21.15.46:0/1322074406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88101910 msgr2=0x7f3d8819f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d7ffff640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88101910 0x7f3d8819f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d7ffff640 1 -- 172.21.15.46:0/1322074406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d881999a0 con 0x7f3d88107910 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.521+0000 7f3d8cff6640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88101910 0x7f3d8819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:51:38.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.522+0000 7f3d7ffff640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 0x7f3d8819fd20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78031460 tx=0x7f3d780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:38.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.522+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d7803f070 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.522+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d780035f0 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.522+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d88199c30 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.522+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d78035030 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.522+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8819a160 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.523+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d88103050 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.524+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3d78042070 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.524+0000 7f3d7dffb640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3d7007af30 0x7f3d7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.524+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f3d780bea20 con 0x7f3d88107910 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.524+0000 7f3d8cff6640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3d7007af30 0x7f3d7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.525+0000 7f3d8cff6640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3d7007af30 0x7f3d7007d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d84005fd0 tx=0x7f3d84005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:38.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.529+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d7808a020 con 0x7f3d88107910 2024-09-21T12:51:38.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:38 smithi176 ceph-mon[80162]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:38 smithi176 ceph-mon[80162]: pgmap v120: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:38.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:38 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1149304307' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:38.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.760+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d8819a410 con 0x7f3d7007af30 2024-09-21T12:51:38.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.761+0000 7f3d7dffb640 1 -- 172.21.15.46:0/1322074406 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f3d8819a410 con 0x7f3d7007af30 2024-09-21T12:51:38.762 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:51:38.762 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:51:38.762 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "4/23 daemons upgraded", 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading crash daemons", 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:51:38.763 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3d7007af30 msgr2=0x7f3d7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3d7007af30 0x7f3d7007d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3d84005fd0 tx=0x7f3d84005850 comp rx=0 tx=0).stop 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 msgr2=0x7f3d8819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 0x7f3d8819fd20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3d78031460 tx=0x7f3d780045e0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 shutdown_connections 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3d7007af30 0x7f3d7007d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d88107910 0x7f3d8819fd20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 --2- 172.21.15.46:0/1322074406 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d88101910 0x7f3d8819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 >> 172.21.15.46:0/1322074406 conn(0x7f3d880fd630 msgr2=0x7f3d88074460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 shutdown_connections 2024-09-21T12:51:38.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.763+0000 7f3d8f25a640 1 -- 172.21.15.46:0/1322074406 wait complete. 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2217298872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381007f0 msgr2=0x7f1f38100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2217298872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381007f0 0x7f1f38100c50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1f28009c20 tx=0x7f1f2802a970 comp rx=0 tx=0).stop 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2217298872 shutdown_connections 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2217298872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381007f0 0x7f1f38100c50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2217298872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f381067f0 0x7f1f38106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2217298872 >> 172.21.15.46:0/2217298872 conn(0x7f1f380fc550 msgr2=0x7f1f380fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2217298872 shutdown_connections 2024-09-21T12:51:38.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.858+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2217298872 wait complete. 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ecfb640 1 Processor -- start 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ecfb640 1 -- start start 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ecfb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f381007f0 0x7f1f380fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ecfb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 0x7f1f380fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ecfb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3810dca0 con 0x7f1f381067f0 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ecfb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3810db20 con 0x7f1f381007f0 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f37fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 0x7f1f380fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f37fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 0x7f1f380fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44964/0 (socket says 172.21.15.46:44964) 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f37fff640 1 -- 172.21.15.46:0/2199432392 learned_addr learned my addr 172.21.15.46:0/2199432392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.859+0000 7f1f3ca97640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f381007f0 0x7f1f380fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f37fff640 1 -- 172.21.15.46:0/2199432392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f381007f0 msgr2=0x7f1f380fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f37fff640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f381007f0 0x7f1f380fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f37fff640 1 -- 172.21.15.46:0/2199432392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f380fd700 con 0x7f1f381067f0 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f37fff640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 0x7f1f380fd1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f2802ae90 tx=0x7f1f2802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f28047070 con 0x7f1f381067f0 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f380fd990 con 0x7f1f381067f0 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1f2802f7e0 con 0x7f1f381067f0 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1f28034070 con 0x7f1f381067f0 2024-09-21T12:51:38.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.860+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f381a3d40 con 0x7f1f381067f0 2024-09-21T12:51:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.861+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f38101f30 con 0x7f1f381067f0 2024-09-21T12:51:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.862+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1f2804a070 con 0x7f1f381067f0 2024-09-21T12:51:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.863+0000 7f1f35ffb640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1f2407af30 0x7f1f2407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:51:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.863+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 6156+0+0 (secure 0 0 0) 0x7f1f280bec60 con 0x7f1f381067f0 2024-09-21T12:51:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.863+0000 7f1f3ca97640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1f2407af30 0x7f1f2407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:51:38.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.863+0000 7f1f3ca97640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1f2407af30 0x7f1f2407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000bbe0 tx=0x7f1f2000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:51:38.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:38.867+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1f2803f070 con 0x7f1f381067f0 2024-09-21T12:51:39.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.146+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1f380fe1b0 con 0x7f1f381067f0 2024-09-21T12:51:39.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.147+0000 7f1f35ffb640 1 -- 172.21.15.46:0/2199432392 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f1f2808a260 con 0x7f1f381067f0 2024-09-21T12:51:39.149 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:39.149 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:51:39.149 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1f2407af30 msgr2=0x7f1f2407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1f2407af30 0x7f1f2407d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f2000bbe0 tx=0x7f1f2000b390 comp rx=0 tx=0).stop 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 msgr2=0x7f1f380fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 0x7f1f380fd1c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1f2802ae90 tx=0x7f1f2802f5f0 comp rx=0 tx=0).stop 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 shutdown_connections 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1f2407af30 0x7f1f2407d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f381067f0 0x7f1f380fd1c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 --2- 172.21.15.46:0/2199432392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f381007f0 0x7f1f380fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 >> 172.21.15.46:0/2199432392 conn(0x7f1f380fc550 msgr2=0x7f1f38069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 shutdown_connections 2024-09-21T12:51:39.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:51:39.149+0000 7f1f3ecfb640 1 -- 172.21.15.46:0/2199432392 wait complete. 2024-09-21T12:51:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:39 smithi046 ceph-mon[108126]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:39 smithi046 ceph-mon[108126]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:39 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/681826995' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:51:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:39 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2199432392' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:51:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:39 smithi176 ceph-mon[80162]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:39 smithi176 ceph-mon[80162]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:39.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:39 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/681826995' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:51:39.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:39 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2199432392' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:51:40.280 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:40 smithi176 ceph-mon[80162]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:40.280 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:40 smithi176 ceph-mon[80162]: pgmap v121: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:40.280 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:40.280 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:40 smithi046 ceph-mon[108126]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:51:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:40 smithi046 ceph-mon[108126]: pgmap v121: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:41 smithi046 ceph-mon[108126]: Upgrade: Updating crash.smithi176 (2/2) 2024-09-21T12:51:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:51:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:41 smithi046 ceph-mon[108126]: Deploying daemon crash.smithi176 on smithi176 2024-09-21T12:51:42.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:41 smithi046 ceph-mon[108126]: pgmap v122: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:42.206 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:41 smithi176 ceph-mon[80162]: Upgrade: Updating crash.smithi176 (2/2) 2024-09-21T12:51:42.206 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:42.206 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi176", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:51:42.206 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:42.206 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:41 smithi176 ceph-mon[80162]: Deploying daemon crash.smithi176 on smithi176 2024-09-21T12:51:42.206 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:41 smithi176 ceph-mon[80162]: pgmap v122: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:43 smithi176 ceph-mon[80162]: pgmap v123: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:43.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:43 smithi046 ceph-mon[108126]: pgmap v123: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:44.428 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:51:44.428 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:44.428 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:44.428 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:44.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:51:44.860 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:44.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:44.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:45.686 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:45 smithi176 ceph-mon[80162]: pgmap v124: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:45.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:45 smithi046 ceph-mon[108126]: pgmap v124: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:48.091 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:47 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.091 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:47 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.091 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:47 smithi176 ceph-mon[80162]: pgmap v125: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:48.091 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:47 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.091 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:47 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:47 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:47 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:47 smithi046 ceph-mon[108126]: pgmap v125: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:47 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:47 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:50 smithi176 ceph-mon[80162]: pgmap v126: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:50.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:50 smithi046 ceph-mon[108126]: pgmap v126: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:50.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:50.570 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:52.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:51 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:52.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:51 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:52.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:51 smithi176 ceph-mon[80162]: pgmap v127: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:52.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:51 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:52.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:51 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:52.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:51 smithi046 ceph-mon[108126]: pgmap v127: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all crash 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"} : dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]': finished 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi176"} : dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi176"}]': finished 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: Upgrade: osd.0 is safe to restart 2024-09-21T12:51:54.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:54 smithi046 ceph-mon[108126]: pgmap v128: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all crash 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"} : dispatch 2024-09-21T12:51:54.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi046"}]': finished 2024-09-21T12:51:54.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi176"} : dispatch 2024-09-21T12:51:54.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi176"}]': finished 2024-09-21T12:51:54.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T12:51:54.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T12:51:54.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: Upgrade: osd.0 is safe to restart 2024-09-21T12:51:54.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:54 smithi176 ceph-mon[80162]: pgmap v128: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:55.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:55 smithi046 ceph-mon[108126]: Upgrade: Updating osd.0 2024-09-21T12:51:55.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:55 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:55.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:55 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T12:51:55.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:55 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:55.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:55 smithi046 ceph-mon[108126]: Deploying daemon osd.0 on smithi046 2024-09-21T12:51:55.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:55 smithi046 ceph-mon[108126]: pgmap v129: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:56.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:55 smithi176 ceph-mon[80162]: Upgrade: Updating osd.0 2024-09-21T12:51:56.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:55 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:56.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:55 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T12:51:56.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:55 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:51:56.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:55 smithi176 ceph-mon[80162]: Deploying daemon osd.0 on smithi046 2024-09-21T12:51:56.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:55 smithi176 ceph-mon[80162]: pgmap v129: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:51:57.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:57 smithi176 ceph-mon[80162]: pgmap v130: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:57.861 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:57 smithi046 ceph-mon[108126]: pgmap v130: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:51:57.861 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:57 smithi046 systemd[1]: Stopping Ceph osd.0 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:51:58.162 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:57 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[48077]: 2024-09-21T12:51:57.938+0000 7f20d4bb7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:51:58.162 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:57 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[48077]: 2024-09-21T12:51:57.938+0000 7f20d4bb7640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-21T12:51:58.162 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:57 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[48077]: 2024-09-21T12:51:57.938+0000 7f20d4bb7640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:51:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:58 smithi176 ceph-mon[80162]: osd.0 marked itself down and dead 2024-09-21T12:51:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:58 smithi046 ceph-mon[108126]: osd.0 marked itself down and dead 2024-09-21T12:51:59.283 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:58 smithi046 podman[116267]: 2024-09-21 12:51:58.981231042 +0000 UTC m=+1.165939762 container died 55bcbcc129fec47ff93060f1f3e8e694d0d7f95c3b93f1d26df4b667d6fa2fb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T12:51:59.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:59 smithi046 podman[116267]: 2024-09-21 12:51:59.464047631 +0000 UTC m=+1.648756353 container cleanup 55bcbcc129fec47ff93060f1f3e8e694d0d7f95c3b93f1d26df4b667d6fa2fb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:51:59.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:59 smithi046 bash[116267]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0 2024-09-21T12:51:59.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:59 smithi046 ceph-mon[108126]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:51:59.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:59 smithi046 ceph-mon[108126]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T12:51:59.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:59.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:51:59.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:51:59 smithi046 ceph-mon[108126]: pgmap v132: 65 pgs: 34 peering, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:51:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:59 smithi176 ceph-mon[80162]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:51:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:59 smithi176 ceph-mon[80162]: osdmap e48: 6 total, 5 up, 6 in 2024-09-21T12:51:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:51:59.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:51:59.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:51:59 smithi176 ceph-mon[80162]: pgmap v132: 65 pgs: 34 peering, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:52:00.090 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:51:59 smithi046 podman[116282]: 2024-09-21 12:51:59.742568674 +0000 UTC m=+0.751410826 container remove 55bcbcc129fec47ff93060f1f3e8e694d0d7f95c3b93f1d26df4b667d6fa2fb7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-4e45e6b, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T12:52:00.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:00 smithi046 podman[116371]: 2024-09-21 12:51:59.993190354 +0000 UTC m=+0.016697737 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:52:00.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:00 smithi046 podman[116371]: 2024-09-21 12:52:00.093402234 +0000 UTC m=+0.116909605 container create 495a9cb9eee2e3c3f14191f55ee728519e77312124abe6f1f0f85ab0f39f8a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T12:52:00.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:00 smithi046 podman[116371]: 2024-09-21 12:52:00.321155844 +0000 UTC m=+0.344663224 container init 495a9cb9eee2e3c3f14191f55ee728519e77312124abe6f1f0f85ab0f39f8a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:52:00.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:00 smithi046 podman[116371]: 2024-09-21 12:52:00.324700987 +0000 UTC m=+0.348208358 container start 495a9cb9eee2e3c3f14191f55ee728519e77312124abe6f1f0f85ab0f39f8a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T12:52:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:00 smithi176 ceph-mon[80162]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T12:52:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:00 smithi176 ceph-mon[80162]: Health check failed: Reduced data availability: 23 pgs peering (PG_AVAILABILITY) 2024-09-21T12:52:00.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:00 smithi046 ceph-mon[108126]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T12:52:00.892 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:00 smithi046 ceph-mon[108126]: Health check failed: Reduced data availability: 23 pgs peering (PG_AVAILABILITY) 2024-09-21T12:52:00.892 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:00 smithi046 podman[116371]: 2024-09-21 12:52:00.431331982 +0000 UTC m=+0.454839354 container attach 495a9cb9eee2e3c3f14191f55ee728519e77312124abe6f1f0f85ab0f39f8a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T12:52:00.892 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:00 smithi046 podman[116371]: 2024-09-21 12:52:00.526871843 +0000 UTC m=+0.550379231 container died 495a9cb9eee2e3c3f14191f55ee728519e77312124abe6f1f0f85ab0f39f8a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T12:52:01.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 podman[116393]: 2024-09-21 12:52:01.157932821 +0000 UTC m=+0.625310041 container remove 495a9cb9eee2e3c3f14191f55ee728519e77312124abe6f1f0f85ab0f39f8a65 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:52:01.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T12:52:01.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 systemd[1]: Stopped Ceph osd.0 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:52:01.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.0.service: Consumed 54.496s CPU time. 2024-09-21T12:52:01.765 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:01 smithi046 ceph-mon[108126]: pgmap v134: 65 pgs: 34 peering, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:52:01.766 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 systemd[1]: Starting Ceph osd.0 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:52:01.766 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 podman[116491]: 2024-09-21 12:52:01.53484504 +0000 UTC m=+0.016613170 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:52:01.766 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 podman[116491]: 2024-09-21 12:52:01.642523994 +0000 UTC m=+0.124292114 container create 91e62f5436c12fa5e5e01cd0c8abde7d3944d9ee382a14ba6fdaa1bb2827bd42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T12:52:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:01 smithi176 ceph-mon[80162]: pgmap v134: 65 pgs: 34 peering, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:52:02.026 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 podman[116491]: 2024-09-21 12:52:01.886653168 +0000 UTC m=+0.368421291 container init 91e62f5436c12fa5e5e01cd0c8abde7d3944d9ee382a14ba6fdaa1bb2827bd42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T12:52:02.026 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 podman[116491]: 2024-09-21 12:52:01.890289193 +0000 UTC m=+0.372057322 container start 91e62f5436c12fa5e5e01cd0c8abde7d3944d9ee382a14ba6fdaa1bb2827bd42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:52:02.026 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:01 smithi046 podman[116491]: 2024-09-21 12:52:01.969842199 +0000 UTC m=+0.451610327 container attach 91e62f5436c12fa5e5e01cd0c8abde7d3944d9ee382a14ba6fdaa1bb2827bd42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:52:02.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:02 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:02.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:02 smithi046 bash[116491]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:02.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:02 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:02.412 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:02 smithi046 bash[116491]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:03 smithi176 ceph-mon[80162]: pgmap v135: 65 pgs: 34 peering, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T12:52:03.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:03 smithi046 ceph-mon[108126]: pgmap v135: 65 pgs: 34 peering, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-09-21T12:52:05.290 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:04 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:52:05.290 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:04 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:05.290 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:04 smithi046 bash[116491]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:52:05.290 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:04 smithi046 bash[116491]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:04 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:04 smithi046 bash[116491]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:52:05.291 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:52:05.632 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-mon[108126]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:05.632 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-mon[108126]: Health check failed: Degraded data redundancy: 65/336 objects degraded (19.345%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:05.632 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-mon[108126]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 23 pgs peering) 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate[116506]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 bash[116491]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T12:52:05.633 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 podman[116491]: 2024-09-21 12:52:05.321179838 +0000 UTC m=+3.802947958 container died 91e62f5436c12fa5e5e01cd0c8abde7d3944d9ee382a14ba6fdaa1bb2827bd42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T12:52:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:05 smithi176 ceph-mon[80162]: pgmap v136: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:05.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:05 smithi176 ceph-mon[80162]: Health check failed: Degraded data redundancy: 65/336 objects degraded (19.345%), 20 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:05.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:05 smithi176 ceph-mon[80162]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 23 pgs peering) 2024-09-21T12:52:06.256 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:05 smithi046 podman[116723]: 2024-09-21 12:52:05.923621344 +0000 UTC m=+0.593111021 container remove 91e62f5436c12fa5e5e01cd0c8abde7d3944d9ee382a14ba6fdaa1bb2827bd42 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T12:52:06.257 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 podman[116781]: 2024-09-21 12:52:06.132789853 +0000 UTC m=+0.111053621 container create b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T12:52:06.257 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 podman[116781]: 2024-09-21 12:52:06.038285931 +0000 UTC m=+0.016549708 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:52:06.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 podman[116781]: 2024-09-21 12:52:06.368767265 +0000 UTC m=+0.347031041 container init b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:52:06.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 podman[116781]: 2024-09-21 12:52:06.37216054 +0000 UTC m=+0.350424306 container start b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T12:52:06.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 ceph-osd[116801]: -- 172.21.15.46:0/1496445062 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a6c8e881e0 con 0x55a6c8e18000 2024-09-21T12:52:06.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 bash[116781]: b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da 2024-09-21T12:52:06.662 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:06 smithi046 systemd[1]: Started Ceph osd.0 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:52:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:07 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:07 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:07 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:07.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:07 smithi046 ceph-mon[108126]: pgmap v137: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:07 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:07 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:07 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:07 smithi176 ceph-mon[80162]: pgmap v137: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:08.536 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:08 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[116797]: 2024-09-21T12:52:08.258+0000 7f28f7100640 -1 Falling back to public interface 2024-09-21T12:52:09.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.238+0000 7fe1d87bd640 1 -- 172.21.15.46:0/538598467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 msgr2=0x7fe1d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.238+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/538598467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0100c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0009880 tx=0x7fe1c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.238+0000 7fe1d87bd640 1 -- 172.21.15.46:0/538598467 shutdown_connections 2024-09-21T12:52:09.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.238+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/538598467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0100c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.238+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/538598467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d0106800 0x7fe1d0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.238+0000 7fe1d87bd640 1 -- 172.21.15.46:0/538598467 >> 172.21.15.46:0/538598467 conn(0x7fe1d00fc520 msgr2=0x7fe1d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:09.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 -- 172.21.15.46:0/538598467 shutdown_connections 2024-09-21T12:52:09.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 -- 172.21.15.46:0/538598467 wait complete. 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 Processor -- start 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 -- start start 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d0106800 0x7fe1d0198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d010dcb0 con 0x7fe1d0100800 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.239+0000 7fe1d87bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d010db30 con 0x7fe1d0106800 2024-09-21T12:52:09.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59480/0 (socket says 172.21.15.46:59480) 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 -- 172.21.15.46:0/1412301302 learned_addr learned my addr 172.21.15.46:0/1412301302 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d5d58640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d0106800 0x7fe1d0198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 -- 172.21.15.46:0/1412301302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d0106800 msgr2=0x7fe1d0198cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d0106800 0x7fe1d0198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 -- 172.21.15.46:0/1412301302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d0199310 con 0x7fe1d0100800 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d6559640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0198780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00e970 tx=0x7fe1cc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1cc00cac0 con 0x7fe1d0100800 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1cc00cc60 con 0x7fe1d0100800 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d01a17f0 con 0x7fe1d0100800 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe1cc018720 con 0x7fe1d0100800 2024-09-21T12:52:09.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.240+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d01a1bf0 con 0x7fe1d0100800 2024-09-21T12:52:09.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.241+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d0101f40 con 0x7fe1d0100800 2024-09-21T12:52:09.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.242+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe1cc010430 con 0x7fe1d0100800 2024-09-21T12:52:09.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.243+0000 7fe1c77fe640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe1bc07af30 0x7fe1bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.243+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fe1cc09e6d0 con 0x7fe1d0100800 2024-09-21T12:52:09.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.243+0000 7fe1d5d58640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe1bc07af30 0x7fe1bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.243+0000 7fe1d5d58640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe1bc07af30 0x7fe1bc07d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0031460 tx=0x7fe1c0009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:09.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.248+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe1cc069cd0 con 0x7fe1d0100800 2024-09-21T12:52:09.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.457+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe1d0062630 con 0x7fe1bc07af30 2024-09-21T12:52:09.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.458+0000 7fe1c77fe640 1 -- 172.21.15.46:0/1412301302 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fe1d0062630 con 0x7fe1bc07af30 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe1bc07af30 msgr2=0x7fe1bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe1bc07af30 0x7fe1bc07d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe1c0031460 tx=0x7fe1c0009560 comp rx=0 tx=0).stop 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 msgr2=0x7fe1d0198780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0198780 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc00e970 tx=0x7fe1cc00ee30 comp rx=0 tx=0).stop 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 shutdown_connections 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe1bc07af30 0x7fe1bc07d3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1d0106800 0x7fe1d0198cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 --2- 172.21.15.46:0/1412301302 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe1d0100800 0x7fe1d0198780 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 >> 172.21.15.46:0/1412301302 conn(0x7fe1d00fc520 msgr2=0x7fe1d00fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 shutdown_connections 2024-09-21T12:52:09.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.460+0000 7fe1d87bd640 1 -- 172.21.15.46:0/1412301302 wait complete. 2024-09-21T12:52:09.471 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:52:09.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 -- 172.21.15.46:0/3054879434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 msgr2=0x7fd70410b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3054879434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd70410b980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009880 tx=0x7fd6f402a530 comp rx=0 tx=0).stop 2024-09-21T12:52:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 -- 172.21.15.46:0/3054879434 shutdown_connections 2024-09-21T12:52:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3054879434 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd70410b980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3054879434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd704102b70 0x7fd704102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 -- 172.21.15.46:0/3054879434 >> 172.21.15.46:0/3054879434 conn(0x7fd7040fc550 msgr2=0x7fd7040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 -- 172.21.15.46:0/3054879434 shutdown_connections 2024-09-21T12:52:09.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 -- 172.21.15.46:0/3054879434 wait complete. 2024-09-21T12:52:09.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 Processor -- start 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.547+0000 7fd70af0c640 1 -- start start 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd70af0c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd704102b70 0x7fd7041007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd70af0c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd704100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd70af0c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd70410ede0 con 0x7fd704103490 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd70af0c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd70410ec60 con 0x7fd704102b70 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd704100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd704100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59490/0 (socket says 172.21.15.46:59490) 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 -- 172.21.15.46:0/3710282189 learned_addr learned my addr 172.21.15.46:0/3710282189 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd708ca8640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd704102b70 0x7fd7041007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 -- 172.21.15.46:0/3710282189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd704102b70 msgr2=0x7fd7041007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd704102b70 0x7fd7041007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 -- 172.21.15.46:0/3710282189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd704101250 con 0x7fd704103490 2024-09-21T12:52:09.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.548+0000 7fd703fff640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd704100d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4004f90 tx=0x7fd6f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.549+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6f403f070 con 0x7fd704103490 2024-09-21T12:52:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.549+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7041014e0 con 0x7fd704103490 2024-09-21T12:52:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.549+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6f4004cf0 con 0x7fd704103490 2024-09-21T12:52:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.549+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6f4035030 con 0x7fd704103490 2024-09-21T12:52:09.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.549+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7041a3d90 con 0x7fd704103490 2024-09-21T12:52:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.550+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd70406a4c0 con 0x7fd704103490 2024-09-21T12:52:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.551+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd6f4042070 con 0x7fd704103490 2024-09-21T12:52:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.551+0000 7fd701ffb640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd6f007af30 0x7fd6f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.551+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fd6f40beb20 con 0x7fd704103490 2024-09-21T12:52:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.551+0000 7fd708ca8640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd6f007af30 0x7fd6f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.552+0000 7fd708ca8640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd6f007af30 0x7fd6f007d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005c40 tx=0x7fd6fc00a390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:09.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.556+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6f408a120 con 0x7fd704103490 2024-09-21T12:52:09.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.769+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd704062630 con 0x7fd6f007af30 2024-09-21T12:52:09.771 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:09 smithi046 ceph-mon[108126]: pgmap v138: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:09.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.771+0000 7fd701ffb640 1 -- 172.21.15.46:0/3710282189 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fd704062630 con 0x7fd6f007af30 2024-09-21T12:52:09.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd6f007af30 msgr2=0x7fd6f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd6f007af30 0x7fd6f007d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc005c40 tx=0x7fd6fc00a390 comp rx=0 tx=0).stop 2024-09-21T12:52:09.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 msgr2=0x7fd704100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd704100d10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4004f90 tx=0x7fd6f40048f0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 shutdown_connections 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd6f007af30 0x7fd6f007d3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd704103490 0x7fd704100d10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 --2- 172.21.15.46:0/3710282189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd704102b70 0x7fd7041007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 >> 172.21.15.46:0/3710282189 conn(0x7fd7040fc550 msgr2=0x7fd704103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 shutdown_connections 2024-09-21T12:52:09.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.773+0000 7fd70af0c640 1 -- 172.21.15.46:0/3710282189 wait complete. 2024-09-21T12:52:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:09 smithi176 ceph-mon[80162]: pgmap v138: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/2615627351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8101900 msgr2=0x7f9df8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/2615627351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8101900 0x7f9df8101d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009880 tx=0x7f9dec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/2615627351 shutdown_connections 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/2615627351 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8101900 0x7f9df8101d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/2615627351 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9df8107900 0x7f9df8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/2615627351 >> 172.21.15.46:0/2615627351 conn(0x7f9df80fd600 msgr2=0x7f9df80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:09.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.857+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/2615627351 shutdown_connections 2024-09-21T12:52:09.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.858+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/2615627351 wait complete. 2024-09-21T12:52:09.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.858+0000 7f9dfdc8c640 1 Processor -- start 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.858+0000 7f9dfdc8c640 1 -- start start 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.858+0000 7f9dfdc8c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9df8101900 0x7f9df80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.858+0000 7f9dfdc8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 0x7f9df8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9dfdc8c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9df810edb0 con 0x7f9df8107900 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9dfdc8c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9df810ec30 con 0x7f9df8101900 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 0x7f9df8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 0x7f9df8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59518/0 (socket says 172.21.15.46:59518) 2024-09-21T12:52:09.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 -- 172.21.15.46:0/4209962241 learned_addr learned my addr 172.21.15.46:0/4209962241 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:09.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df77fe640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9df8101900 0x7f9df80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 -- 172.21.15.46:0/4209962241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9df8101900 msgr2=0x7f9df80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:09.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9df8101900 0x7f9df80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:09.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 -- 172.21.15.46:0/4209962241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df8074f70 con 0x7f9df8107900 2024-09-21T12:52:09.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df6ffd640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 0x7f9df8074a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9dec031460 tx=0x7f9dec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:09.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dec03f070 con 0x7f9df8107900 2024-09-21T12:52:09.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df8075200 con 0x7f9df8107900 2024-09-21T12:52:09.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9dec0035f0 con 0x7f9df8107900 2024-09-21T12:52:09.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9dec035030 con 0x7f9df8107900 2024-09-21T12:52:09.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.859+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df81a3dc0 con 0x7f9df8107900 2024-09-21T12:52:09.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.861+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df8103040 con 0x7f9df8107900 2024-09-21T12:52:09.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.861+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9dec042070 con 0x7f9df8107900 2024-09-21T12:52:09.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.862+0000 7f9df4ff9640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9de007af30 0x7f9de007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:09.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.862+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f9dec0bea20 con 0x7f9df8107900 2024-09-21T12:52:09.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.862+0000 7f9df77fe640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9de007af30 0x7f9de007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:09.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.862+0000 7f9df77fe640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9de007af30 0x7f9de007d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005fd0 tx=0x7f9de8005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:09.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:09.866+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9dec08a020 con 0x7f9df8107900 2024-09-21T12:52:10.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.064+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9df8062630 con 0x7f9de007af30 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.076+0000 7f9df4ff9640 1 -- 172.21.15.46:0/4209962241 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f9df8062630 con 0x7f9de007af30 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 20s ago 13m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (5m) 20s ago 13m 8854k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (5m) 23s ago 12m 8799k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (30s) 20s ago 13m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (26s) 23s ago 12m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:52:10.077 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (118s) 20s ago 12m 74.8M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (7m) 20s ago 7m 93.1M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (7m) 20s ago 7m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (7m) 23s ago 7m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (7m) 23s ago 7m 26.8M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (4m) 20s ago 14m 525M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (3m) 23s ago 12m 457M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (59s) 20s ago 14m 37.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (44s) 23s ago 12m 26.1M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (3m) 20s ago 13m 12.0M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (3m) 23s ago 12m 11.6M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 starting - - - 1217M 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 20s ago 10m 218M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 20s ago 10m 179M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:52:10.078 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (9m) 23s ago 9m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:52:10.079 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (9m) 23s ago 9m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:52:10.079 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (8m) 23s ago 8m 190M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:52:10.079 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (2m) 20s ago 12m 50.1M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:52:10.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9de007af30 msgr2=0x7f9de007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9de007af30 0x7f9de007d3f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9de8005fd0 tx=0x7f9de8005850 comp rx=0 tx=0).stop 2024-09-21T12:52:10.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 msgr2=0x7f9df8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 0x7f9df8074a30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9dec031460 tx=0x7f9dec0045e0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 shutdown_connections 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9de007af30 0x7f9de007d3f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9df8107900 0x7f9df8074a30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 --2- 172.21.15.46:0/4209962241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9df8101900 0x7f9df80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 >> 172.21.15.46:0/4209962241 conn(0x7f9df80fd600 msgr2=0x7f9df80fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 shutdown_connections 2024-09-21T12:52:10.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.079+0000 7f9dfdc8c640 1 -- 172.21.15.46:0/4209962241 wait complete. 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.169+0000 7f4ff3a19640 1 -- 172.21.15.46:0/3560455062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 msgr2=0x7f4fec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.169+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/3560455062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec107ce0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8009880 tx=0x7f4fe802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 -- 172.21.15.46:0/3560455062 shutdown_connections 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/3560455062 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 0x7f4fec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/3560455062 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec107ce0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 -- 172.21.15.46:0/3560455062 >> 172.21.15.46:0/3560455062 conn(0x7f4fec0fd600 msgr2=0x7f4fec0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 -- 172.21.15.46:0/3560455062 shutdown_connections 2024-09-21T12:52:10.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 -- 172.21.15.46:0/3560455062 wait complete. 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 Processor -- start 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.170+0000 7f4ff3a19640 1 -- start start 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff3a19640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 0x7f4fec19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff3a19640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff3a19640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec10edd0 con 0x7f4fec107900 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff3a19640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec10ec50 con 0x7f4fec101900 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59532/0 (socket says 172.21.15.46:59532) 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 -- 172.21.15.46:0/560548468 learned_addr learned my addr 172.21.15.46:0/560548468 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff17b5640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 0x7f4fec19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 -- 172.21.15.46:0/560548468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 msgr2=0x7f4fec19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 0x7f4fec19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 -- 172.21.15.46:0/560548468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec1977a0 con 0x7f4fec107900 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff17b5640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 0x7f4fec19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff0fb4640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec19db60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c8f0 tx=0x7f4fdc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fdc0079b0 con 0x7f4fec107900 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fdc0054e0 con 0x7f4fec107900 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fec197a90 con 0x7f4fec107900 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.171+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4fdc004dd0 con 0x7f4fec107900 2024-09-21T12:52:10.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.172+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fec198020 con 0x7f4fec107900 2024-09-21T12:52:10.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.172+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fec103040 con 0x7f4fec107900 2024-09-21T12:52:10.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.173+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4fdc005020 con 0x7f4fec107900 2024-09-21T12:52:10.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.174+0000 7f4fe27fc640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4fd807af30 0x7f4fd807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.174+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f4fdc09dea0 con 0x7f4fec107900 2024-09-21T12:52:10.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.174+0000 7f4ff17b5640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4fd807af30 0x7f4fd807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.174+0000 7f4ff17b5640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4fd807af30 0x7f4fd807d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8006010 tx=0x7f4fe80095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:10.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.178+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4fdc014030 con 0x7f4fec107900 2024-09-21T12:52:10.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.462+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4fec109e70 con 0x7f4fec107900 2024-09-21T12:52:10.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.463+0000 7f4fe27fc640 1 -- 172.21.15.46:0/560548468 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f4fdc069520 con 0x7f4fec107900 2024-09-21T12:52:10.464 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:10.465 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 9, 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:52:10.466 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4fd807af30 msgr2=0x7f4fd807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4fd807af30 0x7f4fd807d3f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4fe8006010 tx=0x7f4fe80095f0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 msgr2=0x7f4fec19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec19db60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc00c8f0 tx=0x7f4fdc00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 shutdown_connections 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4fd807af30 0x7f4fd807d3f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4fec107900 0x7f4fec19db60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 --2- 172.21.15.46:0/560548468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4fec101900 0x7f4fec19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.465+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 >> 172.21.15.46:0/560548468 conn(0x7f4fec0fd600 msgr2=0x7f4fec0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:10.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.466+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 shutdown_connections 2024-09-21T12:52:10.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.466+0000 7f4ff3a19640 1 -- 172.21.15.46:0/560548468 wait complete. 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.549+0000 7f7534b9c640 1 -- 172.21.15.46:0/1930941084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7530102ab0 msgr2=0x7f7530102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 --2- 172.21.15.46:0/1930941084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7530102ab0 0x7f7530102e90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7528009c20 tx=0x7f752802aa00 comp rx=0 tx=0).stop 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 -- 172.21.15.46:0/1930941084 shutdown_connections 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 --2- 172.21.15.46:0/1930941084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f75301033d0 0x7f753010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 --2- 172.21.15.46:0/1930941084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7530102ab0 0x7f7530102e90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 -- 172.21.15.46:0/1930941084 >> 172.21.15.46:0/1930941084 conn(0x7f75300fc550 msgr2=0x7f75300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:10.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 -- 172.21.15.46:0/1930941084 shutdown_connections 2024-09-21T12:52:10.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 -- 172.21.15.46:0/1930941084 wait complete. 2024-09-21T12:52:10.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.550+0000 7f7534b9c640 1 Processor -- start 2024-09-21T12:52:10.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f7534b9c640 1 -- start start 2024-09-21T12:52:10.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f7534b9c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7530102ab0 0x7f7530100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f7534b9c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 0x7f7530100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f7534b9c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f753010ede0 con 0x7f75301033d0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f7534b9c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f753010ec60 con 0x7f7530102ab0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 0x7f7530100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 0x7f7530100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59542/0 (socket says 172.21.15.46:59542) 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 -- 172.21.15.46:0/2871125964 learned_addr learned my addr 172.21.15.46:0/2871125964 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752e59c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7530102ab0 0x7f7530100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 -- 172.21.15.46:0/2871125964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7530102ab0 msgr2=0x7f7530100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7530102ab0 0x7f7530100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 -- 172.21.15.46:0/2871125964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7530101190 con 0x7f75301033d0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752e59c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7530102ab0 0x7f7530100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.551+0000 7f752dd9b640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 0x7f7530100c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f751800d6d0 tx=0x7f751800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.552+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7518017070 con 0x7f75301033d0 2024-09-21T12:52:10.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.552+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75180054e0 con 0x7f75301033d0 2024-09-21T12:52:10.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.552+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7530101480 con 0x7f75301033d0 2024-09-21T12:52:10.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.552+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7518004ae0 con 0x7f75301033d0 2024-09-21T12:52:10.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.552+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75301a3e30 con 0x7f75301033d0 2024-09-21T12:52:10.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.553+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753006a580 con 0x7f75301033d0 2024-09-21T12:52:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.553+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7518004d90 con 0x7f75301033d0 2024-09-21T12:52:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.554+0000 7f75277fe640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f751c07af90 0x7f751c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.554+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7f751809db40 con 0x7f75301033d0 2024-09-21T12:52:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.554+0000 7f752e59c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f751c07af90 0x7f751c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.555+0000 7f752e59c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f751c07af90 0x7f751c07d450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f80 tx=0x7f752803a040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:10.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.558+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f75180691c0 con 0x7f75301033d0 2024-09-21T12:52:10.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.790+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f75301a4120 con 0x7f75301033d0 2024-09-21T12:52:10.792 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:10 smithi046 ceph-mon[108126]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:10.792 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:10 smithi046 ceph-mon[108126]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:10.792 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:10 smithi046 ceph-mon[108126]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:10.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.791+0000 7f75277fe640 1 -- 172.21.15.46:0/2871125964 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f751806e070 con 0x7f75301033d0 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:52:10.793 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:52:10.794 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:10.795 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:10.796 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:10.796 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:10.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:52:10.796 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f751c07af90 msgr2=0x7f751c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f751c07af90 0x7f751c07d450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7528000f80 tx=0x7f752803a040 comp rx=0 tx=0).stop 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 msgr2=0x7f7530100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 0x7f7530100c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f751800d6d0 tx=0x7f751800db90 comp rx=0 tx=0).stop 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 shutdown_connections 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f751c07af90 0x7f751c07d450 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f75301033d0 0x7f7530100c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 --2- 172.21.15.46:0/2871125964 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7530102ab0 0x7f7530100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 >> 172.21.15.46:0/2871125964 conn(0x7f75300fc550 msgr2=0x7f753010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:10.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 shutdown_connections 2024-09-21T12:52:10.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.793+0000 7f7534b9c640 1 -- 172.21.15.46:0/2871125964 wait complete. 2024-09-21T12:52:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:10 smithi176 ceph-mon[80162]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:10 smithi176 ceph-mon[80162]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:10 smithi176 ceph-mon[80162]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 -- 172.21.15.46:0/2113221056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 msgr2=0x7fc3b8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/2113221056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b8101d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0009880 tx=0x7fc3a002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 -- 172.21.15.46:0/2113221056 shutdown_connections 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/2113221056 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b8101d60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/2113221056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b8107900 0x7fc3b8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 -- 172.21.15.46:0/2113221056 >> 172.21.15.46:0/2113221056 conn(0x7fc3b80fd600 msgr2=0x7fc3b80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 -- 172.21.15.46:0/2113221056 shutdown_connections 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 -- 172.21.15.46:0/2113221056 wait complete. 2024-09-21T12:52:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.879+0000 7fc3bd90f640 1 Processor -- start 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3bd90f640 1 -- start start 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3bd90f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3bd90f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b8107900 0x7fc3b8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3bd90f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b810edd0 con 0x7fc3b8101900 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3bd90f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc3b810ec50 con 0x7fc3b8107900 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59562/0 (socket says 172.21.15.46:59562) 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b6ffd640 1 -- 172.21.15.46:0/399232975 learned_addr learned my addr 172.21.15.46:0/399232975 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b67fc640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b8107900 0x7fc3b8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b6ffd640 1 -- 172.21.15.46:0/399232975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b8107900 msgr2=0x7fc3b8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b6ffd640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b8107900 0x7fc3b8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:10.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.880+0000 7fc3b6ffd640 1 -- 172.21.15.46:0/399232975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b8074f70 con 0x7fc3b8101900 2024-09-21T12:52:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.881+0000 7fc3b6ffd640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b80744f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800ea00 tx=0x7fc3a800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.881+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc3a800cb80 con 0x7fc3b8101900 2024-09-21T12:52:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.881+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc3a800cd20 con 0x7fc3b8101900 2024-09-21T12:52:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.881+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc3a8011470 con 0x7fc3b8101900 2024-09-21T12:52:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.881+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b8075260 con 0x7fc3b8101900 2024-09-21T12:52:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.881+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3b81a3e20 con 0x7fc3b8101900 2024-09-21T12:52:10.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.882+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3b8103040 con 0x7fc3b8101900 2024-09-21T12:52:10.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.883+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc3a80116e0 con 0x7fc3b8101900 2024-09-21T12:52:10.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.883+0000 7fc3bc90d640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc3a407af90 0x7fc3a407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:10.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.883+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fc3a809e320 con 0x7fc3b8101900 2024-09-21T12:52:10.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.883+0000 7fc3b67fc640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc3a407af90 0x7fc3a407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:10.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.884+0000 7fc3b67fc640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc3a407af90 0x7fc3a407d450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8075f80 tx=0x7fc3a0031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:10.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:10.888+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc3a8016030 con 0x7fc3b8101900 2024-09-21T12:52:11.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.095+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc3b8062630 con 0x7fc3a407af90 2024-09-21T12:52:11.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.097+0000 7fc3bc90d640 1 -- 172.21.15.46:0/399232975 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fc3b8062630 con 0x7fc3a407af90 2024-09-21T12:52:11.098 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:52:11.098 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:52:11.098 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "6/23 daemons upgraded", 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:52:11.099 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:52:11.100 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:52:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc3a407af90 msgr2=0x7fc3a407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc3a407af90 0x7fc3a407d450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8075f80 tx=0x7fc3a0031400 comp rx=0 tx=0).stop 2024-09-21T12:52:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 msgr2=0x7fc3b80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b80744f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3a800ea00 tx=0x7fc3a800eec0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 shutdown_connections 2024-09-21T12:52:11.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc3a407af90 0x7fc3a407d450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc3b8107900 0x7fc3b8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 --2- 172.21.15.46:0/399232975 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc3b8101900 0x7fc3b80744f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.099+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 >> 172.21.15.46:0/399232975 conn(0x7fc3b80fd600 msgr2=0x7fc3b80fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:11.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.100+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 shutdown_connections 2024-09-21T12:52:11.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.100+0000 7fc3bd90f640 1 -- 172.21.15.46:0/399232975 wait complete. 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 -- 172.21.15.46:0/3779162242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4101750 msgr2=0x7fbde4101bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3779162242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4101750 0x7fbde4101bb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009880 tx=0x7fbdd802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 -- 172.21.15.46:0/3779162242 shutdown_connections 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3779162242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4101750 0x7fbde4101bb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3779162242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4107750 0x7fbde4107b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 -- 172.21.15.46:0/3779162242 >> 172.21.15.46:0/3779162242 conn(0x7fbde40fd470 msgr2=0x7fbde40ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 -- 172.21.15.46:0/3779162242 shutdown_connections 2024-09-21T12:52:11.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.199+0000 7fbde8da1640 1 -- 172.21.15.46:0/3779162242 wait complete. 2024-09-21T12:52:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.200+0000 7fbde8da1640 1 Processor -- start 2024-09-21T12:52:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.200+0000 7fbde8da1640 1 -- start start 2024-09-21T12:52:11.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.200+0000 7fbde8da1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4101750 0x7fbde40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.200+0000 7fbde8da1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 0x7fbde4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.200+0000 7fbde8da1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbde410ec00 con 0x7fbde4107750 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde8da1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbde410ea80 con 0x7fbde4101750 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 0x7fbde4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4101750 0x7fbde40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde37fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4101750 0x7fbde40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:34490/0 (socket says 172.21.15.46:34490) 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 0x7fbde4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:59592/0 (socket says 172.21.15.46:59592) 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde37fe640 1 -- 172.21.15.46:0/3111427976 learned_addr learned my addr 172.21.15.46:0/3111427976 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde2ffd640 1 -- 172.21.15.46:0/3111427976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4101750 msgr2=0x7fbde40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde2ffd640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4101750 0x7fbde40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde2ffd640 1 -- 172.21.15.46:0/3111427976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbde4074f70 con 0x7fbde4107750 2024-09-21T12:52:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.201+0000 7fbde2ffd640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 0x7fbde4074a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8006010 tx=0x7fbdd80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.202+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdd803f070 con 0x7fbde4107750 2024-09-21T12:52:11.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.202+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbdd80035f0 con 0x7fbde4107750 2024-09-21T12:52:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.202+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde4075200 con 0x7fbde4107750 2024-09-21T12:52:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.202+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbdd8035030 con 0x7fbde4107750 2024-09-21T12:52:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.202+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde41a3b90 con 0x7fbde4107750 2024-09-21T12:52:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.203+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde4102e90 con 0x7fbde4107750 2024-09-21T12:52:11.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.203+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbdd8042070 con 0x7fbde4107750 2024-09-21T12:52:11.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.204+0000 7fbde0ff9640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbdcc07af80 0x7fbdcc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:11.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.204+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 6156+0+0 (secure 0 0 0) 0x7fbdd80be8a0 con 0x7fbde4107750 2024-09-21T12:52:11.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.204+0000 7fbde37fe640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbdcc07af80 0x7fbdcc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:11.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.205+0000 7fbde37fe640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbdcc07af80 0x7fbdcc07d440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4005fd0 tx=0x7fbdd400b480 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:11.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.209+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbdd8089f20 con 0x7fbde4107750 2024-09-21T12:52:11.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.552+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fbde4109ce0 con 0x7fbde4107750 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.552+0000 7fbde0ff9640 1 -- 172.21.15.46:0/3111427976 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1573 (secure 0 0 0) 0x7fbdd808edd0 con 0x7fbde4107750 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 65/336 objects degraded (19.345%), 20 pgs degraded 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout: osd.0 (root=default,host=smithi046) is down 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 65/336 objects degraded (19.345%), 20 pgs degraded 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-21T12:52:11.554 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-21T12:52:11.555 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-21T12:52:11.556 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-21T12:52:11.556 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-21T12:52:11.556 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-21T12:52:11.556 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbdcc07af80 msgr2=0x7fbdcc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbdcc07af80 0x7fbdcc07d440 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4005fd0 tx=0x7fbdd400b480 comp rx=0 tx=0).stop 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 msgr2=0x7fbde4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 0x7fbde4074a30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8006010 tx=0x7fbdd80045e0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 shutdown_connections 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbdcc07af80 0x7fbdcc07d440 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbde4107750 0x7fbde4074a30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 --2- 172.21.15.46:0/3111427976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbde4101750 0x7fbde40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 >> 172.21.15.46:0/3111427976 conn(0x7fbde40fd470 msgr2=0x7fbde40fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 shutdown_connections 2024-09-21T12:52:11.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:11.556+0000 7fbde8da1640 1 -- 172.21.15.46:0/3111427976 wait complete. 2024-09-21T12:52:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:11 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/560548468' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:11 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2871125964' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:52:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:11 smithi176 ceph-mon[80162]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:11 smithi176 ceph-mon[80162]: pgmap v139: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:11 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/560548468' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:11 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2871125964' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:52:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:11 smithi046 ceph-mon[108126]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:11 smithi046 ceph-mon[108126]: pgmap v139: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:12 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3111427976' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:52:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:12 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3111427976' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:52:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:13 smithi176 ceph-mon[80162]: pgmap v140: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:13.688 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:13 smithi046 ceph-mon[108126]: pgmap v140: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:13.688 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:13 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[116797]: 2024-09-21T12:52:13.599+0000 7f28f7100640 -1 osd.0 47 log_to_monitors true 2024-09-21T12:52:14.697 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:14 smithi046 ceph-mon[108126]: from='osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T12:52:14.697 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:14.697 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:52:14.697 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 12:52:14 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[116797]: 2024-09-21T12:52:14.457+0000 7f28eeeaa640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:52:14.733 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:14 smithi176 ceph-mon[80162]: from='osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T12:52:14.734 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:14.734 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: pgmap v142: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:15.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:52:15.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:52:15.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:15.709 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:52:15.709 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T12:52:15.709 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T12:52:15.709 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:15.709 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: pgmap v142: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:15.710 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:15.710 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:52:15.710 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:52:15.710 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:52:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662] boot 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T12:52:16.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:16 smithi176 ceph-mon[80162]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: osd.0 [v2:172.21.15.46:6802/1949953662,v1:172.21.15.46:6803/1949953662] boot 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: osdmap e51: 6 total, 6 up, 6 in 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:16.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:52:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:52:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T12:52:16.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:16 smithi046 ceph-mon[108126]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T12:52:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:17 smithi176 ceph-mon[80162]: pgmap v145: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:17.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:17 smithi046 ceph-mon[108126]: pgmap v145: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 65/336 objects degraded (19.345%) 2024-09-21T12:52:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:19 smithi176 ceph-mon[80162]: pgmap v146: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 9/336 objects degraded (2.679%) 2024-09-21T12:52:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:19 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 9/336 objects degraded (2.679%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:19.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:19 smithi046 ceph-mon[108126]: pgmap v146: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s; 9/336 objects degraded (2.679%) 2024-09-21T12:52:19.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:19 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 9/336 objects degraded (2.679%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:21 smithi176 ceph-mon[80162]: pgmap v147: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T12:52:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:21 smithi176 ceph-mon[80162]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/336 objects degraded (2.679%), 3 pgs degraded) 2024-09-21T12:52:21.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:21 smithi046 ceph-mon[108126]: pgmap v147: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T12:52:21.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:21 smithi046 ceph-mon[108126]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 9/336 objects degraded (2.679%), 3 pgs degraded) 2024-09-21T12:52:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:23 smithi046 ceph-mon[108126]: pgmap v148: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T12:52:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:23 smithi176 ceph-mon[80162]: pgmap v148: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-09-21T12:52:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:25 smithi176 ceph-mon[80162]: pgmap v149: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-21T12:52:25.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:25 smithi046 ceph-mon[108126]: pgmap v149: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-21T12:52:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:27 smithi176 ceph-mon[80162]: pgmap v150: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T12:52:27.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:27 smithi046 ceph-mon[108126]: pgmap v150: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T12:52:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:52:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:30 smithi046 ceph-mon[108126]: pgmap v151: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T12:52:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:30.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:30.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:52:30.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:30 smithi176 ceph-mon[80162]: pgmap v151: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T12:52:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:31 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:52:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:31 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:52:32.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:32 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:52:32.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:32 smithi046 ceph-mon[108126]: Upgrade: osd.1 is safe to restart 2024-09-21T12:52:32.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:32 smithi046 ceph-mon[108126]: pgmap v152: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:52:32.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:32.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T12:52:32.558 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:52:32.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:32 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:52:32.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:32 smithi176 ceph-mon[80162]: Upgrade: osd.1 is safe to restart 2024-09-21T12:52:32.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:32 smithi176 ceph-mon[80162]: pgmap v152: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:52:32.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:32.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T12:52:32.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:52:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:33 smithi046 ceph-mon[108126]: Upgrade: Updating osd.1 2024-09-21T12:52:33.328 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:33 smithi046 ceph-mon[108126]: Deploying daemon osd.1 on smithi046 2024-09-21T12:52:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:33 smithi176 ceph-mon[80162]: Upgrade: Updating osd.1 2024-09-21T12:52:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:33 smithi176 ceph-mon[80162]: Deploying daemon osd.1 on smithi046 2024-09-21T12:52:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:34 smithi176 ceph-mon[80162]: pgmap v153: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:52:34.602 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:34 smithi046 ceph-mon[108126]: pgmap v153: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:52:35.274 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:34 smithi046 systemd[1]: Stopping Ceph osd.1 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:52:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:35 smithi176 ceph-mon[80162]: osd.1 marked itself down and dead 2024-09-21T12:52:35.621 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:35 smithi046 ceph-mon[108126]: osd.1 marked itself down and dead 2024-09-21T12:52:35.621 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:35 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[55764]: 2024-09-21T12:52:35.271+0000 7f73f4525640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:52:35.621 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:35 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[55764]: 2024-09-21T12:52:35.271+0000 7f73f4525640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-21T12:52:35.621 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:35 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[55764]: 2024-09-21T12:52:35.271+0000 7f73f4525640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:52:35.908 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:35 smithi046 podman[121935]: 2024-09-21 12:52:35.620357502 +0000 UTC m=+0.472145002 container died 72bb898bad68a6608b3f9e62c87610c2ee73ae4be0123d03944a49ef16e7f5a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T12:52:36.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:35 smithi046 podman[121935]: 2024-09-21 12:52:35.980547086 +0000 UTC m=+0.832334583 container cleanup 72bb898bad68a6608b3f9e62c87610c2ee73ae4be0123d03944a49ef16e7f5a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T12:52:36.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:35 smithi046 bash[121935]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1 2024-09-21T12:52:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:36 smithi176 ceph-mon[80162]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:52:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:36 smithi176 ceph-mon[80162]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T12:52:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:36 smithi176 ceph-mon[80162]: pgmap v155: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:52:36.619 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:36 smithi046 ceph-mon[108126]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:52:36.619 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:36 smithi046 ceph-mon[108126]: osdmap e53: 6 total, 5 up, 6 in 2024-09-21T12:52:36.619 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:36 smithi046 ceph-mon[108126]: pgmap v155: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:52:36.619 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:36 smithi046 podman[121950]: 2024-09-21 12:52:36.273961815 +0000 UTC m=+0.646309970 container remove 72bb898bad68a6608b3f9e62c87610c2ee73ae4be0123d03944a49ef16e7f5a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:52:36.904 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:36 smithi046 podman[122041]: 2024-09-21 12:52:36.52199479 +0000 UTC m=+0.017107398 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:52:36.904 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:36 smithi046 podman[122041]: 2024-09-21 12:52:36.649996143 +0000 UTC m=+0.145108773 container create a682c44858e7a4a72f6704502a06cdd4b93efd1a93c580a930c9487cd9eded12 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:52:36.904 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:36 smithi046 podman[122041]: 2024-09-21 12:52:36.903059526 +0000 UTC m=+0.398172120 container init a682c44858e7a4a72f6704502a06cdd4b93efd1a93c580a930c9487cd9eded12 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T12:52:37.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:36 smithi046 podman[122041]: 2024-09-21 12:52:36.90706966 +0000 UTC m=+0.402182247 container start a682c44858e7a4a72f6704502a06cdd4b93efd1a93c580a930c9487cd9eded12 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, ceph=True) 2024-09-21T12:52:37.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:36 smithi046 podman[122041]: 2024-09-21 12:52:36.977426576 +0000 UTC m=+0.472539161 container attach a682c44858e7a4a72f6704502a06cdd4b93efd1a93c580a930c9487cd9eded12 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:52:37.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:37 smithi046 podman[122041]: 2024-09-21 12:52:37.098260284 +0000 UTC m=+0.593372883 container died a682c44858e7a4a72f6704502a06cdd4b93efd1a93c580a930c9487cd9eded12 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T12:52:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:37 smithi176 ceph-mon[80162]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T12:52:37.654 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:37 smithi046 ceph-mon[108126]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T12:52:37.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:37 smithi046 podman[122065]: 2024-09-21 12:52:37.739583904 +0000 UTC m=+0.635167317 container remove a682c44858e7a4a72f6704502a06cdd4b93efd1a93c580a930c9487cd9eded12 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T12:52:37.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:37 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T12:52:37.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:37 smithi046 systemd[1]: Stopped Ceph osd.1 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:52:37.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:37 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.1.service: Consumed 1min 2.376s CPU time. 2024-09-21T12:52:38.291 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:37 smithi046 systemd[1]: Starting Ceph osd.1 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:52:38.291 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 podman[122168]: 2024-09-21 12:52:38.099750176 +0000 UTC m=+0.016768313 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:52:38.291 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 podman[122168]: 2024-09-21 12:52:38.198991252 +0000 UTC m=+0.116009371 container create 6701c92e31d1f172329745cc04367712d919cf49f94e14b02038093610762452 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:52:38.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:38 smithi046 ceph-mon[108126]: pgmap v157: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T12:52:38.544 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 podman[122168]: 2024-09-21 12:52:38.443055373 +0000 UTC m=+0.360073501 container init 6701c92e31d1f172329745cc04367712d919cf49f94e14b02038093610762452 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:52:38.544 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 podman[122168]: 2024-09-21 12:52:38.44670194 +0000 UTC m=+0.363720058 container start 6701c92e31d1f172329745cc04367712d919cf49f94e14b02038093610762452 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:52:38.545 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 podman[122168]: 2024-09-21 12:52:38.543313826 +0000 UTC m=+0.460331944 container attach 6701c92e31d1f172329745cc04367712d919cf49f94e14b02038093610762452 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T12:52:38.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:38 smithi176 ceph-mon[80162]: pgmap v157: 65 pgs: 12 stale+active+clean, 53 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-21T12:52:38.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:38.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 bash[122168]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:38.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:38.912 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:38 smithi046 bash[122168]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:39 smithi176 ceph-mon[80162]: pgmap v158: 65 pgs: 16 active+undersized, 3 stale+active+clean, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 45/336 objects degraded (13.393%) 2024-09-21T12:52:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:39 smithi176 ceph-mon[80162]: Health check failed: Degraded data redundancy: 45/336 objects degraded (13.393%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:39.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:39 smithi046 ceph-mon[108126]: pgmap v158: 65 pgs: 16 active+undersized, 3 stale+active+clean, 13 active+undersized+degraded, 33 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 45/336 objects degraded (13.393%) 2024-09-21T12:52:39.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:39 smithi046 ceph-mon[108126]: Health check failed: Degraded data redundancy: 45/336 objects degraded (13.393%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:41.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2598254770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 msgr2=0x7f0a68107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2598254770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a68107ce0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009880 tx=0x7f0a5802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2598254770 shutdown_connections 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2598254770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68101900 0x7f0a68101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2598254770 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a68107ce0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2598254770 >> 172.21.15.46:0/2598254770 conn(0x7f0a680fd600 msgr2=0x7f0a680ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2598254770 shutdown_connections 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.649+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2598254770 wait complete. 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a6d9fe640 1 Processor -- start 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a6d9fe640 1 -- start start 2024-09-21T12:52:41.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a6d9fe640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68101900 0x7f0a6819d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a6d9fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a6819dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a6d9fe640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6810ee30 con 0x7f0a68107900 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a6d9fe640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6810ecb0 con 0x7f0a68101900 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a6819dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a5ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a6819dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57264/0 (socket says 172.21.15.46:57264) 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a5ffff640 1 -- 172.21.15.46:0/2355789617 learned_addr learned my addr 172.21.15.46:0/2355789617 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.650+0000 7f0a66ffd640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68101900 0x7f0a6819d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a5ffff640 1 -- 172.21.15.46:0/2355789617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68101900 msgr2=0x7f0a6819d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a5ffff640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68101900 0x7f0a6819d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a5ffff640 1 -- 172.21.15.46:0/2355789617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a68197840 con 0x7f0a68107900 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a5ffff640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a6819dc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000b420 tx=0x7f0a5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a50011630 con 0x7f0a68107900 2024-09-21T12:52:41.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a50016070 con 0x7f0a68107900 2024-09-21T12:52:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a68197b30 con 0x7f0a68107900 2024-09-21T12:52:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a50010d40 con 0x7f0a68107900 2024-09-21T12:52:41.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.651+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a681980c0 con 0x7f0a68107900 2024-09-21T12:52:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.652+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a68103040 con 0x7f0a68107900 2024-09-21T12:52:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.653+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0a5001b460 con 0x7f0a68107900 2024-09-21T12:52:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.654+0000 7f0a6c9fc640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5407af30 0x7f0a5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.654+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f0a5009d740 con 0x7f0a68107900 2024-09-21T12:52:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.654+0000 7f0a66ffd640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5407af30 0x7f0a5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:41.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.654+0000 7f0a66ffd640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5407af30 0x7f0a5407d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a580096c0 tx=0x7f0a58031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:41.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.658+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a50068d40 con 0x7f0a68107900 2024-09-21T12:52:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:41 smithi176 ceph-mon[80162]: pgmap v159: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:41.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.861+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0a681983d0 con 0x7f0a5407af30 2024-09-21T12:52:41.864 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-mon[108126]: pgmap v159: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:41.864 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:52:41.864 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:41.864 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:52:41.865 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:41.865 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:41.865 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:52:41.865 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:52:41.865 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:52:41.865 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T12:52:41.866 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T12:52:41.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.863+0000 7f0a6c9fc640 1 -- 172.21.15.46:0/2355789617 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0a681983d0 con 0x7f0a5407af30 2024-09-21T12:52:41.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5407af30 msgr2=0x7f0a5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5407af30 0x7f0a5407d3f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0a580096c0 tx=0x7f0a58031400 comp rx=0 tx=0).stop 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 msgr2=0x7f0a6819dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a6819dc00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000b420 tx=0x7f0a5000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 shutdown_connections 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5407af30 0x7f0a5407d3f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a68107900 0x7f0a6819dc00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 --2- 172.21.15.46:0/2355789617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a68101900 0x7f0a6819d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.868 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 >> 172.21.15.46:0/2355789617 conn(0x7f0a680fd600 msgr2=0x7f0a680fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:41.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 shutdown_connections 2024-09-21T12:52:41.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.865+0000 7f0a6d9fe640 1 -- 172.21.15.46:0/2355789617 wait complete. 2024-09-21T12:52:41.876 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:52:41.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 -- 172.21.15.46:0/1561873777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 msgr2=0x7fedc4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:41.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 --2- 172.21.15.46:0/1561873777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4107ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009880 tx=0x7fedb402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 -- 172.21.15.46:0/1561873777 shutdown_connections 2024-09-21T12:52:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 --2- 172.21.15.46:0/1561873777 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedc4101900 0x7fedc4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 --2- 172.21.15.46:0/1561873777 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4107ce0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 -- 172.21.15.46:0/1561873777 >> 172.21.15.46:0/1561873777 conn(0x7fedc40fd600 msgr2=0x7fedc40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 -- 172.21.15.46:0/1561873777 shutdown_connections 2024-09-21T12:52:41.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.955+0000 7fedc957f640 1 -- 172.21.15.46:0/1561873777 wait complete. 2024-09-21T12:52:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc957f640 1 Processor -- start 2024-09-21T12:52:41.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc957f640 1 -- start start 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc957f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedc4101900 0x7fedc40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc957f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc957f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fedc410edd0 con 0x7fedc4107900 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc957f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fedc410ec50 con 0x7fedc4101900 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedba7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedba7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57280/0 (socket says 172.21.15.46:57280) 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedba7fc640 1 -- 172.21.15.46:0/4266723234 learned_addr learned my addr 172.21.15.46:0/4266723234 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.956+0000 7fedc2ffd640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedc4101900 0x7fedc40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedba7fc640 1 -- 172.21.15.46:0/4266723234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedc4101900 msgr2=0x7fedc40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedba7fc640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedc4101900 0x7fedc40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedba7fc640 1 -- 172.21.15.46:0/4266723234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc4074f70 con 0x7fedc4107900 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedba7fc640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4074a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fedac00d6f0 tx=0x7fedac00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedac017070 con 0x7fedc4107900 2024-09-21T12:52:41.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fedac00de00 con 0x7fedc4107900 2024-09-21T12:52:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedc4075260 con 0x7fedc4107900 2024-09-21T12:52:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fedac004bb0 con 0x7fedc4107900 2024-09-21T12:52:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.957+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedc41a3e40 con 0x7fedc4107900 2024-09-21T12:52:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.958+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedc4103040 con 0x7fedc4107900 2024-09-21T12:52:41.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.959+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fedac009a30 con 0x7fedc4107900 2024-09-21T12:52:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.959+0000 7fedc0ff9640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fedb007af90 0x7fedb007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.960+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fedac09dc20 con 0x7fedc4107900 2024-09-21T12:52:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.960+0000 7fedc2ffd640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fedb007af90 0x7fedb007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:41.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.960+0000 7fedc2ffd640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fedb007af90 0x7fedb007d450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fedb4031460 tx=0x7fedb40095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:41.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:41.964+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fedac069200 con 0x7fedc4107900 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:52:42.121 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:52:42.122 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:52:42.122 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate[122184]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T12:52:42.122 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 bash[122168]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T12:52:42.122 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:41 smithi046 podman[122168]: 2024-09-21 12:52:41.910122425 +0000 UTC m=+3.827140561 container died 6701c92e31d1f172329745cc04367712d919cf49f94e14b02038093610762452 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:52:42.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.171+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fedc4062630 con 0x7fedb007af90 2024-09-21T12:52:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.172+0000 7fedc0ff9640 1 -- 172.21.15.46:0/4266723234 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fedc4062630 con 0x7fedb007af90 2024-09-21T12:52:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.174+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fedb007af90 msgr2=0x7fedb007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.174+0000 7fedc957f640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fedb007af90 0x7fedb007d450 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fedb4031460 tx=0x7fedb40095c0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.174+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 msgr2=0x7fedc4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.174+0000 7fedc957f640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4074a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fedac00d6f0 tx=0x7fedac00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 shutdown_connections 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fedb007af90 0x7fedb007d450 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fedc4107900 0x7fedc4074a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 --2- 172.21.15.46:0/4266723234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedc4101900 0x7fedc40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 >> 172.21.15.46:0/4266723234 conn(0x7fedc40fd600 msgr2=0x7fedc40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 shutdown_connections 2024-09-21T12:52:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.175+0000 7fedc957f640 1 -- 172.21.15.46:0/4266723234 wait complete. 2024-09-21T12:52:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 -- 172.21.15.46:0/2355891652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 msgr2=0x7f7670101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 --2- 172.21.15.46:0/2355891652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f7670101d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f765c009880 tx=0x7f765c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 -- 172.21.15.46:0/2355891652 shutdown_connections 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 --2- 172.21.15.46:0/2355891652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f7670101d60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 --2- 172.21.15.46:0/2355891652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7670107900 0x7f7670107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 -- 172.21.15.46:0/2355891652 >> 172.21.15.46:0/2355891652 conn(0x7f76700fd600 msgr2=0x7f76700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 -- 172.21.15.46:0/2355891652 shutdown_connections 2024-09-21T12:52:42.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.260+0000 7f7677088640 1 -- 172.21.15.46:0/2355891652 wait complete. 2024-09-21T12:52:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7677088640 1 Processor -- start 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7677088640 1 -- start start 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7677088640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f76700744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7677088640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7670107900 0x7f7670074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7677088640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f767010edb0 con 0x7f7670101900 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7677088640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f767010ec30 con 0x7f7670107900 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7674e24640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f76700744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7674e24640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f76700744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57302/0 (socket says 172.21.15.46:57302) 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f7674e24640 1 -- 172.21.15.46:0/2550297008 learned_addr learned my addr 172.21.15.46:0/2550297008 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.261+0000 7f766ffff640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7670107900 0x7f7670074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f7674e24640 1 -- 172.21.15.46:0/2550297008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7670107900 msgr2=0x7f7670074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f7674e24640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7670107900 0x7f7670074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f7674e24640 1 -- 172.21.15.46:0/2550297008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7670074f70 con 0x7f7670101900 2024-09-21T12:52:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f7674e24640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f76700744f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f766400c8a0 tx=0x7f766400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76640079b0 con 0x7f7670101900 2024-09-21T12:52:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7664007b50 con 0x7f7670101900 2024-09-21T12:52:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7670075260 con 0x7f7670101900 2024-09-21T12:52:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7664018700 con 0x7f7670101900 2024-09-21T12:52:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.262+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76701a3e20 con 0x7f7670101900 2024-09-21T12:52:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.263+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7670103040 con 0x7f7670101900 2024-09-21T12:52:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.264+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7664007d00 con 0x7f7670101900 2024-09-21T12:52:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.264+0000 7f766dffb640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f766007af80 0x7f766007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.264+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f766409e1a0 con 0x7f7670101900 2024-09-21T12:52:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.264+0000 7f766ffff640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f766007af80 0x7f766007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.265+0000 7f766ffff640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f766007af80 0x7f766007d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7670075f80 tx=0x7f765c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:42.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.269+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7664014030 con 0x7f7670101900 2024-09-21T12:52:42.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.468+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7670062630 con 0x7f766007af80 2024-09-21T12:52:42.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.477+0000 7f766dffb640 1 -- 172.21.15.46:0/2550297008 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7670062630 con 0x7f766007af80 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (2m) 31s ago 13m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (6m) 31s ago 13m 8879k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (5m) 55s ago 13m 8799k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (63s) 31s ago 13m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (58s) 55s ago 13m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (2m) 31s ago 13m 74.9M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (8m) 31s ago 8m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (8m) 31s ago 8m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (8m) 55s ago 8m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (8m) 55s ago 8m 26.8M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (5m) 31s ago 15m 526M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:52:42.480 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (4m) 55s ago 12m 457M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (92s) 31s ago 15m 38.5M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (76s) 55s ago 12m 26.1M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (3m) 31s ago 13m 11.3M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (3m) 55s ago 12m 11.6M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (36s) 31s ago 11m 12.0M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (11m) 31s ago 11m 218M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 72bb898bad68 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 31s ago 10m 179M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (10m) 55s ago 10m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (9m) 55s ago 9m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (9m) 55s ago 9m 190M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:52:42.481 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 31s ago 13m 54.4M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:52:42.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f766007af80 msgr2=0x7f766007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f766007af80 0x7f766007d440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7670075f80 tx=0x7f765c031400 comp rx=0 tx=0).stop 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 msgr2=0x7f76700744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f76700744f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f766400c8a0 tx=0x7f766400cd60 comp rx=0 tx=0).stop 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 shutdown_connections 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f766007af80 0x7f766007d440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7670107900 0x7f7670074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 --2- 172.21.15.46:0/2550297008 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7670101900 0x7f76700744f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 >> 172.21.15.46:0/2550297008 conn(0x7f76700fd600 msgr2=0x7f76700fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 shutdown_connections 2024-09-21T12:52:42.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.480+0000 7f7677088640 1 -- 172.21.15.46:0/2550297008 wait complete. 2024-09-21T12:52:42.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.563+0000 7f680704c640 1 -- 172.21.15.46:0/3863159223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 msgr2=0x7f6800106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.563+0000 7f680704c640 1 --2- 172.21.15.46:0/3863159223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f6800106be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009880 tx=0x7f67f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 -- 172.21.15.46:0/3863159223 shutdown_connections 2024-09-21T12:52:42.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 --2- 172.21.15.46:0/3863159223 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 0x7f6800100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 --2- 172.21.15.46:0/3863159223 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f6800106be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 -- 172.21.15.46:0/3863159223 >> 172.21.15.46:0/3863159223 conn(0x7f68000fc520 msgr2=0x7f68000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 -- 172.21.15.46:0/3863159223 shutdown_connections 2024-09-21T12:52:42.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 -- 172.21.15.46:0/3863159223 wait complete. 2024-09-21T12:52:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 Processor -- start 2024-09-21T12:52:42.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.564+0000 7f680704c640 1 -- start start 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f680704c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 0x7f680019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f680704c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f680019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f680704c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f680010dcb0 con 0x7f6800106800 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f680704c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f680010db30 con 0x7f6800100800 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f680019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f680019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57326/0 (socket says 172.21.15.46:57326) 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 -- 172.21.15.46:0/2783018687 learned_addr learned my addr 172.21.15.46:0/2783018687 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f6804de8640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 0x7f680019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 -- 172.21.15.46:0/2783018687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 msgr2=0x7f680019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 0x7f680019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 -- 172.21.15.46:0/2783018687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68001977b0 con 0x7f6800106800 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f6804de8640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 0x7f680019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fffff640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f680019db70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c8a0 tx=0x7f67f400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:42.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.565+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67f40079b0 con 0x7f6800106800 2024-09-21T12:52:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.566+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f67f4007b50 con 0x7f6800106800 2024-09-21T12:52:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.566+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6800197aa0 con 0x7f6800106800 2024-09-21T12:52:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.566+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f67f4018700 con 0x7f6800106800 2024-09-21T12:52:42.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.566+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6800198030 con 0x7f6800106800 2024-09-21T12:52:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.567+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6800101f40 con 0x7f6800106800 2024-09-21T12:52:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.567+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f67f4007d00 con 0x7f6800106800 2024-09-21T12:52:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.568+0000 7f67fdffb640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f67e807af30 0x7f67e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.568+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f67f409e3b0 con 0x7f6800106800 2024-09-21T12:52:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.568+0000 7f6804de8640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f67e807af30 0x7f67e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.568+0000 7f6804de8640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f67e807af30 0x7f67e807d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67f0006010 tx=0x7f67f00095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:42.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.572+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67f4014030 con 0x7f6800106800 2024-09-21T12:52:42.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:42 smithi176 ceph-mon[80162]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:42.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:42 smithi176 ceph-mon[80162]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:42.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.842+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6800198d10 con 0x7f6800106800 2024-09-21T12:52:42.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:42 smithi046 ceph-mon[108126]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:42.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:42 smithi046 ceph-mon[108126]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:42.845 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:42 smithi046 podman[122436]: 2024-09-21 12:52:42.67293252 +0000 UTC m=+0.756143180 container remove 6701c92e31d1f172329745cc04367712d919cf49f94e14b02038093610762452 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T12:52:42.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.843+0000 7f67fdffb640 1 -- 172.21.15.46:0/2783018687 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f6800198d10 con 0x7f6800106800 2024-09-21T12:52:42.845 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:52:42.845 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8, 2024-09-21T12:52:42.846 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 5 2024-09-21T12:52:42.847 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:52:42.847 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.845+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f67e807af30 msgr2=0x7f67e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.845+0000 7f680704c640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f67e807af30 0x7f67e807d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f67f0006010 tx=0x7f67f00095f0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.845+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 msgr2=0x7f680019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.845+0000 7f680704c640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f680019db70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c8a0 tx=0x7f67f400cd60 comp rx=0 tx=0).stop 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.845+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 shutdown_connections 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.846+0000 7f680704c640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f67e807af30 0x7f67e807d3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.846+0000 7f680704c640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6800106800 0x7f680019db70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.846+0000 7f680704c640 1 --2- 172.21.15.46:0/2783018687 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6800100800 0x7f680019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.846+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 >> 172.21.15.46:0/2783018687 conn(0x7f68000fc520 msgr2=0x7f6800109ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.846+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 shutdown_connections 2024-09-21T12:52:42.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.846+0000 7f680704c640 1 -- 172.21.15.46:0/2783018687 wait complete. 2024-09-21T12:52:42.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.931+0000 7f277fd6c640 1 -- 172.21.15.46:0/508615548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778106800 msgr2=0x7f2778106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.931+0000 7f277fd6c640 1 --2- 172.21.15.46:0/508615548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778106800 0x7f2778106be0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2770009880 tx=0x7f277002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 -- 172.21.15.46:0/508615548 shutdown_connections 2024-09-21T12:52:42.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 --2- 172.21.15.46:0/508615548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2778100800 0x7f2778100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 --2- 172.21.15.46:0/508615548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778106800 0x7f2778106be0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 -- 172.21.15.46:0/508615548 >> 172.21.15.46:0/508615548 conn(0x7f27780fc520 msgr2=0x7f27780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 -- 172.21.15.46:0/508615548 shutdown_connections 2024-09-21T12:52:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 -- 172.21.15.46:0/508615548 wait complete. 2024-09-21T12:52:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.932+0000 7f277fd6c640 1 Processor -- start 2024-09-21T12:52:42.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.933+0000 7f277fd6c640 1 -- start start 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.933+0000 7f277fd6c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 0x7f27781965c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.933+0000 7f277fd6c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2778106800 0x7f2778196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.933+0000 7f277fd6c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f277810dcd0 con 0x7f2778100800 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.933+0000 7f277fd6c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f277810db50 con 0x7f2778106800 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277db08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 0x7f27781965c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277db08640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 0x7f27781965c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57332/0 (socket says 172.21.15.46:57332) 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277db08640 1 -- 172.21.15.46:0/2715145330 learned_addr learned my addr 172.21.15.46:0/2715145330 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:42.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277d307640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2778106800 0x7f2778196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277db08640 1 -- 172.21.15.46:0/2715145330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2778106800 msgr2=0x7f2778196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:42.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277db08640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2778106800 0x7f2778196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:42.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.934+0000 7f277db08640 1 -- 172.21.15.46:0/2715145330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2778197150 con 0x7f2778100800 2024-09-21T12:52:42.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.935+0000 7f277db08640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 0x7f27781965c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2770031460 tx=0x7f27700045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:42.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.935+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f277003f070 con 0x7f2778100800 2024-09-21T12:52:42.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.935+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27781973e0 con 0x7f2778100800 2024-09-21T12:52:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.935+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27700035f0 con 0x7f2778100800 2024-09-21T12:52:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.935+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277819b970 con 0x7f2778100800 2024-09-21T12:52:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.935+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2770035030 con 0x7f2778100800 2024-09-21T12:52:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.936+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2764005290 con 0x7f2778100800 2024-09-21T12:52:42.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.937+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2770042070 con 0x7f2778100800 2024-09-21T12:52:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.938+0000 7f2776ffd640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f276007af30 0x7f276007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.938+0000 7f277d307640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f276007af30 0x7f276007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.938+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f27700be8b0 con 0x7f2778100800 2024-09-21T12:52:42.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.938+0000 7f277d307640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f276007af30 0x7f276007d3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f277806ad40 tx=0x7f276c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:42.944 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:42.942+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2770089eb0 con 0x7f2778100800 2024-09-21T12:52:43.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:42 smithi046 podman[122557]: 2024-09-21 12:52:42.786299006 +0000 UTC m=+0.016859310 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:52:43.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:42 smithi046 podman[122557]: 2024-09-21 12:52:42.932945518 +0000 UTC m=+0.163505811 container create 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T12:52:43.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.170+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2764005d90 con 0x7f2778100800 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:52:43.174 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:52:43.175 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:43.176 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.171+0000 7f2776ffd640 1 -- 172.21.15.46:0/2715145330 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f277008ed60 con 0x7f2778100800 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f276007af30 msgr2=0x7f276007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f276007af30 0x7f276007d3f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f277806ad40 tx=0x7f276c00b390 comp rx=0 tx=0).stop 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 msgr2=0x7f27781965c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 0x7f27781965c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2770031460 tx=0x7f27700045e0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 shutdown_connections 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f276007af30 0x7f276007d3f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2778106800 0x7f2778196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 --2- 172.21.15.46:0/2715145330 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2778100800 0x7f27781965c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 >> 172.21.15.46:0/2715145330 conn(0x7f27780fc520 msgr2=0x7f27780fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 shutdown_connections 2024-09-21T12:52:43.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.174+0000 7f277fd6c640 1 -- 172.21.15.46:0/2715145330 wait complete. 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 -- 172.21.15.46:0/702839535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80103480 msgr2=0x7fcb8010b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 --2- 172.21.15.46:0/702839535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80103480 0x7fcb8010b970 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009880 tx=0x7fcb7002a530 comp rx=0 tx=0).stop 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 -- 172.21.15.46:0/702839535 shutdown_connections 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 --2- 172.21.15.46:0/702839535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80103480 0x7fcb8010b970 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 --2- 172.21.15.46:0/702839535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb80102b60 0x7fcb80102f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 -- 172.21.15.46:0/702839535 >> 172.21.15.46:0/702839535 conn(0x7fcb800fc520 msgr2=0x7fcb800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 -- 172.21.15.46:0/702839535 shutdown_connections 2024-09-21T12:52:43.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.261+0000 7fcb886b2640 1 -- 172.21.15.46:0/702839535 wait complete. 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.262+0000 7fcb886b2640 1 Processor -- start 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.262+0000 7fcb886b2640 1 -- start start 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.262+0000 7fcb886b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 0x7fcb8019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.262+0000 7fcb886b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb80103480 0x7fcb8019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.262+0000 7fcb886b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8010edd0 con 0x7fcb80102b60 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.262+0000 7fcb886b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8010ec50 con 0x7fcb80103480 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 0x7fcb8019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 0x7fcb8019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57360/0 (socket says 172.21.15.46:57360) 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 -- 172.21.15.46:0/3209703014 learned_addr learned my addr 172.21.15.46:0/3209703014 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb85c4d640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb80103480 0x7fcb8019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:43.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 -- 172.21.15.46:0/3209703014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb80103480 msgr2=0x7fcb8019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb80103480 0x7fcb8019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 -- 172.21.15.46:0/3209703014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb80197800 con 0x7fcb80102b60 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb8644e640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 0x7fcb8019d680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d8d0 tx=0x7fcb7c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb7c017030 con 0x7fcb80102b60 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb7c004020 con 0x7fcb80102b60 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb80197af0 con 0x7fcb80102b60 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb7c0047a0 con 0x7fcb80102b60 2024-09-21T12:52:43.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.263+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb80198050 con 0x7fcb80102b60 2024-09-21T12:52:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.264+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8006a9f0 con 0x7fcb80102b60 2024-09-21T12:52:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.265+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcb7c009a30 con 0x7fcb80102b60 2024-09-21T12:52:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.266+0000 7fcb777fe640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcb6c07af30 0x7fcb6c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.266+0000 7fcb85c4d640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcb6c07af30 0x7fcb6c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.266+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7fcb7c018070 con 0x7fcb80102b60 2024-09-21T12:52:43.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.266+0000 7fcb85c4d640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcb6c07af30 0x7fcb6c07d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb80198b50 tx=0x7fcb70004f30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:43.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.271+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb7c069460 con 0x7fcb80102b60 2024-09-21T12:52:43.437 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:43 smithi046 podman[122557]: 2024-09-21 12:52:43.169067817 +0000 UTC m=+0.399628110 container init 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:52:43.437 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:43 smithi046 podman[122557]: 2024-09-21 12:52:43.172660288 +0000 UTC m=+0.403220582 container start 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T12:52:43.437 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-osd[122598]: -- 172.21.15.46:0/527056133 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56321d19a1e0 con 0x56321c339c00 2024-09-21T12:52:43.437 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:43 smithi046 bash[122557]: 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 2024-09-21T12:52:43.437 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:43 smithi046 systemd[1]: Started Ceph osd.1 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:52:43.437 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:43.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.485+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcb80198360 con 0x7fcb6c07af30 2024-09-21T12:52:43.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.486+0000 7fcb777fe640 1 -- 172.21.15.46:0/3209703014 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fcb80198360 con 0x7fcb6c07af30 2024-09-21T12:52:43.488 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:52:43.488 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:52:43.488 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:52:43.489 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcb6c07af30 msgr2=0x7fcb6c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcb6c07af30 0x7fcb6c07d3f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcb80198b50 tx=0x7fcb70004f30 comp rx=0 tx=0).stop 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 msgr2=0x7fcb8019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 0x7fcb8019d680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d8d0 tx=0x7fcb7c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 shutdown_connections 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcb6c07af30 0x7fcb6c07d3f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb80103480 0x7fcb8019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 --2- 172.21.15.46:0/3209703014 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcb80102b60 0x7fcb8019d680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.488+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 >> 172.21.15.46:0/3209703014 conn(0x7fcb800fc520 msgr2=0x7fcb80103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:43.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.489+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 shutdown_connections 2024-09-21T12:52:43.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.489+0000 7fcb886b2640 1 -- 172.21.15.46:0/3209703014 wait complete. 2024-09-21T12:52:43.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1616623887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01067f0 msgr2=0x7f36c0106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1616623887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01067f0 0x7f36c0106bd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36b0009880 tx=0x7f36b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1616623887 shutdown_connections 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1616623887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36c01007f0 0x7f36c0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1616623887 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01067f0 0x7f36c0106bd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1616623887 >> 172.21.15.46:0/1616623887 conn(0x7f36c00fc550 msgr2=0x7f36c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1616623887 shutdown_connections 2024-09-21T12:52:43.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.578+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1616623887 wait complete. 2024-09-21T12:52:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36c4ae7640 1 Processor -- start 2024-09-21T12:52:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36c4ae7640 1 -- start start 2024-09-21T12:52:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36c4ae7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 0x7f36c019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:43.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36c4ae7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36c01067f0 0x7f36c019db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36c4ae7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f36c010dca0 con 0x7f36c01007f0 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36c4ae7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f36c010db20 con 0x7f36c01067f0 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 0x7f36c019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36be59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 0x7f36c019d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57376/0 (socket says 172.21.15.46:57376) 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36be59c640 1 -- 172.21.15.46:0/1440407811 learned_addr learned my addr 172.21.15.46:0/1440407811 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.579+0000 7f36bdd9b640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36c01067f0 0x7f36c019db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36be59c640 1 -- 172.21.15.46:0/1440407811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36c01067f0 msgr2=0x7f36c019db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36be59c640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36c01067f0 0x7f36c019db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36be59c640 1 -- 172.21.15.46:0/1440407811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c0197790 con 0x7f36c01007f0 2024-09-21T12:52:43.583 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36be59c640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 0x7f36c019d610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36b0031460 tx=0x7f36b00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36b003f070 con 0x7f36c01007f0 2024-09-21T12:52:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36c0197a20 con 0x7f36c01007f0 2024-09-21T12:52:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f36b00035f0 con 0x7f36c01007f0 2024-09-21T12:52:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.580+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f36b0035030 con 0x7f36c01007f0 2024-09-21T12:52:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.581+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36c0197f50 con 0x7f36c01007f0 2024-09-21T12:52:43.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.582+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36c0101f30 con 0x7f36c01007f0 2024-09-21T12:52:43.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.582+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f36b0042070 con 0x7f36c01007f0 2024-09-21T12:52:43.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.583+0000 7f36af7fe640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f36a807af30 0x7f36a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:52:43.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.583+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6156+0+0 (secure 0 0 0) 0x7f36b00be950 con 0x7f36c01007f0 2024-09-21T12:52:43.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.583+0000 7f36bdd9b640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f36a807af30 0x7f36a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:52:43.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.583+0000 7f36bdd9b640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f36a807af30 0x7f36a807d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f36c00ffb10 tx=0x7f36b400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:52:43.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.588+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f36b0089f50 con 0x7f36c01007f0 2024-09-21T12:52:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2783018687' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2715145330' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:52:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:43.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:43 smithi176 ceph-mon[80162]: pgmap v160: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:43.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.879+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f36c0198200 con 0x7f36c01007f0 2024-09-21T12:52:43.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2783018687' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:43.881 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2715145330' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:52:43.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:43.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:43.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:43.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:43 smithi046 ceph-mon[108126]: pgmap v160: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:43.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.879+0000 7f36af7fe640 1 -- 172.21.15.46:0/1440407811 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1294 (secure 0 0 0) 0x7f36b008ee00 con 0x7f36c01007f0 2024-09-21T12:52:43.882 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 49/336 objects degraded (14.583%), 15 pgs degraded 2024-09-21T12:52:43.882 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:52:43.882 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: osd.1 (root=default,host=smithi046) is down 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 49/336 objects degraded (14.583%), 15 pgs degraded 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-21T12:52:43.883 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-21T12:52:43.884 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-21T12:52:43.884 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-21T12:52:43.884 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-21T12:52:43.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f36a807af30 msgr2=0x7f36a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f36a807af30 0x7f36a807d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f36c00ffb10 tx=0x7f36b400b390 comp rx=0 tx=0).stop 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 msgr2=0x7f36c019d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 0x7f36c019d610 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f36b0031460 tx=0x7f36b00045e0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 shutdown_connections 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f36a807af30 0x7f36a807d3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f36c01067f0 0x7f36c019db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 --2- 172.21.15.46:0/1440407811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f36c01007f0 0x7f36c019d610 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 >> 172.21.15.46:0/1440407811 conn(0x7f36c00fc550 msgr2=0x7f36c0069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 shutdown_connections 2024-09-21T12:52:43.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:52:43.882+0000 7f36c4ae7640 1 -- 172.21.15.46:0/1440407811 wait complete. 2024-09-21T12:52:44.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:44 smithi046 ceph-mon[108126]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:44.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:44 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1440407811' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:52:44.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:44.816 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:52:44.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:44 smithi176 ceph-mon[80162]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:52:44.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:44 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1440407811' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:52:44.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:44.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:52:45.120 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:44 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[122593]: 2024-09-21T12:52:44.824+0000 7fc751d85640 -1 Falling back to public interface 2024-09-21T12:52:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:45 smithi176 ceph-mon[80162]: pgmap v161: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:45.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:45 smithi046 ceph-mon[108126]: pgmap v161: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:46.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:46 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 49/336 objects degraded (14.583%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:46.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:46 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 49/336 objects degraded (14.583%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:47.764 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:47 smithi046 ceph-mon[108126]: pgmap v162: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:47.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:47 smithi176 ceph-mon[80162]: pgmap v162: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:49.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.769 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:49 smithi046 ceph-mon[108126]: pgmap v163: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:49.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:49 smithi176 ceph-mon[80162]: pgmap v163: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 49/336 objects degraded (14.583%) 2024-09-21T12:52:50.826 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:50 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[122593]: 2024-09-21T12:52:50.615+0000 7fc751d85640 -1 osd.1 52 log_to_monitors true 2024-09-21T12:52:51.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:51 smithi046 ceph-mon[108126]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T12:52:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:51 smithi176 ceph-mon[80162]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T12:52:52.105 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 12:52:51 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[122593]: 2024-09-21T12:52:51.877+0000 7fc745b27640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:52:52.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:52 smithi046 ceph-mon[108126]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:52:52.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:52 smithi046 ceph-mon[108126]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T12:52:52.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:52 smithi046 ceph-mon[108126]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T12:52:52.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:52 smithi046 ceph-mon[108126]: pgmap v165: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 49/336 objects degraded (14.583%) 2024-09-21T12:52:52.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:52 smithi046 ceph-mon[108126]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' 2024-09-21T12:52:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:52 smithi176 ceph-mon[80162]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:52:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:52 smithi176 ceph-mon[80162]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T12:52:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:52 smithi176 ceph-mon[80162]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T12:52:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:52 smithi176 ceph-mon[80162]: pgmap v165: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 49/336 objects degraded (14.583%) 2024-09-21T12:52:52.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:52 smithi176 ceph-mon[80162]: from='osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778]' entity='osd.1' 2024-09-21T12:52:53.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:53.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:53.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:52:53.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:52:53.848 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778] boot 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T12:52:53.849 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:53 smithi046 ceph-mon[108126]: pgmap v167: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 49/336 objects degraded (14.583%) 2024-09-21T12:52:54.040 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: osd.1 [v2:172.21.15.46:6810/1458404778,v1:172.21.15.46:6811/1458404778] boot 2024-09-21T12:52:54.041 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: osdmap e56: 6 total, 6 up, 6 in 2024-09-21T12:52:54.042 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T12:52:54.042 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:53 smithi176 ceph-mon[80162]: pgmap v167: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 49/336 objects degraded (14.583%) 2024-09-21T12:52:55.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:54 smithi046 ceph-mon[108126]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T12:52:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:54 smithi176 ceph-mon[80162]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T12:52:56.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:55 smithi046 ceph-mon[108126]: pgmap v169: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 24/336 objects degraded (7.143%) 2024-09-21T12:52:56.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:55 smithi176 ceph-mon[80162]: pgmap v169: 65 pgs: 5 active+undersized, 7 active+undersized+degraded, 53 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 24/336 objects degraded (7.143%) 2024-09-21T12:52:57.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:56 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 24/336 objects degraded (7.143%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:56 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 24/336 objects degraded (7.143%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T12:52:58.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:57 smithi046 ceph-mon[108126]: pgmap v170: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T12:52:58.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:57 smithi176 ceph-mon[80162]: pgmap v170: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-21T12:52:59.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:52:58 smithi046 ceph-mon[108126]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/336 objects degraded (7.143%), 7 pgs degraded) 2024-09-21T12:52:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:52:58 smithi176 ceph-mon[80162]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/336 objects degraded (7.143%), 7 pgs degraded) 2024-09-21T12:53:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:00 smithi046 ceph-mon[108126]: pgmap v171: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T12:53:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:00 smithi176 ceph-mon[80162]: pgmap v171: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T12:53:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:01 smithi176 ceph-mon[80162]: pgmap v172: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:53:01.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:01 smithi046 ceph-mon[108126]: pgmap v172: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:53:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:03 smithi176 ceph-mon[80162]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-21T12:53:03.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:03 smithi046 ceph-mon[108126]: pgmap v173: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-21T12:53:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:05.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:06.537 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:06 smithi046 ceph-mon[108126]: pgmap v174: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:53:06.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:06 smithi176 ceph-mon[80162]: pgmap v174: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:53:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:07 smithi176 ceph-mon[80162]: pgmap v175: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:07.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:07 smithi046 ceph-mon[108126]: pgmap v175: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:08.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:08 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:53:08.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:08 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:53:08.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:08 smithi046 ceph-mon[108126]: Upgrade: osd.2 is safe to restart 2024-09-21T12:53:08.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:08 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:53:08.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:08 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:53:08.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:08 smithi176 ceph-mon[80162]: Upgrade: osd.2 is safe to restart 2024-09-21T12:53:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:10 smithi046 ceph-mon[108126]: Upgrade: Updating osd.2 2024-09-21T12:53:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:10 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:10 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T12:53:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:10 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:53:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:10 smithi046 ceph-mon[108126]: Deploying daemon osd.2 on smithi046 2024-09-21T12:53:10.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:10 smithi046 ceph-mon[108126]: pgmap v176: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:10.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:10 smithi176 ceph-mon[80162]: Upgrade: Updating osd.2 2024-09-21T12:53:10.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:10 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:10 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T12:53:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:10 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:53:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:10 smithi176 ceph-mon[80162]: Deploying daemon osd.2 on smithi046 2024-09-21T12:53:10.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:10 smithi176 ceph-mon[80162]: pgmap v176: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:11 smithi046 ceph-mon[108126]: pgmap v177: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:11 smithi176 ceph-mon[80162]: pgmap v177: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:12.367 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:12 smithi046 systemd[1]: Stopping Ceph osd.2 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:53:12.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:12 smithi046 ceph-mon[108126]: osd.2 marked itself down and dead 2024-09-21T12:53:12.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:12 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[63402]: 2024-09-21T12:53:12.406+0000 7f37d6779640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:53:12.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:12 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[63402]: 2024-09-21T12:53:12.406+0000 7f37d6779640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-21T12:53:12.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:12 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[63402]: 2024-09-21T12:53:12.406+0000 7f37d6779640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:53:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:12 smithi176 ceph-mon[80162]: osd.2 marked itself down and dead 2024-09-21T12:53:13.266 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:12 smithi046 podman[127359]: 2024-09-21 12:53:12.979324215 +0000 UTC m=+0.687672190 container died 0607ddd740d5ee92a1f7dbeb21565acf3aef31ad619a29bfde19c21aaaee8131 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T12:53:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:13 smithi046 ceph-mon[108126]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:53:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:13 smithi046 ceph-mon[108126]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T12:53:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:13 smithi046 ceph-mon[108126]: pgmap v179: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:53:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:13 smithi046 podman[127359]: 2024-09-21 12:53:13.357165458 +0000 UTC m=+1.065513428 container cleanup 0607ddd740d5ee92a1f7dbeb21565acf3aef31ad619a29bfde19c21aaaee8131 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:53:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:13 smithi046 bash[127359]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2 2024-09-21T12:53:13.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:13 smithi046 podman[127377]: 2024-09-21 12:53:13.515773927 +0000 UTC m=+0.534087989 container remove 0607ddd740d5ee92a1f7dbeb21565acf3aef31ad619a29bfde19c21aaaee8131 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T12:53:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:13 smithi176 ceph-mon[80162]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:53:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:13 smithi176 ceph-mon[80162]: osdmap e58: 6 total, 5 up, 6 in 2024-09-21T12:53:13.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:13 smithi176 ceph-mon[80162]: pgmap v179: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:53:13.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 -- 172.21.15.46:0/3837428281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c100800 msgr2=0x7fe73c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:13.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 --2- 172.21.15.46:0/3837428281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c100800 0x7fe73c100c60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe724009880 tx=0x7fe72402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:13.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 -- 172.21.15.46:0/3837428281 shutdown_connections 2024-09-21T12:53:13.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 --2- 172.21.15.46:0/3837428281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c100800 0x7fe73c100c60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 --2- 172.21.15.46:0/3837428281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe73c106800 0x7fe73c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 -- 172.21.15.46:0/3837428281 >> 172.21.15.46:0/3837428281 conn(0x7fe73c0fc520 msgr2=0x7fe73c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 -- 172.21.15.46:0/3837428281 shutdown_connections 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.973+0000 7fe740eee640 1 -- 172.21.15.46:0/3837428281 wait complete. 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe740eee640 1 Processor -- start 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe740eee640 1 -- start start 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe740eee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe73c100800 0x7fe73c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe740eee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 0x7fe73c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe740eee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c10dcd0 con 0x7fe73c106800 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe740eee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c10db50 con 0x7fe73c100800 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe733fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 0x7fe73c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:13.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe733fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 0x7fe73c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46918/0 (socket says 172.21.15.46:46918) 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe733fff640 1 -- 172.21.15.46:0/1236204016 learned_addr learned my addr 172.21.15.46:0/1236204016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe73a59c640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe73c100800 0x7fe73c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe733fff640 1 -- 172.21.15.46:0/1236204016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe73c100800 msgr2=0x7fe73c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe733fff640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe73c100800 0x7fe73c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.974+0000 7fe733fff640 1 -- 172.21.15.46:0/1236204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c1966a0 con 0x7fe73c106800 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.975+0000 7fe733fff640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 0x7fe73c19cb10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe724031460 tx=0x7fe7240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.975+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe72403f070 con 0x7fe73c106800 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.975+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe7240035f0 con 0x7fe73c106800 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.975+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c196930 con 0x7fe73c106800 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.975+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe724035030 con 0x7fe73c106800 2024-09-21T12:53:13.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.975+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c196e30 con 0x7fe73c106800 2024-09-21T12:53:13.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.976+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c101f40 con 0x7fe73c106800 2024-09-21T12:53:13.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.977+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe724042070 con 0x7fe73c106800 2024-09-21T12:53:13.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.977+0000 7fe7337fe640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe72807af30 0x7fe72807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:13.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.977+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7fe7240be970 con 0x7fe73c106800 2024-09-21T12:53:13.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.977+0000 7fe73a59c640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe72807af30 0x7fe72807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:13.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.978+0000 7fe73a59c640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe72807af30 0x7fe72807d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe72c005fd0 tx=0x7fe72c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:13.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:13.982+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7240c0e20 con 0x7fe73c106800 2024-09-21T12:53:14.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.188+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe73c197140 con 0x7fe72807af30 2024-09-21T12:53:14.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.189+0000 7fe7337fe640 1 -- 172.21.15.46:0/1236204016 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fe73c197140 con 0x7fe72807af30 2024-09-21T12:53:14.191 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:13 smithi046 podman[127464]: 2024-09-21 12:53:13.843479682 +0000 UTC m=+0.016842467 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:53:14.191 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:13 smithi046 podman[127464]: 2024-09-21 12:53:13.958303414 +0000 UTC m=+0.131666206 container create 63a7945c8b41bf1a50555a2d9c24c62a2a8501e65bb311c87b21c189526aa4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-21T12:53:14.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe72807af30 msgr2=0x7fe72807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe72807af30 0x7fe72807d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe72c005fd0 tx=0x7fe72c00b390 comp rx=0 tx=0).stop 2024-09-21T12:53:14.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 msgr2=0x7fe73c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 0x7fe73c19cb10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe724031460 tx=0x7fe7240045e0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 shutdown_connections 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe72807af30 0x7fe72807d3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe73c106800 0x7fe73c19cb10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 --2- 172.21.15.46:0/1236204016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe73c100800 0x7fe73c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 >> 172.21.15.46:0/1236204016 conn(0x7fe73c0fc520 msgr2=0x7fe73c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 shutdown_connections 2024-09-21T12:53:14.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.192+0000 7fe740eee640 1 -- 172.21.15.46:0/1236204016 wait complete. 2024-09-21T12:53:14.202 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.281+0000 7fd50a21f640 1 -- 172.21.15.46:0/1995944824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 msgr2=0x7fd504102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.281+0000 7fd50a21f640 1 --2- 172.21.15.46:0/1995944824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd504102f30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4009880 tx=0x7fd4f402a530 comp rx=0 tx=0).stop 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.281+0000 7fd50a21f640 1 -- 172.21.15.46:0/1995944824 shutdown_connections 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.282+0000 7fd50a21f640 1 --2- 172.21.15.46:0/1995944824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd504103470 0x7fd50410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.282+0000 7fd50a21f640 1 --2- 172.21.15.46:0/1995944824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd504102f30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.282+0000 7fd50a21f640 1 -- 172.21.15.46:0/1995944824 >> 172.21.15.46:0/1995944824 conn(0x7fd5040fc550 msgr2=0x7fd5040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:14.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.282+0000 7fd50a21f640 1 -- 172.21.15.46:0/1995944824 shutdown_connections 2024-09-21T12:53:14.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.282+0000 7fd50a21f640 1 -- 172.21.15.46:0/1995944824 wait complete. 2024-09-21T12:53:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.282+0000 7fd50a21f640 1 Processor -- start 2024-09-21T12:53:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd50a21f640 1 -- start start 2024-09-21T12:53:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd50a21f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd50419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd50a21f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd504103470 0x7fd50419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd50a21f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd50410edc0 con 0x7fd504102b50 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd50a21f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd50410ec40 con 0x7fd504103470 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd5037fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd50419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd5037fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd50419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46944/0 (socket says 172.21.15.46:46944) 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd5037fe640 1 -- 172.21.15.46:0/3291644982 learned_addr learned my addr 172.21.15.46:0/3291644982 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd502ffd640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd504103470 0x7fd50419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd5037fe640 1 -- 172.21.15.46:0/3291644982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd504103470 msgr2=0x7fd50419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd5037fe640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd504103470 0x7fd50419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.283+0000 7fd5037fe640 1 -- 172.21.15.46:0/3291644982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5041977b0 con 0x7fd504102b50 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.284+0000 7fd5037fe640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd50419d630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4004f90 tx=0x7fd4f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.284+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4f403f070 con 0x7fd504102b50 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.284+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd504197a40 con 0x7fd504102b50 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.284+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd504197f70 con 0x7fd504102b50 2024-09-21T12:53:14.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.284+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd4f4004ac0 con 0x7fd504102b50 2024-09-21T12:53:14.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.284+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4f4035030 con 0x7fd504102b50 2024-09-21T12:53:14.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.285+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4f0005290 con 0x7fd504102b50 2024-09-21T12:53:14.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.286+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd4f4042070 con 0x7fd504102b50 2024-09-21T12:53:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.286+0000 7fd500ff9640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd4ec07af80 0x7fd4ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.286+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7fd4f40be770 con 0x7fd504102b50 2024-09-21T12:53:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.286+0000 7fd502ffd640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd4ec07af80 0x7fd4ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.287+0000 7fd502ffd640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd4ec07af80 0x7fd4ec07d440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd504108920 tx=0x7fd4f8005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:14.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.291+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd4f4089df0 con 0x7fd504102b50 2024-09-21T12:53:14.451 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:14 smithi046 podman[127464]: 2024-09-21 12:53:14.235704176 +0000 UTC m=+0.409066961 container init 63a7945c8b41bf1a50555a2d9c24c62a2a8501e65bb311c87b21c189526aa4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T12:53:14.451 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:14 smithi046 podman[127464]: 2024-09-21 12:53:14.240791363 +0000 UTC m=+0.414154155 container start 63a7945c8b41bf1a50555a2d9c24c62a2a8501e65bb311c87b21c189526aa4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T12:53:14.451 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:14 smithi046 podman[127464]: 2024-09-21 12:53:14.360963903 +0000 UTC m=+0.534326689 container attach 63a7945c8b41bf1a50555a2d9c24c62a2a8501e65bb311c87b21c189526aa4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-21T12:53:14.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.499+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd4f0000bc0 con 0x7fd4ec07af80 2024-09-21T12:53:14.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.501+0000 7fd500ff9640 1 -- 172.21.15.46:0/3291644982 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fd4f0000bc0 con 0x7fd4ec07af80 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.503+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd4ec07af80 msgr2=0x7fd4ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.503+0000 7fd50a21f640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd4ec07af80 0x7fd4ec07d440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd504108920 tx=0x7fd4f8005f90 comp rx=0 tx=0).stop 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.503+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 msgr2=0x7fd50419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.503+0000 7fd50a21f640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd50419d630 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4004f90 tx=0x7fd4f40046c0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 shutdown_connections 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd4ec07af80 0x7fd4ec07d440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd504103470 0x7fd50419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 --2- 172.21.15.46:0/3291644982 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd504102b50 0x7fd50419d630 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 >> 172.21.15.46:0/3291644982 conn(0x7fd5040fc550 msgr2=0x7fd504108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 shutdown_connections 2024-09-21T12:53:14.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.504+0000 7fd50a21f640 1 -- 172.21.15.46:0/3291644982 wait complete. 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 -- 172.21.15.46:0/1214915451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 msgr2=0x7f4934107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 --2- 172.21.15.46:0/1214915451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f4934107ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4924009880 tx=0x7f492402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 -- 172.21.15.46:0/1214915451 shutdown_connections 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 --2- 172.21.15.46:0/1214915451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101900 0x7f4934101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 --2- 172.21.15.46:0/1214915451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f4934107ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 -- 172.21.15.46:0/1214915451 >> 172.21.15.46:0/1214915451 conn(0x7f49340fd600 msgr2=0x7f49340ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:14.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 -- 172.21.15.46:0/1214915451 shutdown_connections 2024-09-21T12:53:14.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 -- 172.21.15.46:0/1214915451 wait complete. 2024-09-21T12:53:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 Processor -- start 2024-09-21T12:53:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.590+0000 7f493a061640 1 -- start start 2024-09-21T12:53:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f493a061640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101900 0x7f493419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f493a061640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f493419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f493a061640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f493410edb0 con 0x7f4934107900 2024-09-21T12:53:14.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f493a061640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f493410ec30 con 0x7f4934101900 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f493419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f493419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46960/0 (socket says 172.21.15.46:46960) 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 -- 172.21.15.46:0/2226884251 learned_addr learned my addr 172.21.15.46:0/2226884251 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f49337fe640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101900 0x7f493419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 -- 172.21.15.46:0/2226884251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101900 msgr2=0x7f493419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101900 0x7f493419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 -- 172.21.15.46:0/2226884251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49341977c0 con 0x7f4934107900 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.591+0000 7f492affd640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f493419db80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491c00d8d0 tx=0x7f491c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.592+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f491c017030 con 0x7f4934107900 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.592+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f491c004020 con 0x7f4934107900 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.592+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4934197ab0 con 0x7f4934107900 2024-09-21T12:53:14.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.592+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f491c0047a0 con 0x7f4934107900 2024-09-21T12:53:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.592+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4934198040 con 0x7f4934107900 2024-09-21T12:53:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.593+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4934103040 con 0x7f4934107900 2024-09-21T12:53:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.593+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f491c0041d0 con 0x7f4934107900 2024-09-21T12:53:14.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.594+0000 7f49317fa640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af90 0x7f492007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.594+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f491c018070 con 0x7f4934107900 2024-09-21T12:53:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.594+0000 7f49337fe640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af90 0x7f492007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.595+0000 7f49337fe640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af90 0x7f492007d450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4924031460 tx=0x7f49240095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:14.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.599+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f491c0693e0 con 0x7f4934107900 2024-09-21T12:53:14.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:14 smithi176 ceph-mon[80162]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T12:53:14.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:14 smithi176 ceph-mon[80162]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:14.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:14.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:14.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.795+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f49341983b0 con 0x7f492007af90 2024-09-21T12:53:14.797 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:14 smithi046 podman[127464]: 2024-09-21 12:53:14.490559321 +0000 UTC m=+0.663922113 container died 63a7945c8b41bf1a50555a2d9c24c62a2a8501e65bb311c87b21c189526aa4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T12:53:14.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:14 smithi046 ceph-mon[108126]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T12:53:14.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:14 smithi046 ceph-mon[108126]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:14.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:14.797 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.805+0000 7f49317fa640 1 -- 172.21.15.46:0/2226884251 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f49341983b0 con 0x7f492007af90 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 26s ago 14m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (6m) 26s ago 14m 8954k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (6m) 87s ago 13m 8799k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (95s) 26s ago 14m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (90s) 87s ago 13m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 26s ago 14m 76.7M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (9m) 26s ago 8m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (8m) 26s ago 8m 149M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (8m) 87s ago 8m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:53:14.807 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (8m) 87s ago 8m 26.8M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (5m) 26s ago 15m 527M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (4m) 87s ago 13m 457M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (2m) 26s ago 15m 40.9M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (108s) 87s ago 13m 26.1M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (4m) 26s ago 14m 12.0M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (4m) 87s ago 13m 11.6M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (68s) 26s ago 12m 81.7M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (32s) 26s ago 11m 12.2M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (11m) 26s ago 11m 179M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 0607ddd740d5 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (10m) 87s ago 10m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (10m) 87s ago 10m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (10m) 87s ago 9m 190M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:53:14.808 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (3m) 26s ago 13m 56.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:53:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af90 msgr2=0x7f492007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af90 0x7f492007d450 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4924031460 tx=0x7f49240095c0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 msgr2=0x7f493419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f493419db80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491c00d8d0 tx=0x7f491c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:53:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 shutdown_connections 2024-09-21T12:53:14.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af90 0x7f492007d450 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934107900 0x7f493419db80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 --2- 172.21.15.46:0/2226884251 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101900 0x7f493419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 >> 172.21.15.46:0/2226884251 conn(0x7f49340fd600 msgr2=0x7f49340ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 shutdown_connections 2024-09-21T12:53:14.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.808+0000 7f493a061640 1 -- 172.21.15.46:0/2226884251 wait complete. 2024-09-21T12:53:14.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 -- 172.21.15.46:0/2099033250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5441033e0 msgr2=0x7ff54410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/2099033250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5441033e0 0x7ff54410b8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff538009880 tx=0x7ff53802a530 comp rx=0 tx=0).stop 2024-09-21T12:53:14.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 -- 172.21.15.46:0/2099033250 shutdown_connections 2024-09-21T12:53:14.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/2099033250 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff5441033e0 0x7ff54410b8d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/2099033250 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff544102ac0 0x7ff544102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 -- 172.21.15.46:0/2099033250 >> 172.21.15.46:0/2099033250 conn(0x7ff5440fc520 msgr2=0x7ff5440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 -- 172.21.15.46:0/2099033250 shutdown_connections 2024-09-21T12:53:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.893+0000 7ff54c5a7640 1 -- 172.21.15.46:0/2099033250 wait complete. 2024-09-21T12:53:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54c5a7640 1 Processor -- start 2024-09-21T12:53:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54c5a7640 1 -- start start 2024-09-21T12:53:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54c5a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 0x7ff54419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54c5a7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5441033e0 0x7ff54419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54c5a7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410ee50 con 0x7ff544102ac0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54c5a7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff54410ecd0 con 0x7ff5441033e0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54a343640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 0x7ff54419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54a343640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 0x7ff54419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:46990/0 (socket says 172.21.15.46:46990) 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54a343640 1 -- 172.21.15.46:0/3550063391 learned_addr learned my addr 172.21.15.46:0/3550063391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff549b42640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5441033e0 0x7ff54419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54a343640 1 -- 172.21.15.46:0/3550063391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5441033e0 msgr2=0x7ff54419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54a343640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5441033e0 0x7ff54419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.894+0000 7ff54a343640 1 -- 172.21.15.46:0/3550063391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff544197860 con 0x7ff544102ac0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.895+0000 7ff54a343640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 0x7ff54419d6a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b420 tx=0x7ff54000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.895+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff540011630 con 0x7ff544102ac0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.895+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff540016070 con 0x7ff544102ac0 2024-09-21T12:53:14.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.895+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff544197b50 con 0x7ff544102ac0 2024-09-21T12:53:14.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.895+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff540010d40 con 0x7ff544102ac0 2024-09-21T12:53:14.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.895+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441980b0 con 0x7ff544102ac0 2024-09-21T12:53:14.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.896+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff54406aa90 con 0x7ff544102ac0 2024-09-21T12:53:14.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.897+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff54001b460 con 0x7ff544102ac0 2024-09-21T12:53:14.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.897+0000 7ff5377fe640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff53007af80 0x7ff53007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:14.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.897+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7ff54009d6f0 con 0x7ff544102ac0 2024-09-21T12:53:14.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.897+0000 7ff549b42640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff53007af80 0x7ff53007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:14.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.898+0000 7ff549b42640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff53007af80 0x7ff53007d440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff544199050 tx=0x7ff538031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:14.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:14.902+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff540021250 con 0x7ff544102ac0 2024-09-21T12:53:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.187+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff544198d90 con 0x7ff544102ac0 2024-09-21T12:53:15.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.188+0000 7ff5377fe640 1 -- 172.21.15.46:0/3550063391 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7ff540068d70 con 0x7ff544102ac0 2024-09-21T12:53:15.189 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:53:15.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:53:15.189 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:53:15.189 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:53:15.190 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:53:15.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff53007af80 msgr2=0x7ff53007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff53007af80 0x7ff53007d440 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff544199050 tx=0x7ff538031400 comp rx=0 tx=0).stop 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 msgr2=0x7ff54419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 0x7ff54419d6a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff54000b420 tx=0x7ff54000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 shutdown_connections 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff53007af80 0x7ff53007d440 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff5441033e0 0x7ff54419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 --2- 172.21.15.46:0/3550063391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff544102ac0 0x7ff54419d6a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 >> 172.21.15.46:0/3550063391 conn(0x7ff5440fc520 msgr2=0x7ff544108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 shutdown_connections 2024-09-21T12:53:15.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.190+0000 7ff54c5a7640 1 -- 172.21.15.46:0/3550063391 wait complete. 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.275+0000 7f1a611d2640 1 -- 172.21.15.46:0/957540554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c1033f0 msgr2=0x7f1a5c10b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.275+0000 7f1a611d2640 1 --2- 172.21.15.46:0/957540554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c1033f0 0x7f1a5c10b8e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009880 tx=0x7f1a5002a530 comp rx=0 tx=0).stop 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.275+0000 7f1a611d2640 1 -- 172.21.15.46:0/957540554 shutdown_connections 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.275+0000 7f1a611d2640 1 --2- 172.21.15.46:0/957540554 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c1033f0 0x7f1a5c10b8e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.275+0000 7f1a611d2640 1 --2- 172.21.15.46:0/957540554 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.275+0000 7f1a611d2640 1 -- 172.21.15.46:0/957540554 >> 172.21.15.46:0/957540554 conn(0x7f1a5c0fc510 msgr2=0x7f1a5c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.276+0000 7f1a611d2640 1 -- 172.21.15.46:0/957540554 shutdown_connections 2024-09-21T12:53:15.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.276+0000 7f1a611d2640 1 -- 172.21.15.46:0/957540554 wait complete. 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.276+0000 7f1a611d2640 1 Processor -- start 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.276+0000 7f1a611d2640 1 -- start start 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a611d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c19f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a611d2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a5c1033f0 0x7f1a5c19fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a611d2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c10ede0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a611d2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5c10ec60 con 0x7f1a5c1033f0 2024-09-21T12:53:15.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c19f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c19f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47008/0 (socket says 172.21.15.46:47008) 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5ad9d640 1 -- 172.21.15.46:0/3190947628 learned_addr learned my addr 172.21.15.46:0/3190947628 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5a59c640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a5c1033f0 0x7f1a5c19fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5ad9d640 1 -- 172.21.15.46:0/3190947628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a5c1033f0 msgr2=0x7f1a5c19fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5ad9d640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a5c1033f0 0x7f1a5c19fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.277+0000 7f1a5ad9d640 1 -- 172.21.15.46:0/3190947628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5c199aa0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.278+0000 7f1a5ad9d640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c19f8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00d8d0 tx=0x7f1a4c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.278+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c017070 con 0x7f1a5c102ad0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.278+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1a4c010460 con 0x7f1a5c102ad0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.278+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5c199d90 con 0x7f1a5c102ad0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.278+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1a4c00f5f0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.278+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a5c19a2f0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.279+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a5c06ada0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.280+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1a4c009a30 con 0x7f1a5c102ad0 2024-09-21T12:53:15.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.281+0000 7f1a43fff640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1a4407af40 0x7f1a4407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.281+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f1a4c09de30 con 0x7f1a5c102ad0 2024-09-21T12:53:15.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.281+0000 7f1a5a59c640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1a4407af40 0x7f1a4407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.281+0000 7f1a5a59c640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1a4407af40 0x7f1a4407d400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c19b290 tx=0x7f1a50031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:15.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.285+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1a4c069430 con 0x7f1a5c102ad0 2024-09-21T12:53:15.354 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 podman[127534]: 2024-09-21 12:53:15.098397594 +0000 UTC m=+0.601759863 container remove 63a7945c8b41bf1a50555a2d9c24c62a2a8501e65bb311c87b21c189526aa4cd (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:53:15.354 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T12:53:15.354 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 systemd[1]: Stopped Ceph osd.2 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:53:15.354 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.2.service: Consumed 49.907s CPU time. 2024-09-21T12:53:15.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.527+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f1a5c19afd0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.528+0000 7f1a43fff640 1 -- 172.21.15.46:0/3190947628 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f1a4c06e2e0 con 0x7f1a5c102ad0 2024-09-21T12:53:15.529 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:53:15.530 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:53:15.531 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:53:15.532 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:53:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:53:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1a4407af40 msgr2=0x7f1a4407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1a4407af40 0x7f1a4407d400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c19b290 tx=0x7f1a50031400 comp rx=0 tx=0).stop 2024-09-21T12:53:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 msgr2=0x7f1a5c19f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.533 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c19f8e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00d8d0 tx=0x7f1a4c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 shutdown_connections 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1a4407af40 0x7f1a4407d400 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1a5c1033f0 0x7f1a5c19fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 --2- 172.21.15.46:0/3190947628 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1a5c102ad0 0x7f1a5c19f8e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 >> 172.21.15.46:0/3190947628 conn(0x7f1a5c0fc510 msgr2=0x7f1a5c100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 shutdown_connections 2024-09-21T12:53:15.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.530+0000 7f1a611d2640 1 -- 172.21.15.46:0/3190947628 wait complete. 2024-09-21T12:53:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/4243712040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 msgr2=0x7f9e5810b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/4243712040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5810b960 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009880 tx=0x7f9e4802a530 comp rx=0 tx=0).stop 2024-09-21T12:53:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/4243712040 shutdown_connections 2024-09-21T12:53:15.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/4243712040 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5810b960 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/4243712040 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e58102b50 0x7f9e58102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/4243712040 >> 172.21.15.46:0/4243712040 conn(0x7f9e580fc550 msgr2=0x7f9e580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/4243712040 shutdown_connections 2024-09-21T12:53:15.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:15 smithi046 ceph-mon[108126]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:15.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:15 smithi046 ceph-mon[108126]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:15.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:15 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3550063391' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:15.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:15 smithi046 ceph-mon[108126]: pgmap v181: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 28/336 objects degraded (8.333%) 2024-09-21T12:53:15.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.618+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/4243712040 wait complete. 2024-09-21T12:53:15.621 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 systemd[1]: Starting Ceph osd.2 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:53:15.621 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 podman[127698]: 2024-09-21 12:53:15.478822323 +0000 UTC m=+0.017129117 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:53:15.621 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 podman[127698]: 2024-09-21 12:53:15.591227292 +0000 UTC m=+0.129534073 container create 28cd3fcd836e386ca3cc3b0a1a6362fbe510e8d697f221071a07932e88671011 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:53:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e5e9d4640 1 Processor -- start 2024-09-21T12:53:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e5e9d4640 1 -- start start 2024-09-21T12:53:15.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e5e9d4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e58102b50 0x7f9e5819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e5e9d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e5e9d4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5810ede0 con 0x7f9e58103470 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e5e9d4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5810ec60 con 0x7f9e58102b50 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47028/0 (socket says 172.21.15.46:47028) 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e577fe640 1 -- 172.21.15.46:0/3004942016 learned_addr learned my addr 172.21.15.46:0/3004942016 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.619+0000 7f9e57fff640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e58102b50 0x7f9e5819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e577fe640 1 -- 172.21.15.46:0/3004942016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e58102b50 msgr2=0x7f9e5819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e577fe640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e58102b50 0x7f9e5819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e577fe640 1 -- 172.21.15.46:0/3004942016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e581977b0 con 0x7f9e58103470 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e577fe640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5819db70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e48004f90 tx=0x7f9e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e4803f070 con 0x7f9e58103470 2024-09-21T12:53:15.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e58197a40 con 0x7f9e58103470 2024-09-21T12:53:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e48004b80 con 0x7f9e58103470 2024-09-21T12:53:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e48035030 con 0x7f9e58103470 2024-09-21T12:53:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.620+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e58197f70 con 0x7f9e58103470 2024-09-21T12:53:15.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.621+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5806a4e0 con 0x7f9e58103470 2024-09-21T12:53:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.622+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9e48042070 con 0x7f9e58103470 2024-09-21T12:53:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.622+0000 7f9e557fa640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4407af40 0x7f9e4407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.622+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f9e480bea20 con 0x7f9e58103470 2024-09-21T12:53:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.622+0000 7f9e57fff640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4407af40 0x7f9e4407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.623+0000 7f9e57fff640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4407af40 0x7f9e4407d400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009bd0 tx=0x7f9e40005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:15.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.628+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e4808a020 con 0x7f9e58103470 2024-09-21T12:53:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:15 smithi176 ceph-mon[80162]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:15 smithi176 ceph-mon[80162]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:15 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3550063391' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:15 smithi176 ceph-mon[80162]: pgmap v181: 65 pgs: 10 active+undersized, 4 stale+active+clean, 10 active+undersized+degraded, 41 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 28/336 objects degraded (8.333%) 2024-09-21T12:53:15.859 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.858+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9e581982e0 con 0x7f9e4407af40 2024-09-21T12:53:15.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.859+0000 7f9e557fa640 1 -- 172.21.15.46:0/3004942016 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f9e581982e0 con 0x7f9e4407af40 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "8/23 daemons upgraded", 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:53:15.861 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.861+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4407af40 msgr2=0x7f9e4407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.861+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4407af40 0x7f9e4407d400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9e40009bd0 tx=0x7f9e40005f90 comp rx=0 tx=0).stop 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.861+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 msgr2=0x7f9e5819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.861+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5819db70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9e48004f90 tx=0x7f9e480046c0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.861+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 shutdown_connections 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.862+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4407af40 0x7f9e4407d400 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.862+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e58103470 0x7f9e5819db70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.862+0000 7f9e5e9d4640 1 --2- 172.21.15.46:0/3004942016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e58102b50 0x7f9e5819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.862+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 >> 172.21.15.46:0/3004942016 conn(0x7f9e580fc550 msgr2=0x7f9e58103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.862+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 shutdown_connections 2024-09-21T12:53:15.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.862+0000 7f9e5e9d4640 1 -- 172.21.15.46:0/3004942016 wait complete. 2024-09-21T12:53:15.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 -- 172.21.15.46:0/560439321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 msgr2=0x7f13e4102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/560439321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4102ef0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f13d40098b0 tx=0x7f13d402a560 comp rx=0 tx=0).stop 2024-09-21T12:53:15.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 -- 172.21.15.46:0/560439321 shutdown_connections 2024-09-21T12:53:15.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/560439321 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13e4103430 0x7f13e410b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/560439321 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4102ef0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 -- 172.21.15.46:0/560439321 >> 172.21.15.46:0/560439321 conn(0x7f13e40fc550 msgr2=0x7f13e40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:15.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 -- 172.21.15.46:0/560439321 shutdown_connections 2024-09-21T12:53:15.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.949+0000 7f13e9ddb640 1 -- 172.21.15.46:0/560439321 wait complete. 2024-09-21T12:53:15.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.950+0000 7f13e9ddb640 1 Processor -- start 2024-09-21T12:53:15.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.950+0000 7f13e9ddb640 1 -- start start 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.950+0000 7f13e9ddb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.950+0000 7f13e9ddb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13e4103430 0x7f13e4100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.950+0000 7f13e9ddb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410ede0 con 0x7f13e4102b10 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.950+0000 7f13e9ddb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f13e410ec60 con 0x7f13e4103430 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4100770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47044/0 (socket says 172.21.15.46:47044) 2024-09-21T12:53:15.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 -- 172.21.15.46:0/1847582908 learned_addr learned my addr 172.21.15.46:0/1847582908 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13daffd640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13e4103430 0x7f13e4100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 -- 172.21.15.46:0/1847582908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13e4103430 msgr2=0x7f13e4100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13e4103430 0x7f13e4100cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 -- 172.21.15.46:0/1847582908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e41011f0 con 0x7f13e4102b10 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e37fe640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4100770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13d4031460 tx=0x7f13d40045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.951+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13d403f070 con 0x7f13e4102b10 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.952+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f13d40035f0 con 0x7f13e4102b10 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.952+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13e4101480 con 0x7f13e4102b10 2024-09-21T12:53:15.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.952+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f13d4035030 con 0x7f13e4102b10 2024-09-21T12:53:15.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.952+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13e41a3e30 con 0x7f13e4102b10 2024-09-21T12:53:15.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.953+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13e406a520 con 0x7f13e4102b10 2024-09-21T12:53:15.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.954+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f13d4042070 con 0x7f13e4102b10 2024-09-21T12:53:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.955+0000 7f13e17fa640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f13d007af80 0x7f13d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.955+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 6156+0+0 (secure 0 0 0) 0x7f13d40be810 con 0x7f13e4102b10 2024-09-21T12:53:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.955+0000 7f13daffd640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f13d007af80 0x7f13d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:15.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.955+0000 7f13daffd640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f13d007af80 0x7f13d007d440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13e4102200 tx=0x7f13cc00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:15.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:15.959+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13d4089e90 con 0x7f13e4102b10 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 podman[127698]: 2024-09-21 12:53:15.869192762 +0000 UTC m=+0.407499551 container init 28cd3fcd836e386ca3cc3b0a1a6362fbe510e8d697f221071a07932e88671011 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 podman[127698]: 2024-09-21 12:53:15.873517719 +0000 UTC m=+0.411824508 container start 28cd3fcd836e386ca3cc3b0a1a6362fbe510e8d697f221071a07932e88671011 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:15 smithi046 podman[127698]: 2024-09-21 12:53:15.95236813 +0000 UTC m=+0.490674917 container attach 28cd3fcd836e386ca3cc3b0a1a6362fbe510e8d697f221071a07932e88671011 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:16 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:16 smithi046 bash[127698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:16 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:16.162 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:16 smithi046 bash[127698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.223+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f13e4102ef0 con 0x7f13e4102b10 2024-09-21T12:53:16.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.223+0000 7f13e17fa640 1 -- 172.21.15.46:0/1847582908 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1018 (secure 0 0 0) 0x7f13d408ed40 con 0x7f13e4102b10 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 28/336 objects degraded (8.333%), 10 pgs degraded 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: osd.2 (root=default,host=smithi046) is down 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/336 objects degraded (8.333%), 10 pgs degraded 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-21T12:53:16.225 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-21T12:53:16.226 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-21T12:53:16.226 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-21T12:53:16.226 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-21T12:53:16.226 INFO:teuthology.orchestra.run.smithi046.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-21T12:53:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f13d007af80 msgr2=0x7f13d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f13d007af80 0x7f13d007d440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f13e4102200 tx=0x7f13cc00b390 comp rx=0 tx=0).stop 2024-09-21T12:53:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 msgr2=0x7f13e4100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4100770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f13d4031460 tx=0x7f13d40045c0 comp rx=0 tx=0).stop 2024-09-21T12:53:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 shutdown_connections 2024-09-21T12:53:16.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f13d007af80 0x7f13d007d440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13e4103430 0x7f13e4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 --2- 172.21.15.46:0/1847582908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13e4102b10 0x7f13e4100770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 >> 172.21.15.46:0/1847582908 conn(0x7f13e40fc550 msgr2=0x7f13e4107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 shutdown_connections 2024-09-21T12:53:16.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:16.226+0000 7f13e9ddb640 1 -- 172.21.15.46:0/1847582908 wait complete. 2024-09-21T12:53:16.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:16 smithi046 ceph-mon[108126]: Health check failed: Degraded data redundancy: 28/336 objects degraded (8.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:16.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:16 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3190947628' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:53:16.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:16 smithi046 ceph-mon[108126]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:16.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:16 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1847582908' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:53:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:16 smithi176 ceph-mon[80162]: Health check failed: Degraded data redundancy: 28/336 objects degraded (8.333%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:16 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3190947628' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:53:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:16 smithi176 ceph-mon[80162]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:16 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1847582908' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:53:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:17 smithi176 ceph-mon[80162]: pgmap v182: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/336 objects degraded (12.798%) 2024-09-21T12:53:17.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:17 smithi046 ceph-mon[108126]: pgmap v182: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/336 objects degraded (12.798%) 2024-09-21T12:53:19.281 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:53:19.281 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:19.281 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 bash[127698]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 bash[127698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 bash[127698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 bash[127698]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:18 smithi046 bash[127698]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:53:19.282 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 bash[127698]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:53:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:19 smithi046 ceph-mon[108126]: pgmap v183: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 bash[127698]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 bash[127698]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 bash[127698]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate[127734]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T12:53:19.662 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 bash[127698]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T12:53:19.663 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 podman[127698]: 2024-09-21 12:53:19.31145503 +0000 UTC m=+3.849761831 container died 28cd3fcd836e386ca3cc3b0a1a6362fbe510e8d697f221071a07932e88671011 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:53:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:19 smithi176 ceph-mon[80162]: pgmap v183: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:20.328 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:19 smithi046 podman[127976]: 2024-09-21 12:53:19.981797929 +0000 UTC m=+0.664009494 container remove 28cd3fcd836e386ca3cc3b0a1a6362fbe510e8d697f221071a07932e88671011 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:53:20.328 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 podman[128035]: 2024-09-21 12:53:20.100707978 +0000 UTC m=+0.017302428 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:53:20.328 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 podman[128035]: 2024-09-21 12:53:20.199243116 +0000 UTC m=+0.115837608 container create 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T12:53:20.912 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 podman[128035]: 2024-09-21 12:53:20.451707679 +0000 UTC m=+0.368302139 container init 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T12:53:20.912 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 podman[128035]: 2024-09-21 12:53:20.455195638 +0000 UTC m=+0.371790096 container start 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:53:20.912 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 ceph-osd[128053]: -- 172.21.15.46:0/3836146320 <== mon.0 v2:172.21.15.46:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55afaba7c1e0 con 0x55afaba0c000 2024-09-21T12:53:20.912 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 bash[128035]: 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 2024-09-21T12:53:20.912 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:20 smithi046 systemd[1]: Started Ceph osd.2 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:53:21.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:21.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:21.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:53:21.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:21 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 43/336 objects degraded (12.798%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:21.822 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:21 smithi046 ceph-mon[108126]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:22.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:21 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:22.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:21 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:22.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:21 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:53:22.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:21 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 43/336 objects degraded (12.798%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:22.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:21 smithi176 ceph-mon[80162]: pgmap v184: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:22.412 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:22 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[128049]: 2024-09-21T12:53:22.089+0000 7ff18bcd3640 -1 Falling back to public interface 2024-09-21T12:53:23.696 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:23 smithi046 ceph-mon[108126]: pgmap v185: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:23 smithi176 ceph-mon[80162]: pgmap v185: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:25.687 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:25 smithi046 ceph-mon[108126]: pgmap v186: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:25 smithi176 ceph-mon[80162]: pgmap v186: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:26.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:26.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:26.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:26.998 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:26.998 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:26 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[128049]: 2024-09-21T12:53:26.863+0000 7ff18bcd3640 -1 osd.2 57 log_to_monitors true 2024-09-21T12:53:27.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:27.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:27.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:27.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:27.955 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:27 smithi046 ceph-mon[108126]: from='osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T12:53:27.956 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:27 smithi046 ceph-mon[108126]: pgmap v187: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:27.956 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 12:53:27 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[128049]: 2024-09-21T12:53:27.702+0000 7ff183a7d640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:53:28.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:27 smithi176 ceph-mon[80162]: from='osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T12:53:28.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:27 smithi176 ceph-mon[80162]: pgmap v187: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:53:29.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:28 smithi176 ceph-mon[80162]: from='osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:53:29.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:28 smithi176 ceph-mon[80162]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T12:53:29.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:28 smithi176 ceph-mon[80162]: from='osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T12:53:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:28 smithi046 ceph-mon[108126]: from='osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:53:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:28 smithi046 ceph-mon[108126]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T12:53:29.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:28 smithi046 ceph-mon[108126]: from='osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi046", "root=default"]} : dispatch 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371] boot 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: pgmap v190: 65 pgs: 10 peering, 9 active+undersized, 8 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 28/336 objects degraded (8.333%) 2024-09-21T12:53:29.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:29.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:29.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:53:29.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:53:29.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:29.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:29 smithi046 ceph-mon[108126]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T12:53:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:53:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: osd.2 [v2:172.21.15.46:6818/3863822371,v1:172.21.15.46:6819/3863822371] boot 2024-09-21T12:53:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: osdmap e61: 6 total, 6 up, 6 in 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: pgmap v190: 65 pgs: 10 peering, 9 active+undersized, 8 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s; 28/336 objects degraded (8.333%) 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:30.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:29 smithi176 ceph-mon[80162]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T12:53:31.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:53:31.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:31.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:31.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:31.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:53:31.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:53:31.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:53:31.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:30 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 28/336 objects degraded (8.333%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:53:31.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:53:31.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:30 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 28/336 objects degraded (8.333%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:32.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:31 smithi176 ceph-mon[80162]: pgmap v192: 65 pgs: 15 peering, 4 active+undersized, 5 active+undersized+degraded, 41 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 18/336 objects degraded (5.357%) 2024-09-21T12:53:32.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:31 smithi046 ceph-mon[108126]: pgmap v192: 65 pgs: 15 peering, 4 active+undersized, 5 active+undersized+degraded, 41 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s; 18/336 objects degraded (5.357%) 2024-09-21T12:53:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:33 smithi176 ceph-mon[80162]: pgmap v193: 65 pgs: 15 peering, 50 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-21T12:53:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:33 smithi176 ceph-mon[80162]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/336 objects degraded (5.357%), 5 pgs degraded) 2024-09-21T12:53:33.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:33 smithi046 ceph-mon[108126]: pgmap v193: 65 pgs: 15 peering, 50 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-21T12:53:33.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:33 smithi046 ceph-mon[108126]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/336 objects degraded (5.357%), 5 pgs degraded) 2024-09-21T12:53:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:35 smithi176 ceph-mon[80162]: pgmap v194: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:35.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:35 smithi046 ceph-mon[108126]: pgmap v194: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:37 smithi176 ceph-mon[80162]: pgmap v195: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T12:53:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:37 smithi046 ceph-mon[108126]: pgmap v195: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-21T12:53:39.751 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:39 smithi046 ceph-mon[108126]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:53:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:39 smithi176 ceph-mon[80162]: pgmap v196: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T12:53:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:41 smithi176 ceph-mon[80162]: pgmap v197: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:41.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:41 smithi046 ceph-mon[108126]: pgmap v197: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:43 smithi176 ceph-mon[80162]: pgmap v198: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:43.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:43 smithi046 ceph-mon[108126]: pgmap v198: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:53:45.491 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:45.491 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:53:45.491 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:45.491 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:53:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 -- 172.21.15.46:0/2286328945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 msgr2=0x7f1c7c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 --2- 172.21.15.46:0/2286328945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c106be0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c009880 tx=0x7f1c6c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 -- 172.21.15.46:0/2286328945 shutdown_connections 2024-09-21T12:53:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 --2- 172.21.15.46:0/2286328945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 0x7f1c7c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 --2- 172.21.15.46:0/2286328945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c106be0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 -- 172.21.15.46:0/2286328945 >> 172.21.15.46:0/2286328945 conn(0x7f1c7c0fc520 msgr2=0x7f1c7c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 -- 172.21.15.46:0/2286328945 shutdown_connections 2024-09-21T12:53:46.328 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.326+0000 7f1c80950640 1 -- 172.21.15.46:0/2286328945 wait complete. 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c80950640 1 Processor -- start 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c80950640 1 -- start start 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c80950640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 0x7f1c7c107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c80950640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c80950640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c10dcb0 con 0x7f1c7c106800 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c80950640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7c10db30 con 0x7f1c7c100800 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c71d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c71d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c107c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55658/0 (socket says 172.21.15.46:55658) 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c7a59c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 0x7f1c7c107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.327+0000 7f1c71d9b640 1 -- 172.21.15.46:0/1806716973 learned_addr learned my addr 172.21.15.46:0/1806716973 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:46.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c7a59c640 1 -- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 msgr2=0x7f1c7c107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c7a59c640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c7a59c640 1 -- 172.21.15.46:0/1806716973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7c1081b0 con 0x7f1c7c100800 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c71d9b640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c7a59c640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 0x7f1c7c107730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c02a9c0 tx=0x7f1c6c0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c03f070 con 0x7f1c7c100800 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c6c0035f0 con 0x7f1c7c100800 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7c108440 con 0x7f1c7c100800 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c6c035030 con 0x7f1c7c100800 2024-09-21T12:53:46.331 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.328+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c7c1a3d50 con 0x7f1c7c100800 2024-09-21T12:53:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.330+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c7c101f40 con 0x7f1c7c100800 2024-09-21T12:53:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.330+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1c6c042070 con 0x7f1c7c100800 2024-09-21T12:53:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.331+0000 7f1c73fff640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c6807af40 0x7f1c6807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.331+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f1c6c0be8e0 con 0x7f1c7c100800 2024-09-21T12:53:46.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.331+0000 7f1c71d9b640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c6807af40 0x7f1c6807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.331+0000 7f1c71d9b640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c6807af40 0x7f1c6807d400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c1091c0 tx=0x7f1c64005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:46.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.335+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c6c089e40 con 0x7f1c7c100800 2024-09-21T12:53:46.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:46 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:53:46.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:46 smithi176 ceph-mon[80162]: Upgrade: osd.3 is safe to restart 2024-09-21T12:53:46.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:46 smithi176 ceph-mon[80162]: pgmap v199: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:46.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:46 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:46.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:46 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T12:53:46.459 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:46 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:53:46.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.542+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1c7c06aa00 con 0x7f1c6807af40 2024-09-21T12:53:46.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:46 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:53:46.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:46 smithi046 ceph-mon[108126]: Upgrade: osd.3 is safe to restart 2024-09-21T12:53:46.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:46 smithi046 ceph-mon[108126]: pgmap v199: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:46.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:46 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:46.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:46 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T12:53:46.544 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:46 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:53:46.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.543+0000 7f1c73fff640 1 -- 172.21.15.46:0/1806716973 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f1c7c06aa00 con 0x7f1c6807af40 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c6807af40 msgr2=0x7f1c6807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c6807af40 0x7f1c6807d400 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c1091c0 tx=0x7f1c64005f90 comp rx=0 tx=0).stop 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 msgr2=0x7f1c7c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 0x7f1c7c107730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c02a9c0 tx=0x7f1c6c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 shutdown_connections 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c6807af40 0x7f1c6807d400 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c7c106800 0x7f1c7c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 --2- 172.21.15.46:0/1806716973 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7c100800 0x7f1c7c107730 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 >> 172.21.15.46:0/1806716973 conn(0x7f1c7c0fc520 msgr2=0x7f1c7c06a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:46.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 shutdown_connections 2024-09-21T12:53:46.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.546+0000 7f1c80950640 1 -- 172.21.15.46:0/1806716973 wait complete. 2024-09-21T12:53:46.556 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.632+0000 7f234832a640 1 -- 172.21.15.46:0/30461167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 msgr2=0x7f2340107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.632+0000 7f234832a640 1 --2- 172.21.15.46:0/30461167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f2340107ce0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f233c009880 tx=0x7f233c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 -- 172.21.15.46:0/30461167 shutdown_connections 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 --2- 172.21.15.46:0/30461167 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2340101900 0x7f2340101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 --2- 172.21.15.46:0/30461167 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f2340107ce0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 -- 172.21.15.46:0/30461167 >> 172.21.15.46:0/30461167 conn(0x7f23400fd600 msgr2=0x7f23400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 -- 172.21.15.46:0/30461167 shutdown_connections 2024-09-21T12:53:46.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 -- 172.21.15.46:0/30461167 wait complete. 2024-09-21T12:53:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 Processor -- start 2024-09-21T12:53:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.633+0000 7f234832a640 1 -- start start 2024-09-21T12:53:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f234832a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2340101900 0x7f234019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f234832a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f234019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f234832a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f234010edb0 con 0x7f2340107900 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f234832a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f234010ec30 con 0x7f2340101900 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f234019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f234019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55674/0 (socket says 172.21.15.46:55674) 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 -- 172.21.15.46:0/2373020580 learned_addr learned my addr 172.21.15.46:0/2373020580 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23460c6640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2340101900 0x7f234019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 -- 172.21.15.46:0/2373020580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2340101900 msgr2=0x7f234019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2340101900 0x7f234019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 -- 172.21.15.46:0/2373020580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23401977e0 con 0x7f2340107900 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23458c5640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f234019dba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f233000d8d0 tx=0x7f233000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2330017070 con 0x7f2340107900 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2340197ad0 con 0x7f2340107900 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2330010460 con 0x7f2340107900 2024-09-21T12:53:46.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.634+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f233000f5f0 con 0x7f2340107900 2024-09-21T12:53:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.635+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2340198060 con 0x7f2340107900 2024-09-21T12:53:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.635+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2340103040 con 0x7f2340107900 2024-09-21T12:53:46.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.636+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2330009a30 con 0x7f2340107900 2024-09-21T12:53:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.637+0000 7f23377fe640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f232c07af30 0x7f232c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.637+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f233009de30 con 0x7f2340107900 2024-09-21T12:53:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.637+0000 7f23460c6640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f232c07af30 0x7f232c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.637+0000 7f23460c6640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f232c07af30 0x7f232c07d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f233c0096c0 tx=0x7f233c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:46.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.641+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2330069430 con 0x7f2340107900 2024-09-21T12:53:46.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.847+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2340198310 con 0x7f232c07af30 2024-09-21T12:53:46.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.848+0000 7f23377fe640 1 -- 172.21.15.46:0/2373020580 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2340198310 con 0x7f232c07af30 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.850+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f232c07af30 msgr2=0x7f232c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.850+0000 7f234832a640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f232c07af30 0x7f232c07d3f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f233c0096c0 tx=0x7f233c031400 comp rx=0 tx=0).stop 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.850+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 msgr2=0x7f234019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.850+0000 7f234832a640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f234019dba0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f233000d8d0 tx=0x7f233000dd90 comp rx=0 tx=0).stop 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 shutdown_connections 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f232c07af30 0x7f232c07d3f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2340107900 0x7f234019dba0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 --2- 172.21.15.46:0/2373020580 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2340101900 0x7f234019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 >> 172.21.15.46:0/2373020580 conn(0x7f23400fd600 msgr2=0x7f23400fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 shutdown_connections 2024-09-21T12:53:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.851+0000 7f234832a640 1 -- 172.21.15.46:0/2373020580 wait complete. 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/404478535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 msgr2=0x7fb6e4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/404478535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e4107ce0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4009880 tx=0x7fb6d402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/404478535 shutdown_connections 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/404478535 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e4101900 0x7fb6e4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/404478535 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e4107ce0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/404478535 >> 172.21.15.46:0/404478535 conn(0x7fb6e40fd600 msgr2=0x7fb6e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/404478535 shutdown_connections 2024-09-21T12:53:46.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.935+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/404478535 wait complete. 2024-09-21T12:53:46.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e9d7e640 1 Processor -- start 2024-09-21T12:53:46.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e9d7e640 1 -- start start 2024-09-21T12:53:46.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e9d7e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e4101900 0x7fb6e419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e9d7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e419fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e9d7e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e410edb0 con 0x7fb6e4107900 2024-09-21T12:53:46.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e9d7e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e410ec30 con 0x7fb6e4101900 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e419fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e419fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55698/0 (socket says 172.21.15.46:55698) 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e2ffd640 1 -- 172.21.15.46:0/2536555106 learned_addr learned my addr 172.21.15.46:0/2536555106 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.936+0000 7fb6e37fe640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e4101900 0x7fb6e419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e2ffd640 1 -- 172.21.15.46:0/2536555106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e4101900 msgr2=0x7fb6e419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e2ffd640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e4101900 0x7fb6e419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e2ffd640 1 -- 172.21.15.46:0/2536555106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e4199a50 con 0x7fb6e4107900 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e2ffd640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e419fdd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800d8d0 tx=0x7fb6d800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6d8017070 con 0x7fb6e4107900 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6d8010460 con 0x7fb6e4107900 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e4199d40 con 0x7fb6e4107900 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6d800f5f0 con 0x7fb6e4107900 2024-09-21T12:53:46.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.937+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e419a2d0 con 0x7fb6e4107900 2024-09-21T12:53:46.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.938+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e4103040 con 0x7fb6e4107900 2024-09-21T12:53:46.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.939+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb6d8009a30 con 0x7fb6e4107900 2024-09-21T12:53:46.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.939+0000 7fb6e0ff9640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6cc07af80 0x7fb6cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:46.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.939+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fb6d809dd40 con 0x7fb6e4107900 2024-09-21T12:53:46.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.939+0000 7fb6e37fe640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6cc07af80 0x7fb6cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:46.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.940+0000 7fb6e37fe640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6cc07af80 0x7fb6cc07d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4000c00 tx=0x7fb6d4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:46.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:46.944+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6d80693c0 con 0x7fb6e4107900 2024-09-21T12:53:47.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.144+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb6e419b050 con 0x7fb6cc07af80 2024-09-21T12:53:47.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.154+0000 7fb6e0ff9640 1 -- 172.21.15.46:0/2536555106 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fb6e419b050 con 0x7fb6cc07af80 2024-09-21T12:53:47.155 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (3m) 21s ago 14m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (7m) 21s ago 15m 9126k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (7m) 2m ago 14m 8799k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (2m) 21s ago 14m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (2m) 2m ago 14m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (3m) 21s ago 14m 78.8M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (9m) 21s ago 9m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (9m) 21s ago 9m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (9m) 2m ago 9m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (9m) 2m ago 9m 26.8M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (6m) 21s ago 16m 528M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:53:47.156 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (5m) 2m ago 13m 457M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (2m) 21s ago 16m 42.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (2m) 2m ago 13m 26.1M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 21s ago 14m 11.3M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (4m) 2m ago 14m 11.6M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (101s) 21s ago 12m 82.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (64s) 21s ago 12m 90.4M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (27s) 21s ago 11m 12.0M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (11m) 2m ago 11m 229M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 8697c6675153 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (10m) 2m ago 10m 207M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (10m) 2m ago 10m 190M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:53:47.157 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 21s ago 14m 56.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:53:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6cc07af80 msgr2=0x7fb6cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6cc07af80 0x7fb6cc07d440 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4000c00 tx=0x7fb6d4031400 comp rx=0 tx=0).stop 2024-09-21T12:53:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 msgr2=0x7fb6e419fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e419fdd0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800d8d0 tx=0x7fb6d800dd90 comp rx=0 tx=0).stop 2024-09-21T12:53:47.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 shutdown_connections 2024-09-21T12:53:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6cc07af80 0x7fb6cc07d440 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb6e4107900 0x7fb6e419fdd0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 --2- 172.21.15.46:0/2536555106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e4101900 0x7fb6e419f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 >> 172.21.15.46:0/2536555106 conn(0x7fb6e40fd600 msgr2=0x7fb6e4074940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 shutdown_connections 2024-09-21T12:53:47.159 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.156+0000 7fb6e9d7e640 1 -- 172.21.15.46:0/2536555106 wait complete. 2024-09-21T12:53:47.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/564502761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 msgr2=0x7fc2d0106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/564502761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d0106610 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0009880 tx=0x7fc2c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/564502761 shutdown_connections 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/564502761 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d0106610 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/564502761 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2d0100120 0x7fc2d0100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/564502761 >> 172.21.15.46:0/564502761 conn(0x7fc2d00fbc90 msgr2=0x7fc2d00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/564502761 shutdown_connections 2024-09-21T12:53:47.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.240+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/564502761 wait complete. 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d7b1c640 1 Processor -- start 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d7b1c640 1 -- start start 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d7b1c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2d0100120 0x7fc2d019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d7b1c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d019dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d7b1c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d010eec0 con 0x7fc2d0100ad0 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d7b1c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d010ed40 con 0x7fc2d0100120 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d019dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d019dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55704/0 (socket says 172.21.15.46:55704) 2024-09-21T12:53:47.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 -- 172.21.15.46:0/2253435384 learned_addr learned my addr 172.21.15.46:0/2253435384 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d58b8640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2d0100120 0x7fc2d019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 -- 172.21.15.46:0/2253435384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2d0100120 msgr2=0x7fc2d019d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2d0100120 0x7fc2d019d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 -- 172.21.15.46:0/2253435384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d0197970 con 0x7fc2d0100ad0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.241+0000 7fc2d50b7640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d019dcf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0031460 tx=0x7fc2c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.242+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2c003f070 con 0x7fc2d0100ad0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.242+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d0197c00 con 0x7fc2d0100ad0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.242+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc2c0004cf0 con 0x7fc2d0100ad0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.242+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d0198130 con 0x7fc2d0100ad0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.242+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc2c0035030 con 0x7fc2d0100ad0 2024-09-21T12:53:47.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.243+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d01031e0 con 0x7fc2d0100ad0 2024-09-21T12:53:47.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.243+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc2c0042070 con 0x7fc2d0100ad0 2024-09-21T12:53:47.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.244+0000 7fc2c6ffd640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc2bc07af30 0x7fc2bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.244+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fc2c00beb00 con 0x7fc2d0100ad0 2024-09-21T12:53:47.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.244+0000 7fc2d58b8640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc2bc07af30 0x7fc2bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.244+0000 7fc2d58b8640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc2bc07af30 0x7fc2bc07d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0198ab0 tx=0x7fc2cc008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:47.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.249+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2c008a100 con 0x7fc2d0100ad0 2024-09-21T12:53:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:47 smithi046 ceph-mon[108126]: Upgrade: Updating osd.3 2024-09-21T12:53:47.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:47 smithi046 ceph-mon[108126]: Deploying daemon osd.3 on smithi176 2024-09-21T12:53:47.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.512+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fc2d0109f10 con 0x7fc2d0100ad0 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.512+0000 7fc2c6ffd640 1 -- 172.21.15.46:0/2253435384 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fc2c008c620 con 0x7fc2d0100ad0 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:47.514 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 3 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 7 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:53:47.515 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc2bc07af30 msgr2=0x7fc2bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc2bc07af30 0x7fc2bc07d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0198ab0 tx=0x7fc2cc008040 comp rx=0 tx=0).stop 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 msgr2=0x7fc2d019dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d019dcf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0031460 tx=0x7fc2c00048f0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 shutdown_connections 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc2bc07af30 0x7fc2bc07d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc2d0100ad0 0x7fc2d019dcf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 --2- 172.21.15.46:0/2253435384 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2d0100120 0x7fc2d019d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 >> 172.21.15.46:0/2253435384 conn(0x7fc2d00fbc90 msgr2=0x7fc2d00fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 shutdown_connections 2024-09-21T12:53:47.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.514+0000 7fc2d7b1c640 1 -- 172.21.15.46:0/2253435384 wait complete. 2024-09-21T12:53:47.557 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:47 smithi176 ceph-mon[80162]: Upgrade: Updating osd.3 2024-09-21T12:53:47.557 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:47 smithi176 ceph-mon[80162]: Deploying daemon osd.3 on smithi176 2024-09-21T12:53:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 -- 172.21.15.46:0/3002989442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 msgr2=0x7f7104101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 --2- 172.21.15.46:0/3002989442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f7104101d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f70f8009880 tx=0x7f70f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 -- 172.21.15.46:0/3002989442 shutdown_connections 2024-09-21T12:53:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 --2- 172.21.15.46:0/3002989442 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f7104101d60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 --2- 172.21.15.46:0/3002989442 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 0x7f7104107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 -- 172.21.15.46:0/3002989442 >> 172.21.15.46:0/3002989442 conn(0x7f71040fd600 msgr2=0x7f71040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:47.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 -- 172.21.15.46:0/3002989442 shutdown_connections 2024-09-21T12:53:47.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.599+0000 7f710a44d640 1 -- 172.21.15.46:0/3002989442 wait complete. 2024-09-21T12:53:47.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f710a44d640 1 Processor -- start 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f710a44d640 1 -- start start 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f710a44d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f710419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f710a44d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 0x7f710419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f710a44d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f710410ee30 con 0x7f7104101900 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f710a44d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f710410ecb0 con 0x7f7104107900 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f7103fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f710419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f7103fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f710419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35174/0 (socket says 172.21.15.46:35174) 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f7103fff640 1 -- 172.21.15.46:0/1200517466 learned_addr learned my addr 172.21.15.46:0/1200517466 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f71037fe640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 0x7f710419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f7103fff640 1 -- 172.21.15.46:0/1200517466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 msgr2=0x7f710419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f7103fff640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 0x7f710419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f7103fff640 1 -- 172.21.15.46:0/1200517466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7104197840 con 0x7f7104101900 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.600+0000 7f71037fe640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 0x7f710419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:53:47.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.601+0000 7f7103fff640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f710419d6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b420 tx=0x7f70f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.601+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70f4011630 con 0x7f7104101900 2024-09-21T12:53:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.601+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70f4016070 con 0x7f7104101900 2024-09-21T12:53:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.601+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7104197b30 con 0x7f7104101900 2024-09-21T12:53:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.601+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70f4010d40 con 0x7f7104101900 2024-09-21T12:53:47.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.601+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71041980c0 con 0x7f7104101900 2024-09-21T12:53:47.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.602+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7104103040 con 0x7f7104101900 2024-09-21T12:53:47.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.602+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f70f401b460 con 0x7f7104101900 2024-09-21T12:53:47.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.603+0000 7f71017fa640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70ec07af30 0x7f70ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.603+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f70f409d740 con 0x7f7104101900 2024-09-21T12:53:47.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.603+0000 7f71037fe640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70ec07af30 0x7f70ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.603+0000 7f71037fe640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70ec07af30 0x7f70ec07d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70f8031460 tx=0x7f70f80095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:47.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.607+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70f4021250 con 0x7f7104101900 2024-09-21T12:53:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.836+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7104109e90 con 0x7f7104101900 2024-09-21T12:53:47.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.837+0000 7f71017fa640 1 -- 172.21.15.46:0/1200517466 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f70f4068d40 con 0x7f7104101900 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:53:47.839 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:53:47.840 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:53:47.841 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:53:47.842 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:47.842 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:47.842 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:47.842 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:53:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:53:47.842 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70ec07af30 msgr2=0x7f70ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70ec07af30 0x7f70ec07d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70f8031460 tx=0x7f70f80095f0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 msgr2=0x7f710419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f710419d6c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f70f400b420 tx=0x7f70f400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 shutdown_connections 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70ec07af30 0x7f70ec07d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7104107900 0x7f710419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 --2- 172.21.15.46:0/1200517466 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7104101900 0x7f710419d6c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 >> 172.21.15.46:0/1200517466 conn(0x7f71040fd600 msgr2=0x7f71040fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 shutdown_connections 2024-09-21T12:53:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.840+0000 7f710a44d640 1 -- 172.21.15.46:0/1200517466 wait complete. 2024-09-21T12:53:47.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.927+0000 7fb05cdcb640 1 -- 172.21.15.46:0/4250590809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 msgr2=0x7fb058102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.929 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.927+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/4250590809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058102ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb048009880 tx=0x7fb04802a530 comp rx=0 tx=0).stop 2024-09-21T12:53:47.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 -- 172.21.15.46:0/4250590809 shutdown_connections 2024-09-21T12:53:47.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/4250590809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0581033e0 0x7fb05810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/4250590809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058102ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 -- 172.21.15.46:0/4250590809 >> 172.21.15.46:0/4250590809 conn(0x7fb0580fc520 msgr2=0x7fb0580fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:47.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 -- 172.21.15.46:0/4250590809 shutdown_connections 2024-09-21T12:53:47.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 -- 172.21.15.46:0/4250590809 wait complete. 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 Processor -- start 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.928+0000 7fb05cdcb640 1 -- start start 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05cdcb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05cdcb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0581033e0 0x7fb058100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05cdcb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb05810edf0 con 0x7fb058102ac0 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05cdcb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb05810ec70 con 0x7fb0581033e0 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35190/0 (socket says 172.21.15.46:35190) 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 -- 172.21.15.46:0/335461942 learned_addr learned my addr 172.21.15.46:0/335461942 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb055d9b640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0581033e0 0x7fb058100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 -- 172.21.15.46:0/335461942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0581033e0 msgr2=0x7fb058100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0581033e0 0x7fb058100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 -- 172.21.15.46:0/335461942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0581011a0 con 0x7fb058102ac0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb05659c640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058100720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb048031460 tx=0x7fb0480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.929+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb04803f070 con 0x7fb058102ac0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.930+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0480035f0 con 0x7fb058102ac0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.930+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb058101430 con 0x7fb058102ac0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.930+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb048035030 con 0x7fb058102ac0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.930+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0581a3d80 con 0x7fb058102ac0 2024-09-21T12:53:47.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.931+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05806aa90 con 0x7fb058102ac0 2024-09-21T12:53:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.931+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb048042070 con 0x7fb058102ac0 2024-09-21T12:53:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.932+0000 7fb0477fe640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb04007af80 0x7fb04007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:47.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.932+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7fb0480be900 con 0x7fb058102ac0 2024-09-21T12:53:47.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.932+0000 7fb055d9b640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb04007af80 0x7fb04007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:47.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.932+0000 7fb055d9b640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb04007af80 0x7fb04007d440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0581021b0 tx=0x7fb04c00b2e0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:47.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:47.936+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb048089ee0 con 0x7fb058102ac0 2024-09-21T12:53:48.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.143+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb05810b640 con 0x7fb04007af80 2024-09-21T12:53:48.145 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.144+0000 7fb0477fe640 1 -- 172.21.15.46:0/335461942 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7fb05810b640 con 0x7fb04007af80 2024-09-21T12:53:48.145 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:53:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:53:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:53:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:53:48.145 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "9/23 daemons upgraded", 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:53:48.146 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb04007af80 msgr2=0x7fb04007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb04007af80 0x7fb04007d440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb0581021b0 tx=0x7fb04c00b2e0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 msgr2=0x7fb058100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058100720 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb048031460 tx=0x7fb0480045e0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 shutdown_connections 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb04007af80 0x7fb04007d440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0581033e0 0x7fb058100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 --2- 172.21.15.46:0/335461942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb058102ac0 0x7fb058100720 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 >> 172.21.15.46:0/335461942 conn(0x7fb0580fc520 msgr2=0x7fb05810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:48.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 shutdown_connections 2024-09-21T12:53:48.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.146+0000 7fb05cdcb640 1 -- 172.21.15.46:0/335461942 wait complete. 2024-09-21T12:53:48.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 -- 172.21.15.46:0/2501086862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801067f0 msgr2=0x7f9680106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:48.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 --2- 172.21.15.46:0/2501086862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801067f0 0x7f9680106bd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9674009880 tx=0x7f967402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 -- 172.21.15.46:0/2501086862 shutdown_connections 2024-09-21T12:53:48.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 --2- 172.21.15.46:0/2501086862 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96801007f0 0x7f9680100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 --2- 172.21.15.46:0/2501086862 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801067f0 0x7f9680106bd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 -- 172.21.15.46:0/2501086862 >> 172.21.15.46:0/2501086862 conn(0x7f96800fc550 msgr2=0x7f96800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 -- 172.21.15.46:0/2501086862 shutdown_connections 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.230+0000 7f96871dd640 1 -- 172.21.15.46:0/2501086862 wait complete. 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f96871dd640 1 Processor -- start 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f96871dd640 1 -- start start 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f96871dd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 0x7f968019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f96871dd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96801067f0 0x7f968019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f96871dd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f968010dcc0 con 0x7f96801007f0 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f96871dd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f968010db40 con 0x7f96801067f0 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f9684f79640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 0x7f968019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f9684f79640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 0x7f968019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35212/0 (socket says 172.21.15.46:35212) 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f9684f79640 1 -- 172.21.15.46:0/2719231111 learned_addr learned my addr 172.21.15.46:0/2719231111 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:53:48.234 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.231+0000 7f967ffff640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96801067f0 0x7f968019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f9684f79640 1 -- 172.21.15.46:0/2719231111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96801067f0 msgr2=0x7f968019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f9684f79640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96801067f0 0x7f968019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f9684f79640 1 -- 172.21.15.46:0/2719231111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96801977c0 con 0x7f96801007f0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f9684f79640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 0x7f968019d640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9674031460 tx=0x7f96740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f967403f070 con 0x7f96801007f0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9674004b10 con 0x7f96801007f0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9680197a50 con 0x7f96801007f0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9674035030 con 0x7f96801007f0 2024-09-21T12:53:48.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.232+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9680197f80 con 0x7f96801007f0 2024-09-21T12:53:48.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.233+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9680101f30 con 0x7f96801007f0 2024-09-21T12:53:48.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.234+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9674042070 con 0x7f96801007f0 2024-09-21T12:53:48.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.235+0000 7f967dffb640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967007af90 0x7f967007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:53:48.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.235+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6156+0+0 (secure 0 0 0) 0x7f96740be9c0 con 0x7f96801007f0 2024-09-21T12:53:48.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.235+0000 7f967ffff640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967007af90 0x7f967007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:53:48.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.235+0000 7f967ffff640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967007af90 0x7f967007d450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f968006ad80 tx=0x7f966c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:53:48.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.239+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f967408a040 con 0x7f96801007f0 2024-09-21T12:53:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:48 smithi046 ceph-mon[108126]: from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:48 smithi046 ceph-mon[108126]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:48 smithi046 ceph-mon[108126]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:48 smithi046 ceph-mon[108126]: pgmap v200: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:48 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2253435384' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:48 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1200517466' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:53:48.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.504+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f96801982f0 con 0x7f96801007f0 2024-09-21T12:53:48.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.504+0000 7f967dffb640 1 -- 172.21.15.46:0/2719231111 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f967408eef0 con 0x7f96801007f0 2024-09-21T12:53:48.505 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:53:48.505 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:53:48.506 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:53:48.507 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967007af90 msgr2=0x7f967007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967007af90 0x7f967007d450 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f968006ad80 tx=0x7f966c00b390 comp rx=0 tx=0).stop 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 msgr2=0x7f968019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 0x7f968019d640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9674031460 tx=0x7f96740045e0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 shutdown_connections 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967007af90 0x7f967007d450 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96801067f0 0x7f968019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 --2- 172.21.15.46:0/2719231111 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f96801007f0 0x7f968019d640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 >> 172.21.15.46:0/2719231111 conn(0x7f96800fc550 msgr2=0x7f96801045a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 shutdown_connections 2024-09-21T12:53:48.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:53:48.506+0000 7f96871dd640 1 -- 172.21.15.46:0/2719231111 wait complete. 2024-09-21T12:53:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:48 smithi176 ceph-mon[80162]: from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:48.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:48 smithi176 ceph-mon[80162]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:48.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:48 smithi176 ceph-mon[80162]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:48.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:48 smithi176 ceph-mon[80162]: pgmap v200: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:53:48.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:48 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2253435384' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:53:48.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:48 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1200517466' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:53:49.483 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:49 smithi176 systemd[1]: Stopping Ceph osd.3 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:53:49.484 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:49 smithi176 ceph-mon[80162]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:49.484 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:49 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2719231111' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:53:49.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:49 smithi046 ceph-mon[108126]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:53:49.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:49 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2719231111' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:53:49.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:49 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[41424]: 2024-09-21T12:53:49.481+0000 7f78c52a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:53:49.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:49 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[41424]: 2024-09-21T12:53:49.481+0000 7f78c52a5640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-21T12:53:49.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:49 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[41424]: 2024-09-21T12:53:49.481+0000 7f78c52a5640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:53:50.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:50 smithi176 ceph-mon[80162]: pgmap v201: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:50.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:50 smithi176 ceph-mon[80162]: osd.3 marked itself down and dead 2024-09-21T12:53:50.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:50 smithi046 ceph-mon[108126]: pgmap v201: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:50.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:50 smithi046 ceph-mon[108126]: osd.3 marked itself down and dead 2024-09-21T12:53:50.934 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:50 smithi176 podman[87569]: 2024-09-21 12:53:50.657060603 +0000 UTC m=+1.277335683 container died 8697c667515335ca659730fa628aa51b46c2bfa42cfeff10ba48babbf50777b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T12:53:51.289 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 podman[87569]: 2024-09-21 12:53:51.117505683 +0000 UTC m=+1.737780762 container cleanup 8697c667515335ca659730fa628aa51b46c2bfa42cfeff10ba48babbf50777b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:53:51.289 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 bash[87569]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3 2024-09-21T12:53:51.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:51 smithi046 ceph-mon[108126]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:53:51.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:51 smithi046 ceph-mon[108126]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T12:53:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:51 smithi176 ceph-mon[80162]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:53:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:51 smithi176 ceph-mon[80162]: osdmap e63: 6 total, 5 up, 6 in 2024-09-21T12:53:51.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 podman[87585]: 2024-09-21 12:53:51.41059684 +0000 UTC m=+0.747856243 container remove 8697c667515335ca659730fa628aa51b46c2bfa42cfeff10ba48babbf50777b4 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:53:51.993 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 podman[87673]: 2024-09-21 12:53:51.642921967 +0000 UTC m=+0.015760837 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:53:51.993 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 podman[87673]: 2024-09-21 12:53:51.761606879 +0000 UTC m=+0.134445742 container create 1d378c42ba4923730622fa13eba837b2f38cc3fac1ff47ca135f4d09a47748a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:53:51.993 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 podman[87673]: 2024-09-21 12:53:51.988812323 +0000 UTC m=+0.361651197 container init 1d378c42ba4923730622fa13eba837b2f38cc3fac1ff47ca135f4d09a47748a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:53:51.993 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:51 smithi176 podman[87673]: 2024-09-21 12:53:51.99245465 +0000 UTC m=+0.365293514 container start 1d378c42ba4923730622fa13eba837b2f38cc3fac1ff47ca135f4d09a47748a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T12:53:52.298 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:52 smithi176 podman[87673]: 2024-09-21 12:53:52.097383512 +0000 UTC m=+0.470222382 container attach 1d378c42ba4923730622fa13eba837b2f38cc3fac1ff47ca135f4d09a47748a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:53:52.298 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:52 smithi176 podman[87673]: 2024-09-21 12:53:52.181598986 +0000 UTC m=+0.554437855 container died 1d378c42ba4923730622fa13eba837b2f38cc3fac1ff47ca135f4d09a47748a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True) 2024-09-21T12:53:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:52 smithi176 ceph-mon[80162]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T12:53:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:52 smithi176 ceph-mon[80162]: pgmap v204: 65 pgs: 9 peering, 14 stale+active+clean, 42 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:52.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:52 smithi046 ceph-mon[108126]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T12:53:52.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:52 smithi046 ceph-mon[108126]: pgmap v204: 65 pgs: 9 peering, 14 stale+active+clean, 42 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T12:53:53.285 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:52 smithi176 podman[87696]: 2024-09-21 12:53:52.851390301 +0000 UTC m=+0.664142485 container remove 1d378c42ba4923730622fa13eba837b2f38cc3fac1ff47ca135f4d09a47748a0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T12:53:53.285 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:52 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T12:53:53.285 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:52 smithi176 systemd[1]: Stopped Ceph osd.3 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:53:53.285 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:52 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.3.service: Consumed 1min 2.864s CPU time. 2024-09-21T12:53:53.285 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 systemd[1]: Starting Ceph osd.3 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:53:53.539 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:53 smithi176 ceph-mon[80162]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T12:53:53.539 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 podman[87797]: 2024-09-21 12:53:53.186893607 +0000 UTC m=+0.016486583 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:53:53.539 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 podman[87797]: 2024-09-21 12:53:53.335741454 +0000 UTC m=+0.165334502 container create 0edea11bcb1394086cccd02903eb6d84ab946639eff34b4080328c6db5385db7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:53:53.539 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 podman[87797]: 2024-09-21 12:53:53.538826678 +0000 UTC m=+0.368419654 container init 0edea11bcb1394086cccd02903eb6d84ab946639eff34b4080328c6db5385db7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T12:53:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:53 smithi046 ceph-mon[108126]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-09-21T12:53:53.817 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 podman[87797]: 2024-09-21 12:53:53.542234413 +0000 UTC m=+0.371827397 container start 0edea11bcb1394086cccd02903eb6d84ab946639eff34b4080328c6db5385db7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:53:53.817 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 podman[87797]: 2024-09-21 12:53:53.622200088 +0000 UTC m=+0.451793068 container attach 0edea11bcb1394086cccd02903eb6d84ab946639eff34b4080328c6db5385db7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T12:53:53.817 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:53.817 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 bash[87797]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:53.817 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:53.817 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:53 smithi176 bash[87797]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:54 smithi046 ceph-mon[108126]: pgmap v205: 65 pgs: 2 active+undersized, 9 peering, 13 stale+active+clean, 2 active+undersized+degraded, 39 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 4/336 objects degraded (1.190%) 2024-09-21T12:53:54.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:54 smithi176 ceph-mon[80162]: pgmap v205: 65 pgs: 2 active+undersized, 9 peering, 13 stale+active+clean, 2 active+undersized+degraded, 39 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 3 op/s; 4/336 objects degraded (1.190%) 2024-09-21T12:53:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:55 smithi176 ceph-mon[80162]: Health check failed: Degraded data redundancy: 4/336 objects degraded (1.190%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:55.588 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:55 smithi046 ceph-mon[108126]: Health check failed: Degraded data redundancy: 4/336 objects degraded (1.190%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T12:53:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-mon[80162]: pgmap v206: 65 pgs: 16 active+undersized, 9 peering, 13 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/336 objects degraded (15.179%) 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T12:53:56.567 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T12:53:56.597 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:56 smithi046 ceph-mon[108126]: pgmap v206: 65 pgs: 16 active+undersized, 9 peering, 13 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 51/336 objects degraded (15.179%) 2024-09-21T12:53:57.066 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate[87812]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 bash[87797]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T12:53:57.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:56 smithi176 podman[87797]: 2024-09-21 12:53:56.802251715 +0000 UTC m=+3.631844692 container died 0edea11bcb1394086cccd02903eb6d84ab946639eff34b4080328c6db5385db7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:53:57.705 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:57 smithi176 ceph-mon[80162]: pgmap v207: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:53:57.706 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:57 smithi176 ceph-mon[80162]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:53:57.706 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:57 smithi176 podman[88022]: 2024-09-21 12:53:57.479166312 +0000 UTC m=+0.670788293 container remove 0edea11bcb1394086cccd02903eb6d84ab946639eff34b4080328c6db5385db7 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:53:57.706 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:57 smithi176 podman[88082]: 2024-09-21 12:53:57.591967789 +0000 UTC m=+0.015926170 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:53:57.706 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:57 smithi176 podman[88082]: 2024-09-21 12:53:57.705032688 +0000 UTC m=+0.128991121 container create 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T12:53:57.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:57 smithi046 ceph-mon[108126]: pgmap v207: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:53:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:57 smithi046 ceph-mon[108126]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:53:58.016 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:57 smithi176 podman[88082]: 2024-09-21 12:53:57.907282548 +0000 UTC m=+0.331240926 container init 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:53:58.016 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:57 smithi176 podman[88082]: 2024-09-21 12:53:57.910422164 +0000 UTC m=+0.334380536 container start 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T12:53:58.016 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:57 smithi176 ceph-osd[88101]: -- 172.21.15.176:0/1660327240 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b42103e1e0 con 0x55b420fce000 2024-09-21T12:53:58.281 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:58 smithi176 bash[88082]: 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 2024-09-21T12:53:58.281 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:58 smithi176 systemd[1]: Started Ceph osd.3 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:53:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:53:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:53:59.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:59.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:53:59.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:53:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:00.066 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:53:59 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T12:53:59.794+0000 7fc275713640 -1 Falling back to public interface 2024-09-21T12:54:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:00 smithi046 ceph-mon[108126]: pgmap v208: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:00 smithi176 ceph-mon[80162]: pgmap v208: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:01 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 71/336 objects degraded (21.131%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:01 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:01 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:01 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 71/336 objects degraded (21.131%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:01 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:01 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:02 smithi046 ceph-mon[108126]: pgmap v209: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:02.732 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:02.732 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:02.732 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:02 smithi176 ceph-mon[80162]: pgmap v209: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:03 smithi176 ceph-mon[80162]: pgmap v210: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:03.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:03 smithi046 ceph-mon[108126]: pgmap v210: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:05.750 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:05.750 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:05.750 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:05.750 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:54:05.750 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:05.750 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:05.751 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:05.751 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:05.751 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:05.751 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:54:05.751 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:54:05.751 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-mon[80162]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:54:05.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:54:05.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:05 smithi046 ceph-mon[108126]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T12:54:06.066 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:54:05 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T12:54:05.749+0000 7fc275713640 -1 osd.3 62 log_to_monitors true 2024-09-21T12:54:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:06 smithi046 ceph-mon[108126]: pgmap v211: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:06 smithi046 ceph-mon[108126]: from='osd.3 [v2:172.21.15.176:6800/2902031340,v1:172.21.15.176:6801/2902031340]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:54:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:06 smithi046 ceph-mon[108126]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:54:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:06 smithi176 ceph-mon[80162]: pgmap v211: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 71/336 objects degraded (21.131%) 2024-09-21T12:54:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:06 smithi176 ceph-mon[80162]: from='osd.3 [v2:172.21.15.176:6800/2902031340,v1:172.21.15.176:6801/2902031340]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:54:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:06 smithi176 ceph-mon[80162]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:54:07.067 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 12:54:06 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T12:54:06.603+0000 7fc26d4bd640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:54:07.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:07 smithi046 ceph-mon[108126]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:54:07.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:07 smithi046 ceph-mon[108126]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T12:54:07.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:07 smithi046 ceph-mon[108126]: from='osd.3 [v2:172.21.15.176:6800/2902031340,v1:172.21.15.176:6801/2902031340]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:07.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:07 smithi046 ceph-mon[108126]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:08.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:07 smithi176 ceph-mon[80162]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:54:08.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:07 smithi176 ceph-mon[80162]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T12:54:08.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:07 smithi176 ceph-mon[80162]: from='osd.3 [v2:172.21.15.176:6800/2902031340,v1:172.21.15.176:6801/2902031340]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:08.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:07 smithi176 ceph-mon[80162]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:08 smithi046 ceph-mon[108126]: pgmap v213: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 71/336 objects degraded (21.131%) 2024-09-21T12:54:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:08 smithi046 ceph-mon[108126]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:54:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:08 smithi046 ceph-mon[108126]: osd.3 [v2:172.21.15.176:6800/2902031340,v1:172.21.15.176:6801/2902031340] boot 2024-09-21T12:54:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:08 smithi046 ceph-mon[108126]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T12:54:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:08 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T12:54:08.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:08 smithi046 ceph-mon[108126]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T12:54:09.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:08 smithi176 ceph-mon[80162]: pgmap v213: 65 pgs: 19 active+undersized, 19 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 71/336 objects degraded (21.131%) 2024-09-21T12:54:09.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:08 smithi176 ceph-mon[80162]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:54:09.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:08 smithi176 ceph-mon[80162]: osd.3 [v2:172.21.15.176:6800/2902031340,v1:172.21.15.176:6801/2902031340] boot 2024-09-21T12:54:09.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:08 smithi176 ceph-mon[80162]: osdmap e66: 6 total, 6 up, 6 in 2024-09-21T12:54:09.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:08 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T12:54:09.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:08 smithi176 ceph-mon[80162]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T12:54:09.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:09 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 57/336 objects degraded (16.964%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:10.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:09 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 57/336 objects degraded (16.964%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:10 smithi176 ceph-mon[80162]: pgmap v216: 65 pgs: 3 peering, 12 active+undersized, 15 active+undersized+degraded, 35 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 57/336 objects degraded (16.964%) 2024-09-21T12:54:10.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:10 smithi046 ceph-mon[108126]: pgmap v216: 65 pgs: 3 peering, 12 active+undersized, 15 active+undersized+degraded, 35 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 57/336 objects degraded (16.964%) 2024-09-21T12:54:12.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:12 smithi046 ceph-mon[108126]: pgmap v217: 65 pgs: 3 peering, 6 active+undersized, 10 active+undersized+degraded, 46 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 38/336 objects degraded (11.310%) 2024-09-21T12:54:13.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:12 smithi176 ceph-mon[80162]: pgmap v217: 65 pgs: 3 peering, 6 active+undersized, 10 active+undersized+degraded, 46 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s; 38/336 objects degraded (11.310%) 2024-09-21T12:54:14.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:13 smithi176 ceph-mon[80162]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/336 objects degraded (11.310%), 10 pgs degraded) 2024-09-21T12:54:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:13 smithi046 ceph-mon[108126]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 38/336 objects degraded (11.310%), 10 pgs degraded) 2024-09-21T12:54:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:15 smithi046 ceph-mon[108126]: pgmap v218: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-21T12:54:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:15 smithi176 ceph-mon[80162]: pgmap v218: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s 2024-09-21T12:54:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:17 smithi176 ceph-mon[80162]: pgmap v219: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:54:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:17 smithi046 ceph-mon[108126]: pgmap v219: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:54:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 -- 172.21.15.46:0/2603578673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 msgr2=0x7fef34101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:18.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 --2- 172.21.15.46:0/2603578673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef34101d60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fef28009880 tx=0x7fef2802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 -- 172.21.15.46:0/2603578673 shutdown_connections 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 --2- 172.21.15.46:0/2603578673 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef34101d60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 --2- 172.21.15.46:0/2603578673 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef34107900 0x7fef34107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 -- 172.21.15.46:0/2603578673 >> 172.21.15.46:0/2603578673 conn(0x7fef340fd600 msgr2=0x7fef340ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 -- 172.21.15.46:0/2603578673 shutdown_connections 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.604+0000 7fef39640640 1 -- 172.21.15.46:0/2603578673 wait complete. 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.605+0000 7fef39640640 1 Processor -- start 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.605+0000 7fef39640640 1 -- start start 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.605+0000 7fef39640640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef340744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.605+0000 7fef39640640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef34107900 0x7fef34074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.605+0000 7fef39640640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410ee30 con 0x7fef34101900 2024-09-21T12:54:18.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.605+0000 7fef39640640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fef3410ecb0 con 0x7fef34107900 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef340744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef340744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37668/0 (socket says 172.21.15.46:37668) 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 -- 172.21.15.46:0/3256076631 learned_addr learned my addr 172.21.15.46:0/3256076631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef327fc640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef34107900 0x7fef34074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 -- 172.21.15.46:0/3256076631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef34107900 msgr2=0x7fef34074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef34107900 0x7fef34074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 -- 172.21.15.46:0/3256076631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef34074f70 con 0x7fef34101900 2024-09-21T12:54:18.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef32ffd640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef340744f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef2400b420 tx=0x7fef2400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef24011630 con 0x7fef34101900 2024-09-21T12:54:18.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.606+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef34075260 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.607+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef24016070 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.607+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef24010d40 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.607+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef341a3ee0 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.608+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef34103040 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.608+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fef2401b460 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.609+0000 7fef1bfff640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fef1c07af80 0x7fef1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.609+0000 7fef327fc640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fef1c07af80 0x7fef1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.609+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fef2409d6d0 con 0x7fef34101900 2024-09-21T12:54:18.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.610+0000 7fef327fc640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fef1c07af80 0x7fef1c07d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef34075f80 tx=0x7fef28031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:18.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.614+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fef24068d50 con 0x7fef34101900 2024-09-21T12:54:18.824 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.822+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fef34062630 con 0x7fef1c07af80 2024-09-21T12:54:18.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.823+0000 7fef1bfff640 1 -- 172.21.15.46:0/3256076631 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fef34062630 con 0x7fef1c07af80 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fef1c07af80 msgr2=0x7fef1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fef1c07af80 0x7fef1c07d440 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fef34075f80 tx=0x7fef28031400 comp rx=0 tx=0).stop 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 msgr2=0x7fef340744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef340744f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fef2400b420 tx=0x7fef2400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 shutdown_connections 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fef1c07af80 0x7fef1c07d440 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fef34107900 0x7fef34074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 --2- 172.21.15.46:0/3256076631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fef34101900 0x7fef340744f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 >> 172.21.15.46:0/3256076631 conn(0x7fef340fd600 msgr2=0x7fef340fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.825+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 shutdown_connections 2024-09-21T12:54:18.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.826+0000 7fef39640640 1 -- 172.21.15.46:0/3256076631 wait complete. 2024-09-21T12:54:18.837 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:54:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 -- 172.21.15.46:0/932410075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 msgr2=0x7fc44c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 --2- 172.21.15.46:0/932410075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c106d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009c20 tx=0x7fc43c02a970 comp rx=0 tx=0).stop 2024-09-21T12:54:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 -- 172.21.15.46:0/932410075 shutdown_connections 2024-09-21T12:54:18.914 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 --2- 172.21.15.46:0/932410075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc44c0ffdc0 0x7fc44c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 --2- 172.21.15.46:0/932410075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c106d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 -- 172.21.15.46:0/932410075 >> 172.21.15.46:0/932410075 conn(0x7fc44c0fbc90 msgr2=0x7fc44c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:18.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 -- 172.21.15.46:0/932410075 shutdown_connections 2024-09-21T12:54:18.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.912+0000 7fc451622640 1 -- 172.21.15.46:0/932410075 wait complete. 2024-09-21T12:54:18.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc451622640 1 Processor -- start 2024-09-21T12:54:18.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc451622640 1 -- start start 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc451622640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc44c0ffdc0 0x7fc44c19d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc451622640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c19dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc451622640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c10efa0 con 0x7fc44c1069a0 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc451622640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc44c10ee20 con 0x7fc44c0ffdc0 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc44a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c19dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc44affd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc44c0ffdc0 0x7fc44c19d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc44a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c19dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37694/0 (socket says 172.21.15.46:37694) 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.913+0000 7fc44a7fc640 1 -- 172.21.15.46:0/2143442888 learned_addr learned my addr 172.21.15.46:0/2143442888 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc44a7fc640 1 -- 172.21.15.46:0/2143442888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc44c0ffdc0 msgr2=0x7fc44c19d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc44a7fc640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc44c0ffdc0 0x7fc44c19d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc44a7fc640 1 -- 172.21.15.46:0/2143442888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c197950 con 0x7fc44c1069a0 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc44a7fc640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c19dcd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc43400b420 tx=0x7fc43400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:18.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc434011630 con 0x7fc44c1069a0 2024-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc434016070 con 0x7fc44c1069a0 2024-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc44c197c40 con 0x7fc44c1069a0 2024-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc434010d40 con 0x7fc44c1069a0 2024-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.914+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44c1981d0 con 0x7fc44c1069a0 2024-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.915+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44c1030e0 con 0x7fc44c1069a0 2024-09-21T12:54:18.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.916+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc43401b460 con 0x7fc44c1069a0 2024-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.917+0000 7fc443fff640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc43807af90 0x7fc43807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.917+0000 7fc44affd640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc43807af90 0x7fc43807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.917+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fc43409d610 con 0x7fc44c1069a0 2024-09-21T12:54:18.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.917+0000 7fc44affd640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc43807af90 0x7fc43807d450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009430 tx=0x7fc43c03c040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:18.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:18.921+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc434068c90 con 0x7fc44c1069a0 2024-09-21T12:54:19.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.125+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc44c109f50 con 0x7fc43807af90 2024-09-21T12:54:19.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.126+0000 7fc443fff640 1 -- 172.21.15.46:0/2143442888 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fc44c109f50 con 0x7fc43807af90 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc43807af90 msgr2=0x7fc43807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc43807af90 0x7fc43807d450 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc43c009430 tx=0x7fc43c03c040 comp rx=0 tx=0).stop 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 msgr2=0x7fc44c19dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c19dcd0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc43400b420 tx=0x7fc43400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 shutdown_connections 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc43807af90 0x7fc43807d450 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc44c1069a0 0x7fc44c19dcd0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 --2- 172.21.15.46:0/2143442888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc44c0ffdc0 0x7fc44c19d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 >> 172.21.15.46:0/2143442888 conn(0x7fc44c0fbc90 msgr2=0x7fc44c0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 shutdown_connections 2024-09-21T12:54:19.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.128+0000 7fc451622640 1 -- 172.21.15.46:0/2143442888 wait complete. 2024-09-21T12:54:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 -- 172.21.15.46:0/1214852345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 msgr2=0x7f6908102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 --2- 172.21.15.46:0/1214852345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908102f00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68f80098b0 tx=0x7f68f802a560 comp rx=0 tx=0).stop 2024-09-21T12:54:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 -- 172.21.15.46:0/1214852345 shutdown_connections 2024-09-21T12:54:19.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 --2- 172.21.15.46:0/1214852345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f690810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 --2- 172.21.15.46:0/1214852345 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908102f00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 -- 172.21.15.46:0/1214852345 >> 172.21.15.46:0/1214852345 conn(0x7f69080fc520 msgr2=0x7f69080fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:19.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 -- 172.21.15.46:0/1214852345 shutdown_connections 2024-09-21T12:54:19.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.213+0000 7f690c89a640 1 -- 172.21.15.46:0/1214852345 wait complete. 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690c89a640 1 Processor -- start 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690c89a640 1 -- start start 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690c89a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690c89a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f6908100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690c89a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f690810edf0 con 0x7f6908102b20 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690c89a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f690810ec70 con 0x7f6908103440 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f68fdd9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f6908100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f690659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f68fdd9b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f6908100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:58902/0 (socket says 172.21.15.46:58902) 2024-09-21T12:54:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.214+0000 7f68fdd9b640 1 -- 172.21.15.46:0/238464739 learned_addr learned my addr 172.21.15.46:0/238464739 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.215+0000 7f68fdd9b640 1 -- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 msgr2=0x7f6908100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.215+0000 7f68fdd9b640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.215+0000 7f68fdd9b640 1 -- 172.21.15.46:0/238464739 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6908101200 con 0x7f6908103440 2024-09-21T12:54:19.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.215+0000 7f690659c640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.215+0000 7f68fdd9b640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f6908100cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d6f0 tx=0x7f68f000dbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.215+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68f0017070 con 0x7f6908103440 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.216+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69081014f0 con 0x7f6908103440 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.216+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f68f000de00 con 0x7f6908103440 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.216+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f68f0004bb0 con 0x7f6908103440 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.216+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69081a3ea0 con 0x7f6908103440 2024-09-21T12:54:19.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.217+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f690806aa30 con 0x7f6908103440 2024-09-21T12:54:19.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.218+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f68f0004e60 con 0x7f6908103440 2024-09-21T12:54:19.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.218+0000 7f68fffff640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f68f407af30 0x7f68f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.218+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f68f009dc30 con 0x7f6908103440 2024-09-21T12:54:19.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.218+0000 7f690659c640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f68f407af30 0x7f68f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.219+0000 7f690659c640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f68f407af30 0x7f68f407d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000c00 tx=0x7f68f8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:19.224 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.222+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f68f0069290 con 0x7f6908103440 2024-09-21T12:54:19.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.419+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6908062630 con 0x7f68f407af30 2024-09-21T12:54:19.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.428+0000 7f68fffff640 1 -- 172.21.15.46:0/238464739 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6908062630 con 0x7f68f407af30 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (4m) 53s ago 15m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (7m) 53s ago 15m 9126k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (7m) 18s ago 14m 8980k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (2m) 53s ago 15m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (2m) 18s ago 14m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (4m) 53s ago 15m 78.8M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (10m) 53s ago 10m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (9m) 53s ago 9m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (10m) 18s ago 10m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (9m) 18s ago 9m 26.9M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (6m) 53s ago 16m 528M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:54:19.431 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (5m) 18s ago 14m 458M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (3m) 53s ago 16m 42.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (2m) 18s ago 14m 36.9M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (5m) 53s ago 15m 11.3M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (5m) 18s ago 14m 11.9M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (2m) 53s ago 13m 82.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (96s) 53s ago 12m 90.4M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (59s) 53s ago 12m 12.0M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (21s) 18s ago 11m 14.5M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (11m) 18s ago 11m 209M 2240M 19.1.1-373-g4e45e6b4 164465d2334a cdc28b8161b2 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (11m) 18s ago 11m 189M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:54:19.432 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (4m) 53s ago 14m 56.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:54:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f68f407af30 msgr2=0x7f68f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f68f407af30 0x7f68f407d3f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f68f8000c00 tx=0x7f68f8031400 comp rx=0 tx=0).stop 2024-09-21T12:54:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 msgr2=0x7f6908100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f6908100cc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f68f000d6f0 tx=0x7f68f000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 shutdown_connections 2024-09-21T12:54:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f68f407af30 0x7f68f407d3f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6908103440 0x7f6908100cc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 --2- 172.21.15.46:0/238464739 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6908102b20 0x7f6908100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.430+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 >> 172.21.15.46:0/238464739 conn(0x7f69080fc520 msgr2=0x7f6908103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.431+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 shutdown_connections 2024-09-21T12:54:19.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.431+0000 7f690c89a640 1 -- 172.21.15.46:0/238464739 wait complete. 2024-09-21T12:54:19.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 -- 172.21.15.46:0/2942775332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 msgr2=0x7fad58101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 --2- 172.21.15.46:0/2942775332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad58101d60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fad4c009880 tx=0x7fad4c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 -- 172.21.15.46:0/2942775332 shutdown_connections 2024-09-21T12:54:19.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 --2- 172.21.15.46:0/2942775332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad58101d60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 --2- 172.21.15.46:0/2942775332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58107900 0x7fad58107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 -- 172.21.15.46:0/2942775332 >> 172.21.15.46:0/2942775332 conn(0x7fad580fd600 msgr2=0x7fad580ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:19.517 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:19 smithi046 ceph-mon[108126]: pgmap v220: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 -- 172.21.15.46:0/2942775332 shutdown_connections 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.514+0000 7fad5d92f640 1 -- 172.21.15.46:0/2942775332 wait complete. 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad5d92f640 1 Processor -- start 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad5d92f640 1 -- start start 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad5d92f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad5819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad5d92f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58107900 0x7fad5819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad5d92f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fad5810edd0 con 0x7fad58101900 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad5d92f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fad5810ec50 con 0x7fad58107900 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad5819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad56ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad5819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37728/0 (socket says 172.21.15.46:37728) 2024-09-21T12:54:19.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.515+0000 7fad56ffd640 1 -- 172.21.15.46:0/3493197257 learned_addr learned my addr 172.21.15.46:0/3493197257 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad567fc640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58107900 0x7fad5819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad56ffd640 1 -- 172.21.15.46:0/3493197257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58107900 msgr2=0x7fad5819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad56ffd640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58107900 0x7fad5819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad56ffd640 1 -- 172.21.15.46:0/3493197257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad58197800 con 0x7fad58101900 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad56ffd640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad5819d680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fad4800d6f0 tx=0x7fad4800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad48017070 con 0x7fad58101900 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad58197af0 con 0x7fad58101900 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fad4800de00 con 0x7fad58101900 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad58198050 con 0x7fad58101900 2024-09-21T12:54:19.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.516+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fad48004bb0 con 0x7fad58101900 2024-09-21T12:54:19.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.518+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad58103040 con 0x7fad58101900 2024-09-21T12:54:19.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.518+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fad48009a30 con 0x7fad58101900 2024-09-21T12:54:19.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.519+0000 7fad5c92d640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fad4007af80 0x7fad4007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.519+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fad4809dac0 con 0x7fad58101900 2024-09-21T12:54:19.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.519+0000 7fad567fc640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fad4007af80 0x7fad4007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.519+0000 7fad567fc640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fad4007af80 0x7fad4007d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad58198b50 tx=0x7fad4c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:19.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.523+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fad48069140 con 0x7fad58101900 2024-09-21T12:54:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:19 smithi176 ceph-mon[80162]: pgmap v220: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-21T12:54:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.785+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fad58109e70 con 0x7fad58101900 2024-09-21T12:54:19.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.786+0000 7fad5c92d640 1 -- 172.21.15.46:0/3493197257 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fad4806dff0 con 0x7fad58101900 2024-09-21T12:54:19.788 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:54:19.788 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T12:54:19.789 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 8 2024-09-21T12:54:19.790 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:54:19.790 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fad4007af80 msgr2=0x7fad4007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fad4007af80 0x7fad4007d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad58198b50 tx=0x7fad4c031400 comp rx=0 tx=0).stop 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 msgr2=0x7fad5819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad5819d680 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fad4800d6f0 tx=0x7fad4800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 shutdown_connections 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fad4007af80 0x7fad4007d440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fad58107900 0x7fad5819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 --2- 172.21.15.46:0/3493197257 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fad58101900 0x7fad5819d680 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.788+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 >> 172.21.15.46:0/3493197257 conn(0x7fad580fd600 msgr2=0x7fad580fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.789+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 shutdown_connections 2024-09-21T12:54:19.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.789+0000 7fad5d92f640 1 -- 172.21.15.46:0/3493197257 wait complete. 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.872+0000 7f431297a640 1 -- 172.21.15.46:0/885766828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 msgr2=0x7f430c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.872+0000 7f431297a640 1 --2- 172.21.15.46:0/885766828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c102ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009880 tx=0x7f42fc02a530 comp rx=0 tx=0).stop 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.872+0000 7f431297a640 1 -- 172.21.15.46:0/885766828 shutdown_connections 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.872+0000 7f431297a640 1 --2- 172.21.15.46:0/885766828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f430c1033e0 0x7f430c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.872+0000 7f431297a640 1 --2- 172.21.15.46:0/885766828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c102ea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.872+0000 7f431297a640 1 -- 172.21.15.46:0/885766828 >> 172.21.15.46:0/885766828 conn(0x7f430c0fc520 msgr2=0x7f430c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 -- 172.21.15.46:0/885766828 shutdown_connections 2024-09-21T12:54:19.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 -- 172.21.15.46:0/885766828 wait complete. 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 Processor -- start 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 -- start start 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f430c1033e0 0x7f430c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f430c10edf0 con 0x7f430c102ac0 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f431297a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f430c10ec70 con 0x7f430c1033e0 2024-09-21T12:54:19.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f430bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f430bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37738/0 (socket says 172.21.15.46:37738) 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.873+0000 7f430bfff640 1 -- 172.21.15.46:0/3661475210 learned_addr learned my addr 172.21.15.46:0/3661475210 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f4303fff640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f430c1033e0 0x7f430c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f430bfff640 1 -- 172.21.15.46:0/3661475210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f430c1033e0 msgr2=0x7f430c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f430bfff640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f430c1033e0 0x7f430c100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f430bfff640 1 -- 172.21.15.46:0/3661475210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f430c1011a0 con 0x7f430c102ac0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f430bfff640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c100720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42fc031460 tx=0x7f42fc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42fc03f070 con 0x7f430c102ac0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42fc0035f0 con 0x7f430c102ac0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f430c101430 con 0x7f430c102ac0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42fc035030 con 0x7f430c102ac0 2024-09-21T12:54:19.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.874+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f430c1a3da0 con 0x7f430c102ac0 2024-09-21T12:54:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.875+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f430c06aa90 con 0x7f430c102ac0 2024-09-21T12:54:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.876+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f42fc042070 con 0x7f430c102ac0 2024-09-21T12:54:19.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.876+0000 7f4309ffb640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42f807af80 0x7f42f807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.877+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f42fc0be900 con 0x7f430c102ac0 2024-09-21T12:54:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.877+0000 7f4303fff640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42f807af80 0x7f42f807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:19.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.877+0000 7f4303fff640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42f807af80 0x7f42f807d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f430c1021b0 tx=0x7f42f400b2e0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:19.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:19.881+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42fc089ee0 con 0x7f430c102ac0 2024-09-21T12:54:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.107+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f430c101c50 con 0x7f430c102ac0 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.107+0000 7f4309ffb640 1 -- 172.21.15.46:0/3661475210 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7f42fc08ed90 con 0x7f430c102ac0 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:54:20.110 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:54:20.111 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:54:20.112 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:54:20.113 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42f807af80 msgr2=0x7f42f807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42f807af80 0x7f42f807d440 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f430c1021b0 tx=0x7f42f400b2e0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 msgr2=0x7f430c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c100720 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42fc031460 tx=0x7f42fc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 shutdown_connections 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42f807af80 0x7f42f807d440 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f430c1033e0 0x7f430c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 --2- 172.21.15.46:0/3661475210 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f430c102ac0 0x7f430c100720 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 >> 172.21.15.46:0/3661475210 conn(0x7f430c0fc520 msgr2=0x7f430c108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 shutdown_connections 2024-09-21T12:54:20.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.110+0000 7f431297a640 1 -- 172.21.15.46:0/3661475210 wait complete. 2024-09-21T12:54:20.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 -- 172.21.15.46:0/784891175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc107900 msgr2=0x7f84bc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 --2- 172.21.15.46:0/784891175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc107900 0x7f84bc107ce0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f84b8009880 tx=0x7f84b802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 -- 172.21.15.46:0/784891175 shutdown_connections 2024-09-21T12:54:20.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 --2- 172.21.15.46:0/784891175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84bc101900 0x7f84bc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 --2- 172.21.15.46:0/784891175 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc107900 0x7f84bc107ce0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 -- 172.21.15.46:0/784891175 >> 172.21.15.46:0/784891175 conn(0x7f84bc0fd600 msgr2=0x7f84bc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:20.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 -- 172.21.15.46:0/784891175 shutdown_connections 2024-09-21T12:54:20.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.196+0000 7f84c3a70640 1 -- 172.21.15.46:0/784891175 wait complete. 2024-09-21T12:54:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c3a70640 1 Processor -- start 2024-09-21T12:54:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c3a70640 1 -- start start 2024-09-21T12:54:20.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c3a70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 0x7f84bc19d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c3a70640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84bc107900 0x7f84bc19dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c3a70640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc10ee30 con 0x7f84bc101900 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c3a70640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc10ecb0 con 0x7f84bc107900 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c180c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 0x7f84bc19d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c180c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 0x7f84bc19d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37744/0 (socket says 172.21.15.46:37744) 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c180c640 1 -- 172.21.15.46:0/3999161451 learned_addr learned my addr 172.21.15.46:0/3999161451 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.197+0000 7f84c100b640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84bc107900 0x7f84bc19dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84c180c640 1 -- 172.21.15.46:0/3999161451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84bc107900 msgr2=0x7f84bc19dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84c180c640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84bc107900 0x7f84bc19dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84c180c640 1 -- 172.21.15.46:0/3999161451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc197810 con 0x7f84bc101900 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84c180c640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 0x7f84bc19d690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f84b8031460 tx=0x7f84b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:20.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84b803f070 con 0x7f84bc101900 2024-09-21T12:54:20.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc197aa0 con 0x7f84bc101900 2024-09-21T12:54:20.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84b8004cf0 con 0x7f84bc101900 2024-09-21T12:54:20.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84b8035030 con 0x7f84bc101900 2024-09-21T12:54:20.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.198+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc197fd0 con 0x7f84bc101900 2024-09-21T12:54:20.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.199+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc103040 con 0x7f84bc101900 2024-09-21T12:54:20.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.200+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f84b8042070 con 0x7f84bc101900 2024-09-21T12:54:20.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.200+0000 7f84b2ffd640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84a807af30 0x7f84a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:20.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.200+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7f84b80beb00 con 0x7f84bc101900 2024-09-21T12:54:20.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.200+0000 7f84c100b640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84a807af30 0x7f84a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:20.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.201+0000 7f84c100b640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84a807af30 0x7f84a807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ffc50 tx=0x7f84ac008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:20.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.205+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f84b808a100 con 0x7f84bc101900 2024-09-21T12:54:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:20 smithi046 ceph-mon[108126]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:20 smithi046 ceph-mon[108126]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:20 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:20 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:54:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3493197257' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3661475210' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:54:20.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.411+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f84bc198280 con 0x7f84a807af30 2024-09-21T12:54:20.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.412+0000 7f84b2ffd640 1 -- 172.21.15.46:0/3999161451 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f84bc198280 con 0x7f84a807af30 2024-09-21T12:54:20.414 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:54:20.414 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:54:20.414 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:54:20.414 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:54:20.414 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "10/23 daemons upgraded", 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:54:20.415 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:54:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84a807af30 msgr2=0x7f84a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84a807af30 0x7f84a807d3f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0ffc50 tx=0x7f84ac008040 comp rx=0 tx=0).stop 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 msgr2=0x7f84bc19d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 0x7f84bc19d690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f84b8031460 tx=0x7f84b80048f0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 shutdown_connections 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84a807af30 0x7f84a807d3f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f84bc107900 0x7f84bc19dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 --2- 172.21.15.46:0/3999161451 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f84bc101900 0x7f84bc19d690 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 >> 172.21.15.46:0/3999161451 conn(0x7f84bc0fd600 msgr2=0x7f84bc0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 shutdown_connections 2024-09-21T12:54:20.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.414+0000 7f84c3a70640 1 -- 172.21.15.46:0/3999161451 wait complete. 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 -- 172.21.15.46:0/1267012096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5541028b0 msgr2=0x7fb5540ffdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 --2- 172.21.15.46:0/1267012096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5541028b0 0x7fb5540ffdc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb550009880 tx=0x7fb55002a530 comp rx=0 tx=0).stop 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 -- 172.21.15.46:0/1267012096 shutdown_connections 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 --2- 172.21.15.46:0/1267012096 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb554102c90 0x7fb554100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 --2- 172.21.15.46:0/1267012096 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5541028b0 0x7fb5540ffdc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 -- 172.21.15.46:0/1267012096 >> 172.21.15.46:0/1267012096 conn(0x7fb5540fbc90 msgr2=0x7fb5540fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.498+0000 7fb55b93e640 1 -- 172.21.15.46:0/1267012096 shutdown_connections 2024-09-21T12:54:20.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.499+0000 7fb55b93e640 1 -- 172.21.15.46:0/1267012096 wait complete. 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.499+0000 7fb55b93e640 1 Processor -- start 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.499+0000 7fb55b93e640 1 -- start start 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.499+0000 7fb55b93e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5541028b0 0x7fb55419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb55b93e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 0x7fb55419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb55b93e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb554111000 con 0x7fb554102c90 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb55b93e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb554110e80 con 0x7fb5541028b0 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 0x7fb55419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 0x7fb55419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:37766/0 (socket says 172.21.15.46:37766) 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 -- 172.21.15.46:0/3723408332 learned_addr learned my addr 172.21.15.46:0/3723408332 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:20.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb5596da640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5541028b0 0x7fb55419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 -- 172.21.15.46:0/3723408332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5541028b0 msgr2=0x7fb55419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5541028b0 0x7fb55419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 -- 172.21.15.46:0/3723408332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb554199990 con 0x7fb554102c90 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb558ed9640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 0x7fb55419fd10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb54400d6f0 tx=0x7fb54400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb544017070 con 0x7fb554102c90 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb54400de00 con 0x7fb554102c90 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb554199c80 con 0x7fb554102c90 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.500+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb54400f3c0 con 0x7fb554102c90 2024-09-21T12:54:20.504 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.501+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55419a210 con 0x7fb554102c90 2024-09-21T12:54:20.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.501+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb554100fe0 con 0x7fb554102c90 2024-09-21T12:54:20.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.502+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb54401a070 con 0x7fb554102c90 2024-09-21T12:54:20.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.503+0000 7fb54a7fc640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb54007af30 0x7fb54007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.503+0000 7fb5596da640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb54007af30 0x7fb54007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.503+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6156+0+0 (secure 0 0 0) 0x7fb54409dc90 con 0x7fb554102c90 2024-09-21T12:54:20.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.503+0000 7fb5596da640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb54007af30 0x7fb54007d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb550000c00 tx=0x7fb550031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:20.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.507+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb544021030 con 0x7fb554102c90 2024-09-21T12:54:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:20 smithi176 ceph-mon[80162]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:20 smithi176 ceph-mon[80162]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:20 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:20 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:54:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3493197257' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3661475210' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:54:20.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.771+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb55410bc20 con 0x7fb554102c90 2024-09-21T12:54:20.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.771+0000 7fb54a7fc640 1 -- 172.21.15.46:0/3723408332 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fb544069290 con 0x7fb554102c90 2024-09-21T12:54:20.774 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:54:20.774 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:54:20.774 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb54007af30 msgr2=0x7fb54007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb54007af30 0x7fb54007d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb550000c00 tx=0x7fb550031400 comp rx=0 tx=0).stop 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 msgr2=0x7fb55419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 0x7fb55419fd10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb54400d6f0 tx=0x7fb54400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 shutdown_connections 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb54007af30 0x7fb54007d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb554102c90 0x7fb55419fd10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 --2- 172.21.15.46:0/3723408332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5541028b0 0x7fb55419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 >> 172.21.15.46:0/3723408332 conn(0x7fb5540fbc90 msgr2=0x7fb5540fc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 shutdown_connections 2024-09-21T12:54:20.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:20.774+0000 7fb55b93e640 1 -- 172.21.15.46:0/3723408332 wait complete. 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: pgmap v221: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: from='client.44221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: Upgrade: osd.4 is safe to restart 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3723408332' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T12:54:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:21 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: pgmap v221: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: from='client.44221 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: Upgrade: osd.4 is safe to restart 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3723408332' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T12:54:21.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:21 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:22 smithi176 ceph-mon[80162]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:22 smithi176 ceph-mon[80162]: Upgrade: Updating osd.4 2024-09-21T12:54:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:22 smithi176 ceph-mon[80162]: Deploying daemon osd.4 on smithi176 2024-09-21T12:54:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:22 smithi046 ceph-mon[108126]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:22 smithi046 ceph-mon[108126]: Upgrade: Updating osd.4 2024-09-21T12:54:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:22 smithi046 ceph-mon[108126]: Deploying daemon osd.4 on smithi176 2024-09-21T12:54:23.532 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:23 smithi176 ceph-mon[80162]: pgmap v222: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:54:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:23 smithi046 ceph-mon[108126]: pgmap v222: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T12:54:24.129 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:23 smithi176 systemd[1]: Stopping Ceph osd.4 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:54:24.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:24 smithi046 ceph-mon[108126]: osd.4 marked itself down and dead 2024-09-21T12:54:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:24 smithi176 ceph-mon[80162]: osd.4 marked itself down and dead 2024-09-21T12:54:24.567 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:24 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[47982]: 2024-09-21T12:54:24.127+0000 7fabcba35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:54:24.567 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:24 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[47982]: 2024-09-21T12:54:24.127+0000 7fabcba35640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-21T12:54:24.567 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:24 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[47982]: 2024-09-21T12:54:24.127+0000 7fabcba35640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:54:25.211 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:24 smithi176 podman[92609]: 2024-09-21 12:54:24.874602956 +0000 UTC m=+0.847177495 container died cdc28b8161b2079c7ed744b73bed798cf60d2ca9d3079e344589fb5276fcb8d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS) 2024-09-21T12:54:25.211 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:25 smithi176 podman[92609]: 2024-09-21 12:54:25.210566431 +0000 UTC m=+1.183140971 container cleanup cdc28b8161b2079c7ed744b73bed798cf60d2ca9d3079e344589fb5276fcb8d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T12:54:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:25 smithi176 ceph-mon[80162]: pgmap v223: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:54:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:25 smithi176 ceph-mon[80162]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:54:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:25 smithi176 ceph-mon[80162]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T12:54:25.567 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:25 smithi176 bash[92609]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4 2024-09-21T12:54:25.567 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:25 smithi176 podman[92625]: 2024-09-21 12:54:25.420474408 +0000 UTC m=+0.549325488 container remove cdc28b8161b2079c7ed744b73bed798cf60d2ca9d3079e344589fb5276fcb8d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T12:54:25.599 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:25 smithi046 ceph-mon[108126]: pgmap v223: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:54:25.599 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:25 smithi046 ceph-mon[108126]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:54:25.599 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:25 smithi046 ceph-mon[108126]: osdmap e68: 6 total, 5 up, 6 in 2024-09-21T12:54:25.958 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:25 smithi176 podman[92714]: 2024-09-21 12:54:25.731855202 +0000 UTC m=+0.017189700 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:54:25.958 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:25 smithi176 podman[92714]: 2024-09-21 12:54:25.854899157 +0000 UTC m=+0.140233645 container create 4bf86706927792c1c662bc27b4867da2f05dbb922586af5cc2266ab15781a985 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:54:26.263 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 podman[92714]: 2024-09-21 12:54:26.067837383 +0000 UTC m=+0.353171877 container init 4bf86706927792c1c662bc27b4867da2f05dbb922586af5cc2266ab15781a985 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T12:54:26.263 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 podman[92714]: 2024-09-21 12:54:26.071155176 +0000 UTC m=+0.356489664 container start 4bf86706927792c1c662bc27b4867da2f05dbb922586af5cc2266ab15781a985 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T12:54:26.264 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 podman[92714]: 2024-09-21 12:54:26.142606756 +0000 UTC m=+0.427941266 container attach 4bf86706927792c1c662bc27b4867da2f05dbb922586af5cc2266ab15781a985 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS) 2024-09-21T12:54:26.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:26 smithi176 ceph-mon[80162]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T12:54:26.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 podman[92714]: 2024-09-21 12:54:26.263298935 +0000 UTC m=+0.548633435 container died 4bf86706927792c1c662bc27b4867da2f05dbb922586af5cc2266ab15781a985 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:54:26.596 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:26 smithi046 ceph-mon[108126]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T12:54:27.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 podman[92737]: 2024-09-21 12:54:26.80435139 +0000 UTC m=+0.534876947 container remove 4bf86706927792c1c662bc27b4867da2f05dbb922586af5cc2266ab15781a985 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-09-21T12:54:27.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T12:54:27.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 systemd[1]: Stopped Ceph osd.4 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:54:27.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:26 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.4.service: Consumed 51.732s CPU time. 2024-09-21T12:54:27.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 systemd[1]: Starting Ceph osd.4 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:54:27.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:27 smithi046 ceph-mon[108126]: pgmap v226: 65 pgs: 13 peering, 3 stale+active+clean, 49 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:54:27.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:27 smithi046 ceph-mon[108126]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-21T12:54:27.516 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:27 smithi176 ceph-mon[80162]: pgmap v226: 65 pgs: 13 peering, 3 stale+active+clean, 49 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:54:27.517 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:27 smithi176 ceph-mon[80162]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-21T12:54:27.517 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 podman[92834]: 2024-09-21 12:54:27.146519161 +0000 UTC m=+0.015839005 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:54:27.517 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 podman[92834]: 2024-09-21 12:54:27.255359271 +0000 UTC m=+0.124679106 container create ee81fccc8e69494c1cb8d3af807791756cef86388f5401abb44030dd09ef8a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:54:27.517 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 podman[92834]: 2024-09-21 12:54:27.516204671 +0000 UTC m=+0.385524513 container init ee81fccc8e69494c1cb8d3af807791756cef86388f5401abb44030dd09ef8a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T12:54:27.816 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 podman[92834]: 2024-09-21 12:54:27.519657275 +0000 UTC m=+0.388977112 container start ee81fccc8e69494c1cb8d3af807791756cef86388f5401abb44030dd09ef8a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:54:27.817 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 podman[92834]: 2024-09-21 12:54:27.591595471 +0000 UTC m=+0.460915320 container attach ee81fccc8e69494c1cb8d3af807791756cef86388f5401abb44030dd09ef8a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T12:54:27.817 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:27.817 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 bash[92834]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:27.817 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:27.817 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:27 smithi176 bash[92834]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:28.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:28 smithi046 ceph-mon[108126]: Health check failed: Degraded data redundancy: 36/336 objects degraded (10.714%), 9 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:28 smithi176 ceph-mon[80162]: Health check failed: Degraded data redundancy: 36/336 objects degraded (10.714%), 9 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:29.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:29 smithi046 ceph-mon[108126]: pgmap v227: 65 pgs: 10 active+undersized, 13 peering, 1 stale+active+clean, 9 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 36/336 objects degraded (10.714%) 2024-09-21T12:54:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:29 smithi176 ceph-mon[80162]: pgmap v227: 65 pgs: 10 active+undersized, 13 peering, 1 stale+active+clean, 9 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 2 op/s; 36/336 objects degraded (10.714%) 2024-09-21T12:54:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T12:54:30.768 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:54:31.067 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:54:31.068 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate[92849]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T12:54:31.068 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 bash[92834]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T12:54:31.068 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:30 smithi176 podman[92834]: 2024-09-21 12:54:30.831589242 +0000 UTC m=+3.700909079 container died ee81fccc8e69494c1cb8d3af807791756cef86388f5401abb44030dd09ef8a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T12:54:31.554 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:31 smithi176 ceph-mon[80162]: pgmap v228: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:54:31.554 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 podman[93058]: 2024-09-21 12:54:31.353085954 +0000 UTC m=+0.514686093 container remove ee81fccc8e69494c1cb8d3af807791756cef86388f5401abb44030dd09ef8a8f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T12:54:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:31 smithi046 ceph-mon[108126]: pgmap v228: 65 pgs: 15 active+undersized, 8 peering, 11 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 43/336 objects degraded (12.798%) 2024-09-21T12:54:31.806 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 podman[93116]: 2024-09-21 12:54:31.553940022 +0000 UTC m=+0.106509940 container create 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-21T12:54:31.807 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 podman[93116]: 2024-09-21 12:54:31.463376136 +0000 UTC m=+0.015946064 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:54:31.807 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 podman[93116]: 2024-09-21 12:54:31.80619782 +0000 UTC m=+0.358767753 container init 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-21T12:54:32.066 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 podman[93116]: 2024-09-21 12:54:31.809553659 +0000 UTC m=+0.362123579 container start 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T12:54:32.066 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 ceph-osd[93136]: -- 172.21.15.176:0/899830890 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564c966821e0 con 0x564c96612000 2024-09-21T12:54:32.066 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 bash[93116]: 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f 2024-09-21T12:54:32.066 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:31 smithi176 systemd[1]: Started Ceph osd.4 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:54:33.288 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:32 smithi176 ceph-mon[80162]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:33.289 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:33.289 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:33.289 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:33.289 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:32 smithi176 ceph-mon[80162]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:54:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:32 smithi046 ceph-mon[108126]: pgmap v229: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:32 smithi046 ceph-mon[108126]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:54:33.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:33 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T12:54:33.448+0000 7ff07e8d1640 -1 Falling back to public interface 2024-09-21T12:54:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:34 smithi176 ceph-mon[80162]: pgmap v230: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:34 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:34 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:34 smithi046 ceph-mon[108126]: pgmap v230: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:34 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:34 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:36 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 55/336 objects degraded (16.369%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:36.649 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:36.650 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:36.650 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:36 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 55/336 objects degraded (16.369%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:37 smithi046 ceph-mon[108126]: pgmap v231: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:37.740 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:37 smithi176 ceph-mon[80162]: pgmap v231: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: pgmap v232: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:39.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:39.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:54:39.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='osd.4 [v2:172.21.15.176:6808/3777521673,v1:172.21.15.176:6809/3777521673]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:54:39.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:39 smithi046 ceph-mon[108126]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:54:39.816 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T12:54:39.369+0000 7ff07e8d1640 -1 osd.4 67 log_to_monitors true 2024-09-21T12:54:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: pgmap v232: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='osd.4 [v2:172.21.15.176:6808/3777521673,v1:172.21.15.176:6809/3777521673]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:54:39.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:39 smithi176 ceph-mon[80162]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: from='osd.4 [v2:172.21.15.176:6808/3777521673,v1:172.21.15.176:6809/3777521673]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:40 smithi046 ceph-mon[108126]: from='osd.4 ' entity='osd.4' 2024-09-21T12:54:40.816 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T12:54:40.335+0000 7ff072673640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: from='osd.4 [v2:172.21.15.176:6808/3777521673,v1:172.21.15.176:6809/3777521673]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:54:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:40 smithi176 ceph-mon[80162]: from='osd.4 ' entity='osd.4' 2024-09-21T12:54:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:41 smithi046 ceph-mon[108126]: pgmap v234: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:41 smithi046 ceph-mon[108126]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:54:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:41 smithi046 ceph-mon[108126]: osd.4 [v2:172.21.15.176:6808/3777521673,v1:172.21.15.176:6809/3777521673] boot 2024-09-21T12:54:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:41 smithi046 ceph-mon[108126]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T12:54:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T12:54:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:41 smithi176 ceph-mon[80162]: pgmap v234: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:41 smithi176 ceph-mon[80162]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:54:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:41 smithi176 ceph-mon[80162]: osd.4 [v2:172.21.15.176:6808/3777521673,v1:172.21.15.176:6809/3777521673] boot 2024-09-21T12:54:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:41 smithi176 ceph-mon[80162]: osdmap e71: 6 total, 6 up, 6 in 2024-09-21T12:54:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T12:54:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:43 smithi046 ceph-mon[108126]: pgmap v236: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:43.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:43 smithi046 ceph-mon[108126]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T12:54:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:43 smithi176 ceph-mon[80162]: pgmap v236: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 55/336 objects degraded (16.369%) 2024-09-21T12:54:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:43 smithi176 ceph-mon[80162]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T12:54:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:45 smithi046 ceph-mon[108126]: pgmap v238: 65 pgs: 10 peering, 13 active+undersized, 10 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 29/336 objects degraded (8.631%) 2024-09-21T12:54:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:45 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 29/336 objects degraded (8.631%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:45 smithi176 ceph-mon[80162]: pgmap v238: 65 pgs: 10 peering, 13 active+undersized, 10 active+undersized+degraded, 32 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 29/336 objects degraded (8.631%) 2024-09-21T12:54:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:45.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:45.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:45 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 29/336 objects degraded (8.631%), 10 pgs degraded (PG_DEGRADED) 2024-09-21T12:54:47.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:47 smithi176 ceph-mon[80162]: pgmap v239: 65 pgs: 10 peering, 3 active+undersized, 4 active+undersized+degraded, 48 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 10/336 objects degraded (2.976%) 2024-09-21T12:54:47.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:47 smithi046 ceph-mon[108126]: pgmap v239: 65 pgs: 10 peering, 3 active+undersized, 4 active+undersized+degraded, 48 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 10/336 objects degraded (2.976%) 2024-09-21T12:54:48.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:48 smithi046 ceph-mon[108126]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/336 objects degraded (2.976%), 4 pgs degraded) 2024-09-21T12:54:48.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:48 smithi176 ceph-mon[80162]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 10/336 objects degraded (2.976%), 4 pgs degraded) 2024-09-21T12:54:49.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:49 smithi046 ceph-mon[108126]: pgmap v240: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-21T12:54:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:49 smithi176 ceph-mon[80162]: pgmap v240: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s 2024-09-21T12:54:50.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 -- 172.21.15.46:0/685782601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c1069a0 msgr2=0x7fd17c106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:50.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 --2- 172.21.15.46:0/685782601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c1069a0 0x7fd17c106d80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd178009880 tx=0x7fd17802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:50.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 -- 172.21.15.46:0/685782601 shutdown_connections 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 --2- 172.21.15.46:0/685782601 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 --2- 172.21.15.46:0/685782601 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c1069a0 0x7fd17c106d80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 -- 172.21.15.46:0/685782601 >> 172.21.15.46:0/685782601 conn(0x7fd17c0fbc90 msgr2=0x7fd17c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 -- 172.21.15.46:0/685782601 shutdown_connections 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.874+0000 7fd1841cb640 1 -- 172.21.15.46:0/685782601 wait complete. 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd1841cb640 1 Processor -- start 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd1841cb640 1 -- start start 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd1841cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd1841cb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c1069a0 0x7fd17c19dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd1841cb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c10ef20 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd1841cb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c10eda0 con 0x7fd17c1069a0 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181f67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181f67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53150/0 (socket says 172.21.15.46:53150) 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181f67640 1 -- 172.21.15.46:0/1349263320 learned_addr learned my addr 172.21.15.46:0/1349263320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181766640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c1069a0 0x7fd17c19dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181f67640 1 -- 172.21.15.46:0/1349263320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c1069a0 msgr2=0x7fd17c19dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181f67640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c1069a0 0x7fd17c19dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181f67640 1 -- 172.21.15.46:0/1349263320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c1978b0 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.875+0000 7fd181766640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c1069a0 0x7fd17c19dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.876+0000 7fd181f67640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c19d6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd178031460 tx=0x7fd1780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.876+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd17803f070 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.876+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c197b40 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.876+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd178004b10 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.876+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd178035030 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.876+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c198070 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.877+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17c1030e0 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.878+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd178042070 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.879+0000 7fd172ffd640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd16807af90 0x7fd16807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.879+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7fd1780beb30 con 0x7fd17c0ffdc0 2024-09-21T12:54:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.879+0000 7fd181766640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd16807af90 0x7fd16807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:50.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.879+0000 7fd181766640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd16807af90 0x7fd16807d450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0058c0 tx=0x7fd16c005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:50.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:50.883+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd17808a1b0 con 0x7fd17c0ffdc0 2024-09-21T12:54:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.089+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd17c198de0 con 0x7fd16807af90 2024-09-21T12:54:51.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.091+0000 7fd172ffd640 1 -- 172.21.15.46:0/1349263320 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fd17c198de0 con 0x7fd16807af90 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd16807af90 msgr2=0x7fd16807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd16807af90 0x7fd16807d450 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0058c0 tx=0x7fd16c005850 comp rx=0 tx=0).stop 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 msgr2=0x7fd17c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c19d6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd178031460 tx=0x7fd1780045e0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 shutdown_connections 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd16807af90 0x7fd16807d450 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd17c1069a0 0x7fd17c19dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 --2- 172.21.15.46:0/1349263320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd17c0ffdc0 0x7fd17c19d6f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 >> 172.21.15.46:0/1349263320 conn(0x7fd17c0fbc90 msgr2=0x7fd17c0fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 shutdown_connections 2024-09-21T12:54:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.093+0000 7fd1841cb640 1 -- 172.21.15.46:0/1349263320 wait complete. 2024-09-21T12:54:51.104 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:54:51.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.184+0000 7f82880cf640 1 -- 172.21.15.46:0/4010824649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 msgr2=0x7f8280100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.184+0000 7f82880cf640 1 --2- 172.21.15.46:0/4010824649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f8280100c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8270009880 tx=0x7f827002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 -- 172.21.15.46:0/4010824649 shutdown_connections 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 --2- 172.21.15.46:0/4010824649 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f8280100c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 --2- 172.21.15.46:0/4010824649 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82801067f0 0x7f8280106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 -- 172.21.15.46:0/4010824649 >> 172.21.15.46:0/4010824649 conn(0x7f82800fc550 msgr2=0x7f82800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 -- 172.21.15.46:0/4010824649 shutdown_connections 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 -- 172.21.15.46:0/4010824649 wait complete. 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 Processor -- start 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 -- start start 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f828010b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.185+0000 7f82880cf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82801067f0 0x7f828010bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f82880cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f828010edc0 con 0x7f82801007f0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f82880cf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f828010ec40 con 0x7f82801067f0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f828010b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f828010b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53162/0 (socket says 172.21.15.46:53162) 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 -- 172.21.15.46:0/1806777263 learned_addr learned my addr 172.21.15.46:0/1806777263 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f828566a640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82801067f0 0x7f828010bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 -- 172.21.15.46:0/1806777263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82801067f0 msgr2=0x7f828010bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82801067f0 0x7f828010bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 -- 172.21.15.46:0/1806777263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828010c200 con 0x7f82801007f0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8285e6b640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f828010b780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e970 tx=0x7f827c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f827c00cac0 con 0x7f82801007f0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f827c0054e0 con 0x7f82801007f0 2024-09-21T12:54:51.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f827c010430 con 0x7f82801007f0 2024-09-21T12:54:51.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828010c4f0 con 0x7f82801007f0 2024-09-21T12:54:51.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.186+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82801a3e30 con 0x7f82801007f0 2024-09-21T12:54:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.188+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8280101f30 con 0x7f82801007f0 2024-09-21T12:54:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.188+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f827c004f00 con 0x7f82801007f0 2024-09-21T12:54:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.189+0000 7f8276ffd640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f826c07af80 0x7f826c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.189+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f827c09e570 con 0x7f82801007f0 2024-09-21T12:54:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.189+0000 7f828566a640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f826c07af80 0x7f826c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.189+0000 7f828566a640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f826c07af80 0x7f826c07d440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f828010d210 tx=0x7f8270031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:51.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.193+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f827c069bf0 con 0x7f82801007f0 2024-09-21T12:54:51.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.399+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8280062630 con 0x7f826c07af80 2024-09-21T12:54:51.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.400+0000 7f8276ffd640 1 -- 172.21.15.46:0/1806777263 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f8280062630 con 0x7f826c07af80 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f826c07af80 msgr2=0x7f826c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f826c07af80 0x7f826c07d440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f828010d210 tx=0x7f8270031400 comp rx=0 tx=0).stop 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 msgr2=0x7f828010b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f828010b780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e970 tx=0x7f827c00ed70 comp rx=0 tx=0).stop 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 shutdown_connections 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f826c07af80 0x7f826c07d440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f82801067f0 0x7f828010bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 --2- 172.21.15.46:0/1806777263 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f82801007f0 0x7f828010b780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.402+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 >> 172.21.15.46:0/1806777263 conn(0x7f82800fc550 msgr2=0x7f82800fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:51.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.403+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 shutdown_connections 2024-09-21T12:54:51.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.403+0000 7f82880cf640 1 -- 172.21.15.46:0/1806777263 wait complete. 2024-09-21T12:54:51.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.486+0000 7ff244afc640 1 -- 172.21.15.46:0/40440108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401007f0 msgr2=0x7ff240100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.486+0000 7ff244afc640 1 --2- 172.21.15.46:0/40440108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401007f0 0x7ff240100c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff228009880 tx=0x7ff22802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.488 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:51 smithi046 ceph-mon[108126]: pgmap v241: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:54:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 -- 172.21.15.46:0/40440108 shutdown_connections 2024-09-21T12:54:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 --2- 172.21.15.46:0/40440108 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401007f0 0x7ff240100c50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 --2- 172.21.15.46:0/40440108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401067f0 0x7ff240106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 -- 172.21.15.46:0/40440108 >> 172.21.15.46:0/40440108 conn(0x7ff2400fc550 msgr2=0x7ff2400fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 -- 172.21.15.46:0/40440108 shutdown_connections 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 -- 172.21.15.46:0/40440108 wait complete. 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 Processor -- start 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.487+0000 7ff244afc640 1 -- start start 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff244afc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401007f0 0x7ff24019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff244afc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 0x7ff24019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff244afc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010dca0 con 0x7ff2401067f0 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff244afc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff24010db20 con 0x7ff2401007f0 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 0x7ff24019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 0x7ff24019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53188/0 (socket says 172.21.15.46:53188) 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 -- 172.21.15.46:0/2173409688 learned_addr learned my addr 172.21.15.46:0/2173409688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23e59c640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401007f0 0x7ff24019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 -- 172.21.15.46:0/2173409688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401007f0 msgr2=0x7ff24019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401007f0 0x7ff24019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 -- 172.21.15.46:0/2173409688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff240197770 con 0x7ff2401067f0 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23e59c640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401007f0 0x7ff24019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.488+0000 7ff23dd9b640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 0x7ff24019dbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff228031460 tx=0x7ff2280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.489+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff22803f070 con 0x7ff2401067f0 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.489+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff228004cf0 con 0x7ff2401067f0 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.489+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff240197a00 con 0x7ff2401067f0 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.489+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff228035030 con 0x7ff2401067f0 2024-09-21T12:54:51.492 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.489+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff240197f30 con 0x7ff2401067f0 2024-09-21T12:54:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.490+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff240101f30 con 0x7ff2401067f0 2024-09-21T12:54:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.491+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff228042070 con 0x7ff2401067f0 2024-09-21T12:54:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.491+0000 7ff2377fe640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff22c07af80 0x7ff22c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.492+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7ff2280be9e0 con 0x7ff2401067f0 2024-09-21T12:54:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.492+0000 7ff23e59c640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff22c07af80 0x7ff22c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.492+0000 7ff23e59c640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff22c07af80 0x7ff22c07d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff23000baa0 tx=0x7ff230005d90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:51.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.496+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff22808a060 con 0x7ff2401067f0 2024-09-21T12:54:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:51 smithi176 ceph-mon[80162]: pgmap v241: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T12:54:51.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.692+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff2401982a0 con 0x7ff22c07af80 2024-09-21T12:54:51.703 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.702+0000 7ff2377fe640 1 -- 172.21.15.46:0/2173409688 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff2401982a0 con 0x7ff22c07af80 2024-09-21T12:54:51.704 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:54:51.704 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 86s ago 15m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:54:51.704 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (8m) 86s ago 16m 9126k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:54:51.704 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (8m) 16s ago 15m 9026k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:54:51.704 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (3m) 86s ago 16m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:54:51.705 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (3m) 16s ago 15m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:54:51.705 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (4m) 86s ago 15m 78.8M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:54:51.705 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (10m) 86s ago 10m 93.4M - 19.1.1-373-g4e45e6b4 164465d2334a 2673eca9d080 2024-09-21T12:54:51.705 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (10m) 86s ago 10m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:54:51.705 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (10m) 16s ago 10m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:54:51.705 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (10m) 16s ago 10m 26.9M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (7m) 86s ago 17m 528M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (6m) 16s ago 15m 458M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (3m) 86s ago 17m 42.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (3m) 16s ago 14m 37.7M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 86s ago 15m 11.3M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (5m) 16s ago 15m 11.5M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:54:51.706 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (2m) 86s ago 13m 82.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:54:51.707 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 86s ago 13m 90.4M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:54:51.707 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (91s) 86s ago 12m 12.0M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:54:51.707 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (54s) 16s ago 12m 90.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:54:51.707 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (20s) 16s ago 12m 12.0M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:54:51.707 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (11m) 16s ago 11m 190M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 63befa627e1a 2024-09-21T12:54:51.707 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 86s ago 15m 56.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:54:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff22c07af80 msgr2=0x7ff22c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff22c07af80 0x7ff22c07d440 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff23000baa0 tx=0x7ff230005d90 comp rx=0 tx=0).stop 2024-09-21T12:54:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 msgr2=0x7ff24019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 0x7ff24019dbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff228031460 tx=0x7ff2280048f0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 shutdown_connections 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff22c07af80 0x7ff22c07d440 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff2401067f0 0x7ff24019dbe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 --2- 172.21.15.46:0/2173409688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2401007f0 0x7ff24019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 >> 172.21.15.46:0/2173409688 conn(0x7ff2400fc550 msgr2=0x7ff240104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 shutdown_connections 2024-09-21T12:54:51.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.704+0000 7ff244afc640 1 -- 172.21.15.46:0/2173409688 wait complete. 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 -- 172.21.15.46:0/3286288794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94106800 msgr2=0x7f6f94106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 --2- 172.21.15.46:0/3286288794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94106800 0x7f6f94106be0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009880 tx=0x7f6f8402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 -- 172.21.15.46:0/3286288794 shutdown_connections 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 --2- 172.21.15.46:0/3286288794 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94100800 0x7f6f94100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 --2- 172.21.15.46:0/3286288794 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94106800 0x7f6f94106be0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 -- 172.21.15.46:0/3286288794 >> 172.21.15.46:0/3286288794 conn(0x7f6f940fc520 msgr2=0x7f6f940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 -- 172.21.15.46:0/3286288794 shutdown_connections 2024-09-21T12:54:51.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.787+0000 7f6f990b3640 1 -- 172.21.15.46:0/3286288794 wait complete. 2024-09-21T12:54:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.788+0000 7f6f990b3640 1 Processor -- start 2024-09-21T12:54:51.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.788+0000 7f6f990b3640 1 -- start start 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f990b3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 0x7f6f9419d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f990b3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94106800 0x7f6f9419dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f990b3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9410dcb0 con 0x7f6f94100800 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f990b3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9410db30 con 0x7f6f94106800 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 0x7f6f9419d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 0x7f6f9419d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53200/0 (socket says 172.21.15.46:53200) 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 -- 172.21.15.46:0/1084665083 learned_addr learned my addr 172.21.15.46:0/1084665083 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f9259c640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94106800 0x7f6f9419dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 -- 172.21.15.46:0/1084665083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94106800 msgr2=0x7f6f9419dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94106800 0x7f6f9419dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:51.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 -- 172.21.15.46:0/1084665083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f94197850 con 0x7f6f94100800 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f9259c640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94106800 0x7f6f9419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.789+0000 7f6f92d9d640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 0x7f6f9419d6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f84031460 tx=0x7f6f840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.790+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f8403f070 con 0x7f6f94100800 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.790+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6f840035f0 con 0x7f6f94100800 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.790+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f94197ae0 con 0x7f6f94100800 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.790+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6f84035030 con 0x7f6f94100800 2024-09-21T12:54:51.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.790+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f94198010 con 0x7f6f94100800 2024-09-21T12:54:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.791+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f94101f40 con 0x7f6f94100800 2024-09-21T12:54:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.792+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6f84042070 con 0x7f6f94100800 2024-09-21T12:54:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.792+0000 7f6f7bfff640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6f7c07af30 0x7f6f7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.793+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f6f840bea20 con 0x7f6f94100800 2024-09-21T12:54:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.793+0000 7f6f9259c640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6f7c07af30 0x7f6f7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:51.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.793+0000 7f6f9259c640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6f7c07af30 0x7f6f7c07d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f940ffbb0 tx=0x7f6f8800b5f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:51.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:51.797+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6f8408a020 con 0x7f6f94100800 2024-09-21T12:54:52.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.058+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6f94198d80 con 0x7f6f94100800 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.059+0000 7f6f7bfff640 1 -- 172.21.15.46:0/1084665083 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f6f8408c070 con 0x7f6f94100800 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:54:52.060 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 5 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:54:52.061 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:54:52.062 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:54:52.062 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T12:54:52.062 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 9 2024-09-21T12:54:52.062 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:54:52.062 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6f7c07af30 msgr2=0x7f6f7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6f7c07af30 0x7f6f7c07d3f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f940ffbb0 tx=0x7f6f8800b5f0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 msgr2=0x7f6f9419d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 0x7f6f9419d6d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6f84031460 tx=0x7f6f840045e0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 shutdown_connections 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6f7c07af30 0x7f6f7c07d3f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6f94106800 0x7f6f9419dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 --2- 172.21.15.46:0/1084665083 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6f94100800 0x7f6f9419d6d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 >> 172.21.15.46:0/1084665083 conn(0x7f6f940fc520 msgr2=0x7f6f9406a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 shutdown_connections 2024-09-21T12:54:52.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.061+0000 7f6f990b3640 1 -- 172.21.15.46:0/1084665083 wait complete. 2024-09-21T12:54:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 -- 172.21.15.46:0/834583926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 msgr2=0x7ff628074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.146 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 --2- 172.21.15.46:0/834583926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff628074a00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009880 tx=0x7ff61c02a530 comp rx=0 tx=0).stop 2024-09-21T12:54:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 -- 172.21.15.46:0/834583926 shutdown_connections 2024-09-21T12:54:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 --2- 172.21.15.46:0/834583926 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff628074f40 0x7ff62810dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 --2- 172.21.15.46:0/834583926 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff628074a00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 -- 172.21.15.46:0/834583926 >> 172.21.15.46:0/834583926 conn(0x7ff6280fd600 msgr2=0x7ff6280ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 -- 172.21.15.46:0/834583926 shutdown_connections 2024-09-21T12:54:52.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.145+0000 7ff62ed30640 1 -- 172.21.15.46:0/834583926 wait complete. 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62ed30640 1 Processor -- start 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62ed30640 1 -- start start 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62ed30640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff62819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62ed30640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff628074f40 0x7ff62819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62ed30640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff628110ff0 con 0x7ff628074620 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62ed30640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff628110e70 con 0x7ff628074f40 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62cacc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff62819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62cacc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff62819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53222/0 (socket says 172.21.15.46:53222) 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62cacc640 1 -- 172.21.15.46:0/1558109464 learned_addr learned my addr 172.21.15.46:0/1558109464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff627fff640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff628074f40 0x7ff62819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62cacc640 1 -- 172.21.15.46:0/1558109464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff628074f40 msgr2=0x7ff62819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62cacc640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff628074f40 0x7ff62819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.146+0000 7ff62cacc640 1 -- 172.21.15.46:0/1558109464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff628199a00 con 0x7ff628074620 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.147+0000 7ff62cacc640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff62819f840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff61c031460 tx=0x7ff61c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.147+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff61c03f070 con 0x7ff628074620 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.147+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff61c004cf0 con 0x7ff628074620 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.147+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff628199c90 con 0x7ff628074620 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.147+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff61c035030 con 0x7ff628074620 2024-09-21T12:54:52.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.147+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff62819a1c0 con 0x7ff628074620 2024-09-21T12:54:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.148+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff628075cd0 con 0x7ff628074620 2024-09-21T12:54:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.149+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff61c042070 con 0x7ff628074620 2024-09-21T12:54:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.149+0000 7ff625ffb640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff61807af80 0x7ff61807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.149+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7ff61c0bea80 con 0x7ff628074620 2024-09-21T12:54:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.149+0000 7ff627fff640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff61807af80 0x7ff61807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.150+0000 7ff627fff640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff61807af80 0x7ff61807d440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff614005fd0 tx=0x7ff614005e20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:52.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.154+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff61c08a060 con 0x7ff628074620 2024-09-21T12:54:52.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.379+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff62819af30 con 0x7ff628074620 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.379+0000 7ff625ffb640 1 -- 172.21.15.46:0/1558109464 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) ==== 76+0+2046 (secure 0 0 0) 0x7ff61c08ef10 con 0x7ff628074620 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:e20 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:44:30:428978+0000 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 20 2024-09-21T12:54:52.381 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:44:30.428965+0000 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 45 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:54:52.382 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=14570,1=24297} 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 14570 members: 24297,14570 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{0:14570} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.46:6828/692972635,v1:172.21.15.46:6829/692972635] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:24317} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/2004308327,v1:172.21.15.46:6827/2004308327] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:52.383 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{1:24297} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.176:6824/1059739183,v1:172.21.15.176:6825/1059739183] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:52.384 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:24309} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.176:6826/3542639331,v1:172.21.15.176:6827/3542639331] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:54:52.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:54:52.384 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:54:52.384 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 20 2024-09-21T12:54:52.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.381+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff61807af80 msgr2=0x7ff61807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.381+0000 7ff62ed30640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff61807af80 0x7ff61807d440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff614005fd0 tx=0x7ff614005e20 comp rx=0 tx=0).stop 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.381+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 msgr2=0x7ff62819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.381+0000 7ff62ed30640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff62819f840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff61c031460 tx=0x7ff61c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.381+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 shutdown_connections 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.381+0000 7ff62ed30640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff61807af80 0x7ff61807d440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.382+0000 7ff62ed30640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff628074f40 0x7ff62819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.382+0000 7ff62ed30640 1 --2- 172.21.15.46:0/1558109464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff628074620 0x7ff62819f840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.382+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 >> 172.21.15.46:0/1558109464 conn(0x7ff6280fd600 msgr2=0x7ff62810b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.382+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 shutdown_connections 2024-09-21T12:54:52.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.382+0000 7ff62ed30640 1 -- 172.21.15.46:0/1558109464 wait complete. 2024-09-21T12:54:52.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 -- 172.21.15.46:0/3804520168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81067f0 msgr2=0x7f5fd8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 --2- 172.21.15.46:0/3804520168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81067f0 0x7f5fd8106bd0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8009880 tx=0x7f5fc802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 -- 172.21.15.46:0/3804520168 shutdown_connections 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 --2- 172.21.15.46:0/3804520168 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd81007f0 0x7f5fd8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 --2- 172.21.15.46:0/3804520168 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81067f0 0x7f5fd8106bd0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 -- 172.21.15.46:0/3804520168 >> 172.21.15.46:0/3804520168 conn(0x7f5fd80fc550 msgr2=0x7f5fd80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 -- 172.21.15.46:0/3804520168 shutdown_connections 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 -- 172.21.15.46:0/3804520168 wait complete. 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 Processor -- start 2024-09-21T12:54:52.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.468+0000 7f5fde284640 1 -- start start 2024-09-21T12:54:52.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fde284640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 0x7f5fd819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fde284640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd81067f0 0x7f5fd819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fde284640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd810dd20 con 0x7f5fd81007f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fde284640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd810dba0 con 0x7f5fd81067f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 0x7f5fd819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 0x7f5fd819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53234/0 (socket says 172.21.15.46:53234) 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 -- 172.21.15.46:0/2827636074 learned_addr learned my addr 172.21.15.46:0/2827636074 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd77fe640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd81067f0 0x7f5fd819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 -- 172.21.15.46:0/2827636074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd81067f0 msgr2=0x7f5fd819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd81067f0 0x7f5fd819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 -- 172.21.15.46:0/2827636074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd8197800 con 0x7f5fd81007f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.469+0000 7f5fd7fff640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 0x7f5fd819d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8031460 tx=0x7f5fc80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.470+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fc803f070 con 0x7f5fd81007f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.470+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd8197a90 con 0x7f5fd81007f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.470+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fc8004cf0 con 0x7f5fd81007f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.470+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fc8035030 con 0x7f5fd81007f0 2024-09-21T12:54:52.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.470+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd8197fc0 con 0x7f5fd81007f0 2024-09-21T12:54:52.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.471+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd8101f30 con 0x7f5fd81007f0 2024-09-21T12:54:52.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.471+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5fc8042070 con 0x7f5fd81007f0 2024-09-21T12:54:52.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.472+0000 7f5fd57fa640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc007af80 0x7f5fc007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.472+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7f5fc80be9e0 con 0x7f5fd81007f0 2024-09-21T12:54:52.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.472+0000 7f5fd77fe640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc007af80 0x7f5fc007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.472+0000 7f5fd77fe640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc007af80 0x7f5fc007d440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8105f20 tx=0x7f5fcc008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:52.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.476+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fc808a060 con 0x7f5fd81007f0 2024-09-21T12:54:52.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:52 smithi046 ceph-mon[108126]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:52.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:52 smithi046 ceph-mon[108126]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:52.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:52 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1084665083' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:52.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.681+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5fd8198270 con 0x7f5fc007af80 2024-09-21T12:54:52.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.682+0000 7f5fd57fa640 1 -- 172.21.15.46:0/2827636074 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f5fd8198270 con 0x7f5fc007af80 2024-09-21T12:54:52.685 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:54:52.685 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:54:52.685 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:54:52.686 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "11/23 daemons upgraded", 2024-09-21T12:54:52.687 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:54:52.687 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:54:52.687 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:54:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc007af80 msgr2=0x7f5fc007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc007af80 0x7f5fc007d440 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8105f20 tx=0x7f5fcc008040 comp rx=0 tx=0).stop 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 msgr2=0x7f5fd819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 0x7f5fd819d680 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5fc8031460 tx=0x7f5fc80048f0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 shutdown_connections 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc007af80 0x7f5fc007d440 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fd81067f0 0x7f5fd819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 --2- 172.21.15.46:0/2827636074 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fd81007f0 0x7f5fd819d680 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 >> 172.21.15.46:0/2827636074 conn(0x7f5fd80fc550 msgr2=0x7f5fd8069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 shutdown_connections 2024-09-21T12:54:52.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.685+0000 7f5fde284640 1 -- 172.21.15.46:0/2827636074 wait complete. 2024-09-21T12:54:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1873796942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 msgr2=0x7fd8e0106d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1873796942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e0106d50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009880 tx=0x7fd8d002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1873796942 shutdown_connections 2024-09-21T12:54:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1873796942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 0x7fd8e0100300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1873796942 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e0106d50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1873796942 >> 172.21.15.46:0/1873796942 conn(0x7fd8e00fbc90 msgr2=0x7fd8e00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1873796942 shutdown_connections 2024-09-21T12:54:52.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1873796942 wait complete. 2024-09-21T12:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.770+0000 7fd8e5a21640 1 Processor -- start 2024-09-21T12:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8e5a21640 1 -- start start 2024-09-21T12:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8e5a21640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 0x7fd8e0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8e5a21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e01015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8e5a21640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e010ef50 con 0x7fd8e0106970 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8e5a21640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd8e010edd0 con 0x7fd8e00ffea0 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8de7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e01015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8de7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e01015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53250/0 (socket says 172.21.15.46:53250) 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8de7fc640 1 -- 172.21.15.46:0/1715282670 learned_addr learned my addr 172.21.15.46:0/1715282670 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8deffd640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 0x7fd8e0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8de7fc640 1 -- 172.21.15.46:0/1715282670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 msgr2=0x7fd8e0101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8de7fc640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 0x7fd8e0101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8de7fc640 1 -- 172.21.15.46:0/1715282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8e0101b00 con 0x7fd8e0106970 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.771+0000 7fd8deffd640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 0x7fd8e0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.772+0000 7fd8de7fc640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e01015c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400d6f0 tx=0x7fd8d400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:52.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.772+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8d4017070 con 0x7fd8e0106970 2024-09-21T12:54:52.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.772+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8e0101df0 con 0x7fd8e0106970 2024-09-21T12:54:52.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.772+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8d400de00 con 0x7fd8e0106970 2024-09-21T12:54:52.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.772+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8d4004bb0 con 0x7fd8e0106970 2024-09-21T12:54:52.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.772+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8e01a3f80 con 0x7fd8e0106970 2024-09-21T12:54:52.775 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.773+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8e01031c0 con 0x7fd8e0106970 2024-09-21T12:54:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.774+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd8d4004e60 con 0x7fd8e0106970 2024-09-21T12:54:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.774+0000 7fd8e4a1f640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8c807af30 0x7fd8c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:54:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.774+0000 7fd8deffd640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8c807af30 0x7fd8c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:54:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.774+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6156+0+0 (secure 0 0 0) 0x7fd8d409dc50 con 0x7fd8e0106970 2024-09-21T12:54:52.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.775+0000 7fd8deffd640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8c807af30 0x7fd8c807d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006010 tx=0x7fd8d00095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:54:52.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:52.779+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8d4069250 con 0x7fd8e0106970 2024-09-21T12:54:52.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:52 smithi176 ceph-mon[80162]: from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:52.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:52 smithi176 ceph-mon[80162]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:52.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:52 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1084665083' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:54:53.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.040+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd8e0109e80 con 0x7fd8e0106970 2024-09-21T12:54:53.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.041+0000 7fd8e4a1f640 1 -- 172.21.15.46:0/1715282670 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fd8d406e100 con 0x7fd8e0106970 2024-09-21T12:54:53.042 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:54:53.042 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:54:53.042 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:54:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8c807af30 msgr2=0x7fd8c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8c807af30 0x7fd8c807d3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0006010 tx=0x7fd8d00095f0 comp rx=0 tx=0).stop 2024-09-21T12:54:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 msgr2=0x7fd8e01015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:54:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e01015c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd8d400d6f0 tx=0x7fd8d400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:54:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 shutdown_connections 2024-09-21T12:54:53.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8c807af30 0x7fd8c807d3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd8e0106970 0x7fd8e01015c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 --2- 172.21.15.46:0/1715282670 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd8e00ffea0 0x7fd8e0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:54:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 >> 172.21.15.46:0/1715282670 conn(0x7fd8e00fbc90 msgr2=0x7fd8e00fc730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:54:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 shutdown_connections 2024-09-21T12:54:53.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:54:53.043+0000 7fd8e5a21640 1 -- 172.21.15.46:0/1715282670 wait complete. 2024-09-21T12:54:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:53 smithi046 ceph-mon[108126]: pgmap v242: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:54:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:53 smithi046 ceph-mon[108126]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:53 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1558109464' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:54:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:53 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1715282670' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:54:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:53 smithi176 ceph-mon[80162]: pgmap v242: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:54:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:53 smithi176 ceph-mon[80162]: from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:53 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1558109464' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:54:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:53 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1715282670' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:54:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:54 smithi046 ceph-mon[108126]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:54:54.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:54 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:54.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:54 smithi176 ceph-mon[80162]: from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:54:54.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:54:54.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:54 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:55 smithi046 ceph-mon[108126]: pgmap v243: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-21T12:54:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:55 smithi046 ceph-mon[108126]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:54:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:55 smithi046 ceph-mon[108126]: Upgrade: osd.5 is safe to restart 2024-09-21T12:54:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:55 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:55 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T12:54:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:55 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:55 smithi176 ceph-mon[80162]: pgmap v243: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-21T12:54:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:55 smithi176 ceph-mon[80162]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:54:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:55 smithi176 ceph-mon[80162]: Upgrade: osd.5 is safe to restart 2024-09-21T12:54:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:55 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:55 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T12:54:55.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:55 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:54:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:56 smithi176 ceph-mon[80162]: Upgrade: Updating osd.5 2024-09-21T12:54:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:56 smithi176 ceph-mon[80162]: Deploying daemon osd.5 on smithi176 2024-09-21T12:54:56.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:56 smithi046 ceph-mon[108126]: Upgrade: Updating osd.5 2024-09-21T12:54:56.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:56 smithi046 ceph-mon[108126]: Deploying daemon osd.5 on smithi176 2024-09-21T12:54:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:57 smithi046 ceph-mon[108126]: pgmap v244: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:54:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:57 smithi176 ceph-mon[80162]: pgmap v244: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T12:54:57.567 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:57 smithi176 systemd[1]: Stopping Ceph osd.5 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:54:58.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:57 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[54849]: 2024-09-21T12:54:57.712+0000 7f4df026d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:54:58.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:57 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[54849]: 2024-09-21T12:54:57.712+0000 7f4df026d640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-21T12:54:58.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:57 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[54849]: 2024-09-21T12:54:57.712+0000 7f4df026d640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:54:58.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:58 smithi046 ceph-mon[108126]: osd.5 marked itself down and dead 2024-09-21T12:54:58.677 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:58 smithi176 ceph-mon[80162]: osd.5 marked itself down and dead 2024-09-21T12:54:59.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:58 smithi176 podman[97469]: 2024-09-21 12:54:58.854888221 +0000 UTC m=+1.250587819 container died 63befa627e1a520d6b1fb21efee260ddcf0109089b2e98bbf49b91f55da3972a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b) 2024-09-21T12:54:59.515 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:59 smithi176 podman[97469]: 2024-09-21 12:54:59.221458736 +0000 UTC m=+1.617158321 container cleanup 63befa627e1a520d6b1fb21efee260ddcf0109089b2e98bbf49b91f55da3972a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T12:54:59.515 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:59 smithi176 bash[97469]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5 2024-09-21T12:54:59.515 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:59 smithi176 ceph-mon[80162]: pgmap v245: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:54:59.515 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:59 smithi176 ceph-mon[80162]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:54:59.515 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:59 smithi176 ceph-mon[80162]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T12:54:59.515 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:59.516 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:54:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:59 smithi046 ceph-mon[108126]: pgmap v245: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T12:54:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:59 smithi046 ceph-mon[108126]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:54:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:59 smithi046 ceph-mon[108126]: osdmap e73: 6 total, 5 up, 6 in 2024-09-21T12:54:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:54:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:54:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:54:59.816 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:59 smithi176 podman[97496]: 2024-09-21 12:54:59.514498573 +0000 UTC m=+0.653447616 container remove 63befa627e1a520d6b1fb21efee260ddcf0109089b2e98bbf49b91f55da3972a (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, RELEASE=squid-4e45e6b, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T12:55:00.143 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:59 smithi176 podman[97582]: 2024-09-21 12:54:59.823769248 +0000 UTC m=+0.103060328 container create a503db9edfb5192eb153a91a53b2331bcb9f7a395f621309e544d62641a10dc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:55:00.143 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:54:59 smithi176 podman[97582]: 2024-09-21 12:54:59.737011206 +0000 UTC m=+0.016302297 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:55:00.143 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 podman[97582]: 2024-09-21 12:55:00.042926148 +0000 UTC m=+0.322217234 container init a503db9edfb5192eb153a91a53b2331bcb9f7a395f621309e544d62641a10dc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T12:55:00.144 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 podman[97582]: 2024-09-21 12:55:00.046372945 +0000 UTC m=+0.325664021 container start a503db9edfb5192eb153a91a53b2331bcb9f7a395f621309e544d62641a10dc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T12:55:00.144 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 podman[97582]: 2024-09-21 12:55:00.142524009 +0000 UTC m=+0.421815098 container attach a503db9edfb5192eb153a91a53b2331bcb9f7a395f621309e544d62641a10dc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:55:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:00 smithi046 ceph-mon[108126]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T12:55:00.537 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:00 smithi176 ceph-mon[80162]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T12:55:00.538 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 podman[97582]: 2024-09-21 12:55:00.238728222 +0000 UTC m=+0.518019302 container died a503db9edfb5192eb153a91a53b2331bcb9f7a395f621309e544d62641a10dc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:55:00.792 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 podman[97605]: 2024-09-21 12:55:00.754142726 +0000 UTC m=+0.509456184 container remove a503db9edfb5192eb153a91a53b2331bcb9f7a395f621309e544d62641a10dc6 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T12:55:00.793 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T12:55:00.793 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 systemd[1]: Stopped Ceph osd.5 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:55:00.793 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5.service: Consumed 52.477s CPU time. 2024-09-21T12:55:01.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:00 smithi176 systemd[1]: Starting Ceph osd.5 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T12:55:01.450 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:01 smithi176 ceph-mon[80162]: pgmap v248: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:55:01.451 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 podman[97704]: 2024-09-21 12:55:01.098944257 +0000 UTC m=+0.015788423 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:55:01.451 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 podman[97704]: 2024-09-21 12:55:01.214015069 +0000 UTC m=+0.130859225 container create 6441e66a1cc804b9f2876a4d1225ac48e5a0075ea0597ba61dca5955ac53e1d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2) 2024-09-21T12:55:01.451 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 podman[97704]: 2024-09-21 12:55:01.449909849 +0000 UTC m=+0.366754013 container init 6441e66a1cc804b9f2876a4d1225ac48e5a0075ea0597ba61dca5955ac53e1d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T12:55:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:01 smithi046 ceph-mon[108126]: pgmap v248: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-21T12:55:01.816 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 podman[97704]: 2024-09-21 12:55:01.453437492 +0000 UTC m=+0.370281656 container start 6441e66a1cc804b9f2876a4d1225ac48e5a0075ea0597ba61dca5955ac53e1d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD) 2024-09-21T12:55:01.817 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 podman[97704]: 2024-09-21 12:55:01.574703575 +0000 UTC m=+0.491547761 container attach 6441e66a1cc804b9f2876a4d1225ac48e5a0075ea0597ba61dca5955ac53e1d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T12:55:01.817 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:01.817 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 bash[97704]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:01.817 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:01.817 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:01 smithi176 bash[97704]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:02.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:02 smithi046 ceph-mon[108126]: pgmap v249: 65 pgs: 8 active+undersized, 6 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 16/336 objects degraded (4.762%) 2024-09-21T12:55:02.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:02 smithi046 ceph-mon[108126]: Health check failed: Degraded data redundancy: 16/336 objects degraded (4.762%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T12:55:02.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:02 smithi176 ceph-mon[80162]: pgmap v249: 65 pgs: 8 active+undersized, 6 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 2 op/s; 16/336 objects degraded (4.762%) 2024-09-21T12:55:02.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:02 smithi176 ceph-mon[80162]: Health check failed: Degraded data redundancy: 16/336 objects degraded (4.762%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T12:55:04.718 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-mon[80162]: pgmap v250: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:04.718 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:55:04.718 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:04.718 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:55:04.718 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:55:04.719 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:55:04.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:04 smithi046 ceph-mon[108126]: pgmap v250: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:05.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate[97720]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 bash[97704]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T12:55:05.067 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:04 smithi176 podman[97704]: 2024-09-21 12:55:04.746021398 +0000 UTC m=+3.662865556 container died 6441e66a1cc804b9f2876a4d1225ac48e5a0075ea0597ba61dca5955ac53e1d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T12:55:05.528 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 podman[97924]: 2024-09-21 12:55:05.319360419 +0000 UTC m=+0.566218500 container remove 6441e66a1cc804b9f2876a4d1225ac48e5a0075ea0597ba61dca5955ac53e1d9 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T12:55:05.800 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 podman[97984]: 2024-09-21 12:55:05.430629213 +0000 UTC m=+0.015937920 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T12:55:05.800 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 podman[97984]: 2024-09-21 12:55:05.545277352 +0000 UTC m=+0.130586059 container create c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:55:05.800 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 podman[97984]: 2024-09-21 12:55:05.773949921 +0000 UTC m=+0.359258634 container init c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731) 2024-09-21T12:55:05.800 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 podman[97984]: 2024-09-21 12:55:05.777343124 +0000 UTC m=+0.362651826 container start c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T12:55:06.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 ceph-osd[98003]: -- 172.21.15.176:0/4286034189 <== mon.1 v2:172.21.15.176:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b48f4321e0 con 0x55b48e625c00 2024-09-21T12:55:06.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 bash[97984]: c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 2024-09-21T12:55:06.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:05 smithi176 systemd[1]: Started Ceph osd.5 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T12:55:07.196 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:06 smithi176 ceph-mon[80162]: pgmap v251: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:07.196 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:06 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:07.196 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:06 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:07.196 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:06 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:06 smithi046 ceph-mon[108126]: pgmap v251: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:06 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:06 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:06 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:07.816 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:07 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T12:55:07.660+0000 7faa29204640 -1 Falling back to public interface 2024-09-21T12:55:09.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:08 smithi176 ceph-mon[80162]: pgmap v252: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:09.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:08 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:09.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:08 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:08 smithi046 ceph-mon[108126]: pgmap v252: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:09.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:08 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:09.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:08 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:10.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:10 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:10.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:10 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:10.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:10 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:10.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:10 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:11 smithi176 ceph-mon[80162]: pgmap v253: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:11 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 53/336 objects degraded (15.774%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T12:55:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:11 smithi046 ceph-mon[108126]: pgmap v253: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:11 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 53/336 objects degraded (15.774%), 14 pgs degraded (PG_DEGRADED) 2024-09-21T12:55:12.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:12 smithi176 ceph-mon[80162]: from='osd.5 [v2:172.21.15.176:6816/2113538605,v1:172.21.15.176:6817/2113538605]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:55:12.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:12 smithi176 ceph-mon[80162]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:55:12.317 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:12 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T12:55:12.036+0000 7faa29204640 -1 osd.5 72 log_to_monitors true 2024-09-21T12:55:12.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:12 smithi046 ceph-mon[108126]: from='osd.5 [v2:172.21.15.176:6816/2113538605,v1:172.21.15.176:6817/2113538605]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:55:12.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:12 smithi046 ceph-mon[108126]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:55:13.566 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T12:55:13.187+0000 7faa1cfa6640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:55:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: pgmap v254: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:55:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T12:55:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='osd.5 [v2:172.21.15.176:6816/2113538605,v1:172.21.15.176:6817/2113538605]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:55:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:55:13.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T12:55:13.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: from='osd.5 ' entity='osd.5' 2024-09-21T12:55:13.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:13 smithi176 ceph-mon[80162]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T12:55:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: pgmap v254: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 53/336 objects degraded (15.774%) 2024-09-21T12:55:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:55:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T12:55:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='osd.5 [v2:172.21.15.176:6816/2113538605,v1:172.21.15.176:6817/2113538605]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi176", "root=default"]} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:13.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T12:55:13.664 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:13.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"} : dispatch 2024-09-21T12:55:13.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: from='osd.5 ' entity='osd.5' 2024-09-21T12:55:13.665 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-mon[108126]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T12:55:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:13 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:55:13.815+0000 7f661df42640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:55:14.442 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all osd 2024-09-21T12:55:14.442 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-21T12:55:14.442 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-21T12:55:14.442 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:55:14.443 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: osd.5 [v2:172.21.15.176:6816/2113538605,v1:172.21.15.176:6817/2113538605] boot 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.176:6826/3440958805,v1:172.21.15.176:6827/3440958805] up:boot 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6826/3641180421,v1:172.21.15.46:6827/3641180421] up:boot 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"} : dispatch 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:14.444 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:55:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all osd 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: fsmap cephfs:2 {0=cephfs.smithi046.hxdqyf=up:active,1=cephfs.smithi176.kzzdid=up:active} 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: osd.5 [v2:172.21.15.176:6816/2113538605,v1:172.21.15.176:6817/2113538605] boot 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.176:6826/3440958805,v1:172.21.15.176:6827/3440958805] up:boot 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6826/3641180421,v1:172.21.15.46:6827/3641180421] up:boot 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T12:55:14.568 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"} : dispatch 2024-09-21T12:55:14.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T12:55:14.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:14.569 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:55:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: pgmap v257: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 53/336 objects degraded (15.774%) 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.176:6824/2758440754,v1:172.21.15.176:6825/2758440754] up:boot 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6828/1628549881,v1:172.21.15.46:6829/1628549881] up:boot 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"} : dispatch 2024-09-21T12:55:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"} : dispatch 2024-09-21T12:55:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: pgmap v257: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 53/336 objects degraded (15.774%) 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.176:6824/2758440754,v1:172.21.15.176:6825/2758440754] up:boot 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6828/1628549881,v1:172.21.15.46:6829/1628549881] up:boot 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"} : dispatch 2024-09-21T12:55:15.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"} : dispatch 2024-09-21T12:55:16.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:16 smithi046 ceph-mon[108126]: Upgrade: Updating mds.cephfs.smithi046.ffxnex 2024-09-21T12:55:16.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:16.551 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.ffxnex", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:55:16.552 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:16 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:16.552 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:16 smithi046 ceph-mon[108126]: Deploying daemon mds.cephfs.smithi046.ffxnex on smithi046 2024-09-21T12:55:16.556 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:16 smithi176 ceph-mon[80162]: Upgrade: Updating mds.cephfs.smithi046.ffxnex 2024-09-21T12:55:16.556 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:16.556 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.ffxnex", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:55:16.556 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:16 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:16.556 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:16 smithi176 ceph-mon[80162]: Deploying daemon mds.cephfs.smithi046.ffxnex on smithi046 2024-09-21T12:55:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:17 smithi176 ceph-mon[80162]: pgmap v260: 65 pgs: 4 peering, 12 active+undersized, 12 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 48/336 objects degraded (14.286%) 2024-09-21T12:55:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:17 smithi176 ceph-mon[80162]: Health check update: Degraded data redundancy: 48/336 objects degraded (14.286%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:55:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:17 smithi046 ceph-mon[108126]: pgmap v260: 65 pgs: 4 peering, 12 active+undersized, 12 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 3 op/s; 48/336 objects degraded (14.286%) 2024-09-21T12:55:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:17 smithi046 ceph-mon[108126]: Health check update: Degraded data redundancy: 48/336 objects degraded (14.286%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:55:18.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:18 smithi046 ceph-mon[108126]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T12:55:18.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:18 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:55:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:18 smithi176 ceph-mon[80162]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T12:55:18.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:18 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:55:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:19 smithi176 ceph-mon[80162]: pgmap v262: 65 pgs: 4 peering, 1 active+undersized, 1 active+undersized+degraded, 59 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3/336 objects degraded (0.893%) 2024-09-21T12:55:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:19 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T12:55:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:19 smithi046 ceph-mon[108126]: pgmap v262: 65 pgs: 4 peering, 1 active+undersized, 1 active+undersized+degraded, 59 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 3/336 objects degraded (0.893%) 2024-09-21T12:55:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:19 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T12:55:20.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:20 smithi046 ceph-mon[108126]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/336 objects degraded (0.893%), 1 pg degraded) 2024-09-21T12:55:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:20 smithi176 ceph-mon[80162]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 3/336 objects degraded (0.893%), 1 pg degraded) 2024-09-21T12:55:21.629 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:21 smithi176 ceph-mon[80162]: pgmap v263: 65 pgs: 4 peering, 61 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:21.631 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:21 smithi046 ceph-mon[108126]: pgmap v263: 65 pgs: 4 peering, 61 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 -- 172.21.15.46:0/3866768954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164107900 msgr2=0x7fa164107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 --2- 172.21.15.46:0/3866768954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164107900 0x7fa164107ce0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa154009c20 tx=0x7fa15402a970 comp rx=0 tx=0).stop 2024-09-21T12:55:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 -- 172.21.15.46:0/3866768954 shutdown_connections 2024-09-21T12:55:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 --2- 172.21.15.46:0/3866768954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa164101900 0x7fa164101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 --2- 172.21.15.46:0/3866768954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164107900 0x7fa164107ce0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 -- 172.21.15.46:0/3866768954 >> 172.21.15.46:0/3866768954 conn(0x7fa1640fd620 msgr2=0x7fa1640ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.135+0000 7fa16af24640 1 -- 172.21.15.46:0/3866768954 shutdown_connections 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 -- 172.21.15.46:0/3866768954 wait complete. 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 Processor -- start 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 -- start start 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 0x7fa16419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa164107900 0x7fa16419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa16410edd0 con 0x7fa164101900 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa16af24640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa16410ec50 con 0x7fa164107900 2024-09-21T12:55:23.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa168cc0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 0x7fa16419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.136+0000 7fa168cc0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 0x7fa16419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49956/0 (socket says 172.21.15.46:49956) 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa168cc0640 1 -- 172.21.15.46:0/159140676 learned_addr learned my addr 172.21.15.46:0/159140676 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa163fff640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa164107900 0x7fa16419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa168cc0640 1 -- 172.21.15.46:0/159140676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa164107900 msgr2=0x7fa16419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa168cc0640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa164107900 0x7fa16419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa168cc0640 1 -- 172.21.15.46:0/159140676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1641977c0 con 0x7fa164101900 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa168cc0640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 0x7fa16419d640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa15402ae90 tx=0x7fa15402f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa154047070 con 0x7fa164101900 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa164197a50 con 0x7fa164101900 2024-09-21T12:55:23.141 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa15402f7e0 con 0x7fa164101900 2024-09-21T12:55:23.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.137+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa154034070 con 0x7fa164101900 2024-09-21T12:55:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.138+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa164197f80 con 0x7fa164101900 2024-09-21T12:55:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.139+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa164103040 con 0x7fa164101900 2024-09-21T12:55:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.140+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa15404a070 con 0x7fa164101900 2024-09-21T12:55:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.141+0000 7fa161ffb640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa14c07af30 0x7fa14c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.141+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fa1540beda0 con 0x7fa164101900 2024-09-21T12:55:23.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.141+0000 7fa163fff640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa14c07af30 0x7fa14c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.141+0000 7fa163fff640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa14c07af30 0x7fa14c07d3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa1640ffc10 tx=0x7fa15800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:23.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.149+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa15403f070 con 0x7fa164101900 2024-09-21T12:55:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.359+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa1641982f0 con 0x7fa14c07af30 2024-09-21T12:55:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.361+0000 7fa161ffb640 1 -- 172.21.15.46:0/159140676 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa1641982f0 con 0x7fa14c07af30 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa14c07af30 msgr2=0x7fa14c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa14c07af30 0x7fa14c07d3f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa1640ffc10 tx=0x7fa15800b390 comp rx=0 tx=0).stop 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 msgr2=0x7fa16419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 0x7fa16419d640 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa15402ae90 tx=0x7fa15402f5f0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 shutdown_connections 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa14c07af30 0x7fa14c07d3f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa164107900 0x7fa16419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 --2- 172.21.15.46:0/159140676 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa164101900 0x7fa16419d640 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 >> 172.21.15.46:0/159140676 conn(0x7fa1640fd620 msgr2=0x7fa1640fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 shutdown_connections 2024-09-21T12:55:23.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.363+0000 7fa16af24640 1 -- 172.21.15.46:0/159140676 wait complete. 2024-09-21T12:55:23.375 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:55:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 -- 172.21.15.46:0/847292662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 msgr2=0x7f220410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 --2- 172.21.15.46:0/847292662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f220410b930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009880 tx=0x7f21f802a530 comp rx=0 tx=0).stop 2024-09-21T12:55:23.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 -- 172.21.15.46:0/847292662 shutdown_connections 2024-09-21T12:55:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 --2- 172.21.15.46:0/847292662 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f220410b930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 --2- 172.21.15.46:0/847292662 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2204102b20 0x7f2204102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 -- 172.21.15.46:0/847292662 >> 172.21.15.46:0/847292662 conn(0x7f22040fc580 msgr2=0x7f22040fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 -- 172.21.15.46:0/847292662 shutdown_connections 2024-09-21T12:55:23.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.454+0000 7f2208b3c640 1 -- 172.21.15.46:0/847292662 wait complete. 2024-09-21T12:55:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2208b3c640 1 Processor -- start 2024-09-21T12:55:23.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2208b3c640 1 -- start start 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2208b3c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2204102b20 0x7f2204100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2208b3c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f2204100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2208b3c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f220410ee50 con 0x7f2204103440 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2208b3c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f220410ecd0 con 0x7f2204102b20 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2201d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f2204100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2201d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f2204100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49976/0 (socket says 172.21.15.46:49976) 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f2201d9b640 1 -- 172.21.15.46:0/1324437846 learned_addr learned my addr 172.21.15.46:0/1324437846 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.455+0000 7f220259c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2204102b20 0x7f2204100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f2201d9b640 1 -- 172.21.15.46:0/1324437846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2204102b20 msgr2=0x7f2204100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f2201d9b640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2204102b20 0x7f2204100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f2201d9b640 1 -- 172.21.15.46:0/1324437846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2204101200 con 0x7f2204103440 2024-09-21T12:55:23.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f2201d9b640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f2204100cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21f8031460 tx=0x7f21f8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21f803f070 con 0x7f2204103440 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21f8004a90 con 0x7f2204103440 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2204101490 con 0x7f2204103440 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22041a3e20 con 0x7f2204103440 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.456+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21f8035030 con 0x7f2204103440 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.457+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f220406ada0 con 0x7f2204103440 2024-09-21T12:55:23.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.458+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f21f8042070 con 0x7f2204103440 2024-09-21T12:55:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.459+0000 7f21f37fe640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f21ec07af40 0x7f21ec07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.459+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f21f80beb00 con 0x7f2204103440 2024-09-21T12:55:23.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.459+0000 7f220259c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f21ec07af40 0x7f21ec07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.460+0000 7f220259c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f21ec07af40 0x7f21ec07d400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005fd0 tx=0x7f21f400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:23.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.464+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21f808a050 con 0x7f2204103440 2024-09-21T12:55:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:23 smithi046 ceph-mon[108126]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:23.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.669+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2204062630 con 0x7f21ec07af40 2024-09-21T12:55:23.671 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.670+0000 7f21f37fe640 1 -- 172.21.15.46:0/1324437846 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2204062630 con 0x7f21ec07af40 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f21ec07af40 msgr2=0x7f21ec07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f21ec07af40 0x7f21ec07d400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005fd0 tx=0x7f21f400b390 comp rx=0 tx=0).stop 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 msgr2=0x7f2204100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f2204100cc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f21f8031460 tx=0x7f21f8004530 comp rx=0 tx=0).stop 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 shutdown_connections 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f21ec07af40 0x7f21ec07d400 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2204103440 0x7f2204100cc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 --2- 172.21.15.46:0/1324437846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2204102b20 0x7f2204100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 >> 172.21.15.46:0/1324437846 conn(0x7f22040fc580 msgr2=0x7f2204108f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 shutdown_connections 2024-09-21T12:55:23.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.672+0000 7f2208b3c640 1 -- 172.21.15.46:0/1324437846 wait complete. 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 -- 172.21.15.46:0/1621360803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 msgr2=0x7f32e8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1621360803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8100c60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f32d8009880 tx=0x7f32d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 -- 172.21.15.46:0/1621360803 shutdown_connections 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1621360803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8100c60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1621360803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 0x7f32e8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 -- 172.21.15.46:0/1621360803 >> 172.21.15.46:0/1621360803 conn(0x7f32e80fc520 msgr2=0x7f32e80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:23.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 -- 172.21.15.46:0/1621360803 shutdown_connections 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 -- 172.21.15.46:0/1621360803 wait complete. 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 Processor -- start 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.757+0000 7f32f05c4640 1 -- start start 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32f05c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32f05c4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 0x7f32e8198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32f05c4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f32e810dcd0 con 0x7f32e8100800 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32f05c4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f32e810db50 con 0x7f32e8106800 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49994/0 (socket says 172.21.15.46:49994) 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 -- 172.21.15.46:0/1456846107 learned_addr learned my addr 172.21.15.46:0/1456846107 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32edb5f640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 0x7f32e8198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 -- 172.21.15.46:0/1456846107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 msgr2=0x7f32e8198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 0x7f32e8198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 -- 172.21.15.46:0/1456846107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e8199360 con 0x7f32e8100800 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32edb5f640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 0x7f32e8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32ee360640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8198820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32e400c8f0 tx=0x7f32e400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.758+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32e40079b0 con 0x7f32e8100800 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.759+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e8199650 con 0x7f32e8100800 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.759+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32e40054e0 con 0x7f32e8100800 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.759+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f32e4004dd0 con 0x7f32e8100800 2024-09-21T12:55:23.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.759+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e81a1c50 con 0x7f32e8100800 2024-09-21T12:55:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.760+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e8101f40 con 0x7f32e8100800 2024-09-21T12:55:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.760+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f32e4005020 con 0x7f32e8100800 2024-09-21T12:55:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.761+0000 7f32df7fe640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f32d407aed0 0x7f32d407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.761+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f32e409e070 con 0x7f32e8100800 2024-09-21T12:55:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.761+0000 7f32edb5f640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f32d407aed0 0x7f32d407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:23.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.761+0000 7f32edb5f640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f32d407aed0 0x7f32d407d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f32d8006010 tx=0x7f32d80095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:23.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.765+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32e8199650 con 0x7f32e8100800 2024-09-21T12:55:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:23 smithi176 ceph-mon[80162]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:23.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:23.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:23.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.967+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f32e8108de0 con 0x7f32d407aed0 2024-09-21T12:55:23.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.977+0000 7f32df7fe640 1 -- 172.21.15.46:0/1456846107 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f32d8004440 con 0x7f32d407aed0 2024-09-21T12:55:23.978 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:55:23.978 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (5m) 118s ago 16m 18.8M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:55:23.978 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (8m) 118s ago 16m 9126k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:55:23.978 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (8m) 15s ago 15m 9068k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (3m) 118s ago 16m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (3m) 15s ago 15m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 118s ago 16m 78.8M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 starting - - - - 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (11m) 118s ago 11m 150M - 19.1.1-373-g4e45e6b4 164465d2334a b89e1650faf6 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (11m) 15s ago 11m 27.4M - 19.1.1-373-g4e45e6b4 164465d2334a e1e1d0c39243 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (10m) 15s ago 10m 26.6M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (7m) 118s ago 17m 528M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (6m) 15s ago 15m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (4m) 118s ago 17m 42.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (3m) 15s ago 15m 38.7M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (6m) 118s ago 16m 11.3M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (6m) 15s ago 15m 12.1M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 118s ago 14m 82.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:55:23.979 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (2m) 118s ago 13m 90.4M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:55:23.980 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 118s ago 13m 12.0M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:55:23.980 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (86s) 15s ago 13m 92.5M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:55:23.980 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (52s) 15s ago 12m 91.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:55:23.980 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (18s) 15s ago 12m 12.0M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:55:23.980 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (5m) 118s ago 16m 56.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f32d407aed0 msgr2=0x7f32d407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f32d407aed0 0x7f32d407d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f32d8006010 tx=0x7f32d80095f0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 msgr2=0x7f32e8198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8198820 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f32e400c8f0 tx=0x7f32e400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 shutdown_connections 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f32d407aed0 0x7f32d407d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32e8106800 0x7f32e8198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 --2- 172.21.15.46:0/1456846107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f32e8100800 0x7f32e8198820 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:23.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 >> 172.21.15.46:0/1456846107 conn(0x7f32e80fc520 msgr2=0x7f32e80fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:23.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 shutdown_connections 2024-09-21T12:55:23.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:23.980+0000 7f32f05c4640 1 -- 172.21.15.46:0/1456846107 wait complete. 2024-09-21T12:55:24.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 -- 172.21.15.46:0/2749316193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290101900 msgr2=0x7f0290101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 --2- 172.21.15.46:0/2749316193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290101900 0x7f0290101d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0278009880 tx=0x7f027802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 -- 172.21.15.46:0/2749316193 shutdown_connections 2024-09-21T12:55:24.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 --2- 172.21.15.46:0/2749316193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290101900 0x7f0290101d60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 --2- 172.21.15.46:0/2749316193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0290107900 0x7f0290107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 -- 172.21.15.46:0/2749316193 >> 172.21.15.46:0/2749316193 conn(0x7f02900fd600 msgr2=0x7f02900ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 -- 172.21.15.46:0/2749316193 shutdown_connections 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 -- 172.21.15.46:0/2749316193 wait complete. 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.063+0000 7f0295715640 1 Processor -- start 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0295715640 1 -- start start 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0295715640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0290101900 0x7f02900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0295715640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 0x7f0290074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0295715640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f029010edd0 con 0x7f0290107900 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0295715640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f029010ec50 con 0x7f0290101900 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 0x7f0290074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 0x7f0290074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50014/0 (socket says 172.21.15.46:50014) 2024-09-21T12:55:24.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 -- 172.21.15.46:0/2731027840 learned_addr learned my addr 172.21.15.46:0/2731027840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:24.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f028effd640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0290101900 0x7f02900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 -- 172.21.15.46:0/2731027840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0290101900 msgr2=0x7f02900744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0290101900 0x7f02900744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 -- 172.21.15.46:0/2731027840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0290074f70 con 0x7f0290107900 2024-09-21T12:55:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.064+0000 7f0287fff640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 0x7f0290074a30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0278031460 tx=0x7f02780045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.065+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f027803f070 con 0x7f0290107900 2024-09-21T12:55:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.065+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f02780035f0 con 0x7f0290107900 2024-09-21T12:55:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.065+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0290075200 con 0x7f0290107900 2024-09-21T12:55:24.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.065+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0278035030 con 0x7f0290107900 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.065+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901a3dc0 con 0x7f0290107900 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.066+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0290103040 con 0x7f0290107900 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.066+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0278042070 con 0x7f0290107900 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.067+0000 7f028cff9640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f027c07af80 0x7f027c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.067+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7f02780be910 con 0x7f0290107900 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.067+0000 7f028effd640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f027c07af80 0x7f027c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.068+0000 7f028effd640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f027c07af80 0x7f027c07d440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0280005fd0 tx=0x7f028000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:24.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.071+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0278089ee0 con 0x7f0290107900 2024-09-21T12:55:24.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.340+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0290075a20 con 0x7f0290107900 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.341+0000 7f028cff9640 1 -- 172.21.15.46:0/2731027840 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f027808c400 con 0x7f0290107900 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:55:24.342 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 1 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 11 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:55:24.343 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:55:24.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f027c07af80 msgr2=0x7f027c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f027c07af80 0x7f027c07d440 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0280005fd0 tx=0x7f028000b390 comp rx=0 tx=0).stop 2024-09-21T12:55:24.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 msgr2=0x7f0290074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 0x7f0290074a30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0278031460 tx=0x7f02780045e0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 shutdown_connections 2024-09-21T12:55:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f027c07af80 0x7f027c07d440 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0290107900 0x7f0290074a30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 --2- 172.21.15.46:0/2731027840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0290101900 0x7f02900744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 >> 172.21.15.46:0/2731027840 conn(0x7f02900fd600 msgr2=0x7f02900fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 shutdown_connections 2024-09-21T12:55:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.343+0000 7f0295715640 1 -- 172.21.15.46:0/2731027840 wait complete. 2024-09-21T12:55:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 -- 172.21.15.46:0/2132003373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 msgr2=0x7fb318101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/2132003373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb318101d60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb308009880 tx=0x7fb30802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 -- 172.21.15.46:0/2132003373 shutdown_connections 2024-09-21T12:55:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/2132003373 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb318101d60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/2132003373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 0x7fb318107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 -- 172.21.15.46:0/2132003373 >> 172.21.15.46:0/2132003373 conn(0x7fb3180fd620 msgr2=0x7fb3180ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 -- 172.21.15.46:0/2132003373 shutdown_connections 2024-09-21T12:55:24.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.431+0000 7fb31f7b0640 1 -- 172.21.15.46:0/2132003373 wait complete. 2024-09-21T12:55:24.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31f7b0640 1 Processor -- start 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31f7b0640 1 -- start start 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31f7b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb31819d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31f7b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 0x7fb31819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31f7b0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb31810edb0 con 0x7fb318101900 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31f7b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb31810ec30 con 0x7fb318107900 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31d54c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb31819d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31d54c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb31819d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50030/0 (socket says 172.21.15.46:50030) 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31d54c640 1 -- 172.21.15.46:0/665175849 learned_addr learned my addr 172.21.15.46:0/665175849 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31cd4b640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 0x7fb31819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31d54c640 1 -- 172.21.15.46:0/665175849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 msgr2=0x7fb31819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31d54c640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 0x7fb31819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31d54c640 1 -- 172.21.15.46:0/665175849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3181977a0 con 0x7fb318101900 2024-09-21T12:55:24.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.432+0000 7fb31cd4b640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 0x7fb31819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:55:24.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.433+0000 7fb31d54c640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb31819d620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c810 tx=0x7fb31400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:24.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.433+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb314004020 con 0x7fb318101900 2024-09-21T12:55:24.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.433+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb318197a90 con 0x7fb318101900 2024-09-21T12:55:24.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.433+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3140041c0 con 0x7fb318101900 2024-09-21T12:55:24.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.433+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3140047a0 con 0x7fb318101900 2024-09-21T12:55:24.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.433+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb318198020 con 0x7fb318101900 2024-09-21T12:55:24.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.434+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb318103040 con 0x7fb318101900 2024-09-21T12:55:24.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.434+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb3140079b0 con 0x7fb318101900 2024-09-21T12:55:24.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.435+0000 7fb30e7fc640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb30407af30 0x7fb30407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.435+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fb31409dfb0 con 0x7fb318101900 2024-09-21T12:55:24.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.435+0000 7fb31cd4b640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb30407af30 0x7fb30407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.436+0000 7fb31cd4b640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb30407af30 0x7fb30407d3f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb308031460 tx=0x7fb3080095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:24.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.439+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb314014030 con 0x7fb318101900 2024-09-21T12:55:24.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:24 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:boot 2024-09-21T12:55:24.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:24 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:24 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T12:55:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:24 smithi046 ceph-mon[108126]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:24.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:24 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2731027840' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:24.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.668+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb318109e90 con 0x7fb318101900 2024-09-21T12:55:24.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.669+0000 7fb30e7fc640 1 -- 172.21.15.46:0/665175849 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+2002 (secure 0 0 0) 0x7fb314069500 con 0x7fb318101900 2024-09-21T12:55:24.670 INFO:teuthology.orchestra.run.smithi046.stdout:e25 2024-09-21T12:55:24.670 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:55:23:352032+0000 2024-09-21T12:55:24.670 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:55:24.670 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:55:24.670 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:55:24.671 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:55:24.672 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34324} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/1628549881,v1:172.21.15.46:6829/1628549881] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44265} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/3440958805,v1:172.21.15.176:6827/3440958805] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:24.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44273} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/2758440754,v1:172.21.15.176:6825/2758440754] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 25 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb30407af30 msgr2=0x7fb30407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb30407af30 0x7fb30407d3f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb308031460 tx=0x7fb3080095f0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 msgr2=0x7fb31819d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb31819d620 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb31400c810 tx=0x7fb31400ccd0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 shutdown_connections 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb30407af30 0x7fb30407d3f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb318107900 0x7fb31819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 --2- 172.21.15.46:0/665175849 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb318101900 0x7fb31819d620 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 >> 172.21.15.46:0/665175849 conn(0x7fb3180fd620 msgr2=0x7fb3180fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 shutdown_connections 2024-09-21T12:55:24.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.671+0000 7fb31f7b0640 1 -- 172.21.15.46:0/665175849 wait complete. 2024-09-21T12:55:24.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 -- 172.21.15.46:0/1304481974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 msgr2=0x7fd900106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 --2- 172.21.15.46:0/1304481974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd900106bd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009880 tx=0x7fd8f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 -- 172.21.15.46:0/1304481974 shutdown_connections 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 --2- 172.21.15.46:0/1304481974 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9001007f0 0x7fd900100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 --2- 172.21.15.46:0/1304481974 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd900106bd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 -- 172.21.15.46:0/1304481974 >> 172.21.15.46:0/1304481974 conn(0x7fd9000fc550 msgr2=0x7fd9000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 -- 172.21.15.46:0/1304481974 shutdown_connections 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 -- 172.21.15.46:0/1304481974 wait complete. 2024-09-21T12:55:24.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.760+0000 7fd90679a640 1 Processor -- start 2024-09-21T12:55:24.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd90679a640 1 -- start start 2024-09-21T12:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd90679a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9001007f0 0x7fd9000fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd90679a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd9000fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd90679a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd90010dcc0 con 0x7fd9001067f0 2024-09-21T12:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd90679a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd90010db40 con 0x7fd9001007f0 2024-09-21T12:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8ff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd9000fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8ff7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd9000fd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50046/0 (socket says 172.21.15.46:50046) 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8ff7fe640 1 -- 172.21.15.46:0/3615092116 learned_addr learned my addr 172.21.15.46:0/3615092116 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8fffff640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9001007f0 0x7fd9000fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8ff7fe640 1 -- 172.21.15.46:0/3615092116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9001007f0 msgr2=0x7fd9000fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8ff7fe640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9001007f0 0x7fd9000fcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.761+0000 7fd8ff7fe640 1 -- 172.21.15.46:0/3615092116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9000fd7d0 con 0x7fd9001067f0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.762+0000 7fd8ff7fe640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd9000fd290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400d6f0 tx=0x7fd8f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.762+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8f4017070 con 0x7fd9001067f0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.762+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd8f400de00 con 0x7fd9001067f0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.762+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9000fdac0 con 0x7fd9001067f0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.762+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd8f4004bb0 con 0x7fd9001067f0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.762+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9001a3e70 con 0x7fd9001067f0 2024-09-21T12:55:24.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.763+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd900101f30 con 0x7fd9001067f0 2024-09-21T12:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.763+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd8f4004e60 con 0x7fd9001067f0 2024-09-21T12:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.764+0000 7fd8fd7fa640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8e807af30 0x7fd8e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.764+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7fd8f409dc50 con 0x7fd9001067f0 2024-09-21T12:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.764+0000 7fd8fffff640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8e807af30 0x7fd8e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:24.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.765+0000 7fd8fffff640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8e807af30 0x7fd8e807d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00096c0 tx=0x7fd8f0031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:24.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.769+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd8f40691a0 con 0x7fd9001067f0 2024-09-21T12:55:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:24 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:boot 2024-09-21T12:55:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:24 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:24 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T12:55:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:24 smithi176 ceph-mon[80162]: from='client.34332 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:24.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:24 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2731027840' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:24.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.982+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd900062630 con 0x7fd8e807af30 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.984+0000 7fd8fd7fa640 1 -- 172.21.15.46:0/3615092116 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fd900062630 con 0x7fd8e807af30 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:55:24.985 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:55:24.986 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "12/23 daemons upgraded", 2024-09-21T12:55:24.986 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:55:24.986 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:55:24.986 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8e807af30 msgr2=0x7fd8e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8e807af30 0x7fd8e807d3f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00096c0 tx=0x7fd8f0031400 comp rx=0 tx=0).stop 2024-09-21T12:55:24.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 msgr2=0x7fd9000fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd9000fd290 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400d6f0 tx=0x7fd8f400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 shutdown_connections 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd8e807af30 0x7fd8e807d3f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9001067f0 0x7fd9000fd290 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 --2- 172.21.15.46:0/3615092116 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9001007f0 0x7fd9000fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 >> 172.21.15.46:0/3615092116 conn(0x7fd9000fc550 msgr2=0x7fd900069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 shutdown_connections 2024-09-21T12:55:24.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:24.986+0000 7fd90679a640 1 -- 172.21.15.46:0/3615092116 wait complete. 2024-09-21T12:55:25.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 -- 172.21.15.46:0/1262270274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 msgr2=0x7feedc102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1262270274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc102f30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feecc009880 tx=0x7feecc02a530 comp rx=0 tx=0).stop 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 -- 172.21.15.46:0/1262270274 shutdown_connections 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1262270274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc103470 0x7feedc10b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1262270274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc102f30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 -- 172.21.15.46:0/1262270274 >> 172.21.15.46:0/1262270274 conn(0x7feedc0fc550 msgr2=0x7feedc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 -- 172.21.15.46:0/1262270274 shutdown_connections 2024-09-21T12:55:25.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.072+0000 7feee2ffa640 1 -- 172.21.15.46:0/1262270274 wait complete. 2024-09-21T12:55:25.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee2ffa640 1 Processor -- start 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee2ffa640 1 -- start start 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee2ffa640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee2ffa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc103470 0x7feedc19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee2ffa640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feedc10edc0 con 0x7feedc102b50 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee2ffa640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feedc10ec40 con 0x7feedc103470 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee0d96640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee0d96640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50072/0 (socket says 172.21.15.46:50072) 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feee0d96640 1 -- 172.21.15.46:0/1762027103 learned_addr learned my addr 172.21.15.46:0/1762027103 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.073+0000 7feedbfff640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc103470 0x7feedc19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feee0d96640 1 -- 172.21.15.46:0/1762027103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc103470 msgr2=0x7feedc19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feee0d96640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc103470 0x7feedc19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feee0d96640 1 -- 172.21.15.46:0/1762027103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feedc1977b0 con 0x7feedc102b50 2024-09-21T12:55:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feee0d96640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc19d630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feecc004f90 tx=0x7feecc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feecc03f070 con 0x7feedc102b50 2024-09-21T12:55:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feedc197a40 con 0x7feedc102b50 2024-09-21T12:55:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feecc004c70 con 0x7feedc102b50 2024-09-21T12:55:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feecc035030 con 0x7feedc102b50 2024-09-21T12:55:25.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.074+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feedc197f70 con 0x7feedc102b50 2024-09-21T12:55:25.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.075+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feedc06a4e0 con 0x7feedc102b50 2024-09-21T12:55:25.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.076+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feecc042070 con 0x7feedc102b50 2024-09-21T12:55:25.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.076+0000 7feed9ffb640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feec807af80 0x7feec807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:25.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.077+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6328+0+0 (secure 0 0 0) 0x7feecc0bea10 con 0x7feedc102b50 2024-09-21T12:55:25.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.077+0000 7feedbfff640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feec807af80 0x7feec807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:25.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.077+0000 7feedbfff640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feec807af80 0x7feec807d440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feedc108920 tx=0x7feec400b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:25.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.081+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feecc089f40 con 0x7feedc102b50 2024-09-21T12:55:25.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.350+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7feedc105fb0 con 0x7feedc102b50 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.351+0000 7feed9ffb640 1 -- 172.21.15.46:0/1762027103 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7feecc08edf0 con 0x7feedc102b50 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:55:25.352 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:55:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feec807af80 msgr2=0x7feec807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feec807af80 0x7feec807d440 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feedc108920 tx=0x7feec400b410 comp rx=0 tx=0).stop 2024-09-21T12:55:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 msgr2=0x7feedc19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc19d630 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feecc004f90 tx=0x7feecc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 shutdown_connections 2024-09-21T12:55:25.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feec807af80 0x7feec807d440 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feedc103470 0x7feedc19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 --2- 172.21.15.46:0/1762027103 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feedc102b50 0x7feedc19d630 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.353+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 >> 172.21.15.46:0/1762027103 conn(0x7feedc0fc550 msgr2=0x7feedc108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.354+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 shutdown_connections 2024-09-21T12:55:25.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:25.354+0000 7feee2ffa640 1 -- 172.21.15.46:0/1762027103 wait complete. 2024-09-21T12:55:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:25 smithi046 ceph-mon[108126]: pgmap v265: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:25 smithi046 ceph-mon[108126]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:25 smithi046 ceph-mon[108126]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:25 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/665175849' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:55:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:25 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1762027103' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:55:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:25 smithi176 ceph-mon[80162]: pgmap v265: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:25 smithi176 ceph-mon[80162]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:25 smithi176 ceph-mon[80162]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:25 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/665175849' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:55:25.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:25 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1762027103' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:55:26.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:26 smithi176 ceph-mon[80162]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:26.623 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:26 smithi046 ceph-mon[108126]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:27 smithi046 ceph-mon[108126]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:27 smithi176 ceph-mon[80162]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:29.089 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:28 smithi046 ceph-mon[108126]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:29.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.090 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:28 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:28 smithi176 ceph-mon[80162]: pgmap v267: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:29.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:28 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:30.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:30.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:55:30.388 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:55:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:31 smithi176 ceph-mon[80162]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:31 smithi046 ceph-mon[108126]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:32.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:32.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:32.913 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:34.489 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:34 smithi046 ceph-mon[108126]: Upgrade: Updating mds.cephfs.smithi046.hxdqyf 2024-09-21T12:55:34.489 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:34 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:34.489 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:34 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hxdqyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:55:34.489 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:34 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:34.489 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:34 smithi046 ceph-mon[108126]: Deploying daemon mds.cephfs.smithi046.hxdqyf on smithi046 2024-09-21T12:55:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:34 smithi176 ceph-mon[80162]: Upgrade: Updating mds.cephfs.smithi046.hxdqyf 2024-09-21T12:55:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:34 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:34 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi046.hxdqyf", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:55:34.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:34 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:34.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:34 smithi176 ceph-mon[80162]: Deploying daemon mds.cephfs.smithi046.hxdqyf on smithi046 2024-09-21T12:55:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:35 smithi176 ceph-mon[80162]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:35 smithi046 ceph-mon[108126]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:36.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:36 smithi046 ceph-mon[108126]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T12:55:36.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:36 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:55:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:36 smithi176 ceph-mon[80162]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T12:55:36.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:36 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:55:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:37 smithi176 ceph-mon[80162]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:37.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:37 smithi046 ceph-mon[108126]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:39.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:39 smithi046 ceph-mon[108126]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:39 smithi176 ceph-mon[80162]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: pgmap v274: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:boot 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:40.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"} : dispatch 2024-09-21T12:55:40.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: pgmap v274: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:40.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:boot 2024-09-21T12:55:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:40.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi046.hxdqyf"} : dispatch 2024-09-21T12:55:42.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:42 smithi046 ceph-mon[108126]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:42.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:42 smithi176 ceph-mon[80162]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:45 smithi046 ceph-mon[108126]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:55:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.519 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:45 smithi176 ceph-mon[80162]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:45.519 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.519 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.519 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:55:45.519 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:45.519 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:47 smithi176 ceph-mon[80162]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:47 smithi046 ceph-mon[108126]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:49.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:49.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:49.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:49.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:49.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:49 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:49.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:49 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:50.716 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:50 smithi176 ceph-mon[80162]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:50.716 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:50 smithi176 ceph-mon[80162]: Upgrade: Updating mds.cephfs.smithi176.kzzdid 2024-09-21T12:55:50.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:50.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.kzzdid", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:55:50.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:50 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:50.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:50 smithi176 ceph-mon[80162]: Deploying daemon mds.cephfs.smithi176.kzzdid on smithi176 2024-09-21T12:55:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:50 smithi046 ceph-mon[108126]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:50 smithi046 ceph-mon[108126]: Upgrade: Updating mds.cephfs.smithi176.kzzdid 2024-09-21T12:55:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.kzzdid", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:55:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:50 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:55:50.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:50 smithi046 ceph-mon[108126]: Deploying daemon mds.cephfs.smithi176.kzzdid on smithi176 2024-09-21T12:55:52.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:52 smithi176 ceph-mon[80162]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:52.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:52 smithi176 ceph-mon[80162]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T12:55:52.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:52 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:55:52.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:52 smithi046 ceph-mon[108126]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:52.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:52 smithi046 ceph-mon[108126]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T12:55:52.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:52 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:55:54.697 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:54 smithi176 ceph-mon[80162]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:54.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:54 smithi046 ceph-mon[108126]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.454+0000 7fbe377d8640 1 -- 172.21.15.46:0/872525344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 msgr2=0x7fbe30103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.454+0000 7fbe377d8640 1 --2- 172.21.15.46:0/872525344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe30103f60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009880 tx=0x7fbe2002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.454+0000 7fbe377d8640 1 -- 172.21.15.46:0/872525344 shutdown_connections 2024-09-21T12:55:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.454+0000 7fbe377d8640 1 --2- 172.21.15.46:0/872525344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe30103f60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.454+0000 7fbe377d8640 1 --2- 172.21.15.46:0/872525344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe30109b90 0x7fbe30109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.454+0000 7fbe377d8640 1 -- 172.21.15.46:0/872525344 >> 172.21.15.46:0/872525344 conn(0x7fbe300ff7a0 msgr2=0x7fbe30101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:55.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.455+0000 7fbe377d8640 1 -- 172.21.15.46:0/872525344 shutdown_connections 2024-09-21T12:55:55.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.455+0000 7fbe377d8640 1 -- 172.21.15.46:0/872525344 wait complete. 2024-09-21T12:55:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe377d8640 1 Processor -- start 2024-09-21T12:55:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe377d8640 1 -- start start 2024-09-21T12:55:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe377d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe3019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe377d8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe30109b90 0x7fbe3019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe377d8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbe30110fd0 con 0x7fbe30103b00 2024-09-21T12:55:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe377d8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbe30110e50 con 0x7fbe30109b90 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe35574640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe3019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe35574640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe3019f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38392/0 (socket says 172.21.15.46:38392) 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe35574640 1 -- 172.21.15.46:0/2454187841 learned_addr learned my addr 172.21.15.46:0/2454187841 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe34d73640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe30109b90 0x7fbe3019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe35574640 1 -- 172.21.15.46:0/2454187841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe30109b90 msgr2=0x7fbe3019fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe35574640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe30109b90 0x7fbe3019fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.456+0000 7fbe35574640 1 -- 172.21.15.46:0/2454187841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe301999c0 con 0x7fbe30103b00 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.457+0000 7fbe35574640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe3019f800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00e970 tx=0x7fbe2c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.457+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe2c00cac0 con 0x7fbe30103b00 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.457+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbe2c0054e0 con 0x7fbe30103b00 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.457+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe30199cb0 con 0x7fbe30103b00 2024-09-21T12:55:55.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.457+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbe2c010430 con 0x7fbe30103b00 2024-09-21T12:55:55.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.457+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3019a210 con 0x7fbe30103b00 2024-09-21T12:55:55.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.458+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe30105200 con 0x7fbe30103b00 2024-09-21T12:55:55.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.459+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbe2c004f00 con 0x7fbe30103b00 2024-09-21T12:55:55.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.459+0000 7fbe267fc640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe1c07af80 0x7fbe1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:55.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.459+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7fbe2c09e6f0 con 0x7fbe30103b00 2024-09-21T12:55:55.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.460+0000 7fbe34d73640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe1c07af80 0x7fbe1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:55.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.460+0000 7fbe34d73640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe1c07af80 0x7fbe1c07d440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe3019b1b0 tx=0x7fbe20031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:55.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.464+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe2c069c20 con 0x7fbe30103b00 2024-09-21T12:55:55.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.673+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbe3019aef0 con 0x7fbe1c07af80 2024-09-21T12:55:55.677 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.675+0000 7fbe267fc640 1 -- 172.21.15.46:0/2454187841 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fbe3019aef0 con 0x7fbe1c07af80 2024-09-21T12:55:55.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe1c07af80 msgr2=0x7fbe1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe1c07af80 0x7fbe1c07d440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe3019b1b0 tx=0x7fbe20031400 comp rx=0 tx=0).stop 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 msgr2=0x7fbe3019f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe3019f800 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00e970 tx=0x7fbe2c00ed70 comp rx=0 tx=0).stop 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 shutdown_connections 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbe1c07af80 0x7fbe1c07d440 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbe30109b90 0x7fbe3019fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 --2- 172.21.15.46:0/2454187841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbe30103b00 0x7fbe3019f800 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 >> 172.21.15.46:0/2454187841 conn(0x7fbe300ff7a0 msgr2=0x7fbe301000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 shutdown_connections 2024-09-21T12:55:55.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.677+0000 7fbe377d8640 1 -- 172.21.15.46:0/2454187841 wait complete. 2024-09-21T12:55:55.688 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:55:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 -- 172.21.15.46:0/3653937735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 msgr2=0x7f3d04106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/3653937735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d04106be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009880 tx=0x7f3d0002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 -- 172.21.15.46:0/3653937735 shutdown_connections 2024-09-21T12:55:55.765 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/3653937735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 0x7f3d04100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/3653937735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d04106be0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 -- 172.21.15.46:0/3653937735 >> 172.21.15.46:0/3653937735 conn(0x7f3d040fc520 msgr2=0x7f3d040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:55.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 -- 172.21.15.46:0/3653937735 shutdown_connections 2024-09-21T12:55:55.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.762+0000 7f3d0c78f640 1 -- 172.21.15.46:0/3653937735 wait complete. 2024-09-21T12:55:55.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.763+0000 7f3d0c78f640 1 Processor -- start 2024-09-21T12:55:55.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.763+0000 7f3d0c78f640 1 -- start start 2024-09-21T12:55:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.763+0000 7f3d0c78f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 0x7f3d0410b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.763+0000 7f3d0c78f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d0410bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.763+0000 7f3d0c78f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0410edd0 con 0x7f3d04106800 2024-09-21T12:55:55.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.763+0000 7f3d0c78f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3d0410ec50 con 0x7f3d04100800 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d0410bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d0410bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38402/0 (socket says 172.21.15.46:38402) 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 -- 172.21.15.46:0/2675824087 learned_addr learned my addr 172.21.15.46:0/2675824087 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d0a52b640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 0x7f3d0410b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 -- 172.21.15.46:0/2675824087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 msgr2=0x7f3d0410b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 0x7f3d0410b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 -- 172.21.15.46:0/2675824087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d0410c210 con 0x7f3d04106800 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d0a52b640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 0x7f3d0410b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d09d2a640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d0410bcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e970 tx=0x7f3cf400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cf400cac0 con 0x7f3d04106800 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3cf40054e0 con 0x7f3d04106800 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.764+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d0410c500 con 0x7f3d04106800 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.765+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3cf4010430 con 0x7f3d04106800 2024-09-21T12:55:55.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.765+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d041a3e20 con 0x7f3d04106800 2024-09-21T12:55:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.766+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d04101f40 con 0x7f3d04106800 2024-09-21T12:55:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.766+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3cf4004f00 con 0x7f3d04106800 2024-09-21T12:55:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.767+0000 7f3cfb7fe640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3cf007af90 0x7f3cf007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:55.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.767+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f3cf409e620 con 0x7f3d04106800 2024-09-21T12:55:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.767+0000 7f3d0a52b640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3cf007af90 0x7f3cf007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:55.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.767+0000 7f3d0a52b640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3cf007af90 0x7f3cf007d450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d000096c0 tx=0x7f3d00031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:55.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.772+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3cf4069bf0 con 0x7f3d04106800 2024-09-21T12:55:55.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.977+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d04062630 con 0x7f3cf007af90 2024-09-21T12:55:55.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.979+0000 7f3cfb7fe640 1 -- 172.21.15.46:0/2675824087 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f3d04062630 con 0x7f3cf007af90 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.980+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3cf007af90 msgr2=0x7f3cf007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.980+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3cf007af90 0x7f3cf007d450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3d000096c0 tx=0x7f3d00031400 comp rx=0 tx=0).stop 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.980+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 msgr2=0x7f3d0410bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.980+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d0410bcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3cf400e970 tx=0x7f3cf400ed70 comp rx=0 tx=0).stop 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 shutdown_connections 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3cf007af90 0x7f3cf007d450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3d04106800 0x7f3d0410bcd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 --2- 172.21.15.46:0/2675824087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d04100800 0x7f3d0410b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:55.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 >> 172.21.15.46:0/2675824087 conn(0x7f3d040fc520 msgr2=0x7f3d040fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 shutdown_connections 2024-09-21T12:55:55.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:55.981+0000 7f3d0c78f640 1 -- 172.21.15.46:0/2675824087 wait complete. 2024-09-21T12:55:56.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 -- 172.21.15.46:0/1852460567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 msgr2=0x7f4da4074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 --2- 172.21.15.46:0/1852460567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da4074970 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009880 tx=0x7f4da002a530 comp rx=0 tx=0).stop 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 -- 172.21.15.46:0/1852460567 shutdown_connections 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 --2- 172.21.15.46:0/1852460567 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4da4074eb0 0x7f4da41123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 --2- 172.21.15.46:0/1852460567 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da4074970 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 -- 172.21.15.46:0/1852460567 >> 172.21.15.46:0/1852460567 conn(0x7f4da40fd600 msgr2=0x7f4da40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 -- 172.21.15.46:0/1852460567 shutdown_connections 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.065+0000 7f4dab74c640 1 -- 172.21.15.46:0/1852460567 wait complete. 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4dab74c640 1 Processor -- start 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4dab74c640 1 -- start start 2024-09-21T12:55:56.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4dab74c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4dab74c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4da4074eb0 0x7f4da419e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4dab74c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4da41153d0 con 0x7f4da4074590 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4dab74c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4da4115250 con 0x7f4da4074eb0 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4da94e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4da94e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da419e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38426/0 (socket says 172.21.15.46:38426) 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.066+0000 7f4da94e8640 1 -- 172.21.15.46:0/2823539359 learned_addr learned my addr 172.21.15.46:0/2823539359 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:56.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4da8ce7640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4da4074eb0 0x7f4da419e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4da94e8640 1 -- 172.21.15.46:0/2823539359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4da4074eb0 msgr2=0x7f4da419e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4da94e8640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4da4074eb0 0x7f4da419e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4da94e8640 1 -- 172.21.15.46:0/2823539359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da41a28e0 con 0x7f4da4074590 2024-09-21T12:55:56.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4da94e8640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da419e010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4da0031460 tx=0x7f4da00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:56.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4da003f070 con 0x7f4da4074590 2024-09-21T12:55:56.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4da00035f0 con 0x7f4da4074590 2024-09-21T12:55:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da41a2b70 con 0x7f4da4074590 2024-09-21T12:55:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4da0035030 con 0x7f4da4074590 2024-09-21T12:55:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.067+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da41a30a0 con 0x7f4da4074590 2024-09-21T12:55:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.069+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da4075cd0 con 0x7f4da4074590 2024-09-21T12:55:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.069+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4da0042070 con 0x7f4da4074590 2024-09-21T12:55:56.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.070+0000 7f4d9a7fc640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d9007af30 0x7f4d9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.070+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f4da00bea20 con 0x7f4da4074590 2024-09-21T12:55:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.070+0000 7f4da8ce7640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d9007af30 0x7f4d9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.073 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.070+0000 7f4da8ce7640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d9007af30 0x7f4d9007d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4da4104810 tx=0x7f4d9400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:56.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.074+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4da0089f70 con 0x7f4da4074590 2024-09-21T12:55:56.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.269+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4da41a3350 con 0x7f4d9007af30 2024-09-21T12:55:56.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.278+0000 7f4d9a7fc640 1 -- 172.21.15.46:0/2823539359 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f4da41a3350 con 0x7f4d9007af30 2024-09-21T12:55:56.280 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:55:56.280 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 12s ago 16m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (9m) 12s ago 17m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (9m) 47s ago 16m 9068k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (4m) 12s ago 17m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (4m) 47s ago 16m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (5m) 12s ago 16m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (34s) 12s ago 11m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (17s) 12s ago 11m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 starting - - - - 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (11m) 47s ago 11m 26.6M - 19.1.1-373-g4e45e6b4 164465d2334a ff9f77a0dd99 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (8m) 12s ago 18m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (7m) 47s ago 16m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (4m) 12s ago 18m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:55:56.281 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (4m) 47s ago 16m 38.7M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 12s ago 17m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (7m) 47s ago 16m 12.1M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (3m) 12s ago 14m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 12s ago 14m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (2m) 12s ago 13m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (118s) 47s ago 13m 92.5M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (84s) 47s ago 13m 91.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (50s) 47s ago 12m 12.0M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:55:56.282 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (6m) 12s ago 16m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.280+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d9007af30 msgr2=0x7f4d9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.280+0000 7f4dab74c640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d9007af30 0x7f4d9007d3f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4da4104810 tx=0x7f4d9400b390 comp rx=0 tx=0).stop 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.280+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 msgr2=0x7f4da419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.280+0000 7f4dab74c640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da419e010 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4da0031460 tx=0x7f4da00045e0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 shutdown_connections 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d9007af30 0x7f4d9007d3f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4da4074eb0 0x7f4da419e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 --2- 172.21.15.46:0/2823539359 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4da4074590 0x7f4da419e010 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 >> 172.21.15.46:0/2823539359 conn(0x7f4da40fd600 msgr2=0x7f4da4104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 shutdown_connections 2024-09-21T12:55:56.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.281+0000 7f4dab74c640 1 -- 172.21.15.46:0/2823539359 wait complete. 2024-09-21T12:55:56.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 -- 172.21.15.46:0/1356331032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910100800 msgr2=0x7f0910100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 --2- 172.21.15.46:0/1356331032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910100800 0x7f0910100c60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f08f8009880 tx=0x7f08f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 -- 172.21.15.46:0/1356331032 shutdown_connections 2024-09-21T12:55:56.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 --2- 172.21.15.46:0/1356331032 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910100800 0x7f0910100c60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 --2- 172.21.15.46:0/1356331032 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0910106800 0x7f0910106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 -- 172.21.15.46:0/1356331032 >> 172.21.15.46:0/1356331032 conn(0x7f09100fc520 msgr2=0x7f09100fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:56.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 -- 172.21.15.46:0/1356331032 shutdown_connections 2024-09-21T12:55:56.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.364+0000 7f09152b7640 1 -- 172.21.15.46:0/1356331032 wait complete. 2024-09-21T12:55:56.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f09152b7640 1 Processor -- start 2024-09-21T12:55:56.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f09152b7640 1 -- start start 2024-09-21T12:55:56.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f09152b7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0910100800 0x7f091019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f09152b7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 0x7f091019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f09152b7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f091010dcd0 con 0x7f0910106800 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f09152b7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f091010db50 con 0x7f0910100800 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f090e7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 0x7f091019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f090e7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 0x7f091019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38442/0 (socket says 172.21.15.46:38442) 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f090e7fc640 1 -- 172.21.15.46:0/366502354 learned_addr learned my addr 172.21.15.46:0/366502354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.365+0000 7f090effd640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0910100800 0x7f091019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f090e7fc640 1 -- 172.21.15.46:0/366502354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0910100800 msgr2=0x7f091019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f090e7fc640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0910100800 0x7f091019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f090e7fc640 1 -- 172.21.15.46:0/366502354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0910197800 con 0x7f0910106800 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f090e7fc640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 0x7f091019dbc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08f8031460 tx=0x7f08f8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08f803f070 con 0x7f0910106800 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08f80035f0 con 0x7f0910106800 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08f8035030 con 0x7f0910106800 2024-09-21T12:55:56.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0910197a90 con 0x7f0910106800 2024-09-21T12:55:56.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.366+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0910197fc0 con 0x7f0910106800 2024-09-21T12:55:56.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.367+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0910101f40 con 0x7f0910106800 2024-09-21T12:55:56.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.368+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f08f8042070 con 0x7f0910106800 2024-09-21T12:55:56.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.369+0000 7f0907fff640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08fc07af30 0x7f08fc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.369+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f08f80bea50 con 0x7f0910106800 2024-09-21T12:55:56.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.369+0000 7f090effd640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08fc07af30 0x7f08fc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.369+0000 7f090effd640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08fc07af30 0x7f08fc07d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0900009bd0 tx=0x7f0900005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:56.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.373+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08f8089f00 con 0x7f0910106800 2024-09-21T12:55:56.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.636+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0910109d80 con 0x7f0910106800 2024-09-21T12:55:56.638 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] up:boot 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"} : dispatch 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:56.639 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:56 smithi046 ceph-mon[108126]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:56.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.636+0000 7f0907fff640 1 -- 172.21.15.46:0/366502354 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f08f808c420 con 0x7f0910106800 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:55:56.640 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 3 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 13 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08fc07af30 msgr2=0x7f08fc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08fc07af30 0x7f08fc07d3f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0900009bd0 tx=0x7f0900005f90 comp rx=0 tx=0).stop 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 msgr2=0x7f091019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 0x7f091019dbc0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f08f8031460 tx=0x7f08f8004530 comp rx=0 tx=0).stop 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 shutdown_connections 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08fc07af30 0x7f08fc07d3f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0910106800 0x7f091019dbc0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 --2- 172.21.15.46:0/366502354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0910100800 0x7f091019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 >> 172.21.15.46:0/366502354 conn(0x7f09100fc520 msgr2=0x7f091006a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 shutdown_connections 2024-09-21T12:55:56.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.639+0000 7f09152b7640 1 -- 172.21.15.46:0/366502354 wait complete. 2024-09-21T12:55:56.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 -- 172.21.15.46:0/1740057896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1067f0 msgr2=0x7ff27c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 --2- 172.21.15.46:0/1740057896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1067f0 0x7ff27c106bd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff278009880 tx=0x7ff27802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 -- 172.21.15.46:0/1740057896 shutdown_connections 2024-09-21T12:55:56.726 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 --2- 172.21.15.46:0/1740057896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1007f0 0x7ff27c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 --2- 172.21.15.46:0/1740057896 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1067f0 0x7ff27c106bd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 -- 172.21.15.46:0/1740057896 >> 172.21.15.46:0/1740057896 conn(0x7ff27c0fc550 msgr2=0x7ff27c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:56.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 -- 172.21.15.46:0/1740057896 shutdown_connections 2024-09-21T12:55:56.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 -- 172.21.15.46:0/1740057896 wait complete. 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.724+0000 7ff2837d8640 1 Processor -- start 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff2837d8640 1 -- start start 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff2837d8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 0x7ff27c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff2837d8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1067f0 0x7ff27c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff2837d8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10dcc0 con 0x7ff27c1007f0 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff2837d8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff27c10db40 con 0x7ff27c1067f0 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff281574640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 0x7ff27c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff281574640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 0x7ff27c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38460/0 (socket says 172.21.15.46:38460) 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff281574640 1 -- 172.21.15.46:0/3508732685 learned_addr learned my addr 172.21.15.46:0/3508732685 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff280d73640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1067f0 0x7ff27c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff281574640 1 -- 172.21.15.46:0/3508732685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1067f0 msgr2=0x7ff27c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff281574640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1067f0 0x7ff27c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff281574640 1 -- 172.21.15.46:0/3508732685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff27c199350 con 0x7ff27c1007f0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.725+0000 7ff280d73640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1067f0 0x7ff27c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.726+0000 7ff281574640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 0x7ff27c198810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff278031460 tx=0x7ff278004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.726+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff27803f070 con 0x7ff27c1007f0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.726+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2780035f0 con 0x7ff27c1007f0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.726+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff27c1995e0 con 0x7ff27c1007f0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.726+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff278035030 con 0x7ff27c1007f0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.726+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff27c1a1b90 con 0x7ff27c1007f0 2024-09-21T12:55:56.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.727+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c101f30 con 0x7ff27c1007f0 2024-09-21T12:55:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.728+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff278042070 con 0x7ff27c1007f0 2024-09-21T12:55:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.728+0000 7ff2727fc640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff26807af80 0x7ff26807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.728+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7ff2780be8e0 con 0x7ff27c1007f0 2024-09-21T12:55:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.728+0000 7ff280d73640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff26807af80 0x7ff26807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:56.731 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.729+0000 7ff280d73640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff26807af80 0x7ff26807d440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff27c06a7f0 tx=0x7ff26c005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:56.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.733+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff278089eb0 con 0x7ff27c1007f0 2024-09-21T12:55:56.740 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:56.740 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] up:boot 2024-09-21T12:55:56.740 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.kzzdid"} : dispatch 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:56.741 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:56 smithi176 ceph-mon[80162]: from='client.34374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:56.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.962+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff27c108d60 con 0x7ff27c1007f0 2024-09-21T12:55:56.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.963+0000 7ff2727fc640 1 -- 172.21.15.46:0/3508732685 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+2002 (secure 0 0 0) 0x7ff27808ed60 con 0x7ff27c1007f0 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:e29 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:55:55:441541+0000 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:55:56.966 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:55:56.967 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:55:56.968 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44265} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/3440958805,v1:172.21.15.176:6827/3440958805] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff26807af80 msgr2=0x7ff26807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff26807af80 0x7ff26807d440 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff27c06a7f0 tx=0x7ff26c005f90 comp rx=0 tx=0).stop 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 msgr2=0x7ff27c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 0x7ff27c198810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff278031460 tx=0x7ff278004530 comp rx=0 tx=0).stop 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 shutdown_connections 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff26807af80 0x7ff26807d440 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff27c1067f0 0x7ff27c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 --2- 172.21.15.46:0/3508732685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff27c1007f0 0x7ff27c198810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.965+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 >> 172.21.15.46:0/3508732685 conn(0x7ff27c0fc550 msgr2=0x7ff27c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.966+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 shutdown_connections 2024-09-21T12:55:56.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:56.966+0000 7ff2837d8640 1 -- 172.21.15.46:0/3508732685 wait complete. 2024-09-21T12:55:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 -- 172.21.15.46:0/1562069933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 msgr2=0x7f4118106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 --2- 172.21.15.46:0/1562069933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f4118106bd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f410c009880 tx=0x7f410c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 -- 172.21.15.46:0/1562069933 shutdown_connections 2024-09-21T12:55:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 --2- 172.21.15.46:0/1562069933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 0x7f4118100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 --2- 172.21.15.46:0/1562069933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f4118106bd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 -- 172.21.15.46:0/1562069933 >> 172.21.15.46:0/1562069933 conn(0x7f41180fc550 msgr2=0x7f41180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 -- 172.21.15.46:0/1562069933 shutdown_connections 2024-09-21T12:55:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.052+0000 7f411eb5e640 1 -- 172.21.15.46:0/1562069933 wait complete. 2024-09-21T12:55:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.053+0000 7f411eb5e640 1 Processor -- start 2024-09-21T12:55:57.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.053+0000 7f411eb5e640 1 -- start start 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.053+0000 7f411eb5e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 0x7f411819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.053+0000 7f411eb5e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f411819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.053+0000 7f411eb5e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f411810dcc0 con 0x7f41181067f0 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.053+0000 7f411eb5e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f411810db40 con 0x7f41181007f0 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f411c8fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 0x7f411819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4117fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f411819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:57.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f411c8fa640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 0x7f411819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.46:53486/0 (socket says 172.21.15.46:53486) 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f411c8fa640 1 -- 172.21.15.46:0/3659270099 learned_addr learned my addr 172.21.15.46:0/3659270099 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4117fff640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f411819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38480/0 (socket says 172.21.15.46:38480) 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4117fff640 1 -- 172.21.15.46:0/3659270099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 msgr2=0x7f411819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4117fff640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 0x7f411819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4117fff640 1 -- 172.21.15.46:0/3659270099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41181977b0 con 0x7f41181067f0 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4117fff640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f411819db70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f410400e970 tx=0x7f410400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f410400cac0 con 0x7f41181067f0 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f410400cc60 con 0x7f41181067f0 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4118197aa0 con 0x7f41181067f0 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.054+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f41040047a0 con 0x7f41181067f0 2024-09-21T12:55:57.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.055+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4118198030 con 0x7f41181067f0 2024-09-21T12:55:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.056+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4118101f30 con 0x7f41181067f0 2024-09-21T12:55:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.056+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4104004a50 con 0x7f41181067f0 2024-09-21T12:55:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.057+0000 7f4115ffb640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f410807af30 0x7f410807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.057+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f410409e550 con 0x7f41181067f0 2024-09-21T12:55:57.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.057+0000 7f411c8fa640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f410807af30 0x7f410807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:57.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.058+0000 7f411c8fa640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f410807af30 0x7f410807d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f410c009230 tx=0x7f410c0058d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:57.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.061+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4104069aa0 con 0x7f41181067f0 2024-09-21T12:55:57.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.278+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4118198340 con 0x7f410807af30 2024-09-21T12:55:57.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.279+0000 7f4115ffb640 1 -- 172.21.15.46:0/3659270099 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4118198340 con 0x7f410807af30 2024-09-21T12:55:57.281 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:55:57.281 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:55:57.281 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:55:57.281 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:55:57.281 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "14/23 daemons upgraded", 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:55:57.282 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:55:57.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f410807af30 msgr2=0x7f410807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f410807af30 0x7f410807d3f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f410c009230 tx=0x7f410c0058d0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 msgr2=0x7f411819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f411819db70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f410400e970 tx=0x7f410400ee30 comp rx=0 tx=0).stop 2024-09-21T12:55:57.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 shutdown_connections 2024-09-21T12:55:57.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f410807af30 0x7f410807d3f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41181067f0 0x7f411819db70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 --2- 172.21.15.46:0/3659270099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41181007f0 0x7f411819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 >> 172.21.15.46:0/3659270099 conn(0x7f41180fc550 msgr2=0x7f4118069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:57.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 shutdown_connections 2024-09-21T12:55:57.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.282+0000 7f411eb5e640 1 -- 172.21.15.46:0/3659270099 wait complete. 2024-09-21T12:55:57.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 -- 172.21.15.46:0/2451166706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac103430 msgr2=0x7f29ac10b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 --2- 172.21.15.46:0/2451166706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac103430 0x7f29ac10b920 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f29a00098b0 tx=0x7f29a002a560 comp rx=0 tx=0).stop 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 -- 172.21.15.46:0/2451166706 shutdown_connections 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 --2- 172.21.15.46:0/2451166706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac103430 0x7f29ac10b920 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 --2- 172.21.15.46:0/2451166706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac102b10 0x7f29ac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 -- 172.21.15.46:0/2451166706 >> 172.21.15.46:0/2451166706 conn(0x7f29ac0fc550 msgr2=0x7f29ac0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 -- 172.21.15.46:0/2451166706 shutdown_connections 2024-09-21T12:55:57.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.368+0000 7f29b22c7640 1 -- 172.21.15.46:0/2451166706 wait complete. 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29b22c7640 1 Processor -- start 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29b22c7640 1 -- start start 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29b22c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 0x7f29ac19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29b22c7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac103430 0x7f29ac19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29b22c7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac10ede0 con 0x7f29ac102b10 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29b22c7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f29ac10ec60 con 0x7f29ac103430 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.369+0000 7f29abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 0x7f29ac19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29abfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 0x7f29ac19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38498/0 (socket says 172.21.15.46:38498) 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29abfff640 1 -- 172.21.15.46:0/278437665 learned_addr learned my addr 172.21.15.46:0/278437665 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29ab7fe640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac103430 0x7f29ac19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:57.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29ab7fe640 1 -- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 msgr2=0x7f29ac19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29ab7fe640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 0x7f29ac19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29ab7fe640 1 -- 172.21.15.46:0/278437665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ac1977f0 con 0x7f29ac103430 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29abfff640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 0x7f29ac19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29ab7fe640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac103430 0x7f29ac19dbb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f29a002aa80 tx=0x7f29a00045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29a003f070 con 0x7f29ac103430 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ac197a80 con 0x7f29ac103430 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f29a00035f0 con 0x7f29ac103430 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.370+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f29a0035030 con 0x7f29ac103430 2024-09-21T12:55:57.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.371+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ac197fb0 con 0x7f29ac103430 2024-09-21T12:55:57.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.372+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29ac06a520 con 0x7f29ac103430 2024-09-21T12:55:57.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.372+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f29a0042070 con 0x7f29ac103430 2024-09-21T12:55:57.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.373+0000 7f29a97fa640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f299407af30 0x7f299407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:55:57.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.373+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6328+0+0 (secure 0 0 0) 0x7f29a00be950 con 0x7f29ac103430 2024-09-21T12:55:57.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.373+0000 7f29abfff640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f299407af30 0x7f299407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:55:57.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.373+0000 7f29abfff640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f299407af30 0x7f299407d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f299c011500 tx=0x7f299c005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:55:57.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.377+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f29a0089e00 con 0x7f29ac103430 2024-09-21T12:55:57.644 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:57 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/366502354' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:57.644 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:57 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3508732685' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:55:57.644 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:57 smithi046 ceph-mon[108126]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.641+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f29ac106010 con 0x7f29ac103430 2024-09-21T12:55:57.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.642+0000 7f29a97fa640 1 -- 172.21.15.46:0/278437665 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f29a008ecb0 con 0x7f29ac103430 2024-09-21T12:55:57.644 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:55:57.645 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:55:57.645 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:55:57.645 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:55:57.645 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:55:57.645 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:55:57.645 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:55:57.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f299407af30 msgr2=0x7f299407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f299407af30 0x7f299407d3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f299c011500 tx=0x7f299c005f90 comp rx=0 tx=0).stop 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac103430 msgr2=0x7f29ac19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac103430 0x7f29ac19dbb0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f29a002aa80 tx=0x7f29a00045e0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 shutdown_connections 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f299407af30 0x7f299407d3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29ac103430 0x7f29ac19dbb0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 --2- 172.21.15.46:0/278437665 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f29ac102b10 0x7f29ac19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 >> 172.21.15.46:0/278437665 conn(0x7f29ac0fc550 msgr2=0x7f29ac103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 shutdown_connections 2024-09-21T12:55:57.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:55:57.644+0000 7f29b22c7640 1 -- 172.21.15.46:0/278437665 wait complete. 2024-09-21T12:55:57.787 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:57 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/366502354' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:55:57.787 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:57 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3508732685' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:55:57.787 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:57 smithi176 ceph-mon[80162]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:55:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:58 smithi176 ceph-mon[80162]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:58 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/278437665' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:55:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:58 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:58 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:58.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:58 smithi046 ceph-mon[108126]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:55:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:58 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/278437665' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:55:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:58 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:55:58.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:58 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:00.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:00.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:00.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:55:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:00.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:00.117 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:00.117 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:55:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:01.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:00 smithi176 ceph-mon[80162]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:01.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:00 smithi046 ceph-mon[108126]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:03.213 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:03.213 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.214 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:02 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:02 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:04.518 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:04 smithi176 ceph-mon[80162]: Upgrade: Updating mds.cephfs.smithi176.whwfab 2024-09-21T12:56:04.518 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:04 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:04.518 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:04 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.whwfab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:56:04.518 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:04 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:56:04.518 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:04 smithi176 ceph-mon[80162]: Deploying daemon mds.cephfs.smithi176.whwfab on smithi176 2024-09-21T12:56:04.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:04 smithi046 ceph-mon[108126]: Upgrade: Updating mds.cephfs.smithi176.whwfab 2024-09-21T12:56:04.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:04 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:04.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:04 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi176.whwfab", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:56:04.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:04 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:56:04.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:04 smithi046 ceph-mon[108126]: Deploying daemon mds.cephfs.smithi176.whwfab on smithi176 2024-09-21T12:56:05.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:05 smithi176 ceph-mon[80162]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:05 smithi046 ceph-mon[108126]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:06.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:06 smithi046 ceph-mon[108126]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T12:56:06.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:06 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:56:06.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:06 smithi176 ceph-mon[80162]: osdmap e82: 6 total, 6 up, 6 in 2024-09-21T12:56:06.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:06 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-09-21T12:56:07.548 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:07 smithi046 ceph-mon[108126]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:07 smithi176 ceph-mon[80162]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:09 smithi046 ceph-mon[108126]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:09.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:09 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"} : dispatch 2024-09-21T12:56:09.549 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:09 smithi176 ceph-mon[80162]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:09.549 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:09 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"} : dispatch 2024-09-21T12:56:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:11 smithi176 ceph-mon[80162]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:56:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:11 smithi046 ceph-mon[108126]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:11.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:56:12.429 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:12 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] up:boot 2024-09-21T12:56:12.429 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:12 smithi176 ceph-mon[80162]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:56:12.429 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"} : dispatch 2024-09-21T12:56:12.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:12 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] up:boot 2024-09-21T12:56:12.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:12 smithi046 ceph-mon[108126]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-09-21T12:56:12.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "mds metadata", "who": "cephfs.smithi176.whwfab"} : dispatch 2024-09-21T12:56:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:13 smithi176 ceph-mon[80162]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:13 smithi046 ceph-mon[108126]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T12:56:14.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:15 smithi046 ceph-mon[108126]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:15.698 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:15 smithi176 ceph-mon[80162]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:17 smithi046 ceph-mon[108126]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:17.778 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:17 smithi176 ceph-mon[80162]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:19 smithi046 ceph-mon[108126]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:19 smithi176 ceph-mon[80162]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:21 smithi046 ceph-mon[108126]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:21 smithi176 ceph-mon[80162]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:23 smithi046 ceph-mon[108126]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:23 smithi176 ceph-mon[80162]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:25 smithi046 ceph-mon[108126]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:25 smithi176 ceph-mon[80162]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:27 smithi176 ceph-mon[80162]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:27.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:27 smithi046 ceph-mon[108126]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.739+0000 7f48a5376640 1 -- 172.21.15.46:0/869979305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01007f0 msgr2=0x7f48a0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.739+0000 7f48a5376640 1 --2- 172.21.15.46:0/869979305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01007f0 0x7f48a0100c50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4888009880 tx=0x7f488802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 -- 172.21.15.46:0/869979305 shutdown_connections 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 --2- 172.21.15.46:0/869979305 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01007f0 0x7f48a0100c50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 --2- 172.21.15.46:0/869979305 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48a01067f0 0x7f48a0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 -- 172.21.15.46:0/869979305 >> 172.21.15.46:0/869979305 conn(0x7f48a00fc550 msgr2=0x7f48a00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 -- 172.21.15.46:0/869979305 shutdown_connections 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 -- 172.21.15.46:0/869979305 wait complete. 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 Processor -- start 2024-09-21T12:56:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.740+0000 7f48a5376640 1 -- start start 2024-09-21T12:56:27.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48a5376640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48a01007f0 0x7f48a00fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48a5376640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 0x7f48a00fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48a5376640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f48a010dcc0 con 0x7f48a01067f0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48a5376640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f48a010db40 con 0x7f48a01007f0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 0x7f48a00fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 0x7f48a00fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48250/0 (socket says 172.21.15.46:48250) 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 -- 172.21.15.46:0/3320708597 learned_addr learned my addr 172.21.15.46:0/3320708597 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f489effd640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48a01007f0 0x7f48a00fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 -- 172.21.15.46:0/3320708597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48a01007f0 msgr2=0x7f48a00fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48a01007f0 0x7f48a00fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 -- 172.21.15.46:0/3320708597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a00fd750 con 0x7f48a01067f0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.741+0000 7f48967fc640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 0x7f48a00fd210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4888031460 tx=0x7f4888004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.742+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f488803f070 con 0x7f48a01067f0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.742+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a00fd9e0 con 0x7f48a01067f0 2024-09-21T12:56:27.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.742+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f48880035f0 con 0x7f48a01067f0 2024-09-21T12:56:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.742+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4888035030 con 0x7f48a01067f0 2024-09-21T12:56:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.742+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a01a3da0 con 0x7f48a01067f0 2024-09-21T12:56:27.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.743+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a0101f30 con 0x7f48a01067f0 2024-09-21T12:56:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.743+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4888042070 con 0x7f48a01067f0 2024-09-21T12:56:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.744+0000 7f489cff9640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f488c07af30 0x7f488c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.744+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f48880bea60 con 0x7f48a01067f0 2024-09-21T12:56:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.744+0000 7f489effd640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f488c07af30 0x7f488c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:27.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.744+0000 7f489effd640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f488c07af30 0x7f488c07d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4890009b60 tx=0x7f4890005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:27.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.748+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4888089fb0 con 0x7f48a01067f0 2024-09-21T12:56:27.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.953+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f48a0062630 con 0x7f488c07af30 2024-09-21T12:56:27.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.954+0000 7f489cff9640 1 -- 172.21.15.46:0/3320708597 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f48a0062630 con 0x7f488c07af30 2024-09-21T12:56:27.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f488c07af30 msgr2=0x7f488c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:27.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f488c07af30 0x7f488c07d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4890009b60 tx=0x7f4890005f90 comp rx=0 tx=0).stop 2024-09-21T12:56:27.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 msgr2=0x7f48a00fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:27.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 0x7f48a00fd210 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4888031460 tx=0x7f4888004530 comp rx=0 tx=0).stop 2024-09-21T12:56:27.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 shutdown_connections 2024-09-21T12:56:27.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f488c07af30 0x7f488c07d3f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f48a01067f0 0x7f48a00fd210 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 --2- 172.21.15.46:0/3320708597 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f48a01007f0 0x7f48a00fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:27.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 >> 172.21.15.46:0/3320708597 conn(0x7f48a00fc550 msgr2=0x7f48a0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:27.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 shutdown_connections 2024-09-21T12:56:27.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:27.956+0000 7f48a5376640 1 -- 172.21.15.46:0/3320708597 wait complete. 2024-09-21T12:56:27.967 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 -- 172.21.15.46:0/844245444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438107900 msgr2=0x7fa438107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 --2- 172.21.15.46:0/844245444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438107900 0x7fa438107ce0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa428009880 tx=0x7fa42802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 -- 172.21.15.46:0/844245444 shutdown_connections 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 --2- 172.21.15.46:0/844245444 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa438101900 0x7fa438101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 --2- 172.21.15.46:0/844245444 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438107900 0x7fa438107ce0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 -- 172.21.15.46:0/844245444 >> 172.21.15.46:0/844245444 conn(0x7fa4380fd600 msgr2=0x7fa4380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 -- 172.21.15.46:0/844245444 shutdown_connections 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.042+0000 7fa43e44d640 1 -- 172.21.15.46:0/844245444 wait complete. 2024-09-21T12:56:28.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa43e44d640 1 Processor -- start 2024-09-21T12:56:28.045 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa43e44d640 1 -- start start 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa43e44d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 0x7fa43819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa43e44d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa438107900 0x7fa43819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa43e44d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa43810ee30 con 0x7fa438101900 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa43e44d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa43810ecb0 con 0x7fa438107900 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa437fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 0x7fa43819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa437fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 0x7fa43819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48276/0 (socket says 172.21.15.46:48276) 2024-09-21T12:56:28.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.043+0000 7fa437fff640 1 -- 172.21.15.46:0/363473775 learned_addr learned my addr 172.21.15.46:0/363473775 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa4377fe640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa438107900 0x7fa43819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa437fff640 1 -- 172.21.15.46:0/363473775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa438107900 msgr2=0x7fa43819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa437fff640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa438107900 0x7fa43819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa437fff640 1 -- 172.21.15.46:0/363473775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa438197810 con 0x7fa438101900 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa437fff640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 0x7fa43819d690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa428031460 tx=0x7fa4280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa42803f070 con 0x7fa438101900 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4280044d0 con 0x7fa438101900 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa438197aa0 con 0x7fa438101900 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa428035030 con 0x7fa438101900 2024-09-21T12:56:28.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.044+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa438197fd0 con 0x7fa438101900 2024-09-21T12:56:28.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.046+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa438103040 con 0x7fa438101900 2024-09-21T12:56:28.048 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.046+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa428042070 con 0x7fa438101900 2024-09-21T12:56:28.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.047+0000 7fa4357fa640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa42007af40 0x7fa42007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.047+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa4280beb90 con 0x7fa438101900 2024-09-21T12:56:28.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.047+0000 7fa4377fe640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa42007af40 0x7fa42007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.049 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.047+0000 7fa4377fe640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa42007af40 0x7fa42007d400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4380ffc50 tx=0x7fa42c009110 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:28.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.051+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa428004cf0 con 0x7fa438101900 2024-09-21T12:56:28.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.255+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa438198280 con 0x7fa42007af40 2024-09-21T12:56:28.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.256+0000 7fa4357fa640 1 -- 172.21.15.46:0/363473775 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa438198280 con 0x7fa42007af40 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa42007af40 msgr2=0x7fa42007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa42007af40 0x7fa42007d400 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa4380ffc50 tx=0x7fa42c009110 comp rx=0 tx=0).stop 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 msgr2=0x7fa43819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 0x7fa43819d690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa428031460 tx=0x7fa4280048f0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 shutdown_connections 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa42007af40 0x7fa42007d400 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa438107900 0x7fa43819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 --2- 172.21.15.46:0/363473775 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa438101900 0x7fa43819d690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 >> 172.21.15.46:0/363473775 conn(0x7fa4380fd600 msgr2=0x7fa4380fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 shutdown_connections 2024-09-21T12:56:28.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.259+0000 7fa43e44d640 1 -- 172.21.15.46:0/363473775 wait complete. 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.343+0000 7f8e238b8640 1 -- 172.21.15.46:0/1745600401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c106820 msgr2=0x7f8e1c106c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.343+0000 7f8e238b8640 1 --2- 172.21.15.46:0/1745600401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c106820 0x7f8e1c106c00 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009880 tx=0x7f8e1802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.343+0000 7f8e238b8640 1 -- 172.21.15.46:0/1745600401 shutdown_connections 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.343+0000 7f8e238b8640 1 --2- 172.21.15.46:0/1745600401 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c100820 0x7f8e1c100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.343+0000 7f8e238b8640 1 --2- 172.21.15.46:0/1745600401 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c106820 0x7f8e1c106c00 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.343+0000 7f8e238b8640 1 -- 172.21.15.46:0/1745600401 >> 172.21.15.46:0/1745600401 conn(0x7f8e1c0fc540 msgr2=0x7f8e1c0fe960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.344+0000 7f8e238b8640 1 -- 172.21.15.46:0/1745600401 shutdown_connections 2024-09-21T12:56:28.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.344+0000 7f8e238b8640 1 -- 172.21.15.46:0/1745600401 wait complete. 2024-09-21T12:56:28.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e238b8640 1 Processor -- start 2024-09-21T12:56:28.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e238b8640 1 -- start start 2024-09-21T12:56:28.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e238b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 0x7f8e1c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e238b8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c106820 0x7f8e1c198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e238b8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c10dcf0 con 0x7f8e1c100820 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e238b8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1c10db70 con 0x7f8e1c106820 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e21654640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 0x7f8e1c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e21654640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 0x7f8e1c198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48282/0 (socket says 172.21.15.46:48282) 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.345+0000 7f8e21654640 1 -- 172.21.15.46:0/2578720533 learned_addr learned my addr 172.21.15.46:0/2578720533 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e20e53640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c106820 0x7f8e1c198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e21654640 1 -- 172.21.15.46:0/2578720533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c106820 msgr2=0x7f8e1c198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e21654640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c106820 0x7f8e1c198d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e21654640 1 -- 172.21.15.46:0/2578720533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1c199380 con 0x7f8e1c100820 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e20e53640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c106820 0x7f8e1c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e21654640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 0x7f8e1c198840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e18031460 tx=0x7f8e180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e1803f070 con 0x7f8e1c100820 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8e180035f0 con 0x7f8e1c100820 2024-09-21T12:56:28.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1c199610 con 0x7f8e1c100820 2024-09-21T12:56:28.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e18035030 con 0x7f8e1c100820 2024-09-21T12:56:28.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.346+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1c1a1bc0 con 0x7f8e1c100820 2024-09-21T12:56:28.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.347+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1c101f60 con 0x7f8e1c100820 2024-09-21T12:56:28.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.348+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8e18042070 con 0x7f8e1c100820 2024-09-21T12:56:28.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.349+0000 7f8e127fc640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8e0807af80 0x7f8e0807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.349+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8e180be9c0 con 0x7f8e1c100820 2024-09-21T12:56:28.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.349+0000 7f8e20e53640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8e0807af80 0x7f8e0807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.349+0000 7f8e20e53640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8e0807af80 0x7f8e0807d440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c06ad00 tx=0x7f8e0c005e50 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:28.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.353+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8e18089f90 con 0x7f8e1c100820 2024-09-21T12:56:28.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.551+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8e1c062630 con 0x7f8e0807af80 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.561+0000 7f8e127fc640 1 -- 172.21.15.46:0/2578720533 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8e1c062630 con 0x7f8e0807af80 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (6m) 44s ago 17m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (9m) 44s ago 17m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (9m) 15s ago 16m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (4m) 44s ago 17m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (4m) 15s ago 16m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:56:28.562 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 44s ago 17m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (66s) 44s ago 12m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (49s) 44s ago 12m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (33s) 15s ago 12m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (18s) 15s ago 12m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (9m) 44s ago 18m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (8m) 15s ago 16m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (5m) 44s ago 18m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (5m) 15s ago 16m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (7m) 44s ago 17m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (7m) 15s ago 16m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 44s ago 15m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (3m) 44s ago 14m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:56:28.563 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 44s ago 14m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:56:28.564 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (2m) 15s ago 14m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:56:28.564 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (117s) 15s ago 13m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:56:28.564 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (83s) 15s ago 13m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:56:28.564 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (7m) 44s ago 17m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:56:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8e0807af80 msgr2=0x7f8e0807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8e0807af80 0x7f8e0807d440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c06ad00 tx=0x7f8e0c005e50 comp rx=0 tx=0).stop 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 msgr2=0x7f8e1c198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 0x7f8e1c198840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8e18031460 tx=0x7f8e180045e0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 shutdown_connections 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8e0807af80 0x7f8e0807d440 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8e1c106820 0x7f8e1c198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 --2- 172.21.15.46:0/2578720533 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8e1c100820 0x7f8e1c198840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 >> 172.21.15.46:0/2578720533 conn(0x7f8e1c0fc540 msgr2=0x7f8e1c0fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 shutdown_connections 2024-09-21T12:56:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.563+0000 7f8e238b8640 1 -- 172.21.15.46:0/2578720533 wait complete. 2024-09-21T12:56:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 -- 172.21.15.46:0/160640092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 msgr2=0x7fe2a0100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 --2- 172.21.15.46:0/160640092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a0100630 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe294009880 tx=0x7fe29402a530 comp rx=0 tx=0).stop 2024-09-21T12:56:28.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 -- 172.21.15.46:0/160640092 shutdown_connections 2024-09-21T12:56:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 --2- 172.21.15.46:0/160640092 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a0100630 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 --2- 172.21.15.46:0/160640092 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2a0107b00 0x7fe2a0107ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 -- 172.21.15.46:0/160640092 >> 172.21.15.46:0/160640092 conn(0x7fe2a00771e0 msgr2=0x7fe2a00775f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 -- 172.21.15.46:0/160640092 shutdown_connections 2024-09-21T12:56:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 -- 172.21.15.46:0/160640092 wait complete. 2024-09-21T12:56:28.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.647+0000 7fe2a5658640 1 Processor -- start 2024-09-21T12:56:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe2a5658640 1 -- start start 2024-09-21T12:56:28.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe2a5658640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe2a5658640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2a0107b00 0x7fe2a019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe2a5658640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a010ee40 con 0x7fe2a01001d0 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe2a5658640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a010ecc0 con 0x7fe2a0107b00 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48298/0 (socket says 172.21.15.46:48298) 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29effd640 1 -- 172.21.15.46:0/2446026716 learned_addr learned my addr 172.21.15.46:0/2446026716 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29e7fc640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2a0107b00 0x7fe2a019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29effd640 1 -- 172.21.15.46:0/2446026716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2a0107b00 msgr2=0x7fe2a019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29effd640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2a0107b00 0x7fe2a019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.648+0000 7fe29effd640 1 -- 172.21.15.46:0/2446026716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a01999b0 con 0x7fe2a01001d0 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.649+0000 7fe29effd640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a019f7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c8f0 tx=0x7fe29000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:28.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.649+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe2900079b0 con 0x7fe2a01001d0 2024-09-21T12:56:28.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.649+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe2900054e0 con 0x7fe2a01001d0 2024-09-21T12:56:28.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.649+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a0199ca0 con 0x7fe2a01001d0 2024-09-21T12:56:28.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.649+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe290004dd0 con 0x7fe2a01001d0 2024-09-21T12:56:28.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.649+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a019a200 con 0x7fe2a01001d0 2024-09-21T12:56:28.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.650+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a00697e0 con 0x7fe2a01001d0 2024-09-21T12:56:28.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.651+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe290005020 con 0x7fe2a01001d0 2024-09-21T12:56:28.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.651+0000 7fe287fff640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe28807aed0 0x7fe28807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:28.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.651+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe29009dfe0 con 0x7fe2a01001d0 2024-09-21T12:56:28.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.652+0000 7fe29e7fc640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe28807aed0 0x7fe28807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:28.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.652+0000 7fe29e7fc640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe28807aed0 0x7fe28807d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2a019b1a0 tx=0x7fe294031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:28.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.656+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe290014030 con 0x7fe2a01001d0 2024-09-21T12:56:28.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.918+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe2a019af80 con 0x7fe2a01001d0 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.919+0000 7fe287fff640 1 -- 172.21.15.46:0/2446026716 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe290069530 con 0x7fe2a01001d0 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:56:28.920 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:56:28.921 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:56:28.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe28807aed0 msgr2=0x7fe28807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe28807aed0 0x7fe28807d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe2a019b1a0 tx=0x7fe294031400 comp rx=0 tx=0).stop 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 msgr2=0x7fe2a019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a019f7f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe29000c8f0 tx=0x7fe29000cdb0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 shutdown_connections 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe28807aed0 0x7fe28807d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe2a0107b00 0x7fe2a019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 --2- 172.21.15.46:0/2446026716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe2a01001d0 0x7fe2a019f7f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.921+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 >> 172.21.15.46:0/2446026716 conn(0x7fe2a00771e0 msgr2=0x7fe2a00fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.922+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 shutdown_connections 2024-09-21T12:56:28.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:28.922+0000 7fe2a5658640 1 -- 172.21.15.46:0/2446026716 wait complete. 2024-09-21T12:56:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.005+0000 7f4e255a5640 1 -- 172.21.15.46:0/1850749699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 msgr2=0x7f4e20100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.005+0000 7f4e255a5640 1 --2- 172.21.15.46:0/1850749699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e20100c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4e14009880 tx=0x7f4e1402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 -- 172.21.15.46:0/1850749699 shutdown_connections 2024-09-21T12:56:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 --2- 172.21.15.46:0/1850749699 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e20100c50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 --2- 172.21.15.46:0/1850749699 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e201067f0 0x7f4e20106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 -- 172.21.15.46:0/1850749699 >> 172.21.15.46:0/1850749699 conn(0x7f4e200fc550 msgr2=0x7f4e200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 -- 172.21.15.46:0/1850749699 shutdown_connections 2024-09-21T12:56:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 -- 172.21.15.46:0/1850749699 wait complete. 2024-09-21T12:56:29.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 Processor -- start 2024-09-21T12:56:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.006+0000 7f4e255a5640 1 -- start start 2024-09-21T12:56:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e255a5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e2019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e255a5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e201067f0 0x7f4e2019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e255a5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2010dcc0 con 0x7f4e201007f0 2024-09-21T12:56:29.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e255a5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2010db40 con 0x7f4e201067f0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e2019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e2019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48328/0 (socket says 172.21.15.46:48328) 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 -- 172.21.15.46:0/651970075 learned_addr learned my addr 172.21.15.46:0/651970075 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 -- 172.21.15.46:0/651970075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e201067f0 msgr2=0x7f4e2019dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e201067f0 0x7f4e2019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 -- 172.21.15.46:0/651970075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e201977e0 con 0x7f4e201007f0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e1effd640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e2019d660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000ea00 tx=0x7f4e1000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.007+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e1000cb80 con 0x7f4e201007f0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.008+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e1000cd20 con 0x7f4e201007f0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.008+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e20197ad0 con 0x7f4e201007f0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.008+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e10011470 con 0x7f4e201007f0 2024-09-21T12:56:29.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.008+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e20198060 con 0x7f4e201007f0 2024-09-21T12:56:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.009+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e20101f30 con 0x7f4e201007f0 2024-09-21T12:56:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.009+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4e10005020 con 0x7f4e201007f0 2024-09-21T12:56:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.010+0000 7f4e07fff640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e0807af90 0x7f4e0807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.010+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4e1009e450 con 0x7f4e201007f0 2024-09-21T12:56:29.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.010+0000 7f4e1e7fc640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e0807af90 0x7f4e0807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.010+0000 7f4e1e7fc640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e0807af90 0x7f4e0807d450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e140096c0 tx=0x7f4e14000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:29.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.014+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e10016030 con 0x7f4e201007f0 2024-09-21T12:56:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.241+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4e20109d70 con 0x7f4e201007f0 2024-09-21T12:56:29.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.242+0000 7f4e07fff640 1 -- 172.21.15.46:0/651970075 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f4e10069a20 con 0x7f4e201007f0 2024-09-21T12:56:29.243 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:56:29.243 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:56:29.244 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:56:29.245 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:56:29.246 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:56:29.247 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:56:29.247 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:56:29.247 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e0807af90 msgr2=0x7f4e0807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e0807af90 0x7f4e0807d450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e140096c0 tx=0x7f4e14000bc0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 msgr2=0x7f4e2019d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e2019d660 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4e1000ea00 tx=0x7f4e1000eec0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 shutdown_connections 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4e0807af90 0x7f4e0807d450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e201067f0 0x7f4e2019dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 --2- 172.21.15.46:0/651970075 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e201007f0 0x7f4e2019d660 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 >> 172.21.15.46:0/651970075 conn(0x7f4e200fc550 msgr2=0x7f4e20069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 shutdown_connections 2024-09-21T12:56:29.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.244+0000 7f4e255a5640 1 -- 172.21.15.46:0/651970075 wait complete. 2024-09-21T12:56:29.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 -- 172.21.15.46:0/1625797869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 msgr2=0x7fde30100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 --2- 172.21.15.46:0/1625797869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde30100ab0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fde18009880 tx=0x7fde1802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 -- 172.21.15.46:0/1625797869 shutdown_connections 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 --2- 172.21.15.46:0/1625797869 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde30100ab0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 --2- 172.21.15.46:0/1625797869 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30106650 0x7fde30106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 -- 172.21.15.46:0/1625797869 >> 172.21.15.46:0/1625797869 conn(0x7fde300fc350 msgr2=0x7fde300fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 -- 172.21.15.46:0/1625797869 shutdown_connections 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.331+0000 7fde34f9f640 1 -- 172.21.15.46:0/1625797869 wait complete. 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde34f9f640 1 Processor -- start 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde34f9f640 1 -- start start 2024-09-21T12:56:29.334 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde34f9f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde3019f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde34f9f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30106650 0x7fde3019fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde34f9f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fde3010ca10 con 0x7fde30100650 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde34f9f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fde3010c890 con 0x7fde30106650 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde2f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde3019f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde2f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde3019f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48342/0 (socket says 172.21.15.46:48342) 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.332+0000 7fde2f7fe640 1 -- 172.21.15.46:0/3976531589 learned_addr learned my addr 172.21.15.46:0/3976531589 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde27fff640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30106650 0x7fde3019fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2f7fe640 1 -- 172.21.15.46:0/3976531589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30106650 msgr2=0x7fde3019fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2f7fe640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30106650 0x7fde3019fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2f7fe640 1 -- 172.21.15.46:0/3976531589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde301997e0 con 0x7fde30100650 2024-09-21T12:56:29.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2f7fe640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde3019f660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c8a0 tx=0x7fde2000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde200079b0 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fde20007b50 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde30199ad0 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fde20018700 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.333+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3019a030 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.334+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde30101d90 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.335+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fde20007d00 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.335+0000 7fde2d7fa640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fde1c07af80 0x7fde1c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.335+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fde2009e300 con 0x7fde30100650 2024-09-21T12:56:29.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.335+0000 7fde27fff640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fde1c07af80 0x7fde1c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.336+0000 7fde27fff640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fde1c07af80 0x7fde1c07d440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde3019ab30 tx=0x7fde18031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:29.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.340+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde20014030 con 0x7fde30100650 2024-09-21T12:56:29.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.545+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fde3019a340 con 0x7fde1c07af80 2024-09-21T12:56:29.546 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:29 smithi046 ceph-mon[108126]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:29.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:29 smithi046 ceph-mon[108126]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:29.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:29 smithi046 ceph-mon[108126]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:29.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2446026716' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:29.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/651970075' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:56:29.547 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:29.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.546+0000 7fde2d7fa640 1 -- 172.21.15.46:0/3976531589 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fde3019a340 con 0x7fde1c07af80 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:56:29.548 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fde1c07af80 msgr2=0x7fde1c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fde1c07af80 0x7fde1c07d440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde3019ab30 tx=0x7fde18031420 comp rx=0 tx=0).stop 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 msgr2=0x7fde3019f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde3019f660 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fde2000c8a0 tx=0x7fde2000cd60 comp rx=0 tx=0).stop 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 shutdown_connections 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fde1c07af80 0x7fde1c07d440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde30106650 0x7fde3019fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 --2- 172.21.15.46:0/3976531589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fde30100650 0x7fde3019f660 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 >> 172.21.15.46:0/3976531589 conn(0x7fde300fc350 msgr2=0x7fde300fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:29.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 shutdown_connections 2024-09-21T12:56:29.551 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.549+0000 7fde34f9f640 1 -- 172.21.15.46:0/3976531589 wait complete. 2024-09-21T12:56:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.632+0000 7f42f51ae640 1 -- 172.21.15.46:0/3130517183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 msgr2=0x7f42f0100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.632+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3130517183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f0100c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009880 tx=0x7f42e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 -- 172.21.15.46:0/3130517183 shutdown_connections 2024-09-21T12:56:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3130517183 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f0100c70 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3130517183 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f0106810 0x7f42f0106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 -- 172.21.15.46:0/3130517183 >> 172.21.15.46:0/3130517183 conn(0x7f42f00fc510 msgr2=0x7f42f00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 -- 172.21.15.46:0/3130517183 shutdown_connections 2024-09-21T12:56:29.635 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 -- 172.21.15.46:0/3130517183 wait complete. 2024-09-21T12:56:29.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.633+0000 7f42f51ae640 1 Processor -- start 2024-09-21T12:56:29.636 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42f51ae640 1 -- start start 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42f51ae640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f00fcba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42f51ae640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f0106810 0x7f42f00fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42f51ae640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42f010dce0 con 0x7f42f0100810 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42f51ae640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42f010db60 con 0x7f42f0106810 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f00fcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f00fcba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48364/0 (socket says 172.21.15.46:48364) 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 -- 172.21.15.46:0/3073020816 learned_addr learned my addr 172.21.15.46:0/3073020816 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42ee59c640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f0106810 0x7f42f00fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 -- 172.21.15.46:0/3073020816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f0106810 msgr2=0x7f42f00fd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f0106810 0x7f42f00fd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 -- 172.21.15.46:0/3073020816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f00fd620 con 0x7f42f0100810 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.634+0000 7f42eed9d640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f00fcba0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42e000d6f0 tx=0x7f42e000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:29.637 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.635+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42e0017070 con 0x7f42f0100810 2024-09-21T12:56:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.635+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f00fd910 con 0x7f42f0100810 2024-09-21T12:56:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.635+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42e000de00 con 0x7f42f0100810 2024-09-21T12:56:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.635+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42e0004bb0 con 0x7f42f0100810 2024-09-21T12:56:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.635+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f01a3e70 con 0x7f42f0100810 2024-09-21T12:56:29.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.636+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f0101f50 con 0x7f42f0100810 2024-09-21T12:56:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.636+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f42e0004e60 con 0x7f42f0100810 2024-09-21T12:56:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.637+0000 7f42d7fff640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42d807af30 0x7f42d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:56:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.637+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f42e009dd00 con 0x7f42f0100810 2024-09-21T12:56:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.637+0000 7f42ee59c640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42d807af30 0x7f42d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:56:29.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.637+0000 7f42ee59c640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42d807af30 0x7f42d807d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42f00fe630 tx=0x7f42e4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:56:29.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.641+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f42e00a1030 con 0x7f42f0100810 2024-09-21T12:56:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:29 smithi176 ceph-mon[80162]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:29 smithi176 ceph-mon[80162]: from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:29 smithi176 ceph-mon[80162]: from='client.34398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2446026716' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:56:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/651970075' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:56:29.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.903+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f42f0109d90 con 0x7f42f0100810 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.904+0000 7f42d7fff640 1 -- 172.21.15.46:0/3073020816 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f42e0069250 con 0x7f42f0100810 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:56:29.905 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:56:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42d807af30 msgr2=0x7f42d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42d807af30 0x7f42d807d3f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42f00fe630 tx=0x7f42e4031400 comp rx=0 tx=0).stop 2024-09-21T12:56:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 msgr2=0x7f42f00fcba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:56:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f00fcba0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42e000d6f0 tx=0x7f42e000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.907 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 shutdown_connections 2024-09-21T12:56:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f42d807af30 0x7f42d807d3f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42f0106810 0x7f42f00fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 --2- 172.21.15.46:0/3073020816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42f0100810 0x7f42f00fcba0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:56:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 >> 172.21.15.46:0/3073020816 conn(0x7f42f00fc510 msgr2=0x7f42f006a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:56:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 shutdown_connections 2024-09-21T12:56:29.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:56:29.906+0000 7f42f51ae640 1 -- 172.21.15.46:0/3073020816 wait complete. 2024-09-21T12:56:30.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:30 smithi046 ceph-mon[108126]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:30 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3073020816' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:56:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:30 smithi176 ceph-mon[80162]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:30 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3073020816' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:56:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:31 smithi046 ceph-mon[108126]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:31 smithi046 ceph-mon[108126]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:31 smithi176 ceph-mon[80162]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:31 smithi176 ceph-mon[80162]: from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:56:33.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:33 smithi046 ceph-mon[108126]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:33 smithi176 ceph-mon[80162]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:35 smithi046 ceph-mon[108126]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:35 smithi176 ceph-mon[80162]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:37.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:37 smithi046 ceph-mon[108126]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:37.805 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:37 smithi176 ceph-mon[80162]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:39.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:39 smithi046 ceph-mon[108126]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:39 smithi176 ceph-mon[80162]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:41 smithi046 ceph-mon[108126]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:41 smithi176 ceph-mon[80162]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:43 smithi046 ceph-mon[108126]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:43 smithi176 ceph-mon[80162]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:44.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:45.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:45 smithi046 ceph-mon[108126]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:45.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:45 smithi176 ceph-mon[80162]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:47 smithi046 ceph-mon[108126]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:47.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:47 smithi176 ceph-mon[80162]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:49.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:49 smithi046 ceph-mon[108126]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:49 smithi176 ceph-mon[80162]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:51 smithi176 ceph-mon[80162]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:51.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:51 smithi046 ceph-mon[108126]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:53 smithi176 ceph-mon[80162]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:53.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:53 smithi046 ceph-mon[108126]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:55 smithi176 ceph-mon[80162]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:55.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:55 smithi046 ceph-mon[108126]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:57.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:57 smithi176 ceph-mon[80162]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:57.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:57 smithi046 ceph-mon[108126]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:59 smithi176 ceph-mon[80162]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:56:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:56:59.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:59 smithi046 ceph-mon[108126]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:56:59.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:56:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.003+0000 7fd0d0a62640 1 -- 172.21.15.46:0/3511008523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074e30 msgr2=0x7fd0cc10dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.003+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/3511008523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074e30 0x7fd0cc10dc80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4009880 tx=0x7fd0b402a530 comp rx=0 tx=0).stop 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.003+0000 7fd0d0a62640 1 -- 172.21.15.46:0/3511008523 shutdown_connections 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.003+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/3511008523 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074e30 0x7fd0cc10dc80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.003+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/3511008523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074510 0x7fd0cc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.003+0000 7fd0d0a62640 1 -- 172.21.15.46:0/3511008523 >> 172.21.15.46:0/3511008523 conn(0x7fd0cc0fd600 msgr2=0x7fd0cc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.004+0000 7fd0d0a62640 1 -- 172.21.15.46:0/3511008523 shutdown_connections 2024-09-21T12:57:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.004+0000 7fd0d0a62640 1 -- 172.21.15.46:0/3511008523 wait complete. 2024-09-21T12:57:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.004+0000 7fd0d0a62640 1 Processor -- start 2024-09-21T12:57:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0d0a62640 1 -- start start 2024-09-21T12:57:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0d0a62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 0x7fd0cc19f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0d0a62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074e30 0x7fd0cc19fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.007 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0d0a62640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc110fc0 con 0x7fd0cc074510 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0d0a62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd0cc110e40 con 0x7fd0cc074e30 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0ca59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 0x7fd0cc19f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0ca59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 0x7fd0cc19f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47036/0 (socket says 172.21.15.46:47036) 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0ca59c640 1 -- 172.21.15.46:0/2113353193 learned_addr learned my addr 172.21.15.46:0/2113353193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0c1d9b640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074e30 0x7fd0cc19fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0ca59c640 1 -- 172.21.15.46:0/2113353193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074e30 msgr2=0x7fd0cc19fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0ca59c640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074e30 0x7fd0cc19fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.005+0000 7fd0ca59c640 1 -- 172.21.15.46:0/2113353193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0cc1a0400 con 0x7fd0cc074510 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0c1d9b640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074e30 0x7fd0cc19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0ca59c640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 0x7fd0cc19f810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c8a0 tx=0x7fd0bc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0bc0079b0 con 0x7fd0cc074510 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0cc199af0 con 0x7fd0cc074510 2024-09-21T12:57:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd0bc007b50 con 0x7fd0cc074510 2024-09-21T12:57:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd0bc018700 con 0x7fd0cc074510 2024-09-21T12:57:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.006+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0cc19a050 con 0x7fd0cc074510 2024-09-21T12:57:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.007+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0cc075c50 con 0x7fd0cc074510 2024-09-21T12:57:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.008+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd0bc007d00 con 0x7fd0cc074510 2024-09-21T12:57:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.008+0000 7fd0c3fff640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd0b807af40 0x7fd0b807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.009+0000 7fd0c1d9b640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd0b807af40 0x7fd0b807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.009+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd0bc09e460 con 0x7fd0cc074510 2024-09-21T12:57:00.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.009+0000 7fd0c1d9b640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd0b807af40 0x7fd0b807d400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc19b1c0 tx=0x7fd0b4031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.013+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0bc014030 con 0x7fd0cc074510 2024-09-21T12:57:00.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.224+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd0cc19b010 con 0x7fd0b807af40 2024-09-21T12:57:00.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.225+0000 7fd0c3fff640 1 -- 172.21.15.46:0/2113353193 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd0cc19b010 con 0x7fd0b807af40 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.227+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd0b807af40 msgr2=0x7fd0b807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.227+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd0b807af40 0x7fd0b807d400 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc19b1c0 tx=0x7fd0b4031420 comp rx=0 tx=0).stop 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.227+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 msgr2=0x7fd0cc19f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.227+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 0x7fd0cc19f810 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c8a0 tx=0x7fd0bc00cd60 comp rx=0 tx=0).stop 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 shutdown_connections 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd0b807af40 0x7fd0b807d400 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0cc074e30 0x7fd0cc19fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 --2- 172.21.15.46:0/2113353193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd0cc074510 0x7fd0cc19f810 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 >> 172.21.15.46:0/2113353193 conn(0x7fd0cc0fd600 msgr2=0x7fd0cc10b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 shutdown_connections 2024-09-21T12:57:00.230 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.228+0000 7fd0d0a62640 1 -- 172.21.15.46:0/2113353193 wait complete. 2024-09-21T12:57:00.238 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:57:00.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 -- 172.21.15.46:0/2919188534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 msgr2=0x7f0850102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 --2- 172.21.15.46:0/2919188534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f0850102ea0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0840009880 tx=0x7f084002a530 comp rx=0 tx=0).stop 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 -- 172.21.15.46:0/2919188534 shutdown_connections 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 --2- 172.21.15.46:0/2919188534 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08501033e0 0x7f085010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 --2- 172.21.15.46:0/2919188534 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f0850102ea0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 -- 172.21.15.46:0/2919188534 >> 172.21.15.46:0/2919188534 conn(0x7f08500fc520 msgr2=0x7f08500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 -- 172.21.15.46:0/2919188534 shutdown_connections 2024-09-21T12:57:00.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.313+0000 7f08549be640 1 -- 172.21.15.46:0/2919188534 wait complete. 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.314+0000 7f08549be640 1 Processor -- start 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.314+0000 7f08549be640 1 -- start start 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.314+0000 7f08549be640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f085019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.314+0000 7f08549be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08501033e0 0x7f085019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.314+0000 7f08549be640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f085010edf0 con 0x7f0850102ac0 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.314+0000 7f08549be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f085010ec70 con 0x7f08501033e0 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f085019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f085019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47064/0 (socket says 172.21.15.46:47064) 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 -- 172.21.15.46:0/32404582 learned_addr learned my addr 172.21.15.46:0/32404582 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f0845d9b640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08501033e0 0x7f085019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 -- 172.21.15.46:0/32404582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08501033e0 msgr2=0x7f085019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08501033e0 0x7f085019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 -- 172.21.15.46:0/32404582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08501977c0 con 0x7f0850102ac0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f084e59c640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f085019d640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0840031460 tx=0x7f08400045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f084003f070 con 0x7f0850102ac0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0850197a50 con 0x7f0850102ac0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08400035f0 con 0x7f0850102ac0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.315+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0840035030 con 0x7f0850102ac0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.316+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0850197f80 con 0x7f0850102ac0 2024-09-21T12:57:00.318 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.317+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f085006aa90 con 0x7f0850102ac0 2024-09-21T12:57:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.317+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0840042070 con 0x7f0850102ac0 2024-09-21T12:57:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.318+0000 7f0847fff640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083c07af80 0x7f083c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.319 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.318+0000 7f0845d9b640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083c07af80 0x7f083c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.318+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f08400be9d0 con 0x7f0850102ac0 2024-09-21T12:57:00.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.319+0000 7f0845d9b640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083c07af80 0x7f083c07d440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08380058c0 tx=0x7f0838005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.322+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0840089fa0 con 0x7f0850102ac0 2024-09-21T12:57:00.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.530+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08501981a0 con 0x7f083c07af80 2024-09-21T12:57:00.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.531+0000 7f0847fff640 1 -- 172.21.15.46:0/32404582 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f08501981a0 con 0x7f083c07af80 2024-09-21T12:57:00.534 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083c07af80 msgr2=0x7f083c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083c07af80 0x7f083c07d440 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f08380058c0 tx=0x7f0838005850 comp rx=0 tx=0).stop 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 msgr2=0x7f085019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f085019d640 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0840031460 tx=0x7f08400045e0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 shutdown_connections 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083c07af80 0x7f083c07d440 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08501033e0 0x7f085019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 --2- 172.21.15.46:0/32404582 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0850102ac0 0x7f085019d640 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.533+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 >> 172.21.15.46:0/32404582 conn(0x7f08500fc520 msgr2=0x7f085010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.534+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 shutdown_connections 2024-09-21T12:57:00.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.534+0000 7f08549be640 1 -- 172.21.15.46:0/32404582 wait complete. 2024-09-21T12:57:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.618+0000 7f002e7c8640 1 -- 172.21.15.46:0/3728564488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281007f0 msgr2=0x7f0028100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.618+0000 7f002e7c8640 1 --2- 172.21.15.46:0/3728564488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281007f0 0x7f0028100c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f001c009880 tx=0x7f001c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:00 smithi046 ceph-mon[108126]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:00.620 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:00 smithi046 ceph-mon[108126]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.618+0000 7f002e7c8640 1 -- 172.21.15.46:0/3728564488 shutdown_connections 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 --2- 172.21.15.46:0/3728564488 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281007f0 0x7f0028100c50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 --2- 172.21.15.46:0/3728564488 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00281067f0 0x7f0028106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 -- 172.21.15.46:0/3728564488 >> 172.21.15.46:0/3728564488 conn(0x7f00280fc550 msgr2=0x7f00280fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 -- 172.21.15.46:0/3728564488 shutdown_connections 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 -- 172.21.15.46:0/3728564488 wait complete. 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 Processor -- start 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.619+0000 7f002e7c8640 1 -- start start 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f002e7c8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00281007f0 0x7f002819d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f002e7c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 0x7f002819dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f002e7c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f002810dd20 con 0x7f00281067f0 2024-09-21T12:57:00.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f002e7c8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f002810dba0 con 0x7f00281007f0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 0x7f002819dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 0x7f002819dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47082/0 (socket says 172.21.15.46:47082) 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 -- 172.21.15.46:0/553573650 learned_addr learned my addr 172.21.15.46:0/553573650 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f0027fff640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00281007f0 0x7f002819d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 -- 172.21.15.46:0/553573650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00281007f0 msgr2=0x7f002819d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00281007f0 0x7f002819d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 -- 172.21.15.46:0/553573650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00281978d0 con 0x7f00281067f0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.620+0000 7f00277fe640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 0x7f002819dc50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f001c031460 tx=0x7f001c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.621+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f001c03f070 con 0x7f00281067f0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.621+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0028197b60 con 0x7f00281067f0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.621+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f001c004cf0 con 0x7f00281067f0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.621+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f001c035030 con 0x7f00281067f0 2024-09-21T12:57:00.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.621+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0028198090 con 0x7f00281067f0 2024-09-21T12:57:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.622+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0028101f30 con 0x7f00281067f0 2024-09-21T12:57:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.623+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f001c042070 con 0x7f00281067f0 2024-09-21T12:57:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.623+0000 7f00257fa640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f001007af30 0x7f001007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.623+0000 7f0027fff640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f001007af30 0x7f001007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.623+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f001c0bebb0 con 0x7f00281067f0 2024-09-21T12:57:00.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.624+0000 7f0027fff640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f001007af30 0x7f001007d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0028198a10 tx=0x7f0018008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.628+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f001c0c5080 con 0x7f00281067f0 2024-09-21T12:57:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:00 smithi176 ceph-mon[80162]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:00 smithi176 ceph-mon[80162]: from='client.34422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:00.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.822+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0028198e00 con 0x7f001007af30 2024-09-21T12:57:00.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.831+0000 7f00257fa640 1 -- 172.21.15.46:0/553573650 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0028198e00 con 0x7f001007af30 2024-09-21T12:57:00.832 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 76s ago 17m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (10m) 76s ago 18m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (10m) 47s ago 17m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 76s ago 18m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (5m) 47s ago 17m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (6m) 76s ago 17m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (98s) 76s ago 12m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (81s) 76s ago 12m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (65s) 47s ago 12m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (50s) 47s ago 12m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (9m) 76s ago 19m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (8m) 47s ago 17m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (5m) 76s ago 19m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:57:00.833 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (5m) 47s ago 17m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 76s ago 18m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (8m) 47s ago 17m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (4m) 76s ago 16m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 76s ago 15m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (3m) 76s ago 15m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (3m) 47s ago 14m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (2m) 47s ago 14m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (115s) 47s ago 13m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:57:00.834 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (7m) 76s ago 17m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f001007af30 msgr2=0x7f001007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f001007af30 0x7f001007d3f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0028198a10 tx=0x7f0018008040 comp rx=0 tx=0).stop 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 msgr2=0x7f002819dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 0x7f002819dc50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f001c031460 tx=0x7f001c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 shutdown_connections 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f001007af30 0x7f001007d3f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00281067f0 0x7f002819dc50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 --2- 172.21.15.46:0/553573650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00281007f0 0x7f002819d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.833+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 >> 172.21.15.46:0/553573650 conn(0x7f00280fc550 msgr2=0x7f0028069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.834+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 shutdown_connections 2024-09-21T12:57:00.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.834+0000 7f002e7c8640 1 -- 172.21.15.46:0/553573650 wait complete. 2024-09-21T12:57:00.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 -- 172.21.15.46:0/2684777542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601007f0 msgr2=0x7ffa60100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/2684777542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601007f0 0x7ffa60100c50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa48009880 tx=0x7ffa4802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 -- 172.21.15.46:0/2684777542 shutdown_connections 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/2684777542 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601007f0 0x7ffa60100c50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/2684777542 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa601067f0 0x7ffa60106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 -- 172.21.15.46:0/2684777542 >> 172.21.15.46:0/2684777542 conn(0x7ffa600fc550 msgr2=0x7ffa600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 -- 172.21.15.46:0/2684777542 shutdown_connections 2024-09-21T12:57:00.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.917+0000 7ffa64e8a640 1 -- 172.21.15.46:0/2684777542 wait complete. 2024-09-21T12:57:00.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa64e8a640 1 Processor -- start 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa64e8a640 1 -- start start 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa64e8a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa601007f0 0x7ffa6019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa64e8a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 0x7ffa6019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa64e8a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6010dcc0 con 0x7ffa601067f0 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa64e8a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6010db40 con 0x7ffa601007f0 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa5dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 0x7ffa6019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa5dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 0x7ffa6019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47088/0 (socket says 172.21.15.46:47088) 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.918+0000 7ffa5dd9b640 1 -- 172.21.15.46:0/715629193 learned_addr learned my addr 172.21.15.46:0/715629193 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa5e59c640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa601007f0 0x7ffa6019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa5dd9b640 1 -- 172.21.15.46:0/715629193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa601007f0 msgr2=0x7ffa6019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa5dd9b640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa601007f0 0x7ffa6019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa5dd9b640 1 -- 172.21.15.46:0/715629193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa601999b0 con 0x7ffa601067f0 2024-09-21T12:57:00.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa5dd9b640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 0x7ffa6019fd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa48031460 tx=0x7ffa48004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa4803f070 con 0x7ffa601067f0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffa480035f0 con 0x7ffa601067f0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa60199c40 con 0x7ffa601067f0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffa48035030 con 0x7ffa601067f0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.919+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6019a170 con 0x7ffa601067f0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.920+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa60101f30 con 0x7ffa601067f0 2024-09-21T12:57:00.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.921+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffa48042070 con 0x7ffa601067f0 2024-09-21T12:57:00.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.922+0000 7ffa577fe640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffa4c07af80 0x7ffa4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:00.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.922+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ffa480beff0 con 0x7ffa601067f0 2024-09-21T12:57:00.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.922+0000 7ffa5e59c640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffa4c07af80 0x7ffa4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:00.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.923+0000 7ffa5e59c640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffa4c07af80 0x7ffa4c07d440 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa6019aaf0 tx=0x7ffa58009500 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:00.927 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:00.926+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa4808a5c0 con 0x7ffa601067f0 2024-09-21T12:57:01.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.190+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ffa6019af40 con 0x7ffa601067f0 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.191+0000 7ffa577fe640 1 -- 172.21.15.46:0/715629193 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ffa4808f470 con 0x7ffa601067f0 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:57:01.192 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:57:01.193 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:57:01.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffa4c07af80 msgr2=0x7ffa4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffa4c07af80 0x7ffa4c07d440 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffa6019aaf0 tx=0x7ffa58009500 comp rx=0 tx=0).stop 2024-09-21T12:57:01.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 msgr2=0x7ffa6019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 0x7ffa6019fd30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa48031460 tx=0x7ffa48004530 comp rx=0 tx=0).stop 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 shutdown_connections 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffa4c07af80 0x7ffa4c07d440 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffa601067f0 0x7ffa6019fd30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 --2- 172.21.15.46:0/715629193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffa601007f0 0x7ffa6019f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 >> 172.21.15.46:0/715629193 conn(0x7ffa600fc550 msgr2=0x7ffa60069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 shutdown_connections 2024-09-21T12:57:01.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.194+0000 7ffa64e8a640 1 -- 172.21.15.46:0/715629193 wait complete. 2024-09-21T12:57:01.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 -- 172.21.15.46:0/1560343156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c106800 msgr2=0x7f534c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 --2- 172.21.15.46:0/1560343156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c106800 0x7f534c106be0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f533c009880 tx=0x7f533c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 -- 172.21.15.46:0/1560343156 shutdown_connections 2024-09-21T12:57:01.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 --2- 172.21.15.46:0/1560343156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f534c100800 0x7f534c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 --2- 172.21.15.46:0/1560343156 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c106800 0x7f534c106be0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 -- 172.21.15.46:0/1560343156 >> 172.21.15.46:0/1560343156 conn(0x7f534c0fc520 msgr2=0x7f534c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:01.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 -- 172.21.15.46:0/1560343156 shutdown_connections 2024-09-21T12:57:01.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.279+0000 7f535097e640 1 -- 172.21.15.46:0/1560343156 wait complete. 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f535097e640 1 Processor -- start 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f535097e640 1 -- start start 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f535097e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 0x7f534c107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f535097e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f534c106800 0x7f534c107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f535097e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f534c10dcb0 con 0x7f534c100800 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f535097e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f534c10db30 con 0x7f534c106800 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f534a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 0x7f534c107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f534a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 0x7f534c107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47112/0 (socket says 172.21.15.46:47112) 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f534a59c640 1 -- 172.21.15.46:0/1386408645 learned_addr learned my addr 172.21.15.46:0/1386408645 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.280+0000 7f5343fff640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f534c106800 0x7f534c107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f534a59c640 1 -- 172.21.15.46:0/1386408645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f534c106800 msgr2=0x7f534c107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f534a59c640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f534c106800 0x7f534c107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f534a59c640 1 -- 172.21.15.46:0/1386408645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c1081b0 con 0x7f534c100800 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f534a59c640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 0x7f534c107730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f533c031460 tx=0x7f533c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f533c03f070 con 0x7f534c100800 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f533c0035f0 con 0x7f534c100800 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c108440 con 0x7f534c100800 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f533c035030 con 0x7f534c100800 2024-09-21T12:57:01.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.281+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c1a3e10 con 0x7f534c100800 2024-09-21T12:57:01.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.282+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f534c101f40 con 0x7f534c100800 2024-09-21T12:57:01.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.283+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f533c042070 con 0x7f534c100800 2024-09-21T12:57:01.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.283+0000 7f53437fe640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f533807af80 0x7f533807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.283+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f533c0be910 con 0x7f534c100800 2024-09-21T12:57:01.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.283+0000 7f5343fff640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f533807af80 0x7f533807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.284+0000 7f5343fff640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f533807af80 0x7f533807d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f534c1091c0 tx=0x7f533400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:01.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.288+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f533c089ee0 con 0x7f534c100800 2024-09-21T12:57:01.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.513+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f534c1a4100 con 0x7f534c100800 2024-09-21T12:57:01.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:01 smithi046 ceph-mon[108126]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:01.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:01 smithi046 ceph-mon[108126]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:01.515 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:01 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/715629193' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:57:01.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.513+0000 7f53437fe640 1 -- 172.21.15.46:0/1386408645 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f533c08ed90 con 0x7f534c100800 2024-09-21T12:57:01.515 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:57:01.516 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:57:01.517 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:01.518 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:57:01.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f533807af80 msgr2=0x7f533807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f533807af80 0x7f533807d440 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f534c1091c0 tx=0x7f533400b390 comp rx=0 tx=0).stop 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 msgr2=0x7f534c107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 0x7f534c107730 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f533c031460 tx=0x7f533c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 shutdown_connections 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f533807af80 0x7f533807d440 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f534c106800 0x7f534c107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 --2- 172.21.15.46:0/1386408645 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f534c100800 0x7f534c107730 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 >> 172.21.15.46:0/1386408645 conn(0x7f534c0fc520 msgr2=0x7f534c06a330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 shutdown_connections 2024-09-21T12:57:01.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.517+0000 7f535097e640 1 -- 172.21.15.46:0/1386408645 wait complete. 2024-09-21T12:57:01.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 -- 172.21.15.46:0/3556974614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 msgr2=0x7f7714100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 --2- 172.21.15.46:0/3556974614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100220 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7704009880 tx=0x7f770402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 -- 172.21.15.46:0/3556974614 shutdown_connections 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 --2- 172.21.15.46:0/3556974614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100220 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 --2- 172.21.15.46:0/3556974614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77141069a0 0x7f7714106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 -- 172.21.15.46:0/3556974614 >> 172.21.15.46:0/3556974614 conn(0x7f77140fbc90 msgr2=0x7f77140fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 -- 172.21.15.46:0/3556974614 shutdown_connections 2024-09-21T12:57:01.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.603+0000 7f771c1be640 1 -- 172.21.15.46:0/3556974614 wait complete. 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f771c1be640 1 Processor -- start 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f771c1be640 1 -- start start 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f771c1be640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f771c1be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77141069a0 0x7f77141014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f771c1be640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f771410ef20 con 0x7f77140ffdc0 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f771c1be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f771410eda0 con 0x7f77141069a0 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f7719f5a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f7719f5a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47136/0 (socket says 172.21.15.46:47136) 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f7719f5a640 1 -- 172.21.15.46:0/490920470 learned_addr learned my addr 172.21.15.46:0/490920470 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.604+0000 7f7719759640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77141069a0 0x7f77141014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f7719f5a640 1 -- 172.21.15.46:0/490920470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77141069a0 msgr2=0x7f77141014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f7719f5a640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77141069a0 0x7f77141014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f7719f5a640 1 -- 172.21.15.46:0/490920470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7714101a20 con 0x7f77140ffdc0 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f7719f5a640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100fa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f771000cc60 tx=0x7f771000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f771000ce10 con 0x7f77140ffdc0 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f771000f910 con 0x7f77140ffdc0 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7714101d10 con 0x7f77140ffdc0 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7710018ae0 con 0x7f77140ffdc0 2024-09-21T12:57:01.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.605+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77141a3ed0 con 0x7f77140ffdc0 2024-09-21T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.606+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77141030e0 con 0x7f77140ffdc0 2024-09-21T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.607+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7710018c80 con 0x7f77140ffdc0 2024-09-21T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.607+0000 7f770affd640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f770007af80 0x7f770007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.608+0000 7f7719759640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f770007af80 0x7f770007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.608+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f771009e6e0 con 0x7f77140ffdc0 2024-09-21T12:57:01.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.608+0000 7f7719759640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f770007af80 0x7f770007d440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7714102a30 tx=0x7f7704031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:01.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.612+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7710014030 con 0x7f77140ffdc0 2024-09-21T12:57:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:01 smithi176 ceph-mon[80162]: from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:01 smithi176 ceph-mon[80162]: from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:01 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/715629193' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:57:01.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.818+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7714062630 con 0x7f770007af80 2024-09-21T12:57:01.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.819+0000 7f770affd640 1 -- 172.21.15.46:0/490920470 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7714062630 con 0x7f770007af80 2024-09-21T12:57:01.820 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:57:01.820 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:57:01.820 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:57:01.821 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f770007af80 msgr2=0x7f770007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f770007af80 0x7f770007d440 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7714102a30 tx=0x7f7704031420 comp rx=0 tx=0).stop 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 msgr2=0x7f7714100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100fa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f771000cc60 tx=0x7f771000a620 comp rx=0 tx=0).stop 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 shutdown_connections 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f770007af80 0x7f770007d440 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77141069a0 0x7f77141014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 --2- 172.21.15.46:0/490920470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f77140ffdc0 0x7f7714100fa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 >> 172.21.15.46:0/490920470 conn(0x7f77140fbc90 msgr2=0x7f77140fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 shutdown_connections 2024-09-21T12:57:01.823 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.821+0000 7f771c1be640 1 -- 172.21.15.46:0/490920470 wait complete. 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.906+0000 7fae6fd57640 1 -- 172.21.15.46:0/1459363267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 msgr2=0x7fae68100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.906+0000 7fae6fd57640 1 --2- 172.21.15.46:0/1459363267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae68100a30 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae64009880 tx=0x7fae6402a490 comp rx=0 tx=0).stop 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.906+0000 7fae6fd57640 1 -- 172.21.15.46:0/1459363267 shutdown_connections 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.906+0000 7fae6fd57640 1 --2- 172.21.15.46:0/1459363267 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae68101000 0x7fae6810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.906+0000 7fae6fd57640 1 --2- 172.21.15.46:0/1459363267 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae68100a30 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.906+0000 7fae6fd57640 1 -- 172.21.15.46:0/1459363267 >> 172.21.15.46:0/1459363267 conn(0x7fae680fc520 msgr2=0x7fae680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 -- 172.21.15.46:0/1459363267 shutdown_connections 2024-09-21T12:57:01.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 -- 172.21.15.46:0/1459363267 wait complete. 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 Processor -- start 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 -- start start 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae6819f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae68101000 0x7fae6819fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae68110f90 con 0x7fae68100650 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.907+0000 7fae6fd57640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae68110e10 con 0x7fae68101000 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae6819f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae6819f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:47156/0 (socket says 172.21.15.46:47156) 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 -- 172.21.15.46:0/10905099 learned_addr learned my addr 172.21.15.46:0/10905099 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:01.910 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6d2f2640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae68101000 0x7fae6819fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 -- 172.21.15.46:0/10905099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae68101000 msgr2=0x7fae6819fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae68101000 0x7fae6819fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 -- 172.21.15.46:0/10905099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae68199980 con 0x7fae68100650 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6daf3640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae6819f7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fae64031460 tx=0x7fae640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae6403f070 con 0x7fae68100650 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae68199c10 con 0x7fae68100650 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae64004cf0 con 0x7fae68100650 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae64035030 con 0x7fae68100650 2024-09-21T12:57:01.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.908+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae6819a1a0 con 0x7fae68100650 2024-09-21T12:57:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.910+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae6806aa90 con 0x7fae68100650 2024-09-21T12:57:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.910+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fae64042070 con 0x7fae68100650 2024-09-21T12:57:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.911+0000 7fae5effd640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae5407af30 0x7fae5407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.911+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fae640be790 con 0x7fae68100650 2024-09-21T12:57:01.912 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.911+0000 7fae6d2f2640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae5407af30 0x7fae5407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:01.913 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.911+0000 7fae6d2f2640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae5407af30 0x7fae5407d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fae68102530 tx=0x7fae5800a2d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:01.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:01.915+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae64089c40 con 0x7fae68100650 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.179+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fae6819aeb0 con 0x7fae68100650 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.180+0000 7fae5effd640 1 -- 172.21.15.46:0/10905099 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fae6408eaf0 con 0x7fae68100650 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:57:02.181 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:57:02.182 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:57:02.182 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:57:02.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae5407af30 msgr2=0x7fae5407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae5407af30 0x7fae5407d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fae68102530 tx=0x7fae5800a2d0 comp rx=0 tx=0).stop 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 msgr2=0x7fae6819f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae6819f7c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fae64031460 tx=0x7fae640048f0 comp rx=0 tx=0).stop 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 shutdown_connections 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae5407af30 0x7fae5407d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae68101000 0x7fae6819fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 --2- 172.21.15.46:0/10905099 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae68100650 0x7fae6819f7c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 >> 172.21.15.46:0/10905099 conn(0x7fae680fc520 msgr2=0x7fae680fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 shutdown_connections 2024-09-21T12:57:02.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:02.182+0000 7fae6fd57640 1 -- 172.21.15.46:0/10905099 wait complete. 2024-09-21T12:57:02.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:02 smithi176 ceph-mon[80162]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:02.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:02 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1386408645' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:57:02.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:02 smithi176 ceph-mon[80162]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:02.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:02 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/10905099' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:57:02.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:02 smithi046 ceph-mon[108126]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:02.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:02 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1386408645' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:57:02.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:02 smithi046 ceph-mon[108126]: from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:02.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:02 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/10905099' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:57:04.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:04 smithi176 ceph-mon[80162]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:04.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:04 smithi046 ceph-mon[108126]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:06.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:06 smithi176 ceph-mon[80162]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:06.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:06 smithi046 ceph-mon[108126]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:08.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:08 smithi176 ceph-mon[80162]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:08.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:08 smithi046 ceph-mon[108126]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:10 smithi176 ceph-mon[80162]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:10.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:10 smithi046 ceph-mon[108126]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:12 smithi176 ceph-mon[80162]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:12.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:12 smithi046 ceph-mon[108126]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:14 smithi176 ceph-mon[80162]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:14.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:14 smithi046 ceph-mon[108126]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:14.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:16.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:16 smithi176 ceph-mon[80162]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:16.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:16 smithi046 ceph-mon[108126]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:18.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:18 smithi046 ceph-mon[108126]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:18.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:18 smithi176 ceph-mon[80162]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:20.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:20 smithi176 ceph-mon[80162]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:20.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:20 smithi046 ceph-mon[108126]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:22.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:22 smithi176 ceph-mon[80162]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:22.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:22 smithi046 ceph-mon[108126]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:24.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:24 smithi176 ceph-mon[80162]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:24.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:24 smithi046 ceph-mon[108126]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:26.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:26 smithi176 ceph-mon[80162]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:26.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:26 smithi046 ceph-mon[108126]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:28.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:28 smithi176 ceph-mon[80162]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:28.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:28 smithi046 ceph-mon[108126]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:29.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:30 smithi176 ceph-mon[80162]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:30.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:30 smithi046 ceph-mon[108126]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:32.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.280+0000 7fa46c267640 1 -- 172.21.15.46:0/3935638875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 msgr2=0x7fa464103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.280+0000 7fa46c267640 1 --2- 172.21.15.46:0/3935638875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa464103f60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa454009880 tx=0x7fa45402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.280+0000 7fa46c267640 1 -- 172.21.15.46:0/3935638875 shutdown_connections 2024-09-21T12:57:32.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 --2- 172.21.15.46:0/3935638875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa464103f60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 --2- 172.21.15.46:0/3935638875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa464109b90 0x7fa464109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 -- 172.21.15.46:0/3935638875 >> 172.21.15.46:0/3935638875 conn(0x7fa4640ff800 msgr2=0x7fa464101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 -- 172.21.15.46:0/3935638875 shutdown_connections 2024-09-21T12:57:32.284 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 -- 172.21.15.46:0/3935638875 wait complete. 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 Processor -- start 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.281+0000 7fa46c267640 1 -- start start 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46c267640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa46419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46c267640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa464109b90 0x7fa46419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46c267640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa464110fd0 con 0x7fa464103b00 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46c267640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa464110e50 con 0x7fa464109b90 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46a003640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa46419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46a003640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa46419f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40040/0 (socket says 172.21.15.46:40040) 2024-09-21T12:57:32.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46a003640 1 -- 172.21.15.46:0/2454209868 learned_addr learned my addr 172.21.15.46:0/2454209868 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa469802640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa464109b90 0x7fa46419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46a003640 1 -- 172.21.15.46:0/2454209868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa464109b90 msgr2=0x7fa46419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46a003640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa464109b90 0x7fa46419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.282+0000 7fa46a003640 1 -- 172.21.15.46:0/2454209868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa464199a00 con 0x7fa464103b00 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.283+0000 7fa46a003640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa46419f840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa46000d6f0 tx=0x7fa46000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.283+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa460017070 con 0x7fa464103b00 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.283+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa46000de00 con 0x7fa464103b00 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.283+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa464199cf0 con 0x7fa464103b00 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.283+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa460004bb0 con 0x7fa464103b00 2024-09-21T12:57:32.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.283+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46419a250 con 0x7fa464103b00 2024-09-21T12:57:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.284+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa464105200 con 0x7fa464103b00 2024-09-21T12:57:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.285+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa460010460 con 0x7fa464103b00 2024-09-21T12:57:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.285+0000 7fa45b7fe640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa45007af40 0x7fa45007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.286+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa46009dce0 con 0x7fa464103b00 2024-09-21T12:57:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.286+0000 7fa469802640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa45007af40 0x7fa45007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.286+0000 7fa469802640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa45007af40 0x7fa45007d400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa46419b1f0 tx=0x7fa454031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:32.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.290+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa460069230 con 0x7fa464103b00 2024-09-21T12:57:32.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.499+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa46419af30 con 0x7fa45007af40 2024-09-21T12:57:32.503 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.501+0000 7fa45b7fe640 1 -- 172.21.15.46:0/2454209868 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa46419af30 con 0x7fa45007af40 2024-09-21T12:57:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa45007af40 msgr2=0x7fa45007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa45007af40 0x7fa45007d400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa46419b1f0 tx=0x7fa454031400 comp rx=0 tx=0).stop 2024-09-21T12:57:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 msgr2=0x7fa46419f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa46419f840 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fa46000d6f0 tx=0x7fa46000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.505 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 shutdown_connections 2024-09-21T12:57:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa45007af40 0x7fa45007d400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa464109b90 0x7fa46419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 --2- 172.21.15.46:0/2454209868 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa464103b00 0x7fa46419f840 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 >> 172.21.15.46:0/2454209868 conn(0x7fa4640ff800 msgr2=0x7fa464100190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 shutdown_connections 2024-09-21T12:57:32.506 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.503+0000 7fa46c267640 1 -- 172.21.15.46:0/2454209868 wait complete. 2024-09-21T12:57:32.514 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 -- 172.21.15.46:0/4158424723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c107900 msgr2=0x7f802c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 --2- 172.21.15.46:0/4158424723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c107900 0x7f802c107ce0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8028009880 tx=0x7f802802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 -- 172.21.15.46:0/4158424723 shutdown_connections 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 --2- 172.21.15.46:0/4158424723 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c101900 0x7f802c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 --2- 172.21.15.46:0/4158424723 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c107900 0x7f802c107ce0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 -- 172.21.15.46:0/4158424723 >> 172.21.15.46:0/4158424723 conn(0x7f802c0fd600 msgr2=0x7f802c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 -- 172.21.15.46:0/4158424723 shutdown_connections 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.589+0000 7f8033a70640 1 -- 172.21.15.46:0/4158424723 wait complete. 2024-09-21T12:57:32.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f8033a70640 1 Processor -- start 2024-09-21T12:57:32.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f8033a70640 1 -- start start 2024-09-21T12:57:32.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f8033a70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 0x7f802c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f8033a70640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c107900 0x7f802c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f8033a70640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f802c10edd0 con 0x7f802c101900 2024-09-21T12:57:32.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f8033a70640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f802c10ec50 con 0x7f802c107900 2024-09-21T12:57:32.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f803180c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 0x7f802c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f803180c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 0x7f802c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40054/0 (socket says 172.21.15.46:40054) 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.590+0000 7f803180c640 1 -- 172.21.15.46:0/718436910 learned_addr learned my addr 172.21.15.46:0/718436910 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f803100b640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c107900 0x7f802c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f803180c640 1 -- 172.21.15.46:0/718436910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c107900 msgr2=0x7f802c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f803180c640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c107900 0x7f802c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f803180c640 1 -- 172.21.15.46:0/718436910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f802c074f70 con 0x7f802c101900 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f803100b640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c107900 0x7f802c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f803180c640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 0x7f802c0744f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8028031460 tx=0x7f80280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f802803f070 con 0x7f802c101900 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f802c075200 con 0x7f802c101900 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8028004cf0 con 0x7f802c101900 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8028035030 con 0x7f802c101900 2024-09-21T12:57:32.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.591+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f802c1a3e00 con 0x7f802c101900 2024-09-21T12:57:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.592+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f802c103040 con 0x7f802c101900 2024-09-21T12:57:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.593+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8028042070 con 0x7f802c101900 2024-09-21T12:57:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.593+0000 7f8022ffd640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f801807af30 0x7f801807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.594+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f80280beb70 con 0x7f802c101900 2024-09-21T12:57:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.594+0000 7f803100b640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f801807af30 0x7f801807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.594+0000 7f803100b640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f801807af30 0x7f801807d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f802c075f80 tx=0x7f801c005d30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:32.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.598+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f802808a0c0 con 0x7f802c101900 2024-09-21T12:57:32.810 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.808+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f802c062630 con 0x7f801807af30 2024-09-21T12:57:32.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.809+0000 7f8022ffd640 1 -- 172.21.15.46:0/718436910 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f802c062630 con 0x7f801807af30 2024-09-21T12:57:32.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f801807af30 msgr2=0x7f801807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f801807af30 0x7f801807d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f802c075f80 tx=0x7f801c005d30 comp rx=0 tx=0).stop 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 msgr2=0x7f802c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 0x7f802c0744f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8028031460 tx=0x7f80280048f0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 shutdown_connections 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f801807af30 0x7f801807d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f802c107900 0x7f802c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 --2- 172.21.15.46:0/718436910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f802c101900 0x7f802c0744f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.811+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 >> 172.21.15.46:0/718436910 conn(0x7f802c0fd600 msgr2=0x7f802c0fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.812+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 shutdown_connections 2024-09-21T12:57:32.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.812+0000 7f8033a70640 1 -- 172.21.15.46:0/718436910 wait complete. 2024-09-21T12:57:32.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.896+0000 7fa718d26640 1 -- 172.21.15.46:0/2060718556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714107900 msgr2=0x7fa714107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.896+0000 7fa718d26640 1 --2- 172.21.15.46:0/2060718556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714107900 0x7fa714107ce0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa704009880 tx=0x7fa70402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.899 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:32 smithi046 ceph-mon[108126]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.897+0000 7fa718d26640 1 -- 172.21.15.46:0/2060718556 shutdown_connections 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.897+0000 7fa718d26640 1 --2- 172.21.15.46:0/2060718556 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa714101900 0x7fa714101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.897+0000 7fa718d26640 1 --2- 172.21.15.46:0/2060718556 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714107900 0x7fa714107ce0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.897+0000 7fa718d26640 1 -- 172.21.15.46:0/2060718556 >> 172.21.15.46:0/2060718556 conn(0x7fa7140fd600 msgr2=0x7fa7140ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.897+0000 7fa718d26640 1 -- 172.21.15.46:0/2060718556 shutdown_connections 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.897+0000 7fa718d26640 1 -- 172.21.15.46:0/2060718556 wait complete. 2024-09-21T12:57:32.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa718d26640 1 Processor -- start 2024-09-21T12:57:32.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa718d26640 1 -- start start 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa718d26640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 0x7fa7140744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa718d26640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa714107900 0x7fa714074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa718d26640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa71410edd0 con 0x7fa714101900 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa718d26640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa71410ec50 con 0x7fa714107900 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa71259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 0x7fa7140744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa71259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 0x7fa7140744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40068/0 (socket says 172.21.15.46:40068) 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa71259c640 1 -- 172.21.15.46:0/365987847 learned_addr learned my addr 172.21.15.46:0/365987847 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:32.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.898+0000 7fa711d9b640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa714107900 0x7fa714074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa71259c640 1 -- 172.21.15.46:0/365987847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa714107900 msgr2=0x7fa714074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa71259c640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa714107900 0x7fa714074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa71259c640 1 -- 172.21.15.46:0/365987847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa714074f70 con 0x7fa714101900 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa71259c640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 0x7fa7140744f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa704031460 tx=0x7fa7040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa70403f070 con 0x7fa714101900 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7040035f0 con 0x7fa714101900 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa714075200 con 0x7fa714101900 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa704035030 con 0x7fa714101900 2024-09-21T12:57:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.899+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7141a3d60 con 0x7fa714101900 2024-09-21T12:57:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.900+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa714103040 con 0x7fa714101900 2024-09-21T12:57:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.901+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa704042070 con 0x7fa714101900 2024-09-21T12:57:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.902+0000 7fa7037fe640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa6fc07af80 0x7fa6fc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.902+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa7040be9b0 con 0x7fa714101900 2024-09-21T12:57:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.902+0000 7fa711d9b640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa6fc07af80 0x7fa6fc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.902+0000 7fa711d9b640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa6fc07af80 0x7fa6fc07d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa714075f80 tx=0x7fa70800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:32.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:32.906+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa704089ee0 con 0x7fa714101900 2024-09-21T12:57:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:32 smithi176 ceph-mon[80162]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:33.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.102+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa714062630 con 0x7fa6fc07af80 2024-09-21T12:57:33.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.111+0000 7fa7037fe640 1 -- 172.21.15.46:0/365987847 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa714062630 con 0x7fa6fc07af80 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (7m) 108s ago 18m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (10m) 108s ago 18m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (10m) 79s ago 17m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (5m) 108s ago 18m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (5m) 79s ago 17m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 108s ago 18m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (2m) 108s ago 13m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (114s) 108s ago 13m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (98s) 79s ago 13m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (83s) 79s ago 13m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:57:33.114 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (10m) 108s ago 19m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (9m) 79s ago 17m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (6m) 108s ago 20m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (6m) 79s ago 17m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (8m) 108s ago 18m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (8m) 79s ago 17m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 108s ago 16m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (4m) 108s ago 16m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 108s ago 15m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (3m) 79s ago 15m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (3m) 79s ago 14m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (2m) 79s ago 14m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:57:33.115 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (8m) 108s ago 18m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:57:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa6fc07af80 msgr2=0x7fa6fc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa6fc07af80 0x7fa6fc07d440 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa714075f80 tx=0x7fa70800b390 comp rx=0 tx=0).stop 2024-09-21T12:57:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 msgr2=0x7fa7140744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 0x7fa7140744f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa704031460 tx=0x7fa7040045e0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 shutdown_connections 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa6fc07af80 0x7fa6fc07d440 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa714107900 0x7fa714074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 --2- 172.21.15.46:0/365987847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa714101900 0x7fa7140744f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 >> 172.21.15.46:0/365987847 conn(0x7fa7140fd600 msgr2=0x7fa7140fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 shutdown_connections 2024-09-21T12:57:33.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.114+0000 7fa718d26640 1 -- 172.21.15.46:0/365987847 wait complete. 2024-09-21T12:57:33.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.202+0000 7efedf8d5640 1 -- 172.21.15.46:0/1223633908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074e30 msgr2=0x7efed810dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.202+0000 7efedf8d5640 1 --2- 172.21.15.46:0/1223633908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074e30 0x7efed810dc80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efecc009880 tx=0x7efecc02a530 comp rx=0 tx=0).stop 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.202+0000 7efedf8d5640 1 -- 172.21.15.46:0/1223633908 shutdown_connections 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.202+0000 7efedf8d5640 1 --2- 172.21.15.46:0/1223633908 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074e30 0x7efed810dc80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.202+0000 7efedf8d5640 1 --2- 172.21.15.46:0/1223633908 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efed8074510 0x7efed80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.202+0000 7efedf8d5640 1 -- 172.21.15.46:0/1223633908 >> 172.21.15.46:0/1223633908 conn(0x7efed80fd600 msgr2=0x7efed80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 -- 172.21.15.46:0/1223633908 shutdown_connections 2024-09-21T12:57:33.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 -- 172.21.15.46:0/1223633908 wait complete. 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 Processor -- start 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 -- start start 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 0x7efed819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efed8074e30 0x7efed819fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efed8110fe0 con 0x7efed8074510 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.203+0000 7efedf8d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efed8110e60 con 0x7efed8074e30 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 0x7efed819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 0x7efed819f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40088/0 (socket says 172.21.15.46:40088) 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 -- 172.21.15.46:0/3703621470 learned_addr learned my addr 172.21.15.46:0/3703621470 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedce70640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efed8074e30 0x7efed819fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 -- 172.21.15.46:0/3703621470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efed8074e30 msgr2=0x7efed819fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efed8074e30 0x7efed819fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 -- 172.21.15.46:0/3703621470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efed8199a90 con 0x7efed8074510 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedd671640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 0x7efed819f8d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efed400e970 tx=0x7efed400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed400cac0 con 0x7efed8074510 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efed40054e0 con 0x7efed8074510 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efed8199d80 con 0x7efed8074510 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efed4010430 con 0x7efed8074510 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.204+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efed819a2e0 con 0x7efed8074510 2024-09-21T12:57:33.208 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.205+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efed8075c50 con 0x7efed8074510 2024-09-21T12:57:33.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.206+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efed4004f00 con 0x7efed8074510 2024-09-21T12:57:33.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.207+0000 7efeca7fc640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efec407af80 0x7efec407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.207+0000 7efedce70640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efec407af80 0x7efec407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.207+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efed409e6f0 con 0x7efed8074510 2024-09-21T12:57:33.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.208+0000 7efedce70640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efec407af80 0x7efec407d440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efed819b280 tx=0x7efecc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:33.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.212+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efed4069c20 con 0x7efed8074510 2024-09-21T12:57:33.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.476+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7efed819afc0 con 0x7efed8074510 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.477+0000 7efeca7fc640 1 -- 172.21.15.46:0/3703621470 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7efed406ead0 con 0x7efed8074510 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:33.479 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:57:33.480 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:57:33.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efec407af80 msgr2=0x7efec407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efec407af80 0x7efec407d440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efed819b280 tx=0x7efecc031400 comp rx=0 tx=0).stop 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 msgr2=0x7efed819f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 0x7efed819f8d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efed400e970 tx=0x7efed400ed70 comp rx=0 tx=0).stop 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 shutdown_connections 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efec407af80 0x7efec407d440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efed8074e30 0x7efed819fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 --2- 172.21.15.46:0/3703621470 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efed8074510 0x7efed819f8d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 >> 172.21.15.46:0/3703621470 conn(0x7efed80fd600 msgr2=0x7efed810b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 shutdown_connections 2024-09-21T12:57:33.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.479+0000 7efedf8d5640 1 -- 172.21.15.46:0/3703621470 wait complete. 2024-09-21T12:57:33.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.564+0000 7f3fda441640 1 -- 172.21.15.46:0/3080915020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4107900 msgr2=0x7f3fd4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 --2- 172.21.15.46:0/3080915020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4107900 0x7f3fd4107ce0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4009880 tx=0x7f3fc402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 -- 172.21.15.46:0/3080915020 shutdown_connections 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 --2- 172.21.15.46:0/3080915020 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fd4101900 0x7f3fd4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 --2- 172.21.15.46:0/3080915020 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4107900 0x7f3fd4107ce0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 -- 172.21.15.46:0/3080915020 >> 172.21.15.46:0/3080915020 conn(0x7f3fd40fd600 msgr2=0x7f3fd40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 -- 172.21.15.46:0/3080915020 shutdown_connections 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 -- 172.21.15.46:0/3080915020 wait complete. 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 Processor -- start 2024-09-21T12:57:33.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.565+0000 7f3fda441640 1 -- start start 2024-09-21T12:57:33.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fda441640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 0x7f3fd40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fda441640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fd4107900 0x7f3fd4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fda441640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd410edd0 con 0x7f3fd4101900 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fda441640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3fd410ec50 con 0x7f3fd4107900 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 0x7f3fd40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 0x7f3fd40744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40108/0 (socket says 172.21.15.46:40108) 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 -- 172.21.15.46:0/1689133370 learned_addr learned my addr 172.21.15.46:0/1689133370 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd37fe640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fd4107900 0x7f3fd4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 -- 172.21.15.46:0/1689133370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fd4107900 msgr2=0x7f3fd4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fd4107900 0x7f3fd4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 -- 172.21.15.46:0/1689133370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd4074f70 con 0x7f3fd4101900 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd3fff640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 0x7f3fd40744f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4031460 tx=0x7f3fc40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:33.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.566+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fc403f070 con 0x7f3fd4101900 2024-09-21T12:57:33.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.567+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3fc40035f0 con 0x7f3fd4101900 2024-09-21T12:57:33.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.567+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd4075200 con 0x7f3fd4101900 2024-09-21T12:57:33.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.567+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3fc4035030 con 0x7f3fd4101900 2024-09-21T12:57:33.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.567+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fd41a3d60 con 0x7f3fd4101900 2024-09-21T12:57:33.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.568+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fd4103040 con 0x7f3fd4101900 2024-09-21T12:57:33.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.568+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3fc4042070 con 0x7f3fd4101900 2024-09-21T12:57:33.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.569+0000 7f3fd17fa640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3fbc07af30 0x7f3fbc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.569+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3fc40bea20 con 0x7f3fd4101900 2024-09-21T12:57:33.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.569+0000 7f3fd37fe640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3fbc07af30 0x7f3fbc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.569+0000 7f3fd37fe640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3fbc07af30 0x7f3fbc07d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4075f80 tx=0x7f3fc800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:33.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.573+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3fc4089f70 con 0x7f3fd4101900 2024-09-21T12:57:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.804+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3fd402d7c0 con 0x7f3fd4101900 2024-09-21T12:57:33.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.805+0000 7f3fd17fa640 1 -- 172.21.15.46:0/1689133370 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f3fc408ee20 con 0x7f3fd4101900 2024-09-21T12:57:33.807 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:57:33.807 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:57:33.807 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:57:33.808 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:57:33.809 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:33.810 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3fbc07af30 msgr2=0x7f3fbc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3fbc07af30 0x7f3fbc07d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4075f80 tx=0x7f3fc800b390 comp rx=0 tx=0).stop 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 msgr2=0x7f3fd40744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 0x7f3fd40744f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4031460 tx=0x7f3fc40045e0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 shutdown_connections 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3fbc07af30 0x7f3fbc07d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3fd4107900 0x7f3fd4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 --2- 172.21.15.46:0/1689133370 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3fd4101900 0x7f3fd40744f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 >> 172.21.15.46:0/1689133370 conn(0x7f3fd40fd600 msgr2=0x7f3fd40fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 shutdown_connections 2024-09-21T12:57:33.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.807+0000 7f3fda441640 1 -- 172.21.15.46:0/1689133370 wait complete. 2024-09-21T12:57:33.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 -- 172.21.15.46:0/947537683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f80ffdc0 msgr2=0x7f65f8100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 --2- 172.21.15.46:0/947537683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f80ffdc0 0x7f65f8100220 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009880 tx=0x7f65e802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 -- 172.21.15.46:0/947537683 shutdown_connections 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 --2- 172.21.15.46:0/947537683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f80ffdc0 0x7f65f8100220 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 --2- 172.21.15.46:0/947537683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f81069a0 0x7f65f8106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 -- 172.21.15.46:0/947537683 >> 172.21.15.46:0/947537683 conn(0x7f65f80fbc90 msgr2=0x7f65f80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 -- 172.21.15.46:0/947537683 shutdown_connections 2024-09-21T12:57:33.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.892+0000 7f65ffb62640 1 -- 172.21.15.46:0/947537683 wait complete. 2024-09-21T12:57:33.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65ffb62640 1 Processor -- start 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65ffb62640 1 -- start start 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65ffb62640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f80ffdc0 0x7f65f8100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65ffb62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 0x7f65f81014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65ffb62640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f65f810ef20 con 0x7f65f81069a0 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65ffb62640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f65f810eda0 con 0x7f65f80ffdc0 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65fd0fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 0x7f65f81014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65fd0fd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 0x7f65f81014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40120/0 (socket says 172.21.15.46:40120) 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65fd0fd640 1 -- 172.21.15.46:0/1396515641 learned_addr learned my addr 172.21.15.46:0/1396515641 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.893+0000 7f65fd8fe640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f80ffdc0 0x7f65f8100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65fd0fd640 1 -- 172.21.15.46:0/1396515641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f80ffdc0 msgr2=0x7f65f8100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65fd0fd640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f80ffdc0 0x7f65f8100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:33.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65fd0fd640 1 -- 172.21.15.46:0/1396515641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f8101a20 con 0x7f65f81069a0 2024-09-21T12:57:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65fd0fd640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 0x7f65f81014e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f65e8031460 tx=0x7f65e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65e803f070 con 0x7f65f81069a0 2024-09-21T12:57:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65e8004b10 con 0x7f65f81069a0 2024-09-21T12:57:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65e8035030 con 0x7f65f81069a0 2024-09-21T12:57:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f8101cb0 con 0x7f65f81069a0 2024-09-21T12:57:33.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.894+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81a3e70 con 0x7f65f81069a0 2024-09-21T12:57:33.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.895+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f81030e0 con 0x7f65f81069a0 2024-09-21T12:57:33.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.896+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f65e8042070 con 0x7f65f81069a0 2024-09-21T12:57:33.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.896+0000 7f65eeffd640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f65e407af90 0x7f65e407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:33.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.896+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f65e80beb30 con 0x7f65f81069a0 2024-09-21T12:57:33.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.896+0000 7f65fd8fe640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f65e407af90 0x7f65e407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:33.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.897+0000 7f65fd8fe640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f65e407af90 0x7f65e407d450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005fd0 tx=0x7f65f400b590 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:33.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:33.901+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65e808a100 con 0x7f65f81069a0 2024-09-21T12:57:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:33 smithi176 ceph-mon[80162]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:33 smithi176 ceph-mon[80162]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:33 smithi176 ceph-mon[80162]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:33 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3703621470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:57:34.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.105+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f65f8062630 con 0x7f65e407af90 2024-09-21T12:57:34.108 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:33 smithi046 ceph-mon[108126]: from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:34.108 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:33 smithi046 ceph-mon[108126]: from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:34.108 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:33 smithi046 ceph-mon[108126]: from='client.34458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:34.109 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:33 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3703621470' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:57:34.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.107+0000 7f65eeffd640 1 -- 172.21.15.46:0/1396515641 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f65f8062630 con 0x7f65e407af90 2024-09-21T12:57:34.109 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:57:34.110 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:57:34.110 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:57:34.110 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:57:34.110 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:57:34.110 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:57:34.110 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:57:34.111 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:57:34.112 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f65e407af90 msgr2=0x7f65e407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f65e407af90 0x7f65e407d450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65f4005fd0 tx=0x7f65f400b590 comp rx=0 tx=0).stop 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 msgr2=0x7f65f81014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 0x7f65f81014e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f65e8031460 tx=0x7f65e80045e0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 shutdown_connections 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f65e407af90 0x7f65e407d450 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65f81069a0 0x7f65f81014e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 --2- 172.21.15.46:0/1396515641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65f80ffdc0 0x7f65f8100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 >> 172.21.15.46:0/1396515641 conn(0x7f65f80fbc90 msgr2=0x7f65f80fc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:34.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 shutdown_connections 2024-09-21T12:57:34.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.109+0000 7f65ffb62640 1 -- 172.21.15.46:0/1396515641 wait complete. 2024-09-21T12:57:34.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 -- 172.21.15.46:0/3011087080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840ffdc0 msgr2=0x7fb284100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:34.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 --2- 172.21.15.46:0/3011087080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840ffdc0 0x7fb284100220 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb278009880 tx=0x7fb27802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 -- 172.21.15.46:0/3011087080 shutdown_connections 2024-09-21T12:57:34.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 --2- 172.21.15.46:0/3011087080 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2840ffdc0 0x7fb284100220 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 --2- 172.21.15.46:0/3011087080 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2841069a0 0x7fb284106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 -- 172.21.15.46:0/3011087080 >> 172.21.15.46:0/3011087080 conn(0x7fb2840fbc90 msgr2=0x7fb2840fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:34.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 -- 172.21.15.46:0/3011087080 shutdown_connections 2024-09-21T12:57:34.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.193+0000 7fb28a093640 1 -- 172.21.15.46:0/3011087080 wait complete. 2024-09-21T12:57:34.198 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.194+0000 7fb28a093640 1 Processor -- start 2024-09-21T12:57:34.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.194+0000 7fb28a093640 1 -- start start 2024-09-21T12:57:34.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.194+0000 7fb28a093640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840ffdc0 0x7fb28419f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:34.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.194+0000 7fb28a093640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 0x7fb28419fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.194+0000 7fb28a093640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb28410ef20 con 0x7fb2841069a0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.194+0000 7fb28a093640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb28410eda0 con 0x7fb2840ffdc0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 0x7fb28419fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 0x7fb28419fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40136/0 (socket says 172.21.15.46:40136) 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 -- 172.21.15.46:0/468753814 learned_addr learned my addr 172.21.15.46:0/468753814 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb2837fe640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840ffdc0 0x7fb28419f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 -- 172.21.15.46:0/468753814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840ffdc0 msgr2=0x7fb28419f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840ffdc0 0x7fb28419f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 -- 172.21.15.46:0/468753814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb284199ac0 con 0x7fb2841069a0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb2837fe640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840ffdc0 0x7fb28419f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb282ffd640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 0x7fb28419fe40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb278031460 tx=0x7fb2780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb27803f070 con 0x7fb2841069a0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb284199d50 con 0x7fb2841069a0 2024-09-21T12:57:34.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb278004cf0 con 0x7fb2841069a0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb278035030 con 0x7fb2841069a0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.195+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28419a280 con 0x7fb2841069a0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.197+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2841030e0 con 0x7fb2841069a0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.197+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb278042070 con 0x7fb2841069a0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.197+0000 7fb280ff9640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb26c07af30 0x7fb26c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.198+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb2780bec20 con 0x7fb2841069a0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.198+0000 7fb2837fe640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb26c07af30 0x7fb26c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:57:34.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.198+0000 7fb2837fe640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb26c07af30 0x7fb26c07d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb274005fd0 tx=0x7fb274005ec0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:57:34.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.202+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb27808a170 con 0x7fb2841069a0 2024-09-21T12:57:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.463+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb28419aff0 con 0x7fb2841069a0 2024-09-21T12:57:34.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.463+0000 7fb280ff9640 1 -- 172.21.15.46:0/468753814 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fb27808f020 con 0x7fb2841069a0 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:57:34.466 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb26c07af30 msgr2=0x7fb26c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb26c07af30 0x7fb26c07d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb274005fd0 tx=0x7fb274005ec0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 msgr2=0x7fb28419fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 0x7fb28419fe40 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb278031460 tx=0x7fb2780048f0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 shutdown_connections 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb26c07af30 0x7fb26c07d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb2841069a0 0x7fb28419fe40 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 --2- 172.21.15.46:0/468753814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb2840ffdc0 0x7fb28419f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:57:34.468 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 >> 172.21.15.46:0/468753814 conn(0x7fb2840fbc90 msgr2=0x7fb284100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:57:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 shutdown_connections 2024-09-21T12:57:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:57:34.466+0000 7fb28a093640 1 -- 172.21.15.46:0/468753814 wait complete. 2024-09-21T12:57:35.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:34 smithi176 ceph-mon[80162]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:35.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:34 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1689133370' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:57:35.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:34 smithi176 ceph-mon[80162]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:35.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:34 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/468753814' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:57:35.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:34 smithi046 ceph-mon[108126]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:34 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1689133370' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:57:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:34 smithi046 ceph-mon[108126]: from='client.34470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:57:35.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:34 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/468753814' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:57:37.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:36 smithi176 ceph-mon[80162]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:37.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:36 smithi046 ceph-mon[108126]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:39.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:38 smithi176 ceph-mon[80162]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:39.123 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:38 smithi046 ceph-mon[108126]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:41.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:40 smithi176 ceph-mon[80162]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:41.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:40 smithi046 ceph-mon[108126]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:43.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:42 smithi176 ceph-mon[80162]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:42 smithi046 ceph-mon[108126]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:45.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:44 smithi176 ceph-mon[80162]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:45.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:45.124 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:44 smithi046 ceph-mon[108126]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:45.124 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:57:47.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:46 smithi176 ceph-mon[80162]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:47.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:46 smithi046 ceph-mon[108126]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:49.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:48 smithi176 ceph-mon[80162]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:49.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:48 smithi046 ceph-mon[108126]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:51.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:50 smithi176 ceph-mon[80162]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:51.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:50 smithi046 ceph-mon[108126]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:53.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:52 smithi176 ceph-mon[80162]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:53.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:52 smithi046 ceph-mon[108126]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:55.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:54 smithi176 ceph-mon[80162]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:55.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:54 smithi046 ceph-mon[108126]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:57.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:56 smithi176 ceph-mon[80162]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:57.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:56 smithi046 ceph-mon[108126]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:59.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:58 smithi176 ceph-mon[80162]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:57:59.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:58 smithi046 ceph-mon[108126]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:00.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:57:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:00.111 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:57:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:01.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:00 smithi176 ceph-mon[80162]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:01.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:00 smithi046 ceph-mon[108126]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:03.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:02 smithi176 ceph-mon[80162]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:03.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:02 smithi046 ceph-mon[108126]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:04.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 -- 172.21.15.46:0/1899756344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee8102ac0 msgr2=0x7faee8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 --2- 172.21.15.46:0/1899756344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee8102ac0 0x7faee8102ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7faed8009880 tx=0x7faed802a530 comp rx=0 tx=0).stop 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 -- 172.21.15.46:0/1899756344 shutdown_connections 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 --2- 172.21.15.46:0/1899756344 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee81033e0 0x7faee810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 --2- 172.21.15.46:0/1899756344 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee8102ac0 0x7faee8102ea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 -- 172.21.15.46:0/1899756344 >> 172.21.15.46:0/1899756344 conn(0x7faee80fc520 msgr2=0x7faee80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 -- 172.21.15.46:0/1899756344 shutdown_connections 2024-09-21T12:58:04.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.565+0000 7faeeea0e640 1 -- 172.21.15.46:0/1899756344 wait complete. 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.566+0000 7faeeea0e640 1 Processor -- start 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.566+0000 7faeeea0e640 1 -- start start 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faeeea0e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee8102ac0 0x7faee819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faeeea0e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 0x7faee819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faeeea0e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faee810edf0 con 0x7faee81033e0 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faeeea0e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faee810ec70 con 0x7faee8102ac0 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 0x7faee819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 0x7faee819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57228/0 (socket says 172.21.15.46:57228) 2024-09-21T12:58:04.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 -- 172.21.15.46:0/2385727901 learned_addr learned my addr 172.21.15.46:0/2385727901 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee7fff640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee8102ac0 0x7faee819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 -- 172.21.15.46:0/2385727901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee8102ac0 msgr2=0x7faee819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee8102ac0 0x7faee819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 -- 172.21.15.46:0/2385727901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faee81977c0 con 0x7faee81033e0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee77fe640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 0x7faee819db80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c8f0 tx=0x7faedc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.567+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faedc00ae50 con 0x7faee81033e0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.568+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faedc005020 con 0x7faee81033e0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.568+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faee8197ab0 con 0x7faee81033e0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.568+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faedc004d70 con 0x7faee81033e0 2024-09-21T12:58:04.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.568+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faee8198040 con 0x7faee81033e0 2024-09-21T12:58:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.569+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faee806aa90 con 0x7faee81033e0 2024-09-21T12:58:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.569+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faedc0051d0 con 0x7faee81033e0 2024-09-21T12:58:04.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.570+0000 7faee57fa640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faed007b130 0x7faed007d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:04.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.570+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faedc09de40 con 0x7faee81033e0 2024-09-21T12:58:04.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.570+0000 7faee7fff640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faed007b130 0x7faed007d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:04.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.571+0000 7faee7fff640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faed007b130 0x7faed007d5f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faed8031460 tx=0x7faed8005bd0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:04.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.575+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faedc014030 con 0x7faee81033e0 2024-09-21T12:58:04.783 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.782+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faee8198350 con 0x7faed007b130 2024-09-21T12:58:04.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.784+0000 7faee57fa640 1 -- 172.21.15.46:0/2385727901 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7faee8198350 con 0x7faed007b130 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faed007b130 msgr2=0x7faed007d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faed007b130 0x7faed007d5f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faed8031460 tx=0x7faed8005bd0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 msgr2=0x7faee819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 0x7faee819db80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7faedc00c8f0 tx=0x7faedc00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 shutdown_connections 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faed007b130 0x7faed007d5f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faee81033e0 0x7faee819db80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 --2- 172.21.15.46:0/2385727901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee8102ac0 0x7faee819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 >> 172.21.15.46:0/2385727901 conn(0x7faee80fc520 msgr2=0x7faee810af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:04.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 shutdown_connections 2024-09-21T12:58:04.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.786+0000 7faeeea0e640 1 -- 172.21.15.46:0/2385727901 wait complete. 2024-09-21T12:58:04.796 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:58:04.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 -- 172.21.15.46:0/967005768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 msgr2=0x7fe02c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:04.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 --2- 172.21.15.46:0/967005768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c106bd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe01c009880 tx=0x7fe01c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 -- 172.21.15.46:0/967005768 shutdown_connections 2024-09-21T12:58:04.873 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:04 smithi046 ceph-mon[108126]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 --2- 172.21.15.46:0/967005768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c1007f0 0x7fe02c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 --2- 172.21.15.46:0/967005768 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c106bd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 -- 172.21.15.46:0/967005768 >> 172.21.15.46:0/967005768 conn(0x7fe02c0fc550 msgr2=0x7fe02c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 -- 172.21.15.46:0/967005768 shutdown_connections 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.872+0000 7fe032fa4640 1 -- 172.21.15.46:0/967005768 wait complete. 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe032fa4640 1 Processor -- start 2024-09-21T12:58:04.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe032fa4640 1 -- start start 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe032fa4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c1007f0 0x7fe02c0fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe032fa4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c0fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe032fa4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10dcc0 con 0x7fe02c1067f0 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe032fa4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe02c10db40 con 0x7fe02c1007f0 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe02bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c0fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe02bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c0fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57240/0 (socket says 172.21.15.46:57240) 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe02bfff640 1 -- 172.21.15.46:0/677791033 learned_addr learned my addr 172.21.15.46:0/677791033 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe030d40640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c1007f0 0x7fe02c0fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe02bfff640 1 -- 172.21.15.46:0/677791033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c1007f0 msgr2=0x7fe02c0fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe02bfff640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c1007f0 0x7fe02c0fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.873+0000 7fe02bfff640 1 -- 172.21.15.46:0/677791033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02c0fd750 con 0x7fe02c1067f0 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.874+0000 7fe02bfff640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c0fd210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe02000d6f0 tx=0x7fe02000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:04.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.874+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe020017070 con 0x7fe02c1067f0 2024-09-21T12:58:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.874+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe02000de00 con 0x7fe02c1067f0 2024-09-21T12:58:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.874+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe02c0fda40 con 0x7fe02c1067f0 2024-09-21T12:58:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.874+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe020004bb0 con 0x7fe02c1067f0 2024-09-21T12:58:04.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.874+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe02c1a3e30 con 0x7fe02c1067f0 2024-09-21T12:58:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.875+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe02c101f30 con 0x7fe02c1067f0 2024-09-21T12:58:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.876+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe020004e60 con 0x7fe02c1067f0 2024-09-21T12:58:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.876+0000 7fe029ffb640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe01407af30 0x7fe01407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.876+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe02009dc30 con 0x7fe02c1067f0 2024-09-21T12:58:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.876+0000 7fe030d40640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe01407af30 0x7fe01407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:04.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.877+0000 7fe030d40640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe01407af30 0x7fe01407d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0096c0 tx=0x7fe01c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:04.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:04.881+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe020069180 con 0x7fe02c1067f0 2024-09-21T12:58:05.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:04 smithi176 ceph-mon[80162]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:05.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.083+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe02c062630 con 0x7fe01407af30 2024-09-21T12:58:05.085 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.085+0000 7fe029ffb640 1 -- 172.21.15.46:0/677791033 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe02c062630 con 0x7fe01407af30 2024-09-21T12:58:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe01407af30 msgr2=0x7fe01407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe01407af30 0x7fe01407d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe01c0096c0 tx=0x7fe01c031400 comp rx=0 tx=0).stop 2024-09-21T12:58:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 msgr2=0x7fe02c0fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c0fd210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe02000d6f0 tx=0x7fe02000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 shutdown_connections 2024-09-21T12:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe01407af30 0x7fe01407d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe02c1067f0 0x7fe02c0fd210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 --2- 172.21.15.46:0/677791033 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe02c1007f0 0x7fe02c0fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 >> 172.21.15.46:0/677791033 conn(0x7fe02c0fc550 msgr2=0x7fe02c069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 shutdown_connections 2024-09-21T12:58:05.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.087+0000 7fe032fa4640 1 -- 172.21.15.46:0/677791033 wait complete. 2024-09-21T12:58:05.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 -- 172.21.15.46:0/3950002208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 msgr2=0x7f24ac100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 --2- 172.21.15.46:0/3950002208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac100c60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f249c009880 tx=0x7f249c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 -- 172.21.15.46:0/3950002208 shutdown_connections 2024-09-21T12:58:05.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 --2- 172.21.15.46:0/3950002208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac100c60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 --2- 172.21.15.46:0/3950002208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 0x7f24ac106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 -- 172.21.15.46:0/3950002208 >> 172.21.15.46:0/3950002208 conn(0x7f24ac0fc520 msgr2=0x7f24ac0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 -- 172.21.15.46:0/3950002208 shutdown_connections 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.172+0000 7f24b434f640 1 -- 172.21.15.46:0/3950002208 wait complete. 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b434f640 1 Processor -- start 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b434f640 1 -- start start 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b434f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b434f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 0x7f24ac19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b434f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10dcb0 con 0x7f24ac100800 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b434f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10db30 con 0x7f24ac106800 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b20eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b20eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac19d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57254/0 (socket says 172.21.15.46:57254) 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b20eb640 1 -- 172.21.15.46:0/2440873012 learned_addr learned my addr 172.21.15.46:0/2440873012 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b18ea640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 0x7f24ac19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b20eb640 1 -- 172.21.15.46:0/2440873012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 msgr2=0x7f24ac19dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b20eb640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 0x7f24ac19dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b20eb640 1 -- 172.21.15.46:0/2440873012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac1977f0 con 0x7f24ac100800 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.173+0000 7f24b18ea640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 0x7f24ac19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.174+0000 7f24b20eb640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac19d670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a800d8d0 tx=0x7f24a800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.174+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24a8017070 con 0x7f24ac100800 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.174+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f24a8010460 con 0x7f24ac100800 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.174+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac197ae0 con 0x7f24ac100800 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.174+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f24a800f5f0 con 0x7f24ac100800 2024-09-21T12:58:05.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.174+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac198040 con 0x7f24ac100800 2024-09-21T12:58:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.175+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ac101f40 con 0x7f24ac100800 2024-09-21T12:58:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.176+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f24a8009a30 con 0x7f24ac100800 2024-09-21T12:58:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.176+0000 7f24a37fe640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f249807af30 0x7f249807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.177+0000 7f24b18ea640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f249807af30 0x7f249807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.177+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f24a809df90 con 0x7f24ac100800 2024-09-21T12:58:05.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.177+0000 7f24b18ea640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f249807af30 0x7f249807d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f24ac198b40 tx=0x7f249c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:05.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.181+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f24a80694e0 con 0x7f24ac100800 2024-09-21T12:58:05.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.376+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f24ac1982f0 con 0x7f249807af30 2024-09-21T12:58:05.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.386+0000 7f24a37fe640 1 -- 172.21.15.46:0/2440873012 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f24ac1982f0 con 0x7f249807af30 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 2m ago 19m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (11m) 2m ago 19m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (11m) 112s ago 18m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (6m) 2m ago 19m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (6m) 112s ago 18m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (7m) 2m ago 18m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (2m) 2m ago 13m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (2m) 2m ago 13m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (2m) 112s ago 13m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (115s) 112s ago 13m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:58:05.388 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (10m) 2m ago 20m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (9m) 112s ago 18m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (6m) 2m ago 20m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (6m) 112s ago 18m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (9m) 2m ago 19m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (9m) 112s ago 18m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (5m) 2m ago 17m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 2m ago 16m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (4m) 2m ago 16m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (4m) 112s ago 15m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (3m) 112s ago 15m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (2m) 112s ago 14m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:58:05.389 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (8m) 2m ago 18m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f249807af30 msgr2=0x7f249807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f249807af30 0x7f249807d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f24ac198b40 tx=0x7f249c031400 comp rx=0 tx=0).stop 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 msgr2=0x7f24ac19d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac19d670 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f24a800d8d0 tx=0x7f24a800dd90 comp rx=0 tx=0).stop 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 shutdown_connections 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f249807af30 0x7f249807d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f24ac106800 0x7f24ac19dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 --2- 172.21.15.46:0/2440873012 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f24ac100800 0x7f24ac19d670 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 >> 172.21.15.46:0/2440873012 conn(0x7f24ac0fc520 msgr2=0x7f24ac06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 shutdown_connections 2024-09-21T12:58:05.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.388+0000 7f24b434f640 1 -- 172.21.15.46:0/2440873012 wait complete. 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 -- 172.21.15.46:0/4043390057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 msgr2=0x7f522c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 --2- 172.21.15.46:0/4043390057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c10b8c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5220009880 tx=0x7f522002a530 comp rx=0 tx=0).stop 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 -- 172.21.15.46:0/4043390057 shutdown_connections 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 --2- 172.21.15.46:0/4043390057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c10b8c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 --2- 172.21.15.46:0/4043390057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522c102ab0 0x7f522c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 -- 172.21.15.46:0/4043390057 >> 172.21.15.46:0/4043390057 conn(0x7f522c0fc550 msgr2=0x7f522c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 -- 172.21.15.46:0/4043390057 shutdown_connections 2024-09-21T12:58:05.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 -- 172.21.15.46:0/4043390057 wait complete. 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.472+0000 7f5232122640 1 Processor -- start 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f5232122640 1 -- start start 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f5232122640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522c102ab0 0x7f522c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f5232122640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f5232122640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f522c10ede0 con 0x7f522c1033d0 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f5232122640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f522c10ec60 con 0x7f522c102ab0 2024-09-21T12:58:05.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57266/0 (socket says 172.21.15.46:57266) 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522affd640 1 -- 172.21.15.46:0/3248848132 learned_addr learned my addr 172.21.15.46:0/3248848132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522b7fe640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522c102ab0 0x7f522c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522affd640 1 -- 172.21.15.46:0/3248848132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522c102ab0 msgr2=0x7f522c100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522affd640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522c102ab0 0x7f522c100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.473+0000 7f522affd640 1 -- 172.21.15.46:0/3248848132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f522c101190 con 0x7f522c1033d0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.474+0000 7f522affd640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c100c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5220031460 tx=0x7f5220004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.474+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f522003f070 con 0x7f522c1033d0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.474+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f522c101420 con 0x7f522c1033d0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.474+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f522c1a3dd0 con 0x7f522c1033d0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.474+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52200035f0 con 0x7f522c1033d0 2024-09-21T12:58:05.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.474+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5220035030 con 0x7f522c1033d0 2024-09-21T12:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.475+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5218005290 con 0x7f522c1033d0 2024-09-21T12:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.476+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5220042070 con 0x7f522c1033d0 2024-09-21T12:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.476+0000 7f5228ff9640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f521407af80 0x7f521407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.476+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f52200be810 con 0x7f522c1033d0 2024-09-21T12:58:05.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.476+0000 7f522b7fe640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f521407af80 0x7f521407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.477+0000 7f522b7fe640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f521407af80 0x7f521407d440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f521c005fd0 tx=0x7f521c009680 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:05.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.483+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5220089de0 con 0x7f522c1033d0 2024-09-21T12:58:05.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.748+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5218005d90 con 0x7f522c1033d0 2024-09-21T12:58:05.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.749+0000 7f5228ff9640 1 -- 172.21.15.46:0/3248848132 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f522008ec90 con 0x7f522c1033d0 2024-09-21T12:58:05.750 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:58:05.750 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:58:05.751 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:58:05.752 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:58:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f521407af80 msgr2=0x7f521407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f521407af80 0x7f521407d440 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f521c005fd0 tx=0x7f521c009680 comp rx=0 tx=0).stop 2024-09-21T12:58:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 msgr2=0x7f522c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c100c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5220031460 tx=0x7f5220004530 comp rx=0 tx=0).stop 2024-09-21T12:58:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 shutdown_connections 2024-09-21T12:58:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f521407af80 0x7f521407d440 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f522c1033d0 0x7f522c100c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 --2- 172.21.15.46:0/3248848132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f522c102ab0 0x7f522c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 >> 172.21.15.46:0/3248848132 conn(0x7f522c0fc550 msgr2=0x7f522c108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:05.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 shutdown_connections 2024-09-21T12:58:05.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.751+0000 7f5232122640 1 -- 172.21.15.46:0/3248848132 wait complete. 2024-09-21T12:58:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 -- 172.21.15.46:0/2975786562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8101900 msgr2=0x7fd9d8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/2975786562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8101900 0x7fd9d8101d60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc009880 tx=0x7fd9cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 -- 172.21.15.46:0/2975786562 shutdown_connections 2024-09-21T12:58:05.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/2975786562 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8101900 0x7fd9d8101d60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/2975786562 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8107900 0x7fd9d8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 -- 172.21.15.46:0/2975786562 >> 172.21.15.46:0/2975786562 conn(0x7fd9d80fd600 msgr2=0x7fd9d80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:05.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 -- 172.21.15.46:0/2975786562 shutdown_connections 2024-09-21T12:58:05.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.836+0000 7fd9dc88b640 1 -- 172.21.15.46:0/2975786562 wait complete. 2024-09-21T12:58:05.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9dc88b640 1 Processor -- start 2024-09-21T12:58:05.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9dc88b640 1 -- start start 2024-09-21T12:58:05.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9dc88b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8101900 0x7fd9d819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9dc88b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 0x7fd9d819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9dc88b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d810edd0 con 0x7fd9d8107900 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9dc88b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d810ec50 con 0x7fd9d8101900 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.837+0000 7fd9d5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 0x7fd9d819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 0x7fd9d819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57290/0 (socket says 172.21.15.46:57290) 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d5d9b640 1 -- 172.21.15.46:0/3595795943 learned_addr learned my addr 172.21.15.46:0/3595795943 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d659c640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8101900 0x7fd9d819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d5d9b640 1 -- 172.21.15.46:0/3595795943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8101900 msgr2=0x7fd9d819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d5d9b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8101900 0x7fd9d819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:05.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d5d9b640 1 -- 172.21.15.46:0/3595795943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d8197800 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d659c640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8101900 0x7fd9d819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9d5d9b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 0x7fd9d819dbc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc031460 tx=0x7fd9cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc03f070 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9cc0035f0 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d8197a90 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9cc035030 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.838+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d8197fc0 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.839+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9d8103040 con 0x7fd9d8107900 2024-09-21T12:58:05.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.840+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd9cc042070 con 0x7fd9d8107900 2024-09-21T12:58:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.841+0000 7fd9c77fe640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd9c007af30 0x7fd9c007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.841+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd9cc0bead0 con 0x7fd9d8107900 2024-09-21T12:58:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.841+0000 7fd9d659c640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd9c007af30 0x7fd9c007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:05.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.841+0000 7fd9d659c640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd9c007af30 0x7fd9c007d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80058c0 tx=0x7fd9c8005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:05.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:05.845+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9cc08a020 con 0x7fd9d8107900 2024-09-21T12:58:06.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:05 smithi176 ceph-mon[80162]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:06.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:05 smithi176 ceph-mon[80162]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:06.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:05 smithi176 ceph-mon[80162]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:06.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:05 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3248848132' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:58:06.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.070+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fd9d8198d30 con 0x7fd9d8107900 2024-09-21T12:58:06.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:05 smithi046 ceph-mon[108126]: from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:06.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:05 smithi046 ceph-mon[108126]: from='client.34482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:06.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:05 smithi046 ceph-mon[108126]: from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:06.072 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:05 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3248848132' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:58:06.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.071+0000 7fd9c77fe640 1 -- 172.21.15.46:0/3595795943 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7fd9cc08c020 con 0x7fd9d8107900 2024-09-21T12:58:06.073 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:58:06.073 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:58:06.073 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:58:06.073 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:58:06.073 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:58:06.074 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:58:06.075 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:58:06.076 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:06.077 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:06.078 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:06.078 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:06.078 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd9c007af30 msgr2=0x7fd9c007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd9c007af30 0x7fd9c007d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80058c0 tx=0x7fd9c8005850 comp rx=0 tx=0).stop 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 msgr2=0x7fd9d819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 0x7fd9d819dbc0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc031460 tx=0x7fd9cc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 shutdown_connections 2024-09-21T12:58:06.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd9c007af30 0x7fd9c007d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd9d8107900 0x7fd9d819dbc0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 --2- 172.21.15.46:0/3595795943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9d8101900 0x7fd9d819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 >> 172.21.15.46:0/3595795943 conn(0x7fd9d80fd600 msgr2=0x7fd9d80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 shutdown_connections 2024-09-21T12:58:06.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.073+0000 7fd9dc88b640 1 -- 172.21.15.46:0/3595795943 wait complete. 2024-09-21T12:58:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 -- 172.21.15.46:0/520263955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0103470 msgr2=0x7f08f010b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 --2- 172.21.15.46:0/520263955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0103470 0x7f08f010b960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f08e4009880 tx=0x7f08e402a530 comp rx=0 tx=0).stop 2024-09-21T12:58:06.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 -- 172.21.15.46:0/520263955 shutdown_connections 2024-09-21T12:58:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 --2- 172.21.15.46:0/520263955 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0103470 0x7f08f010b960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 --2- 172.21.15.46:0/520263955 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f0102b50 0x7f08f0102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 -- 172.21.15.46:0/520263955 >> 172.21.15.46:0/520263955 conn(0x7f08f00fc550 msgr2=0x7f08f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 -- 172.21.15.46:0/520263955 shutdown_connections 2024-09-21T12:58:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 -- 172.21.15.46:0/520263955 wait complete. 2024-09-21T12:58:06.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.160+0000 7f08f6199640 1 Processor -- start 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08f6199640 1 -- start start 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08f6199640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 0x7f08f019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08f6199640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f0103470 0x7f08f019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08f6199640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f08f010ede0 con 0x7f08f0102b50 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08f6199640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f08f010ec60 con 0x7f08f0103470 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 0x7f08f019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 0x7f08f019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57306/0 (socket says 172.21.15.46:57306) 2024-09-21T12:58:06.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 -- 172.21.15.46:0/1644463006 learned_addr learned my addr 172.21.15.46:0/1644463006 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 -- 172.21.15.46:0/1644463006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f0103470 msgr2=0x7f08f019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f0103470 0x7f08f019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 -- 172.21.15.46:0/1644463006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f01977b0 con 0x7f08f0102b50 2024-09-21T12:58:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.161+0000 7f08ef7fe640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 0x7f08f019d630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08e000d6f0 tx=0x7f08e000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.162+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08e0017070 con 0x7f08f0102b50 2024-09-21T12:58:06.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.162+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f0197aa0 con 0x7f08f0102b50 2024-09-21T12:58:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.162+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08e000de00 con 0x7f08f0102b50 2024-09-21T12:58:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.162+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f08e0004bb0 con 0x7f08f0102b50 2024-09-21T12:58:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.162+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f0198030 con 0x7f08f0102b50 2024-09-21T12:58:06.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.163+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f006a4e0 con 0x7f08f0102b50 2024-09-21T12:58:06.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.163+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f08e0004e60 con 0x7f08f0102b50 2024-09-21T12:58:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.164+0000 7f08ecff9640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08d807af30 0x7f08d807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.164+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f08e009dda0 con 0x7f08f0102b50 2024-09-21T12:58:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.164+0000 7f08eeffd640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08d807af30 0x7f08d807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:06.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.164+0000 7f08eeffd640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08d807af30 0x7f08d807d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08e40096c0 tx=0x7f08e4000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:06.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.168+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f08e0069250 con 0x7f08f0102b50 2024-09-21T12:58:06.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.373+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f08f01982e0 con 0x7f08d807af30 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.374+0000 7f08ecff9640 1 -- 172.21.15.46:0/1644463006 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f08f01982e0 con 0x7f08d807af30 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:58:06.375 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:58:06.376 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08d807af30 msgr2=0x7f08d807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08d807af30 0x7f08d807d3f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f08e40096c0 tx=0x7f08e4000bc0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 msgr2=0x7f08f019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 0x7f08f019d630 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f08e000d6f0 tx=0x7f08e000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 shutdown_connections 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f08d807af30 0x7f08d807d3f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08f0103470 0x7f08f019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 --2- 172.21.15.46:0/1644463006 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f08f0102b50 0x7f08f019d630 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 >> 172.21.15.46:0/1644463006 conn(0x7f08f00fc550 msgr2=0x7f08f0103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 shutdown_connections 2024-09-21T12:58:06.378 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.376+0000 7f08f6199640 1 -- 172.21.15.46:0/1644463006 wait complete. 2024-09-21T12:58:06.462 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 -- 172.21.15.46:0/4132006347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34109b90 msgr2=0x7faf34109f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/4132006347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34109b90 0x7faf34109f70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf30009880 tx=0x7faf3002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 -- 172.21.15.46:0/4132006347 shutdown_connections 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/4132006347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf34103b00 0x7faf34103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/4132006347 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34109b90 0x7faf34109f70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 -- 172.21.15.46:0/4132006347 >> 172.21.15.46:0/4132006347 conn(0x7faf340ff800 msgr2=0x7faf34101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 -- 172.21.15.46:0/4132006347 shutdown_connections 2024-09-21T12:58:06.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.461+0000 7faf3bc5f640 1 -- 172.21.15.46:0/4132006347 wait complete. 2024-09-21T12:58:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf3bc5f640 1 Processor -- start 2024-09-21T12:58:06.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf3bc5f640 1 -- start start 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf3bc5f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 0x7faf3419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf3bc5f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf34109b90 0x7faf3419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf3bc5f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf34110fd0 con 0x7faf34103b00 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf3bc5f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf34110e50 con 0x7faf34109b90 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf399fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 0x7faf3419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf399fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 0x7faf3419f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57332/0 (socket says 172.21.15.46:57332) 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf399fb640 1 -- 172.21.15.46:0/2248785000 learned_addr learned my addr 172.21.15.46:0/2248785000 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.462+0000 7faf391fa640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf34109b90 0x7faf3419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf399fb640 1 -- 172.21.15.46:0/2248785000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf34109b90 msgr2=0x7faf3419fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf399fb640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf34109b90 0x7faf3419fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf399fb640 1 -- 172.21.15.46:0/2248785000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf341999e0 con 0x7faf34103b00 2024-09-21T12:58:06.465 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf399fb640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 0x7faf3419f820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf30031460 tx=0x7faf300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf3003f070 con 0x7faf34103b00 2024-09-21T12:58:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf34199c70 con 0x7faf34103b00 2024-09-21T12:58:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf30004cf0 con 0x7faf34103b00 2024-09-21T12:58:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf30035030 con 0x7faf34103b00 2024-09-21T12:58:06.466 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.463+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3419a1a0 con 0x7faf34103b00 2024-09-21T12:58:06.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.464+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf34105200 con 0x7faf34103b00 2024-09-21T12:58:06.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.465+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faf30042070 con 0x7faf34103b00 2024-09-21T12:58:06.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.465+0000 7faf2affd640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf2007af30 0x7faf2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:06.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.466+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faf300beb60 con 0x7faf34103b00 2024-09-21T12:58:06.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.466+0000 7faf391fa640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf2007af30 0x7faf2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:06.467 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.466+0000 7faf391fa640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf2007af30 0x7faf2007d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf34101e50 tx=0x7faf2400a250 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:06.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.470+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf3008a010 con 0x7faf34103b00 2024-09-21T12:58:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.735+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7faf3419af10 con 0x7faf34103b00 2024-09-21T12:58:06.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.735+0000 7faf2affd640 1 -- 172.21.15.46:0/2248785000 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7faf3008eec0 con 0x7faf34103b00 2024-09-21T12:58:06.736 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:58:06.736 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:58:06.737 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:58:06.737 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:58:06.737 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:58:06.737 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:58:06.737 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf2007af30 msgr2=0x7faf2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf2007af30 0x7faf2007d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7faf34101e50 tx=0x7faf2400a250 comp rx=0 tx=0).stop 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 msgr2=0x7faf3419f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 0x7faf3419f820 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faf30031460 tx=0x7faf300048f0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 shutdown_connections 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf2007af30 0x7faf2007d3f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf34109b90 0x7faf3419fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 --2- 172.21.15.46:0/2248785000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf34103b00 0x7faf3419f820 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 >> 172.21.15.46:0/2248785000 conn(0x7faf340ff800 msgr2=0x7faf34100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 shutdown_connections 2024-09-21T12:58:06.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:06.737+0000 7faf3bc5f640 1 -- 172.21.15.46:0/2248785000 wait complete. 2024-09-21T12:58:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:06 smithi176 ceph-mon[80162]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:06 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3595795943' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:58:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:06 smithi176 ceph-mon[80162]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:07.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:06 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2248785000' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:58:07.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:06 smithi046 ceph-mon[108126]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:07.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:06 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3595795943' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:58:07.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:06 smithi046 ceph-mon[108126]: from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:07.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:06 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2248785000' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:58:09.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:08 smithi176 ceph-mon[80162]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:09.126 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:08 smithi046 ceph-mon[108126]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:11.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:10 smithi176 ceph-mon[80162]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:10 smithi046 ceph-mon[108126]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:13.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:12 smithi176 ceph-mon[80162]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:13.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:12 smithi046 ceph-mon[108126]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:14 smithi176 ceph-mon[80162]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:15.111 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:14 smithi046 ceph-mon[108126]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:15.111 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:17.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:16 smithi176 ceph-mon[80162]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:17.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:16 smithi046 ceph-mon[108126]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:19.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:18 smithi176 ceph-mon[80162]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:19.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:18 smithi046 ceph-mon[108126]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:21.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:20 smithi176 ceph-mon[80162]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:21.111 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:20 smithi046 ceph-mon[108126]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:23.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:22 smithi046 ceph-mon[108126]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:22 smithi176 ceph-mon[80162]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:25.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:24 smithi046 ceph-mon[108126]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:25.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:24 smithi176 ceph-mon[80162]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:27.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:26 smithi046 ceph-mon[108126]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:26 smithi176 ceph-mon[80162]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:29.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:28 smithi046 ceph-mon[108126]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:28 smithi176 ceph-mon[80162]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:30.115 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:30.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:31.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:30 smithi046 ceph-mon[108126]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:30 smithi176 ceph-mon[80162]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:33.117 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:32 smithi046 ceph-mon[108126]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:32 smithi176 ceph-mon[80162]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:35.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:34 smithi046 ceph-mon[108126]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:34 smithi176 ceph-mon[80162]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:36.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 -- 172.21.15.46:0/166235952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4101010 msgr2=0x7f01b4101450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:36.836 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/166235952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4101010 0x7f01b4101450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f01a8009880 tx=0x7f01a802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 -- 172.21.15.46:0/166235952 shutdown_connections 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/166235952 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4101010 0x7f01b4101450 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/166235952 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b4105860 0x7f01b4105c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 -- 172.21.15.46:0/166235952 >> 172.21.15.46:0/166235952 conn(0x7f01b40fbc90 msgr2=0x7f01b40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 -- 172.21.15.46:0/166235952 shutdown_connections 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 -- 172.21.15.46:0/166235952 wait complete. 2024-09-21T12:58:36.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.835+0000 7f01ba1f7640 1 Processor -- start 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01ba1f7640 1 -- start start 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01ba1f7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b4101010 0x7f01b4196710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01ba1f7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 0x7f01b4196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01ba1f7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f01b410de20 con 0x7f01b4105860 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01ba1f7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01b410dca0 con 0x7f01b4101010 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 0x7f01b4196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01b2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 0x7f01b4196c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38642/0 (socket says 172.21.15.46:38642) 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01b2ffd640 1 -- 172.21.15.46:0/2681109485 learned_addr learned my addr 172.21.15.46:0/2681109485 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01b37fe640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b4101010 0x7f01b4196710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:36.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01b2ffd640 1 -- 172.21.15.46:0/2681109485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b4101010 msgr2=0x7f01b4196710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.836+0000 7f01b2ffd640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b4101010 0x7f01b4196710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01b2ffd640 1 -- 172.21.15.46:0/2681109485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01b4197190 con 0x7f01b4105860 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01b2ffd640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 0x7f01b4196c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01a8031460 tx=0x7f01a80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01a803f070 con 0x7f01b4105860 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01a80035f0 con 0x7f01b4105860 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01b4197420 con 0x7f01b4105860 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01a8035030 con 0x7f01b4105860 2024-09-21T12:58:36.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.837+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01b41a3f50 con 0x7f01b4105860 2024-09-21T12:58:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.838+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01b4102020 con 0x7f01b4105860 2024-09-21T12:58:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.839+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f01a8042070 con 0x7f01b4105860 2024-09-21T12:58:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.839+0000 7f01b0ff9640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f019c07af80 0x7f019c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.840+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f01a80bea30 con 0x7f01b4105860 2024-09-21T12:58:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.840+0000 7f01b37fe640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f019c07af80 0x7f019c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:36.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.840+0000 7f01b37fe640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f019c07af80 0x7f019c07d440 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005fd0 tx=0x7f01a4005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:36.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:36.847+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01a808a000 con 0x7f01b4105860 2024-09-21T12:58:37.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.057+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f01b4100550 con 0x7f019c07af80 2024-09-21T12:58:37.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.058+0000 7f01b0ff9640 1 -- 172.21.15.46:0/2681109485 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f01b4100550 con 0x7f019c07af80 2024-09-21T12:58:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f019c07af80 msgr2=0x7f019c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f019c07af80 0x7f019c07d440 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f01a4005fd0 tx=0x7f01a4005850 comp rx=0 tx=0).stop 2024-09-21T12:58:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 msgr2=0x7f01b4196c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 0x7f01b4196c50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f01a8031460 tx=0x7f01a80045e0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 shutdown_connections 2024-09-21T12:58:37.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f019c07af80 0x7f019c07d440 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01b4105860 0x7f01b4196c50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 --2- 172.21.15.46:0/2681109485 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01b4101010 0x7f01b4196710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 >> 172.21.15.46:0/2681109485 conn(0x7f01b40fbc90 msgr2=0x7f01b40fc630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 shutdown_connections 2024-09-21T12:58:37.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.061+0000 7f01ba1f7640 1 -- 172.21.15.46:0/2681109485 wait complete. 2024-09-21T12:58:37.071 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:58:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.146+0000 7f575c93a640 1 -- 172.21.15.46:0/399632437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 msgr2=0x7f5758102f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.148 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.146+0000 7f575c93a640 1 --2- 172.21.15.46:0/399632437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f5758102f10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5748009880 tx=0x7f574802a530 comp rx=0 tx=0).stop 2024-09-21T12:58:37.148 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:36 smithi046 ceph-mon[108126]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.147+0000 7f575c93a640 1 -- 172.21.15.46:0/399632437 shutdown_connections 2024-09-21T12:58:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.147+0000 7f575c93a640 1 --2- 172.21.15.46:0/399632437 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5758103450 0x7f575810b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.147+0000 7f575c93a640 1 --2- 172.21.15.46:0/399632437 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f5758102f10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.147+0000 7f575c93a640 1 -- 172.21.15.46:0/399632437 >> 172.21.15.46:0/399632437 conn(0x7f57580fc550 msgr2=0x7f57580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:37.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.147+0000 7f575c93a640 1 -- 172.21.15.46:0/399632437 shutdown_connections 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.147+0000 7f575c93a640 1 -- 172.21.15.46:0/399632437 wait complete. 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575c93a640 1 Processor -- start 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575c93a640 1 -- start start 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575c93a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f575819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575c93a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5758103450 0x7f575819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575c93a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f575810ede0 con 0x7f5758102b30 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575c93a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f575810ec60 con 0x7f5758103450 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f575819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f575819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:38660/0 (socket says 172.21.15.46:38660) 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575659c640 1 -- 172.21.15.46:0/1161669921 learned_addr learned my addr 172.21.15.46:0/1161669921 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f5755d9b640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5758103450 0x7f575819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575659c640 1 -- 172.21.15.46:0/1161669921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5758103450 msgr2=0x7f575819db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.148+0000 7f575659c640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5758103450 0x7f575819db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f575659c640 1 -- 172.21.15.46:0/1161669921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57581977d0 con 0x7f5758102b30 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f575659c640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f575819d650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5748004f90 tx=0x7f57480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f574803f070 con 0x7f5758102b30 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5748004c70 con 0x7f5758102b30 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5758197a60 con 0x7f5758102b30 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5748035030 con 0x7f5758102b30 2024-09-21T12:58:37.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.149+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5758197f90 con 0x7f5758102b30 2024-09-21T12:58:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.150+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575806a500 con 0x7f5758102b30 2024-09-21T12:58:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.151+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5748042070 con 0x7f5758102b30 2024-09-21T12:58:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.152+0000 7f57477fe640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f574007af30 0x7f574007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.152+0000 7f5755d9b640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f574007af30 0x7f574007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.152+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f57480bea30 con 0x7f5758102b30 2024-09-21T12:58:37.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.152+0000 7f5755d9b640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f574007af30 0x7f574007d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5758108900 tx=0x7f574c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:37.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.156+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5748089f80 con 0x7f5758102b30 2024-09-21T12:58:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:36 smithi176 ceph-mon[80162]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:37.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.363+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5758198240 con 0x7f574007af30 2024-09-21T12:58:37.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.364+0000 7f57477fe640 1 -- 172.21.15.46:0/1161669921 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5758198240 con 0x7f574007af30 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f574007af30 msgr2=0x7f574007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f574007af30 0x7f574007d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5758108900 tx=0x7f574c00b390 comp rx=0 tx=0).stop 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 msgr2=0x7f575819d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f575819d650 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5748004f90 tx=0x7f57480048f0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 shutdown_connections 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f574007af30 0x7f574007d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.368 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5758103450 0x7f575819db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 --2- 172.21.15.46:0/1161669921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5758102b30 0x7f575819d650 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 >> 172.21.15.46:0/1161669921 conn(0x7f57580fc550 msgr2=0x7f5758108f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 shutdown_connections 2024-09-21T12:58:37.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.367+0000 7f575c93a640 1 -- 172.21.15.46:0/1161669921 wait complete. 2024-09-21T12:58:37.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 -- 172.21.15.46:0/2135725798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c106800 msgr2=0x7f5e9c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 --2- 172.21.15.46:0/2135725798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c106800 0x7f5e9c106be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009880 tx=0x7f5e9802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 -- 172.21.15.46:0/2135725798 shutdown_connections 2024-09-21T12:58:37.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 --2- 172.21.15.46:0/2135725798 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c100800 0x7f5e9c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 --2- 172.21.15.46:0/2135725798 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c106800 0x7f5e9c106be0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 -- 172.21.15.46:0/2135725798 >> 172.21.15.46:0/2135725798 conn(0x7f5e9c0fc520 msgr2=0x7f5e9c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:37.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 -- 172.21.15.46:0/2135725798 shutdown_connections 2024-09-21T12:58:37.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.452+0000 7f5ea3897640 1 -- 172.21.15.46:0/2135725798 wait complete. 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea3897640 1 Processor -- start 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea3897640 1 -- start start 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea3897640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 0x7f5e9c198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea3897640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c106800 0x7f5e9c198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea3897640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c10dcd0 con 0x7f5e9c100800 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea3897640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c10db50 con 0x7f5e9c106800 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea1633640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 0x7f5e9c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea1633640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 0x7f5e9c198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51268/0 (socket says 172.21.15.46:51268) 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea1633640 1 -- 172.21.15.46:0/3020169268 learned_addr learned my addr 172.21.15.46:0/3020169268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea0e32640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c106800 0x7f5e9c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.453+0000 7f5ea1633640 1 -- 172.21.15.46:0/3020169268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c106800 msgr2=0x7f5e9c198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5ea1633640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c106800 0x7f5e9c198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5ea1633640 1 -- 172.21.15.46:0/3020169268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9c199350 con 0x7f5e9c100800 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5ea0e32640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c106800 0x7f5e9c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5ea1633640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 0x7f5e9c198810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e98031460 tx=0x7f5e980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e9803f070 con 0x7f5e9c100800 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5e980035f0 con 0x7f5e9c100800 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9c1995e0 con 0x7f5e9c100800 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e98035030 con 0x7f5e9c100800 2024-09-21T12:58:37.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.454+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c1a1b90 con 0x7f5e9c100800 2024-09-21T12:58:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.455+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c101f40 con 0x7f5e9c100800 2024-09-21T12:58:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.456+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5e98042070 con 0x7f5e9c100800 2024-09-21T12:58:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.456+0000 7f5e927fc640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5e8807af30 0x7f5e8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.456+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5e980bead0 con 0x7f5e9c100800 2024-09-21T12:58:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.456+0000 7f5ea0e32640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5e8807af30 0x7f5e8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.457+0000 7f5ea0e32640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5e8807af30 0x7f5e8807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0058c0 tx=0x7f5e8c005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:37.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.461+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e9808a020 con 0x7f5e9c100800 2024-09-21T12:58:37.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.655+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5e9c062630 con 0x7f5e8807af30 2024-09-21T12:58:37.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.665+0000 7f5e927fc640 1 -- 172.21.15.46:0/3020169268 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5e9c062630 con 0x7f5e8807af30 2024-09-21T12:58:37.666 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:58:37.666 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (8m) 2m ago 19m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:58:37.666 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (12m) 2m ago 19m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:58:37.666 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (11m) 2m ago 18m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:58:37.666 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (6m) 2m ago 19m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (6m) 2m ago 18m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (8m) 2m ago 19m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (3m) 2m ago 14m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (2m) 2m ago 14m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (2m) 2m ago 14m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (2m) 2m ago 14m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (11m) 2m ago 21m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (10m) 2m ago 18m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (7m) 2m ago 21m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (7m) 2m ago 18m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (9m) 2m ago 19m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:58:37.667 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (9m) 2m ago 18m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (6m) 2m ago 17m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (5m) 2m ago 17m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 2m ago 16m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (4m) 2m ago 16m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (4m) 2m ago 15m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (3m) 2m ago 15m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:58:37.668 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (9m) 2m ago 19m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5e8807af30 msgr2=0x7f5e8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5e8807af30 0x7f5e8807d3f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0058c0 tx=0x7f5e8c005850 comp rx=0 tx=0).stop 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 msgr2=0x7f5e9c198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 0x7f5e9c198810 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e98031460 tx=0x7f5e980045e0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 shutdown_connections 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5e8807af30 0x7f5e8807d3f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e9c106800 0x7f5e9c198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 --2- 172.21.15.46:0/3020169268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5e9c100800 0x7f5e9c198810 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 >> 172.21.15.46:0/3020169268 conn(0x7f5e9c0fc520 msgr2=0x7f5e9c0fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 shutdown_connections 2024-09-21T12:58:37.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.667+0000 7f5ea3897640 1 -- 172.21.15.46:0/3020169268 wait complete. 2024-09-21T12:58:37.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 -- 172.21.15.46:0/4125042998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c107900 msgr2=0x7f1f0c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 --2- 172.21.15.46:0/4125042998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c107900 0x7f1f0c107ce0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1efc009880 tx=0x7f1efc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 -- 172.21.15.46:0/4125042998 shutdown_connections 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 --2- 172.21.15.46:0/4125042998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f0c101900 0x7f1f0c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 --2- 172.21.15.46:0/4125042998 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c107900 0x7f1f0c107ce0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 -- 172.21.15.46:0/4125042998 >> 172.21.15.46:0/4125042998 conn(0x7f1f0c0fd600 msgr2=0x7f1f0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 -- 172.21.15.46:0/4125042998 shutdown_connections 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 -- 172.21.15.46:0/4125042998 wait complete. 2024-09-21T12:58:37.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.751+0000 7f1f1166a640 1 Processor -- start 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f1166a640 1 -- start start 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f1166a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 0x7f1f0c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f1166a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f0c107900 0x7f1f0c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f1166a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c10ee30 con 0x7f1f0c101900 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f1166a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c10ecb0 con 0x7f1f0c107900 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 0x7f1f0c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 0x7f1f0c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51294/0 (socket says 172.21.15.46:51294) 2024-09-21T12:58:37.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0affd640 1 -- 172.21.15.46:0/1084247195 learned_addr learned my addr 172.21.15.46:0/1084247195 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0a7fc640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f0c107900 0x7f1f0c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0affd640 1 -- 172.21.15.46:0/1084247195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f0c107900 msgr2=0x7f1f0c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0affd640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f0c107900 0x7f1f0c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.752+0000 7f1f0affd640 1 -- 172.21.15.46:0/1084247195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c197860 con 0x7f1f0c101900 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.753+0000 7f1f0affd640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 0x7f1f0c19d6a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1efc031460 tx=0x7f1efc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.753+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1efc03f070 con 0x7f1f0c101900 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.753+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c197af0 con 0x7f1f0c101900 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.753+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c198020 con 0x7f1f0c101900 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.753+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1efc004cf0 con 0x7f1f0c101900 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.753+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1efc035030 con 0x7f1f0c101900 2024-09-21T12:58:37.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.754+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1eec005290 con 0x7f1f0c101900 2024-09-21T12:58:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.755+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1efc042070 con 0x7f1f0c101900 2024-09-21T12:58:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.755+0000 7f1f03fff640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1ef807af80 0x7f1ef807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.756+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1efc0bea10 con 0x7f1f0c101900 2024-09-21T12:58:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.756+0000 7f1f0a7fc640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1ef807af80 0x7f1ef807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:37.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.756+0000 7f1f0a7fc640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1ef807af80 0x7f1ef807d440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0ffc20 tx=0x7f1ef4008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:37.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:37.760+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1efc089fe0 con 0x7f1f0c101900 2024-09-21T12:58:38.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.024+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1eec005d90 con 0x7f1f0c101900 2024-09-21T12:58:38.026 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:37 smithi046 ceph-mon[108126]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:38.026 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:37 smithi046 ceph-mon[108126]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:38.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.025+0000 7f1f03fff640 1 -- 172.21.15.46:0/1084247195 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f1efc08ee90 con 0x7f1f0c101900 2024-09-21T12:58:38.026 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:58:38.026 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:58:38.026 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:58:38.026 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:38.026 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:58:38.027 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:58:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1ef807af80 msgr2=0x7f1ef807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1ef807af80 0x7f1ef807d440 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c0ffc20 tx=0x7f1ef4008040 comp rx=0 tx=0).stop 2024-09-21T12:58:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 msgr2=0x7f1f0c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 0x7f1f0c19d6a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1efc031460 tx=0x7f1efc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 shutdown_connections 2024-09-21T12:58:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1ef807af80 0x7f1ef807d440 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1f0c107900 0x7f1f0c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 --2- 172.21.15.46:0/1084247195 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1f0c101900 0x7f1f0c19d6a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 >> 172.21.15.46:0/1084247195 conn(0x7f1f0c0fd600 msgr2=0x7f1f0c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 shutdown_connections 2024-09-21T12:58:38.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.027+0000 7f1f1166a640 1 -- 172.21.15.46:0/1084247195 wait complete. 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.111+0000 7f958426c640 1 -- 172.21.15.46:0/1270348685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c102ab0 msgr2=0x7f957c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.111+0000 7f958426c640 1 --2- 172.21.15.46:0/1270348685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c102ab0 0x7f957c102e90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9578009880 tx=0x7f957802a530 comp rx=0 tx=0).stop 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.111+0000 7f958426c640 1 -- 172.21.15.46:0/1270348685 shutdown_connections 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.111+0000 7f958426c640 1 --2- 172.21.15.46:0/1270348685 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f957c1033d0 0x7f957c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.111+0000 7f958426c640 1 --2- 172.21.15.46:0/1270348685 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c102ab0 0x7f957c102e90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.111+0000 7f958426c640 1 -- 172.21.15.46:0/1270348685 >> 172.21.15.46:0/1270348685 conn(0x7f957c0fc550 msgr2=0x7f957c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.112+0000 7f958426c640 1 -- 172.21.15.46:0/1270348685 shutdown_connections 2024-09-21T12:58:38.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.112+0000 7f958426c640 1 -- 172.21.15.46:0/1270348685 wait complete. 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.112+0000 7f958426c640 1 Processor -- start 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.112+0000 7f958426c640 1 -- start start 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f958426c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f957c102ab0 0x7f957c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f958426c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 0x7f957c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f958426c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f957c10edc0 con 0x7f957c1033d0 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f958426c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f957c10ec40 con 0x7f957c102ab0 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 0x7f957c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 0x7f957c19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51310/0 (socket says 172.21.15.46:51310) 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 -- 172.21.15.46:0/3498280658 learned_addr learned my addr 172.21.15.46:0/3498280658 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:38.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9582008640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f957c102ab0 0x7f957c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 -- 172.21.15.46:0/3498280658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f957c102ab0 msgr2=0x7f957c19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f957c102ab0 0x7f957c19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 -- 172.21.15.46:0/3498280658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957c1977b0 con 0x7f957c1033d0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f9581807640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 0x7f957c19db70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c8f0 tx=0x7f956c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f956c0079b0 con 0x7f957c1033d0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f956c007b50 con 0x7f957c1033d0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f957c197aa0 con 0x7f957c1033d0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.113+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f956c018610 con 0x7f957c1033d0 2024-09-21T12:58:38.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.114+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f957c198030 con 0x7f957c1033d0 2024-09-21T12:58:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.114+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f957c06a580 con 0x7f957c1033d0 2024-09-21T12:58:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.115+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f956c007d00 con 0x7f957c1033d0 2024-09-21T12:58:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.116+0000 7f95737fe640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f956807af80 0x7f956807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.116+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f956c09e230 con 0x7f957c1033d0 2024-09-21T12:58:38.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.116+0000 7f9582008640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f956807af80 0x7f956807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.116+0000 7f9582008640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f956807af80 0x7f956807d440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9578000c00 tx=0x7f9578031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:38.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.120+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f956c014030 con 0x7f957c1033d0 2024-09-21T12:58:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:37 smithi176 ceph-mon[80162]: from='client.34506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:37 smithi176 ceph-mon[80162]: from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.345+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f957c105f80 con 0x7f957c1033d0 2024-09-21T12:58:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.345+0000 7f95737fe640 1 -- 172.21.15.46:0/3498280658 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f956c069760 con 0x7f957c1033d0 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:58:38.347 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:58:38.348 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:58:38.349 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:38.350 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:38.350 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:38.350 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:58:38.350 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:58:38.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.347+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f956807af80 msgr2=0x7f956807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.347+0000 7f958426c640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f956807af80 0x7f956807d440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9578000c00 tx=0x7f9578031400 comp rx=0 tx=0).stop 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.347+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 msgr2=0x7f957c19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.347+0000 7f958426c640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 0x7f957c19db70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f956c00c8f0 tx=0x7f956c00cdb0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 shutdown_connections 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f956807af80 0x7f956807d440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f957c1033d0 0x7f957c19db70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 --2- 172.21.15.46:0/3498280658 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f957c102ab0 0x7f957c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 >> 172.21.15.46:0/3498280658 conn(0x7f957c0fc550 msgr2=0x7f957c108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 shutdown_connections 2024-09-21T12:58:38.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.348+0000 7f958426c640 1 -- 172.21.15.46:0/3498280658 wait complete. 2024-09-21T12:58:38.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 -- 172.21.15.46:0/3778261239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 msgr2=0x7fb5a8106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 --2- 172.21.15.46:0/3778261239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8106be0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb5a4009880 tx=0x7fb5a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 -- 172.21.15.46:0/3778261239 shutdown_connections 2024-09-21T12:58:38.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 --2- 172.21.15.46:0/3778261239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5a8100800 0x7fb5a8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 --2- 172.21.15.46:0/3778261239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8106be0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 -- 172.21.15.46:0/3778261239 >> 172.21.15.46:0/3778261239 conn(0x7fb5a80fc520 msgr2=0x7fb5a80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:38.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 -- 172.21.15.46:0/3778261239 shutdown_connections 2024-09-21T12:58:38.435 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.433+0000 7fb5af280640 1 -- 172.21.15.46:0/3778261239 wait complete. 2024-09-21T12:58:38.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5af280640 1 Processor -- start 2024-09-21T12:58:38.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5af280640 1 -- start start 2024-09-21T12:58:38.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5af280640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5a8100800 0x7fb5a81987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5af280640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5af280640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810dcd0 con 0x7fb5a8106800 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5af280640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a810db50 con 0x7fb5a8100800 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ac81b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ac81b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51330/0 (socket says 172.21.15.46:51330) 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ac81b640 1 -- 172.21.15.46:0/1689549650 learned_addr learned my addr 172.21.15.46:0/1689549650 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ad01c640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5a8100800 0x7fb5a81987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ac81b640 1 -- 172.21.15.46:0/1689549650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5a8100800 msgr2=0x7fb5a81987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ac81b640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5a8100800 0x7fb5a81987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.434+0000 7fb5ac81b640 1 -- 172.21.15.46:0/1689549650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a8199320 con 0x7fb5a8106800 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.435+0000 7fb5ac81b640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8198d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb59800d6f0 tx=0x7fb59800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.435+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb598017070 con 0x7fb5a8106800 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.435+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a8199610 con 0x7fb5a8106800 2024-09-21T12:58:38.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.435+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb59800de00 con 0x7fb5a8106800 2024-09-21T12:58:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.435+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb598004bb0 con 0x7fb5a8106800 2024-09-21T12:58:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.435+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a81a1c10 con 0x7fb5a8106800 2024-09-21T12:58:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.436+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a8101f40 con 0x7fb5a8106800 2024-09-21T12:58:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.437+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb598004e60 con 0x7fb5a8106800 2024-09-21T12:58:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.437+0000 7fb59e7fc640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb59407af30 0x7fb59407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.438 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.437+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb59809dc10 con 0x7fb5a8106800 2024-09-21T12:58:38.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.437+0000 7fb5ad01c640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb59407af30 0x7fb59407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.438+0000 7fb5ad01c640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb59407af30 0x7fb59407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40096c0 tx=0x7fb5a4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:38.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.442+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb5a8199610 con 0x7fb5a8106800 2024-09-21T12:58:38.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.645+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb5a8062630 con 0x7fb59407af30 2024-09-21T12:58:38.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.646+0000 7fb59e7fc640 1 -- 172.21.15.46:0/1689549650 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fb5a8062630 con 0x7fb59407af30 2024-09-21T12:58:38.647 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:58:38.648 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb59407af30 msgr2=0x7fb59407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb59407af30 0x7fb59407d3f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40096c0 tx=0x7fb5a4031400 comp rx=0 tx=0).stop 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 msgr2=0x7fb5a8198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8198d20 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb59800d6f0 tx=0x7fb59800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 shutdown_connections 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb59407af30 0x7fb59407d3f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb5a8106800 0x7fb5a8198d20 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 --2- 172.21.15.46:0/1689549650 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5a8100800 0x7fb5a81987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 >> 172.21.15.46:0/1689549650 conn(0x7fb5a80fc520 msgr2=0x7fb5a80fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 shutdown_connections 2024-09-21T12:58:38.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.649+0000 7fb5af280640 1 -- 172.21.15.46:0/1689549650 wait complete. 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1046929323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 msgr2=0x7f66f4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1046929323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f4106be0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009880 tx=0x7f66e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1046929323 shutdown_connections 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1046929323 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 0x7f66f4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1046929323 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f4106be0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1046929323 >> 172.21.15.46:0/1046929323 conn(0x7f66f40fc520 msgr2=0x7f66f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1046929323 shutdown_connections 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.733+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1046929323 wait complete. 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66fa8a3640 1 Processor -- start 2024-09-21T12:58:38.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66fa8a3640 1 -- start start 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66fa8a3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 0x7f66f419f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66fa8a3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f419fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66fa8a3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f66f410dcd0 con 0x7f66f4106800 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66fa8a3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f66f410db50 con 0x7f66f4100800 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f419fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66f37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f419fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51356/0 (socket says 172.21.15.46:51356) 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.734+0000 7f66f37fe640 1 -- 172.21.15.46:0/1953420633 learned_addr learned my addr 172.21.15.46:0/1953420633 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f3fff640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 0x7f66f419f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f37fe640 1 -- 172.21.15.46:0/1953420633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 msgr2=0x7f66f419f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f37fe640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 0x7f66f419f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f37fe640 1 -- 172.21.15.46:0/1953420633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f41999e0 con 0x7f66f4106800 2024-09-21T12:58:38.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f3fff640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 0x7f66f419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:58:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f37fe640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f419fd60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d6f0 tx=0x7f66e800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66e8017070 con 0x7f66f4106800 2024-09-21T12:58:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66e800de00 con 0x7f66f4106800 2024-09-21T12:58:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f4199cd0 con 0x7f66f4106800 2024-09-21T12:58:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f66e8004bb0 con 0x7f66f4106800 2024-09-21T12:58:38.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.735+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f419a260 con 0x7f66f4106800 2024-09-21T12:58:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.736+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f4101f40 con 0x7f66f4106800 2024-09-21T12:58:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.737+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f66e8009a30 con 0x7f66f4106800 2024-09-21T12:58:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.737+0000 7f66f17fa640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f66dc07af80 0x7f66dc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:58:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.737+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f66e809dc20 con 0x7f66f4106800 2024-09-21T12:58:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.737+0000 7f66f3fff640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f66dc07af80 0x7f66dc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:58:38.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.738+0000 7f66f3fff640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f66dc07af80 0x7f66dc07d440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000c00 tx=0x7f66e4031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:58:38.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:38.742+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66e80691f0 con 0x7f66f4106800 2024-09-21T12:58:38.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:38 smithi046 ceph-mon[108126]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:38.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:38 smithi046 ceph-mon[108126]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:38.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:38 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1084247195' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:58:38.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:38 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3498280658' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.006+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f66f419af40 con 0x7f66f4106800 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.007+0000 7f66f17fa640 1 -- 172.21.15.46:0/1953420633 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f66e806e0a0 con 0x7f66f4106800 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:58:39.008 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f66dc07af80 msgr2=0x7f66dc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f66dc07af80 0x7f66dc07d440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f66e4000c00 tx=0x7f66e4031420 comp rx=0 tx=0).stop 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 msgr2=0x7f66f419fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f419fd60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f66e800d6f0 tx=0x7f66e800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 shutdown_connections 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f66dc07af80 0x7f66dc07d440 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f66f4106800 0x7f66f419fd60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 --2- 172.21.15.46:0/1953420633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f66f4100800 0x7f66f419f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 >> 172.21.15.46:0/1953420633 conn(0x7f66f40fc520 msgr2=0x7f66f40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 shutdown_connections 2024-09-21T12:58:39.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:58:39.009+0000 7f66fa8a3640 1 -- 172.21.15.46:0/1953420633 wait complete. 2024-09-21T12:58:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:38 smithi176 ceph-mon[80162]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:38 smithi176 ceph-mon[80162]: from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:38 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1084247195' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:58:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:38 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3498280658' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:58:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:39 smithi176 ceph-mon[80162]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:40.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:39 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1953420633' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:58:40.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:39 smithi046 ceph-mon[108126]: from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:58:40.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:39 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1953420633' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:58:41.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:40 smithi046 ceph-mon[108126]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:40 smithi176 ceph-mon[80162]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:42 smithi046 ceph-mon[108126]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:42 smithi176 ceph-mon[80162]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:44.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:44 smithi046 ceph-mon[108126]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:44.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:45.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:44 smithi176 ceph-mon[80162]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:45.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:58:47.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:46 smithi046 ceph-mon[108126]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:46 smithi176 ceph-mon[80162]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:49.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:48 smithi046 ceph-mon[108126]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:48 smithi176 ceph-mon[80162]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:51.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:50 smithi046 ceph-mon[108126]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:50 smithi176 ceph-mon[80162]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:53.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:52 smithi046 ceph-mon[108126]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:52 smithi176 ceph-mon[80162]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:55.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:54 smithi046 ceph-mon[108126]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:54 smithi176 ceph-mon[80162]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:57.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:56 smithi046 ceph-mon[108126]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:56 smithi176 ceph-mon[80162]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:59.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:58 smithi046 ceph-mon[108126]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:58:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:58 smithi176 ceph-mon[80162]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:00.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:58:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:58:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:00 smithi046 ceph-mon[108126]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:00 smithi176 ceph-mon[80162]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:03.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:02 smithi046 ceph-mon[108126]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:02 smithi176 ceph-mon[80162]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:05.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:04 smithi046 ceph-mon[108126]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:05.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:04 smithi176 ceph-mon[80162]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:07.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:06 smithi046 ceph-mon[108126]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:06 smithi176 ceph-mon[80162]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:09.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.106+0000 7f3192146640 1 -- 172.21.15.46:0/553125803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c106800 msgr2=0x7f318c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.106+0000 7f3192146640 1 --2- 172.21.15.46:0/553125803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c106800 0x7f318c106be0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f317c009880 tx=0x7f317c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 -- 172.21.15.46:0/553125803 shutdown_connections 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 --2- 172.21.15.46:0/553125803 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c100800 0x7f318c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 --2- 172.21.15.46:0/553125803 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c106800 0x7f318c106be0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 -- 172.21.15.46:0/553125803 >> 172.21.15.46:0/553125803 conn(0x7f318c0fc520 msgr2=0x7f318c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 -- 172.21.15.46:0/553125803 shutdown_connections 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 -- 172.21.15.46:0/553125803 wait complete. 2024-09-21T12:59:09.110 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.107+0000 7f3192146640 1 Processor -- start 2024-09-21T12:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f3192146640 1 -- start start 2024-09-21T12:59:09.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f3192146640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 0x7f318c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f3192146640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c106800 0x7f318c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f3192146640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f318c10dcd0 con 0x7f318c100800 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f3192146640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f318c10db50 con 0x7f318c106800 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f318b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 0x7f318c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f318b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 0x7f318c19f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43758/0 (socket says 172.21.15.46:43758) 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f318b7fe640 1 -- 172.21.15.46:0/1695982901 learned_addr learned my addr 172.21.15.46:0/1695982901 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.108+0000 7f318affd640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c106800 0x7f318c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f318b7fe640 1 -- 172.21.15.46:0/1695982901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c106800 msgr2=0x7f318c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f318b7fe640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c106800 0x7f318c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f318b7fe640 1 -- 172.21.15.46:0/1695982901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318c1999a0 con 0x7f318c100800 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f318b7fe640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 0x7f318c19f7e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f317c031460 tx=0x7f317c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:09.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f317c03f070 con 0x7f318c100800 2024-09-21T12:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f317c0035f0 con 0x7f318c100800 2024-09-21T12:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318c199c30 con 0x7f318c100800 2024-09-21T12:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f317c035030 con 0x7f318c100800 2024-09-21T12:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.109+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318c19a160 con 0x7f318c100800 2024-09-21T12:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.110+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f318c101f40 con 0x7f318c100800 2024-09-21T12:59:09.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.111+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f317c042070 con 0x7f318c100800 2024-09-21T12:59:09.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.112+0000 7f3188ff9640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f317407af80 0x7f317407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.112+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f317c0be8e0 con 0x7f318c100800 2024-09-21T12:59:09.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.112+0000 7f318affd640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f317407af80 0x7f317407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.113+0000 7f318affd640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f317407af80 0x7f317407d440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f318c0fea80 tx=0x7f3180005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:09.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.117+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f317c089eb0 con 0x7f318c100800 2024-09-21T12:59:09.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:08 smithi046 ceph-mon[108126]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:08 smithi176 ceph-mon[80162]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:09.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.323+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f318c19a4d0 con 0x7f317407af80 2024-09-21T12:59:09.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.324+0000 7f3188ff9640 1 -- 172.21.15.46:0/1695982901 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f318c19a4d0 con 0x7f317407af80 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.326+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f317407af80 msgr2=0x7f317407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.326+0000 7f3192146640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f317407af80 0x7f317407d440 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f318c0fea80 tx=0x7f3180005f90 comp rx=0 tx=0).stop 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.326+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 msgr2=0x7f318c19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.326+0000 7f3192146640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 0x7f318c19f7e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f317c031460 tx=0x7f317c004530 comp rx=0 tx=0).stop 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 shutdown_connections 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f317407af80 0x7f317407d440 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f318c106800 0x7f318c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 --2- 172.21.15.46:0/1695982901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f318c100800 0x7f318c19f7e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 >> 172.21.15.46:0/1695982901 conn(0x7f318c0fc520 msgr2=0x7f318c0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:09.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 shutdown_connections 2024-09-21T12:59:09.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.327+0000 7f3192146640 1 -- 172.21.15.46:0/1695982901 wait complete. 2024-09-21T12:59:09.338 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:59:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 -- 172.21.15.46:0/2857184666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 msgr2=0x7ff50c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 --2- 172.21.15.46:0/2857184666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c102ea0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc009880 tx=0x7ff4fc02a530 comp rx=0 tx=0).stop 2024-09-21T12:59:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 -- 172.21.15.46:0/2857184666 shutdown_connections 2024-09-21T12:59:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 --2- 172.21.15.46:0/2857184666 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 0x7ff50c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.415 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 --2- 172.21.15.46:0/2857184666 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c102ea0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 -- 172.21.15.46:0/2857184666 >> 172.21.15.46:0/2857184666 conn(0x7ff50c0fc520 msgr2=0x7ff50c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:09.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 -- 172.21.15.46:0/2857184666 shutdown_connections 2024-09-21T12:59:09.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 -- 172.21.15.46:0/2857184666 wait complete. 2024-09-21T12:59:09.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.413+0000 7ff511bc0640 1 Processor -- start 2024-09-21T12:59:09.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff511bc0640 1 -- start start 2024-09-21T12:59:09.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff511bc0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff511bc0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 0x7ff50c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff511bc0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c10edf0 con 0x7ff50c102ac0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff511bc0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c10ec70 con 0x7ff50c1033e0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43782/0 (socket says 172.21.15.46:43782) 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50b7fe640 1 -- 172.21.15.46:0/3939346472 learned_addr learned my addr 172.21.15.46:0/3939346472 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50affd640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 0x7ff50c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50b7fe640 1 -- 172.21.15.46:0/3939346472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 msgr2=0x7ff50c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50b7fe640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 0x7ff50c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50b7fe640 1 -- 172.21.15.46:0/3939346472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c1977c0 con 0x7ff50c102ac0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.414+0000 7ff50affd640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 0x7ff50c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.415+0000 7ff50b7fe640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c19d640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc031460 tx=0x7ff4fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.415+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4fc03f070 con 0x7ff50c102ac0 2024-09-21T12:59:09.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.415+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff4fc004cf0 con 0x7ff50c102ac0 2024-09-21T12:59:09.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.415+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff4fc035030 con 0x7ff50c102ac0 2024-09-21T12:59:09.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.415+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c197a50 con 0x7ff50c102ac0 2024-09-21T12:59:09.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.415+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c197f80 con 0x7ff50c102ac0 2024-09-21T12:59:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.416+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c06aa90 con 0x7ff50c102ac0 2024-09-21T12:59:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.417+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff4fc042070 con 0x7ff50c102ac0 2024-09-21T12:59:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.417+0000 7ff508ff9640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff4f407af30 0x7ff4f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.417+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff4fc0bec10 con 0x7ff50c102ac0 2024-09-21T12:59:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.417+0000 7ff50affd640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff4f407af30 0x7ff4f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.418+0000 7ff50affd640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff4f407af30 0x7ff4f407d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff50c108900 tx=0x7ff500005dd0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:09.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.422+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff4fc08a0c0 con 0x7ff50c102ac0 2024-09-21T12:59:09.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.627+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff50c198230 con 0x7ff4f407af30 2024-09-21T12:59:09.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.629+0000 7ff508ff9640 1 -- 172.21.15.46:0/3939346472 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff50c198230 con 0x7ff4f407af30 2024-09-21T12:59:09.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff4f407af30 msgr2=0x7ff4f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff4f407af30 0x7ff4f407d3f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff50c108900 tx=0x7ff500005dd0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 msgr2=0x7ff50c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c19d640 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc031460 tx=0x7ff4fc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 shutdown_connections 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff4f407af30 0x7ff4f407d3f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff50c1033e0 0x7ff50c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 --2- 172.21.15.46:0/3939346472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff50c102ac0 0x7ff50c19d640 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.631+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 >> 172.21.15.46:0/3939346472 conn(0x7ff50c0fc520 msgr2=0x7ff50c10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.632+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 shutdown_connections 2024-09-21T12:59:09.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.632+0000 7ff511bc0640 1 -- 172.21.15.46:0/3939346472 wait complete. 2024-09-21T12:59:09.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 -- 172.21.15.46:0/3332952584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec106800 msgr2=0x7efcec106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3332952584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec106800 0x7efcec106be0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009880 tx=0x7efcdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 -- 172.21.15.46:0/3332952584 shutdown_connections 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3332952584 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec100800 0x7efcec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3332952584 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec106800 0x7efcec106be0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 -- 172.21.15.46:0/3332952584 >> 172.21.15.46:0/3332952584 conn(0x7efcec0fc520 msgr2=0x7efcec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 -- 172.21.15.46:0/3332952584 shutdown_connections 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.716+0000 7efcf0c63640 1 -- 172.21.15.46:0/3332952584 wait complete. 2024-09-21T12:59:09.719 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcf0c63640 1 Processor -- start 2024-09-21T12:59:09.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcf0c63640 1 -- start start 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcf0c63640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 0x7efcec19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcf0c63640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec106800 0x7efcec19fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcf0c63640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efcec10dcb0 con 0x7efcec100800 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcf0c63640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efcec10db30 con 0x7efcec106800 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcea59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 0x7efcec19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcea59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 0x7efcec19f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43806/0 (socket says 172.21.15.46:43806) 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efcea59c640 1 -- 172.21.15.46:0/3924038000 learned_addr learned my addr 172.21.15.46:0/3924038000 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.717+0000 7efce1d9b640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec106800 0x7efcec19fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efcea59c640 1 -- 172.21.15.46:0/3924038000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec106800 msgr2=0x7efcec19fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efcea59c640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec106800 0x7efcec19fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efcea59c640 1 -- 172.21.15.46:0/3924038000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcec1999e0 con 0x7efcec100800 2024-09-21T12:59:09.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efcea59c640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 0x7efcec19f820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efcdc031460 tx=0x7efcdc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcdc03f070 con 0x7efcec100800 2024-09-21T12:59:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efcdc0035f0 con 0x7efcec100800 2024-09-21T12:59:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcec199c70 con 0x7efcec100800 2024-09-21T12:59:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efcdc035030 con 0x7efcec100800 2024-09-21T12:59:09.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.718+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcec19a1a0 con 0x7efcec100800 2024-09-21T12:59:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.719+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcec101f40 con 0x7efcec100800 2024-09-21T12:59:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.720+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efcdc042070 con 0x7efcec100800 2024-09-21T12:59:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.720+0000 7efce3fff640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efcd807af30 0x7efcd807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.720+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efcdc0bea20 con 0x7efcec100800 2024-09-21T12:59:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.720+0000 7efce1d9b640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efcd807af30 0x7efcd807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:09.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.721+0000 7efce1d9b640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efcd807af30 0x7efcd807d3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efcec0ffb60 tx=0x7efcd400b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:09.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.725+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efcdc089f70 con 0x7efcec100800 2024-09-21T12:59:09.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.920+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efcec19afe0 con 0x7efcd807af30 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.930+0000 7efce3fff640 1 -- 172.21.15.46:0/3924038000 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7efcec19afe0 con 0x7efcd807af30 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (9m) 3m ago 20m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (12m) 3m ago 20m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (12m) 2m ago 19m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (7m) 3m ago 20m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:59:09.932 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (7m) 2m ago 19m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (8m) 3m ago 19m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (3m) 3m ago 14m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (3m) 3m ago 14m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (3m) 2m ago 14m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (2m) 2m ago 14m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (11m) 3m ago 21m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (10m) 2m ago 19m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (7m) 3m ago 21m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (7m) 2m ago 19m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (10m) 3m ago 20m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (10m) 2m ago 19m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 3m ago 18m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 3m ago 17m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:59:09.933 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (5m) 3m ago 17m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:59:09.934 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (5m) 2m ago 16m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:59:09.934 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (4m) 2m ago 16m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:59:09.934 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (4m) 2m ago 15m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:59:09.934 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (9m) 3m ago 19m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.932+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efcd807af30 msgr2=0x7efcd807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.932+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efcd807af30 0x7efcd807d3f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7efcec0ffb60 tx=0x7efcd400b410 comp rx=0 tx=0).stop 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 msgr2=0x7efcec19f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 0x7efcec19f820 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efcdc031460 tx=0x7efcdc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 shutdown_connections 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efcd807af30 0x7efcd807d3f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efcec106800 0x7efcec19fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 --2- 172.21.15.46:0/3924038000 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efcec100800 0x7efcec19f820 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 >> 172.21.15.46:0/3924038000 conn(0x7efcec0fc520 msgr2=0x7efcec06a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:09.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 shutdown_connections 2024-09-21T12:59:09.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:09.933+0000 7efcf0c63640 1 -- 172.21.15.46:0/3924038000 wait complete. 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 -- 172.21.15.46:0/3442726987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108101900 msgr2=0x7f4108101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 --2- 172.21.15.46:0/3442726987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108101900 0x7f4108101d60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009880 tx=0x7f40f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 -- 172.21.15.46:0/3442726987 shutdown_connections 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 --2- 172.21.15.46:0/3442726987 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108101900 0x7f4108101d60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 --2- 172.21.15.46:0/3442726987 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4108107900 0x7f4108107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 -- 172.21.15.46:0/3442726987 >> 172.21.15.46:0/3442726987 conn(0x7f41080fd600 msgr2=0x7f41080ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:10.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 -- 172.21.15.46:0/3442726987 shutdown_connections 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.016+0000 7f410d5ec640 1 -- 172.21.15.46:0/3442726987 wait complete. 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f410d5ec640 1 Processor -- start 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f410d5ec640 1 -- start start 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f410d5ec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4108101900 0x7f41080744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f410d5ec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 0x7f4108074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f410d5ec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f410810edd0 con 0x7f4108107900 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f410d5ec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f410810ec50 con 0x7f4108101900 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f41067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 0x7f4108074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f41067fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 0x7f4108074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43816/0 (socket says 172.21.15.46:43816) 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f41067fc640 1 -- 172.21.15.46:0/1997186479 learned_addr learned my addr 172.21.15.46:0/1997186479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:10.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f4106ffd640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4108101900 0x7f41080744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f41067fc640 1 -- 172.21.15.46:0/1997186479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4108101900 msgr2=0x7f41080744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f41067fc640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4108101900 0x7f41080744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.017+0000 7f41067fc640 1 -- 172.21.15.46:0/1997186479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4108074f70 con 0x7f4108107900 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.018+0000 7f41067fc640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 0x7f4108074a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40f0031460 tx=0x7f40f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.018+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40f003f070 con 0x7f4108107900 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.018+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4108075200 con 0x7f4108107900 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.018+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40f00035f0 con 0x7f4108107900 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.018+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40f0035030 con 0x7f4108107900 2024-09-21T12:59:10.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.018+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41081a3dc0 con 0x7f4108107900 2024-09-21T12:59:10.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.019+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4108103040 con 0x7f4108107900 2024-09-21T12:59:10.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.020+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f40f0042070 con 0x7f4108107900 2024-09-21T12:59:10.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.020+0000 7f40fffff640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f407af30 0x7f40f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.020+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f40f00bea20 con 0x7f4108107900 2024-09-21T12:59:10.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.020+0000 7f4106ffd640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f407af30 0x7f40f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.021+0000 7f4106ffd640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f407af30 0x7f40f407d3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4100005fd0 tx=0x7f4100009680 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:10.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.025+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40f0089f70 con 0x7f4108107900 2024-09-21T12:59:10.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:09 smithi046 ceph-mon[108126]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:10.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.290+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4108109e70 con 0x7f4108107900 2024-09-21T12:59:10.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.290+0000 7f40fffff640 1 -- 172.21.15.46:0/1997186479 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f40f008ee20 con 0x7f4108107900 2024-09-21T12:59:10.292 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:59:10.293 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:59:10.294 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:10.294 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:59:10.294 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:59:10.294 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:59:10.294 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.292+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f407af30 msgr2=0x7f40f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.292+0000 7f410d5ec640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f407af30 0x7f40f407d3f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4100005fd0 tx=0x7f4100009680 comp rx=0 tx=0).stop 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.292+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 msgr2=0x7f4108074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.292+0000 7f410d5ec640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 0x7f4108074a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f40f0031460 tx=0x7f40f00045e0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 shutdown_connections 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f407af30 0x7f40f407d3f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4108107900 0x7f4108074a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 --2- 172.21.15.46:0/1997186479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4108101900 0x7f41080744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 >> 172.21.15.46:0/1997186479 conn(0x7f41080fd600 msgr2=0x7f41080fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:10.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 shutdown_connections 2024-09-21T12:59:10.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.293+0000 7f410d5ec640 1 -- 172.21.15.46:0/1997186479 wait complete. 2024-09-21T12:59:10.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:09 smithi176 ceph-mon[80162]: from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:10.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1621315338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 msgr2=0x7f4f5810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1621315338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5810b8c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4f48009880 tx=0x7f4f4802a530 comp rx=0 tx=0).stop 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1621315338 shutdown_connections 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1621315338 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5810b8c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1621315338 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 0x7f4f58102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1621315338 >> 172.21.15.46:0/1621315338 conn(0x7f4f580fc550 msgr2=0x7f4f580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1621315338 shutdown_connections 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1621315338 wait complete. 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 Processor -- start 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.378+0000 7f4f5fa0d640 1 -- start start 2024-09-21T12:59:10.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5fa0d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 0x7f4f5819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5fa0d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5fa0d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5810ee40 con 0x7f4f581033d0 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5fa0d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5810ecc0 con 0x7f4f58102ab0 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43838/0 (socket says 172.21.15.46:43838) 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 -- 172.21.15.46:0/1799652623 learned_addr learned my addr 172.21.15.46:0/1799652623 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5d7a9640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 0x7f4f5819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 -- 172.21.15.46:0/1799652623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 msgr2=0x7f4f5819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 0x7f4f5819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 -- 172.21.15.46:0/1799652623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f58197830 con 0x7f4f581033d0 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5d7a9640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 0x7f4f5819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:59:10.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5cfa8640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5819dbf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4f48031460 tx=0x7f4f480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:10.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f4803f070 con 0x7f4f581033d0 2024-09-21T12:59:10.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.379+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f58197ac0 con 0x7f4f581033d0 2024-09-21T12:59:10.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.380+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f48004ac0 con 0x7f4f581033d0 2024-09-21T12:59:10.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.380+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f48035030 con 0x7f4f581033d0 2024-09-21T12:59:10.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.380+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f58197ff0 con 0x7f4f581033d0 2024-09-21T12:59:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.381+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f5806a580 con 0x7f4f581033d0 2024-09-21T12:59:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.381+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4f48042070 con 0x7f4f581033d0 2024-09-21T12:59:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.382+0000 7f4f4e7fc640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f4407af80 0x7f4f4407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.382+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4f480beaa0 con 0x7f4f581033d0 2024-09-21T12:59:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.382+0000 7f4f5d7a9640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f4407af80 0x7f4f4407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.382+0000 7f4f5d7a9640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f4407af80 0x7f4f4407d440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006fd0 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:10.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.386+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f4808a070 con 0x7f4f581033d0 2024-09-21T12:59:10.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.614+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f4f58105f50 con 0x7f4f581033d0 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.614+0000 7f4f4e7fc640 1 -- 172.21.15.46:0/1799652623 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f4f4808ef20 con 0x7f4f581033d0 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:59:10.617 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:59:10.618 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:59:10.619 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:10.620 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f4407af80 msgr2=0x7f4f4407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f4407af80 0x7f4f4407d440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4f54006fd0 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 msgr2=0x7f4f5819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5819dbf0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4f48031460 tx=0x7f4f480046c0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 shutdown_connections 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f4407af80 0x7f4f4407d440 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f581033d0 0x7f4f5819dbf0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 --2- 172.21.15.46:0/1799652623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f58102ab0 0x7f4f5819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 >> 172.21.15.46:0/1799652623 conn(0x7f4f580fc550 msgr2=0x7f4f58108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:10.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 shutdown_connections 2024-09-21T12:59:10.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.617+0000 7f4f5fa0d640 1 -- 172.21.15.46:0/1799652623 wait complete. 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.702+0000 7ff31cfd8640 1 -- 172.21.15.46:0/3464653923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 msgr2=0x7ff31810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.702+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/3464653923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31810b8d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009880 tx=0x7ff30c02a530 comp rx=0 tx=0).stop 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.702+0000 7ff31cfd8640 1 -- 172.21.15.46:0/3464653923 shutdown_connections 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.702+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/3464653923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31810b8d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.702+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/3464653923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff318102ac0 0x7ff318102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.702+0000 7ff31cfd8640 1 -- 172.21.15.46:0/3464653923 >> 172.21.15.46:0/3464653923 conn(0x7ff3180fc520 msgr2=0x7ff3180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.703+0000 7ff31cfd8640 1 -- 172.21.15.46:0/3464653923 shutdown_connections 2024-09-21T12:59:10.705 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.703+0000 7ff31cfd8640 1 -- 172.21.15.46:0/3464653923 wait complete. 2024-09-21T12:59:10.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.703+0000 7ff31cfd8640 1 Processor -- start 2024-09-21T12:59:10.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.703+0000 7ff31cfd8640 1 -- start start 2024-09-21T12:59:10.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff31cfd8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff318102ac0 0x7ff31819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff31cfd8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff31cfd8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff31810edd0 con 0x7ff3181033e0 2024-09-21T12:59:10.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff31cfd8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff31810ec50 con 0x7ff318102ac0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43866/0 (socket says 172.21.15.46:43866) 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 -- 172.21.15.46:0/2153981208 learned_addr learned my addr 172.21.15.46:0/2153981208 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff31659c640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff318102ac0 0x7ff31819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 -- 172.21.15.46:0/2153981208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff318102ac0 msgr2=0x7ff31819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff318102ac0 0x7ff31819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 -- 172.21.15.46:0/2153981208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3181977e0 con 0x7ff3181033e0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.704+0000 7ff315d9b640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31819dba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff30c031460 tx=0x7ff30c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.705+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff30c03f070 con 0x7ff3181033e0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.705+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff318197a70 con 0x7ff3181033e0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.705+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff30c004ac0 con 0x7ff3181033e0 2024-09-21T12:59:10.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.705+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff30c035030 con 0x7ff3181033e0 2024-09-21T12:59:10.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.705+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff318197fa0 con 0x7ff3181033e0 2024-09-21T12:59:10.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.706+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff31806aa90 con 0x7ff3181033e0 2024-09-21T12:59:10.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.706+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff30c042070 con 0x7ff3181033e0 2024-09-21T12:59:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.707+0000 7ff3077fe640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff30007af30 0x7ff30007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.707+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff30c0beb10 con 0x7ff3181033e0 2024-09-21T12:59:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.707+0000 7ff31659c640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff30007af30 0x7ff30007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:10.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.708+0000 7ff31659c640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff30007af30 0x7ff30007d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff30800ba40 tx=0x7ff308005cc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:10.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.711+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff30c08a060 con 0x7ff3181033e0 2024-09-21T12:59:10.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.917+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff318198310 con 0x7ff30007af30 2024-09-21T12:59:10.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.918+0000 7ff3077fe640 1 -- 172.21.15.46:0/2153981208 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff318198310 con 0x7ff30007af30 2024-09-21T12:59:10.920 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:59:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:59:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:59:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:59:10.920 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:59:10.921 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:59:10.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff30007af30 msgr2=0x7ff30007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff30007af30 0x7ff30007d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff30800ba40 tx=0x7ff308005cc0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 msgr2=0x7ff31819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31819dba0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff30c031460 tx=0x7ff30c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 shutdown_connections 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff30007af30 0x7ff30007d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff3181033e0 0x7ff31819dba0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 --2- 172.21.15.46:0/2153981208 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff318102ac0 0x7ff31819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 >> 172.21.15.46:0/2153981208 conn(0x7ff3180fc520 msgr2=0x7ff318108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 shutdown_connections 2024-09-21T12:59:10.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:10.920+0000 7ff31cfd8640 1 -- 172.21.15.46:0/2153981208 wait complete. 2024-09-21T12:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 -- 172.21.15.46:0/780431402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1067f0 msgr2=0x7f3bec106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 --2- 172.21.15.46:0/780431402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1067f0 0x7f3bec106bd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009880 tx=0x7f3be802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 -- 172.21.15.46:0/780431402 shutdown_connections 2024-09-21T12:59:11.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 --2- 172.21.15.46:0/780431402 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bec1007f0 0x7f3bec100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 --2- 172.21.15.46:0/780431402 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1067f0 0x7f3bec106bd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 -- 172.21.15.46:0/780431402 >> 172.21.15.46:0/780431402 conn(0x7f3bec0fc550 msgr2=0x7f3bec0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 -- 172.21.15.46:0/780431402 shutdown_connections 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 -- 172.21.15.46:0/780431402 wait complete. 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 Processor -- start 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.005+0000 7f3bf358e640 1 -- start start 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf358e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 0x7f3bec19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf358e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bec1067f0 0x7f3bec19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf358e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec10dcc0 con 0x7f3bec1007f0 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf358e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec10db40 con 0x7f3bec1067f0 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 0x7f3bec19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 0x7f3bec19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43884/0 (socket says 172.21.15.46:43884) 2024-09-21T12:59:11.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 -- 172.21.15.46:0/1390867085 learned_addr learned my addr 172.21.15.46:0/1390867085 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf0b29640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bec1067f0 0x7f3bec19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 -- 172.21.15.46:0/1390867085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bec1067f0 msgr2=0x7f3bec19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bec1067f0 0x7f3bec19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 -- 172.21.15.46:0/1390867085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec1977b0 con 0x7f3bec1007f0 2024-09-21T12:59:11.010 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3bf132a640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 0x7f3bec19d630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3be8031460 tx=0x7f3be80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.006+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3be803f070 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.007+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3be8004b10 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.007+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec197a40 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.007+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3be8035030 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.007+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec197f70 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.008+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec101f30 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.008+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3be8042070 con 0x7f3bec1007f0 2024-09-21T12:59:11.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.009+0000 7f3be27fc640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3bd807af90 0x7f3bd807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.009+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3be80bea70 con 0x7f3bec1007f0 2024-09-21T12:59:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.009+0000 7f3bf0b29640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3bd807af90 0x7f3bd807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:11.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.009+0000 7f3bf0b29640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3bd807af90 0x7f3bd807d450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3bec104fd0 tx=0x7f3bdc00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:11.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.014+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3be808a040 con 0x7f3bec1007f0 2024-09-21T12:59:11.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:10 smithi046 ceph-mon[108126]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:10 smithi046 ceph-mon[108126]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:10 smithi046 ceph-mon[108126]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:10 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1997186479' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:59:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:10 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1799652623' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:59:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.274+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f3bec109d70 con 0x7f3bec1007f0 2024-09-21T12:59:11.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.274+0000 7f3be27fc640 1 -- 172.21.15.46:0/1390867085 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f3be808eef0 con 0x7f3bec1007f0 2024-09-21T12:59:11.276 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:59:11.277 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:59:11.277 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:59:11.277 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:59:11.277 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:59:11.277 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:59:11.277 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3bd807af90 msgr2=0x7f3bd807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3bd807af90 0x7f3bd807d450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3bec104fd0 tx=0x7f3bdc00b390 comp rx=0 tx=0).stop 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 msgr2=0x7f3bec19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 0x7f3bec19d630 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3be8031460 tx=0x7f3be80045e0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 shutdown_connections 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3bd807af90 0x7f3bd807d450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3bec1067f0 0x7f3bec19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 --2- 172.21.15.46:0/1390867085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3bec1007f0 0x7f3bec19d630 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:11.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.276+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 >> 172.21.15.46:0/1390867085 conn(0x7f3bec0fc550 msgr2=0x7f3bec069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:11.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.277+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 shutdown_connections 2024-09-21T12:59:11.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:11.277+0000 7f3bf358e640 1 -- 172.21.15.46:0/1390867085 wait complete. 2024-09-21T12:59:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:10 smithi176 ceph-mon[80162]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:10 smithi176 ceph-mon[80162]: from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:10 smithi176 ceph-mon[80162]: from='client.34542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:10 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1997186479' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:59:11.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:10 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1799652623' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:59:12.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:11 smithi046 ceph-mon[108126]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:12.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:11 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1390867085' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:59:12.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:11 smithi176 ceph-mon[80162]: from='client.34554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:12.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:11 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1390867085' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:59:13.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:12 smithi176 ceph-mon[80162]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:13.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:12 smithi046 ceph-mon[108126]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:14 smithi176 ceph-mon[80162]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:15.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:14 smithi046 ceph-mon[108126]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:16 smithi176 ceph-mon[80162]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:16 smithi046 ceph-mon[108126]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:19.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:18 smithi176 ceph-mon[80162]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:19.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:18 smithi046 ceph-mon[108126]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:20 smithi176 ceph-mon[80162]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:20 smithi046 ceph-mon[108126]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:22 smithi176 ceph-mon[80162]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:23.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:22 smithi046 ceph-mon[108126]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:25.262 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:24 smithi046 ceph-mon[108126]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:25.309 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:24 smithi176 ceph-mon[80162]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:26 smithi176 ceph-mon[80162]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:26 smithi046 ceph-mon[108126]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:28 smithi176 ceph-mon[80162]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:28 smithi046 ceph-mon[108126]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:30.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:30.337 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:30 smithi176 ceph-mon[80162]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:30 smithi046 ceph-mon[108126]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:32 smithi176 ceph-mon[80162]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:32 smithi046 ceph-mon[108126]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:34 smithi176 ceph-mon[80162]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:34 smithi046 ceph-mon[108126]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:36 smithi176 ceph-mon[80162]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:36 smithi046 ceph-mon[108126]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:38 smithi176 ceph-mon[80162]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:38 smithi046 ceph-mon[108126]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:40 smithi176 ceph-mon[80162]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:41.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 -- 172.21.15.46:0/934673749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4190102ab0 msgr2=0x7f4190102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 --2- 172.21.15.46:0/934673749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4190102ab0 0x7f4190102e90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f418c009880 tx=0x7f418c02a530 comp rx=0 tx=0).stop 2024-09-21T12:59:41.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 -- 172.21.15.46:0/934673749 shutdown_connections 2024-09-21T12:59:41.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 --2- 172.21.15.46:0/934673749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41901033d0 0x7f419010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 --2- 172.21.15.46:0/934673749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4190102ab0 0x7f4190102e90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 -- 172.21.15.46:0/934673749 >> 172.21.15.46:0/934673749 conn(0x7f41900fc550 msgr2=0x7f41900fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:41.377 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:40 smithi046 ceph-mon[108126]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 -- 172.21.15.46:0/934673749 shutdown_connections 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.375+0000 7f4197fb4640 1 -- 172.21.15.46:0/934673749 wait complete. 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4197fb4640 1 Processor -- start 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4197fb4640 1 -- start start 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4197fb4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4190102ab0 0x7f419019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4197fb4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 0x7f419019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4197fb4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f419010ede0 con 0x7f41901033d0 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4197fb4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f419010ec60 con 0x7f4190102ab0 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f419554f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 0x7f419019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f419554f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 0x7f419019db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33852/0 (socket says 172.21.15.46:33852) 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f419554f640 1 -- 172.21.15.46:0/1608838867 learned_addr learned my addr 172.21.15.46:0/1608838867 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.376+0000 7f4195d50640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4190102ab0 0x7f419019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f419554f640 1 -- 172.21.15.46:0/1608838867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4190102ab0 msgr2=0x7f419019d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f419554f640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4190102ab0 0x7f419019d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f419554f640 1 -- 172.21.15.46:0/1608838867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41901977b0 con 0x7f41901033d0 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f419554f640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 0x7f419019db70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f418000e970 tx=0x7f418000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f418000cac0 con 0x7f41901033d0 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f41800054e0 con 0x7f41901033d0 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4190197aa0 con 0x7f41901033d0 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4180004dd0 con 0x7f41901033d0 2024-09-21T12:59:41.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.377+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4190198030 con 0x7f41901033d0 2024-09-21T12:59:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.378+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419006a580 con 0x7f41901033d0 2024-09-21T12:59:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.379+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4180005020 con 0x7f41901033d0 2024-09-21T12:59:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.380+0000 7f4186ffd640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f417c07af30 0x7f417c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.380+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f418009e680 con 0x7f41901033d0 2024-09-21T12:59:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.380+0000 7f4195d50640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f417c07af30 0x7f417c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.380+0000 7f4195d50640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f417c07af30 0x7f417c07d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f418c0096c0 tx=0x7f418c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:41.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.384+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4180069bb0 con 0x7f41901033d0 2024-09-21T12:59:41.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.590+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4190198340 con 0x7f417c07af30 2024-09-21T12:59:41.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.591+0000 7f4186ffd640 1 -- 172.21.15.46:0/1608838867 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4190198340 con 0x7f417c07af30 2024-09-21T12:59:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f417c07af30 msgr2=0x7f417c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f417c07af30 0x7f417c07d3f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f418c0096c0 tx=0x7f418c031400 comp rx=0 tx=0).stop 2024-09-21T12:59:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 msgr2=0x7f419019db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 0x7f419019db70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f418000e970 tx=0x7f418000ee30 comp rx=0 tx=0).stop 2024-09-21T12:59:41.594 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 shutdown_connections 2024-09-21T12:59:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f417c07af30 0x7f417c07d3f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f41901033d0 0x7f419019db70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 --2- 172.21.15.46:0/1608838867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4190102ab0 0x7f419019d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 >> 172.21.15.46:0/1608838867 conn(0x7f41900fc550 msgr2=0x7f419010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 shutdown_connections 2024-09-21T12:59:41.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.593+0000 7f4197fb4640 1 -- 172.21.15.46:0/1608838867 wait complete. 2024-09-21T12:59:41.603 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 -- 172.21.15.46:0/3715163721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 msgr2=0x7f4604101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 --2- 172.21.15.46:0/3715163721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f4604101d60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f45f8009880 tx=0x7f45f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 -- 172.21.15.46:0/3715163721 shutdown_connections 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 --2- 172.21.15.46:0/3715163721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f4604101d60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 --2- 172.21.15.46:0/3715163721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4604107900 0x7f4604107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 -- 172.21.15.46:0/3715163721 >> 172.21.15.46:0/3715163721 conn(0x7f46040fd600 msgr2=0x7f46040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 -- 172.21.15.46:0/3715163721 shutdown_connections 2024-09-21T12:59:41.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.679+0000 7f460892c640 1 -- 172.21.15.46:0/3715163721 wait complete. 2024-09-21T12:59:41.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.680+0000 7f460892c640 1 Processor -- start 2024-09-21T12:59:41.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.680+0000 7f460892c640 1 -- start start 2024-09-21T12:59:41.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460892c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f460419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460892c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4604107900 0x7f460419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460892c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f460410edb0 con 0x7f4604101900 2024-09-21T12:59:41.683 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460892c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f460410ec30 con 0x7f4604107900 2024-09-21T12:59:41.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f460419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f460419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33870/0 (socket says 172.21.15.46:33870) 2024-09-21T12:59:41.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 -- 172.21.15.46:0/226668066 learned_addr learned my addr 172.21.15.46:0/226668066 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:41.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f4601d9b640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4604107900 0x7f460419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 -- 172.21.15.46:0/226668066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4604107900 msgr2=0x7f460419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4604107900 0x7f460419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 -- 172.21.15.46:0/226668066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46041977d0 con 0x7f4604101900 2024-09-21T12:59:41.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460259c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f460419d650 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f45f400d8d0 tx=0x7f45f400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:41.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45f4017070 con 0x7f4604101900 2024-09-21T12:59:41.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45f4010460 con 0x7f4604101900 2024-09-21T12:59:41.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4604197ac0 con 0x7f4604101900 2024-09-21T12:59:41.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.681+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45f400f5f0 con 0x7f4604101900 2024-09-21T12:59:41.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.682+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4604198020 con 0x7f4604101900 2024-09-21T12:59:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.682+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4604103040 con 0x7f4604101900 2024-09-21T12:59:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.683+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f45f4009a30 con 0x7f4604101900 2024-09-21T12:59:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.684+0000 7f45f37fe640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45ec07af80 0x7f45ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.684+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f45f409df40 con 0x7f4604101900 2024-09-21T12:59:41.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.684+0000 7f4601d9b640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45ec07af80 0x7f45ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.684+0000 7f4601d9b640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45ec07af80 0x7f45ec07d440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4604198b20 tx=0x7f45f8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:41.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.688+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45f4069470 con 0x7f4604101900 2024-09-21T12:59:41.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.893+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f46041982d0 con 0x7f45ec07af80 2024-09-21T12:59:41.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.894+0000 7f45f37fe640 1 -- 172.21.15.46:0/226668066 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f46041982d0 con 0x7f45ec07af80 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45ec07af80 msgr2=0x7f45ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45ec07af80 0x7f45ec07d440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4604198b20 tx=0x7f45f8031400 comp rx=0 tx=0).stop 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 msgr2=0x7f460419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f460419d650 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f45f400d8d0 tx=0x7f45f400dd90 comp rx=0 tx=0).stop 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 shutdown_connections 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45ec07af80 0x7f45ec07d440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4604107900 0x7f460419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 --2- 172.21.15.46:0/226668066 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4604101900 0x7f460419d650 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 >> 172.21.15.46:0/226668066 conn(0x7f46040fd600 msgr2=0x7f46040fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 shutdown_connections 2024-09-21T12:59:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.897+0000 7f460892c640 1 -- 172.21.15.46:0/226668066 wait complete. 2024-09-21T12:59:41.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.982+0000 7faac1227640 1 -- 172.21.15.46:0/621214607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 msgr2=0x7faabc100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.982+0000 7faac1227640 1 --2- 172.21.15.46:0/621214607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc100c60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009880 tx=0x7faaa402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.982+0000 7faac1227640 1 -- 172.21.15.46:0/621214607 shutdown_connections 2024-09-21T12:59:41.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.982+0000 7faac1227640 1 --2- 172.21.15.46:0/621214607 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc100c60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.982+0000 7faac1227640 1 --2- 172.21.15.46:0/621214607 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 0x7faabc106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.982+0000 7faac1227640 1 -- 172.21.15.46:0/621214607 >> 172.21.15.46:0/621214607 conn(0x7faabc0fc520 msgr2=0x7faabc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:41.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.983+0000 7faac1227640 1 -- 172.21.15.46:0/621214607 shutdown_connections 2024-09-21T12:59:41.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.983+0000 7faac1227640 1 -- 172.21.15.46:0/621214607 wait complete. 2024-09-21T12:59:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.983+0000 7faac1227640 1 Processor -- start 2024-09-21T12:59:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faac1227640 1 -- start start 2024-09-21T12:59:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faac1227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faac1227640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 0x7faabc198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faac1227640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faabc10dcb0 con 0x7faabc100800 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faac1227640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faabc10db30 con 0x7faabc106800 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faabad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faabad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33882/0 (socket says 172.21.15.46:33882) 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faabad9d640 1 -- 172.21.15.46:0/2471832693 learned_addr learned my addr 172.21.15.46:0/2471832693 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faab3fff640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 0x7faabc198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faabad9d640 1 -- 172.21.15.46:0/2471832693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 msgr2=0x7faabc198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faabad9d640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 0x7faabc198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faabad9d640 1 -- 172.21.15.46:0/2471832693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc1992c0 con 0x7faabc100800 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.984+0000 7faab3fff640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 0x7faabc198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.985+0000 7faabad9d640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc1987c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c8a0 tx=0x7faaac00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.985+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faaac0079b0 con 0x7faabc100800 2024-09-21T12:59:41.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.985+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc1995b0 con 0x7faabc100800 2024-09-21T12:59:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.985+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faaac007b50 con 0x7faabc100800 2024-09-21T12:59:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.985+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faaac018700 con 0x7faabc100800 2024-09-21T12:59:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.985+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc1a1ba0 con 0x7faabc100800 2024-09-21T12:59:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.986+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc101f40 con 0x7faabc100800 2024-09-21T12:59:41.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.987+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faaac007d00 con 0x7faabc100800 2024-09-21T12:59:41.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.987+0000 7faab8d99640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faaa807af80 0x7faaa807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:41.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.987+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faaac09e2d0 con 0x7faabc100800 2024-09-21T12:59:41.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.988+0000 7faab3fff640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faaa807af80 0x7faaa807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:41.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.988+0000 7faab3fff640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faaa807af80 0x7faaa807d440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faaa4006010 tx=0x7faaa40095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:41.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:41.992+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faaac014030 con 0x7faabc100800 2024-09-21T12:59:42.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.190+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7faabc062630 con 0x7faaa807af80 2024-09-21T12:59:42.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.199+0000 7faab8d99640 1 -- 172.21.15.46:0/2471832693 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7faabc062630 con 0x7faaa807af80 2024-09-21T12:59:42.200 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (9m) 3m ago 20m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (13m) 3m ago 20m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (12m) 3m ago 20m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 3m ago 20m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (7m) 3m ago 20m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (9m) 3m ago 20m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (4m) 3m ago 15m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (4m) 3m ago 15m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (3m) 3m ago 15m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T12:59:42.201 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (3m) 3m ago 15m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (12m) 3m ago 22m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (11m) 3m ago 19m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (8m) 3m ago 22m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (8m) 3m ago 19m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (10m) 3m ago 20m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (10m) 3m ago 19m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (7m) 3m ago 18m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (6m) 3m ago 18m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 3m ago 17m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (5m) 3m ago 17m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T12:59:42.202 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (5m) 3m ago 16m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T12:59:42.203 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (4m) 3m ago 16m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T12:59:42.203 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (10m) 3m ago 20m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T12:59:42.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faaa807af80 msgr2=0x7faaa807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faaa807af80 0x7faaa807d440 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7faaa4006010 tx=0x7faaa40095f0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 msgr2=0x7faabc1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc1987c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c8a0 tx=0x7faaac00cd60 comp rx=0 tx=0).stop 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 shutdown_connections 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faaa807af80 0x7faaa807d440 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faabc106800 0x7faabc198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 --2- 172.21.15.46:0/2471832693 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faabc100800 0x7faabc1987c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 >> 172.21.15.46:0/2471832693 conn(0x7faabc0fc520 msgr2=0x7faabc0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 shutdown_connections 2024-09-21T12:59:42.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.202+0000 7faac1227640 1 -- 172.21.15.46:0/2471832693 wait complete. 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.285+0000 7fd932700640 1 -- 172.21.15.46:0/2396375683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c100800 msgr2=0x7fd92c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.285+0000 7fd932700640 1 --2- 172.21.15.46:0/2396375683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c100800 0x7fd92c100c60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd920009880 tx=0x7fd92002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.285+0000 7fd932700640 1 -- 172.21.15.46:0/2396375683 shutdown_connections 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.285+0000 7fd932700640 1 --2- 172.21.15.46:0/2396375683 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c100800 0x7fd92c100c60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.285+0000 7fd932700640 1 --2- 172.21.15.46:0/2396375683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92c106800 0x7fd92c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.285+0000 7fd932700640 1 -- 172.21.15.46:0/2396375683 >> 172.21.15.46:0/2396375683 conn(0x7fd92c0fc520 msgr2=0x7fd92c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.286+0000 7fd932700640 1 -- 172.21.15.46:0/2396375683 shutdown_connections 2024-09-21T12:59:42.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.286+0000 7fd932700640 1 -- 172.21.15.46:0/2396375683 wait complete. 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.286+0000 7fd932700640 1 Processor -- start 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.286+0000 7fd932700640 1 -- start start 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd932700640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92c100800 0x7fd92c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd932700640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 0x7fd92c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd932700640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c10dcb0 con 0x7fd92c106800 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd932700640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd92c10db30 con 0x7fd92c100800 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 0x7fd92c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 0x7fd92c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33890/0 (socket says 172.21.15.46:33890) 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 -- 172.21.15.46:0/3788849548 learned_addr learned my addr 172.21.15.46:0/3788849548 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92bfff640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92c100800 0x7fd92c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 -- 172.21.15.46:0/3788849548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92c100800 msgr2=0x7fd92c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92c100800 0x7fd92c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 -- 172.21.15.46:0/3788849548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd92c1977f0 con 0x7fd92c106800 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.287+0000 7fd92b7fe640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 0x7fd92c19dbb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd920031460 tx=0x7fd9200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.288+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd92003f070 con 0x7fd92c106800 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.288+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9200035f0 con 0x7fd92c106800 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.288+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd92c197a80 con 0x7fd92c106800 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.288+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd920035030 con 0x7fd92c106800 2024-09-21T12:59:42.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.288+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd92c197fb0 con 0x7fd92c106800 2024-09-21T12:59:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.289+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd92c101f40 con 0x7fd92c106800 2024-09-21T12:59:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.290+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd920042070 con 0x7fd92c106800 2024-09-21T12:59:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.290+0000 7fd9297fa640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd91407f340 0x7fd914081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.290+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd9200bea00 con 0x7fd92c106800 2024-09-21T12:59:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.291+0000 7fd92bfff640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd91407f340 0x7fd914081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.291+0000 7fd92bfff640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd91407f340 0x7fd914081800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00bbe0 tx=0x7fd91c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:42.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.295+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd920089f50 con 0x7fd92c106800 2024-09-21T12:59:42.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.559+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd92c109da0 con 0x7fd92c106800 2024-09-21T12:59:42.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.560+0000 7fd9297fa640 1 -- 172.21.15.46:0/3788849548 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fd92008ee00 con 0x7fd92c106800 2024-09-21T12:59:42.561 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T12:59:42.562 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T12:59:42.563 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T12:59:42.563 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd91407f340 msgr2=0x7fd914081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd91407f340 0x7fd914081800 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd91c00bbe0 tx=0x7fd91c00b390 comp rx=0 tx=0).stop 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 msgr2=0x7fd92c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 0x7fd92c19dbb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd920031460 tx=0x7fd9200045e0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 shutdown_connections 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd91407f340 0x7fd914081800 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd92c106800 0x7fd92c19dbb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 --2- 172.21.15.46:0/3788849548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd92c100800 0x7fd92c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.562+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 >> 172.21.15.46:0/3788849548 conn(0x7fd92c0fc520 msgr2=0x7fd92c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.563+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 shutdown_connections 2024-09-21T12:59:42.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.563+0000 7fd932700640 1 -- 172.21.15.46:0/3788849548 wait complete. 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 -- 172.21.15.46:0/3396634107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 msgr2=0x7f7978106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 --2- 172.21.15.46:0/3396634107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f7978106bd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f7968009c20 tx=0x7f796802a970 comp rx=0 tx=0).stop 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 -- 172.21.15.46:0/3396634107 shutdown_connections 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 --2- 172.21.15.46:0/3396634107 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 0x7f7978100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 --2- 172.21.15.46:0/3396634107 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f7978106bd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 -- 172.21.15.46:0/3396634107 >> 172.21.15.46:0/3396634107 conn(0x7f79780fc550 msgr2=0x7f79780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 -- 172.21.15.46:0/3396634107 shutdown_connections 2024-09-21T12:59:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 -- 172.21.15.46:0/3396634107 wait complete. 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.647+0000 7f797c854640 1 Processor -- start 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797c854640 1 -- start start 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797c854640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 0x7f797819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797c854640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f797819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797c854640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f797810dca0 con 0x7f79781067f0 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797c854640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f797810db20 con 0x7f79781007f0 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f797819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f797819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33910/0 (socket says 172.21.15.46:33910) 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 -- 172.21.15.46:0/1666345686 learned_addr learned my addr 172.21.15.46:0/1666345686 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797659c640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 0x7f797819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 -- 172.21.15.46:0/1666345686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 msgr2=0x7f797819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 0x7f797819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 -- 172.21.15.46:0/1666345686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7978197750 con 0x7f79781067f0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f797659c640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 0x7f797819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.648+0000 7f7975d9b640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f797819dbc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f796000c8a0 tx=0x7f796000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.649+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79600079b0 con 0x7f79781067f0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.649+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7978197a40 con 0x7f79781067f0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.649+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7960007b50 con 0x7f79781067f0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.649+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7960018700 con 0x7f79781067f0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.649+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7978197fd0 con 0x7f79781067f0 2024-09-21T12:59:42.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.650+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7978101f30 con 0x7f79781067f0 2024-09-21T12:59:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.650+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7960007d00 con 0x7f79781067f0 2024-09-21T12:59:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.651+0000 7f796f7fe640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f796407af30 0x7f796407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.651+0000 7f797659c640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f796407af30 0x7f796407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.651+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f796009e390 con 0x7f79781067f0 2024-09-21T12:59:42.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.651+0000 7f797659c640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f796407af30 0x7f796407d3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7968005e30 tx=0x7f7968005da0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:42.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.655+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7960014030 con 0x7f79781067f0 2024-09-21T12:59:42.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.879+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7978198340 con 0x7f79781067f0 2024-09-21T12:59:42.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.880+0000 7f796f7fe640 1 -- 172.21.15.46:0/1666345686 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f7960069880 con 0x7f79781067f0 2024-09-21T12:59:42.882 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T12:59:42.882 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T12:59:42.882 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:59:42.882 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:59:42.882 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T12:59:42.883 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:42.883 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:59:42.883 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T12:59:42.883 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T12:59:42.883 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T12:59:42.884 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T12:59:42.885 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T12:59:42.885 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T12:59:42.885 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T12:59:42.885 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T12:59:42.885 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:59:42.885 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T12:59:42.886 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T12:59:42.887 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T12:59:42.887 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T12:59:42.887 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T12:59:42.887 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T12:59:42.887 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:59:42.887 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:42.888 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:59:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T12:59:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f796407af30 msgr2=0x7f796407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f796407af30 0x7f796407d3f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7968005e30 tx=0x7f7968005da0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 msgr2=0x7f797819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f797819dbc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f796000c8a0 tx=0x7f796000cd60 comp rx=0 tx=0).stop 2024-09-21T12:59:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 shutdown_connections 2024-09-21T12:59:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f796407af30 0x7f796407d3f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79781067f0 0x7f797819dbc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 --2- 172.21.15.46:0/1666345686 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79781007f0 0x7f797819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 >> 172.21.15.46:0/1666345686 conn(0x7f79780fc550 msgr2=0x7f7978069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 shutdown_connections 2024-09-21T12:59:42.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.882+0000 7f797c854640 1 -- 172.21.15.46:0/1666345686 wait complete. 2024-09-21T12:59:42.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 -- 172.21.15.46:0/2846865455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c103430 msgr2=0x7f608c10b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.969 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2846865455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c103430 0x7f608c10b920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f607c0098b0 tx=0x7f607c02a560 comp rx=0 tx=0).stop 2024-09-21T12:59:42.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 -- 172.21.15.46:0/2846865455 shutdown_connections 2024-09-21T12:59:42.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2846865455 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c103430 0x7f608c10b920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2846865455 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c102b10 0x7f608c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 -- 172.21.15.46:0/2846865455 >> 172.21.15.46:0/2846865455 conn(0x7f608c0fc550 msgr2=0x7f608c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:42.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 -- 172.21.15.46:0/2846865455 shutdown_connections 2024-09-21T12:59:42.970 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.968+0000 7f6093fd2640 1 -- 172.21.15.46:0/2846865455 wait complete. 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6093fd2640 1 Processor -- start 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6093fd2640 1 -- start start 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6093fd2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 0x7f608c100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6093fd2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c103430 0x7f608c100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6093fd2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10ede0 con 0x7f608c102b10 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6093fd2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10ec60 con 0x7f608c103430 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6091d6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 0x7f608c100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6091d6e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 0x7f608c100770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33938/0 (socket says 172.21.15.46:33938) 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6091d6e640 1 -- 172.21.15.46:0/2800149030 learned_addr learned my addr 172.21.15.46:0/2800149030 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:42.972 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f609156d640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c103430 0x7f608c100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6091d6e640 1 -- 172.21.15.46:0/2800149030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c103430 msgr2=0x7f608c100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6091d6e640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c103430 0x7f608c100cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f6091d6e640 1 -- 172.21.15.46:0/2800149030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c1011f0 con 0x7f608c102b10 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.969+0000 7f609156d640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c103430 0x7f608c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.970+0000 7f6091d6e640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 0x7f608c100770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f608800e970 tx=0x7f608800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.970+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f608800cac0 con 0x7f608c102b10 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.970+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60880054e0 con 0x7f608c102b10 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.970+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608c1014e0 con 0x7f608c102b10 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.970+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6088010430 con 0x7f608c102b10 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.970+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608c1a3e70 con 0x7f608c102b10 2024-09-21T12:59:42.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.971+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608c06a520 con 0x7f608c102b10 2024-09-21T12:59:42.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.971+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6088004ea0 con 0x7f608c102b10 2024-09-21T12:59:42.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.972+0000 7f6082ffd640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f607807af40 0x7f607807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:42.974 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.972+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f608809e7f0 con 0x7f608c102b10 2024-09-21T12:59:42.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.972+0000 7f609156d640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f607807af40 0x7f607807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:42.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.973+0000 7f609156d640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f607807af40 0x7f607807d400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f607c000c00 tx=0x7f607c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:42.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:42.977+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6088069d40 con 0x7f608c102b10 2024-09-21T12:59:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:42 smithi046 ceph-mon[108126]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:42 smithi046 ceph-mon[108126]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:43.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:42 smithi046 ceph-mon[108126]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:43.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:42 smithi046 ceph-mon[108126]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:43.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:42 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3788849548' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:59:43.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:42 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1666345686' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:59:43.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.185+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f608c062630 con 0x7f607807af40 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.187+0000 7f6082ffd640 1 -- 172.21.15.46:0/2800149030 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f608c062630 con 0x7f607807af40 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T12:59:43.188 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T12:59:43.189 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f607807af40 msgr2=0x7f607807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f607807af40 0x7f607807d400 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f607c000c00 tx=0x7f607c031400 comp rx=0 tx=0).stop 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 msgr2=0x7f608c100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 0x7f608c100770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f608800e970 tx=0x7f608800ed70 comp rx=0 tx=0).stop 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 shutdown_connections 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f607807af40 0x7f607807d400 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f608c103430 0x7f608c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 --2- 172.21.15.46:0/2800149030 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f608c102b10 0x7f608c100770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 >> 172.21.15.46:0/2800149030 conn(0x7f608c0fc550 msgr2=0x7f608c103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 shutdown_connections 2024-09-21T12:59:43.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.189+0000 7f6093fd2640 1 -- 172.21.15.46:0/2800149030 wait complete. 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.273+0000 7f15e380f640 1 -- 172.21.15.46:0/2729612073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1011d0 msgr2=0x7f15dc1056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.273+0000 7f15e380f640 1 --2- 172.21.15.46:0/2729612073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1011d0 0x7f15dc1056a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009880 tx=0x7f15cc02a530 comp rx=0 tx=0).stop 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 -- 172.21.15.46:0/2729612073 shutdown_connections 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 --2- 172.21.15.46:0/2729612073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1011d0 0x7f15dc1056a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 --2- 172.21.15.46:0/2729612073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15dc1008b0 0x7f15dc100c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 -- 172.21.15.46:0/2729612073 >> 172.21.15.46:0/2729612073 conn(0x7f15dc0fc520 msgr2=0x7f15dc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:43.275 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 -- 172.21.15.46:0/2729612073 shutdown_connections 2024-09-21T12:59:43.276 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 -- 172.21.15.46:0/2729612073 wait complete. 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 Processor -- start 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.274+0000 7f15e380f640 1 -- start start 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e380f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 0x7f15dc19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e380f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15dc1011d0 0x7f15dc19e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e380f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc1153f0 con 0x7f15dc1008b0 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e380f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15dc115270 con 0x7f15dc1011d0 2024-09-21T12:59:43.277 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 0x7f15dc19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 0x7f15dc19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:33966/0 (socket says 172.21.15.46:33966) 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 -- 172.21.15.46:0/3382198736 learned_addr learned my addr 172.21.15.46:0/3382198736 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e0daa640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15dc1011d0 0x7f15dc19e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 -- 172.21.15.46:0/3382198736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15dc1011d0 msgr2=0x7f15dc19e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15dc1011d0 0x7f15dc19e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 -- 172.21.15.46:0/3382198736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15dc1a28a0 con 0x7f15dc1008b0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15e15ab640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 0x7f15dc19dfd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15d800d6f0 tx=0x7f15d800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.275+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15d8017070 con 0x7f15dc1008b0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.276+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15d800de00 con 0x7f15dc1008b0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.276+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15dc1a2b90 con 0x7f15dc1008b0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.276+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15d8004bb0 con 0x7f15dc1008b0 2024-09-21T12:59:43.278 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.276+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15dc1a3120 con 0x7f15dc1008b0 2024-09-21T12:59:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.277+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15dc06aa90 con 0x7f15dc1008b0 2024-09-21T12:59:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.277+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f15d8004e60 con 0x7f15dc1008b0 2024-09-21T12:59:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.278+0000 7f15d27fc640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15c807af30 0x7f15c807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:59:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.278+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f15d809dd00 con 0x7f15dc1008b0 2024-09-21T12:59:43.279 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.278+0000 7f15e0daa640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15c807af30 0x7f15c807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:59:43.280 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.278+0000 7f15e0daa640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15c807af30 0x7f15c807d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15dc1124f0 tx=0x7f15cc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:59:43.283 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.282+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15d80a1030 con 0x7f15dc1008b0 2024-09-21T12:59:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:42 smithi176 ceph-mon[80162]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:42 smithi176 ceph-mon[80162]: from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:42 smithi176 ceph-mon[80162]: from='client.34566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:42 smithi176 ceph-mon[80162]: from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:42 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3788849548' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:59:43.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:42 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1666345686' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:59:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.546+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f15dc19f330 con 0x7f15dc1008b0 2024-09-21T12:59:43.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.546+0000 7f15d27fc640 1 -- 172.21.15.46:0/3382198736 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f15d8069250 con 0x7f15dc1008b0 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T12:59:43.548 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T12:59:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15c807af30 msgr2=0x7f15c807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15c807af30 0x7f15c807d3f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f15dc1124f0 tx=0x7f15cc031400 comp rx=0 tx=0).stop 2024-09-21T12:59:43.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 msgr2=0x7f15dc19dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 0x7f15dc19dfd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f15d800d6f0 tx=0x7f15d800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 shutdown_connections 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15c807af30 0x7f15c807d3f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15dc1011d0 0x7f15dc19e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 --2- 172.21.15.46:0/3382198736 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15dc1008b0 0x7f15dc19dfd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.548+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 >> 172.21.15.46:0/3382198736 conn(0x7f15dc0fc520 msgr2=0x7f15dc112c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.549+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 shutdown_connections 2024-09-21T12:59:43.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T12:59:43.549+0000 7f15e380f640 1 -- 172.21.15.46:0/3382198736 wait complete. 2024-09-21T12:59:44.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:43 smithi176 ceph-mon[80162]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:44.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:43 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3382198736' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:59:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:43 smithi046 ceph-mon[108126]: from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:59:44.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:43 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3382198736' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:59:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:44 smithi176 ceph-mon[80162]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:44 smithi046 ceph-mon[108126]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:59:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:46 smithi176 ceph-mon[80162]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:46 smithi046 ceph-mon[108126]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:49.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:48 smithi176 ceph-mon[80162]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:48 smithi046 ceph-mon[108126]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:50 smithi176 ceph-mon[80162]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:50 smithi046 ceph-mon[108126]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:52 smithi176 ceph-mon[80162]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:52 smithi046 ceph-mon[108126]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:54 smithi176 ceph-mon[80162]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:54 smithi046 ceph-mon[108126]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:56 smithi176 ceph-mon[80162]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:56 smithi046 ceph-mon[108126]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 12:59:58 smithi176 ceph-mon[80162]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:59:59.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:58 smithi046 ceph-mon[108126]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 12:59:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:00:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T12:59:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-09-21T13:00:01.002 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:01.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:00:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:00:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: fs cephfs is degraded 2024-09-21T13:00:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:00:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:00:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:00:01.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:00 smithi046 ceph-mon[108126]: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:00:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:00:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:00:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: fs cephfs is degraded 2024-09-21T13:00:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:00:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:00:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:00:01.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:00 smithi176 ceph-mon[80162]: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:00:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:03 smithi176 ceph-mon[80162]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:03 smithi046 ceph-mon[108126]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:05.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:05 smithi176 ceph-mon[80162]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:05 smithi046 ceph-mon[108126]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:07 smithi176 ceph-mon[80162]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:07 smithi046 ceph-mon[108126]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:09 smithi176 ceph-mon[80162]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:09 smithi046 ceph-mon[108126]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:11 smithi176 ceph-mon[80162]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:11 smithi046 ceph-mon[108126]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:13.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:13 smithi176 ceph-mon[80162]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:13.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:13 smithi046 ceph-mon[108126]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 -- 172.21.15.46:0/2142833623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4101900 msgr2=0x7f16a4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/2142833623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4101900 0x7f16a4101d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1698009880 tx=0x7f169802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 -- 172.21.15.46:0/2142833623 shutdown_connections 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/2142833623 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4101900 0x7f16a4101d60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/2142833623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a4107900 0x7f16a4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 -- 172.21.15.46:0/2142833623 >> 172.21.15.46:0/2142833623 conn(0x7f16a40fd600 msgr2=0x7f16a40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 -- 172.21.15.46:0/2142833623 shutdown_connections 2024-09-21T13:00:13.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.646+0000 7f16aa5bc640 1 -- 172.21.15.46:0/2142833623 wait complete. 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.647+0000 7f16aa5bc640 1 Processor -- start 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.647+0000 7f16aa5bc640 1 -- start start 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16aa5bc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a4101900 0x7f16a40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16aa5bc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 0x7f16a4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16aa5bc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410edd0 con 0x7f16a4107900 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16aa5bc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ec50 con 0x7f16a4101900 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 0x7f16a4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 0x7f16a4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45802/0 (socket says 172.21.15.46:45802) 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a37fe640 1 -- 172.21.15.46:0/1681878132 learned_addr learned my addr 172.21.15.46:0/1681878132 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a3fff640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a4101900 0x7f16a40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:13.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a37fe640 1 -- 172.21.15.46:0/1681878132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a4101900 msgr2=0x7f16a40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a37fe640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a4101900 0x7f16a40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.648+0000 7f16a37fe640 1 -- 172.21.15.46:0/1681878132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a4074f70 con 0x7f16a4107900 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.649+0000 7f16a37fe640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 0x7f16a4074a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1698031460 tx=0x7f16980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.649+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f169803f070 con 0x7f16a4107900 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.649+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a4075200 con 0x7f16a4107900 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.649+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1698004cf0 con 0x7f16a4107900 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.649+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1698035030 con 0x7f16a4107900 2024-09-21T13:00:13.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.649+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a41a3d60 con 0x7f16a4107900 2024-09-21T13:00:13.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.650+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4103040 con 0x7f16a4107900 2024-09-21T13:00:13.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.651+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1698042070 con 0x7f16a4107900 2024-09-21T13:00:13.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.651+0000 7f16a17fa640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f168c07af30 0x7f168c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:13.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.651+0000 7f16a3fff640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f168c07af30 0x7f168c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:13.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.651+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f16980beb70 con 0x7f16a4107900 2024-09-21T13:00:13.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.652+0000 7f16a3fff640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f168c07af30 0x7f168c07d3f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1694005fd0 tx=0x7f1694005e20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:13.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.656+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f169808a0c0 con 0x7f16a4107900 2024-09-21T13:00:13.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.859+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f16a4062630 con 0x7f168c07af30 2024-09-21T13:00:13.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.861+0000 7f16a17fa640 1 -- 172.21.15.46:0/1681878132 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f16a4062630 con 0x7f168c07af30 2024-09-21T13:00:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f168c07af30 msgr2=0x7f168c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f168c07af30 0x7f168c07d3f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1694005fd0 tx=0x7f1694005e20 comp rx=0 tx=0).stop 2024-09-21T13:00:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 msgr2=0x7f16a4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 0x7f16a4074a30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1698031460 tx=0x7f16980048f0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 shutdown_connections 2024-09-21T13:00:13.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f168c07af30 0x7f168c07d3f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16a4107900 0x7f16a4074a30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 --2- 172.21.15.46:0/1681878132 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a4101900 0x7f16a40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 >> 172.21.15.46:0/1681878132 conn(0x7f16a40fd600 msgr2=0x7f16a40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 shutdown_connections 2024-09-21T13:00:13.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.863+0000 7f16aa5bc640 1 -- 172.21.15.46:0/1681878132 wait complete. 2024-09-21T13:00:13.874 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 -- 172.21.15.46:0/4191721176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1007f0 msgr2=0x7ff73c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 --2- 172.21.15.46:0/4191721176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1007f0 0x7ff73c100c50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff730009880 tx=0x7ff73002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 -- 172.21.15.46:0/4191721176 shutdown_connections 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 --2- 172.21.15.46:0/4191721176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1007f0 0x7ff73c100c50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 --2- 172.21.15.46:0/4191721176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff73c1067f0 0x7ff73c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 -- 172.21.15.46:0/4191721176 >> 172.21.15.46:0/4191721176 conn(0x7ff73c0fc550 msgr2=0x7ff73c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:13.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 -- 172.21.15.46:0/4191721176 shutdown_connections 2024-09-21T13:00:13.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 -- 172.21.15.46:0/4191721176 wait complete. 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 Processor -- start 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.951+0000 7ff742497640 1 -- start start 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff742497640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff73c1007f0 0x7ff73c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff742497640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 0x7ff73c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff742497640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c10dca0 con 0x7ff73c1067f0 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff742497640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff73c10db20 con 0x7ff73c1007f0 2024-09-21T13:00:13.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 0x7ff73c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 0x7ff73c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45820/0 (socket says 172.21.15.46:45820) 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 -- 172.21.15.46:0/1023077565 learned_addr learned my addr 172.21.15.46:0/1023077565 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73bfff640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff73c1007f0 0x7ff73c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 -- 172.21.15.46:0/1023077565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff73c1007f0 msgr2=0x7ff73c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff73c1007f0 0x7ff73c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 -- 172.21.15.46:0/1023077565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73c0fd700 con 0x7ff73c1067f0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.952+0000 7ff73b7fe640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 0x7ff73c0fd1c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff730031460 tx=0x7ff7300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.953+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff73003f070 con 0x7ff73c1067f0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.953+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7300044d0 con 0x7ff73c1067f0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.953+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73c0fd990 con 0x7ff73c1067f0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.953+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff730035030 con 0x7ff73c1067f0 2024-09-21T13:00:13.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.953+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73c1a3cf0 con 0x7ff73c1067f0 2024-09-21T13:00:13.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.954+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff73c101f30 con 0x7ff73c1067f0 2024-09-21T13:00:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.954+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff730042070 con 0x7ff73c1067f0 2024-09-21T13:00:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.955+0000 7ff7397fa640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff72407af90 0x7ff72407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.955+0000 7ff73bfff640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff72407af90 0x7ff72407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.955+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff7300beae0 con 0x7ff73c1067f0 2024-09-21T13:00:13.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.956+0000 7ff73bfff640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff72407af90 0x7ff72407d450 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005e10 tx=0x7ff72c005da0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:13.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:13.959+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff730004cf0 con 0x7ff73c1067f0 2024-09-21T13:00:14.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.165+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff73c062630 con 0x7ff72407af90 2024-09-21T13:00:14.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.166+0000 7ff7397fa640 1 -- 172.21.15.46:0/1023077565 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff73c062630 con 0x7ff72407af90 2024-09-21T13:00:14.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff72407af90 msgr2=0x7ff72407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff72407af90 0x7ff72407d450 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005e10 tx=0x7ff72c005da0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 msgr2=0x7ff73c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 0x7ff73c0fd1c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff730031460 tx=0x7ff7300048f0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 shutdown_connections 2024-09-21T13:00:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff72407af90 0x7ff72407d450 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff73c1067f0 0x7ff73c0fd1c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 --2- 172.21.15.46:0/1023077565 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff73c1007f0 0x7ff73c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 >> 172.21.15.46:0/1023077565 conn(0x7ff73c0fc550 msgr2=0x7ff73c069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 shutdown_connections 2024-09-21T13:00:14.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.168+0000 7ff742497640 1 -- 172.21.15.46:0/1023077565 wait complete. 2024-09-21T13:00:14.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 -- 172.21.15.46:0/2300163127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 msgr2=0x7f3424102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2300163127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f3424102f30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3420009c20 tx=0x7f342002aa00 comp rx=0 tx=0).stop 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 -- 172.21.15.46:0/2300163127 shutdown_connections 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2300163127 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3424103470 0x7f342410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2300163127 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f3424102f30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 -- 172.21.15.46:0/2300163127 >> 172.21.15.46:0/2300163127 conn(0x7f34240fc550 msgr2=0x7f34240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 -- 172.21.15.46:0/2300163127 shutdown_connections 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 -- 172.21.15.46:0/2300163127 wait complete. 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.253+0000 7f342bc1e640 1 Processor -- start 2024-09-21T13:00:14.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f342bc1e640 1 -- start start 2024-09-21T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f342bc1e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f342419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f342bc1e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3424103470 0x7f342419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f342bc1e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f342410ede0 con 0x7f3424102b50 2024-09-21T13:00:14.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f342bc1e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f342410ec60 con 0x7f3424103470 2024-09-21T13:00:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34299ba640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f342419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34299ba640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f342419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45834/0 (socket says 172.21.15.46:45834) 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34299ba640 1 -- 172.21.15.46:0/2514327184 learned_addr learned my addr 172.21.15.46:0/2514327184 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34291b9640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3424103470 0x7f342419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34299ba640 1 -- 172.21.15.46:0/2514327184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3424103470 msgr2=0x7f342419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34299ba640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3424103470 0x7f342419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.254+0000 7f34299ba640 1 -- 172.21.15.46:0/2514327184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34241977d0 con 0x7f3424102b50 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.255+0000 7f34299ba640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f342419d650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f342002af20 tx=0x7f342002ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.255+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3420047070 con 0x7f3424102b50 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.255+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3420003e30 con 0x7f3424102b50 2024-09-21T13:00:14.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.255+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3424197a60 con 0x7f3424102b50 2024-09-21T13:00:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.255+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3420033050 con 0x7f3424102b50 2024-09-21T13:00:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.255+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3424197f90 con 0x7f3424102b50 2024-09-21T13:00:14.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.256+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f342406a4e0 con 0x7f3424102b50 2024-09-21T13:00:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.257+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f342004a070 con 0x7f3424102b50 2024-09-21T13:00:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.257+0000 7f3416ffd640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f341007af30 0x7f341007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.257+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f342003e030 con 0x7f3424102b50 2024-09-21T13:00:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.258+0000 7f34291b9640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f341007af30 0x7f341007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.258+0000 7f34291b9640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f341007af30 0x7f341007d3f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3424108920 tx=0x7f341800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:14.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.263+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f342008a740 con 0x7f3424102b50 2024-09-21T13:00:14.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.472+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3424198240 con 0x7f341007af30 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.481+0000 7f3416ffd640 1 -- 172.21.15.46:0/2514327184 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f3424198240 con 0x7f341007af30 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (10m) 4m ago 21m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (13m) 4m ago 21m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (13m) 4m ago 20m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (8m) 4m ago 21m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:00:14.482 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (8m) 4m ago 20m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (10m) 4m ago 21m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (4m) 4m ago 15m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (4m) 4m ago 15m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (4m) 4m ago 15m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (4m) 4m ago 15m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (12m) 4m ago 22m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (11m) 4m ago 20m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 4m ago 22m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (8m) 4m ago 20m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (11m) 4m ago 21m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (11m) 4m ago 20m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 4m ago 19m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (7m) 4m ago 18m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (6m) 4m ago 18m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (6m) 4m ago 17m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:00:14.483 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (5m) 4m ago 17m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:00:14.484 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (5m) 4m ago 16m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:00:14.484 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (10m) 4m ago 20m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:00:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f341007af30 msgr2=0x7f341007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f341007af30 0x7f341007d3f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3424108920 tx=0x7f341800b390 comp rx=0 tx=0).stop 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 msgr2=0x7f342419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f342419d650 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f342002af20 tx=0x7f342002ee50 comp rx=0 tx=0).stop 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 shutdown_connections 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f341007af30 0x7f341007d3f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3424103470 0x7f342419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 --2- 172.21.15.46:0/2514327184 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3424102b50 0x7f342419d650 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 >> 172.21.15.46:0/2514327184 conn(0x7f34240fc550 msgr2=0x7f3424108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.483+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 shutdown_connections 2024-09-21T13:00:14.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.484+0000 7f342bc1e640 1 -- 172.21.15.46:0/2514327184 wait complete. 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.567+0000 7f6a062d3640 1 -- 172.21.15.46:0/791961614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00107900 msgr2=0x7f6a00107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.567+0000 7f6a062d3640 1 --2- 172.21.15.46:0/791961614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00107900 0x7f6a00107ce0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f69f0009880 tx=0x7f69f002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.567+0000 7f6a062d3640 1 -- 172.21.15.46:0/791961614 shutdown_connections 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.567+0000 7f6a062d3640 1 --2- 172.21.15.46:0/791961614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00101900 0x7f6a00101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.567+0000 7f6a062d3640 1 --2- 172.21.15.46:0/791961614 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00107900 0x7f6a00107ce0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.567+0000 7f6a062d3640 1 -- 172.21.15.46:0/791961614 >> 172.21.15.46:0/791961614 conn(0x7f6a000fd600 msgr2=0x7f6a000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.568+0000 7f6a062d3640 1 -- 172.21.15.46:0/791961614 shutdown_connections 2024-09-21T13:00:14.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.568+0000 7f6a062d3640 1 -- 172.21.15.46:0/791961614 wait complete. 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.568+0000 7f6a062d3640 1 Processor -- start 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.568+0000 7f6a062d3640 1 -- start start 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f6a062d3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 0x7f6a0019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f6a062d3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00107900 0x7f6a0019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f6a062d3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0010edb0 con 0x7f6a00101900 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f6a062d3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0010ec30 con 0x7f6a00107900 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 0x7f6a0019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 0x7f6a0019f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45856/0 (socket says 172.21.15.46:45856) 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 -- 172.21.15.46:0/479600290 learned_addr learned my addr 172.21.15.46:0/479600290 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:14.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69ff7fe640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00107900 0x7f6a0019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 -- 172.21.15.46:0/479600290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00107900 msgr2=0x7f6a0019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00107900 0x7f6a0019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 -- 172.21.15.46:0/479600290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00199a50 con 0x7f6a00101900 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69ff7fe640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00107900 0x7f6a0019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.569+0000 7f69fffff640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 0x7f6a0019f890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f69f0031460 tx=0x7f69f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.570+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69f003f070 con 0x7f6a00101900 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.570+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69f00035f0 con 0x7f6a00101900 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.570+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a00199ce0 con 0x7f6a00101900 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.570+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f69f0035030 con 0x7f6a00101900 2024-09-21T13:00:14.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.570+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0019a210 con 0x7f6a00101900 2024-09-21T13:00:14.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.571+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a00103040 con 0x7f6a00101900 2024-09-21T13:00:14.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.572+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f69f0042070 con 0x7f6a00101900 2024-09-21T13:00:14.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.572+0000 7f69fd7fa640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f69e807af30 0x7f69e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.572+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f69f00bead0 con 0x7f6a00101900 2024-09-21T13:00:14.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.572+0000 7f69ff7fe640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f69e807af30 0x7f69e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.573+0000 7f69ff7fe640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f69e807af30 0x7f69e807d3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69f40058c0 tx=0x7f69f4005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:14.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.577+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f69f008a020 con 0x7f6a00101900 2024-09-21T13:00:14.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.845+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f6a0019af80 con 0x7f6a00101900 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.846+0000 7f69fd7fa640 1 -- 172.21.15.46:0/479600290 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f69f008c070 con 0x7f6a00101900 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:14.847 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:00:14.848 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f69e807af30 msgr2=0x7f69e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f69e807af30 0x7f69e807d3f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f69f40058c0 tx=0x7f69f4005850 comp rx=0 tx=0).stop 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 msgr2=0x7f6a0019f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 0x7f6a0019f890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f69f0031460 tx=0x7f69f00045e0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 shutdown_connections 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f69e807af30 0x7f69e807d3f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6a00107900 0x7f6a0019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 --2- 172.21.15.46:0/479600290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6a00101900 0x7f6a0019f890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 >> 172.21.15.46:0/479600290 conn(0x7f6a000fd600 msgr2=0x7f6a000fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 shutdown_connections 2024-09-21T13:00:14.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.848+0000 7f6a062d3640 1 -- 172.21.15.46:0/479600290 wait complete. 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 -- 172.21.15.46:0/2956961721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4107900 msgr2=0x7f0de4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/2956961721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4107900 0x7f0de4107ce0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4009880 tx=0x7f0dd402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 -- 172.21.15.46:0/2956961721 shutdown_connections 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/2956961721 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4101900 0x7f0de4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/2956961721 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4107900 0x7f0de4107ce0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 -- 172.21.15.46:0/2956961721 >> 172.21.15.46:0/2956961721 conn(0x7f0de40fd600 msgr2=0x7f0de40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 -- 172.21.15.46:0/2956961721 shutdown_connections 2024-09-21T13:00:14.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.933+0000 7f0dea0cc640 1 -- 172.21.15.46:0/2956961721 wait complete. 2024-09-21T13:00:14.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0dea0cc640 1 Processor -- start 2024-09-21T13:00:14.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0dea0cc640 1 -- start start 2024-09-21T13:00:14.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0dea0cc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 0x7f0de419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0dea0cc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4107900 0x7f0de419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0dea0cc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0de410edb0 con 0x7f0de4101900 2024-09-21T13:00:14.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0dea0cc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0de410ec30 con 0x7f0de4107900 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 0x7f0de419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 0x7f0de419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45868/0 (socket says 172.21.15.46:45868) 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de37fe640 1 -- 172.21.15.46:0/4015241178 learned_addr learned my addr 172.21.15.46:0/4015241178 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de2ffd640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4107900 0x7f0de419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de37fe640 1 -- 172.21.15.46:0/4015241178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4107900 msgr2=0x7f0de419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de37fe640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4107900 0x7f0de419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.934+0000 7f0de37fe640 1 -- 172.21.15.46:0/4015241178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de41977c0 con 0x7f0de4101900 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.935+0000 7f0de37fe640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 0x7f0de419d640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4031460 tx=0x7f0dd40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.935+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0dd403f070 con 0x7f0de4101900 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.935+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de4197a50 con 0x7f0de4101900 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.935+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0dd40035f0 con 0x7f0de4101900 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.935+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0dd4035030 con 0x7f0de4101900 2024-09-21T13:00:14.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.935+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de4197f80 con 0x7f0de4101900 2024-09-21T13:00:14.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.936+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de4103040 con 0x7f0de4101900 2024-09-21T13:00:14.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.937+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0dd4042070 con 0x7f0de4101900 2024-09-21T13:00:14.938 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.937+0000 7f0de0ff9640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dcc07af30 0x7f0dcc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:14.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.937+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0dd40bea20 con 0x7f0de4101900 2024-09-21T13:00:14.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.937+0000 7f0de2ffd640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dcc07af30 0x7f0dcc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:14.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.938+0000 7f0de2ffd640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dcc07af30 0x7f0dcc07d3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0de4100e00 tx=0x7f0dd800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:14.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:14.942+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0dd4089f70 con 0x7f0de4101900 2024-09-21T13:00:15.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:15 smithi046 ceph-mon[108126]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:15.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:15 smithi046 ceph-mon[108126]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:15.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:15 smithi046 ceph-mon[108126]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:15.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:15.116 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:15 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/479600290' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:00:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.168+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0de4104b10 con 0x7f0de4101900 2024-09-21T13:00:15.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.168+0000 7f0de0ff9640 1 -- 172.21.15.46:0/4015241178 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f0dd408ee20 con 0x7f0de4101900 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:00:15.170 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:00:15.171 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:15.172 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.170+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dcc07af30 msgr2=0x7f0dcc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.170+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dcc07af30 0x7f0dcc07d3f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0de4100e00 tx=0x7f0dd800b390 comp rx=0 tx=0).stop 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.170+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 msgr2=0x7f0de419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.170+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 0x7f0de419d640 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0dd4031460 tx=0x7f0dd40045e0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 shutdown_connections 2024-09-21T13:00:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dcc07af30 0x7f0dcc07d3f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0de4107900 0x7f0de419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 --2- 172.21.15.46:0/4015241178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0de4101900 0x7f0de419d640 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 >> 172.21.15.46:0/4015241178 conn(0x7f0de40fd600 msgr2=0x7f0de40ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 shutdown_connections 2024-09-21T13:00:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.171+0000 7f0dea0cc640 1 -- 172.21.15.46:0/4015241178 wait complete. 2024-09-21T13:00:15.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 -- 172.21.15.46:0/2873747910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 msgr2=0x7f3640101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 --2- 172.21.15.46:0/2873747910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f3640101d60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3634009880 tx=0x7f363402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 -- 172.21.15.46:0/2873747910 shutdown_connections 2024-09-21T13:00:15.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 --2- 172.21.15.46:0/2873747910 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f3640101d60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 --2- 172.21.15.46:0/2873747910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3640107900 0x7f3640107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 -- 172.21.15.46:0/2873747910 >> 172.21.15.46:0/2873747910 conn(0x7f36400fd600 msgr2=0x7f36400ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:15.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 -- 172.21.15.46:0/2873747910 shutdown_connections 2024-09-21T13:00:15.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 -- 172.21.15.46:0/2873747910 wait complete. 2024-09-21T13:00:15.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.256+0000 7f36468eb640 1 Processor -- start 2024-09-21T13:00:15.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f36468eb640 1 -- start start 2024-09-21T13:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f36468eb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f364019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f36468eb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3640107900 0x7f364019fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:15.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f36468eb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f364010ee30 con 0x7f3640101900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f36468eb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f364010ecb0 con 0x7f3640107900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f364019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f364019f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45894/0 (socket says 172.21.15.46:45894) 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363ffff640 1 -- 172.21.15.46:0/902870981 learned_addr learned my addr 172.21.15.46:0/902870981 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363f7fe640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3640107900 0x7f364019fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363ffff640 1 -- 172.21.15.46:0/902870981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3640107900 msgr2=0x7f364019fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363ffff640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3640107900 0x7f364019fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.257+0000 7f363ffff640 1 -- 172.21.15.46:0/902870981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3640199a90 con 0x7f3640101900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.258+0000 7f363ffff640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f364019f8d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f363000b420 tx=0x7f363000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.258+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3630011630 con 0x7f3640101900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.258+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3640199d80 con 0x7f3640101900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.258+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3630016070 con 0x7f3640101900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.258+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3630010d40 con 0x7f3640101900 2024-09-21T13:00:15.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.258+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f364019a2e0 con 0x7f3640101900 2024-09-21T13:00:15.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.259+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3640103040 con 0x7f3640101900 2024-09-21T13:00:15.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.260+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f363001b460 con 0x7f3640101900 2024-09-21T13:00:15.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.260+0000 7f363d7fa640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f362807af40 0x7f362807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:15.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.260+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f363009d740 con 0x7f3640101900 2024-09-21T13:00:15.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.260+0000 7f363f7fe640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f362807af40 0x7f362807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:15.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.261+0000 7f363f7fe640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f362807af40 0x7f362807d400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f364019b280 tx=0x7f3634031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:15.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.265+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3630068c90 con 0x7f3640101900 2024-09-21T13:00:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:15 smithi176 ceph-mon[80162]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:15 smithi176 ceph-mon[80162]: from='client.34590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:15 smithi176 ceph-mon[80162]: from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:15 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/479600290' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:00:15.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.473+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f364019a5f0 con 0x7f362807af40 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.474+0000 7f363d7fa640 1 -- 172.21.15.46:0/902870981 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f364019a5f0 con 0x7f362807af40 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:00:15.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:00:15.476 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:00:15.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f362807af40 msgr2=0x7f362807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f362807af40 0x7f362807d400 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f364019b280 tx=0x7f3634031400 comp rx=0 tx=0).stop 2024-09-21T13:00:15.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 msgr2=0x7f364019f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f364019f8d0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f363000b420 tx=0x7f363000b8e0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 shutdown_connections 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f362807af40 0x7f362807d400 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3640107900 0x7f364019fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 --2- 172.21.15.46:0/902870981 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3640101900 0x7f364019f8d0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 >> 172.21.15.46:0/902870981 conn(0x7f36400fd600 msgr2=0x7f3640074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 shutdown_connections 2024-09-21T13:00:15.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.476+0000 7f36468eb640 1 -- 172.21.15.46:0/902870981 wait complete. 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.560+0000 7fa0a19c3640 1 -- 172.21.15.46:0/1288679790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c1033d0 msgr2=0x7fa09c10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.560+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/1288679790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c1033d0 0x7fa09c10b8c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa090009880 tx=0x7fa09002a530 comp rx=0 tx=0).stop 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.560+0000 7fa0a19c3640 1 -- 172.21.15.46:0/1288679790 shutdown_connections 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.560+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/1288679790 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c1033d0 0x7fa09c10b8c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.560+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/1288679790 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c102ab0 0x7fa09c102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.560+0000 7fa0a19c3640 1 -- 172.21.15.46:0/1288679790 >> 172.21.15.46:0/1288679790 conn(0x7fa09c0fc550 msgr2=0x7fa09c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.561+0000 7fa0a19c3640 1 -- 172.21.15.46:0/1288679790 shutdown_connections 2024-09-21T13:00:15.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.561+0000 7fa0a19c3640 1 -- 172.21.15.46:0/1288679790 wait complete. 2024-09-21T13:00:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.561+0000 7fa0a19c3640 1 Processor -- start 2024-09-21T13:00:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.561+0000 7fa0a19c3640 1 -- start start 2024-09-21T13:00:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa0a19c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 0x7fa09c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa0a19c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c1033d0 0x7fa09c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa0a19c3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c10edc0 con 0x7fa09c102ab0 2024-09-21T13:00:15.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa0a19c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa09c10ec40 con 0x7fa09c1033d0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 0x7fa09c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 0x7fa09c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:45904/0 (socket says 172.21.15.46:45904) 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 -- 172.21.15.46:0/3074840253 learned_addr learned my addr 172.21.15.46:0/3074840253 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09a7fc640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c1033d0 0x7fa09c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 -- 172.21.15.46:0/3074840253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c1033d0 msgr2=0x7fa09c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c1033d0 0x7fa09c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 -- 172.21.15.46:0/3074840253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09c101190 con 0x7fa09c102ab0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09a7fc640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c1033d0 0x7fa09c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.562+0000 7fa09affd640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 0x7fa09c100710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c810 tx=0x7fa08c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.563+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa08c004020 con 0x7fa09c102ab0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.563+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa08c0041c0 con 0x7fa09c102ab0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.563+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09c101480 con 0x7fa09c102ab0 2024-09-21T13:00:15.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.563+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa08c0047a0 con 0x7fa09c102ab0 2024-09-21T13:00:15.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.563+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09c1a3e10 con 0x7fa09c102ab0 2024-09-21T13:00:15.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.564+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa09c06a580 con 0x7fa09c102ab0 2024-09-21T13:00:15.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.564+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa08c0079b0 con 0x7fa09c102ab0 2024-09-21T13:00:15.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.565+0000 7fa0a09c1640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa08407af80 0x7fa08407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:15.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.565+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa08c09df10 con 0x7fa09c102ab0 2024-09-21T13:00:15.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.565+0000 7fa09a7fc640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa08407af80 0x7fa08407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:15.567 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.566+0000 7fa09a7fc640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa08407af80 0x7fa08407d440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa090006010 tx=0x7fa0900095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:15.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.569+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa08c014030 con 0x7fa09c102ab0 2024-09-21T13:00:15.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.830+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa09c102e90 con 0x7fa09c102ab0 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.831+0000 7fa0a09c1640 1 -- 172.21.15.46:0/3074840253 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fa08c0694e0 con 0x7fa09c102ab0 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:00:15.832 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:00:15.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa08407af80 msgr2=0x7fa08407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa08407af80 0x7fa08407d440 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa090006010 tx=0x7fa0900095f0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 msgr2=0x7fa09c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:15.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 0x7fa09c100710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa08c00c810 tx=0x7fa08c00ccd0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 shutdown_connections 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa08407af80 0x7fa08407d440 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa09c1033d0 0x7fa09c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 --2- 172.21.15.46:0/3074840253 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa09c102ab0 0x7fa09c100710 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 >> 172.21.15.46:0/3074840253 conn(0x7fa09c0fc550 msgr2=0x7fa09c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 shutdown_connections 2024-09-21T13:00:15.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:15.833+0000 7fa0a19c3640 1 -- 172.21.15.46:0/3074840253 wait complete. 2024-09-21T13:00:16.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:16 smithi046 ceph-mon[108126]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:16.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:16 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4015241178' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:00:16.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:16 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3074840253' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:00:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:16 smithi176 ceph-mon[80162]: from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:16 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4015241178' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:00:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:16 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3074840253' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:00:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:17 smithi176 ceph-mon[80162]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:17 smithi176 ceph-mon[80162]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:17 smithi046 ceph-mon[108126]: from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:17 smithi046 ceph-mon[108126]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:19 smithi176 ceph-mon[80162]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:19.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:19 smithi046 ceph-mon[108126]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:21 smithi176 ceph-mon[80162]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:21 smithi046 ceph-mon[108126]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:23 smithi176 ceph-mon[80162]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:23.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:23 smithi046 ceph-mon[108126]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:25.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:25 smithi176 ceph-mon[80162]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:25 smithi046 ceph-mon[108126]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:27 smithi176 ceph-mon[80162]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:27 smithi046 ceph-mon[108126]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:29 smithi176 ceph-mon[80162]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:29 smithi046 ceph-mon[108126]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:30.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:31 smithi176 ceph-mon[80162]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:31 smithi046 ceph-mon[108126]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:33 smithi176 ceph-mon[80162]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:33 smithi046 ceph-mon[108126]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:35 smithi176 ceph-mon[80162]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:35 smithi046 ceph-mon[108126]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:37 smithi176 ceph-mon[80162]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:37.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:37 smithi046 ceph-mon[108126]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:39 smithi176 ceph-mon[80162]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:39 smithi046 ceph-mon[108126]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:41.408 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:41 smithi046 ceph-mon[108126]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:41.446 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:41 smithi176 ceph-mon[80162]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:43.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:43 smithi046 ceph-mon[108126]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:43 smithi176 ceph-mon[80162]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:45 smithi046 ceph-mon[108126]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:45 smithi176 ceph-mon[80162]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:00:45.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/3099795140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 msgr2=0x7f2e18106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:45.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/3099795140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18106be0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009880 tx=0x7f2e0802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:45.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/3099795140 shutdown_connections 2024-09-21T13:00:45.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/3099795140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 0x7f2e18100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:45.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/3099795140 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18106be0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:45.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/3099795140 >> 172.21.15.46:0/3099795140 conn(0x7f2e180fc520 msgr2=0x7f2e180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:45.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/3099795140 shutdown_connections 2024-09-21T13:00:45.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/3099795140 wait complete. 2024-09-21T13:00:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.930+0000 7f2e1f0a1640 1 Processor -- start 2024-09-21T13:00:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1f0a1640 1 -- start start 2024-09-21T13:00:45.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1f0a1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 0x7f2e18107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1f0a1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1f0a1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1810dcb0 con 0x7f2e18106800 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1f0a1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e1810db30 con 0x7f2e18100800 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e17fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e17fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18107c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53882/0 (socket says 172.21.15.46:53882) 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e17fff640 1 -- 172.21.15.46:0/2596438464 learned_addr learned my addr 172.21.15.46:0/2596438464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1ce3d640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 0x7f2e18107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e17fff640 1 -- 172.21.15.46:0/2596438464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 msgr2=0x7f2e18107730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e17fff640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 0x7f2e18107730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e17fff640 1 -- 172.21.15.46:0/2596438464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e181081b0 con 0x7f2e18106800 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.931+0000 7f2e1ce3d640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 0x7f2e18107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.932+0000 7f2e17fff640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18107c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00d8d0 tx=0x7f2e0c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:45.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.932+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e0c017030 con 0x7f2e18106800 2024-09-21T13:00:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.932+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e0c004020 con 0x7f2e18106800 2024-09-21T13:00:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.932+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e181084a0 con 0x7f2e18106800 2024-09-21T13:00:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.932+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e0c0047a0 con 0x7f2e18106800 2024-09-21T13:00:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.932+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e181a3dc0 con 0x7f2e18106800 2024-09-21T13:00:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.933+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e18101f40 con 0x7f2e18106800 2024-09-21T13:00:45.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.934+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2e0c0041d0 con 0x7f2e18106800 2024-09-21T13:00:45.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.934+0000 7f2e15ffb640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e0007af30 0x7f2e0007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:45.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.935+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2e0c018070 con 0x7f2e18106800 2024-09-21T13:00:45.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.935+0000 7f2e1ce3d640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e0007af30 0x7f2e0007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:45.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.935+0000 7f2e1ce3d640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e0007af30 0x7f2e0007d3f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e08006010 tx=0x7f2e080095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:45.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:45.940+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e0c069420 con 0x7f2e18106800 2024-09-21T13:00:46.147 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.145+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2e1806aa00 con 0x7f2e0007af30 2024-09-21T13:00:46.149 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.147+0000 7f2e15ffb640 1 -- 172.21.15.46:0/2596438464 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2e1806aa00 con 0x7f2e0007af30 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e0007af30 msgr2=0x7f2e0007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e0007af30 0x7f2e0007d3f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2e08006010 tx=0x7f2e080095f0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 msgr2=0x7f2e18107c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18107c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00d8d0 tx=0x7f2e0c00dd90 comp rx=0 tx=0).stop 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 shutdown_connections 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e0007af30 0x7f2e0007d3f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e18106800 0x7f2e18107c70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 --2- 172.21.15.46:0/2596438464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e18100800 0x7f2e18107730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 >> 172.21.15.46:0/2596438464 conn(0x7f2e180fc520 msgr2=0x7f2e1806a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 shutdown_connections 2024-09-21T13:00:46.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.149+0000 7f2e1f0a1640 1 -- 172.21.15.46:0/2596438464 wait complete. 2024-09-21T13:00:46.160 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.234+0000 7f2270cb9640 1 -- 172.21.15.46:0/3478068588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 msgr2=0x7f226c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.234+0000 7f2270cb9640 1 --2- 172.21.15.46:0/3478068588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c100c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2260009880 tx=0x7f226002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.235+0000 7f2270cb9640 1 -- 172.21.15.46:0/3478068588 shutdown_connections 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.235+0000 7f2270cb9640 1 --2- 172.21.15.46:0/3478068588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c100c50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.235+0000 7f2270cb9640 1 --2- 172.21.15.46:0/3478068588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c1067f0 0x7f226c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.235+0000 7f2270cb9640 1 -- 172.21.15.46:0/3478068588 >> 172.21.15.46:0/3478068588 conn(0x7f226c0fc550 msgr2=0x7f226c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.235+0000 7f2270cb9640 1 -- 172.21.15.46:0/3478068588 shutdown_connections 2024-09-21T13:00:46.237 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.235+0000 7f2270cb9640 1 -- 172.21.15.46:0/3478068588 wait complete. 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2270cb9640 1 Processor -- start 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2270cb9640 1 -- start start 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2270cb9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2270cb9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c1067f0 0x7f226c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2270cb9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f226c10edc0 con 0x7f226c1007f0 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2270cb9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f226c10ec40 con 0x7f226c1067f0 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f226a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f226a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53902/0 (socket says 172.21.15.46:53902) 2024-09-21T13:00:46.239 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f226a59c640 1 -- 172.21.15.46:0/1389957555 learned_addr learned my addr 172.21.15.46:0/1389957555 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f2269d9b640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c1067f0 0x7f226c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f226a59c640 1 -- 172.21.15.46:0/1389957555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c1067f0 msgr2=0x7f226c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f226a59c640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c1067f0 0x7f226c19db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.236+0000 7f226a59c640 1 -- 172.21.15.46:0/1389957555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226c1977b0 con 0x7f226c1007f0 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.237+0000 7f226a59c640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c19d630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c8f0 tx=0x7f225c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.237+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f225c0079b0 con 0x7f226c1007f0 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.237+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f226c197aa0 con 0x7f226c1007f0 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.237+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f226c198000 con 0x7f226c1007f0 2024-09-21T13:00:46.240 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.237+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f225c0054e0 con 0x7f226c1007f0 2024-09-21T13:00:46.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.237+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f225c004dd0 con 0x7f226c1007f0 2024-09-21T13:00:46.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.238+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f224c005290 con 0x7f226c1007f0 2024-09-21T13:00:46.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.239+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f225c007b50 con 0x7f226c1007f0 2024-09-21T13:00:46.241 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.239+0000 7f225b7fe640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f225407af30 0x7f225407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.240+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f225c09dfb0 con 0x7f226c1007f0 2024-09-21T13:00:46.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.240+0000 7f2269d9b640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f225407af30 0x7f225407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.240+0000 7f2269d9b640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f225407af30 0x7f225407d3f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f226c198b00 tx=0x7f2260031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:46.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.245+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f225c014030 con 0x7f226c1007f0 2024-09-21T13:00:46.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.450+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f224c000bc0 con 0x7f225407af30 2024-09-21T13:00:46.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.451+0000 7f225b7fe640 1 -- 172.21.15.46:0/1389957555 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f224c000bc0 con 0x7f225407af30 2024-09-21T13:00:46.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f225407af30 msgr2=0x7f225407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f225407af30 0x7f225407d3f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f226c198b00 tx=0x7f2260031420 comp rx=0 tx=0).stop 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 msgr2=0x7f226c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c19d630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f225c00c8f0 tx=0x7f225c00cdb0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 shutdown_connections 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f225407af30 0x7f225407d3f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f226c1067f0 0x7f226c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 --2- 172.21.15.46:0/1389957555 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f226c1007f0 0x7f226c19d630 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 >> 172.21.15.46:0/1389957555 conn(0x7f226c0fc550 msgr2=0x7f226c0fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 shutdown_connections 2024-09-21T13:00:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.453+0000 7f2270cb9640 1 -- 172.21.15.46:0/1389957555 wait complete. 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 -- 172.21.15.46:0/1242126838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 msgr2=0x7fa55810b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 --2- 172.21.15.46:0/1242126838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55810b920 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa5440098b0 tx=0x7fa54402a560 comp rx=0 tx=0).stop 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 -- 172.21.15.46:0/1242126838 shutdown_connections 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 --2- 172.21.15.46:0/1242126838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55810b920 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 --2- 172.21.15.46:0/1242126838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa558102b10 0x7fa558102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 -- 172.21.15.46:0/1242126838 >> 172.21.15.46:0/1242126838 conn(0x7fa5580fc550 msgr2=0x7fa5580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 -- 172.21.15.46:0/1242126838 shutdown_connections 2024-09-21T13:00:46.552 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.549+0000 7fa55ecea640 1 -- 172.21.15.46:0/1242126838 wait complete. 2024-09-21T13:00:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.550+0000 7fa55ecea640 1 Processor -- start 2024-09-21T13:00:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.550+0000 7fa55ecea640 1 -- start start 2024-09-21T13:00:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.550+0000 7fa55ecea640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa558102b10 0x7fa55819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.553 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa55ecea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa55ecea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa55810edc0 con 0x7fa558103430 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa55ecea640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa55810ec40 con 0x7fa558102b10 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53910/0 (socket says 172.21.15.46:53910) 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 -- 172.21.15.46:0/692411646 learned_addr learned my addr 172.21.15.46:0/692411646 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa55ca86640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa558102b10 0x7fa55819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 -- 172.21.15.46:0/692411646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa558102b10 msgr2=0x7fa55819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa558102b10 0x7fa55819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 -- 172.21.15.46:0/692411646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5581977f0 con 0x7fa558103430 2024-09-21T13:00:46.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.551+0000 7fa557fff640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55819dbb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa544031460 tx=0x7fa5440045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:46.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.552+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa54403f070 con 0x7fa558103430 2024-09-21T13:00:46.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.552+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa5440035f0 con 0x7fa558103430 2024-09-21T13:00:46.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.552+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa558197a80 con 0x7fa558103430 2024-09-21T13:00:46.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.552+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa544035030 con 0x7fa558103430 2024-09-21T13:00:46.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.552+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa558197fb0 con 0x7fa558103430 2024-09-21T13:00:46.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.553+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55806a520 con 0x7fa558103430 2024-09-21T13:00:46.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.554+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa544042070 con 0x7fa558103430 2024-09-21T13:00:46.556 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.555+0000 7fa555ffb640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa54807af80 0x7fa54807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.555+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa5440be8c0 con 0x7fa558103430 2024-09-21T13:00:46.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.555+0000 7fa55ca86640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa54807af80 0x7fa54807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.555+0000 7fa55ca86640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa54807af80 0x7fa54807d440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa54c005d00 tx=0x7fa54c00b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:46.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.560+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa544089e90 con 0x7fa558103430 2024-09-21T13:00:46.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.755+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa558198320 con 0x7fa54807af80 2024-09-21T13:00:46.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.765+0000 7fa555ffb640 1 -- 172.21.15.46:0/692411646 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fa558198320 con 0x7fa54807af80 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (10m) 5m ago 21m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (14m) 5m ago 22m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (14m) 4m ago 21m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 5m ago 21m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (9m) 4m ago 21m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (10m) 5m ago 21m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (5m) 5m ago 16m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (5m) 5m ago 16m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (4m) 4m ago 16m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (4m) 4m ago 16m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:00:46.767 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (13m) 5m ago 23m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (12m) 4m ago 20m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (9m) 5m ago 23m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (9m) 4m ago 20m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (12m) 5m ago 21m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (11m) 4m ago 21m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (8m) 5m ago 19m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 5m ago 19m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 5m ago 18m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (6m) 4m ago 18m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (6m) 4m ago 17m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (5m) 4m ago 17m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:00:46.768 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (11m) 5m ago 21m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:00:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa54807af80 msgr2=0x7fa54807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa54807af80 0x7fa54807d440 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fa54c005d00 tx=0x7fa54c00b410 comp rx=0 tx=0).stop 2024-09-21T13:00:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 msgr2=0x7fa55819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55819dbb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa544031460 tx=0x7fa5440045c0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 shutdown_connections 2024-09-21T13:00:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa54807af80 0x7fa54807d440 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa558103430 0x7fa55819dbb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 --2- 172.21.15.46:0/692411646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa558102b10 0x7fa55819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 >> 172.21.15.46:0/692411646 conn(0x7fa5580fc550 msgr2=0x7fa558103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 shutdown_connections 2024-09-21T13:00:46.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.767+0000 7fa55ecea640 1 -- 172.21.15.46:0/692411646 wait complete. 2024-09-21T13:00:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 -- 172.21.15.46:0/616451820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 msgr2=0x7f2a38102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 --2- 172.21.15.46:0/616451820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a38102f40 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2a28009880 tx=0x7f2a2802a530 comp rx=0 tx=0).stop 2024-09-21T13:00:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 -- 172.21.15.46:0/616451820 shutdown_connections 2024-09-21T13:00:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 --2- 172.21.15.46:0/616451820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a38103480 0x7f2a3810b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 --2- 172.21.15.46:0/616451820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a38102f40 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 -- 172.21.15.46:0/616451820 >> 172.21.15.46:0/616451820 conn(0x7f2a380fc520 msgr2=0x7f2a380fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 -- 172.21.15.46:0/616451820 shutdown_connections 2024-09-21T13:00:46.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.850+0000 7f2a3e071640 1 -- 172.21.15.46:0/616451820 wait complete. 2024-09-21T13:00:46.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a3e071640 1 Processor -- start 2024-09-21T13:00:46.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a3e071640 1 -- start start 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a3e071640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a381007c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a3e071640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a38103480 0x7f2a38100d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a3e071640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3810edf0 con 0x7f2a38102b60 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a3e071640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a3810ec70 con 0x7f2a38103480 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.851+0000 7f2a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a381007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a377fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a381007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53924/0 (socket says 172.21.15.46:53924) 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a377fe640 1 -- 172.21.15.46:0/3296779747 learned_addr learned my addr 172.21.15.46:0/3296779747 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a36ffd640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a38103480 0x7f2a38100d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a377fe640 1 -- 172.21.15.46:0/3296779747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a38103480 msgr2=0x7f2a38100d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a377fe640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a38103480 0x7f2a38100d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a377fe640 1 -- 172.21.15.46:0/3296779747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a38101240 con 0x7f2a38102b60 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a377fe640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a381007c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2a28004f90 tx=0x7f2a280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:46.855 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a2803f070 con 0x7f2a38102b60 2024-09-21T13:00:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a28004c70 con 0x7f2a38102b60 2024-09-21T13:00:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a381014d0 con 0x7f2a38102b60 2024-09-21T13:00:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.852+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a28035030 con 0x7f2a38102b60 2024-09-21T13:00:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.853+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a381a3dc0 con 0x7f2a38102b60 2024-09-21T13:00:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.853+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a3806a9f0 con 0x7f2a38102b60 2024-09-21T13:00:46.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.854+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2a28042070 con 0x7f2a38102b60 2024-09-21T13:00:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.855+0000 7f2a34ff9640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a2007af30 0x7f2a2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.855+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2a280be990 con 0x7f2a38102b60 2024-09-21T13:00:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.855+0000 7f2a36ffd640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a2007af30 0x7f2a2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:46.857 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.855+0000 7f2a36ffd640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a2007af30 0x7f2a2007d3f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2a38102250 tx=0x7f2a2c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:46.862 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:46.860+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a28089ee0 con 0x7f2a38102b60 2024-09-21T13:00:47.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.121+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2a38106030 con 0x7f2a38102b60 2024-09-21T13:00:47.123 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:47 smithi046 ceph-mon[108126]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:47.123 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:47 smithi046 ceph-mon[108126]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:47.123 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:47 smithi046 ceph-mon[108126]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.121+0000 7f2a34ff9640 1 -- 172.21.15.46:0/3296779747 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2a2808ed90 con 0x7f2a38102b60 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:47.124 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:00:47.125 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a2007af30 msgr2=0x7f2a2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a2007af30 0x7f2a2007d3f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2a38102250 tx=0x7f2a2c00b390 comp rx=0 tx=0).stop 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 msgr2=0x7f2a381007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a381007c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f2a28004f90 tx=0x7f2a280048f0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 shutdown_connections 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a2007af30 0x7f2a2007d3f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a38103480 0x7f2a38100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 --2- 172.21.15.46:0/3296779747 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a38102b60 0x7f2a381007c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 >> 172.21.15.46:0/3296779747 conn(0x7f2a380fc520 msgr2=0x7f2a38103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:47.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 shutdown_connections 2024-09-21T13:00:47.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.124+0000 7f2a3e071640 1 -- 172.21.15.46:0/3296779747 wait complete. 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 -- 172.21.15.46:0/3573517883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 msgr2=0x7f5a9c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 --2- 172.21.15.46:0/3573517883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c106be0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009880 tx=0x7f5a8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 -- 172.21.15.46:0/3573517883 shutdown_connections 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 --2- 172.21.15.46:0/3573517883 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 0x7f5a9c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 --2- 172.21.15.46:0/3573517883 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c106be0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 -- 172.21.15.46:0/3573517883 >> 172.21.15.46:0/3573517883 conn(0x7f5a9c0fc520 msgr2=0x7f5a9c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:47.210 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 -- 172.21.15.46:0/3573517883 shutdown_connections 2024-09-21T13:00:47.211 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.208+0000 7f5aa193d640 1 -- 172.21.15.46:0/3573517883 wait complete. 2024-09-21T13:00:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5aa193d640 1 Processor -- start 2024-09-21T13:00:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5aa193d640 1 -- start start 2024-09-21T13:00:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5aa193d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 0x7f5a9c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5aa193d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.212 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5aa193d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c10dcd0 con 0x7f5a9c106800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5aa193d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9c10db50 con 0x7f5a9c100800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a93fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a93fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53948/0 (socket says 172.21.15.46:53948) 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a93fff640 1 -- 172.21.15.46:0/229255593 learned_addr learned my addr 172.21.15.46:0/229255593 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a9affd640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 0x7f5a9c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a93fff640 1 -- 172.21.15.46:0/229255593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 msgr2=0x7f5a9c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a93fff640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 0x7f5a9c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a93fff640 1 -- 172.21.15.46:0/229255593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a9c1977c0 con 0x7f5a9c106800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.209+0000 7f5a9affd640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 0x7f5a9c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.210+0000 7f5a93fff640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c19db80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400d6f0 tx=0x7f5a8400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.210+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a84017070 con 0x7f5a9c106800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.210+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5a8400de00 con 0x7f5a9c106800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.210+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a9c197ab0 con 0x7f5a9c106800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.210+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5a84004bb0 con 0x7f5a9c106800 2024-09-21T13:00:47.213 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.210+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a9c198040 con 0x7f5a9c106800 2024-09-21T13:00:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.211+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a9c101f40 con 0x7f5a9c106800 2024-09-21T13:00:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.212+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5a84009a30 con 0x7f5a9c106800 2024-09-21T13:00:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.212+0000 7f5aa093b640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5a8807af90 0x7f5a8807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.212+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5a8409dc20 con 0x7f5a9c106800 2024-09-21T13:00:47.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.212+0000 7f5a9affd640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5a8807af90 0x7f5a8807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.213+0000 7f5a9affd640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5a8807af90 0x7f5a8807d450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c000c00 tx=0x7f5a8c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:47.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.217+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5a840691f0 con 0x7f5a9c106800 2024-09-21T13:00:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.444+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5a9c109d80 con 0x7f5a9c106800 2024-09-21T13:00:47.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.444+0000 7f5aa093b640 1 -- 172.21.15.46:0/229255593 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f5a8406e0a0 con 0x7f5a9c106800 2024-09-21T13:00:47.446 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:00:47.446 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:00:47.446 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:00:47.446 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:00:47.447 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:00:47.448 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:47.449 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:00:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:00:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5a8807af90 msgr2=0x7f5a8807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5a8807af90 0x7f5a8807d450 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c000c00 tx=0x7f5a8c031400 comp rx=0 tx=0).stop 2024-09-21T13:00:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 msgr2=0x7f5a9c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c19db80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f5a8400d6f0 tx=0x7f5a8400dbb0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 shutdown_connections 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5a8807af90 0x7f5a8807d450 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5a9c106800 0x7f5a9c19db80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 --2- 172.21.15.46:0/229255593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a9c100800 0x7f5a9c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.446+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 >> 172.21.15.46:0/229255593 conn(0x7f5a9c0fc520 msgr2=0x7f5a9c06a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.447+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 shutdown_connections 2024-09-21T13:00:47.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.447+0000 7f5aa193d640 1 -- 172.21.15.46:0/229255593 wait complete. 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.533+0000 7ffb872db640 1 -- 172.21.15.46:0/4091219933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 msgr2=0x7ffb80106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.533+0000 7ffb872db640 1 --2- 172.21.15.46:0/4091219933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb80106be0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c009880 tx=0x7ffb7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.533+0000 7ffb872db640 1 -- 172.21.15.46:0/4091219933 shutdown_connections 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.533+0000 7ffb872db640 1 --2- 172.21.15.46:0/4091219933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb80100800 0x7ffb80100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.533+0000 7ffb872db640 1 --2- 172.21.15.46:0/4091219933 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb80106be0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.533+0000 7ffb872db640 1 -- 172.21.15.46:0/4091219933 >> 172.21.15.46:0/4091219933 conn(0x7ffb800fc520 msgr2=0x7ffb800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.534+0000 7ffb872db640 1 -- 172.21.15.46:0/4091219933 shutdown_connections 2024-09-21T13:00:47.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.534+0000 7ffb872db640 1 -- 172.21.15.46:0/4091219933 wait complete. 2024-09-21T13:00:47.536 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.534+0000 7ffb872db640 1 Processor -- start 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.534+0000 7ffb872db640 1 -- start start 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb80100800 0x7ffb800fcc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb800fd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8010dcd0 con 0x7ffb80106800 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb8010db50 con 0x7ffb80100800 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb800fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb800fd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56884/0 (socket says 172.21.15.46:56884) 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 -- 172.21.15.46:0/191456828 learned_addr learned my addr 172.21.15.46:0/191456828 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb85077640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb80100800 0x7ffb800fcc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 -- 172.21.15.46:0/191456828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb80100800 msgr2=0x7ffb800fcc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb80100800 0x7ffb800fcc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 -- 172.21.15.46:0/191456828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb800fd6c0 con 0x7ffb80106800 2024-09-21T13:00:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb84876640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb800fd180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000d6f0 tx=0x7ffb7000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb70017070 con 0x7ffb80106800 2024-09-21T13:00:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb800fd9b0 con 0x7ffb80106800 2024-09-21T13:00:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb7000de00 con 0x7ffb80106800 2024-09-21T13:00:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb70004bb0 con 0x7ffb80106800 2024-09-21T13:00:47.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb801a3e30 con 0x7ffb80106800 2024-09-21T13:00:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.535+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb80101f40 con 0x7ffb80106800 2024-09-21T13:00:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.537+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffb70004e60 con 0x7ffb80106800 2024-09-21T13:00:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.537+0000 7ffb767fc640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb6c07af30 0x7ffb6c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.537+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ffb7009dce0 con 0x7ffb80106800 2024-09-21T13:00:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.537+0000 7ffb85077640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb6c07af30 0x7ffb6c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.537+0000 7ffb85077640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb6c07af30 0x7ffb6c07d3f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0096c0 tx=0x7ffb7c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:47.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.542+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb70069230 con 0x7ffb80106800 2024-09-21T13:00:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:47 smithi176 ceph-mon[80162]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:47 smithi176 ceph-mon[80162]: from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:47 smithi176 ceph-mon[80162]: from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:47.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.750+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffb80062630 con 0x7ffb6c07af30 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.751+0000 7ffb767fc640 1 -- 172.21.15.46:0/191456828 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ffb80062630 con 0x7ffb6c07af30 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:00:47.752 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:00:47.753 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:00:47.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb6c07af30 msgr2=0x7ffb6c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb6c07af30 0x7ffb6c07d3f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c0096c0 tx=0x7ffb7c031400 comp rx=0 tx=0).stop 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 msgr2=0x7ffb800fd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb800fd180 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ffb7000d6f0 tx=0x7ffb7000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 shutdown_connections 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb6c07af30 0x7ffb6c07d3f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb80106800 0x7ffb800fd180 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 --2- 172.21.15.46:0/191456828 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb80100800 0x7ffb800fcc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 >> 172.21.15.46:0/191456828 conn(0x7ffb800fc520 msgr2=0x7ffb8006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 shutdown_connections 2024-09-21T13:00:47.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.753+0000 7ffb872db640 1 -- 172.21.15.46:0/191456828 wait complete. 2024-09-21T13:00:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 -- 172.21.15.46:0/1823036944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 msgr2=0x7fcda4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/1823036944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda4100c60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009880 tx=0x7fcd9802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 -- 172.21.15.46:0/1823036944 shutdown_connections 2024-09-21T13:00:47.839 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/1823036944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda4100c60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/1823036944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcda4106800 0x7fcda4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 -- 172.21.15.46:0/1823036944 >> 172.21.15.46:0/1823036944 conn(0x7fcda40fc520 msgr2=0x7fcda40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 -- 172.21.15.46:0/1823036944 shutdown_connections 2024-09-21T13:00:47.840 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.838+0000 7fcda9eb9640 1 -- 172.21.15.46:0/1823036944 wait complete. 2024-09-21T13:00:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda9eb9640 1 Processor -- start 2024-09-21T13:00:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda9eb9640 1 -- start start 2024-09-21T13:00:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda9eb9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda9eb9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcda4106800 0x7fcda419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda9eb9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcda410dcb0 con 0x7fcda4100800 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda9eb9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcda410db30 con 0x7fcda4106800 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda419d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56908/0 (socket says 172.21.15.46:56908) 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda37fe640 1 -- 172.21.15.46:0/285422487 learned_addr learned my addr 172.21.15.46:0/285422487 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda37fe640 1 -- 172.21.15.46:0/285422487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcda4106800 msgr2=0x7fcda419dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda2ffd640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcda4106800 0x7fcda419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda37fe640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcda4106800 0x7fcda419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.839+0000 7fcda37fe640 1 -- 172.21.15.46:0/285422487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda41977f0 con 0x7fcda4100800 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.840+0000 7fcda37fe640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda419d670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400c8a0 tx=0x7fcd9400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.840+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd940079b0 con 0x7fcda4100800 2024-09-21T13:00:47.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.840+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd94007b50 con 0x7fcda4100800 2024-09-21T13:00:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.840+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda4197ae0 con 0x7fcda4100800 2024-09-21T13:00:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.840+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd94018700 con 0x7fcda4100800 2024-09-21T13:00:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.840+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda4198070 con 0x7fcda4100800 2024-09-21T13:00:47.843 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.841+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda4101f40 con 0x7fcda4100800 2024-09-21T13:00:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.841+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcd94007d00 con 0x7fcda4100800 2024-09-21T13:00:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.842+0000 7fcda0ff9640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd8c07af80 0x7fcd8c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:00:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.842+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcd9409e300 con 0x7fcda4100800 2024-09-21T13:00:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.842+0000 7fcda2ffd640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd8c07af80 0x7fcd8c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:00:47.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.843+0000 7fcda2ffd640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd8c07af80 0x7fcd8c07d440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd98031460 tx=0x7fcd98009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:00:47.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:47.847+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd94014030 con 0x7fcda4100800 2024-09-21T13:00:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.114+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcda4109da0 con 0x7fcda4100800 2024-09-21T13:00:48.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.114+0000 7fcda0ff9640 1 -- 172.21.15.46:0/285422487 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcd940698d0 con 0x7fcda4100800 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:00:48.116 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd8c07af80 msgr2=0x7fcd8c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd8c07af80 0x7fcd8c07d440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcd98031460 tx=0x7fcd98009560 comp rx=0 tx=0).stop 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 msgr2=0x7fcda419d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda419d670 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400c8a0 tx=0x7fcd9400cd60 comp rx=0 tx=0).stop 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 shutdown_connections 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd8c07af80 0x7fcd8c07d440 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:48.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcda4106800 0x7fcda419dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:48.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 --2- 172.21.15.46:0/285422487 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcda4100800 0x7fcda419d670 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:00:48.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 >> 172.21.15.46:0/285422487 conn(0x7fcda40fc520 msgr2=0x7fcda406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:00:48.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 shutdown_connections 2024-09-21T13:00:48.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:00:48.117+0000 7fcda9eb9640 1 -- 172.21.15.46:0/285422487 wait complete. 2024-09-21T13:00:48.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:48 smithi046 ceph-mon[108126]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:48 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3296779747' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:00:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:48 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/229255593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:00:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:48 smithi176 ceph-mon[80162]: from='client.34626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:48 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3296779747' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:00:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:48 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/229255593' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:00:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:49 smithi046 ceph-mon[108126]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:49 smithi046 ceph-mon[108126]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:49 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/285422487' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:00:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:49 smithi176 ceph-mon[80162]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:49.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:49 smithi176 ceph-mon[80162]: from='client.34638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:00:49.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:49 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/285422487' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:00:51.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:51 smithi046 ceph-mon[108126]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:51 smithi176 ceph-mon[80162]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:53 smithi046 ceph-mon[108126]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:53 smithi176 ceph-mon[80162]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:55 smithi046 ceph-mon[108126]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:55 smithi176 ceph-mon[80162]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:57 smithi046 ceph-mon[108126]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:57 smithi176 ceph-mon[80162]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:59.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:00:59 smithi046 ceph-mon[108126]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:00:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:00:59 smithi176 ceph-mon[80162]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:00.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:01.357 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:01 smithi176 ceph-mon[80162]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:01.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:01 smithi046 ceph-mon[108126]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:03 smithi046 ceph-mon[108126]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:03 smithi176 ceph-mon[80162]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:05 smithi046 ceph-mon[108126]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:05 smithi176 ceph-mon[80162]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:07 smithi046 ceph-mon[108126]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:07 smithi176 ceph-mon[80162]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:09 smithi046 ceph-mon[108126]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:09 smithi176 ceph-mon[80162]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:11 smithi046 ceph-mon[108126]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:11 smithi176 ceph-mon[80162]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:13.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:13 smithi046 ceph-mon[108126]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:13 smithi176 ceph-mon[80162]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:15.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:15 smithi046 ceph-mon[108126]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:15.413 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:15 smithi176 ceph-mon[80162]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:17 smithi176 ceph-mon[80162]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:17 smithi046 ceph-mon[108126]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:18.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 -- 172.21.15.46:0/2358598624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 msgr2=0x7fd5a8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/2358598624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a8100c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009880 tx=0x7fd59c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.214 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 -- 172.21.15.46:0/2358598624 shutdown_connections 2024-09-21T13:01:18.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/2358598624 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a8100c50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/2358598624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a81067f0 0x7fd5a8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 -- 172.21.15.46:0/2358598624 >> 172.21.15.46:0/2358598624 conn(0x7fd5a80fc550 msgr2=0x7fd5a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:18.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 -- 172.21.15.46:0/2358598624 shutdown_connections 2024-09-21T13:01:18.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.213+0000 7fd5aefcb640 1 -- 172.21.15.46:0/2358598624 wait complete. 2024-09-21T13:01:18.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5aefcb640 1 Processor -- start 2024-09-21T13:01:18.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5aefcb640 1 -- start start 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5aefcb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5aefcb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a81067f0 0x7fd5a819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5aefcb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a810dcc0 con 0x7fd5a81007f0 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5aefcb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a810db40 con 0x7fd5a81067f0 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5acd67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5acd67640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55992/0 (socket says 172.21.15.46:55992) 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5acd67640 1 -- 172.21.15.46:0/320014073 learned_addr learned my addr 172.21.15.46:0/320014073 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5a7fff640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a81067f0 0x7fd5a819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5acd67640 1 -- 172.21.15.46:0/320014073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a81067f0 msgr2=0x7fd5a819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5acd67640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a81067f0 0x7fd5a819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.214+0000 7fd5acd67640 1 -- 172.21.15.46:0/320014073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a81977e0 con 0x7fd5a81007f0 2024-09-21T13:01:18.217 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.215+0000 7fd5acd67640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a819d660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd59800d6f0 tx=0x7fd59800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:18.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.215+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd598017070 con 0x7fd5a81007f0 2024-09-21T13:01:18.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.215+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd59800de00 con 0x7fd5a81007f0 2024-09-21T13:01:18.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.215+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a8197ad0 con 0x7fd5a81007f0 2024-09-21T13:01:18.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.215+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd598004bb0 con 0x7fd5a81007f0 2024-09-21T13:01:18.218 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.215+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a8198030 con 0x7fd5a81007f0 2024-09-21T13:01:18.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.216+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a8101f30 con 0x7fd5a81007f0 2024-09-21T13:01:18.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.217+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd598009a30 con 0x7fd5a81007f0 2024-09-21T13:01:18.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.218+0000 7fd5a5ffb640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd59007af80 0x7fd59007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.218+0000 7fd5a7fff640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd59007af80 0x7fd59007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.218+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd59809dc10 con 0x7fd5a81007f0 2024-09-21T13:01:18.219 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.218+0000 7fd5a7fff640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd59007af80 0x7fd59007d440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8198b30 tx=0x7fd59c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:18.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.222+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd598069140 con 0x7fd5a81007f0 2024-09-21T13:01:18.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.425+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fd5a81982e0 con 0x7fd59007af80 2024-09-21T13:01:18.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.426+0000 7fd5a5ffb640 1 -- 172.21.15.46:0/320014073 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fd5a81982e0 con 0x7fd59007af80 2024-09-21T13:01:18.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd59007af80 msgr2=0x7fd59007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd59007af80 0x7fd59007d440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8198b30 tx=0x7fd59c031400 comp rx=0 tx=0).stop 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 msgr2=0x7fd5a819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a819d660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd59800d6f0 tx=0x7fd59800dbb0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 shutdown_connections 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd59007af80 0x7fd59007d440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5a81067f0 0x7fd5a819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 --2- 172.21.15.46:0/320014073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd5a81007f0 0x7fd5a819d660 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.428+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 >> 172.21.15.46:0/320014073 conn(0x7fd5a80fc550 msgr2=0x7fd5a8069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.429+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 shutdown_connections 2024-09-21T13:01:18.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.429+0000 7fd5aefcb640 1 -- 172.21.15.46:0/320014073 wait complete. 2024-09-21T13:01:18.439 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:01:18.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 -- 172.21.15.46:0/579457275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198106800 msgr2=0x7fc198106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 --2- 172.21.15.46:0/579457275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198106800 0x7fc198106be0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc188009880 tx=0x7fc18802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 -- 172.21.15.46:0/579457275 shutdown_connections 2024-09-21T13:01:18.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 --2- 172.21.15.46:0/579457275 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198100800 0x7fc198100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 --2- 172.21.15.46:0/579457275 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198106800 0x7fc198106be0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 -- 172.21.15.46:0/579457275 >> 172.21.15.46:0/579457275 conn(0x7fc1980fc520 msgr2=0x7fc1980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:18.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 -- 172.21.15.46:0/579457275 shutdown_connections 2024-09-21T13:01:18.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.514+0000 7fc19d563640 1 -- 172.21.15.46:0/579457275 wait complete. 2024-09-21T13:01:18.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.515+0000 7fc19d563640 1 Processor -- start 2024-09-21T13:01:18.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.515+0000 7fc19d563640 1 -- start start 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.515+0000 7fc19d563640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 0x7fc19819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.515+0000 7fc19d563640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198106800 0x7fc19819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.515+0000 7fc19d563640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc19810dcd0 con 0x7fc198100800 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.515+0000 7fc19d563640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc19810db50 con 0x7fc198106800 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 0x7fc19819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 0x7fc19819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56010/0 (socket says 172.21.15.46:56010) 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 -- 172.21.15.46:0/3571206102 learned_addr learned my addr 172.21.15.46:0/3571206102 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc1967fc640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198106800 0x7fc19819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 -- 172.21.15.46:0/3571206102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198106800 msgr2=0x7fc19819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198106800 0x7fc19819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 -- 172.21.15.46:0/3571206102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc198197800 con 0x7fc198100800 2024-09-21T13:01:18.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc1967fc640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198106800 0x7fc19819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc196ffd640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 0x7fc19819d680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc188031460 tx=0x7fc1880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc18803f070 con 0x7fc198100800 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc1880035f0 con 0x7fc198100800 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc198197a90 con 0x7fc198100800 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc188035030 con 0x7fc198100800 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.516+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc198197fc0 con 0x7fc198100800 2024-09-21T13:01:18.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.517+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc198101f40 con 0x7fc198100800 2024-09-21T13:01:18.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.518+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc188042070 con 0x7fc198100800 2024-09-21T13:01:18.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.519+0000 7fc17ffff640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc18007af30 0x7fc18007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.519+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc1880bead0 con 0x7fc198100800 2024-09-21T13:01:18.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.519+0000 7fc1967fc640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc18007af30 0x7fc18007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.521 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.519+0000 7fc1967fc640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc18007af30 0x7fc18007d3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0058c0 tx=0x7fc18c005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:18.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.523+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc18808a020 con 0x7fc198100800 2024-09-21T13:01:18.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.727+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc198198330 con 0x7fc18007af30 2024-09-21T13:01:18.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.728+0000 7fc17ffff640 1 -- 172.21.15.46:0/3571206102 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc198198330 con 0x7fc18007af30 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc18007af30 msgr2=0x7fc18007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc18007af30 0x7fc18007d3f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc18c0058c0 tx=0x7fc18c005850 comp rx=0 tx=0).stop 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 msgr2=0x7fc19819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 0x7fc19819d680 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc188031460 tx=0x7fc1880045e0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 shutdown_connections 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc18007af30 0x7fc18007d3f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc198106800 0x7fc19819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 --2- 172.21.15.46:0/3571206102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc198100800 0x7fc19819d680 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.730+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 >> 172.21.15.46:0/3571206102 conn(0x7fc1980fc520 msgr2=0x7fc19806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:18.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.731+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 shutdown_connections 2024-09-21T13:01:18.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.731+0000 7fc19d563640 1 -- 172.21.15.46:0/3571206102 wait complete. 2024-09-21T13:01:18.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 -- 172.21.15.46:0/154504824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 msgr2=0x7fb88c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 --2- 172.21.15.46:0/154504824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c101d60 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb87c009880 tx=0x7fb87c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 -- 172.21.15.46:0/154504824 shutdown_connections 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 --2- 172.21.15.46:0/154504824 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c101d60 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 --2- 172.21.15.46:0/154504824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c107900 0x7fb88c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 -- 172.21.15.46:0/154504824 >> 172.21.15.46:0/154504824 conn(0x7fb88c0fd600 msgr2=0x7fb88c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 -- 172.21.15.46:0/154504824 shutdown_connections 2024-09-21T13:01:18.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.815+0000 7fb893fbd640 1 -- 172.21.15.46:0/154504824 wait complete. 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb893fbd640 1 Processor -- start 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb893fbd640 1 -- start start 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb893fbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb893fbd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c107900 0x7fb88c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb893fbd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c10edb0 con 0x7fb88c101900 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb893fbd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c10ec30 con 0x7fb88c107900 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb891d59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb891d59640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56032/0 (socket says 172.21.15.46:56032) 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.816+0000 7fb891d59640 1 -- 172.21.15.46:0/64359332 learned_addr learned my addr 172.21.15.46:0/64359332 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:18.819 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb891558640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c107900 0x7fb88c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb891d59640 1 -- 172.21.15.46:0/64359332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c107900 msgr2=0x7fb88c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb891d59640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c107900 0x7fb88c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb891d59640 1 -- 172.21.15.46:0/64359332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c197800 con 0x7fb88c101900 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb891d59640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c19d680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb88800d8d0 tx=0x7fb88800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb888017030 con 0x7fb88c101900 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb888004020 con 0x7fb88c101900 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb8880047a0 con 0x7fb88c101900 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c197af0 con 0x7fb88c101900 2024-09-21T13:01:18.820 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.817+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c198050 con 0x7fb88c101900 2024-09-21T13:01:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.818+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c103040 con 0x7fb88c101900 2024-09-21T13:01:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.819+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb8880041d0 con 0x7fb88c101900 2024-09-21T13:01:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.819+0000 7fb882ffd640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87807af30 0x7fb87807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.819+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb888018070 con 0x7fb88c101900 2024-09-21T13:01:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.819+0000 7fb891558640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87807af30 0x7fb87807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:18.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.820+0000 7fb891558640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87807af30 0x7fb87807d3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb88c198b50 tx=0x7fb87c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:18.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:18.824+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb888069420 con 0x7fb88c101900 2024-09-21T13:01:19.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.018+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb88c1983c0 con 0x7fb87807af30 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.030+0000 7fb882ffd640 1 -- 172.21.15.46:0/64359332 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb88c1983c0 con 0x7fb87807af30 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (11m) 5m ago 22m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (14m) 5m ago 22m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (14m) 5m ago 21m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (9m) 5m ago 22m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (9m) 5m ago 21m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (11m) 5m ago 22m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:01:19.031 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (5m) 5m ago 17m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (5m) 5m ago 16m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (5m) 5m ago 17m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (5m) 5m ago 16m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (13m) 5m ago 23m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (12m) 5m ago 21m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 5m ago 23m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (9m) 5m ago 21m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (12m) 5m ago 22m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (12m) 5m ago 21m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 5m ago 20m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (8m) 5m ago 19m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (7m) 5m ago 19m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (7m) 5m ago 18m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:01:19.032 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (6m) 5m ago 18m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:01:19.033 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (6m) 5m ago 18m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:01:19.033 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (11m) 5m ago 21m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:01:19.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87807af30 msgr2=0x7fb87807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87807af30 0x7fb87807d3f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb88c198b50 tx=0x7fb87c031400 comp rx=0 tx=0).stop 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 msgr2=0x7fb88c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c19d680 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb88800d8d0 tx=0x7fb88800dd90 comp rx=0 tx=0).stop 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 shutdown_connections 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87807af30 0x7fb87807d3f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c107900 0x7fb88c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 --2- 172.21.15.46:0/64359332 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c101900 0x7fb88c19d680 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 >> 172.21.15.46:0/64359332 conn(0x7fb88c0fd600 msgr2=0x7fb88c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 shutdown_connections 2024-09-21T13:01:19.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.032+0000 7fb893fbd640 1 -- 172.21.15.46:0/64359332 wait complete. 2024-09-21T13:01:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1052575871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc101900 msgr2=0x7f72bc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1052575871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc101900 0x7f72bc101d60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f72b0009880 tx=0x7f72b002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1052575871 shutdown_connections 2024-09-21T13:01:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1052575871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc101900 0x7f72bc101d60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1052575871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72bc107900 0x7f72bc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1052575871 >> 172.21.15.46:0/1052575871 conn(0x7f72bc0fd600 msgr2=0x7f72bc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1052575871 shutdown_connections 2024-09-21T13:01:19.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.115+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1052575871 wait complete. 2024-09-21T13:01:19.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72c1bc9640 1 Processor -- start 2024-09-21T13:01:19.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72c1bc9640 1 -- start start 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72c1bc9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72bc101900 0x7f72bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72c1bc9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 0x7f72bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72c1bc9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc10edd0 con 0x7f72bc107900 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72c1bc9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f72bc10ec50 con 0x7f72bc101900 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72baffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 0x7f72bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72baffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 0x7f72bc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56052/0 (socket says 172.21.15.46:56052) 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.116+0000 7f72baffd640 1 -- 172.21.15.46:0/1919513945 learned_addr learned my addr 172.21.15.46:0/1919513945 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72bb7fe640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72bc101900 0x7f72bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72baffd640 1 -- 172.21.15.46:0/1919513945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72bc101900 msgr2=0x7f72bc0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72baffd640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72bc101900 0x7f72bc0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72baffd640 1 -- 172.21.15.46:0/1919513945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72bc074f70 con 0x7f72bc107900 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72baffd640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 0x7f72bc074a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f72b0031460 tx=0x7f72b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:19.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72b003f070 con 0x7f72bc107900 2024-09-21T13:01:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72b0004cf0 con 0x7f72bc107900 2024-09-21T13:01:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72bc075200 con 0x7f72bc107900 2024-09-21T13:01:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72b0035030 con 0x7f72bc107900 2024-09-21T13:01:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.117+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72bc1a3dc0 con 0x7f72bc107900 2024-09-21T13:01:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.118+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72bc103040 con 0x7f72bc107900 2024-09-21T13:01:19.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.119+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f72b0042070 con 0x7f72bc107900 2024-09-21T13:01:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.119+0000 7f72b8ff9640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f72a407af30 0x7f72a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.119+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f72b00beac0 con 0x7f72bc107900 2024-09-21T13:01:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.119+0000 7f72bb7fe640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f72a407af30 0x7f72a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.120+0000 7f72bb7fe640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f72a407af30 0x7f72a407d3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0058c0 tx=0x7f72ac00a250 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:19.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.124+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72b008a010 con 0x7f72bc107900 2024-09-21T13:01:19.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.387+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f72bc109e70 con 0x7f72bc107900 2024-09-21T13:01:19.389 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:19 smithi046 ceph-mon[108126]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:19.389 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:19 smithi046 ceph-mon[108126]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.388+0000 7f72b8ff9640 1 -- 172.21.15.46:0/1919513945 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f72b008eec0 con 0x7f72bc107900 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:01:19.390 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:01:19.391 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:01:19.392 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:01:19.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f72a407af30 msgr2=0x7f72a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f72a407af30 0x7f72a407d3f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f72ac0058c0 tx=0x7f72ac00a250 comp rx=0 tx=0).stop 2024-09-21T13:01:19.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 msgr2=0x7f72bc074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 0x7f72bc074a30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f72b0031460 tx=0x7f72b00048f0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 shutdown_connections 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f72a407af30 0x7f72a407d3f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f72bc107900 0x7f72bc074a30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 --2- 172.21.15.46:0/1919513945 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72bc101900 0x7f72bc0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 >> 172.21.15.46:0/1919513945 conn(0x7f72bc0fd600 msgr2=0x7f72bc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 shutdown_connections 2024-09-21T13:01:19.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.390+0000 7f72c1bc9640 1 -- 172.21.15.46:0/1919513945 wait complete. 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.474+0000 7f16dbc97640 1 -- 172.21.15.46:0/2034156867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 msgr2=0x7f16d410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.474+0000 7f16dbc97640 1 --2- 172.21.15.46:0/2034156867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d410b920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f16c40098b0 tx=0x7f16c402a560 comp rx=0 tx=0).stop 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 -- 172.21.15.46:0/2034156867 shutdown_connections 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 --2- 172.21.15.46:0/2034156867 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d410b920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 --2- 172.21.15.46:0/2034156867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d4102b10 0x7f16d4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 -- 172.21.15.46:0/2034156867 >> 172.21.15.46:0/2034156867 conn(0x7f16d40fc550 msgr2=0x7f16d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 -- 172.21.15.46:0/2034156867 shutdown_connections 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 -- 172.21.15.46:0/2034156867 wait complete. 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 Processor -- start 2024-09-21T13:01:19.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 -- start start 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d4102b10 0x7f16d419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.475+0000 7f16dbc97640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f16d410edc0 con 0x7f16d4103430 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16dbc97640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f16d410ec40 con 0x7f16d4102b10 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56068/0 (socket says 172.21.15.46:56068) 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 -- 172.21.15.46:0/3155623879 learned_addr learned my addr 172.21.15.46:0/3155623879 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9a33640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d4102b10 0x7f16d419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 -- 172.21.15.46:0/3155623879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d4102b10 msgr2=0x7f16d419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d4102b10 0x7f16d419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 -- 172.21.15.46:0/3155623879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16d41977f0 con 0x7f16d4103430 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16d9232640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d419dbb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f16c40099d0 tx=0x7f16c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16c403f070 con 0x7f16d4103430 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f16c40035f0 con 0x7f16d4103430 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16d4197a80 con 0x7f16d4103430 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f16c4035030 con 0x7f16d4103430 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.476+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16d4197fb0 con 0x7f16d4103430 2024-09-21T13:01:19.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.477+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16d406a520 con 0x7f16d4103430 2024-09-21T13:01:19.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.478+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f16c4042070 con 0x7f16d4103430 2024-09-21T13:01:19.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.479+0000 7f16caffd640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f16c007af90 0x7f16c007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.479+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f16c40be9f0 con 0x7f16d4103430 2024-09-21T13:01:19.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.479+0000 7f16d9a33640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f16c007af90 0x7f16c007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.479+0000 7f16d9a33640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f16c007af90 0x7f16c007d450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16d000bbe0 tx=0x7f16d000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:19.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.483+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16c4089fc0 con 0x7f16d4103430 2024-09-21T13:01:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:19 smithi176 ceph-mon[80162]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:19 smithi176 ceph-mon[80162]: from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:19.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.715+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f16d4198d20 con 0x7f16d4103430 2024-09-21T13:01:19.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.715+0000 7f16caffd640 1 -- 172.21.15.46:0/3155623879 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f16c408ee70 con 0x7f16d4103430 2024-09-21T13:01:19.716 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:01:19.717 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:01:19.718 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:19.719 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:19.720 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:01:19.720 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f16c007af90 msgr2=0x7f16c007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f16c007af90 0x7f16c007d450 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f16d000bbe0 tx=0x7f16d000b390 comp rx=0 tx=0).stop 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 msgr2=0x7f16d419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d419dbb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f16c40099d0 tx=0x7f16c40045e0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 shutdown_connections 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f16c007af90 0x7f16c007d450 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f16d4103430 0x7f16d419dbb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 --2- 172.21.15.46:0/3155623879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16d4102b10 0x7f16d419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 >> 172.21.15.46:0/3155623879 conn(0x7f16d40fc550 msgr2=0x7f16d4103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 shutdown_connections 2024-09-21T13:01:19.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.718+0000 7f16dbc97640 1 -- 172.21.15.46:0/3155623879 wait complete. 2024-09-21T13:01:19.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 -- 172.21.15.46:0/2665910202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 msgr2=0x7f720c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 --2- 172.21.15.46:0/2665910202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c10b8d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7200009880 tx=0x7f720002a530 comp rx=0 tx=0).stop 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 -- 172.21.15.46:0/2665910202 shutdown_connections 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 --2- 172.21.15.46:0/2665910202 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c10b8d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 --2- 172.21.15.46:0/2665910202 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 0x7f720c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 -- 172.21.15.46:0/2665910202 >> 172.21.15.46:0/2665910202 conn(0x7f720c0fc520 msgr2=0x7f720c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 -- 172.21.15.46:0/2665910202 shutdown_connections 2024-09-21T13:01:19.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.803+0000 7f72126bf640 1 -- 172.21.15.46:0/2665910202 wait complete. 2024-09-21T13:01:19.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f72126bf640 1 Processor -- start 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f72126bf640 1 -- start start 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f72126bf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 0x7f720c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f72126bf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f72126bf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f720c10edd0 con 0x7f720c1033e0 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f72126bf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f720c10ec50 con 0x7f720c102ac0 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.804+0000 7f720b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56078/0 (socket says 172.21.15.46:56078) 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720b7fe640 1 -- 172.21.15.46:0/3990926891 learned_addr learned my addr 172.21.15.46:0/3990926891 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720bfff640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 0x7f720c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720b7fe640 1 -- 172.21.15.46:0/3990926891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 msgr2=0x7f720c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720b7fe640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 0x7f720c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720b7fe640 1 -- 172.21.15.46:0/3990926891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f720c1011a0 con 0x7f720c1033e0 2024-09-21T13:01:19.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720bfff640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 0x7f720c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:01:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f720b7fe640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c100c60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7200031460 tx=0x7f7200004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f720003f070 con 0x7f720c1033e0 2024-09-21T13:01:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f720c101430 con 0x7f720c1033e0 2024-09-21T13:01:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72000035f0 con 0x7f720c1033e0 2024-09-21T13:01:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7200035030 con 0x7f720c1033e0 2024-09-21T13:01:19.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.805+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f720c1a3da0 con 0x7f720c1033e0 2024-09-21T13:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.807+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f720c06aa90 con 0x7f720c1033e0 2024-09-21T13:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.807+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7200042070 con 0x7f720c1033e0 2024-09-21T13:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.808+0000 7f72097fa640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f71f407af30 0x7f71f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.808+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f72000beb00 con 0x7f720c1033e0 2024-09-21T13:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.808+0000 7f720bfff640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f71f407af30 0x7f71f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:19.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.808+0000 7f720bfff640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f71f407af30 0x7f71f407d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005fd0 tx=0x7f71fc00b5f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:19.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:19.812+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7200089fb0 con 0x7f720c1033e0 2024-09-21T13:01:20.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.017+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f720c062630 con 0x7f71f407af30 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.019+0000 7f72097fa640 1 -- 172.21.15.46:0/3990926891 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f720c062630 con 0x7f71f407af30 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:01:20.020 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:01:20.021 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:01:20.021 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:01:20.021 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:01:20.021 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:01:20.021 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:01:20.021 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:01:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f71f407af30 msgr2=0x7f71f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:20.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f71f407af30 0x7f71f407d3f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f71fc005fd0 tx=0x7f71fc00b5f0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 msgr2=0x7f720c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c100c60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7200031460 tx=0x7f7200004530 comp rx=0 tx=0).stop 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 shutdown_connections 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f71f407af30 0x7f71f407d3f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f720c1033e0 0x7f720c100c60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 --2- 172.21.15.46:0/3990926891 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f720c102ac0 0x7f720c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 >> 172.21.15.46:0/3990926891 conn(0x7f720c0fc520 msgr2=0x7f720c108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 shutdown_connections 2024-09-21T13:01:20.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.021+0000 7f72126bf640 1 -- 172.21.15.46:0/3990926891 wait complete. 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 -- 172.21.15.46:0/1640619968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81067f0 msgr2=0x7f78f8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/1640619968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81067f0 0x7f78f8106bd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f78e8009880 tx=0x7f78e802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 -- 172.21.15.46:0/1640619968 shutdown_connections 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/1640619968 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78f81007f0 0x7f78f8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/1640619968 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81067f0 0x7f78f8106bd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 -- 172.21.15.46:0/1640619968 >> 172.21.15.46:0/1640619968 conn(0x7f78f80fc550 msgr2=0x7f78f80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:20.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 -- 172.21.15.46:0/1640619968 shutdown_connections 2024-09-21T13:01:20.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 -- 172.21.15.46:0/1640619968 wait complete. 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.107+0000 7f78fcc4d640 1 Processor -- start 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78fcc4d640 1 -- start start 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78fcc4d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 0x7f78f8198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78fcc4d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78f81067f0 0x7f78f8198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78fcc4d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810dcc0 con 0x7f78f81007f0 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78fcc4d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f78f810db40 con 0x7f78f81067f0 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 0x7f78f8198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 0x7f78f8198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56096/0 (socket says 172.21.15.46:56096) 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 -- 172.21.15.46:0/2118735655 learned_addr learned my addr 172.21.15.46:0/2118735655 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f5d9b640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78f81067f0 0x7f78f8198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:20.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 -- 172.21.15.46:0/2118735655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78f81067f0 msgr2=0x7f78f8198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78f81067f0 0x7f78f8198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 -- 172.21.15.46:0/2118735655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f8199350 con 0x7f78f81007f0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.108+0000 7f78f659c640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 0x7f78f8198810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78e8031460 tx=0x7f78e80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.109+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78e803f070 con 0x7f78f81007f0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.109+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f78e8004cf0 con 0x7f78f81007f0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.109+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f81995e0 con 0x7f78f81007f0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.109+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f78e8035030 con 0x7f78f81007f0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.109+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f81a1b90 con 0x7f78f81007f0 2024-09-21T13:01:20.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.110+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f8101f30 con 0x7f78f81007f0 2024-09-21T13:01:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.111+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f78e8042070 con 0x7f78f81007f0 2024-09-21T13:01:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.111+0000 7f78e77fe640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78e007af80 0x7f78e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.111+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f78e80bea90 con 0x7f78f81007f0 2024-09-21T13:01:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.111+0000 7f78f5d9b640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78e007af80 0x7f78e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:20.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.112+0000 7f78f5d9b640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78e007af80 0x7f78e007d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005fd0 tx=0x7f78ec005e20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:20.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.115+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f78e808a060 con 0x7f78f81007f0 2024-09-21T13:01:20.376 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.375+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f78f8108d60 con 0x7f78f81007f0 2024-09-21T13:01:20.376 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:20 smithi046 ceph-mon[108126]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:20.377 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:20 smithi046 ceph-mon[108126]: from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:20.377 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1919513945' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:01:20.377 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3155623879' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:01:20.377 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.375+0000 7f78e77fe640 1 -- 172.21.15.46:0/2118735655 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f78e808ef10 con 0x7f78f81007f0 2024-09-21T13:01:20.377 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:01:20.377 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:01:20.377 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:01:20.377 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:01:20.378 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:01:20.378 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:01:20.378 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78e007af80 msgr2=0x7f78e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78e007af80 0x7f78e007d440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f78ec005fd0 tx=0x7f78ec005e20 comp rx=0 tx=0).stop 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 msgr2=0x7f78f8198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 0x7f78f8198810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f78e8031460 tx=0x7f78e80048f0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 shutdown_connections 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f78e007af80 0x7f78e007d440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78f81067f0 0x7f78f8198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 --2- 172.21.15.46:0/2118735655 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f78f81007f0 0x7f78f8198810 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 >> 172.21.15.46:0/2118735655 conn(0x7f78f80fc550 msgr2=0x7f78f80fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:20.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 shutdown_connections 2024-09-21T13:01:20.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:20.378+0000 7f78fcc4d640 1 -- 172.21.15.46:0/2118735655 wait complete. 2024-09-21T13:01:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:20 smithi176 ceph-mon[80162]: from='client.34650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:20 smithi176 ceph-mon[80162]: from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1919513945' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:01:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3155623879' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:01:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:21 smithi046 ceph-mon[108126]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:21 smithi046 ceph-mon[108126]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:21 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2118735655' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:01:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:21 smithi176 ceph-mon[80162]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:21 smithi176 ceph-mon[80162]: from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:21 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2118735655' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:01:23.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:23 smithi046 ceph-mon[108126]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:23 smithi176 ceph-mon[80162]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:25.414 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:25 smithi046 ceph-mon[108126]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:25 smithi176 ceph-mon[80162]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:27 smithi046 ceph-mon[108126]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:27 smithi176 ceph-mon[80162]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:29 smithi046 ceph-mon[108126]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:29 smithi176 ceph-mon[80162]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:31 smithi046 ceph-mon[108126]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:31 smithi176 ceph-mon[80162]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:33 smithi046 ceph-mon[108126]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:33 smithi176 ceph-mon[80162]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:35 smithi046 ceph-mon[108126]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:35 smithi176 ceph-mon[80162]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:37 smithi176 ceph-mon[80162]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:37 smithi046 ceph-mon[108126]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:39 smithi046 ceph-mon[108126]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:39 smithi176 ceph-mon[80162]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:41 smithi176 ceph-mon[80162]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:41 smithi046 ceph-mon[108126]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:43 smithi176 ceph-mon[80162]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:43 smithi046 ceph-mon[108126]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:45 smithi046 ceph-mon[108126]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:45 smithi176 ceph-mon[80162]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:01:47.435 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:47 smithi176 ceph-mon[80162]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:47 smithi046 ceph-mon[108126]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:49 smithi176 ceph-mon[80162]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:49 smithi046 ceph-mon[108126]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.475+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/3366020085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 msgr2=0x7fc5b8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.475+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/3366020085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b8100c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac009880 tx=0x7fc5ac02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/3366020085 shutdown_connections 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/3366020085 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b8100c50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/3366020085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 0x7fc5b8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/3366020085 >> 172.21.15.46:0/3366020085 conn(0x7fc5b80fc550 msgr2=0x7fc5b80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:50.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/3366020085 shutdown_connections 2024-09-21T13:01:50.478 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/3366020085 wait complete. 2024-09-21T13:01:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.476+0000 7fc5bd1c3640 1 Processor -- start 2024-09-21T13:01:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5bd1c3640 1 -- start start 2024-09-21T13:01:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5bd1c3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b81023c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5bd1c3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 0x7fc5b8102900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:50.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5bd1c3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b810dcc0 con 0x7fc5b81007f0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5bd1c3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b810db40 con 0x7fc5b81067f0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5b6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b81023c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5b6d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b81023c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53794/0 (socket says 172.21.15.46:53794) 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5b6d9d640 1 -- 172.21.15.46:0/345794925 learned_addr learned my addr 172.21.15.46:0/345794925 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.477+0000 7fc5b659c640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 0x7fc5b8102900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5b6d9d640 1 -- 172.21.15.46:0/345794925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 msgr2=0x7fc5b8102900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5b6d9d640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 0x7fc5b8102900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5b6d9d640 1 -- 172.21.15.46:0/345794925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b8102e40 con 0x7fc5b81007f0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5b659c640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 0x7fc5b8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5b6d9d640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b81023c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800ea00 tx=0x7fc5a800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5a800cb80 con 0x7fc5b81007f0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc5a800cd20 con 0x7fc5b81007f0 2024-09-21T13:01:50.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b8103130 con 0x7fc5b81007f0 2024-09-21T13:01:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5a8011470 con 0x7fc5b81007f0 2024-09-21T13:01:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.478+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b81a3e00 con 0x7fc5b81007f0 2024-09-21T13:01:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.479+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b8101f30 con 0x7fc5b81007f0 2024-09-21T13:01:50.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.480+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc5a8005020 con 0x7fc5b81007f0 2024-09-21T13:01:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.480+0000 7fc59ffff640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc5a007af80 0x7fc5a007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.480+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc5a809e490 con 0x7fc5b81007f0 2024-09-21T13:01:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.481+0000 7fc5b659c640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc5a007af80 0x7fc5a007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:50.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.481+0000 7fc5b659c640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc5a007af80 0x7fc5a007d440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8103e50 tx=0x7fc5ac031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:50.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.485+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5a8016030 con 0x7fc5b81007f0 2024-09-21T13:01:50.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.693+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc5b8069ca0 con 0x7fc5a007af80 2024-09-21T13:01:50.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.695+0000 7fc59ffff640 1 -- 172.21.15.46:0/345794925 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc5b8069ca0 con 0x7fc5a007af80 2024-09-21T13:01:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc5a007af80 msgr2=0x7fc5a007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc5a007af80 0x7fc5a007d440 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8103e50 tx=0x7fc5ac031400 comp rx=0 tx=0).stop 2024-09-21T13:01:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 msgr2=0x7fc5b81023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b81023c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc5a800ea00 tx=0x7fc5a800eec0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.698 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 shutdown_connections 2024-09-21T13:01:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc5a007af80 0x7fc5a007d440 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc5b81067f0 0x7fc5b8102900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 --2- 172.21.15.46:0/345794925 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc5b81007f0 0x7fc5b81023c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 >> 172.21.15.46:0/345794925 conn(0x7fc5b80fc550 msgr2=0x7fc5b8104560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 shutdown_connections 2024-09-21T13:01:50.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.697+0000 7fc5bd1c3640 1 -- 172.21.15.46:0/345794925 wait complete. 2024-09-21T13:01:50.707 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.782+0000 7fae2a71a640 1 -- 172.21.15.46:0/2480571802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae24102ab0 msgr2=0x7fae24102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.782+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2480571802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae24102ab0 0x7fae24102e90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fae14009880 tx=0x7fae1402a530 comp rx=0 tx=0).stop 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 -- 172.21.15.46:0/2480571802 shutdown_connections 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2480571802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae241033d0 0x7fae2410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2480571802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae24102ab0 0x7fae24102e90 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 -- 172.21.15.46:0/2480571802 >> 172.21.15.46:0/2480571802 conn(0x7fae240fc550 msgr2=0x7fae240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 -- 172.21.15.46:0/2480571802 shutdown_connections 2024-09-21T13:01:50.784 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 -- 172.21.15.46:0/2480571802 wait complete. 2024-09-21T13:01:50.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 Processor -- start 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.783+0000 7fae2a71a640 1 -- start start 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae2a71a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae24102ab0 0x7fae2419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae2a71a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 0x7fae2419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae2a71a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fae2410ee40 con 0x7fae241033d0 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae2a71a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fae2410ecc0 con 0x7fae24102ab0 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 0x7fae2419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae237fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 0x7fae2419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53816/0 (socket says 172.21.15.46:53816) 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae237fe640 1 -- 172.21.15.46:0/2982611934 learned_addr learned my addr 172.21.15.46:0/2982611934 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae23fff640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae24102ab0 0x7fae2419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae237fe640 1 -- 172.21.15.46:0/2982611934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae24102ab0 msgr2=0x7fae2419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae237fe640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae24102ab0 0x7fae2419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:50.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.784+0000 7fae237fe640 1 -- 172.21.15.46:0/2982611934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae24197810 con 0x7fae241033d0 2024-09-21T13:01:50.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.785+0000 7fae237fe640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 0x7fae2419dbd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae1800b370 tx=0x7fae1800b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:50.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.785+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae18015020 con 0x7fae241033d0 2024-09-21T13:01:50.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.785+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fae18011af0 con 0x7fae241033d0 2024-09-21T13:01:50.787 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.785+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae24197b00 con 0x7fae241033d0 2024-09-21T13:01:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.785+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fae18010d60 con 0x7fae241033d0 2024-09-21T13:01:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.785+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae24198090 con 0x7fae241033d0 2024-09-21T13:01:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.786+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae2406a580 con 0x7fae241033d0 2024-09-21T13:01:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.787+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fae18018020 con 0x7fae241033d0 2024-09-21T13:01:50.788 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.787+0000 7fae217fa640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae0c07af80 0x7fae0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.788+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fae1809d8d0 con 0x7fae241033d0 2024-09-21T13:01:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.788+0000 7fae23fff640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae0c07af80 0x7fae0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:50.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.788+0000 7fae23fff640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae0c07af80 0x7fae0c07d440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fae140096c0 tx=0x7fae14031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:50.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.792+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fae1801f020 con 0x7fae241033d0 2024-09-21T13:01:50.999 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.998+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fae241983a0 con 0x7fae0c07af80 2024-09-21T13:01:51.000 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:50.999+0000 7fae217fa640 1 -- 172.21.15.46:0/2982611934 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fae241983a0 con 0x7fae0c07af80 2024-09-21T13:01:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae0c07af80 msgr2=0x7fae0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae0c07af80 0x7fae0c07d440 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fae140096c0 tx=0x7fae14031400 comp rx=0 tx=0).stop 2024-09-21T13:01:51.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 msgr2=0x7fae2419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 0x7fae2419dbd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae1800b370 tx=0x7fae1800b830 comp rx=0 tx=0).stop 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 shutdown_connections 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fae0c07af80 0x7fae0c07d440 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fae241033d0 0x7fae2419dbd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 --2- 172.21.15.46:0/2982611934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae24102ab0 0x7fae2419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 >> 172.21.15.46:0/2982611934 conn(0x7fae240fc550 msgr2=0x7fae24108e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 shutdown_connections 2024-09-21T13:01:51.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.001+0000 7fae2a71a640 1 -- 172.21.15.46:0/2982611934 wait complete. 2024-09-21T13:01:51.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 -- 172.21.15.46:0/3825708110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 msgr2=0x7f6d1c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 --2- 172.21.15.46:0/3825708110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c10b8d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c009880 tx=0x7f6d0c02a530 comp rx=0 tx=0).stop 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 -- 172.21.15.46:0/3825708110 shutdown_connections 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 --2- 172.21.15.46:0/3825708110 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c10b8d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 --2- 172.21.15.46:0/3825708110 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d1c102ac0 0x7f6d1c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 -- 172.21.15.46:0/3825708110 >> 172.21.15.46:0/3825708110 conn(0x7f6d1c0fc520 msgr2=0x7f6d1c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 -- 172.21.15.46:0/3825708110 shutdown_connections 2024-09-21T13:01:51.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.086+0000 7f6d24773640 1 -- 172.21.15.46:0/3825708110 wait complete. 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.087+0000 7f6d24773640 1 Processor -- start 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.087+0000 7f6d24773640 1 -- start start 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.087+0000 7f6d24773640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d1c102ac0 0x7f6d1c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.087+0000 7f6d24773640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.087+0000 7f6d24773640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c10edf0 con 0x7f6d1c1033e0 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.087+0000 7f6d24773640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1c10ec70 con 0x7f6d1c102ac0 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53832/0 (socket says 172.21.15.46:53832) 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 -- 172.21.15.46:0/106497130 learned_addr learned my addr 172.21.15.46:0/106497130 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:51.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d2250f640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d1c102ac0 0x7f6d1c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 -- 172.21.15.46:0/106497130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d1c102ac0 msgr2=0x7f6d1c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d1c102ac0 0x7f6d1c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 -- 172.21.15.46:0/106497130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1c1011a0 con 0x7f6d1c1033e0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d21d0e640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c100c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c031460 tx=0x7f6d0c0045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d0c03f070 con 0x7f6d1c1033e0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d0c0035f0 con 0x7f6d1c1033e0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d0c035030 con 0x7f6d1c1033e0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d1c101430 con 0x7f6d1c1033e0 2024-09-21T13:01:51.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.088+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d1c1a3dc0 con 0x7f6d1c1033e0 2024-09-21T13:01:51.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.089+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1c06aa90 con 0x7f6d1c1033e0 2024-09-21T13:01:51.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.091+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6d0c042070 con 0x7f6d1c1033e0 2024-09-21T13:01:51.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.091+0000 7f6d137fe640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d0807af30 0x7f6d0807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.091+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6d0c0bef50 con 0x7f6d1c1033e0 2024-09-21T13:01:51.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.092+0000 7f6d2250f640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d0807af30 0x7f6d0807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.092+0000 7f6d2250f640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d0807af30 0x7f6d0807d3f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009b60 tx=0x7f6d18005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:51.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.095+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d0c08a520 con 0x7f6d1c1033e0 2024-09-21T13:01:51.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.292+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6d1c062630 con 0x7f6d0807af30 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.302+0000 7f6d137fe640 1 -- 172.21.15.46:0/106497130 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f6d1c062630 con 0x7f6d0807af30 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (12m) 6m ago 22m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (15m) 6m ago 23m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (15m) 5m ago 22m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 6m ago 23m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (10m) 5m ago 22m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (11m) 6m ago 22m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:01:51.303 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (6m) 6m ago 17m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (6m) 6m ago 17m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (5m) 5m ago 17m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (5m) 5m ago 17m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (14m) 6m ago 24m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (13m) 5m ago 22m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (10m) 6m ago 24m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (10m) 5m ago 21m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (13m) 6m ago 22m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (12m) 5m ago 22m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (9m) 6m ago 20m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 6m ago 20m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (8m) 6m ago 19m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (7m) 5m ago 19m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (7m) 5m ago 19m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:01:51.304 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (6m) 5m ago 18m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:01:51.305 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (12m) 6m ago 22m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:01:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d0807af30 msgr2=0x7f6d0807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d0807af30 0x7f6d0807d3f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009b60 tx=0x7f6d18005f90 comp rx=0 tx=0).stop 2024-09-21T13:01:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 msgr2=0x7f6d1c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c100c60 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c031460 tx=0x7f6d0c0045c0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 shutdown_connections 2024-09-21T13:01:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d0807af30 0x7f6d0807d3f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d1c1033e0 0x7f6d1c100c60 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 --2- 172.21.15.46:0/106497130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d1c102ac0 0x7f6d1c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 >> 172.21.15.46:0/106497130 conn(0x7f6d1c0fc520 msgr2=0x7f6d1c108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 shutdown_connections 2024-09-21T13:01:51.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.304+0000 7f6d24773640 1 -- 172.21.15.46:0/106497130 wait complete. 2024-09-21T13:01:51.388 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 -- 172.21.15.46:0/1870780802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 msgr2=0x7f7fd4102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/1870780802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd4102f00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40098b0 tx=0x7f7fc402a560 comp rx=0 tx=0).stop 2024-09-21T13:01:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 -- 172.21.15.46:0/1870780802 shutdown_connections 2024-09-21T13:01:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/1870780802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fd4103440 0x7f7fd410b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/1870780802 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd4102f00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 -- 172.21.15.46:0/1870780802 >> 172.21.15.46:0/1870780802 conn(0x7f7fd40fc520 msgr2=0x7f7fd40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.389 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:51 smithi046 ceph-mon[108126]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 -- 172.21.15.46:0/1870780802 shutdown_connections 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.387+0000 7f7fda7b2640 1 -- 172.21.15.46:0/1870780802 wait complete. 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.388+0000 7f7fda7b2640 1 Processor -- start 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.388+0000 7f7fda7b2640 1 -- start start 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fda7b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fda7b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fd4103440 0x7f7fd419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fda7b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd410edd0 con 0x7f7fd4102b20 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fda7b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd410ec50 con 0x7f7fd4103440 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53856/0 (socket says 172.21.15.46:53856) 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 -- 172.21.15.46:0/4200245399 learned_addr learned my addr 172.21.15.46:0/4200245399 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd37fe640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fd4103440 0x7f7fd419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 -- 172.21.15.46:0/4200245399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fd4103440 msgr2=0x7f7fd419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fd4103440 0x7f7fd419dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 -- 172.21.15.46:0/4200245399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd4197800 con 0x7f7fd4102b20 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.389+0000 7f7fd3fff640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd419d680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4031460 tx=0x7f7fc40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.390+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc403f070 con 0x7f7fd4102b20 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.390+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fc40044d0 con 0x7f7fd4102b20 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.390+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd4197a90 con 0x7f7fd4102b20 2024-09-21T13:01:51.392 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.390+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc4035030 con 0x7f7fd4102b20 2024-09-21T13:01:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.390+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd4197fc0 con 0x7f7fd4102b20 2024-09-21T13:01:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.391+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd406aa30 con 0x7f7fd4102b20 2024-09-21T13:01:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.392+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7fc4042070 con 0x7f7fd4102b20 2024-09-21T13:01:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.392+0000 7f7fd17fa640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fc007af80 0x7f7fc007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.392+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7fc40bea40 con 0x7f7fd4102b20 2024-09-21T13:01:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.392+0000 7f7fd37fe640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fc007af80 0x7f7fc007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.393+0000 7f7fd37fe640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fc007af80 0x7f7fc007d440 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005e10 tx=0x7f7fbc005da0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:51.397 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.397+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fc4004cf0 con 0x7f7fd4102b20 2024-09-21T13:01:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:51 smithi176 ceph-mon[80162]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.655+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7fd4198d30 con 0x7f7fd4102b20 2024-09-21T13:01:51.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.656+0000 7f7fd17fa640 1 -- 172.21.15.46:0/4200245399 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f7fc408a010 con 0x7f7fd4102b20 2024-09-21T13:01:51.658 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:01:51.658 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:01:51.658 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:01:51.659 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.657+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fc007af80 msgr2=0x7f7fc007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.657+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fc007af80 0x7f7fc007d440 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc005e10 tx=0x7f7fbc005da0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 msgr2=0x7f7fd419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd419d680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4031460 tx=0x7f7fc40048f0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 shutdown_connections 2024-09-21T13:01:51.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fc007af80 0x7f7fc007d440 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fd4103440 0x7f7fd419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 --2- 172.21.15.46:0/4200245399 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fd4102b20 0x7f7fd419d680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 >> 172.21.15.46:0/4200245399 conn(0x7f7fd40fc520 msgr2=0x7f7fd4103da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 shutdown_connections 2024-09-21T13:01:51.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.658+0000 7f7fda7b2640 1 -- 172.21.15.46:0/4200245399 wait complete. 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.741+0000 7ff0f8c53640 1 -- 172.21.15.46:0/1395133448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 msgr2=0x7ff0f4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.741+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/1395133448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f4100c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc009880 tx=0x7ff0dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 -- 172.21.15.46:0/1395133448 shutdown_connections 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/1395133448 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f4100c50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/1395133448 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 0x7ff0f4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 -- 172.21.15.46:0/1395133448 >> 172.21.15.46:0/1395133448 conn(0x7ff0f40fc550 msgr2=0x7ff0f40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 -- 172.21.15.46:0/1395133448 shutdown_connections 2024-09-21T13:01:51.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 -- 172.21.15.46:0/1395133448 wait complete. 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 Processor -- start 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.742+0000 7ff0f8c53640 1 -- start start 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f8c53640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f40fccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f8c53640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 0x7ff0f40fd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f8c53640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410dd20 con 0x7ff0f41007f0 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f8c53640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f410dba0 con 0x7ff0f41067f0 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f40fccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f40fccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53882/0 (socket says 172.21.15.46:53882) 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 -- 172.21.15.46:0/4134022875 learned_addr learned my addr 172.21.15.46:0/4134022875 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0ebfff640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 0x7ff0f40fd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 -- 172.21.15.46:0/4134022875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 msgr2=0x7ff0f40fd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 0x7ff0f40fd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 -- 172.21.15.46:0/4134022875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f40fd770 con 0x7ff0f41007f0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0ebfff640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 0x7ff0f40fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0f259c640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f40fccf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400b420 tx=0x7ff0e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.743+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0e4011630 con 0x7ff0f41007f0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.744+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0e4016070 con 0x7ff0f41007f0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.744+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f40fda60 con 0x7ff0f41007f0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.744+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0e4010d40 con 0x7ff0f41007f0 2024-09-21T13:01:51.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.744+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f41a3ed0 con 0x7ff0f41007f0 2024-09-21T13:01:51.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.745+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f4101f30 con 0x7ff0f41007f0 2024-09-21T13:01:51.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.745+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff0e401b460 con 0x7ff0f41007f0 2024-09-21T13:01:51.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.746+0000 7ff0eb7fe640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff0e007af80 0x7ff0e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:51.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.746+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff0e409d7f0 con 0x7ff0f41007f0 2024-09-21T13:01:51.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.746+0000 7ff0ebfff640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff0e007af80 0x7ff0e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:51.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.747+0000 7ff0ebfff640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff0e007af80 0x7ff0e007d440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc0095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:51.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.750+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff0e4021250 con 0x7ff0f41007f0 2024-09-21T13:01:51.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.977+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff0f4109d90 con 0x7ff0f41007f0 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.977+0000 7ff0eb7fe640 1 -- 172.21.15.46:0/4134022875 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7ff0e4068d20 con 0x7ff0f41007f0 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:01:51.979 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:01:51.980 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:01:51.981 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:51.982 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff0e007af80 msgr2=0x7ff0e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff0e007af80 0x7ff0e007d440 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc006010 tx=0x7ff0dc0095f0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 msgr2=0x7ff0f40fccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f40fccf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400b420 tx=0x7ff0e400b8e0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 shutdown_connections 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff0e007af80 0x7ff0e007d440 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0f41067f0 0x7ff0f40fd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 --2- 172.21.15.46:0/4134022875 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff0f41007f0 0x7ff0f40fccf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:51.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.980+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 >> 172.21.15.46:0/4134022875 conn(0x7ff0f40fc550 msgr2=0x7ff0f4069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:51.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.981+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 shutdown_connections 2024-09-21T13:01:51.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:51.981+0000 7ff0f8c53640 1 -- 172.21.15.46:0/4134022875 wait complete. 2024-09-21T13:01:52.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 -- 172.21.15.46:0/3878960264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c01069a0 msgr2=0x7f87c0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/3878960264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c01069a0 0x7f87c0106d80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009880 tx=0x7f87b402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 -- 172.21.15.46:0/3878960264 shutdown_connections 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/3878960264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c00ffdc0 0x7f87c0100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/3878960264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c01069a0 0x7f87c0106d80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 -- 172.21.15.46:0/3878960264 >> 172.21.15.46:0/3878960264 conn(0x7f87c00fbc90 msgr2=0x7f87c00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 -- 172.21.15.46:0/3878960264 shutdown_connections 2024-09-21T13:01:52.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.065+0000 7f87c6ed4640 1 -- 172.21.15.46:0/3878960264 wait complete. 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c6ed4640 1 Processor -- start 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c6ed4640 1 -- start start 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c6ed4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 0x7f87c019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c6ed4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c01069a0 0x7f87c019dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c6ed4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010ef20 con 0x7f87c00ffdc0 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c6ed4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f87c010eda0 con 0x7f87c01069a0 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c4c70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 0x7f87c019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c4c70640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 0x7f87c019d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53888/0 (socket says 172.21.15.46:53888) 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.066+0000 7f87c4c70640 1 -- 172.21.15.46:0/2231299639 learned_addr learned my addr 172.21.15.46:0/2231299639 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:52.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87bffff640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c01069a0 0x7f87c019dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87c4c70640 1 -- 172.21.15.46:0/2231299639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c01069a0 msgr2=0x7f87c019dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87c4c70640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c01069a0 0x7f87c019dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87c4c70640 1 -- 172.21.15.46:0/2231299639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c01978b0 con 0x7f87c00ffdc0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87c4c70640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 0x7f87c019d6f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87b4031460 tx=0x7f87b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87b403f070 con 0x7f87c00ffdc0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c0197b40 con 0x7f87c00ffdc0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f87b40035f0 con 0x7f87c00ffdc0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f87b4035030 con 0x7f87c00ffdc0 2024-09-21T13:01:52.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.067+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c0198070 con 0x7f87c00ffdc0 2024-09-21T13:01:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.068+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c01030e0 con 0x7f87c00ffdc0 2024-09-21T13:01:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.069+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f87b4042070 con 0x7f87c00ffdc0 2024-09-21T13:01:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.070+0000 7f87bdffb640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f87b007af30 0x7f87b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.070+0000 7f87bffff640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f87b007af30 0x7f87b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:52.071 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.070+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f87b40beac0 con 0x7f87c00ffdc0 2024-09-21T13:01:52.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.070+0000 7f87bffff640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f87b007af30 0x7f87b007d3f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87c00fe240 tx=0x7f87ac00b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:52.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.074+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87b4089f70 con 0x7f87c00ffdc0 2024-09-21T13:01:52.281 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.280+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f87c0198de0 con 0x7f87b007af30 2024-09-21T13:01:52.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:52 smithi046 ceph-mon[108126]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:52.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:52 smithi046 ceph-mon[108126]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:52.281 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:52 smithi046 ceph-mon[108126]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:52.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:52 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4200245399' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:01:52.282 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:52 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4134022875' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:01:52.282 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.281+0000 7f87bdffb640 1 -- 172.21.15.46:0/2231299639 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f87c0198de0 con 0x7f87b007af30 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:01:52.283 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:01:52.284 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:01:52.284 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:01:52.284 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:01:52.284 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:01:52.284 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:01:52.284 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:01:52.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f87b007af30 msgr2=0x7f87b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f87b007af30 0x7f87b007d3f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87c00fe240 tx=0x7f87ac00b410 comp rx=0 tx=0).stop 2024-09-21T13:01:52.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 msgr2=0x7f87c019d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.285 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 0x7f87c019d6f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f87b4031460 tx=0x7f87b40045e0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 shutdown_connections 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f87b007af30 0x7f87b007d3f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87c01069a0 0x7f87c019dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 --2- 172.21.15.46:0/2231299639 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f87c00ffdc0 0x7f87c019d6f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 >> 172.21.15.46:0/2231299639 conn(0x7f87c00fbc90 msgr2=0x7f87c00fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 shutdown_connections 2024-09-21T13:01:52.286 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.284+0000 7f87c6ed4640 1 -- 172.21.15.46:0/2231299639 wait complete. 2024-09-21T13:01:52.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 -- 172.21.15.46:0/2648252717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 msgr2=0x7f81b0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 --2- 172.21.15.46:0/2648252717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b0100c60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009880 tx=0x7f81a402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 -- 172.21.15.46:0/2648252717 shutdown_connections 2024-09-21T13:01:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 --2- 172.21.15.46:0/2648252717 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b0100c60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 --2- 172.21.15.46:0/2648252717 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 0x7f81b0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 -- 172.21.15.46:0/2648252717 >> 172.21.15.46:0/2648252717 conn(0x7f81b00fc520 msgr2=0x7f81b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 -- 172.21.15.46:0/2648252717 shutdown_connections 2024-09-21T13:01:52.371 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.369+0000 7f81b5724640 1 -- 172.21.15.46:0/2648252717 wait complete. 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81b5724640 1 Processor -- start 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81b5724640 1 -- start start 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81b5724640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81b5724640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 0x7f81b019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81b5724640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f81b010dcd0 con 0x7f81b0100800 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81b5724640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f81b010db50 con 0x7f81b0106800 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81aeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53894/0 (socket says 172.21.15.46:53894) 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.370+0000 7f81aeffd640 1 -- 172.21.15.46:0/1941717433 learned_addr learned my addr 172.21.15.46:0/1941717433 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81ae7fc640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 0x7f81b019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:52.373 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81aeffd640 1 -- 172.21.15.46:0/1941717433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 msgr2=0x7f81b019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81aeffd640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 0x7f81b019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81aeffd640 1 -- 172.21.15.46:0/1941717433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b01977f0 con 0x7f81b0100800 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81ae7fc640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 0x7f81b019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81aeffd640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b019d670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f81a000d6f0 tx=0x7f81a000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81a0017070 con 0x7f81b0100800 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f81a000de00 con 0x7f81b0100800 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f81a0004bb0 con 0x7f81b0100800 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b0197ae0 con 0x7f81b0100800 2024-09-21T13:01:52.374 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.371+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b0198040 con 0x7f81b0100800 2024-09-21T13:01:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.372+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81b0101f40 con 0x7f81b0100800 2024-09-21T13:01:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.373+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f81a0009a30 con 0x7f81b0100800 2024-09-21T13:01:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.373+0000 7f8197fff640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f819807af80 0x7f819807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:01:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.373+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f81a009dc20 con 0x7f81b0100800 2024-09-21T13:01:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.373+0000 7f81ae7fc640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f819807af80 0x7f819807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:01:52.375 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.374+0000 7f81ae7fc640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f819807af80 0x7f819807d440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f81b0198b40 tx=0x7f81a4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:01:52.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.378+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81a00691f0 con 0x7f81b0100800 2024-09-21T13:01:52.511 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:52 smithi176 ceph-mon[80162]: from='client.34674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:52.511 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:52 smithi176 ceph-mon[80162]: from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:52.511 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:52 smithi176 ceph-mon[80162]: from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:52.511 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:52 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4200245399' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:01:52.512 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:52 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4134022875' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:01:52.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.641+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f81b0109d80 con 0x7f81b0100800 2024-09-21T13:01:52.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.642+0000 7f8197fff640 1 -- 172.21.15.46:0/1941717433 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f81a006e0a0 con 0x7f81b0100800 2024-09-21T13:01:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:01:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:01:52.644 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:01:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:01:52.644 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:01:52.644 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:01:52.645 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.644+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f819807af80 msgr2=0x7f819807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.644+0000 7f81b5724640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f819807af80 0x7f819807d440 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f81b0198b40 tx=0x7f81a4031400 comp rx=0 tx=0).stop 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.644+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 msgr2=0x7f81b019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.644+0000 7f81b5724640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b019d670 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f81a000d6f0 tx=0x7f81a000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.644+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 shutdown_connections 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.645+0000 7f81b5724640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f819807af80 0x7f819807d440 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.645+0000 7f81b5724640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81b0106800 0x7f81b019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.645+0000 7f81b5724640 1 --2- 172.21.15.46:0/1941717433 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f81b0100800 0x7f81b019d670 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:01:52.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.645+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 >> 172.21.15.46:0/1941717433 conn(0x7f81b00fc520 msgr2=0x7f81b006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:01:52.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.645+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 shutdown_connections 2024-09-21T13:01:52.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:01:52.645+0000 7f81b5724640 1 -- 172.21.15.46:0/1941717433 wait complete. 2024-09-21T13:01:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:53 smithi176 ceph-mon[80162]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:53 smithi176 ceph-mon[80162]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:53 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1941717433' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:01:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:53 smithi046 ceph-mon[108126]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:53 smithi046 ceph-mon[108126]: from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:01:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:53 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1941717433' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:01:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:55 smithi176 ceph-mon[80162]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:55.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:55 smithi046 ceph-mon[108126]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:57 smithi046 ceph-mon[108126]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:57 smithi176 ceph-mon[80162]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:01:59 smithi176 ceph-mon[80162]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:01:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:01:59 smithi046 ceph-mon[108126]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:01 smithi176 ceph-mon[80162]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:01 smithi046 ceph-mon[108126]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:03 smithi046 ceph-mon[108126]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:03 smithi176 ceph-mon[80162]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:05 smithi176 ceph-mon[80162]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:05 smithi046 ceph-mon[108126]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:07 smithi176 ceph-mon[80162]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:07 smithi046 ceph-mon[108126]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:09 smithi046 ceph-mon[108126]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:09 smithi176 ceph-mon[80162]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:11 smithi176 ceph-mon[80162]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:11 smithi046 ceph-mon[108126]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:13 smithi176 ceph-mon[80162]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:13 smithi046 ceph-mon[108126]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:15 smithi046 ceph-mon[108126]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:15 smithi176 ceph-mon[80162]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:17 smithi176 ceph-mon[80162]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:17.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:17 smithi046 ceph-mon[108126]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:19 smithi176 ceph-mon[80162]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:19 smithi046 ceph-mon[108126]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:21 smithi046 ceph-mon[108126]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:21 smithi176 ceph-mon[80162]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:22.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 -- 172.21.15.46:0/406447506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c1033e0 msgr2=0x7f6e0c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:22.744 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 --2- 172.21.15.46:0/406447506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c1033e0 0x7f6e0c10b8d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009880 tx=0x7f6e0002a530 comp rx=0 tx=0).stop 2024-09-21T13:02:22.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 -- 172.21.15.46:0/406447506 shutdown_connections 2024-09-21T13:02:22.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 --2- 172.21.15.46:0/406447506 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c1033e0 0x7f6e0c10b8d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:22.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 --2- 172.21.15.46:0/406447506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:22.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 -- 172.21.15.46:0/406447506 >> 172.21.15.46:0/406447506 conn(0x7f6e0c0fc520 msgr2=0x7f6e0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:22.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 -- 172.21.15.46:0/406447506 shutdown_connections 2024-09-21T13:02:22.745 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.743+0000 7f6e11809640 1 -- 172.21.15.46:0/406447506 wait complete. 2024-09-21T13:02:22.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.744+0000 7f6e11809640 1 Processor -- start 2024-09-21T13:02:22.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.744+0000 7f6e11809640 1 -- start start 2024-09-21T13:02:22.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e11809640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:22.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e11809640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e0c1033e0 0x7f6e0c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:22.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e11809640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c10edd0 con 0x7f6e0c102ac0 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e11809640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c10ec50 con 0x7f6e0c1033e0 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58574/0 (socket says 172.21.15.46:58574) 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 -- 172.21.15.46:0/366026733 learned_addr learned my addr 172.21.15.46:0/366026733 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0a7fc640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e0c1033e0 0x7f6e0c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 -- 172.21.15.46:0/366026733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e0c1033e0 msgr2=0x7f6e0c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e0c1033e0 0x7f6e0c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:22.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 -- 172.21.15.46:0/366026733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c1977e0 con 0x7f6e0c102ac0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.745+0000 7f6e0affd640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c19d660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d8d0 tx=0x7f6dfc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.746+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dfc017030 con 0x7f6e0c102ac0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.746+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6dfc004020 con 0x7f6e0c102ac0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.746+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c197ad0 con 0x7f6e0c102ac0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.746+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6dfc0047a0 con 0x7f6e0c102ac0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.746+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c198030 con 0x7f6e0c102ac0 2024-09-21T13:02:22.748 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.747+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c06aa90 con 0x7f6e0c102ac0 2024-09-21T13:02:22.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.748+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6dfc0041d0 con 0x7f6e0c102ac0 2024-09-21T13:02:22.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.748+0000 7f6e10807640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6df407af30 0x7f6df407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:22.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.748+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6dfc018070 con 0x7f6e0c102ac0 2024-09-21T13:02:22.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.748+0000 7f6e0a7fc640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6df407af30 0x7f6df407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:22.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.749+0000 7f6e0a7fc640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6df407af30 0x7f6df407d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c198b30 tx=0x7f6e00031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:22.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.753+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6dfc069380 con 0x7f6e0c102ac0 2024-09-21T13:02:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.962+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6e0c198340 con 0x7f6df407af30 2024-09-21T13:02:22.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.963+0000 7f6e10807640 1 -- 172.21.15.46:0/366026733 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f6e0c198340 con 0x7f6df407af30 2024-09-21T13:02:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6df407af30 msgr2=0x7f6df407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6df407af30 0x7f6df407d3f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c198b30 tx=0x7f6e00031400 comp rx=0 tx=0).stop 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 msgr2=0x7f6e0c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c19d660 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00d8d0 tx=0x7f6dfc00dd90 comp rx=0 tx=0).stop 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 shutdown_connections 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6df407af30 0x7f6df407d3f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6e0c1033e0 0x7f6e0c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 --2- 172.21.15.46:0/366026733 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6e0c102ac0 0x7f6e0c19d660 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 >> 172.21.15.46:0/366026733 conn(0x7f6e0c0fc520 msgr2=0x7f6e0c108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 shutdown_connections 2024-09-21T13:02:22.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:22.965+0000 7f6e11809640 1 -- 172.21.15.46:0/366026733 wait complete. 2024-09-21T13:02:22.977 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:02:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.053+0000 7ffb44fbd640 1 -- 172.21.15.46:0/4097233220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 msgr2=0x7ffb40106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.053+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/4097233220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb40106be0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009880 tx=0x7ffb3002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 -- 172.21.15.46:0/4097233220 shutdown_connections 2024-09-21T13:02:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/4097233220 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb40100800 0x7ffb40100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/4097233220 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb40106be0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 -- 172.21.15.46:0/4097233220 >> 172.21.15.46:0/4097233220 conn(0x7ffb400fc520 msgr2=0x7ffb400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 -- 172.21.15.46:0/4097233220 shutdown_connections 2024-09-21T13:02:23.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 -- 172.21.15.46:0/4097233220 wait complete. 2024-09-21T13:02:23.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.054+0000 7ffb44fbd640 1 Processor -- start 2024-09-21T13:02:23.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb44fbd640 1 -- start start 2024-09-21T13:02:23.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb44fbd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb40100800 0x7ffb4019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb44fbd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb4019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb44fbd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4010edf0 con 0x7ffb40106800 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb44fbd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ffb4010ec70 con 0x7ffb40100800 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb4019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3dd9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb4019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58586/0 (socket says 172.21.15.46:58586) 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3dd9b640 1 -- 172.21.15.46:0/838868674 learned_addr learned my addr 172.21.15.46:0/838868674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3e59c640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb40100800 0x7ffb4019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3dd9b640 1 -- 172.21.15.46:0/838868674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb40100800 msgr2=0x7ffb4019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3dd9b640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb40100800 0x7ffb4019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.055+0000 7ffb3dd9b640 1 -- 172.21.15.46:0/838868674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb40197800 con 0x7ffb40106800 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.056+0000 7ffb3dd9b640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb4019dbc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400d6f0 tx=0x7ffb3400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.056+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb34017070 con 0x7ffb40106800 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.056+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb40197af0 con 0x7ffb40106800 2024-09-21T13:02:23.058 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.056+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb3400de00 con 0x7ffb40106800 2024-09-21T13:02:23.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.056+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ffb34004bb0 con 0x7ffb40106800 2024-09-21T13:02:23.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.056+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb40198080 con 0x7ffb40106800 2024-09-21T13:02:23.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.057+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb40101f40 con 0x7ffb40106800 2024-09-21T13:02:23.059 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.058+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ffb34009a30 con 0x7ffb40106800 2024-09-21T13:02:23.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.059+0000 7ffb2f7fe640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb2807af80 0x7ffb2807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.059+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ffb3409db50 con 0x7ffb40106800 2024-09-21T13:02:23.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.059+0000 7ffb3e59c640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb2807af80 0x7ffb2807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.059+0000 7ffb3e59c640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb2807af80 0x7ffb2807d440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb300096c0 tx=0x7ffb30031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:23.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.063+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffb34069120 con 0x7ffb40106800 2024-09-21T13:02:23.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.269+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ffb40198330 con 0x7ffb2807af80 2024-09-21T13:02:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.270+0000 7ffb2f7fe640 1 -- 172.21.15.46:0/838868674 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ffb40198330 con 0x7ffb2807af80 2024-09-21T13:02:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb2807af80 msgr2=0x7ffb2807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb2807af80 0x7ffb2807d440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffb300096c0 tx=0x7ffb30031400 comp rx=0 tx=0).stop 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 msgr2=0x7ffb4019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb4019dbc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400d6f0 tx=0x7ffb3400dbb0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 shutdown_connections 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ffb2807af80 0x7ffb2807d440 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ffb40106800 0x7ffb4019dbc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 --2- 172.21.15.46:0/838868674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ffb40100800 0x7ffb4019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 >> 172.21.15.46:0/838868674 conn(0x7ffb400fc520 msgr2=0x7ffb400fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 shutdown_connections 2024-09-21T13:02:23.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.272+0000 7ffb44fbd640 1 -- 172.21.15.46:0/838868674 wait complete. 2024-09-21T13:02:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.356+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1029663898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec1033e0 msgr2=0x7f2fec10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.356+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1029663898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec1033e0 0x7f2fec10b8d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2fe0009880 tx=0x7f2fe002a530 comp rx=0 tx=0).stop 2024-09-21T13:02:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.356+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1029663898 shutdown_connections 2024-09-21T13:02:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.357+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1029663898 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec1033e0 0x7f2fec10b8d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.357+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1029663898 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fec102ac0 0x7f2fec102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.358 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:23 smithi046 ceph-mon[108126]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.357+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1029663898 >> 172.21.15.46:0/1029663898 conn(0x7f2fec0fc520 msgr2=0x7f2fec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.357+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1029663898 shutdown_connections 2024-09-21T13:02:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.357+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1029663898 wait complete. 2024-09-21T13:02:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.357+0000 7f2ff1e2a640 1 Processor -- start 2024-09-21T13:02:23.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2ff1e2a640 1 -- start start 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2ff1e2a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 0x7f2fec100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2ff1e2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fec1033e0 0x7f2fec100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2ff1e2a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec10edd0 con 0x7f2fec102ac0 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2ff1e2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec10ec50 con 0x7f2fec1033e0 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 0x7f2fec100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 0x7f2fec100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58604/0 (socket says 172.21.15.46:58604) 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feb7fe640 1 -- 172.21.15.46:0/1863453929 learned_addr learned my addr 172.21.15.46:0/1863453929 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feaffd640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fec1033e0 0x7f2fec100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feb7fe640 1 -- 172.21.15.46:0/1863453929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fec1033e0 msgr2=0x7f2fec100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feb7fe640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fec1033e0 0x7f2fec100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.358+0000 7f2feb7fe640 1 -- 172.21.15.46:0/1863453929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec1011a0 con 0x7f2fec102ac0 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.359+0000 7f2feb7fe640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 0x7f2fec100720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00d8d0 tx=0x7f2fdc00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:23.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.359+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fdc017070 con 0x7f2fec102ac0 2024-09-21T13:02:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.359+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec101490 con 0x7f2fec102ac0 2024-09-21T13:02:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.359+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fdc010460 con 0x7f2fec102ac0 2024-09-21T13:02:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.359+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fdc00f5f0 con 0x7f2fec102ac0 2024-09-21T13:02:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.359+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec1a3e60 con 0x7f2fec102ac0 2024-09-21T13:02:23.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.360+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fec06aa90 con 0x7f2fec102ac0 2024-09-21T13:02:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.361+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2fdc009a30 con 0x7f2fec102ac0 2024-09-21T13:02:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.361+0000 7f2fe8ff9640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd407af30 0x7f2fd407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.361+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2fdc09dee0 con 0x7f2fec102ac0 2024-09-21T13:02:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.361+0000 7f2feaffd640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd407af30 0x7f2fd407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.362+0000 7f2feaffd640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd407af30 0x7f2fd407d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1021b0 tx=0x7f2fe0031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:23.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.366+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fdc069430 con 0x7f2fec102ac0 2024-09-21T13:02:23.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.561+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2fec062630 con 0x7f2fd407af30 2024-09-21T13:02:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:23 smithi176 ceph-mon[80162]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.571+0000 7f2fe8ff9640 1 -- 172.21.15.46:0/1863453929 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2fec062630 con 0x7f2fd407af30 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (12m) 6m ago 23m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (15m) 6m ago 23m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (15m) 6m ago 22m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (10m) 6m ago 23m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (10m) 6m ago 22m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:02:23.572 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (12m) 6m ago 23m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (7m) 6m ago 18m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (6m) 6m ago 18m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (6m) 6m ago 18m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (6m) 6m ago 17m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (14m) 6m ago 24m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (13m) 6m ago 22m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 6m ago 24m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (10m) 6m ago 22m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (13m) 6m ago 23m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (13m) 6m ago 22m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 6m ago 21m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (9m) 6m ago 20m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 6m ago 20m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (8m) 6m ago 20m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (7m) 6m ago 19m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:02:23.573 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (7m) 6m ago 19m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:02:23.574 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (12m) 6m ago 23m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:02:23.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd407af30 msgr2=0x7f2fd407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd407af30 0x7f2fd407d3f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2fec1021b0 tx=0x7f2fe0031400 comp rx=0 tx=0).stop 2024-09-21T13:02:23.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 msgr2=0x7f2fec100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 0x7f2fec100720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00d8d0 tx=0x7f2fdc00dd90 comp rx=0 tx=0).stop 2024-09-21T13:02:23.574 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 shutdown_connections 2024-09-21T13:02:23.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2fd407af30 0x7f2fd407d3f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2fec1033e0 0x7f2fec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 --2- 172.21.15.46:0/1863453929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2fec102ac0 0x7f2fec100720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 >> 172.21.15.46:0/1863453929 conn(0x7f2fec0fc520 msgr2=0x7f2fec108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:23.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 shutdown_connections 2024-09-21T13:02:23.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.573+0000 7f2ff1e2a640 1 -- 172.21.15.46:0/1863453929 wait complete. 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1855652196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8102ac0 msgr2=0x7f89d8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1855652196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8102ac0 0x7f89d8102ea0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f89c8009880 tx=0x7f89c802a530 comp rx=0 tx=0).stop 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1855652196 shutdown_connections 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1855652196 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d81033e0 0x7f89d810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1855652196 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d8102ac0 0x7f89d8102ea0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1855652196 >> 172.21.15.46:0/1855652196 conn(0x7f89d80fc520 msgr2=0x7f89d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1855652196 shutdown_connections 2024-09-21T13:02:23.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.656+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1855652196 wait complete. 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.657+0000 7f89dcdd2640 1 Processor -- start 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.657+0000 7f89dcdd2640 1 -- start start 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89dcdd2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d8102ac0 0x7f89d8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89dcdd2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 0x7f89d8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89dcdd2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89d810edf0 con 0x7f89d81033e0 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89dcdd2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89d810ec70 con 0x7f89d8102ac0 2024-09-21T13:02:23.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 0x7f89d8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 0x7f89d8100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58620/0 (socket says 172.21.15.46:58620) 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 -- 172.21.15.46:0/1851187688 learned_addr learned my addr 172.21.15.46:0/1851187688 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d659c640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d8102ac0 0x7f89d8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 -- 172.21.15.46:0/1851187688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d8102ac0 msgr2=0x7f89d8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d8102ac0 0x7f89d8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 -- 172.21.15.46:0/1851187688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d81011a0 con 0x7f89d81033e0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d659c640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d8102ac0 0x7f89d8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.658+0000 7f89d5d9b640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 0x7f89d8100c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00d6d0 tx=0x7f89cc00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.659+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89cc017070 con 0x7f89d81033e0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.659+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89cc0054e0 con 0x7f89d81033e0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.659+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d8101490 con 0x7f89d81033e0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.659+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89cc004ae0 con 0x7f89d81033e0 2024-09-21T13:02:23.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.659+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d81a3e60 con 0x7f89d81033e0 2024-09-21T13:02:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.660+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d806aa90 con 0x7f89d81033e0 2024-09-21T13:02:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.660+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f89cc004d90 con 0x7f89d81033e0 2024-09-21T13:02:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.661+0000 7f89c77fe640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89c007af90 0x7f89c007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.661+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f89cc09dbf0 con 0x7f89d81033e0 2024-09-21T13:02:23.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.661+0000 7f89d659c640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89c007af90 0x7f89c007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:23.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.662+0000 7f89d659c640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89c007af90 0x7f89c007d450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89c8000c00 tx=0x7f89c8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:23.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.666+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89cc0691c0 con 0x7f89d81033e0 2024-09-21T13:02:23.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.930+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f89d8105f90 con 0x7f89d81033e0 2024-09-21T13:02:23.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.930+0000 7f89c77fe640 1 -- 172.21.15.46:0/1851187688 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f89cc06e070 con 0x7f89d81033e0 2024-09-21T13:02:23.931 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:02:23.932 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:02:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:02:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:02:23.933 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:02:23.933 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89c007af90 msgr2=0x7f89c007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89c007af90 0x7f89c007d450 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f89c8000c00 tx=0x7f89c8031400 comp rx=0 tx=0).stop 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 msgr2=0x7f89d8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 0x7f89d8100c60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f89cc00d6d0 tx=0x7f89cc00db90 comp rx=0 tx=0).stop 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 shutdown_connections 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89c007af90 0x7f89c007d450 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89d81033e0 0x7f89d8100c60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 --2- 172.21.15.46:0/1851187688 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89d8102ac0 0x7f89d8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 >> 172.21.15.46:0/1851187688 conn(0x7f89d80fc520 msgr2=0x7f89d8108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:23.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 shutdown_connections 2024-09-21T13:02:23.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:23.933+0000 7f89dcdd2640 1 -- 172.21.15.46:0/1851187688 wait complete. 2024-09-21T13:02:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 -- 172.21.15.46:0/3464219571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454107900 msgr2=0x7fb454107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 --2- 172.21.15.46:0/3464219571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454107900 0x7fb454107ce0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fb450009880 tx=0x7fb45002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 -- 172.21.15.46:0/3464219571 shutdown_connections 2024-09-21T13:02:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 --2- 172.21.15.46:0/3464219571 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb454101900 0x7fb454101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 --2- 172.21.15.46:0/3464219571 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454107900 0x7fb454107ce0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 -- 172.21.15.46:0/3464219571 >> 172.21.15.46:0/3464219571 conn(0x7fb4540fd600 msgr2=0x7fb4540ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:24.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 -- 172.21.15.46:0/3464219571 shutdown_connections 2024-09-21T13:02:24.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.017+0000 7fb45b80a640 1 -- 172.21.15.46:0/3464219571 wait complete. 2024-09-21T13:02:24.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb45b80a640 1 Processor -- start 2024-09-21T13:02:24.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb45b80a640 1 -- start start 2024-09-21T13:02:24.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb45b80a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 0x7fb45419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb45b80a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb454107900 0x7fb45419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb45b80a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb45410edb0 con 0x7fb454101900 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb45b80a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb45410ec30 con 0x7fb454107900 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb4595a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 0x7fb45419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb4595a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 0x7fb45419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58638/0 (socket says 172.21.15.46:58638) 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb4595a6640 1 -- 172.21.15.46:0/1263974821 learned_addr learned my addr 172.21.15.46:0/1263974821 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.018+0000 7fb458da5640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb454107900 0x7fb45419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb4595a6640 1 -- 172.21.15.46:0/1263974821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb454107900 msgr2=0x7fb45419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb4595a6640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb454107900 0x7fb45419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb4595a6640 1 -- 172.21.15.46:0/1263974821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4541977c0 con 0x7fb454101900 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb4595a6640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 0x7fb45419d640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb450031460 tx=0x7fb4500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb45003f070 con 0x7fb454101900 2024-09-21T13:02:24.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb454197a50 con 0x7fb454101900 2024-09-21T13:02:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4500035f0 con 0x7fb454101900 2024-09-21T13:02:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb450035030 con 0x7fb454101900 2024-09-21T13:02:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.019+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb454197f80 con 0x7fb454101900 2024-09-21T13:02:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.020+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb454103040 con 0x7fb454101900 2024-09-21T13:02:24.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.021+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb450042070 con 0x7fb454101900 2024-09-21T13:02:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.021+0000 7fb44a7fc640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb44007af30 0x7fb44007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.021+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb4500bea20 con 0x7fb454101900 2024-09-21T13:02:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.021+0000 7fb458da5640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb44007af30 0x7fb44007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.022+0000 7fb458da5640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb44007af30 0x7fb44007d3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb454100e00 tx=0x7fb44400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:24.027 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.026+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb450089f70 con 0x7fb454101900 2024-09-21T13:02:24.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.257+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb454104b10 con 0x7fb454101900 2024-09-21T13:02:24.258 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.257+0000 7fb44a7fc640 1 -- 172.21.15.46:0/1263974821 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7fb45008ee20 con 0x7fb454101900 2024-09-21T13:02:24.258 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:02:24.258 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:02:24.258 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:02:24.259 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:02:24.260 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:24.261 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb44007af30 msgr2=0x7fb44007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb44007af30 0x7fb44007d3f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb454100e00 tx=0x7fb44400b390 comp rx=0 tx=0).stop 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 msgr2=0x7fb45419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 0x7fb45419d640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb450031460 tx=0x7fb4500045e0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 shutdown_connections 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb44007af30 0x7fb44007d3f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb454107900 0x7fb45419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 --2- 172.21.15.46:0/1263974821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb454101900 0x7fb45419d640 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 >> 172.21.15.46:0/1263974821 conn(0x7fb4540fd600 msgr2=0x7fb4540ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 shutdown_connections 2024-09-21T13:02:24.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.259+0000 7fb45b80a640 1 -- 172.21.15.46:0/1263974821 wait complete. 2024-09-21T13:02:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 -- 172.21.15.46:0/3167912082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c107900 msgr2=0x7f5b0c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 --2- 172.21.15.46:0/3167912082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c107900 0x7f5b0c107ce0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009880 tx=0x7f5b0802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 -- 172.21.15.46:0/3167912082 shutdown_connections 2024-09-21T13:02:24.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 --2- 172.21.15.46:0/3167912082 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b0c101900 0x7f5b0c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 --2- 172.21.15.46:0/3167912082 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c107900 0x7f5b0c107ce0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 -- 172.21.15.46:0/3167912082 >> 172.21.15.46:0/3167912082 conn(0x7f5b0c0fd600 msgr2=0x7f5b0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:24.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 -- 172.21.15.46:0/3167912082 shutdown_connections 2024-09-21T13:02:24.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.344+0000 7f5b13b36640 1 -- 172.21.15.46:0/3167912082 wait complete. 2024-09-21T13:02:24.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b13b36640 1 Processor -- start 2024-09-21T13:02:24.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b13b36640 1 -- start start 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b13b36640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 0x7f5b0c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b13b36640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b0c107900 0x7f5b0c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b13b36640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c10ee30 con 0x7f5b0c101900 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b13b36640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5b0c10ecb0 con 0x7f5b0c107900 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b118d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 0x7f5b0c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b118d2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 0x7f5b0c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58648/0 (socket says 172.21.15.46:58648) 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.345+0000 7f5b118d2640 1 -- 172.21.15.46:0/297066899 learned_addr learned my addr 172.21.15.46:0/297066899 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b110d1640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b0c107900 0x7f5b0c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b118d2640 1 -- 172.21.15.46:0/297066899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b0c107900 msgr2=0x7f5b0c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b118d2640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b0c107900 0x7f5b0c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b118d2640 1 -- 172.21.15.46:0/297066899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0c074f70 con 0x7f5b0c101900 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b118d2640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 0x7f5b0c0744f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b08031460 tx=0x7f5b080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:24.348 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b0803f070 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b08004cf0 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b0c075200 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b08035030 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.346+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b0c1a3dd0 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.347+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b0c103040 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.348+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5b08042070 con 0x7f5b0c101900 2024-09-21T13:02:24.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.349+0000 7f5b02ffd640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5af807af30 0x7f5af807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.349+0000 7f5b110d1640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5af807af30 0x7f5af807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.349+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5b080bebb0 con 0x7f5b0c101900 2024-09-21T13:02:24.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.349+0000 7f5b110d1640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5af807af30 0x7f5af807d3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c075f80 tx=0x7f5afc008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:24.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.353+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5b080c5080 con 0x7f5b0c101900 2024-09-21T13:02:24.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.559+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5b0c062630 con 0x7f5af807af30 2024-09-21T13:02:24.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:24 smithi046 ceph-mon[108126]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:24.560 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:24 smithi046 ceph-mon[108126]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:24.561 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:24 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1851187688' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:02:24.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.560+0000 7f5b02ffd640 1 -- 172.21.15.46:0/297066899 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5b0c062630 con 0x7f5af807af30 2024-09-21T13:02:24.561 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:02:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:02:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:02:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:02:24.561 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:02:24.562 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:02:24.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5af807af30 msgr2=0x7f5af807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5af807af30 0x7f5af807d3f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c075f80 tx=0x7f5afc008040 comp rx=0 tx=0).stop 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 msgr2=0x7f5b0c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 0x7f5b0c0744f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5b08031460 tx=0x7f5b080048f0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 shutdown_connections 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5af807af30 0x7f5af807d3f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b0c107900 0x7f5b0c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 --2- 172.21.15.46:0/297066899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5b0c101900 0x7f5b0c0744f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 >> 172.21.15.46:0/297066899 conn(0x7f5b0c0fd600 msgr2=0x7f5b0c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 shutdown_connections 2024-09-21T13:02:24.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.563+0000 7f5b13b36640 1 -- 172.21.15.46:0/297066899 wait complete. 2024-09-21T13:02:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:24 smithi176 ceph-mon[80162]: from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:24 smithi176 ceph-mon[80162]: from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:24 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1851187688' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:02:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 -- 172.21.15.46:0/1633949458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 msgr2=0x7f0100101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 --2- 172.21.15.46:0/1633949458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f0100101d60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00f4009880 tx=0x7f00f402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 -- 172.21.15.46:0/1633949458 shutdown_connections 2024-09-21T13:02:24.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 --2- 172.21.15.46:0/1633949458 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f0100101d60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 --2- 172.21.15.46:0/1633949458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0100107900 0x7f0100107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 -- 172.21.15.46:0/1633949458 >> 172.21.15.46:0/1633949458 conn(0x7f01000fd600 msgr2=0x7f01000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:24.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 -- 172.21.15.46:0/1633949458 shutdown_connections 2024-09-21T13:02:24.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.650+0000 7f01058ab640 1 -- 172.21.15.46:0/1633949458 wait complete. 2024-09-21T13:02:24.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f01058ab640 1 Processor -- start 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f01058ab640 1 -- start start 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f01058ab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f01000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f01058ab640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0100107900 0x7f0100074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f01058ab640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f010010edb0 con 0x7f0100101900 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f01058ab640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f010010ec30 con 0x7f0100107900 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f00feffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f01000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f00feffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f01000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:58670/0 (socket says 172.21.15.46:58670) 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f00feffd640 1 -- 172.21.15.46:0/4186157769 learned_addr learned my addr 172.21.15.46:0/4186157769 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.651+0000 7f00fe7fc640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0100107900 0x7f0100074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f00feffd640 1 -- 172.21.15.46:0/4186157769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0100107900 msgr2=0x7f0100074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f00feffd640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0100107900 0x7f0100074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f00feffd640 1 -- 172.21.15.46:0/4186157769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0100074f70 con 0x7f0100101900 2024-09-21T13:02:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f00feffd640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f01000744f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f00f000c810 tx=0x7f00f000ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00f0004020 con 0x7f0100101900 2024-09-21T13:02:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f00f00041c0 con 0x7f0100101900 2024-09-21T13:02:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00f00047a0 con 0x7f0100101900 2024-09-21T13:02:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0100075260 con 0x7f0100101900 2024-09-21T13:02:24.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.652+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01001a3e80 con 0x7f0100101900 2024-09-21T13:02:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.653+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0100103040 con 0x7f0100101900 2024-09-21T13:02:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.654+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f00f00079b0 con 0x7f0100101900 2024-09-21T13:02:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.654+0000 7f01048a9640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00e807af80 0x7f00e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.654+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f00f009dfb0 con 0x7f0100101900 2024-09-21T13:02:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.655+0000 7f00fe7fc640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00e807af80 0x7f00e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:24.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.655+0000 7f00fe7fc640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00e807af80 0x7f00e807d440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0100075f80 tx=0x7f00f4031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:24.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.659+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00f0014030 con 0x7f0100101900 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.921+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f0100101d60 con 0x7f0100101900 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.922+0000 7f01048a9640 1 -- 172.21.15.46:0/4186157769 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f00f00694e0 con 0x7f0100101900 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:02:24.923 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:02:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00e807af80 msgr2=0x7f00e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00e807af80 0x7f00e807d440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0100075f80 tx=0x7f00f4031420 comp rx=0 tx=0).stop 2024-09-21T13:02:24.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 msgr2=0x7f01000744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f01000744f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f00f000c810 tx=0x7f00f000ccd0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 shutdown_connections 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00e807af80 0x7f00e807d440 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0100107900 0x7f0100074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 --2- 172.21.15.46:0/4186157769 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0100101900 0x7f01000744f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 >> 172.21.15.46:0/4186157769 conn(0x7f01000fd600 msgr2=0x7f01000fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.924+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 shutdown_connections 2024-09-21T13:02:24.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:24.925+0000 7f01058ab640 1 -- 172.21.15.46:0/4186157769 wait complete. 2024-09-21T13:02:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:25 smithi176 ceph-mon[80162]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:25 smithi176 ceph-mon[80162]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:25 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1263974821' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:02:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:25 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4186157769' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:02:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:25 smithi046 ceph-mon[108126]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:25 smithi046 ceph-mon[108126]: from='client.34710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:25 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1263974821' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:02:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:25 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4186157769' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:02:26.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:26 smithi176 ceph-mon[80162]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:26.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:26 smithi046 ceph-mon[108126]: from='client.34722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:27 smithi046 ceph-mon[108126]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:27 smithi176 ceph-mon[80162]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:29 smithi176 ceph-mon[80162]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:29 smithi046 ceph-mon[108126]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:31 smithi176 ceph-mon[80162]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:31 smithi046 ceph-mon[108126]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:33 smithi046 ceph-mon[108126]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:33 smithi176 ceph-mon[80162]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:35 smithi176 ceph-mon[80162]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:35 smithi046 ceph-mon[108126]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:37 smithi176 ceph-mon[80162]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:37 smithi046 ceph-mon[108126]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:39 smithi046 ceph-mon[108126]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:39 smithi176 ceph-mon[80162]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:41 smithi176 ceph-mon[80162]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:41 smithi046 ceph-mon[108126]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:43 smithi176 ceph-mon[80162]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:43 smithi046 ceph-mon[108126]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:44.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:44.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:45 smithi046 ceph-mon[108126]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:45 smithi176 ceph-mon[80162]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:47 smithi176 ceph-mon[80162]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:47 smithi046 ceph-mon[108126]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:49 smithi176 ceph-mon[80162]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:49 smithi046 ceph-mon[108126]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:51 smithi046 ceph-mon[108126]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:51 smithi176 ceph-mon[80162]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:53 smithi176 ceph-mon[80162]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:53 smithi046 ceph-mon[108126]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:55.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 -- 172.21.15.46:0/2227715886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 msgr2=0x7fdf00100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/2227715886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf00100220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009880 tx=0x7fdee802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 -- 172.21.15.46:0/2227715886 shutdown_connections 2024-09-21T13:02:55.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/2227715886 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf00100220 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.029 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/2227715886 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf001069a0 0x7fdf00106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 -- 172.21.15.46:0/2227715886 >> 172.21.15.46:0/2227715886 conn(0x7fdf000fbc90 msgr2=0x7fdf000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 -- 172.21.15.46:0/2227715886 shutdown_connections 2024-09-21T13:02:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.022+0000 7fdf04fcc640 1 -- 172.21.15.46:0/2227715886 wait complete. 2024-09-21T13:02:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.023+0000 7fdf04fcc640 1 Processor -- start 2024-09-21T13:02:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdf04fcc640 1 -- start start 2024-09-21T13:02:55.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdf04fcc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf0019f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdf04fcc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf001069a0 0x7fdf0019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdf04fcc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0010ef20 con 0x7fdf000ffdc0 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdf04fcc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdf0010eda0 con 0x7fdf001069a0 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdefe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf0019f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdefe59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf0019f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55128/0 (socket says 172.21.15.46:55128) 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdefe59c640 1 -- 172.21.15.46:0/1145055354 learned_addr learned my addr 172.21.15.46:0/1145055354 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:55.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdef5d9b640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf001069a0 0x7fdf0019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdefe59c640 1 -- 172.21.15.46:0/1145055354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf001069a0 msgr2=0x7fdf0019fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdefe59c640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf001069a0 0x7fdf0019fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.024+0000 7fdefe59c640 1 -- 172.21.15.46:0/1145055354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf00199ac0 con 0x7fdf000ffdc0 2024-09-21T13:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.025+0000 7fdefe59c640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf0019f900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdef000d8d0 tx=0x7fdef000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.025+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdef0017030 con 0x7fdf000ffdc0 2024-09-21T13:02:55.032 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.025+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf00199db0 con 0x7fdf000ffdc0 2024-09-21T13:02:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.025+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdef0004020 con 0x7fdf000ffdc0 2024-09-21T13:02:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.025+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdef00047a0 con 0x7fdf000ffdc0 2024-09-21T13:02:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.025+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0019a310 con 0x7fdf000ffdc0 2024-09-21T13:02:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.026+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf001030e0 con 0x7fdf000ffdc0 2024-09-21T13:02:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.027+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdef00041d0 con 0x7fdf000ffdc0 2024-09-21T13:02:55.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.027+0000 7fdef7fff640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdeec07af90 0x7fdeec07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.028+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdef0018070 con 0x7fdf000ffdc0 2024-09-21T13:02:55.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.028+0000 7fdef5d9b640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdeec07af90 0x7fdeec07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.028+0000 7fdef5d9b640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdeec07af90 0x7fdeec07d450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdf0019b2b0 tx=0x7fdee80095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.032+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdef0069430 con 0x7fdf000ffdc0 2024-09-21T13:02:55.242 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.241+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fdf0019a620 con 0x7fdeec07af90 2024-09-21T13:02:55.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.242+0000 7fdef7fff640 1 -- 172.21.15.46:0/1145055354 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fdf0019a620 con 0x7fdeec07af90 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdeec07af90 msgr2=0x7fdeec07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdeec07af90 0x7fdeec07d450 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fdf0019b2b0 tx=0x7fdee80095c0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 msgr2=0x7fdf0019f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf0019f900 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fdef000d8d0 tx=0x7fdef000dd90 comp rx=0 tx=0).stop 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 shutdown_connections 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdeec07af90 0x7fdeec07d450 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf001069a0 0x7fdf0019fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 --2- 172.21.15.46:0/1145055354 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdf000ffdc0 0x7fdf0019f900 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 >> 172.21.15.46:0/1145055354 conn(0x7fdf000fbc90 msgr2=0x7fdf000fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 shutdown_connections 2024-09-21T13:02:55.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.244+0000 7fdf04fcc640 1 -- 172.21.15.46:0/1145055354 wait complete. 2024-09-21T13:02:55.254 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:02:55.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 -- 172.21.15.46:0/1084948911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c107900 msgr2=0x7fc82c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 --2- 172.21.15.46:0/1084948911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c107900 0x7fc82c107ce0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc828009880 tx=0x7fc82802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 -- 172.21.15.46:0/1084948911 shutdown_connections 2024-09-21T13:02:55.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 --2- 172.21.15.46:0/1084948911 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c101900 0x7fc82c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.332 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 --2- 172.21.15.46:0/1084948911 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c107900 0x7fc82c107ce0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 -- 172.21.15.46:0/1084948911 >> 172.21.15.46:0/1084948911 conn(0x7fc82c0fd600 msgr2=0x7fc82c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 -- 172.21.15.46:0/1084948911 shutdown_connections 2024-09-21T13:02:55.333 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 -- 172.21.15.46:0/1084948911 wait complete. 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.331+0000 7fc834185640 1 Processor -- start 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc834185640 1 -- start start 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc834185640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 0x7fc82c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc834185640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c107900 0x7fc82c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc834185640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c10edb0 con 0x7fc82c101900 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc834185640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc82c10ec30 con 0x7fc82c107900 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 0x7fc82c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 0x7fc82c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55136/0 (socket says 172.21.15.46:55136) 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 -- 172.21.15.46:0/4139647318 learned_addr learned my addr 172.21.15.46:0/4139647318 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:55.335 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831720640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c107900 0x7fc82c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 -- 172.21.15.46:0/4139647318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c107900 msgr2=0x7fc82c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c107900 0x7fc82c19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 -- 172.21.15.46:0/4139647318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82c1977e0 con 0x7fc82c101900 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831720640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c107900 0x7fc82c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.332+0000 7fc831f21640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 0x7fc82c19d660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc828031460 tx=0x7fc8280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.333+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc82803f070 con 0x7fc82c101900 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.333+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82c197a70 con 0x7fc82c101900 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.333+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8280044d0 con 0x7fc82c101900 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.333+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc828035030 con 0x7fc82c101900 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.333+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc82c197fa0 con 0x7fc82c101900 2024-09-21T13:02:55.336 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.334+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82c103040 con 0x7fc82c101900 2024-09-21T13:02:55.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.334+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc828042070 con 0x7fc82c101900 2024-09-21T13:02:55.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.335+0000 7fc822ffd640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc81807af40 0x7fc81807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.335+0000 7fc831720640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc81807af40 0x7fc81807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.335+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc8280bec50 con 0x7fc82c101900 2024-09-21T13:02:55.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.335+0000 7fc831720640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc81807af40 0x7fc81807d400 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc82c100d10 tx=0x7fc81c005d90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.339+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc828004cf0 con 0x7fc82c101900 2024-09-21T13:02:55.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.544+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc82c198250 con 0x7fc81807af40 2024-09-21T13:02:55.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.545+0000 7fc822ffd640 1 -- 172.21.15.46:0/4139647318 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc82c198250 con 0x7fc81807af40 2024-09-21T13:02:55.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc81807af40 msgr2=0x7fc81807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc81807af40 0x7fc81807d400 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc82c100d10 tx=0x7fc81c005d90 comp rx=0 tx=0).stop 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 msgr2=0x7fc82c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 0x7fc82c19d660 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc828031460 tx=0x7fc8280048f0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 shutdown_connections 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc81807af40 0x7fc81807d400 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc82c107900 0x7fc82c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 --2- 172.21.15.46:0/4139647318 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc82c101900 0x7fc82c19d660 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 >> 172.21.15.46:0/4139647318 conn(0x7fc82c0fd600 msgr2=0x7fc82c0fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 shutdown_connections 2024-09-21T13:02:55.550 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.547+0000 7fc834185640 1 -- 172.21.15.46:0/4139647318 wait complete. 2024-09-21T13:02:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:55 smithi176 ceph-mon[80162]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:55.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.631+0000 7f52e00af640 1 -- 172.21.15.46:0/1904004959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8107910 msgr2=0x7f52d8107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.631+0000 7f52e00af640 1 --2- 172.21.15.46:0/1904004959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8107910 0x7f52d8107cf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f52c8009c20 tx=0x7f52c802a970 comp rx=0 tx=0).stop 2024-09-21T13:02:55.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.631+0000 7f52e00af640 1 -- 172.21.15.46:0/1904004959 shutdown_connections 2024-09-21T13:02:55.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.631+0000 7f52e00af640 1 --2- 172.21.15.46:0/1904004959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52d8101910 0x7f52d8101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.631+0000 7f52e00af640 1 --2- 172.21.15.46:0/1904004959 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8107910 0x7f52d8107cf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.631+0000 7f52e00af640 1 -- 172.21.15.46:0/1904004959 >> 172.21.15.46:0/1904004959 conn(0x7f52d80fd610 msgr2=0x7f52d80ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.634 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:55 smithi046 ceph-mon[108126]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.632+0000 7f52e00af640 1 -- 172.21.15.46:0/1904004959 shutdown_connections 2024-09-21T13:02:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.632+0000 7f52e00af640 1 -- 172.21.15.46:0/1904004959 wait complete. 2024-09-21T13:02:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.632+0000 7f52e00af640 1 Processor -- start 2024-09-21T13:02:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.632+0000 7f52e00af640 1 -- start start 2024-09-21T13:02:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52e00af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 0x7f52d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.638 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52e00af640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52d8107910 0x7f52d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52e00af640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f52d810ede0 con 0x7f52d8101910 2024-09-21T13:02:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52e00af640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f52d810ec60 con 0x7f52d8107910 2024-09-21T13:02:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 0x7f52d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 0x7f52d80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55168/0 (socket says 172.21.15.46:55168) 2024-09-21T13:02:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 -- 172.21.15.46:0/4208995041 learned_addr learned my addr 172.21.15.46:0/4208995041 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:55.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dd64a640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52d8107910 0x7f52d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 -- 172.21.15.46:0/4208995041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52d8107910 msgr2=0x7f52d8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52d8107910 0x7f52d8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 -- 172.21.15.46:0/4208995041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52d8074f70 con 0x7f52d8101910 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.633+0000 7f52dde4b640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 0x7f52d80744f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f52c802ae90 tx=0x7f52c802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.634+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52c8047070 con 0x7f52d8101910 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.634+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f52c802f7e0 con 0x7f52d8101910 2024-09-21T13:02:55.640 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.634+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f52c8034070 con 0x7f52d8101910 2024-09-21T13:02:55.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.634+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52d8075200 con 0x7f52d8101910 2024-09-21T13:02:55.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.634+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52d81a3dd0 con 0x7f52d8101910 2024-09-21T13:02:55.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.635+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52d8103050 con 0x7f52d8101910 2024-09-21T13:02:55.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.635+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f52c804a070 con 0x7f52d8101910 2024-09-21T13:02:55.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.636+0000 7f52d6ffd640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f52c007af80 0x7f52c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.641 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.636+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f52c80bebf0 con 0x7f52d8101910 2024-09-21T13:02:55.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.636+0000 7f52dd64a640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f52c007af80 0x7f52c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.636+0000 7f52dd64a640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f52c007af80 0x7f52c007d440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52d8075f80 tx=0x7f52cc00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.640+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f52c803f070 con 0x7f52d8101910 2024-09-21T13:02:55.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.836+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f52d8062630 con 0x7f52c007af80 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.846+0000 7f52d6ffd640 1 -- 172.21.15.46:0/4208995041 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f52d8062630 con 0x7f52c007af80 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (13m) 7m ago 23m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (16m) 7m ago 24m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (16m) 6m ago 23m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (11m) 7m ago 24m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (11m) 6m ago 23m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (12m) 7m ago 23m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (7m) 7m ago 18m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (7m) 7m ago 18m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:02:55.847 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (7m) 6m ago 18m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (6m) 6m ago 18m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (15m) 7m ago 25m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (14m) 6m ago 23m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (11m) 7m ago 25m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (11m) 6m ago 23m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (14m) 7m ago 24m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (14m) 6m ago 23m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (10m) 7m ago 21m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 7m ago 21m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (9m) 7m ago 20m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (8m) 6m ago 20m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (8m) 6m ago 20m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (7m) 6m ago 19m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:02:55.848 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (13m) 7m ago 23m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:02:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f52c007af80 msgr2=0x7f52c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f52c007af80 0x7f52c007d440 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f52d8075f80 tx=0x7f52cc00b390 comp rx=0 tx=0).stop 2024-09-21T13:02:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 msgr2=0x7f52d80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 0x7f52d80744f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f52c802ae90 tx=0x7f52c802f5f0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 shutdown_connections 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f52c007af80 0x7f52c007d440 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f52d8107910 0x7f52d8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 --2- 172.21.15.46:0/4208995041 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f52d8101910 0x7f52d80744f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 >> 172.21.15.46:0/4208995041 conn(0x7f52d80fd610 msgr2=0x7f52d80fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 shutdown_connections 2024-09-21T13:02:55.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.848+0000 7f52e00af640 1 -- 172.21.15.46:0/4208995041 wait complete. 2024-09-21T13:02:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 -- 172.21.15.46:0/1581339978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4100800 msgr2=0x7fbdb4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 --2- 172.21.15.46:0/1581339978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4100800 0x7fbdb4100c60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c009880 tx=0x7fbd9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.932 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 -- 172.21.15.46:0/1581339978 shutdown_connections 2024-09-21T13:02:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 --2- 172.21.15.46:0/1581339978 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4100800 0x7fbdb4100c60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 --2- 172.21.15.46:0/1581339978 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbdb4106800 0x7fbdb4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 -- 172.21.15.46:0/1581339978 >> 172.21.15.46:0/1581339978 conn(0x7fbdb40fc520 msgr2=0x7fbdb40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 -- 172.21.15.46:0/1581339978 shutdown_connections 2024-09-21T13:02:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 -- 172.21.15.46:0/1581339978 wait complete. 2024-09-21T13:02:55.933 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.931+0000 7fbdb97be640 1 Processor -- start 2024-09-21T13:02:55.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdb97be640 1 -- start start 2024-09-21T13:02:55.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdb97be640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbdb4100800 0x7fbdb419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdb97be640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 0x7fbdb419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdb97be640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb410dcd0 con 0x7fbdb4106800 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdb97be640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb410db50 con 0x7fbdb4100800 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdaa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 0x7fbdb419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdaa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 0x7fbdb419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55178/0 (socket says 172.21.15.46:55178) 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdaa7fc640 1 -- 172.21.15.46:0/2812689878 learned_addr learned my addr 172.21.15.46:0/2812689878 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdb2ffd640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbdb4100800 0x7fbdb419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdaa7fc640 1 -- 172.21.15.46:0/2812689878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbdb4100800 msgr2=0x7fbdb419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdaa7fc640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbdb4100800 0x7fbdb419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.932+0000 7fbdaa7fc640 1 -- 172.21.15.46:0/2812689878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb4197800 con 0x7fbdb4106800 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.933+0000 7fbdaa7fc640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 0x7fbdb419dbc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c031460 tx=0x7fbd9c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.933+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c03f070 con 0x7fbdb4106800 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.933+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbd9c0035f0 con 0x7fbdb4106800 2024-09-21T13:02:55.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.933+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb4197a90 con 0x7fbdb4106800 2024-09-21T13:02:55.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.933+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbd9c035030 con 0x7fbdb4106800 2024-09-21T13:02:55.936 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.933+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb4197fc0 con 0x7fbdb4106800 2024-09-21T13:02:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.934+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb4101f40 con 0x7fbdb4106800 2024-09-21T13:02:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.935+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbd9c042070 con 0x7fbdb4106800 2024-09-21T13:02:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.935+0000 7fbdb0ff9640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbda007af30 0x7fbda007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.935+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbd9c0bea20 con 0x7fbdb4106800 2024-09-21T13:02:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.935+0000 7fbdb2ffd640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbda007af30 0x7fbda007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:55.937 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.936+0000 7fbdb2ffd640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbda007af30 0x7fbda007d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbda4005fd0 tx=0x7fbda400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:55.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:55.940+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbd9c089f70 con 0x7fbdb4106800 2024-09-21T13:02:56.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.200+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbdb4109d80 con 0x7fbdb4106800 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.201+0000 7fbdb0ff9640 1 -- 172.21.15.46:0/2812689878 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbd9c08ee20 con 0x7fbdb4106800 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:02:56.202 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:02:56.203 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbda007af30 msgr2=0x7fbda007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbda007af30 0x7fbda007d3f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbda4005fd0 tx=0x7fbda400b390 comp rx=0 tx=0).stop 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 msgr2=0x7fbdb419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 0x7fbdb419dbc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c031460 tx=0x7fbd9c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 shutdown_connections 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbda007af30 0x7fbda007d3f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbdb4106800 0x7fbdb419dbc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 --2- 172.21.15.46:0/2812689878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbdb4100800 0x7fbdb419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 >> 172.21.15.46:0/2812689878 conn(0x7fbdb40fc520 msgr2=0x7fbdb406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:56.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 shutdown_connections 2024-09-21T13:02:56.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.203+0000 7fbdb97be640 1 -- 172.21.15.46:0/2812689878 wait complete. 2024-09-21T13:02:56.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 -- 172.21.15.46:0/284260589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78101900 msgr2=0x7fab78101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 --2- 172.21.15.46:0/284260589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78101900 0x7fab78101d60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fab68009880 tx=0x7fab6802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 -- 172.21.15.46:0/284260589 shutdown_connections 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 --2- 172.21.15.46:0/284260589 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78101900 0x7fab78101d60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 --2- 172.21.15.46:0/284260589 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab78107900 0x7fab78107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 -- 172.21.15.46:0/284260589 >> 172.21.15.46:0/284260589 conn(0x7fab780fd600 msgr2=0x7fab780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 -- 172.21.15.46:0/284260589 shutdown_connections 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.288+0000 7fab806e1640 1 -- 172.21.15.46:0/284260589 wait complete. 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab806e1640 1 Processor -- start 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab806e1640 1 -- start start 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab806e1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab78101900 0x7fab7819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab806e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 0x7fab7819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab806e1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fab7810edd0 con 0x7fab78107900 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab806e1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fab7810ec50 con 0x7fab78101900 2024-09-21T13:02:56.291 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab7dc7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 0x7fab7819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab7dc7c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 0x7fab7819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55196/0 (socket says 172.21.15.46:55196) 2024-09-21T13:02:56.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab7dc7c640 1 -- 172.21.15.46:0/248733874 learned_addr learned my addr 172.21.15.46:0/248733874 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:56.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.289+0000 7fab7e47d640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab78101900 0x7fab7819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab7dc7c640 1 -- 172.21.15.46:0/248733874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab78101900 msgr2=0x7fab7819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab7dc7c640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab78101900 0x7fab7819d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab7dc7c640 1 -- 172.21.15.46:0/248733874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab78197800 con 0x7fab78107900 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab7dc7c640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 0x7fab7819dbc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fab68031460 tx=0x7fab68004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab6803f070 con 0x7fab78107900 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab680035f0 con 0x7fab78107900 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab68035030 con 0x7fab78107900 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab78197a90 con 0x7fab78107900 2024-09-21T13:02:56.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.290+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab78197fc0 con 0x7fab78107900 2024-09-21T13:02:56.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.291+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab78103040 con 0x7fab78107900 2024-09-21T13:02:56.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.292+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fab68042070 con 0x7fab78107900 2024-09-21T13:02:56.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.292+0000 7fab6f7fe640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab6407af80 0x7fab6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.293+0000 7fab7e47d640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab6407af80 0x7fab6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.293+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fab680be8e0 con 0x7fab78107900 2024-09-21T13:02:56.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.293+0000 7fab7e47d640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab6407af80 0x7fab6407d440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab74009bd0 tx=0x7fab74005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:56.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.297+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab68089eb0 con 0x7fab78107900 2024-09-21T13:02:56.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.525+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fab78109e70 con 0x7fab78107900 2024-09-21T13:02:56.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:56 smithi046 ceph-mon[108126]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:56.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:56 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2812689878' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:02:56.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.526+0000 7fab6f7fe640 1 -- 172.21.15.46:0/248733874 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7fab6808ed60 con 0x7fab78107900 2024-09-21T13:02:56.527 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:02:56.527 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:02:56.527 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:02:56.527 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:02:56.528 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:02:56.529 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:56.530 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab6407af80 msgr2=0x7fab6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab6407af80 0x7fab6407d440 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fab74009bd0 tx=0x7fab74005f90 comp rx=0 tx=0).stop 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 msgr2=0x7fab7819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 0x7fab7819dbc0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fab68031460 tx=0x7fab68004530 comp rx=0 tx=0).stop 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 shutdown_connections 2024-09-21T13:02:56.531 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab6407af80 0x7fab6407d440 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fab78107900 0x7fab7819dbc0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 --2- 172.21.15.46:0/248733874 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fab78101900 0x7fab7819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 >> 172.21.15.46:0/248733874 conn(0x7fab780fd600 msgr2=0x7fab780fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 shutdown_connections 2024-09-21T13:02:56.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.529+0000 7fab806e1640 1 -- 172.21.15.46:0/248733874 wait complete. 2024-09-21T13:02:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:56 smithi176 ceph-mon[80162]: from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:56 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2812689878' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 -- 172.21.15.46:0/3962775152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 msgr2=0x7f1170102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 --2- 172.21.15.46:0/3962775152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170102e90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1168009880 tx=0x7f116802a530 comp rx=0 tx=0).stop 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 -- 172.21.15.46:0/3962775152 shutdown_connections 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 --2- 172.21.15.46:0/3962775152 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 0x7f117010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 --2- 172.21.15.46:0/3962775152 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170102e90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 -- 172.21.15.46:0/3962775152 >> 172.21.15.46:0/3962775152 conn(0x7f11700fc550 msgr2=0x7f11700fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 -- 172.21.15.46:0/3962775152 shutdown_connections 2024-09-21T13:02:56.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.615+0000 7f1174fd7640 1 -- 172.21.15.46:0/3962775152 wait complete. 2024-09-21T13:02:56.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f1174fd7640 1 Processor -- start 2024-09-21T13:02:56.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f1174fd7640 1 -- start start 2024-09-21T13:02:56.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f1174fd7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f1174fd7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 0x7f1170100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f1174fd7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f117010ede0 con 0x7f1170102ab0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f1174fd7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f117010ec60 con 0x7f11701033d0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116e59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55216/0 (socket says 172.21.15.46:55216) 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116e59c640 1 -- 172.21.15.46:0/2580788366 learned_addr learned my addr 172.21.15.46:0/2580788366 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116dd9b640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 0x7f1170100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116e59c640 1 -- 172.21.15.46:0/2580788366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 msgr2=0x7f1170100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116e59c640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 0x7f1170100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116e59c640 1 -- 172.21.15.46:0/2580788366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1170101190 con 0x7f1170102ab0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.616+0000 7f116dd9b640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 0x7f1170100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.617+0000 7f116e59c640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170100710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1168031460 tx=0x7f11680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.617+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f116803f070 con 0x7f1170102ab0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.617+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1170101420 con 0x7f1170102ab0 2024-09-21T13:02:56.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.617+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11680035f0 con 0x7f1170102ab0 2024-09-21T13:02:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.617+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1168035030 con 0x7f1170102ab0 2024-09-21T13:02:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.617+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11701a3d70 con 0x7f1170102ab0 2024-09-21T13:02:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.618+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117006a580 con 0x7f1170102ab0 2024-09-21T13:02:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.619+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1168042070 con 0x7f1170102ab0 2024-09-21T13:02:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.619+0000 7f11677fe640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f115c07af80 0x7f115c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.619+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f11680be9c0 con 0x7f1170102ab0 2024-09-21T13:02:56.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.619+0000 7f116dd9b640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f115c07af80 0x7f115c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.620+0000 7f116dd9b640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f115c07af80 0x7f115c07d440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11701021a0 tx=0x7f1158009670 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:56.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.624+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1168089f90 con 0x7f1170102ab0 2024-09-21T13:02:56.833 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.832+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f117010b5d0 con 0x7f115c07af80 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.834+0000 7f11677fe640 1 -- 172.21.15.46:0/2580788366 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f117010b5d0 con 0x7f115c07af80 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:02:56.835 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:02:56.836 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:02:56.836 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:02:56.836 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:02:56.836 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:02:56.836 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:02:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f115c07af80 msgr2=0x7f115c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f115c07af80 0x7f115c07d440 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11701021a0 tx=0x7f1158009670 comp rx=0 tx=0).stop 2024-09-21T13:02:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 msgr2=0x7f1170100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170100710 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1168031460 tx=0x7f11680045e0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.837 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 shutdown_connections 2024-09-21T13:02:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f115c07af80 0x7f115c07d440 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f11701033d0 0x7f1170100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 --2- 172.21.15.46:0/2580788366 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1170102ab0 0x7f1170100710 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 >> 172.21.15.46:0/2580788366 conn(0x7f11700fc550 msgr2=0x7f117010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 shutdown_connections 2024-09-21T13:02:56.838 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.836+0000 7f1174fd7640 1 -- 172.21.15.46:0/2580788366 wait complete. 2024-09-21T13:02:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 -- 172.21.15.46:0/2423166913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224100800 msgr2=0x7f6224100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 --2- 172.21.15.46:0/2423166913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224100800 0x7f6224100c60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f6218009c20 tx=0x7f621802a970 comp rx=0 tx=0).stop 2024-09-21T13:02:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 -- 172.21.15.46:0/2423166913 shutdown_connections 2024-09-21T13:02:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 --2- 172.21.15.46:0/2423166913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224100800 0x7f6224100c60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 --2- 172.21.15.46:0/2423166913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6224106800 0x7f6224106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 -- 172.21.15.46:0/2423166913 >> 172.21.15.46:0/2423166913 conn(0x7f62240fc520 msgr2=0x7f62240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 -- 172.21.15.46:0/2423166913 shutdown_connections 2024-09-21T13:02:56.922 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.920+0000 7f622b968640 1 -- 172.21.15.46:0/2423166913 wait complete. 2024-09-21T13:02:56.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f622b968640 1 Processor -- start 2024-09-21T13:02:56.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f622b968640 1 -- start start 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f622b968640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6224100800 0x7f622419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f622b968640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 0x7f622419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f622b968640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f622410dcb0 con 0x7f6224106800 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f622b968640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f622410db30 con 0x7f6224100800 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f6228f03640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 0x7f622419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f6228f03640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 0x7f622419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:55236/0 (socket says 172.21.15.46:55236) 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f6228f03640 1 -- 172.21.15.46:0/1638300425 learned_addr learned my addr 172.21.15.46:0/1638300425 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.921+0000 7f6229704640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6224100800 0x7f622419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f6228f03640 1 -- 172.21.15.46:0/1638300425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6224100800 msgr2=0x7f622419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f6228f03640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6224100800 0x7f622419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f6228f03640 1 -- 172.21.15.46:0/1638300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62241977f0 con 0x7f6224106800 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f6228f03640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 0x7f622419dbb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f621802ae90 tx=0x7f621802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:56.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6218047070 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f621802f7e0 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6218034070 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6224197a80 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.922+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6224197fb0 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.923+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6224101f40 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.924+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f621804a070 con 0x7f6224106800 2024-09-21T13:02:56.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.924+0000 7f62227fc640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f620c07af30 0x7f620c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:02:56.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.924+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f62180beda0 con 0x7f6224106800 2024-09-21T13:02:56.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.924+0000 7f6229704640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f620c07af30 0x7f620c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:02:56.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.925+0000 7f6229704640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f620c07af30 0x7f620c07d3f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f621c005d00 tx=0x7f621c00b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:02:56.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:56.929+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f621803f070 con 0x7f6224106800 2024-09-21T13:02:57.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.192+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6224109da0 con 0x7f6224106800 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.193+0000 7f62227fc640 1 -- 172.21.15.46:0/1638300425 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f621808a2f0 con 0x7f6224106800 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:02:57.194 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:02:57.195 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f620c07af30 msgr2=0x7f620c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f620c07af30 0x7f620c07d3f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f621c005d00 tx=0x7f621c00b410 comp rx=0 tx=0).stop 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 msgr2=0x7f622419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 0x7f622419dbb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f621802ae90 tx=0x7f621802f5f0 comp rx=0 tx=0).stop 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 shutdown_connections 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f620c07af30 0x7f620c07d3f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6224106800 0x7f622419dbb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 --2- 172.21.15.46:0/1638300425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6224100800 0x7f622419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:02:57.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 >> 172.21.15.46:0/1638300425 conn(0x7f62240fc520 msgr2=0x7f622406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:02:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 shutdown_connections 2024-09-21T13:02:57.197 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:02:57.195+0000 7f622b968640 1 -- 172.21.15.46:0/1638300425 wait complete. 2024-09-21T13:02:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:57 smithi046 ceph-mon[108126]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:57 smithi046 ceph-mon[108126]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:57 smithi046 ceph-mon[108126]: from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:57 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/248733874' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:02:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:57 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1638300425' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:02:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:57 smithi176 ceph-mon[80162]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:57 smithi176 ceph-mon[80162]: from='client.34734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:57 smithi176 ceph-mon[80162]: from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:57 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/248733874' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:02:57.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:57 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1638300425' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:02:58.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:58 smithi046 ceph-mon[108126]: from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:58.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:58 smithi176 ceph-mon[80162]: from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:02:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:59 smithi176 ceph-mon[80162]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:02:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:02:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:59 smithi046 ceph-mon[108126]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:02:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:02:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:01 smithi046 ceph-mon[108126]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:01 smithi176 ceph-mon[80162]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:03 smithi046 ceph-mon[108126]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:03.573 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:03 smithi176 ceph-mon[80162]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:05 smithi046 ceph-mon[108126]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:05 smithi176 ceph-mon[80162]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:07 smithi046 ceph-mon[108126]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:07 smithi176 ceph-mon[80162]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:09 smithi046 ceph-mon[108126]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:09 smithi176 ceph-mon[80162]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:11 smithi046 ceph-mon[108126]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:11 smithi176 ceph-mon[80162]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:13 smithi046 ceph-mon[108126]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:13.725 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:13 smithi176 ceph-mon[80162]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:14.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:15 smithi046 ceph-mon[108126]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:15 smithi176 ceph-mon[80162]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:17.618 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:17 smithi176 ceph-mon[80162]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:17.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:17 smithi046 ceph-mon[108126]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:19.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:19 smithi046 ceph-mon[108126]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:19.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:19 smithi176 ceph-mon[80162]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:21 smithi046 ceph-mon[108126]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:21 smithi176 ceph-mon[80162]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:23 smithi046 ceph-mon[108126]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:23 smithi176 ceph-mon[80162]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:25 smithi046 ceph-mon[108126]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:25 smithi176 ceph-mon[80162]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:27.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 -- 172.21.15.46:0/3931576112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba01033d0 msgr2=0x7faba010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 --2- 172.21.15.46:0/3931576112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba01033d0 0x7faba010b8c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fab94009880 tx=0x7fab9402a530 comp rx=0 tx=0).stop 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 -- 172.21.15.46:0/3931576112 shutdown_connections 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 --2- 172.21.15.46:0/3931576112 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba01033d0 0x7faba010b8c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 --2- 172.21.15.46:0/3931576112 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba0102ab0 0x7faba0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 -- 172.21.15.46:0/3931576112 >> 172.21.15.46:0/3931576112 conn(0x7faba00fc550 msgr2=0x7faba00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 -- 172.21.15.46:0/3931576112 shutdown_connections 2024-09-21T13:03:27.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.292+0000 7faba6d57640 1 -- 172.21.15.46:0/3931576112 wait complete. 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba6d57640 1 Processor -- start 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba6d57640 1 -- start start 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba6d57640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 0x7faba0100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba6d57640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba01033d0 0x7faba0100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba6d57640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faba010ede0 con 0x7faba0102ab0 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba6d57640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faba010ec60 con 0x7faba01033d0 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba4af3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 0x7faba0100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba4af3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 0x7faba0100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56078/0 (socket says 172.21.15.46:56078) 2024-09-21T13:03:27.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7faba4af3640 1 -- 172.21.15.46:0/3811337180 learned_addr learned my addr 172.21.15.46:0/3811337180 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.293+0000 7fab9ffff640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba01033d0 0x7faba0100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7faba4af3640 1 -- 172.21.15.46:0/3811337180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba01033d0 msgr2=0x7faba0100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7faba4af3640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba01033d0 0x7faba0100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7faba4af3640 1 -- 172.21.15.46:0/3811337180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba0101190 con 0x7faba0102ab0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7faba4af3640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 0x7faba0100710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c8f0 tx=0x7fab9000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab900079b0 con 0x7faba0102ab0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fab900054e0 con 0x7faba0102ab0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faba0101480 con 0x7faba0102ab0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fab90004dd0 con 0x7faba0102ab0 2024-09-21T13:03:27.298 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.294+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faba01a3e90 con 0x7faba0102ab0 2024-09-21T13:03:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.295+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faba006a580 con 0x7faba0102ab0 2024-09-21T13:03:27.299 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.296+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fab90005020 con 0x7faba0102ab0 2024-09-21T13:03:27.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.296+0000 7fab9dffb640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab8807af30 0x7fab8807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.297+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fab9009def0 con 0x7faba0102ab0 2024-09-21T13:03:27.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.297+0000 7fab9ffff640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab8807af30 0x7fab8807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.297+0000 7fab9ffff640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab8807af30 0x7fab8807d3f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faba01021a0 tx=0x7fab94031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:27.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.301+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab90014030 con 0x7faba0102ab0 2024-09-21T13:03:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:27 smithi046 ceph-mon[108126]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:27.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.507+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faba0062630 con 0x7fab8807af30 2024-09-21T13:03:27.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.509+0000 7fab9dffb640 1 -- 172.21.15.46:0/3811337180 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7faba0062630 con 0x7fab8807af30 2024-09-21T13:03:27.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab8807af30 msgr2=0x7fab8807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab8807af30 0x7fab8807d3f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7faba01021a0 tx=0x7fab94031400 comp rx=0 tx=0).stop 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 msgr2=0x7faba0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 0x7faba0100710 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fab9000c8f0 tx=0x7fab9000cdb0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 shutdown_connections 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fab8807af30 0x7fab8807d3f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faba01033d0 0x7faba0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 --2- 172.21.15.46:0/3811337180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faba0102ab0 0x7faba0100710 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 >> 172.21.15.46:0/3811337180 conn(0x7faba00fc550 msgr2=0x7faba0108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 shutdown_connections 2024-09-21T13:03:27.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.511+0000 7faba6d57640 1 -- 172.21.15.46:0/3811337180 wait complete. 2024-09-21T13:03:27.523 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:03:27.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 -- 172.21.15.46:0/321915642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc102b40 msgr2=0x7f0afc102f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 --2- 172.21.15.46:0/321915642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc102b40 0x7f0afc102f20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f0aec009880 tx=0x7f0aec02a530 comp rx=0 tx=0).stop 2024-09-21T13:03:27.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 -- 172.21.15.46:0/321915642 shutdown_connections 2024-09-21T13:03:27.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 --2- 172.21.15.46:0/321915642 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0afc103460 0x7f0afc10b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 --2- 172.21.15.46:0/321915642 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc102b40 0x7f0afc102f20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 -- 172.21.15.46:0/321915642 >> 172.21.15.46:0/321915642 conn(0x7f0afc0fc520 msgr2=0x7f0afc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:27.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 -- 172.21.15.46:0/321915642 shutdown_connections 2024-09-21T13:03:27.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.597+0000 7f0b011d6640 1 -- 172.21.15.46:0/321915642 wait complete. 2024-09-21T13:03:27.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.598+0000 7f0b011d6640 1 Processor -- start 2024-09-21T13:03:27.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.598+0000 7f0b011d6640 1 -- start start 2024-09-21T13:03:27.602 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.598+0000 7f0b011d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0afc102b40 0x7f0afc19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.598+0000 7f0b011d6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 0x7f0afc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.598+0000 7f0b011d6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc10edf0 con 0x7f0afc103460 2024-09-21T13:03:27.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.598+0000 7f0b011d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0afc10ec70 con 0x7f0afc102b40 2024-09-21T13:03:27.603 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 0x7f0afc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 0x7f0afc19dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50636/0 (socket says 172.21.15.46:50636) 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 -- 172.21.15.46:0/3468195467 learned_addr learned my addr 172.21.15.46:0/3468195467 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afad9d640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0afc102b40 0x7f0afc19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 -- 172.21.15.46:0/3468195467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0afc102b40 msgr2=0x7f0afc19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0afc102b40 0x7f0afc19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 -- 172.21.15.46:0/3468195467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc1977e0 con 0x7f0afc103460 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0afa59c640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 0x7f0afc19dba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d6f0 tx=0x7f0af000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0af0017070 con 0x7f0afc103460 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0af000de00 con 0x7f0afc103460 2024-09-21T13:03:27.604 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc197ad0 con 0x7f0afc103460 2024-09-21T13:03:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0af0004bb0 con 0x7f0afc103460 2024-09-21T13:03:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.599+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0afc198060 con 0x7f0afc103460 2024-09-21T13:03:27.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.600+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0afc06aa10 con 0x7f0afc103460 2024-09-21T13:03:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.601+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0af0004e60 con 0x7f0afc103460 2024-09-21T13:03:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.602+0000 7f0ae3fff640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0ae407af30 0x7f0ae407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.602+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0af009dcf0 con 0x7f0afc103460 2024-09-21T13:03:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.602+0000 7f0afad9d640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0ae407af30 0x7f0ae407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.606 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.602+0000 7f0afad9d640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0ae407af30 0x7f0ae407d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0096c0 tx=0x7f0aec004f30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:27.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.606+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0af00691a0 con 0x7f0afc103460 2024-09-21T13:03:27.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.810+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0afc198310 con 0x7f0ae407af30 2024-09-21T13:03:27.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.811+0000 7f0ae3fff640 1 -- 172.21.15.46:0/3468195467 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0afc198310 con 0x7f0ae407af30 2024-09-21T13:03:27.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0ae407af30 msgr2=0x7f0ae407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0ae407af30 0x7f0ae407d3f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0096c0 tx=0x7f0aec004f30 comp rx=0 tx=0).stop 2024-09-21T13:03:27.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 msgr2=0x7f0afc19dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 0x7f0afc19dba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0af000d6f0 tx=0x7f0af000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 shutdown_connections 2024-09-21T13:03:27.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0ae407af30 0x7f0ae407d3f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0afc103460 0x7f0afc19dba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 --2- 172.21.15.46:0/3468195467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0afc102b40 0x7f0afc19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 >> 172.21.15.46:0/3468195467 conn(0x7f0afc0fc520 msgr2=0x7f0afc108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:27.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 shutdown_connections 2024-09-21T13:03:27.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.813+0000 7f0b011d6640 1 -- 172.21.15.46:0/3468195467 wait complete. 2024-09-21T13:03:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:27 smithi176 ceph-mon[80162]: pgmap v509: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 -- 172.21.15.46:0/2651267820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed41033e0 msgr2=0x7f5ed410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 --2- 172.21.15.46:0/2651267820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed41033e0 0x7f5ed410b8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009880 tx=0x7f5ec402a530 comp rx=0 tx=0).stop 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 -- 172.21.15.46:0/2651267820 shutdown_connections 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 --2- 172.21.15.46:0/2651267820 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed41033e0 0x7f5ed410b8d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 --2- 172.21.15.46:0/2651267820 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 -- 172.21.15.46:0/2651267820 >> 172.21.15.46:0/2651267820 conn(0x7f5ed40fc520 msgr2=0x7f5ed40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 -- 172.21.15.46:0/2651267820 shutdown_connections 2024-09-21T13:03:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.897+0000 7f5edbed8640 1 -- 172.21.15.46:0/2651267820 wait complete. 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5edbed8640 1 Processor -- start 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5edbed8640 1 -- start start 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5edbed8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5edbed8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed41033e0 0x7f5ed4100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5edbed8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410edf0 con 0x7f5ed4102ac0 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5edbed8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5ed410ec70 con 0x7f5ed41033e0 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5ed9c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5ed9c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50656/0 (socket says 172.21.15.46:50656) 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5ed9c74640 1 -- 172.21.15.46:0/47982367 learned_addr learned my addr 172.21.15.46:0/47982367 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.898+0000 7f5ed9473640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed41033e0 0x7f5ed4100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ed9c74640 1 -- 172.21.15.46:0/47982367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed41033e0 msgr2=0x7f5ed4100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ed9c74640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed41033e0 0x7f5ed4100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:27.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ed9c74640 1 -- 172.21.15.46:0/47982367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ed41011a0 con 0x7f5ed4102ac0 2024-09-21T13:03:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ed9c74640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4100720 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d6f0 tx=0x7f5ed000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0017070 con 0x7f5ed4102ac0 2024-09-21T13:03:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ed4101490 con 0x7f5ed4102ac0 2024-09-21T13:03:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ed000de00 con 0x7f5ed4102ac0 2024-09-21T13:03:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ed0004bb0 con 0x7f5ed4102ac0 2024-09-21T13:03:27.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.899+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ed41a3e80 con 0x7f5ed4102ac0 2024-09-21T13:03:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.900+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed406aa90 con 0x7f5ed4102ac0 2024-09-21T13:03:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.901+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5ed0004e60 con 0x7f5ed4102ac0 2024-09-21T13:03:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.901+0000 7f5ecaffd640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5ec007af30 0x7f5ec007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.901+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5ed009dc30 con 0x7f5ed4102ac0 2024-09-21T13:03:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.901+0000 7f5ed9473640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5ec007af30 0x7f5ec007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:27.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.902+0000 7f5ed9473640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5ec007af30 0x7f5ec007d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5ed41021b0 tx=0x7f5ec4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:27.908 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:27.906+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ed0069180 con 0x7f5ed4102ac0 2024-09-21T13:03:28.105 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.103+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5ed4062630 con 0x7f5ec007af30 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.113+0000 7f5ecaffd640 1 -- 172.21.15.46:0/47982367 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5ed4062630 con 0x7f5ec007af30 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (13m) 7m ago 24m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (16m) 7m ago 24m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (16m) 7m ago 23m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (11m) 7m ago 24m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:03:28.115 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (11m) 7m ago 23m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (13m) 7m ago 24m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (8m) 7m ago 19m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (7m) 7m ago 19m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (7m) 7m ago 19m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (7m) 7m ago 19m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (16m) 7m ago 25m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (15m) 7m ago 23m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 7m ago 25m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (12m) 7m ago 23m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (14m) 7m ago 24m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (14m) 7m ago 23m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (11m) 7m ago 22m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (10m) 7m ago 21m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:03:28.116 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 7m ago 21m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:03:28.117 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (9m) 7m ago 21m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:03:28.117 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (8m) 7m ago 20m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:03:28.117 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (8m) 7m ago 20m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:03:28.117 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (14m) 7m ago 24m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5ec007af30 msgr2=0x7f5ec007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5ec007af30 0x7f5ec007d3f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5ed41021b0 tx=0x7f5ec4031400 comp rx=0 tx=0).stop 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 msgr2=0x7f5ed4100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4100720 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5ed000d6f0 tx=0x7f5ed000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 shutdown_connections 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5ec007af30 0x7f5ec007d3f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ed41033e0 0x7f5ed4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 --2- 172.21.15.46:0/47982367 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5ed4102ac0 0x7f5ed4100720 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 >> 172.21.15.46:0/47982367 conn(0x7f5ed40fc520 msgr2=0x7f5ed4108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:28.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 shutdown_connections 2024-09-21T13:03:28.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.115+0000 7f5edbed8640 1 -- 172.21.15.46:0/47982367 wait complete. 2024-09-21T13:03:28.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 -- 172.21.15.46:0/247513735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 msgr2=0x7ff800106c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 --2- 172.21.15.46:0/247513735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff800106c50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc009880 tx=0x7ff7fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 -- 172.21.15.46:0/247513735 shutdown_connections 2024-09-21T13:03:28.200 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 --2- 172.21.15.46:0/247513735 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff800100ed0 0x7ff800101330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 --2- 172.21.15.46:0/247513735 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff800106c50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 -- 172.21.15.46:0/247513735 >> 172.21.15.46:0/247513735 conn(0x7ff8000fbc90 msgr2=0x7ff8000fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:28.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 -- 172.21.15.46:0/247513735 shutdown_connections 2024-09-21T13:03:28.201 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.198+0000 7ff8083b5640 1 -- 172.21.15.46:0/247513735 wait complete. 2024-09-21T13:03:28.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff8083b5640 1 Processor -- start 2024-09-21T13:03:28.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff8083b5640 1 -- start start 2024-09-21T13:03:28.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff8083b5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff800100ed0 0x7ff80019d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff8083b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff80019dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff8083b5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff80010dda0 con 0x7ff800106870 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff8083b5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff80010dc20 con 0x7ff800100ed0 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff805950640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff80019dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff805950640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff80019dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50678/0 (socket says 172.21.15.46:50678) 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff805950640 1 -- 172.21.15.46:0/4136736086 learned_addr learned my addr 172.21.15.46:0/4136736086 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff806151640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff800100ed0 0x7ff80019d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff805950640 1 -- 172.21.15.46:0/4136736086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff800100ed0 msgr2=0x7ff80019d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff805950640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff800100ed0 0x7ff80019d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.199+0000 7ff805950640 1 -- 172.21.15.46:0/4136736086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff800197970 con 0x7ff800106870 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.200+0000 7ff805950640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff80019dcf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000b420 tx=0x7ff7f000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.200+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7f0011630 con 0x7ff800106870 2024-09-21T13:03:28.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.200+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff7f0016070 con 0x7ff800106870 2024-09-21T13:03:28.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.200+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff800197c60 con 0x7ff800106870 2024-09-21T13:03:28.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.200+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff7f0010d40 con 0x7ff800106870 2024-09-21T13:03:28.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.200+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8001981f0 con 0x7ff800106870 2024-09-21T13:03:28.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.201+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8001020f0 con 0x7ff800106870 2024-09-21T13:03:28.204 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.202+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff7f00117d0 con 0x7ff800106870 2024-09-21T13:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.203+0000 7ff7f77fe640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff7ec07af30 0x7ff7ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.203+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff7f009e4a0 con 0x7ff800106870 2024-09-21T13:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.203+0000 7ff806151640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff7ec07af30 0x7ff7ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.205 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.203+0000 7ff806151640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff7ec07af30 0x7ff7ec07d3f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc000c00 tx=0x7ff7fc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:28.209 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.207+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7f0020020 con 0x7ff800106870 2024-09-21T13:03:28.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.471+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7ff800109df0 con 0x7ff800106870 2024-09-21T13:03:28.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.472+0000 7ff7f77fe640 1 -- 172.21.15.46:0/4136736086 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7ff7f00699d0 con 0x7ff800106870 2024-09-21T13:03:28.474 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:03:28.474 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:03:28.474 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:03:28.474 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:03:28.475 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:03:28.476 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff7ec07af30 msgr2=0x7ff7ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff7ec07af30 0x7ff7ec07d3f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc000c00 tx=0x7ff7fc031400 comp rx=0 tx=0).stop 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 msgr2=0x7ff80019dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff80019dcf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff7f000b420 tx=0x7ff7f000b8e0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 shutdown_connections 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff7ec07af30 0x7ff7ec07d3f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff800106870 0x7ff80019dcf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 --2- 172.21.15.46:0/4136736086 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff800100ed0 0x7ff80019d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.474+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 >> 172.21.15.46:0/4136736086 conn(0x7ff8000fbc90 msgr2=0x7ff8001000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.475+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 shutdown_connections 2024-09-21T13:03:28.477 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.475+0000 7ff8083b5640 1 -- 172.21.15.46:0/4136736086 wait complete. 2024-09-21T13:03:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 -- 172.21.15.46:0/3119590547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1007f0 msgr2=0x7f7e5c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/3119590547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c100c50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009880 tx=0x7f7e5002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.561 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 -- 172.21.15.46:0/3119590547 shutdown_connections 2024-09-21T13:03:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/3119590547 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c100c50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/3119590547 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 -- 172.21.15.46:0/3119590547 >> 172.21.15.46:0/3119590547 conn(0x7f7e5c0fc550 msgr2=0x7f7e5c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 -- 172.21.15.46:0/3119590547 shutdown_connections 2024-09-21T13:03:28.562 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 -- 172.21.15.46:0/3119590547 wait complete. 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.559+0000 7f7e63ed4640 1 Processor -- start 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e63ed4640 1 -- start start 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e63ed4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e63ed4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e63ed4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c10dca0 con 0x7f7e5c1067f0 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e63ed4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c10db20 con 0x7f7e5c1007f0 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c19fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50694/0 (socket says 172.21.15.46:50694) 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 -- 172.21.15.46:0/1268731811 learned_addr learned my addr 172.21.15.46:0/1268731811 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 -- 172.21.15.46:0/1268731811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1007f0 msgr2=0x7f7e5c19f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e61c70640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c19f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 -- 172.21.15.46:0/1268731811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c199990 con 0x7f7e5c1067f0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e61c70640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c19f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.560+0000 7f7e6146f640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c19fd10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7e50031460 tx=0x7f7e500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.561+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e5003f070 con 0x7f7e5c1067f0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.561+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e50004b10 con 0x7f7e5c1067f0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.561+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5c199c20 con 0x7f7e5c1067f0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.561+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e50035030 con 0x7f7e5c1067f0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.561+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5c19a150 con 0x7f7e5c1067f0 2024-09-21T13:03:28.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.562+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5c101f30 con 0x7f7e5c1067f0 2024-09-21T13:03:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.562+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7e50042070 con 0x7f7e5c1067f0 2024-09-21T13:03:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.563+0000 7f7e4effd640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7e4807af90 0x7f7e4807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.563+0000 7f7e61c70640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7e4807af90 0x7f7e4807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.563+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7e500beb20 con 0x7f7e5c1067f0 2024-09-21T13:03:28.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.564+0000 7f7e61c70640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7e4807af90 0x7f7e4807d450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c19aad0 tx=0x7f7e58005e70 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:28.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.568+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7e5008a0f0 con 0x7f7e5c1067f0 2024-09-21T13:03:28.797 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.795+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f7e5c19aec0 con 0x7f7e5c1067f0 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.795+0000 7f7e4effd640 1 -- 172.21.15.46:0/1268731811 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f7e5008efa0 con 0x7f7e5c1067f0 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:03:28.798 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:03:28.799 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:03:28.800 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:03:28.801 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7e4807af90 msgr2=0x7f7e4807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7e4807af90 0x7f7e4807d450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c19aad0 tx=0x7f7e58005e70 comp rx=0 tx=0).stop 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 msgr2=0x7f7e5c19fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c19fd10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f7e50031460 tx=0x7f7e500045e0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 shutdown_connections 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7e4807af90 0x7f7e4807d450 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7e5c1067f0 0x7f7e5c19fd10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 --2- 172.21.15.46:0/1268731811 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7e5c1007f0 0x7f7e5c19f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 >> 172.21.15.46:0/1268731811 conn(0x7f7e5c0fc550 msgr2=0x7f7e5c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 shutdown_connections 2024-09-21T13:03:28.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.798+0000 7f7e63ed4640 1 -- 172.21.15.46:0/1268731811 wait complete. 2024-09-21T13:03:28.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 -- 172.21.15.46:0/938716619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18102b20 msgr2=0x7f0d18102f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/938716619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18102b20 0x7f0d18102f00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0d080098b0 tx=0x7f0d0802a560 comp rx=0 tx=0).stop 2024-09-21T13:03:28.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 -- 172.21.15.46:0/938716619 shutdown_connections 2024-09-21T13:03:28.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/938716619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d18103440 0x7f0d1810b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/938716619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18102b20 0x7f0d18102f00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 -- 172.21.15.46:0/938716619 >> 172.21.15.46:0/938716619 conn(0x7f0d180fc520 msgr2=0x7f0d180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:28.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 -- 172.21.15.46:0/938716619 shutdown_connections 2024-09-21T13:03:28.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.883+0000 7f0d1cec9640 1 -- 172.21.15.46:0/938716619 wait complete. 2024-09-21T13:03:28.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.884+0000 7f0d1cec9640 1 Processor -- start 2024-09-21T13:03:28.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.884+0000 7f0d1cec9640 1 -- start start 2024-09-21T13:03:28.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.884+0000 7f0d1cec9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d18102b20 0x7f0d18100780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.884+0000 7f0d1cec9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 0x7f0d18100cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.884+0000 7f0d1cec9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810edf0 con 0x7f0d18103440 2024-09-21T13:03:28.888 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.884+0000 7f0d1cec9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0d1810ec70 con 0x7f0d18102b20 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 0x7f0d18100cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 0x7f0d18100cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50704/0 (socket says 172.21.15.46:50704) 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 -- 172.21.15.46:0/1191731397 learned_addr learned my addr 172.21.15.46:0/1191731397 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d1659c640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d18102b20 0x7f0d18100780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 -- 172.21.15.46:0/1191731397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d18102b20 msgr2=0x7f0d18100780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d18102b20 0x7f0d18100780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 -- 172.21.15.46:0/1191731397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d18101200 con 0x7f0d18103440 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d15d9b640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 0x7f0d18100cc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00d6f0 tx=0x7f0d0c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d0c017070 con 0x7f0d18103440 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0d0c00de00 con 0x7f0d18103440 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d181014f0 con 0x7f0d18103440 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0d0c004bb0 con 0x7f0d18103440 2024-09-21T13:03:28.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.885+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d181a3f00 con 0x7f0d18103440 2024-09-21T13:03:28.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.887+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d1806aa30 con 0x7f0d18103440 2024-09-21T13:03:28.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.887+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0d0c009a30 con 0x7f0d18103440 2024-09-21T13:03:28.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.888+0000 7f0d077fe640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0d0007af80 0x7f0d0007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:28.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.888+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0d0c09dc30 con 0x7f0d18103440 2024-09-21T13:03:28.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.888+0000 7f0d1659c640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0d0007af80 0x7f0d0007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:28.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.888+0000 7f0d1659c640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0d0007af80 0x7f0d0007d440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d08000c00 tx=0x7f0d08031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:28.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:28.892+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0d0c069200 con 0x7f0d18103440 2024-09-21T13:03:29.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.101+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0d18062630 con 0x7f0d0007af80 2024-09-21T13:03:29.104 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.102+0000 7f0d077fe640 1 -- 172.21.15.46:0/1191731397 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0d18062630 con 0x7f0d0007af80 2024-09-21T13:03:29.104 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:03:29.104 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:03:29.104 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:03:29.104 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:03:29.105 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:03:29.106 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0d0007af80 msgr2=0x7f0d0007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0d0007af80 0x7f0d0007d440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0d08000c00 tx=0x7f0d08031400 comp rx=0 tx=0).stop 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 msgr2=0x7f0d18100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 0x7f0d18100cc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0d0c00d6f0 tx=0x7f0d0c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 shutdown_connections 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0d0007af80 0x7f0d0007d440 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.107 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0d18103440 0x7f0d18100cc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 --2- 172.21.15.46:0/1191731397 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d18102b20 0x7f0d18100780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 >> 172.21.15.46:0/1191731397 conn(0x7f0d180fc520 msgr2=0x7f0d18107e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:29.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 shutdown_connections 2024-09-21T13:03:29.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.104+0000 7f0d1cec9640 1 -- 172.21.15.46:0/1191731397 wait complete. 2024-09-21T13:03:29.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 -- 172.21.15.46:0/1767327290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201067f0 msgr2=0x7f6520106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:29.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 --2- 172.21.15.46:0/1767327290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201067f0 0x7f6520106bd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6510009c20 tx=0x7f651002a970 comp rx=0 tx=0).stop 2024-09-21T13:03:29.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 -- 172.21.15.46:0/1767327290 shutdown_connections 2024-09-21T13:03:29.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 --2- 172.21.15.46:0/1767327290 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65201007f0 0x7f6520100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 --2- 172.21.15.46:0/1767327290 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201067f0 0x7f6520106bd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 -- 172.21.15.46:0/1767327290 >> 172.21.15.46:0/1767327290 conn(0x7f65200fc550 msgr2=0x7f65200fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 -- 172.21.15.46:0/1767327290 shutdown_connections 2024-09-21T13:03:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 -- 172.21.15.46:0/1767327290 wait complete. 2024-09-21T13:03:29.192 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.189+0000 7f652597c640 1 Processor -- start 2024-09-21T13:03:29.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f652597c640 1 -- start start 2024-09-21T13:03:29.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f652597c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 0x7f652019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:29.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f652597c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65201067f0 0x7f652019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:29.193 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f652597c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f652010dd20 con 0x7f65201007f0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f652597c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f652010dba0 con 0x7f65201067f0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 0x7f652019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 0x7f652019d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:50728/0 (socket says 172.21.15.46:50728) 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 -- 172.21.15.46:0/2224784539 learned_addr learned my addr 172.21.15.46:0/2224784539 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651e7fc640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65201067f0 0x7f652019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 -- 172.21.15.46:0/2224784539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65201067f0 msgr2=0x7f652019dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65201067f0 0x7f652019dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 -- 172.21.15.46:0/2224784539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6520197870 con 0x7f65201007f0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.190+0000 7f651effd640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 0x7f652019d6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6510005cc0 tx=0x7f651002f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.191+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6510047070 con 0x7f65201007f0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.191+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6520197b00 con 0x7f65201007f0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.191+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f651002f7e0 con 0x7f65201007f0 2024-09-21T13:03:29.194 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.191+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6510034070 con 0x7f65201007f0 2024-09-21T13:03:29.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.191+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6520198030 con 0x7f65201007f0 2024-09-21T13:03:29.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.192+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6520101f30 con 0x7f65201007f0 2024-09-21T13:03:29.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.192+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f651004a070 con 0x7f65201007f0 2024-09-21T13:03:29.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.193+0000 7f652497a640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f650c07af30 0x7f650c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:29.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.193+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f65100bef90 con 0x7f65201007f0 2024-09-21T13:03:29.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.193+0000 7f651e7fc640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f650c07af30 0x7f650c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:29.196 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.194+0000 7f651e7fc640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f650c07af30 0x7f650c07d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6520106090 tx=0x7f6508008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:29.199 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.197+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f651003f070 con 0x7f65201007f0 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.479+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6520198da0 con 0x7f65201007f0 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.480+0000 7f652497a640 1 -- 172.21.15.46:0/2224784539 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f651008a4e0 con 0x7f65201007f0 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:03:29.482 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:03:29.483 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:03:29.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f650c07af30 msgr2=0x7f650c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f650c07af30 0x7f650c07d3f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6520106090 tx=0x7f6508008040 comp rx=0 tx=0).stop 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 msgr2=0x7f652019d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 0x7f652019d6b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6510005cc0 tx=0x7f651002f5f0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 shutdown_connections 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f650c07af30 0x7f650c07d3f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f65201067f0 0x7f652019dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 --2- 172.21.15.46:0/2224784539 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f65201007f0 0x7f652019d6b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.482+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 >> 172.21.15.46:0/2224784539 conn(0x7f65200fc550 msgr2=0x7f652006a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.483+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 shutdown_connections 2024-09-21T13:03:29.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:29.483+0000 7f652597c640 1 -- 172.21.15.46:0/2224784539 wait complete. 2024-09-21T13:03:29.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4136736086' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:03:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1268731811' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:03:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: from='client.34758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: pgmap v510: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:29.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4136736086' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:03:29.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1268731811' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:03:29.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:30.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:30 smithi046 ceph-mon[108126]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:30.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:30 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2224784539' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:03:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:30 smithi176 ceph-mon[80162]: from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:03:30.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:30 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2224784539' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:03:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:31 smithi046 ceph-mon[108126]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:31 smithi176 ceph-mon[80162]: pgmap v511: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:33.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:33 smithi046 ceph-mon[108126]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:33 smithi176 ceph-mon[80162]: pgmap v512: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:35 smithi046 ceph-mon[108126]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:35 smithi176 ceph-mon[80162]: pgmap v513: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:37 smithi046 ceph-mon[108126]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:37 smithi176 ceph-mon[80162]: pgmap v514: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:39.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:39 smithi046 ceph-mon[108126]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:39 smithi176 ceph-mon[80162]: pgmap v515: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:41 smithi046 ceph-mon[108126]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:41 smithi176 ceph-mon[80162]: pgmap v516: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:43 smithi046 ceph-mon[108126]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:43 smithi176 ceph-mon[80162]: pgmap v517: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:44.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:44.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:45.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:45 smithi046 ceph-mon[108126]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:45 smithi176 ceph-mon[80162]: pgmap v518: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:47 smithi046 ceph-mon[108126]: pgmap v519: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:47.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:47 smithi176 ceph-mon[80162]: pgmap v519: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:49 smithi176 ceph-mon[80162]: pgmap v520: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:49 smithi046 ceph-mon[108126]: pgmap v520: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:51.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:51 smithi046 ceph-mon[108126]: pgmap v521: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:51 smithi176 ceph-mon[80162]: pgmap v521: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:53 smithi176 ceph-mon[80162]: pgmap v522: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:53.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:53 smithi046 ceph-mon[108126]: pgmap v522: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:55 smithi176 ceph-mon[80162]: pgmap v523: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:55.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:55 smithi046 ceph-mon[108126]: pgmap v523: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:57.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:57 smithi176 ceph-mon[80162]: pgmap v524: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:57.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:57 smithi046 ceph-mon[108126]: pgmap v524: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:59.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.575+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/2926857976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78107910 msgr2=0x7f4f78107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:59.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.575+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/2926857976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78107910 0x7f4f78107cf0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4f68009880 tx=0x7f4f6802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/2926857976 shutdown_connections 2024-09-21T13:03:59.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/2926857976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78101910 0x7f4f78101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/2926857976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78107910 0x7f4f78107cf0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/2926857976 >> 172.21.15.46:0/2926857976 conn(0x7f4f780fd630 msgr2=0x7f4f780ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:59.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/2926857976 shutdown_connections 2024-09-21T13:03:59.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/2926857976 wait complete. 2024-09-21T13:03:59.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 Processor -- start 2024-09-21T13:03:59.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.576+0000 7f4f7e2c1640 1 -- start start 2024-09-21T13:03:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f7e2c1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 0x7f4f7819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f7e2c1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78107910 0x7f4f7819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:59.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f7e2c1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7810ede0 con 0x7f4f78101910 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f7e2c1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7810ec60 con 0x7f4f78107910 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 0x7f4f7819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 0x7f4f7819d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35342/0 (socket says 172.21.15.46:35342) 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 -- 172.21.15.46:0/850636150 learned_addr learned my addr 172.21.15.46:0/850636150 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f777fe640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78107910 0x7f4f7819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 -- 172.21.15.46:0/850636150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78107910 msgr2=0x7f4f7819db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78107910 0x7f4f7819db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 -- 172.21.15.46:0/850636150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f781977b0 con 0x7f4f78101910 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f777fe640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78107910 0x7f4f7819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.577+0000 7f4f77fff640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 0x7f4f7819d630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4f68031460 tx=0x7f4f680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.578+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f6803f070 con 0x7f4f78101910 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.578+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f680035f0 con 0x7f4f78101910 2024-09-21T13:03:59.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.578+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f68035030 con 0x7f4f78101910 2024-09-21T13:03:59.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.578+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f78197a40 con 0x7f4f78101910 2024-09-21T13:03:59.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.578+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f78197f70 con 0x7f4f78101910 2024-09-21T13:03:59.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.579+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f78103050 con 0x7f4f78101910 2024-09-21T13:03:59.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.579+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4f68042070 con 0x7f4f78101910 2024-09-21T13:03:59.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.580+0000 7f4f757fa640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f6007af80 0x7f4f6007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:59.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.580+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4f680be9c0 con 0x7f4f78101910 2024-09-21T13:03:59.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.580+0000 7f4f777fe640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f6007af80 0x7f4f6007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:59.582 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.580+0000 7f4f777fe640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f6007af80 0x7f4f6007d440 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0058c0 tx=0x7f4f6c005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:59.585 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.584+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f68089f90 con 0x7f4f78101910 2024-09-21T13:03:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:59 smithi046 ceph-mon[108126]: pgmap v525: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:03:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:59.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.788+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4f78198220 con 0x7f4f6007af80 2024-09-21T13:03:59.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.789+0000 7f4f757fa640 1 -- 172.21.15.46:0/850636150 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4f78198220 con 0x7f4f6007af80 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f6007af80 msgr2=0x7f4f6007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f6007af80 0x7f4f6007d440 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c0058c0 tx=0x7f4f6c005850 comp rx=0 tx=0).stop 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 msgr2=0x7f4f7819d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 0x7f4f7819d630 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f4f68031460 tx=0x7f4f680045e0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 shutdown_connections 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4f6007af80 0x7f4f6007d440 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f78107910 0x7f4f7819db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 --2- 172.21.15.46:0/850636150 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4f78101910 0x7f4f7819d630 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 >> 172.21.15.46:0/850636150 conn(0x7f4f780fd630 msgr2=0x7f4f780fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 shutdown_connections 2024-09-21T13:03:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.792+0000 7f4f7e2c1640 1 -- 172.21.15.46:0/850636150 wait complete. 2024-09-21T13:03:59.802 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:03:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:59 smithi176 ceph-mon[80162]: pgmap v525: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:03:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:03:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:03:59.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 -- 172.21.15.46:0/3383419217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694101900 msgr2=0x7f9694101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:59.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 --2- 172.21.15.46:0/3383419217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694101900 0x7f9694101d60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9688009880 tx=0x7f968802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 -- 172.21.15.46:0/3383419217 shutdown_connections 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 --2- 172.21.15.46:0/3383419217 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694101900 0x7f9694101d60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 --2- 172.21.15.46:0/3383419217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9694107900 0x7f9694107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 -- 172.21.15.46:0/3383419217 >> 172.21.15.46:0/3383419217 conn(0x7f96940fd600 msgr2=0x7f96940ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 -- 172.21.15.46:0/3383419217 shutdown_connections 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 -- 172.21.15.46:0/3383419217 wait complete. 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 Processor -- start 2024-09-21T13:03:59.880 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.878+0000 7f969a60e640 1 -- start start 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f969a60e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9694101900 0x7f969419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f969a60e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 0x7f969419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f969a60e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f969410edd0 con 0x7f9694107900 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f969a60e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f969410ec50 con 0x7f9694101900 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f96937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 0x7f969419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f96937fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 0x7f969419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35348/0 (socket says 172.21.15.46:35348) 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f96937fe640 1 -- 172.21.15.46:0/1114466766 learned_addr learned my addr 172.21.15.46:0/1114466766 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f9693fff640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9694101900 0x7f969419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f96937fe640 1 -- 172.21.15.46:0/1114466766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9694101900 msgr2=0x7f969419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f96937fe640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9694101900 0x7f969419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.879+0000 7f96937fe640 1 -- 172.21.15.46:0/1114466766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96941977a0 con 0x7f9694107900 2024-09-21T13:03:59.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.880+0000 7f96937fe640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 0x7f969419db60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9688031460 tx=0x7f96880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.880+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f968803f070 con 0x7f9694107900 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.880+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f96880035f0 con 0x7f9694107900 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.880+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9694197a30 con 0x7f9694107900 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.880+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9688035030 con 0x7f9694107900 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.880+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9694197f60 con 0x7f9694107900 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.881+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9694103040 con 0x7f9694107900 2024-09-21T13:03:59.883 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.882+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9688042070 con 0x7f9694107900 2024-09-21T13:03:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.882+0000 7f96917fa640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967c07af80 0x7f967c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:03:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.882+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f96880be910 con 0x7f9694107900 2024-09-21T13:03:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.882+0000 7f9693fff640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967c07af80 0x7f967c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:03:59.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.883+0000 7f9693fff640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967c07af80 0x7f967c07d440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9684005fd0 tx=0x7f968400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:03:59.887 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:03:59.887+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9688089ee0 con 0x7f9694107900 2024-09-21T13:04:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.091+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9694198210 con 0x7f967c07af80 2024-09-21T13:04:00.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.092+0000 7f96917fa640 1 -- 172.21.15.46:0/1114466766 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9694198210 con 0x7f967c07af80 2024-09-21T13:04:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967c07af80 msgr2=0x7f967c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967c07af80 0x7f967c07d440 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9684005fd0 tx=0x7f968400b390 comp rx=0 tx=0).stop 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 msgr2=0x7f969419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 0x7f969419db60 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9688031460 tx=0x7f96880045e0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 shutdown_connections 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f967c07af80 0x7f967c07d440 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9694107900 0x7f969419db60 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 --2- 172.21.15.46:0/1114466766 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9694101900 0x7f969419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 >> 172.21.15.46:0/1114466766 conn(0x7f96940fd600 msgr2=0x7f96940fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 shutdown_connections 2024-09-21T13:04:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.094+0000 7f969a60e640 1 -- 172.21.15.46:0/1114466766 wait complete. 2024-09-21T13:04:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 -- 172.21.15.46:0/3087534989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81007f0 msgr2=0x7fdfe8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 --2- 172.21.15.46:0/3087534989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81007f0 0x7fdfe8100c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc009880 tx=0x7fdfdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 -- 172.21.15.46:0/3087534989 shutdown_connections 2024-09-21T13:04:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 --2- 172.21.15.46:0/3087534989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81007f0 0x7fdfe8100c50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 --2- 172.21.15.46:0/3087534989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81067f0 0x7fdfe8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 -- 172.21.15.46:0/3087534989 >> 172.21.15.46:0/3087534989 conn(0x7fdfe80fc550 msgr2=0x7fdfe80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:00.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 -- 172.21.15.46:0/3087534989 shutdown_connections 2024-09-21T13:04:00.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.179+0000 7fdfeca85640 1 -- 172.21.15.46:0/3087534989 wait complete. 2024-09-21T13:04:00.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfeca85640 1 Processor -- start 2024-09-21T13:04:00.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfeca85640 1 -- start start 2024-09-21T13:04:00.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfeca85640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81007f0 0x7fdfe819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfeca85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 0x7fdfe819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfeca85640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe810dcc0 con 0x7fdfe81067f0 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfeca85640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdfe810db40 con 0x7fdfe81007f0 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfe5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 0x7fdfe819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfe5d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 0x7fdfe819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35360/0 (socket says 172.21.15.46:35360) 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfe5d9b640 1 -- 172.21.15.46:0/1098295561 learned_addr learned my addr 172.21.15.46:0/1098295561 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfe659c640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81007f0 0x7fdfe819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.180+0000 7fdfe5d9b640 1 -- 172.21.15.46:0/1098295561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81007f0 msgr2=0x7fdfe819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfe5d9b640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81007f0 0x7fdfe819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfe5d9b640 1 -- 172.21.15.46:0/1098295561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfe81977e0 con 0x7fdfe81067f0 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfe659c640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81007f0 0x7fdfe819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfe5d9b640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 0x7fdfe819dba0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc031460 tx=0x7fdfdc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:00.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfdc03f070 con 0x7fdfe81067f0 2024-09-21T13:04:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdfdc0035f0 con 0x7fdfe81067f0 2024-09-21T13:04:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfe8197a70 con 0x7fdfe81067f0 2024-09-21T13:04:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdfdc035030 con 0x7fdfe81067f0 2024-09-21T13:04:00.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.181+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfe8197fa0 con 0x7fdfe81067f0 2024-09-21T13:04:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.182+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfe8101f30 con 0x7fdfe81067f0 2024-09-21T13:04:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.183+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdfdc042070 con 0x7fdfe81067f0 2024-09-21T13:04:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.183+0000 7fdfd77fe640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdfd007af30 0x7fdfd007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.184+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdfdc0beac0 con 0x7fdfe81067f0 2024-09-21T13:04:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.184+0000 7fdfe659c640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdfd007af30 0x7fdfd007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.184+0000 7fdfe659c640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdfd007af30 0x7fdfd007d3f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8005fd0 tx=0x7fdfd800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:00.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.188+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdfdc089f70 con 0x7fdfe81067f0 2024-09-21T13:04:00.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.384+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdfe8198310 con 0x7fdfd007af30 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.394+0000 7fdfd77fe640 1 -- 172.21.15.46:0/1098295561 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fdfe8198310 con 0x7fdfd007af30 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (14m) 8m ago 24m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (17m) 8m ago 25m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (17m) 7m ago 24m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 8m ago 25m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (12m) 7m ago 24m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (13m) 8m ago 24m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:04:00.395 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (8m) 8m ago 19m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (8m) 8m ago 19m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (8m) 7m ago 19m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (7m) 7m ago 19m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (16m) 8m ago 26m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (15m) 7m ago 24m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (12m) 8m ago 26m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (12m) 7m ago 24m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (15m) 8m ago 25m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (15m) 7m ago 24m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (11m) 8m ago 23m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (11m) 8m ago 22m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (10m) 8m ago 22m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (10m) 7m ago 21m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (9m) 7m ago 21m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:04:00.396 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (8m) 7m ago 20m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:04:00.397 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (14m) 8m ago 24m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.396+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdfd007af30 msgr2=0x7fdfd007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.396+0000 7fdfeca85640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdfd007af30 0x7fdfd007d3f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8005fd0 tx=0x7fdfd800b390 comp rx=0 tx=0).stop 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.396+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 msgr2=0x7fdfe819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.396+0000 7fdfeca85640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 0x7fdfe819dba0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc031460 tx=0x7fdfdc0045e0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 shutdown_connections 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdfd007af30 0x7fdfd007d3f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdfe81067f0 0x7fdfe819dba0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 --2- 172.21.15.46:0/1098295561 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdfe81007f0 0x7fdfe819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.398 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 >> 172.21.15.46:0/1098295561 conn(0x7fdfe80fc550 msgr2=0x7fdfe8069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 shutdown_connections 2024-09-21T13:04:00.399 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.397+0000 7fdfeca85640 1 -- 172.21.15.46:0/1098295561 wait complete. 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.479+0000 7f9967b1a640 1 -- 172.21.15.46:0/1181107264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960103490 msgr2=0x7f996010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.479+0000 7f9967b1a640 1 --2- 172.21.15.46:0/1181107264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960103490 0x7f996010b980 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9954009880 tx=0x7f995402a530 comp rx=0 tx=0).stop 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- 172.21.15.46:0/1181107264 shutdown_connections 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 --2- 172.21.15.46:0/1181107264 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960103490 0x7f996010b980 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 --2- 172.21.15.46:0/1181107264 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9960102b70 0x7f9960102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- 172.21.15.46:0/1181107264 >> 172.21.15.46:0/1181107264 conn(0x7f99600fc550 msgr2=0x7f99600fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- 172.21.15.46:0/1181107264 shutdown_connections 2024-09-21T13:04:00.481 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- 172.21.15.46:0/1181107264 wait complete. 2024-09-21T13:04:00.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 Processor -- start 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- start start 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 0x7f996019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9960103490 0x7f996019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f996010ee40 con 0x7f9960102b70 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.480+0000 7f9967b1a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f996010ecc0 con 0x7f9960103490 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 0x7f996019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 0x7f996019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35368/0 (socket says 172.21.15.46:35368) 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 -- 172.21.15.46:0/2637071786 learned_addr learned my addr 172.21.15.46:0/2637071786 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99650b5640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9960103490 0x7f996019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 -- 172.21.15.46:0/2637071786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9960103490 msgr2=0x7f996019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9960103490 0x7f996019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 -- 172.21.15.46:0/2637071786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9960197810 con 0x7f9960102b70 2024-09-21T13:04:00.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f99658b6640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 0x7f996019d690 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f995c00ba50 tx=0x7f995c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:00.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f995c019070 con 0x7f9960102b70 2024-09-21T13:04:00.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f995c00ce20 con 0x7f9960102b70 2024-09-21T13:04:00.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9960197b00 con 0x7f9960102b70 2024-09-21T13:04:00.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f995c0075a0 con 0x7f9960102b70 2024-09-21T13:04:00.484 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.481+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9960198060 con 0x7f9960102b70 2024-09-21T13:04:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.482+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996006a4c0 con 0x7f9960102b70 2024-09-21T13:04:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.483+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f995c01c070 con 0x7f9960102b70 2024-09-21T13:04:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.483+0000 7f9952ffd640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994c07af30 0x7f994c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.484+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f995c09da40 con 0x7f9960102b70 2024-09-21T13:04:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.484+0000 7f99650b5640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994c07af30 0x7f994c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.484+0000 7f99650b5640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994c07af30 0x7f994c07d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9960198b60 tx=0x7f9954004f30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:00.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.488+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f995c068ef0 con 0x7f9960102b70 2024-09-21T13:04:00.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.753+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9960198d70 con 0x7f9960102b70 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.754+0000 7f9952ffd640 1 -- 172.21.15.46:0/2637071786 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f9960198d70 con 0x7f9960102b70 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:04:00.755 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:04:00.756 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:04:00.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994c07af30 msgr2=0x7f994c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994c07af30 0x7f994c07d3f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9960198b60 tx=0x7f9954004f30 comp rx=0 tx=0).stop 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 msgr2=0x7f996019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 0x7f996019d690 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f995c00ba50 tx=0x7f995c00bf10 comp rx=0 tx=0).stop 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 shutdown_connections 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994c07af30 0x7f994c07d3f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9960103490 0x7f996019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 --2- 172.21.15.46:0/2637071786 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9960102b70 0x7f996019d690 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 >> 172.21.15.46:0/2637071786 conn(0x7f99600fc550 msgr2=0x7f9960108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 shutdown_connections 2024-09-21T13:04:00.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.756+0000 7f9967b1a640 1 -- 172.21.15.46:0/2637071786 wait complete. 2024-09-21T13:04:00.841 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 -- 172.21.15.46:0/2245873472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 msgr2=0x7f9d1c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 --2- 172.21.15.46:0/2245873472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c100c60 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009880 tx=0x7f9d0802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 -- 172.21.15.46:0/2245873472 shutdown_connections 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 --2- 172.21.15.46:0/2245873472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c100c60 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 --2- 172.21.15.46:0/2245873472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1c106800 0x7f9d1c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 -- 172.21.15.46:0/2245873472 >> 172.21.15.46:0/2245873472 conn(0x7f9d1c0fc520 msgr2=0x7f9d1c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 -- 172.21.15.46:0/2245873472 shutdown_connections 2024-09-21T13:04:00.842 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.840+0000 7f9d22cec640 1 -- 172.21.15.46:0/2245873472 wait complete. 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d22cec640 1 Processor -- start 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d22cec640 1 -- start start 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d22cec640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c0fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d22cec640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1c106800 0x7f9d1c0fd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d22cec640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c10dcd0 con 0x7f9d1c100800 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d22cec640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1c10db50 con 0x7f9d1c106800 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d20a88640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c0fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d20a88640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c0fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35388/0 (socket says 172.21.15.46:35388) 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.841+0000 7f9d20a88640 1 -- 172.21.15.46:0/1854963552 learned_addr learned my addr 172.21.15.46:0/1854963552 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d1bfff640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1c106800 0x7f9d1c0fd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d20a88640 1 -- 172.21.15.46:0/1854963552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1c106800 msgr2=0x7f9d1c0fd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d20a88640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1c106800 0x7f9d1c0fd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:00.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d20a88640 1 -- 172.21.15.46:0/1854963552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1c0fd670 con 0x7f9d1c100800 2024-09-21T13:04:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d20a88640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c0fcbf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000d6f0 tx=0x7f9d1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d10017070 con 0x7f9d1c100800 2024-09-21T13:04:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d1000de00 con 0x7f9d1c100800 2024-09-21T13:04:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1c0fd960 con 0x7f9d1c100800 2024-09-21T13:04:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d10004bb0 con 0x7f9d1c100800 2024-09-21T13:04:00.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.842+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1c1a3e70 con 0x7f9d1c100800 2024-09-21T13:04:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.843+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d1c101f40 con 0x7f9d1c100800 2024-09-21T13:04:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.844+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9d10009a30 con 0x7f9d1c100800 2024-09-21T13:04:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.844+0000 7f9d19ffb640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9d0c07af80 0x7f9d0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.845+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9d1009dc30 con 0x7f9d1c100800 2024-09-21T13:04:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.845+0000 7f9d1bfff640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9d0c07af80 0x7f9d0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:00.846 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.845+0000 7f9d1bfff640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9d0c07af80 0x7f9d0c07d440 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0fe680 tx=0x7f9d08031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:00.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:00.849+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9d10069200 con 0x7f9d1c100800 2024-09-21T13:04:01.076 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.075+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9d1c109d80 con 0x7f9d1c100800 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.076+0000 7f9d19ffb640 1 -- 172.21.15.46:0/1854963552 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f9d1005ee20 con 0x7f9d1c100800 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:01.077 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:04:01.078 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:04:01.079 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:01.080 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9d0c07af80 msgr2=0x7f9d0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9d0c07af80 0x7f9d0c07d440 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0fe680 tx=0x7f9d08031400 comp rx=0 tx=0).stop 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 msgr2=0x7f9d1c0fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c0fcbf0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000d6f0 tx=0x7f9d1000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 shutdown_connections 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9d0c07af80 0x7f9d0c07d440 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9d1c106800 0x7f9d1c0fd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.081 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 --2- 172.21.15.46:0/1854963552 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9d1c100800 0x7f9d1c0fcbf0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 >> 172.21.15.46:0/1854963552 conn(0x7f9d1c0fc520 msgr2=0x7f9d1c06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 shutdown_connections 2024-09-21T13:04:01.082 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.078+0000 7f9d22cec640 1 -- 172.21.15.46:0/1854963552 wait complete. 2024-09-21T13:04:01.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2607449848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681007f0 msgr2=0x7fda68100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2607449848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681007f0 0x7fda68100c50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fda5c009880 tx=0x7fda5c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2607449848 shutdown_connections 2024-09-21T13:04:01.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2607449848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681007f0 0x7fda68100c50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2607449848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda681067f0 0x7fda68106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2607449848 >> 172.21.15.46:0/2607449848 conn(0x7fda680fc550 msgr2=0x7fda680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2607449848 shutdown_connections 2024-09-21T13:04:01.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.165+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2607449848 wait complete. 2024-09-21T13:04:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6c8d5640 1 Processor -- start 2024-09-21T13:04:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6c8d5640 1 -- start start 2024-09-21T13:04:01.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6c8d5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda681007f0 0x7fda6819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6c8d5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 0x7fda6819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6c8d5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fda6810dcc0 con 0x7fda681067f0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6c8d5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fda6810db40 con 0x7fda681007f0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda65d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 0x7fda6819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda65d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 0x7fda6819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35408/0 (socket says 172.21.15.46:35408) 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda65d9b640 1 -- 172.21.15.46:0/2135070708 learned_addr learned my addr 172.21.15.46:0/2135070708 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda6659c640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda681007f0 0x7fda6819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda65d9b640 1 -- 172.21.15.46:0/2135070708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda681007f0 msgr2=0x7fda6819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda65d9b640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda681007f0 0x7fda6819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.166+0000 7fda65d9b640 1 -- 172.21.15.46:0/2135070708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda681977e0 con 0x7fda681067f0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.167+0000 7fda65d9b640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 0x7fda6819dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fda5c031460 tx=0x7fda5c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.167+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda5c03f070 con 0x7fda681067f0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.167+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda68197a70 con 0x7fda681067f0 2024-09-21T13:04:01.169 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.167+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fda5c0035f0 con 0x7fda681067f0 2024-09-21T13:04:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.167+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fda5c035030 con 0x7fda681067f0 2024-09-21T13:04:01.170 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.167+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda68197fa0 con 0x7fda681067f0 2024-09-21T13:04:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.168+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68101f30 con 0x7fda681067f0 2024-09-21T13:04:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.169+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fda5c042070 con 0x7fda681067f0 2024-09-21T13:04:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.169+0000 7fda577fe640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fda5007af30 0x7fda5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.169+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fda5c0bea20 con 0x7fda681067f0 2024-09-21T13:04:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.169+0000 7fda6659c640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fda5007af30 0x7fda5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:01.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.170+0000 7fda6659c640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fda5007af30 0x7fda5007d3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda5800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:01.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.174+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fda5c089f70 con 0x7fda681067f0 2024-09-21T13:04:01.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.380+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda68198250 con 0x7fda5007af30 2024-09-21T13:04:01.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.381+0000 7fda577fe640 1 -- 172.21.15.46:0/2135070708 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fda68198250 con 0x7fda5007af30 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:04:01.383 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:04:01.384 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.384+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fda5007af30 msgr2=0x7fda5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.384+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fda5007af30 0x7fda5007d3f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fda58005fd0 tx=0x7fda5800b390 comp rx=0 tx=0).stop 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 msgr2=0x7fda6819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 0x7fda6819dba0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fda5c031460 tx=0x7fda5c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 shutdown_connections 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fda5007af30 0x7fda5007d3f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fda681067f0 0x7fda6819dba0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 --2- 172.21.15.46:0/2135070708 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda681007f0 0x7fda6819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 >> 172.21.15.46:0/2135070708 conn(0x7fda680fc550 msgr2=0x7fda68069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 shutdown_connections 2024-09-21T13:04:01.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.385+0000 7fda6c8d5640 1 -- 172.21.15.46:0/2135070708 wait complete. 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.469+0000 7fd421760640 1 -- 172.21.15.46:0/725679071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c103470 msgr2=0x7fd41c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.469+0000 7fd421760640 1 --2- 172.21.15.46:0/725679071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c103470 0x7fd41c10b960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd410009880 tx=0x7fd41002a530 comp rx=0 tx=0).stop 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.469+0000 7fd421760640 1 -- 172.21.15.46:0/725679071 shutdown_connections 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.469+0000 7fd421760640 1 --2- 172.21.15.46:0/725679071 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c103470 0x7fd41c10b960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.469+0000 7fd421760640 1 --2- 172.21.15.46:0/725679071 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c102b50 0x7fd41c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.469+0000 7fd421760640 1 -- 172.21.15.46:0/725679071 >> 172.21.15.46:0/725679071 conn(0x7fd41c0fc550 msgr2=0x7fd41c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.470+0000 7fd421760640 1 -- 172.21.15.46:0/725679071 shutdown_connections 2024-09-21T13:04:01.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.470+0000 7fd421760640 1 -- 172.21.15.46:0/725679071 wait complete. 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.470+0000 7fd421760640 1 Processor -- start 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.470+0000 7fd421760640 1 -- start start 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd421760640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 0x7fd41c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd421760640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c103470 0x7fd41c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd421760640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c10ede0 con 0x7fd41c102b50 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd421760640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd41c10ec60 con 0x7fd41c103470 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 0x7fd41c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 0x7fd41c19d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35428/0 (socket says 172.21.15.46:35428) 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 -- 172.21.15.46:0/2118130619 learned_addr learned my addr 172.21.15.46:0/2118130619 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:01.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 -- 172.21.15.46:0/2118130619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c103470 msgr2=0x7fd41c19db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c103470 0x7fd41c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 -- 172.21.15.46:0/2118130619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd41c1977b0 con 0x7fd41c102b50 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd41affd640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 0x7fd41c19d630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00d6f0 tx=0x7fd40c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd40c017070 con 0x7fd41c102b50 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd40c00de00 con 0x7fd41c102b50 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd41c197aa0 con 0x7fd41c102b50 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.471+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd40c004bb0 con 0x7fd41c102b50 2024-09-21T13:04:01.474 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.472+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd41c198030 con 0x7fd41c102b50 2024-09-21T13:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.473+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd41c06a4e0 con 0x7fd41c102b50 2024-09-21T13:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.473+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd40c004e60 con 0x7fd41c102b50 2024-09-21T13:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.474+0000 7fd403fff640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd40407af30 0x7fd40407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.474+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd40c09dd00 con 0x7fd41c102b50 2024-09-21T13:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.474+0000 7fd41a7fc640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd40407af30 0x7fd40407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:01.475 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.474+0000 7fd41a7fc640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd40407af30 0x7fd40407d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd4100096c0 tx=0x7fd410000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:01.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.478+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd40c0a1030 con 0x7fd41c102b50 2024-09-21T13:04:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:01 smithi046 ceph-mon[108126]: pgmap v526: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:01 smithi046 ceph-mon[108126]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:01 smithi046 ceph-mon[108126]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:01 smithi046 ceph-mon[108126]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:01 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2637071786' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:04:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:01 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1854963552' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:04:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.742+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd41c105fe0 con 0x7fd41c102b50 2024-09-21T13:04:01.743 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.742+0000 7fd403fff640 1 -- 172.21.15.46:0/2118130619 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fd40c069250 con 0x7fd41c102b50 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:04:01.744 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd40407af30 msgr2=0x7fd40407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd40407af30 0x7fd40407d3f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd4100096c0 tx=0x7fd410000bc0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 msgr2=0x7fd41c19d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 0x7fd41c19d630 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd40c00d6f0 tx=0x7fd40c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 shutdown_connections 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd40407af30 0x7fd40407d3f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd41c103470 0x7fd41c19db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 --2- 172.21.15.46:0/2118130619 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd41c102b50 0x7fd41c19d630 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 >> 172.21.15.46:0/2118130619 conn(0x7fd41c0fc550 msgr2=0x7fd41c103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:01.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 shutdown_connections 2024-09-21T13:04:01.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:01.745+0000 7fd421760640 1 -- 172.21.15.46:0/2118130619 wait complete. 2024-09-21T13:04:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:01 smithi176 ceph-mon[80162]: pgmap v526: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:01 smithi176 ceph-mon[80162]: from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:01 smithi176 ceph-mon[80162]: from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:01 smithi176 ceph-mon[80162]: from='client.34794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:01 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2637071786' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:04:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:01 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1854963552' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:04:02.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:02 smithi176 ceph-mon[80162]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:02.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:02 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2118130619' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:04:02.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:02 smithi046 ceph-mon[108126]: from='client.34806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:02.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:02 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2118130619' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:04:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:03 smithi176 ceph-mon[80162]: pgmap v527: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:03.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:03 smithi046 ceph-mon[108126]: pgmap v527: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:05 smithi176 ceph-mon[80162]: pgmap v528: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:05.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:05 smithi046 ceph-mon[108126]: pgmap v528: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:07 smithi176 ceph-mon[80162]: pgmap v529: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:07.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:07 smithi046 ceph-mon[108126]: pgmap v529: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:09 smithi176 ceph-mon[80162]: pgmap v530: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:09.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:09 smithi046 ceph-mon[108126]: pgmap v530: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:11 smithi176 ceph-mon[80162]: pgmap v531: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:11.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:11 smithi046 ceph-mon[108126]: pgmap v531: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:13 smithi176 ceph-mon[80162]: pgmap v532: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:13.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:13 smithi046 ceph-mon[108126]: pgmap v532: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:04:14.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:04:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:15 smithi176 ceph-mon[80162]: pgmap v533: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:15.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:15 smithi046 ceph-mon[108126]: pgmap v533: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:17 smithi176 ceph-mon[80162]: pgmap v534: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:17.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:17 smithi046 ceph-mon[108126]: pgmap v534: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:19.711 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:19 smithi176 ceph-mon[80162]: pgmap v535: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:19.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:19 smithi046 ceph-mon[108126]: pgmap v535: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:21 smithi176 ceph-mon[80162]: pgmap v536: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:21.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:21 smithi046 ceph-mon[108126]: pgmap v536: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:23 smithi176 ceph-mon[80162]: pgmap v537: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:23.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:23 smithi046 ceph-mon[108126]: pgmap v537: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:25 smithi176 ceph-mon[80162]: pgmap v538: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:25.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:25 smithi046 ceph-mon[108126]: pgmap v538: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:27 smithi176 ceph-mon[80162]: pgmap v539: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:27.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:27 smithi046 ceph-mon[108126]: pgmap v539: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:29 smithi176 ceph-mon[80162]: pgmap v540: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:04:29.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:29 smithi046 ceph-mon[108126]: pgmap v540: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:29.839 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:04:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:31 smithi176 ceph-mon[80162]: pgmap v541: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.842+0000 7fca31a36640 1 -- 172.21.15.46:0/2653588278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 msgr2=0x7fca2c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.842+0000 7fca31a36640 1 --2- 172.21.15.46:0/2653588278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c102ea0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca1c009880 tx=0x7fca1c02a530 comp rx=0 tx=0).stop 2024-09-21T13:04:31.844 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 -- 172.21.15.46:0/2653588278 shutdown_connections 2024-09-21T13:04:31.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 --2- 172.21.15.46:0/2653588278 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2c1033e0 0x7fca2c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:31.845 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:31 smithi046 ceph-mon[108126]: pgmap v541: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:31.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 --2- 172.21.15.46:0/2653588278 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c102ea0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:31.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 -- 172.21.15.46:0/2653588278 >> 172.21.15.46:0/2653588278 conn(0x7fca2c0fc520 msgr2=0x7fca2c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:31.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 -- 172.21.15.46:0/2653588278 shutdown_connections 2024-09-21T13:04:31.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 -- 172.21.15.46:0/2653588278 wait complete. 2024-09-21T13:04:31.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.843+0000 7fca31a36640 1 Processor -- start 2024-09-21T13:04:31.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca31a36640 1 -- start start 2024-09-21T13:04:31.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca31a36640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:31.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca31a36640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2c1033e0 0x7fca2c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:31.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca31a36640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c10edf0 con 0x7fca2c102ac0 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca31a36640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c10ec70 con 0x7fca2c1033e0 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35922/0 (socket says 172.21.15.46:35922) 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2affd640 1 -- 172.21.15.46:0/1213830180 learned_addr learned my addr 172.21.15.46:0/1213830180 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2a7fc640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2c1033e0 0x7fca2c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2affd640 1 -- 172.21.15.46:0/1213830180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2c1033e0 msgr2=0x7fca2c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:31.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2affd640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2c1033e0 0x7fca2c100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.844+0000 7fca2affd640 1 -- 172.21.15.46:0/1213830180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c1011a0 con 0x7fca2c102ac0 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.845+0000 7fca2affd640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c100720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca1c031460 tx=0x7fca1c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.845+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca1c03f070 con 0x7fca2c102ac0 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.845+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c101430 con 0x7fca2c102ac0 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.845+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fca1c0035f0 con 0x7fca2c102ac0 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.845+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c1a3d80 con 0x7fca2c102ac0 2024-09-21T13:04:31.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.845+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fca1c035030 con 0x7fca2c102ac0 2024-09-21T13:04:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.846+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca18005290 con 0x7fca2c102ac0 2024-09-21T13:04:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.847+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fca1c042070 con 0x7fca2c102ac0 2024-09-21T13:04:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.847+0000 7fca30a34640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fca1407af80 0x7fca1407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.848+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fca1c0be810 con 0x7fca2c102ac0 2024-09-21T13:04:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.848+0000 7fca2a7fc640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fca1407af80 0x7fca1407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:31.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.848+0000 7fca2a7fc640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fca1407af80 0x7fca1407d440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca2c1021b0 tx=0x7fca20005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:31.854 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:31.852+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fca1c089de0 con 0x7fca2c102ac0 2024-09-21T13:04:32.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.062+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fca18000bc0 con 0x7fca1407af80 2024-09-21T13:04:32.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.063+0000 7fca30a34640 1 -- 172.21.15.46:0/1213830180 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fca18000bc0 con 0x7fca1407af80 2024-09-21T13:04:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fca1407af80 msgr2=0x7fca1407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fca1407af80 0x7fca1407d440 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fca2c1021b0 tx=0x7fca20005f90 comp rx=0 tx=0).stop 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 msgr2=0x7fca2c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c100720 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fca1c031460 tx=0x7fca1c004530 comp rx=0 tx=0).stop 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 shutdown_connections 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fca1407af80 0x7fca1407d440 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca2c1033e0 0x7fca2c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 --2- 172.21.15.46:0/1213830180 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca2c102ac0 0x7fca2c100720 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.065+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 >> 172.21.15.46:0/1213830180 conn(0x7fca2c0fc520 msgr2=0x7fca2c10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.066+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 shutdown_connections 2024-09-21T13:04:32.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.066+0000 7fca31a36640 1 -- 172.21.15.46:0/1213830180 wait complete. 2024-09-21T13:04:32.075 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.150+0000 7f7c9f328640 1 -- 172.21.15.46:0/3595582186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981067f0 msgr2=0x7f7c98106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.150+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3595582186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981067f0 0x7f7c98106bd0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009880 tx=0x7f7c8802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 -- 172.21.15.46:0/3595582186 shutdown_connections 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3595582186 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981007f0 0x7f7c98100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3595582186 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981067f0 0x7f7c98106bd0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 -- 172.21.15.46:0/3595582186 >> 172.21.15.46:0/3595582186 conn(0x7f7c980fc550 msgr2=0x7f7c980fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 -- 172.21.15.46:0/3595582186 shutdown_connections 2024-09-21T13:04:32.152 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 -- 172.21.15.46:0/3595582186 wait complete. 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 Processor -- start 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.151+0000 7f7c9f328640 1 -- start start 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9f328640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 0x7f7c98107720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9f328640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981067f0 0x7f7c98107c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9f328640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9810dca0 con 0x7f7c981007f0 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9f328640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9810db20 con 0x7f7c981067f0 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 0x7f7c98107720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 0x7f7c98107720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35952/0 (socket says 172.21.15.46:35952) 2024-09-21T13:04:32.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 -- 172.21.15.46:0/3955696316 learned_addr learned my addr 172.21.15.46:0/3955696316 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 -- 172.21.15.46:0/3955696316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981067f0 msgr2=0x7f7c98107c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9c8c3640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981067f0 0x7f7c98107c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981067f0 0x7f7c98107c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 -- 172.21.15.46:0/3955696316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c981081a0 con 0x7f7c981007f0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9c8c3640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981067f0 0x7f7c98107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.152+0000 7f7c9d0c4640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 0x7f7c98107720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7c88031460 tx=0x7f7c880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.153+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c8803f070 con 0x7f7c981007f0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.153+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c880035f0 con 0x7f7c981007f0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.153+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c98108430 con 0x7f7c981007f0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.153+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c88035030 con 0x7f7c981007f0 2024-09-21T13:04:32.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.153+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c981a3d10 con 0x7f7c981007f0 2024-09-21T13:04:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.155+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c98101f30 con 0x7f7c981007f0 2024-09-21T13:04:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.155+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7c88042070 con 0x7f7c981007f0 2024-09-21T13:04:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.155+0000 7f7c967fc640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7c8007af30 0x7f7c8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.156+0000 7f7c9c8c3640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7c8007af30 0x7f7c8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.156+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7c880be630 con 0x7f7c981007f0 2024-09-21T13:04:32.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.156+0000 7f7c9c8c3640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7c8007af30 0x7f7c8007d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c981091b0 tx=0x7f7c8c005e50 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:32.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.160+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c88089b80 con 0x7f7c981007f0 2024-09-21T13:04:32.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.364+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7c9806a520 con 0x7f7c8007af30 2024-09-21T13:04:32.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.366+0000 7f7c967fc640 1 -- 172.21.15.46:0/3955696316 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7c9806a520 con 0x7f7c8007af30 2024-09-21T13:04:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7c8007af30 msgr2=0x7f7c8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7c8007af30 0x7f7c8007d3f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7c981091b0 tx=0x7f7c8c005e50 comp rx=0 tx=0).stop 2024-09-21T13:04:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 msgr2=0x7f7c98107720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 0x7f7c98107720 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f7c88031460 tx=0x7f7c880045e0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 shutdown_connections 2024-09-21T13:04:32.369 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7c8007af30 0x7f7c8007d3f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7c981067f0 0x7f7c98107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 --2- 172.21.15.46:0/3955696316 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7c981007f0 0x7f7c98107720 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 >> 172.21.15.46:0/3955696316 conn(0x7f7c980fc550 msgr2=0x7f7c98069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:32.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 shutdown_connections 2024-09-21T13:04:32.370 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.368+0000 7f7c9f328640 1 -- 172.21.15.46:0/3955696316 wait complete. 2024-09-21T13:04:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 -- 172.21.15.46:0/628386871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c107900 msgr2=0x7f9f2c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 --2- 172.21.15.46:0/628386871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c107900 0x7f9f2c107ce0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009880 tx=0x7f9f1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 -- 172.21.15.46:0/628386871 shutdown_connections 2024-09-21T13:04:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 --2- 172.21.15.46:0/628386871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f2c101900 0x7f9f2c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 --2- 172.21.15.46:0/628386871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c107900 0x7f9f2c107ce0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 -- 172.21.15.46:0/628386871 >> 172.21.15.46:0/628386871 conn(0x7f9f2c0fd600 msgr2=0x7f9f2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 -- 172.21.15.46:0/628386871 shutdown_connections 2024-09-21T13:04:32.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.452+0000 7f9f31a34640 1 -- 172.21.15.46:0/628386871 wait complete. 2024-09-21T13:04:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f31a34640 1 Processor -- start 2024-09-21T13:04:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f31a34640 1 -- start start 2024-09-21T13:04:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f31a34640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 0x7f9f2c19f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f31a34640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f2c107900 0x7f9f2c19fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f31a34640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c10edd0 con 0x7f9f2c101900 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f31a34640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9f2c10ec50 con 0x7f9f2c107900 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f2affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 0x7f9f2c19f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f2affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 0x7f9f2c19f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35966/0 (socket says 172.21.15.46:35966) 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f2affd640 1 -- 172.21.15.46:0/2332870706 learned_addr learned my addr 172.21.15.46:0/2332870706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f23fff640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f2c107900 0x7f9f2c19fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f2affd640 1 -- 172.21.15.46:0/2332870706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f2c107900 msgr2=0x7f9f2c19fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f2affd640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f2c107900 0x7f9f2c19fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.453+0000 7f9f2affd640 1 -- 172.21.15.46:0/2332870706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2c199990 con 0x7f9f2c101900 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.454+0000 7f9f2affd640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 0x7f9f2c19f7d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c031460 tx=0x7f9f1c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.454+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f1c03f070 con 0x7f9f2c101900 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.454+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f1c004b10 con 0x7f9f2c101900 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.454+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f2c199c20 con 0x7f9f2c101900 2024-09-21T13:04:32.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.454+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9f1c035030 con 0x7f9f2c101900 2024-09-21T13:04:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.454+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f2c19a150 con 0x7f9f2c101900 2024-09-21T13:04:32.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.455+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f2c103040 con 0x7f9f2c101900 2024-09-21T13:04:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.455+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9f1c042070 con 0x7f9f2c101900 2024-09-21T13:04:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.456+0000 7f9f30a32640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9f1807af90 0x7f9f1807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.456+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9f1c0bea80 con 0x7f9f2c101900 2024-09-21T13:04:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.456+0000 7f9f23fff640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9f1807af90 0x7f9f1807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.457+0000 7f9f23fff640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9f1807af90 0x7f9f1807d450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0757e0 tx=0x7f9f1400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:32.461 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.461+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f1c08a050 con 0x7f9f2c101900 2024-09-21T13:04:32.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.661+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9f2c19a400 con 0x7f9f1807af90 2024-09-21T13:04:32.672 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.671+0000 7f9f30a32640 1 -- 172.21.15.46:0/2332870706 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f9f2c19a400 con 0x7f9f1807af90 2024-09-21T13:04:32.672 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:04:32.672 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (14m) 8m ago 25m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:04:32.672 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (17m) 8m ago 25m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:04:32.672 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (17m) 8m ago 24m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (12m) 8m ago 25m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (12m) 8m ago 24m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (14m) 8m ago 25m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (9m) 8m ago 20m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (8m) 8m ago 20m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (8m) 8m ago 20m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (8m) 8m ago 20m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (17m) 8m ago 26m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (16m) 8m ago 24m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 8m ago 27m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (13m) 8m ago 24m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (15m) 8m ago 25m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (15m) 8m ago 24m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:04:32.673 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (12m) 8m ago 23m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:04:32.674 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (11m) 8m ago 23m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:04:32.674 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (11m) 8m ago 22m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:04:32.674 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (10m) 8m ago 22m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:04:32.674 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (10m) 8m ago 21m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:04:32.674 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (9m) 8m ago 21m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:04:32.674 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (15m) 8m ago 25m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9f1807af90 msgr2=0x7f9f1807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9f1807af90 0x7f9f1807d450 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0757e0 tx=0x7f9f1400b390 comp rx=0 tx=0).stop 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 msgr2=0x7f9f2c19f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 0x7f9f2c19f7d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c031460 tx=0x7f9f1c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 shutdown_connections 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9f1807af90 0x7f9f1807d450 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f2c107900 0x7f9f2c19fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.675 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 --2- 172.21.15.46:0/2332870706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9f2c101900 0x7f9f2c19f7d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 >> 172.21.15.46:0/2332870706 conn(0x7f9f2c0fd600 msgr2=0x7f9f2c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:32.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 shutdown_connections 2024-09-21T13:04:32.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.674+0000 7f9f31a34640 1 -- 172.21.15.46:0/2332870706 wait complete. 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.757+0000 7f05e717d640 1 -- 172.21.15.46:0/214799532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 msgr2=0x7f05e010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.757+0000 7f05e717d640 1 --2- 172.21.15.46:0/214799532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e010b8d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f05d0009880 tx=0x7f05d002a530 comp rx=0 tx=0).stop 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.757+0000 7f05e717d640 1 -- 172.21.15.46:0/214799532 shutdown_connections 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.757+0000 7f05e717d640 1 --2- 172.21.15.46:0/214799532 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e010b8d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.758+0000 7f05e717d640 1 --2- 172.21.15.46:0/214799532 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e0102ac0 0x7f05e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.758+0000 7f05e717d640 1 -- 172.21.15.46:0/214799532 >> 172.21.15.46:0/214799532 conn(0x7f05e00fc520 msgr2=0x7f05e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.758+0000 7f05e717d640 1 -- 172.21.15.46:0/214799532 shutdown_connections 2024-09-21T13:04:32.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.758+0000 7f05e717d640 1 -- 172.21.15.46:0/214799532 wait complete. 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.758+0000 7f05e717d640 1 Processor -- start 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.758+0000 7f05e717d640 1 -- start start 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05e717d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e0102ac0 0x7f05e0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05e717d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05e717d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f05e010edf0 con 0x7f05e01033e0 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05e717d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f05e010ec70 con 0x7f05e0102ac0 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e0100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35990/0 (socket says 172.21.15.46:35990) 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 -- 172.21.15.46:0/3830583528 learned_addr learned my addr 172.21.15.46:0/3830583528 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05e4f19640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e0102ac0 0x7f05e0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 -- 172.21.15.46:0/3830583528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e0102ac0 msgr2=0x7f05e0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e0102ac0 0x7f05e0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 -- 172.21.15.46:0/3830583528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e01011a0 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05dffff640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e0100c60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f05d0031460 tx=0x7f05d0004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d003f070 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.759+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f05d00035f0 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.760+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f05d0035030 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.760+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e0101430 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.760+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e01a3dc0 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.761+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05e006aa90 con 0x7f05e01033e0 2024-09-21T13:04:32.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.762+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f05d0042070 con 0x7f05e01033e0 2024-09-21T13:04:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.762+0000 7f05ddffb640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f05cc07af80 0x7f05cc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.762+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f05d00be8e0 con 0x7f05e01033e0 2024-09-21T13:04:32.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.762+0000 7f05e4f19640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f05cc07af80 0x7f05cc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:32.764 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.763+0000 7f05e4f19640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f05cc07af80 0x7f05cc07d440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005fd0 tx=0x7f05c800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:32.768 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:32.767+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f05d0089eb0 con 0x7f05e01033e0 2024-09-21T13:04:33.030 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.029+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f05e0105f60 con 0x7f05e01033e0 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.029+0000 7f05ddffb640 1 -- 172.21.15.46:0/3830583528 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f05d008ed60 con 0x7f05e01033e0 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:04:33.031 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:04:33.032 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:04:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f05cc07af80 msgr2=0x7f05cc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f05cc07af80 0x7f05cc07d440 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005fd0 tx=0x7f05c800b390 comp rx=0 tx=0).stop 2024-09-21T13:04:33.033 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 msgr2=0x7f05e0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e0100c60 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f05d0031460 tx=0x7f05d0004530 comp rx=0 tx=0).stop 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 shutdown_connections 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f05cc07af80 0x7f05cc07d440 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f05e01033e0 0x7f05e0100c60 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 --2- 172.21.15.46:0/3830583528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05e0102ac0 0x7f05e0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 >> 172.21.15.46:0/3830583528 conn(0x7f05e00fc520 msgr2=0x7f05e0108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:33.034 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 shutdown_connections 2024-09-21T13:04:33.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.032+0000 7f05e717d640 1 -- 172.21.15.46:0/3830583528 wait complete. 2024-09-21T13:04:33.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.120+0000 7fcf10258640 1 -- 172.21.15.46:0/2715065492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08101900 msgr2=0x7fcf08101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.120+0000 7fcf10258640 1 --2- 172.21.15.46:0/2715065492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08101900 0x7fcf08101d60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009880 tx=0x7fcef802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 -- 172.21.15.46:0/2715065492 shutdown_connections 2024-09-21T13:04:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 --2- 172.21.15.46:0/2715065492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08101900 0x7fcf08101d60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 --2- 172.21.15.46:0/2715065492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf08107900 0x7fcf08107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 -- 172.21.15.46:0/2715065492 >> 172.21.15.46:0/2715065492 conn(0x7fcf080fd5e0 msgr2=0x7fcf080ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 -- 172.21.15.46:0/2715065492 shutdown_connections 2024-09-21T13:04:33.122 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 -- 172.21.15.46:0/2715065492 wait complete. 2024-09-21T13:04:33.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 Processor -- start 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.121+0000 7fcf10258640 1 -- start start 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf10258640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf08101900 0x7fcf0819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf10258640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 0x7fcf0819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf10258640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0810edd0 con 0x7fcf08107900 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf10258640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcf0810ec50 con 0x7fcf08101900 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0d7f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 0x7fcf0819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0d7f3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 0x7fcf0819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36002/0 (socket says 172.21.15.46:36002) 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0d7f3640 1 -- 172.21.15.46:0/3905056923 learned_addr learned my addr 172.21.15.46:0/3905056923 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0dff4640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf08101900 0x7fcf0819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0d7f3640 1 -- 172.21.15.46:0/3905056923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf08101900 msgr2=0x7fcf0819d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0d7f3640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf08101900 0x7fcf0819d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.122+0000 7fcf0d7f3640 1 -- 172.21.15.46:0/3905056923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf08197820 con 0x7fcf08107900 2024-09-21T13:04:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.123+0000 7fcf0d7f3640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 0x7fcf0819dbe0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009230 tx=0x7fcef8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.123+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcef803f070 con 0x7fcf08107900 2024-09-21T13:04:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.123+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf08197ab0 con 0x7fcf08107900 2024-09-21T13:04:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.123+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcef8004a90 con 0x7fcf08107900 2024-09-21T13:04:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.123+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcef8035030 con 0x7fcf08107900 2024-09-21T13:04:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.123+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf08197fe0 con 0x7fcf08107900 2024-09-21T13:04:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.124+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf08103040 con 0x7fcf08107900 2024-09-21T13:04:33.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.125+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcef8042070 con 0x7fcf08107900 2024-09-21T13:04:33.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.125+0000 7fcefeffd640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcef407af90 0x7fcef407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.125+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcef80bec00 con 0x7fcf08107900 2024-09-21T13:04:33.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.125+0000 7fcf0dff4640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcef407af90 0x7fcef407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.126+0000 7fcf0dff4640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcef407af90 0x7fcef407d450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf04005fd0 tx=0x7fcf04005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:33.131 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.130+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcef80c4020 con 0x7fcf08107900 2024-09-21T13:04:33.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.354+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fcf08198d50 con 0x7fcf08107900 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.355+0000 7fcefeffd640 1 -- 172.21.15.46:0/3905056923 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7fcef808a150 con 0x7fcf08107900 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:04:33.356 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:04:33.357 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:04:33.358 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:04:33.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcef407af90 msgr2=0x7fcef407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcef407af90 0x7fcef407d450 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fcf04005fd0 tx=0x7fcf04005850 comp rx=0 tx=0).stop 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 msgr2=0x7fcf0819dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 0x7fcf0819dbe0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009230 tx=0x7fcef8004600 comp rx=0 tx=0).stop 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 shutdown_connections 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcef407af90 0x7fcef407d450 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcf08107900 0x7fcf0819dbe0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 --2- 172.21.15.46:0/3905056923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf08101900 0x7fcf0819d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 >> 172.21.15.46:0/3905056923 conn(0x7fcf080fd5e0 msgr2=0x7fcf080fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 shutdown_connections 2024-09-21T13:04:33.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.357+0000 7fcf10258640 1 -- 172.21.15.46:0/3905056923 wait complete. 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.442+0000 7f94eccdb640 1 -- 172.21.15.46:0/829219763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 msgr2=0x7f94e8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.442+0000 7f94eccdb640 1 --2- 172.21.15.46:0/829219763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e8100c50 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009880 tx=0x7f94d002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 -- 172.21.15.46:0/829219763 shutdown_connections 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 --2- 172.21.15.46:0/829219763 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e8100c50 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 --2- 172.21.15.46:0/829219763 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e81067f0 0x7f94e8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 -- 172.21.15.46:0/829219763 >> 172.21.15.46:0/829219763 conn(0x7f94e80fc550 msgr2=0x7f94e80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 -- 172.21.15.46:0/829219763 shutdown_connections 2024-09-21T13:04:33.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 -- 172.21.15.46:0/829219763 wait complete. 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.443+0000 7f94eccdb640 1 Processor -- start 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94eccdb640 1 -- start start 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94eccdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e81987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94eccdb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e81067f0 0x7f94e8198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94eccdb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f94e810dcc0 con 0x7f94e81007f0 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94eccdb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f94e810db40 con 0x7f94e81067f0 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94e659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e81987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94e659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e81987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36020/0 (socket says 172.21.15.46:36020) 2024-09-21T13:04:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94e659c640 1 -- 172.21.15.46:0/1414058207 learned_addr learned my addr 172.21.15.46:0/1414058207 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94ddd9b640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e81067f0 0x7f94e8198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94e659c640 1 -- 172.21.15.46:0/1414058207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e81067f0 msgr2=0x7f94e8198d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94e659c640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e81067f0 0x7f94e8198d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.444+0000 7f94e659c640 1 -- 172.21.15.46:0/1414058207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e8199330 con 0x7f94e81007f0 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.445+0000 7f94e659c640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e81987f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f94d800d6f0 tx=0x7f94d800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.445+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94d8017070 con 0x7f94e81007f0 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.445+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f94d800de00 con 0x7f94e81007f0 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.445+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f94d8004bb0 con 0x7f94e81007f0 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.445+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94e8199620 con 0x7f94e81007f0 2024-09-21T13:04:33.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.445+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94e81a1c20 con 0x7f94e81007f0 2024-09-21T13:04:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.446+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94e8101f30 con 0x7f94e81007f0 2024-09-21T13:04:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.447+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f94d8009a30 con 0x7f94e81007f0 2024-09-21T13:04:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.447+0000 7f94dffff640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f94d407afd0 0x7f94d407d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.447+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f94d809dc10 con 0x7f94e81007f0 2024-09-21T13:04:33.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.448+0000 7f94ddd9b640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f94d407afd0 0x7f94d407d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.448+0000 7f94ddd9b640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f94d407afd0 0x7f94d407d490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94e806a7f0 tx=0x7f94d0031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:33.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.452+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f94e8199620 con 0x7f94e81007f0 2024-09-21T13:04:33.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:33 smithi046 ceph-mon[108126]: pgmap v542: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:33.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:33 smithi046 ceph-mon[108126]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:33.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:33 smithi046 ceph-mon[108126]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:33.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:33 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3830583528' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:04:33.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:33 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3905056923' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:04:33.662 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.661+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f94e8062630 con 0x7f94d407afd0 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.663+0000 7f94dffff640 1 -- 172.21.15.46:0/1414058207 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f94e8062630 con 0x7f94d407afd0 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:04:33.664 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:04:33.665 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:04:33.665 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:04:33.665 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:04:33.665 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:04:33.665 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:04:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f94d407afd0 msgr2=0x7f94d407d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f94d407afd0 0x7f94d407d490 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f94e806a7f0 tx=0x7f94d0031400 comp rx=0 tx=0).stop 2024-09-21T13:04:33.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 msgr2=0x7f94e81987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e81987f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f94d800d6f0 tx=0x7f94d800dbb0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 shutdown_connections 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f94d407afd0 0x7f94d407d490 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94e81067f0 0x7f94e8198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 --2- 172.21.15.46:0/1414058207 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f94e81007f0 0x7f94e81987f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 >> 172.21.15.46:0/1414058207 conn(0x7f94e80fc550 msgr2=0x7f94e80fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 shutdown_connections 2024-09-21T13:04:33.667 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.665+0000 7f94eccdb640 1 -- 172.21.15.46:0/1414058207 wait complete. 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 -- 172.21.15.46:0/1613481720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 msgr2=0x7f327c10b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 --2- 172.21.15.46:0/1613481720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c10b960 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f326c009880 tx=0x7f326c02a530 comp rx=0 tx=0).stop 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 -- 172.21.15.46:0/1613481720 shutdown_connections 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 --2- 172.21.15.46:0/1613481720 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c10b960 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 --2- 172.21.15.46:0/1613481720 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327c102b50 0x7f327c102f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 -- 172.21.15.46:0/1613481720 >> 172.21.15.46:0/1613481720 conn(0x7f327c0fc550 msgr2=0x7f327c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 -- 172.21.15.46:0/1613481720 shutdown_connections 2024-09-21T13:04:33.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.750+0000 7f32840ea640 1 -- 172.21.15.46:0/1613481720 wait complete. 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f32840ea640 1 Processor -- start 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f32840ea640 1 -- start start 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f32840ea640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327c102b50 0x7f327c19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f32840ea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c19fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f32840ea640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f327c10edc0 con 0x7f327c103470 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f32840ea640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f327c10ec40 con 0x7f327c102b50 2024-09-21T13:04:33.753 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281685640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c19fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281685640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c19fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36036/0 (socket says 172.21.15.46:36036) 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281685640 1 -- 172.21.15.46:0/827180088 learned_addr learned my addr 172.21.15.46:0/827180088 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281e86640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327c102b50 0x7f327c19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281685640 1 -- 172.21.15.46:0/827180088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327c102b50 msgr2=0x7f327c19f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281685640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327c102b50 0x7f327c19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.751+0000 7f3281685640 1 -- 172.21.15.46:0/827180088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f327c1a0430 con 0x7f327c103470 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.752+0000 7f3281685640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c19fd80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f326c004f90 tx=0x7f326c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.752+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f326c03f070 con 0x7f327c103470 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.752+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f326c004cf0 con 0x7f327c103470 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.752+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f327c199ac0 con 0x7f327c103470 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.752+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f326c035030 con 0x7f327c103470 2024-09-21T13:04:33.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.752+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f327c199fc0 con 0x7f327c103470 2024-09-21T13:04:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.753+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f327c06a4e0 con 0x7f327c103470 2024-09-21T13:04:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.754+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f326c042070 con 0x7f327c103470 2024-09-21T13:04:33.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.754+0000 7f3272ffd640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f326807af80 0x7f326807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:04:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.754+0000 7f3281e86640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f326807af80 0x7f326807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:04:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.754+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f326c0beb00 con 0x7f327c103470 2024-09-21T13:04:33.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.755+0000 7f3281e86640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f326807af80 0x7f326807d440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f327c19ab40 tx=0x7f3278005cc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:04:33.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:33.759+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f326c08a0d0 con 0x7f327c103470 2024-09-21T13:04:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:33 smithi176 ceph-mon[80162]: pgmap v542: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:33 smithi176 ceph-mon[80162]: from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:33 smithi176 ceph-mon[80162]: from='client.34818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:33 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3830583528' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:04:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:33 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3905056923' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:04:34.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.019+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f327c102f30 con 0x7f327c103470 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.020+0000 7f3272ffd640 1 -- 172.21.15.46:0/827180088 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f326c08ef80 con 0x7f327c103470 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:04:34.021 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f326807af80 msgr2=0x7f326807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f326807af80 0x7f326807d440 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f327c19ab40 tx=0x7f3278005cc0 comp rx=0 tx=0).stop 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 msgr2=0x7f327c19fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c19fd80 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f326c004f90 tx=0x7f326c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 shutdown_connections 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f326807af80 0x7f326807d440 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f327c103470 0x7f327c19fd80 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:34.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 --2- 172.21.15.46:0/827180088 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f327c102b50 0x7f327c19f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:04:34.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 >> 172.21.15.46:0/827180088 conn(0x7f327c0fc550 msgr2=0x7f327c100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:04:34.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 shutdown_connections 2024-09-21T13:04:34.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:04:34.022+0000 7f32840ea640 1 -- 172.21.15.46:0/827180088 wait complete. 2024-09-21T13:04:34.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:34 smithi176 ceph-mon[80162]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:34.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:34 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/827180088' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:04:34.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:34 smithi046 ceph-mon[108126]: from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:34.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:34 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/827180088' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:04:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:35 smithi176 ceph-mon[80162]: pgmap v543: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:35 smithi176 ceph-mon[80162]: from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:35.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:35 smithi046 ceph-mon[108126]: pgmap v543: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:35.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:35 smithi046 ceph-mon[108126]: from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:04:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:37 smithi176 ceph-mon[80162]: pgmap v544: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:37 smithi046 ceph-mon[108126]: pgmap v544: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:39 smithi176 ceph-mon[80162]: pgmap v545: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:39.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:39 smithi046 ceph-mon[108126]: pgmap v545: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:41 smithi176 ceph-mon[80162]: pgmap v546: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:41.882 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:41 smithi046 ceph-mon[108126]: pgmap v546: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:43 smithi176 ceph-mon[80162]: pgmap v547: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:43.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:43 smithi046 ceph-mon[108126]: pgmap v547: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:04:44.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:04:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:45 smithi176 ceph-mon[80162]: pgmap v548: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:45.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:45 smithi046 ceph-mon[108126]: pgmap v548: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:46.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:46 smithi176 ceph-mon[80162]: pgmap v549: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:46.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:46 smithi046 ceph-mon[108126]: pgmap v549: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:48.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:48 smithi046 ceph-mon[108126]: pgmap v550: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:49.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:48 smithi176 ceph-mon[80162]: pgmap v550: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:50.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:50 smithi046 ceph-mon[108126]: pgmap v551: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:51.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:50 smithi176 ceph-mon[80162]: pgmap v551: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:52.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:52 smithi046 ceph-mon[108126]: pgmap v552: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:53.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:52 smithi176 ceph-mon[80162]: pgmap v552: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:54.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:54 smithi046 ceph-mon[108126]: pgmap v553: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:55.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:54 smithi176 ceph-mon[80162]: pgmap v553: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:56.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:56 smithi046 ceph-mon[108126]: pgmap v554: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:57.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:56 smithi176 ceph-mon[80162]: pgmap v554: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:58.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:58 smithi046 ceph-mon[108126]: pgmap v555: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:59.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:58 smithi176 ceph-mon[80162]: pgmap v555: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:04:59.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:04:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:00.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:04:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:00.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:00 smithi046 ceph-mon[108126]: pgmap v556: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:01.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:00 smithi176 ceph-mon[80162]: pgmap v556: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:02.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:02 smithi046 ceph-mon[108126]: pgmap v557: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:03.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:02 smithi176 ceph-mon[80162]: pgmap v557: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 -- 172.21.15.46:0/1995705593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 msgr2=0x7f1070102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 --2- 172.21.15.46:0/1995705593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f1070102ea0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1060009880 tx=0x7f106002a530 comp rx=0 tx=0).stop 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 -- 172.21.15.46:0/1995705593 shutdown_connections 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 --2- 172.21.15.46:0/1995705593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10701033e0 0x7f107010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 --2- 172.21.15.46:0/1995705593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f1070102ea0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 -- 172.21.15.46:0/1995705593 >> 172.21.15.46:0/1995705593 conn(0x7f10700fc520 msgr2=0x7f10700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:04.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 -- 172.21.15.46:0/1995705593 shutdown_connections 2024-09-21T13:05:04.124 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 -- 172.21.15.46:0/1995705593 wait complete. 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.121+0000 7f107606a640 1 Processor -- start 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f107606a640 1 -- start start 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f107606a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f107019d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f107606a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10701033e0 0x7f107019dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f107606a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f107010edd0 con 0x7f1070102ac0 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f107606a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f107010ec50 con 0x7f10701033e0 2024-09-21T13:05:04.125 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f107019d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f107019d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35772/0 (socket says 172.21.15.46:35772) 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106f7fe640 1 -- 172.21.15.46:0/57381490 learned_addr learned my addr 172.21.15.46:0/57381490 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106effd640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10701033e0 0x7f107019dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106f7fe640 1 -- 172.21.15.46:0/57381490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10701033e0 msgr2=0x7f107019dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106f7fe640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10701033e0 0x7f107019dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.122+0000 7f106f7fe640 1 -- 172.21.15.46:0/57381490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10701978e0 con 0x7f1070102ac0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.123+0000 7f106f7fe640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f107019d720 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1060031460 tx=0x7f10600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.123+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f106003f070 con 0x7f1070102ac0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.123+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10600035f0 con 0x7f1070102ac0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.123+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1070197b70 con 0x7f1070102ac0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.123+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1060035030 con 0x7f1070102ac0 2024-09-21T13:05:04.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.123+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10701980a0 con 0x7f1070102ac0 2024-09-21T13:05:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.124+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f107006aa90 con 0x7f1070102ac0 2024-09-21T13:05:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.125+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1060042070 con 0x7f1070102ac0 2024-09-21T13:05:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.125+0000 7f106cff9640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f105807af30 0x7f105807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.127 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.126+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f10600beb70 con 0x7f1070102ac0 2024-09-21T13:05:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.126+0000 7f106effd640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f105807af30 0x7f105807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.128 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.126+0000 7f106effd640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f105807af30 0x7f105807d3f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10640058c0 tx=0x7f1064005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:04.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.130+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f106008a020 con 0x7f1070102ac0 2024-09-21T13:05:04.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.337+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1070198e10 con 0x7f105807af30 2024-09-21T13:05:04.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.338+0000 7f106cff9640 1 -- 172.21.15.46:0/57381490 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1070198e10 con 0x7f105807af30 2024-09-21T13:05:04.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f105807af30 msgr2=0x7f105807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f105807af30 0x7f105807d3f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f10640058c0 tx=0x7f1064005850 comp rx=0 tx=0).stop 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 msgr2=0x7f107019d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f107019d720 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f1060031460 tx=0x7f10600045e0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 shutdown_connections 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f105807af30 0x7f105807d3f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10701033e0 0x7f107019dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 --2- 172.21.15.46:0/57381490 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1070102ac0 0x7f107019d720 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 >> 172.21.15.46:0/57381490 conn(0x7f10700fc520 msgr2=0x7f1070108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 shutdown_connections 2024-09-21T13:05:04.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.340+0000 7f107606a640 1 -- 172.21.15.46:0/57381490 wait complete. 2024-09-21T13:05:04.351 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:05:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 -- 172.21.15.46:0/1784400026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 msgr2=0x7ff054107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 --2- 172.21.15.46:0/1784400026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff054107ce0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff050009880 tx=0x7ff05002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 -- 172.21.15.46:0/1784400026 shutdown_connections 2024-09-21T13:05:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 --2- 172.21.15.46:0/1784400026 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 0x7ff054101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 --2- 172.21.15.46:0/1784400026 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff054107ce0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 -- 172.21.15.46:0/1784400026 >> 172.21.15.46:0/1784400026 conn(0x7ff0540fd600 msgr2=0x7ff0540ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 -- 172.21.15.46:0/1784400026 shutdown_connections 2024-09-21T13:05:04.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.426+0000 7ff05b53c640 1 -- 172.21.15.46:0/1784400026 wait complete. 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff05b53c640 1 Processor -- start 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff05b53c640 1 -- start start 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff05b53c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 0x7ff05419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff05b53c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff05419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff05b53c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff05410edd0 con 0x7ff054107900 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff05b53c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff05410ec50 con 0x7ff054101900 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff058ad7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff05419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff058ad7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff05419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35796/0 (socket says 172.21.15.46:35796) 2024-09-21T13:05:04.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff058ad7640 1 -- 172.21.15.46:0/507828002 learned_addr learned my addr 172.21.15.46:0/507828002 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff0592d8640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 0x7ff05419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff058ad7640 1 -- 172.21.15.46:0/507828002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 msgr2=0x7ff05419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.427+0000 7ff058ad7640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 0x7ff05419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff058ad7640 1 -- 172.21.15.46:0/507828002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0541977c0 con 0x7ff054107900 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff0592d8640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 0x7ff05419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff058ad7640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff05419db80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c8f0 tx=0x7ff04400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff0440079b0 con 0x7ff054107900 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0440054e0 con 0x7ff054107900 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff054197ab0 con 0x7ff054107900 2024-09-21T13:05:04.431 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff044004dd0 con 0x7ff054107900 2024-09-21T13:05:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.428+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff054198040 con 0x7ff054107900 2024-09-21T13:05:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.429+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff054103040 con 0x7ff054107900 2024-09-21T13:05:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.430+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff044005020 con 0x7ff054107900 2024-09-21T13:05:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.430+0000 7ff04a7fc640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff04007aed0 0x7ff04007d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.430+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff04409e090 con 0x7ff054107900 2024-09-21T13:05:04.432 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.430+0000 7ff0592d8640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff04007aed0 0x7ff04007d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.433 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.431+0000 7ff0592d8640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff04007aed0 0x7ff04007d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff050031460 tx=0x7ff050009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:04.437 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.435+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff044014030 con 0x7ff054107900 2024-09-21T13:05:04.644 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.642+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff054198350 con 0x7ff04007aed0 2024-09-21T13:05:04.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.643+0000 7ff04a7fc640 1 -- 172.21.15.46:0/507828002 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff054198350 con 0x7ff04007aed0 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.645+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff04007aed0 msgr2=0x7ff04007d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.645+0000 7ff05b53c640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff04007aed0 0x7ff04007d390 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff050031460 tx=0x7ff050009560 comp rx=0 tx=0).stop 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.645+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 msgr2=0x7ff05419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.645+0000 7ff05b53c640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff05419db80 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ff04400c8f0 tx=0x7ff04400cdb0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 shutdown_connections 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff04007aed0 0x7ff04007d390 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff054107900 0x7ff05419db80 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 --2- 172.21.15.46:0/507828002 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff054101900 0x7ff05419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 >> 172.21.15.46:0/507828002 conn(0x7ff0540fd600 msgr2=0x7ff0540fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:04.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 shutdown_connections 2024-09-21T13:05:04.649 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.646+0000 7ff05b53c640 1 -- 172.21.15.46:0/507828002 wait complete. 2024-09-21T13:05:04.732 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.730+0000 7f212c792640 1 -- 172.21.15.46:0/1288658465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 msgr2=0x7f2124106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.730+0000 7f212c792640 1 --2- 172.21.15.46:0/1288658465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f2124106d80 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2120009880 tx=0x7f212002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.730+0000 7f212c792640 1 -- 172.21.15.46:0/1288658465 shutdown_connections 2024-09-21T13:05:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.730+0000 7f212c792640 1 --2- 172.21.15.46:0/1288658465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21240ffdc0 0x7f2124100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 --2- 172.21.15.46:0/1288658465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f2124106d80 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.733 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 -- 172.21.15.46:0/1288658465 >> 172.21.15.46:0/1288658465 conn(0x7f21240fbc90 msgr2=0x7f21240fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:04.733 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:04 smithi046 ceph-mon[108126]: pgmap v558: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:04.733 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:04 smithi046 ceph-mon[108126]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 -- 172.21.15.46:0/1288658465 shutdown_connections 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 -- 172.21.15.46:0/1288658465 wait complete. 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 Processor -- start 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 -- start start 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.731+0000 7f212c792640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21240ffdc0 0x7f2124100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f212c792640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f21241014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f212c792640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f212410ef20 con 0x7f21241069a0 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f212c792640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f212410eda0 con 0x7f21240ffdc0 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f21241014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.735 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f21241014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35804/0 (socket says 172.21.15.46:35804) 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 -- 172.21.15.46:0/2388109239 learned_addr learned my addr 172.21.15.46:0/2388109239 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f212a52e640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21240ffdc0 0x7f2124100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 -- 172.21.15.46:0/2388109239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21240ffdc0 msgr2=0x7f2124100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21240ffdc0 0x7f2124100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 -- 172.21.15.46:0/2388109239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2124101a20 con 0x7f21241069a0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f2129d2d640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f21241014e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f211400c8a0 tx=0x7f211400cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21140079b0 con 0x7f21241069a0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.732+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2124101d10 con 0x7f21241069a0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.733+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2114007b50 con 0x7f21241069a0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.733+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2114018700 con 0x7f21241069a0 2024-09-21T13:05:04.736 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.733+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21241a3eb0 con 0x7f21241069a0 2024-09-21T13:05:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.734+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21241030e0 con 0x7f21241069a0 2024-09-21T13:05:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.734+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2114007d00 con 0x7f21241069a0 2024-09-21T13:05:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.735+0000 7f211b7fe640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f211007af90 0x7f211007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.735+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f211409e250 con 0x7f21241069a0 2024-09-21T13:05:04.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.735+0000 7f212a52e640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f211007af90 0x7f211007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:04.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.736+0000 7f212a52e640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f211007af90 0x7f211007d450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2120000c00 tx=0x7f2120031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:04.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.740+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2114014030 con 0x7f21241069a0 2024-09-21T13:05:04.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.937+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f21240fcc30 con 0x7f211007af90 2024-09-21T13:05:04.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.946+0000 7f211b7fe640 1 -- 172.21.15.46:0/2388109239 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f21240fcc30 con 0x7f211007af90 2024-09-21T13:05:04.948 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (15m) 9m ago 26m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (18m) 9m ago 26m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (18m) 8m ago 25m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (13m) 9m ago 26m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (13m) 8m ago 25m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (14m) 9m ago 25m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (9m) 9m ago 20m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (9m) 9m ago 20m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (9m) 8m ago 20m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (8m) 8m ago 20m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:05:04.949 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (17m) 9m ago 27m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (16m) 8m ago 25m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (13m) 9m ago 27m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (13m) 8m ago 25m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (16m) 9m ago 26m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (16m) 8m ago 25m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (12m) 9m ago 24m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (12m) 9m ago 23m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (11m) 9m ago 23m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (11m) 8m ago 22m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (10m) 8m ago 22m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (9m) 8m ago 21m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:05:04.950 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (15m) 9m ago 25m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:05:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f211007af90 msgr2=0x7f211007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f211007af90 0x7f211007d450 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2120000c00 tx=0x7f2120031400 comp rx=0 tx=0).stop 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 msgr2=0x7f21241014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f21241014e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f211400c8a0 tx=0x7f211400cd60 comp rx=0 tx=0).stop 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 shutdown_connections 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f211007af90 0x7f211007d450 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f21241069a0 0x7f21241014e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 --2- 172.21.15.46:0/2388109239 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f21240ffdc0 0x7f2124100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 >> 172.21.15.46:0/2388109239 conn(0x7f21240fbc90 msgr2=0x7f21240fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 shutdown_connections 2024-09-21T13:05:04.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:04.949+0000 7f212c792640 1 -- 172.21.15.46:0/2388109239 wait complete. 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 -- 172.21.15.46:0/4110132996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 msgr2=0x7f9968101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 --2- 172.21.15.46:0/4110132996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f9968101d60 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f995c009880 tx=0x7f995c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 -- 172.21.15.46:0/4110132996 shutdown_connections 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 --2- 172.21.15.46:0/4110132996 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f9968101d60 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 --2- 172.21.15.46:0/4110132996 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9968107900 0x7f9968107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 -- 172.21.15.46:0/4110132996 >> 172.21.15.46:0/4110132996 conn(0x7f99680fd600 msgr2=0x7f99680ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 -- 172.21.15.46:0/4110132996 shutdown_connections 2024-09-21T13:05:05.035 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.032+0000 7f996da1b640 1 -- 172.21.15.46:0/4110132996 wait complete. 2024-09-21T13:05:05.036 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.033+0000 7f996da1b640 1 Processor -- start 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.033+0000 7f996da1b640 1 -- start start 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f996da1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f996819f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f996da1b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9968107900 0x7f996819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f996da1b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f996810edd0 con 0x7f9968101900 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f996da1b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f996810ec50 con 0x7f9968107900 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f996819f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f996819f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35834/0 (socket says 172.21.15.46:35834) 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 -- 172.21.15.46:0/4179328970 learned_addr learned my addr 172.21.15.46:0/4179328970 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f99667fc640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9968107900 0x7f996819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 -- 172.21.15.46:0/4179328970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9968107900 msgr2=0x7f996819fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9968107900 0x7f996819fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.037 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 -- 172.21.15.46:0/4179328970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9968199a10 con 0x7f9968101900 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.034+0000 7f9966ffd640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f996819f850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f995800d6f0 tx=0x7f995800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.035+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9958017070 con 0x7f9968101900 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.035+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f995800de00 con 0x7f9968101900 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.035+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9968199d00 con 0x7f9968101900 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.035+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9958004bb0 con 0x7f9968101900 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.035+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996819a260 con 0x7f9968101900 2024-09-21T13:05:05.038 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.036+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9968103040 con 0x7f9968101900 2024-09-21T13:05:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.037+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9958004e60 con 0x7f9968101900 2024-09-21T13:05:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.037+0000 7f996ca19640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f995007af30 0x7f995007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.038+0000 7f99667fc640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f995007af30 0x7f995007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.038+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f995809dcd0 con 0x7f9968101900 2024-09-21T13:05:05.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.038+0000 7f99667fc640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f995007af30 0x7f995007d3f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f996819b200 tx=0x7f995c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:05.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.042+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9958069180 con 0x7f9968101900 2024-09-21T13:05:05.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:04 smithi176 ceph-mon[80162]: pgmap v558: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:05.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:04 smithi176 ceph-mon[80162]: from='client.34842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:05.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.308+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f996819b010 con 0x7f9968101900 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.309+0000 7f996ca19640 1 -- 172.21.15.46:0/4179328970 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f995806e030 con 0x7f9968101900 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:05:05.311 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:05:05.312 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:05:05.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f995007af30 msgr2=0x7f995007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f995007af30 0x7f995007d3f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f996819b200 tx=0x7f995c031400 comp rx=0 tx=0).stop 2024-09-21T13:05:05.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 msgr2=0x7f996819f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f996819f850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f995800d6f0 tx=0x7f995800dbb0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 shutdown_connections 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f995007af30 0x7f995007d3f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9968107900 0x7f996819fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 --2- 172.21.15.46:0/4179328970 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9968101900 0x7f996819f850 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 >> 172.21.15.46:0/4179328970 conn(0x7f99680fd600 msgr2=0x7f9968074480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 shutdown_connections 2024-09-21T13:05:05.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.311+0000 7f996da1b640 1 -- 172.21.15.46:0/4179328970 wait complete. 2024-09-21T13:05:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 -- 172.21.15.46:0/1446393465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01007f0 msgr2=0x7f23b0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 --2- 172.21.15.46:0/1446393465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01007f0 0x7f23b0100c50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2398009880 tx=0x7f239802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 -- 172.21.15.46:0/1446393465 shutdown_connections 2024-09-21T13:05:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 --2- 172.21.15.46:0/1446393465 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01007f0 0x7f23b0100c50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 --2- 172.21.15.46:0/1446393465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b01067f0 0x7f23b0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 -- 172.21.15.46:0/1446393465 >> 172.21.15.46:0/1446393465 conn(0x7f23b00fc550 msgr2=0x7f23b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 -- 172.21.15.46:0/1446393465 shutdown_connections 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 -- 172.21.15.46:0/1446393465 wait complete. 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 Processor -- start 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.397+0000 7f23b592d640 1 -- start start 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23b592d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b01007f0 0x7f23b00fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23b592d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 0x7f23b00fd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23b592d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f23b010dcc0 con 0x7f23b01067f0 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23b592d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f23b010db40 con 0x7f23b01007f0 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 0x7f23b00fd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 0x7f23b00fd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35846/0 (socket says 172.21.15.46:35846) 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 -- 172.21.15.46:0/778380476 learned_addr learned my addr 172.21.15.46:0/778380476 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23aeffd640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b01007f0 0x7f23b00fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 -- 172.21.15.46:0/778380476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b01007f0 msgr2=0x7f23b00fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b01007f0 0x7f23b00fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 -- 172.21.15.46:0/778380476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b00fd750 con 0x7f23b01067f0 2024-09-21T13:05:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.398+0000 7f23a7fff640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 0x7f23b00fd210 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2398031460 tx=0x7f2398004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.399+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f239803f070 con 0x7f23b01067f0 2024-09-21T13:05:05.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.399+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b00fd9e0 con 0x7f23b01067f0 2024-09-21T13:05:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.399+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2398004a90 con 0x7f23b01067f0 2024-09-21T13:05:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.399+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2398035030 con 0x7f23b01067f0 2024-09-21T13:05:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.399+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b01a3da0 con 0x7f23b01067f0 2024-09-21T13:05:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.400+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b0101f30 con 0x7f23b01067f0 2024-09-21T13:05:05.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.401+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2398042070 con 0x7f23b01067f0 2024-09-21T13:05:05.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.401+0000 7f23b492b640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f239c07af40 0x7f239c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.401+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f23980beb00 con 0x7f23b01067f0 2024-09-21T13:05:05.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.401+0000 7f23aeffd640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f239c07af40 0x7f239c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.402+0000 7f23aeffd640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f239c07af40 0x7f239c07d400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009bd0 tx=0x7f23a0005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:05.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.406+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f239808a050 con 0x7f23b01067f0 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.667+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f23b0109d70 con 0x7f23b01067f0 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.668+0000 7f23b492b640 1 -- 172.21.15.46:0/778380476 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f239808ef00 con 0x7f23b01067f0 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:05:05.670 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:05:05.671 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:05:05.672 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:05.673 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f239c07af40 msgr2=0x7f239c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f239c07af40 0x7f239c07d400 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f23a0009bd0 tx=0x7f23a0005f90 comp rx=0 tx=0).stop 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 msgr2=0x7f23b00fd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 0x7f23b00fd210 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2398031460 tx=0x7f2398004530 comp rx=0 tx=0).stop 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 shutdown_connections 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f239c07af40 0x7f239c07d400 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f23b01067f0 0x7f23b00fd210 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 --2- 172.21.15.46:0/778380476 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f23b01007f0 0x7f23b00fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 >> 172.21.15.46:0/778380476 conn(0x7f23b00fc550 msgr2=0x7f23b0069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 shutdown_connections 2024-09-21T13:05:05.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.670+0000 7f23b592d640 1 -- 172.21.15.46:0/778380476 wait complete. 2024-09-21T13:05:05.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 -- 172.21.15.46:0/2229924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 msgr2=0x7f8cf010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 --2- 172.21.15.46:0/2229924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf010b8d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0009880 tx=0x7f8ce002a530 comp rx=0 tx=0).stop 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 -- 172.21.15.46:0/2229924809 shutdown_connections 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 --2- 172.21.15.46:0/2229924809 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf010b8d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 --2- 172.21.15.46:0/2229924809 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf0102ac0 0x7f8cf0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 -- 172.21.15.46:0/2229924809 >> 172.21.15.46:0/2229924809 conn(0x7f8cf00fc520 msgr2=0x7f8cf00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 -- 172.21.15.46:0/2229924809 shutdown_connections 2024-09-21T13:05:05.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.756+0000 7f8cf727d640 1 -- 172.21.15.46:0/2229924809 wait complete. 2024-09-21T13:05:05.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf727d640 1 Processor -- start 2024-09-21T13:05:05.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf727d640 1 -- start start 2024-09-21T13:05:05.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf727d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf0102ac0 0x7f8cf019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf727d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf727d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf010edf0 con 0x7f8cf01033e0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf727d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf010ec70 con 0x7f8cf0102ac0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf4818640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf4818640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35858/0 (socket says 172.21.15.46:35858) 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf4818640 1 -- 172.21.15.46:0/3142808792 learned_addr learned my addr 172.21.15.46:0/3142808792 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.757+0000 7f8cf5019640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf0102ac0 0x7f8cf019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8cf4818640 1 -- 172.21.15.46:0/3142808792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf0102ac0 msgr2=0x7f8cf019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8cf4818640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf0102ac0 0x7f8cf019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8cf4818640 1 -- 172.21.15.46:0/3142808792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf0197820 con 0x7f8cf01033e0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8cf4818640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf019dbe0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0031460 tx=0x7f8ce00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ce003f070 con 0x7f8cf01033e0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8ce0004ac0 con 0x7f8cf01033e0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8ce0035030 con 0x7f8cf01033e0 2024-09-21T13:05:05.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf0197ab0 con 0x7f8cf01033e0 2024-09-21T13:05:05.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.758+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf0197fe0 con 0x7f8cf01033e0 2024-09-21T13:05:05.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.759+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf006aa90 con 0x7f8cf01033e0 2024-09-21T13:05:05.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.760+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8ce0042070 con 0x7f8cf01033e0 2024-09-21T13:05:05.762 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.760+0000 7f8ce67fc640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8cdc07af80 0x7f8cdc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:05.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.761+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8ce00bea00 con 0x7f8cf01033e0 2024-09-21T13:05:05.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.761+0000 7f8cf5019640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8cdc07af80 0x7f8cdc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:05.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.761+0000 7f8cf5019640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8cdc07af80 0x7f8cdc07d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0058c0 tx=0x7f8cec00a250 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:05.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.765+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ce0089f30 con 0x7f8cf01033e0 2024-09-21T13:05:05.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:05 smithi046 ceph-mon[108126]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:05.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:05 smithi046 ceph-mon[108126]: from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:05.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:05 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4179328970' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:05:05.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.974+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8cf0198290 con 0x7f8cdc07af80 2024-09-21T13:05:05.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.975+0000 7f8ce67fc640 1 -- 172.21.15.46:0/3142808792 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8cf0198290 con 0x7f8cdc07af80 2024-09-21T13:05:05.977 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:05:05.977 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:05:05.977 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:05:05.978 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8cdc07af80 msgr2=0x7f8cdc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8cdc07af80 0x7f8cdc07d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8cec0058c0 tx=0x7f8cec00a250 comp rx=0 tx=0).stop 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 msgr2=0x7f8cf019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf019dbe0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0031460 tx=0x7f8ce00046c0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 shutdown_connections 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8cdc07af80 0x7f8cdc07d440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8cf01033e0 0x7f8cf019dbe0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 --2- 172.21.15.46:0/3142808792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8cf0102ac0 0x7f8cf019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.977+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 >> 172.21.15.46:0/3142808792 conn(0x7f8cf00fc520 msgr2=0x7f8cf0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.978+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 shutdown_connections 2024-09-21T13:05:05.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:05.978+0000 7f8cf727d640 1 -- 172.21.15.46:0/3142808792 wait complete. 2024-09-21T13:05:06.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 -- 172.21.15.46:0/3857553865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 msgr2=0x7f1e0c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:06.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 --2- 172.21.15.46:0/3857553865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c106bd0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009880 tx=0x7f1dfc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 -- 172.21.15.46:0/3857553865 shutdown_connections 2024-09-21T13:05:06.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 --2- 172.21.15.46:0/3857553865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e0c1007f0 0x7f1e0c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.064 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 --2- 172.21.15.46:0/3857553865 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c106bd0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 -- 172.21.15.46:0/3857553865 >> 172.21.15.46:0/3857553865 conn(0x7f1e0c0fc550 msgr2=0x7f1e0c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:06.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 -- 172.21.15.46:0/3857553865 shutdown_connections 2024-09-21T13:05:06.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 -- 172.21.15.46:0/3857553865 wait complete. 2024-09-21T13:05:06.065 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.062+0000 7f1e11862640 1 Processor -- start 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e11862640 1 -- start start 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e11862640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e0c1007f0 0x7f1e0c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e11862640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e11862640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c10dd20 con 0x7f1e0c1067f0 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e11862640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c10dba0 con 0x7f1e0c1007f0 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:35878/0 (socket says 172.21.15.46:35878) 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 -- 172.21.15.46:0/2058009937 learned_addr learned my addr 172.21.15.46:0/2058009937 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:06.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0affd640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e0c1007f0 0x7f1e0c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 -- 172.21.15.46:0/2058009937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e0c1007f0 msgr2=0x7f1e0c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e0c1007f0 0x7f1e0c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 -- 172.21.15.46:0/2058009937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c197800 con 0x7f1e0c1067f0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.063+0000 7f1e0a7fc640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c19dbc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000b420 tx=0x7f1e0000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.064+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e00011630 con 0x7f1e0c1067f0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.064+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1e00016070 con 0x7f1e0c1067f0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.064+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1e00010d40 con 0x7f1e0c1067f0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.064+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c197af0 con 0x7f1e0c1067f0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.064+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c198080 con 0x7f1e0c1067f0 2024-09-21T13:05:06.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.065+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0c101f30 con 0x7f1e0c1067f0 2024-09-21T13:05:06.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:05 smithi176 ceph-mon[80162]: from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:06.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:05 smithi176 ceph-mon[80162]: from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:06.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:05 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4179328970' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:05:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.066+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1e0001b460 con 0x7f1e0c1067f0 2024-09-21T13:05:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.066+0000 7f1e10860640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1df407af30 0x7f1df407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:06.069 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.066+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1e0009d7f0 con 0x7f1e0c1067f0 2024-09-21T13:05:06.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.066+0000 7f1e0affd640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1df407af30 0x7f1df407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:06.070 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.067+0000 7f1e0affd640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1df407af30 0x7f1df407d3f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0096c0 tx=0x7f1dfc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:06.072 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.071+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e00021250 con 0x7f1e0c1067f0 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.336+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1e0c109d70 con 0x7f1e0c1067f0 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.337+0000 7f1e10860640 1 -- 172.21.15.46:0/2058009937 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f1e00068d40 con 0x7f1e0c1067f0 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:05:06.339 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:05:06.340 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:05:06.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1df407af30 msgr2=0x7f1df407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:06.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1df407af30 0x7f1df407d3f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0096c0 tx=0x7f1dfc031400 comp rx=0 tx=0).stop 2024-09-21T13:05:06.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 msgr2=0x7f1e0c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c19dbc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1e0000b420 tx=0x7f1e0000b8e0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 shutdown_connections 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1df407af30 0x7f1df407d3f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1e0c1067f0 0x7f1e0c19dbc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 --2- 172.21.15.46:0/2058009937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e0c1007f0 0x7f1e0c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 >> 172.21.15.46:0/2058009937 conn(0x7f1e0c0fc550 msgr2=0x7f1e0c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 shutdown_connections 2024-09-21T13:05:06.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:06.340+0000 7f1e11862640 1 -- 172.21.15.46:0/2058009937 wait complete. 2024-09-21T13:05:06.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:06 smithi046 ceph-mon[108126]: pgmap v559: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:06.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:06 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/778380476' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:05:06.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:06 smithi046 ceph-mon[108126]: from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:06.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:06 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2058009937' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:05:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:06 smithi176 ceph-mon[80162]: pgmap v559: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:06 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/778380476' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:05:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:06 smithi176 ceph-mon[80162]: from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:07.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:06 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2058009937' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:05:08.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:08 smithi046 ceph-mon[108126]: pgmap v560: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:09.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:08 smithi176 ceph-mon[80162]: pgmap v560: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:10.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:10 smithi176 ceph-mon[80162]: pgmap v561: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:10.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:10 smithi046 ceph-mon[108126]: pgmap v561: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:12.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:12 smithi046 ceph-mon[108126]: pgmap v562: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:13.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:12 smithi176 ceph-mon[80162]: pgmap v562: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:14 smithi176 ceph-mon[80162]: pgmap v563: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:15.119 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:14 smithi046 ceph-mon[108126]: pgmap v563: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:17.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:16 smithi176 ceph-mon[80162]: pgmap v564: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:17.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:16 smithi046 ceph-mon[108126]: pgmap v564: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:19.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:18 smithi176 ceph-mon[80162]: pgmap v565: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:19.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:18 smithi046 ceph-mon[108126]: pgmap v565: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:20.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:20 smithi046 ceph-mon[108126]: pgmap v566: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:21.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:20 smithi176 ceph-mon[80162]: pgmap v566: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:23.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:22 smithi176 ceph-mon[80162]: pgmap v567: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:23.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:22 smithi046 ceph-mon[108126]: pgmap v567: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:25.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:24 smithi176 ceph-mon[80162]: pgmap v568: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:25.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:24 smithi046 ceph-mon[108126]: pgmap v568: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:27.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:26 smithi046 ceph-mon[108126]: pgmap v569: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:27.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:26 smithi176 ceph-mon[80162]: pgmap v569: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:29.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:28 smithi176 ceph-mon[80162]: pgmap v570: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:29.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:28 smithi046 ceph-mon[108126]: pgmap v570: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:30.112 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:31.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:30 smithi176 ceph-mon[80162]: pgmap v571: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:31.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:30 smithi046 ceph-mon[108126]: pgmap v571: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:33.117 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:32 smithi046 ceph-mon[108126]: pgmap v572: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:32 smithi176 ceph-mon[80162]: pgmap v572: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:35.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:34 smithi046 ceph-mon[108126]: pgmap v573: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:34 smithi176 ceph-mon[80162]: pgmap v573: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:36.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 -- 172.21.15.46:0/1388972899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2670102b80 msgr2=0x7f2670102f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 --2- 172.21.15.46:0/1388972899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2670102b80 0x7f2670102f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2660009880 tx=0x7f266002a530 comp rx=0 tx=0).stop 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 -- 172.21.15.46:0/1388972899 shutdown_connections 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 --2- 172.21.15.46:0/1388972899 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f26701034a0 0x7f267010b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 --2- 172.21.15.46:0/1388972899 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2670102b80 0x7f2670102f60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 -- 172.21.15.46:0/1388972899 >> 172.21.15.46:0/1388972899 conn(0x7f26700fc520 msgr2=0x7f26700fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 -- 172.21.15.46:0/1388972899 shutdown_connections 2024-09-21T13:05:36.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.440+0000 7f2675e12640 1 -- 172.21.15.46:0/1388972899 wait complete. 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.441+0000 7f2675e12640 1 Processor -- start 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.441+0000 7f2675e12640 1 -- start start 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2675e12640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670102b80 0x7f26701007e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2675e12640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 0x7f2670100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2675e12640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f267010edf0 con 0x7f26701034a0 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2675e12640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f267010ec70 con 0x7f2670102b80 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 0x7f2670100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 0x7f2670100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49050/0 (socket says 172.21.15.46:49050) 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 -- 172.21.15.46:0/1366797951 learned_addr learned my addr 172.21.15.46:0/1366797951 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f266f7fe640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670102b80 0x7f26701007e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 -- 172.21.15.46:0/1366797951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670102b80 msgr2=0x7f26701007e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670102b80 0x7f26701007e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 -- 172.21.15.46:0/1366797951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2670101260 con 0x7f26701034a0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.442+0000 7f2666ffd640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 0x7f2670100d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f265800d6f0 tx=0x7f265800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.443+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2658017070 con 0x7f26701034a0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.443+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2670101550 con 0x7f26701034a0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.443+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f265800de00 con 0x7f26701034a0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.443+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2658004bb0 con 0x7f26701034a0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.443+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26701a3e80 con 0x7f26701034a0 2024-09-21T13:05:36.445 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.444+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f267006a9d0 con 0x7f26701034a0 2024-09-21T13:05:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.445+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2658004e60 con 0x7f26701034a0 2024-09-21T13:05:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.445+0000 7f266d7fa640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f265c07af40 0x7f265c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.445+0000 7f266f7fe640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f265c07af40 0x7f265c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:36.446 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.445+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f265809dc30 con 0x7f26701034a0 2024-09-21T13:05:36.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.446+0000 7f266f7fe640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f265c07af40 0x7f265c07d400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f26600096c0 tx=0x7f2660004f30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:36.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.450+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2658069180 con 0x7f26701034a0 2024-09-21T13:05:36.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.656+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2670062630 con 0x7f265c07af40 2024-09-21T13:05:36.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.657+0000 7f266d7fa640 1 -- 172.21.15.46:0/1366797951 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2670062630 con 0x7f265c07af40 2024-09-21T13:05:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f265c07af40 msgr2=0x7f265c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.660 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f265c07af40 0x7f265c07d400 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f26600096c0 tx=0x7f2660004f30 comp rx=0 tx=0).stop 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 msgr2=0x7f2670100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 0x7f2670100d20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f265800d6f0 tx=0x7f265800dbb0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 shutdown_connections 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f265c07af40 0x7f265c07d400 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f26701034a0 0x7f2670100d20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 --2- 172.21.15.46:0/1366797951 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670102b80 0x7f26701007e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 >> 172.21.15.46:0/1366797951 conn(0x7f26700fc520 msgr2=0x7f2670108fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.659+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 shutdown_connections 2024-09-21T13:05:36.661 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.660+0000 7f2675e12640 1 -- 172.21.15.46:0/1366797951 wait complete. 2024-09-21T13:05:36.669 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:05:36.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 -- 172.21.15.46:0/2198040930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 msgr2=0x7f3890106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 --2- 172.21.15.46:0/2198040930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890106be0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3884009880 tx=0x7f388402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 -- 172.21.15.46:0/2198040930 shutdown_connections 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 --2- 172.21.15.46:0/2198040930 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 0x7f3890100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 --2- 172.21.15.46:0/2198040930 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890106be0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 -- 172.21.15.46:0/2198040930 >> 172.21.15.46:0/2198040930 conn(0x7f38900fc520 msgr2=0x7f38900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 -- 172.21.15.46:0/2198040930 shutdown_connections 2024-09-21T13:05:36.747 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.745+0000 7f38971db640 1 -- 172.21.15.46:0/2198040930 wait complete. 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f38971db640 1 Processor -- start 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f38971db640 1 -- start start 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f38971db640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 0x7f38901987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f38971db640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890198ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f38971db640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f389010dcb0 con 0x7f3890106800 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f38971db640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f389010db30 con 0x7f3890100800 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.746+0000 7f388ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890198ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890198ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49074/0 (socket says 172.21.15.46:49074) 2024-09-21T13:05:36.749 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388ffff640 1 -- 172.21.15.46:0/3911175944 learned_addr learned my addr 172.21.15.46:0/3911175944 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f3894f77640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 0x7f38901987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388ffff640 1 -- 172.21.15.46:0/3911175944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 msgr2=0x7f38901987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388ffff640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 0x7f38901987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388ffff640 1 -- 172.21.15.46:0/3911175944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38901992a0 con 0x7f3890106800 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f3894f77640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 0x7f38901987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388ffff640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890198ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c8a0 tx=0x7f387c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f387c0079b0 con 0x7f3890106800 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3890199590 con 0x7f3890106800 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f387c007b50 con 0x7f3890106800 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.747+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f387c018700 con 0x7f3890106800 2024-09-21T13:05:36.750 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.748+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38901a1b80 con 0x7f3890106800 2024-09-21T13:05:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.749+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3890101f40 con 0x7f3890106800 2024-09-21T13:05:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.750+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f387c007d00 con 0x7f3890106800 2024-09-21T13:05:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.750+0000 7f388dffb640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f388007af30 0x7f388007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:36.751 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.750+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f387c09e420 con 0x7f3890106800 2024-09-21T13:05:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.750+0000 7f3894f77640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f388007af30 0x7f388007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:36.752 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.751+0000 7f3894f77640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f388007af30 0x7f388007d3f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3884031460 tx=0x7f3884009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:36.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.756+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f387c014030 con 0x7f3890106800 2024-09-21T13:05:36.964 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.963+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3890062630 con 0x7f388007af30 2024-09-21T13:05:36.965 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.964+0000 7f388dffb640 1 -- 172.21.15.46:0/3911175944 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3890062630 con 0x7f388007af30 2024-09-21T13:05:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f388007af30 msgr2=0x7f388007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f388007af30 0x7f388007d3f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3884031460 tx=0x7f3884009560 comp rx=0 tx=0).stop 2024-09-21T13:05:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 msgr2=0x7f3890198ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890198ce0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f387c00c8a0 tx=0x7f387c00cd60 comp rx=0 tx=0).stop 2024-09-21T13:05:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 shutdown_connections 2024-09-21T13:05:36.967 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f388007af30 0x7f388007d3f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3890106800 0x7f3890198ce0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 --2- 172.21.15.46:0/3911175944 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3890100800 0x7f38901987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 >> 172.21.15.46:0/3911175944 conn(0x7f38900fc520 msgr2=0x7f38900fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 shutdown_connections 2024-09-21T13:05:36.968 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:36.966+0000 7f38971db640 1 -- 172.21.15.46:0/3911175944 wait complete. 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.050+0000 7f699dc35640 1 -- 172.21.15.46:0/3608442421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 msgr2=0x7f6998103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.050+0000 7f699dc35640 1 --2- 172.21.15.46:0/3608442421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f6998103f60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f698c009880 tx=0x7f698c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 -- 172.21.15.46:0/3608442421 shutdown_connections 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 --2- 172.21.15.46:0/3608442421 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f6998103f60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 --2- 172.21.15.46:0/3608442421 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6998109b90 0x7f6998109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 -- 172.21.15.46:0/3608442421 >> 172.21.15.46:0/3608442421 conn(0x7f69980ff800 msgr2=0x7f6998101c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:37.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 -- 172.21.15.46:0/3608442421 shutdown_connections 2024-09-21T13:05:37.053 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:36 smithi046 ceph-mon[108126]: pgmap v574: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 -- 172.21.15.46:0/3608442421 wait complete. 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.051+0000 7f699dc35640 1 Processor -- start 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f699dc35640 1 -- start start 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f699dc35640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f699819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f699dc35640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6998109b90 0x7f699819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f699dc35640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6998110fd0 con 0x7f6998103b00 2024-09-21T13:05:37.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f699dc35640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6998110e50 con 0x7f6998109b90 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f69977fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f699819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f69977fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f699819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49094/0 (socket says 172.21.15.46:49094) 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f69977fe640 1 -- 172.21.15.46:0/2259680176 learned_addr learned my addr 172.21.15.46:0/2259680176 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f6996ffd640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6998109b90 0x7f699819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f69977fe640 1 -- 172.21.15.46:0/2259680176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6998109b90 msgr2=0x7f699819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f69977fe640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6998109b90 0x7f699819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.052+0000 7f69977fe640 1 -- 172.21.15.46:0/2259680176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6998199a00 con 0x7f6998103b00 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.053+0000 7f69977fe640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f699819f840 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f698800ea00 tx=0x7f698800eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.053+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f698800cb80 con 0x7f6998103b00 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.053+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f698800cd20 con 0x7f6998103b00 2024-09-21T13:05:37.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.053+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6998199cf0 con 0x7f6998103b00 2024-09-21T13:05:37.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.053+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6988011470 con 0x7f6998103b00 2024-09-21T13:05:37.056 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.053+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f699819a250 con 0x7f6998103b00 2024-09-21T13:05:37.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.055+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6988005020 con 0x7f6998103b00 2024-09-21T13:05:37.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.055+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6998105200 con 0x7f6998103b00 2024-09-21T13:05:37.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.055+0000 7f6994ff9640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f698007af30 0x7f698007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.055+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f698809e4c0 con 0x7f6998103b00 2024-09-21T13:05:37.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.055+0000 7f6996ffd640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f698007af30 0x7f698007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.057 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.056+0000 7f6996ffd640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f698007af30 0x7f698007d3f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f699819b1f0 tx=0x7f698c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:37.060 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.060+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6988016030 con 0x7f6998103b00 2024-09-21T13:05:37.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.255+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f699819af30 con 0x7f698007af30 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.265+0000 7f6994ff9640 1 -- 172.21.15.46:0/2259680176 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f699819af30 con 0x7f698007af30 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (15m) 9m ago 26m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (19m) 9m ago 26m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (18m) 9m ago 25m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (13m) 9m ago 26m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (13m) 9m ago 25m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:05:37.266 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (15m) 9m ago 26m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (10m) 9m ago 21m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (9m) 9m ago 21m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (9m) 9m ago 21m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (9m) 9m ago 21m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (18m) 9m ago 28m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (17m) 9m ago 25m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (14m) 9m ago 28m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (14m) 9m ago 25m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (16m) 9m ago 26m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (16m) 9m ago 25m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (13m) 9m ago 24m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (12m) 9m ago 24m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (12m) 9m ago 23m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (11m) 9m ago 23m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:05:37.267 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (11m) 9m ago 22m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:05:37.268 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (10m) 9m ago 22m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:05:37.268 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (16m) 9m ago 26m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:05:37.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f698007af30 msgr2=0x7f698007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f698007af30 0x7f698007d3f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f699819b1f0 tx=0x7f698c031400 comp rx=0 tx=0).stop 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 msgr2=0x7f699819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f699819f840 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f698800ea00 tx=0x7f698800eec0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 shutdown_connections 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f698007af30 0x7f698007d3f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6998109b90 0x7f699819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 --2- 172.21.15.46:0/2259680176 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6998103b00 0x7f699819f840 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 >> 172.21.15.46:0/2259680176 conn(0x7f69980ff800 msgr2=0x7f6998100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 shutdown_connections 2024-09-21T13:05:37.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.267+0000 7f699dc35640 1 -- 172.21.15.46:0/2259680176 wait complete. 2024-09-21T13:05:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:36 smithi176 ceph-mon[80162]: pgmap v574: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.350+0000 7f07e724e640 1 -- 172.21.15.46:0/2325803967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e01069a0 msgr2=0x7f07e0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.350+0000 7f07e724e640 1 --2- 172.21.15.46:0/2325803967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e01069a0 0x7f07e0106d80 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009880 tx=0x7f07d002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.350+0000 7f07e724e640 1 -- 172.21.15.46:0/2325803967 shutdown_connections 2024-09-21T13:05:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.350+0000 7f07e724e640 1 --2- 172.21.15.46:0/2325803967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07e00ffdc0 0x7f07e0100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.350+0000 7f07e724e640 1 --2- 172.21.15.46:0/2325803967 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e01069a0 0x7f07e0106d80 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.350+0000 7f07e724e640 1 -- 172.21.15.46:0/2325803967 >> 172.21.15.46:0/2325803967 conn(0x7f07e00fbc90 msgr2=0x7f07e00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 -- 172.21.15.46:0/2325803967 shutdown_connections 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 -- 172.21.15.46:0/2325803967 wait complete. 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 Processor -- start 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 -- start start 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 0x7f07e019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07e01069a0 0x7f07e019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f07e010ef20 con 0x7f07e00ffdc0 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.351+0000 7f07e724e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f07e010eda0 con 0x7f07e01069a0 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 0x7f07e019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 0x7f07e019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49106/0 (socket says 172.21.15.46:49106) 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 -- 172.21.15.46:0/3346389781 learned_addr learned my addr 172.21.15.46:0/3346389781 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:37.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07dffff640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07e01069a0 0x7f07e019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 -- 172.21.15.46:0/3346389781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07e01069a0 msgr2=0x7f07e019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07e01069a0 0x7f07e019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 -- 172.21.15.46:0/3346389781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07e0197890 con 0x7f07e00ffdc0 2024-09-21T13:05:37.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e4fea640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 0x7f07e019d6d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f07d0031460 tx=0x7f07d00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07d003f070 con 0x7f07e00ffdc0 2024-09-21T13:05:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07d0004b10 con 0x7f07e00ffdc0 2024-09-21T13:05:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07e0197b20 con 0x7f07e00ffdc0 2024-09-21T13:05:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.352+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07d0035030 con 0x7f07e00ffdc0 2024-09-21T13:05:37.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.353+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07e0198050 con 0x7f07e00ffdc0 2024-09-21T13:05:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.354+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07e01030e0 con 0x7f07e00ffdc0 2024-09-21T13:05:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.354+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f07d0042070 con 0x7f07e00ffdc0 2024-09-21T13:05:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.355+0000 7f07ddffb640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f07cc07af90 0x7f07cc07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.355+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f07d00bebe0 con 0x7f07e00ffdc0 2024-09-21T13:05:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.355+0000 7f07dffff640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f07cc07af90 0x7f07cc07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.356+0000 7f07dffff640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f07cc07af90 0x7f07cc07d450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f07c8005fd0 tx=0x7f07c8005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:37.360 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.359+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f07d008a1b0 con 0x7f07e00ffdc0 2024-09-21T13:05:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.624+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f07e0198dc0 con 0x7f07e00ffdc0 2024-09-21T13:05:37.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.624+0000 7f07ddffb640 1 -- 172.21.15.46:0/3346389781 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f07d008f060 con 0x7f07e00ffdc0 2024-09-21T13:05:37.625 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:05:37.626 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:05:37.627 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:05:37.627 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:05:37.627 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:05:37.627 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f07cc07af90 msgr2=0x7f07cc07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f07cc07af90 0x7f07cc07d450 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f07c8005fd0 tx=0x7f07c8005850 comp rx=0 tx=0).stop 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 msgr2=0x7f07e019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 0x7f07e019d6d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f07d0031460 tx=0x7f07d00045e0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 shutdown_connections 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f07cc07af90 0x7f07cc07d450 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f07e01069a0 0x7f07e019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 --2- 172.21.15.46:0/3346389781 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f07e00ffdc0 0x7f07e019d6d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.628 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 >> 172.21.15.46:0/3346389781 conn(0x7f07e00fbc90 msgr2=0x7f07e00fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 shutdown_connections 2024-09-21T13:05:37.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.627+0000 7f07e724e640 1 -- 172.21.15.46:0/3346389781 wait complete. 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 -- 172.21.15.46:0/3270943682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34101000 msgr2=0x7f3e3410dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/3270943682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34101000 0x7f3e3410dcc0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f3e28009880 tx=0x7f3e2802a490 comp rx=0 tx=0).stop 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 -- 172.21.15.46:0/3270943682 shutdown_connections 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/3270943682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34101000 0x7f3e3410dcc0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/3270943682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34100650 0x7f3e34100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 -- 172.21.15.46:0/3270943682 >> 172.21.15.46:0/3270943682 conn(0x7f3e340fc520 msgr2=0x7f3e340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 -- 172.21.15.46:0/3270943682 shutdown_connections 2024-09-21T13:05:37.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.711+0000 7f3e3bed8640 1 -- 172.21.15.46:0/3270943682 wait complete. 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.712+0000 7f3e3bed8640 1 Processor -- start 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.712+0000 7f3e3bed8640 1 -- start start 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.712+0000 7f3e3bed8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 0x7f3e3419f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.712+0000 7f3e3bed8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34101000 0x7f3e3419fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.712+0000 7f3e3bed8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3e34110f90 con 0x7f3e34100650 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.712+0000 7f3e3bed8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3e34110e10 con 0x7f3e34101000 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 0x7f3e3419f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 0x7f3e3419f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48862/0 (socket says 172.21.15.46:48862) 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 -- 172.21.15.46:0/2855056604 learned_addr learned my addr 172.21.15.46:0/2855056604 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39473640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34101000 0x7f3e3419fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 -- 172.21.15.46:0/2855056604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34101000 msgr2=0x7f3e3419fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34101000 0x7f3e3419fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 -- 172.21.15.46:0/2855056604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e34199a20 con 0x7f3e34100650 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e39c74640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 0x7f3e3419f860 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c8f0 tx=0x7f3e3000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e300079b0 con 0x7f3e34100650 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e300054e0 con 0x7f3e34100650 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e30004dd0 con 0x7f3e34100650 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e34199d10 con 0x7f3e34100650 2024-09-21T13:05:37.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.713+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3419a270 con 0x7f3e34100650 2024-09-21T13:05:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.714+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3406aa90 con 0x7f3e34100650 2024-09-21T13:05:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.715+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3e30005020 con 0x7f3e34100650 2024-09-21T13:05:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.716+0000 7f3e26ffd640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3e2007af30 0x7f3e2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.716+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3e3009df40 con 0x7f3e34100650 2024-09-21T13:05:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.716+0000 7f3e39473640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3e2007af30 0x7f3e2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:37.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.716+0000 7f3e39473640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3e2007af30 0x7f3e2007d3f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3e3419b210 tx=0x7f3e28031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:37.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.720+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e30014030 con 0x7f3e34100650 2024-09-21T13:05:37.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:37 smithi046 ceph-mon[108126]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:37.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:37 smithi046 ceph-mon[108126]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:37.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:37 smithi046 ceph-mon[108126]: from='client.34878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:37.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:37 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3346389781' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:05:37.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.948+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f3e3419af50 con 0x7f3e34100650 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.949+0000 7f3e26ffd640 1 -- 172.21.15.46:0/2855056604 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f3e30069470 con 0x7f3e34100650 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:05:37.950 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:05:37.951 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:05:37.952 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:37.953 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3e2007af30 msgr2=0x7f3e2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3e2007af30 0x7f3e2007d3f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3e3419b210 tx=0x7f3e28031400 comp rx=0 tx=0).stop 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 msgr2=0x7f3e3419f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 0x7f3e3419f860 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c8f0 tx=0x7f3e3000cdb0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 shutdown_connections 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3e2007af30 0x7f3e2007d3f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e34101000 0x7f3e3419fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 --2- 172.21.15.46:0/2855056604 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3e34100650 0x7f3e3419f860 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.951+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 >> 172.21.15.46:0/2855056604 conn(0x7f3e340fc520 msgr2=0x7f3e340fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.952+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 shutdown_connections 2024-09-21T13:05:37.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:37.952+0000 7f3e3bed8640 1 -- 172.21.15.46:0/2855056604 wait complete. 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2423310813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 msgr2=0x7ff254106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2423310813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff254106be0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff250009880 tx=0x7ff25002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2423310813 shutdown_connections 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2423310813 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff254100800 0x7ff254100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2423310813 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff254106be0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2423310813 >> 172.21.15.46:0/2423310813 conn(0x7ff2540fc520 msgr2=0x7ff2540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:38.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2423310813 shutdown_connections 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2423310813 wait complete. 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 Processor -- start 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.037+0000 7ff25b6cb640 1 -- start start 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff25b6cb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff254100800 0x7ff2540fcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff25b6cb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff2540fd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff25b6cb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff25410dcd0 con 0x7ff254106800 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff25b6cb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff25410db50 con 0x7ff254100800 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff2540fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff2540fd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48880/0 (socket says 172.21.15.46:48880) 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 -- 172.21.15.46:0/2843084467 learned_addr learned my addr 172.21.15.46:0/2843084467 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff259467640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff254100800 0x7ff2540fcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:38.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 -- 172.21.15.46:0/2843084467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff254100800 msgr2=0x7ff2540fcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff254100800 0x7ff2540fcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 -- 172.21.15.46:0/2843084467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2540fd680 con 0x7ff254106800 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.038+0000 7ff258c66640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff2540fd140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff24400d6f0 tx=0x7ff24400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.039+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff244017070 con 0x7ff254106800 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.039+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2540fd970 con 0x7ff254106800 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.039+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff24400de00 con 0x7ff254106800 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.039+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff244004bb0 con 0x7ff254106800 2024-09-21T13:05:38.042 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.039+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2541a3e60 con 0x7ff254106800 2024-09-21T13:05:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.040+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254101f40 con 0x7ff254106800 2024-09-21T13:05:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.040+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff244004e60 con 0x7ff254106800 2024-09-21T13:05:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.041+0000 7ff24a7fc640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff24007af40 0x7ff24007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.041+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff24409dce0 con 0x7ff254106800 2024-09-21T13:05:38.043 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.041+0000 7ff259467640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff24007af40 0x7ff24007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:38.044 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.042+0000 7ff259467640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff24007af40 0x7ff24007d400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff250031460 tx=0x7ff2500095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:38.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.045+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff244069230 con 0x7ff254106800 2024-09-21T13:05:38.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.250+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff254062630 con 0x7ff24007af40 2024-09-21T13:05:38.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.251+0000 7ff24a7fc640 1 -- 172.21.15.46:0/2843084467 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7ff254062630 con 0x7ff24007af40 2024-09-21T13:05:38.252 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:05:38.253 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.254+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff24007af40 msgr2=0x7ff24007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.254+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff24007af40 0x7ff24007d400 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff250031460 tx=0x7ff2500095c0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.254+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 msgr2=0x7ff2540fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.254+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff2540fd140 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff24400d6f0 tx=0x7ff24400dbb0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 shutdown_connections 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff24007af40 0x7ff24007d400 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff254106800 0x7ff2540fd140 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.256 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 --2- 172.21.15.46:0/2843084467 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff254100800 0x7ff2540fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 >> 172.21.15.46:0/2843084467 conn(0x7ff2540fc520 msgr2=0x7ff25406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:38.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 shutdown_connections 2024-09-21T13:05:38.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.255+0000 7ff25b6cb640 1 -- 172.21.15.46:0/2843084467 wait complete. 2024-09-21T13:05:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:37 smithi176 ceph-mon[80162]: from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:37 smithi176 ceph-mon[80162]: from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:37 smithi176 ceph-mon[80162]: from='client.34878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:37 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3346389781' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:05:38.341 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.340+0000 7fea746d4640 1 -- 172.21.15.46:0/1470983814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102b60 msgr2=0x7fea6c102f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.340+0000 7fea746d4640 1 --2- 172.21.15.46:0/1470983814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102b60 0x7fea6c102f40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fea68009880 tx=0x7fea6802a530 comp rx=0 tx=0).stop 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.340+0000 7fea746d4640 1 -- 172.21.15.46:0/1470983814 shutdown_connections 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.340+0000 7fea746d4640 1 --2- 172.21.15.46:0/1470983814 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6c103480 0x7fea6c10b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.340+0000 7fea746d4640 1 --2- 172.21.15.46:0/1470983814 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c102b60 0x7fea6c102f40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.340+0000 7fea746d4640 1 -- 172.21.15.46:0/1470983814 >> 172.21.15.46:0/1470983814 conn(0x7fea6c0fc520 msgr2=0x7fea6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 -- 172.21.15.46:0/1470983814 shutdown_connections 2024-09-21T13:05:38.342 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 -- 172.21.15.46:0/1470983814 wait complete. 2024-09-21T13:05:38.343 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 Processor -- start 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 -- start start 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6c102b60 0x7fea6c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 0x7fea6c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c10edf0 con 0x7fea6c103480 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.341+0000 7fea746d4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fea6c10ec70 con 0x7fea6c102b60 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 0x7fea6c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 0x7fea6c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48898/0 (socket says 172.21.15.46:48898) 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 -- 172.21.15.46:0/2453874417 learned_addr learned my addr 172.21.15.46:0/2453874417 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea72470640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6c102b60 0x7fea6c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 -- 172.21.15.46:0/2453874417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6c102b60 msgr2=0x7fea6c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6c102b60 0x7fea6c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 -- 172.21.15.46:0/2453874417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c197800 con 0x7fea6c103480 2024-09-21T13:05:38.344 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea71c6f640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 0x7fea6c19dbc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00d6f0 tx=0x7fea5c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea5c017070 con 0x7fea6c103480 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea5c00de00 con 0x7fea6c103480 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c197af0 con 0x7fea6c103480 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea5c004bb0 con 0x7fea6c103480 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.342+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6c198080 con 0x7fea6c103480 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.343+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea6c06a9f0 con 0x7fea6c103480 2024-09-21T13:05:38.345 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.344+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fea5c009a30 con 0x7fea6c103480 2024-09-21T13:05:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.344+0000 7fea637fe640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fea5807af90 0x7fea5807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:05:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.345+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fea5c09dc20 con 0x7fea6c103480 2024-09-21T13:05:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.345+0000 7fea72470640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fea5807af90 0x7fea5807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:05:38.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.345+0000 7fea72470640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fea5807af90 0x7fea5807d450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea68004f90 tx=0x7fea680095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:05:38.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.349+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea5c0691f0 con 0x7fea6c103480 2024-09-21T13:05:38.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.610+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fea6c106030 con 0x7fea6c103480 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.610+0000 7fea637fe640 1 -- 172.21.15.46:0/2453874417 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fea5c06e0a0 con 0x7fea6c103480 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:05:38.612 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fea5807af90 msgr2=0x7fea5807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fea5807af90 0x7fea5807d450 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fea68004f90 tx=0x7fea680095c0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 msgr2=0x7fea6c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 0x7fea6c19dbc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fea5c00d6f0 tx=0x7fea5c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 shutdown_connections 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fea5807af90 0x7fea5807d450 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fea6c103480 0x7fea6c19dbc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 --2- 172.21.15.46:0/2453874417 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fea6c102b60 0x7fea6c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:05:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 >> 172.21.15.46:0/2453874417 conn(0x7fea6c0fc520 msgr2=0x7fea6c103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:05:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 shutdown_connections 2024-09-21T13:05:38.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:05:38.613+0000 7fea746d4640 1 -- 172.21.15.46:0/2453874417 wait complete. 2024-09-21T13:05:38.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:38 smithi046 ceph-mon[108126]: pgmap v575: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:38.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:38 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2855056604' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:05:38.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:38 smithi046 ceph-mon[108126]: from='client.34890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:38.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:38 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2453874417' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:05:39.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:38 smithi176 ceph-mon[80162]: pgmap v575: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:39.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:38 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2855056604' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:05:39.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:38 smithi176 ceph-mon[80162]: from='client.34890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:05:39.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:38 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2453874417' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:05:41.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:40 smithi046 ceph-mon[108126]: pgmap v576: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:40 smithi176 ceph-mon[80162]: pgmap v576: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:42 smithi046 ceph-mon[108126]: pgmap v577: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:42 smithi176 ceph-mon[80162]: pgmap v577: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:45.119 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:44 smithi046 ceph-mon[108126]: pgmap v578: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:45.119 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:44 smithi176 ceph-mon[80162]: pgmap v578: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:05:47.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:46 smithi046 ceph-mon[108126]: pgmap v579: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:46 smithi176 ceph-mon[80162]: pgmap v579: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:49.118 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:48 smithi176 ceph-mon[80162]: pgmap v580: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:49.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:48 smithi046 ceph-mon[108126]: pgmap v580: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:51.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:50 smithi046 ceph-mon[108126]: pgmap v581: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:50 smithi176 ceph-mon[80162]: pgmap v581: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:53.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:52 smithi046 ceph-mon[108126]: pgmap v582: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:52 smithi176 ceph-mon[80162]: pgmap v582: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:55.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:54 smithi046 ceph-mon[108126]: pgmap v583: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:55.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:54 smithi176 ceph-mon[80162]: pgmap v583: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:57.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:56 smithi046 ceph-mon[108126]: pgmap v584: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:56 smithi176 ceph-mon[80162]: pgmap v584: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:59.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:58 smithi046 ceph-mon[108126]: pgmap v585: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:05:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:58 smithi176 ceph-mon[80162]: pgmap v585: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:00.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:05:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:05:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:01.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:00 smithi046 ceph-mon[108126]: pgmap v586: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:01.228 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:00 smithi176 ceph-mon[80162]: pgmap v586: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:03.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:02 smithi046 ceph-mon[108126]: pgmap v587: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:02 smithi176 ceph-mon[80162]: pgmap v587: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:05.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:04 smithi046 ceph-mon[108126]: pgmap v588: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:05.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:04 smithi176 ceph-mon[80162]: pgmap v588: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:07.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:06 smithi046 ceph-mon[108126]: pgmap v589: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:06 smithi176 ceph-mon[80162]: pgmap v589: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.711+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/895260115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64102ac0 msgr2=0x7f4d64102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:08.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.711+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/895260115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64102ac0 0x7f4d64102ea0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009880 tx=0x7f4d6002a530 comp rx=0 tx=0).stop 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/895260115 shutdown_connections 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/895260115 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d641033e0 0x7f4d6410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/895260115 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d64102ac0 0x7f4d64102ea0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/895260115 >> 172.21.15.46:0/895260115 conn(0x7f4d640fc520 msgr2=0x7f4d640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/895260115 shutdown_connections 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/895260115 wait complete. 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 Processor -- start 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.712+0000 7f4d6c6bd640 1 -- start start 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d6c6bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d64102ac0 0x7f4d6419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d6c6bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 0x7f4d6419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d6c6bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6410edf0 con 0x7f4d641033e0 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d6c6bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6410ec70 con 0x7f4d64102ac0 2024-09-21T13:06:08.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 0x7f4d6419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 0x7f4d6419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51444/0 (socket says 172.21.15.46:51444) 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 -- 172.21.15.46:0/2334066219 learned_addr learned my addr 172.21.15.46:0/2334066219 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d6a459640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d64102ac0 0x7f4d6419f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 -- 172.21.15.46:0/2334066219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d64102ac0 msgr2=0x7f4d6419f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d64102ac0 0x7f4d6419f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 -- 172.21.15.46:0/2334066219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d64199a10 con 0x7f4d641033e0 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d6a459640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d64102ac0 0x7f4d6419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:06:08.716 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.713+0000 7f4d69c58640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 0x7f4d6419fd40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400d6d0 tx=0x7f4d5400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.714+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d54017070 con 0x7f4d641033e0 2024-09-21T13:06:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.714+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d64199d00 con 0x7f4d641033e0 2024-09-21T13:06:08.717 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.714+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d540054e0 con 0x7f4d641033e0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.714+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d54004ae0 con 0x7f4d641033e0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.714+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d6419a290 con 0x7f4d641033e0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.715+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d6406aa90 con 0x7f4d641033e0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.716+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4d54004de0 con 0x7f4d641033e0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.716+0000 7f4d5b7fe640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d5007af30 0x7f4d5007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.716+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4d5409dca0 con 0x7f4d641033e0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.716+0000 7f4d6a459640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d5007af30 0x7f4d5007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:08.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.717+0000 7f4d6a459640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d5007af30 0x7f4d5007d3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000c00 tx=0x7f4d60031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:08.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.721+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d540a2070 con 0x7f4d641033e0 2024-09-21T13:06:08.930 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.929+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4d6419aef0 con 0x7f4d5007af30 2024-09-21T13:06:08.931 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.930+0000 7f4d5b7fe640 1 -- 172.21.15.46:0/2334066219 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4d6419aef0 con 0x7f4d5007af30 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d5007af30 msgr2=0x7f4d5007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d5007af30 0x7f4d5007d3f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4d60000c00 tx=0x7f4d60031420 comp rx=0 tx=0).stop 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 msgr2=0x7f4d6419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 0x7f4d6419fd40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4d5400d6d0 tx=0x7f4d5400db90 comp rx=0 tx=0).stop 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 shutdown_connections 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4d5007af30 0x7f4d5007d3f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:08.934 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4d641033e0 0x7f4d6419fd40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 --2- 172.21.15.46:0/2334066219 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4d64102ac0 0x7f4d6419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 >> 172.21.15.46:0/2334066219 conn(0x7f4d640fc520 msgr2=0x7f4d64100b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 shutdown_connections 2024-09-21T13:06:08.935 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:08.933+0000 7f4d6c6bd640 1 -- 172.21.15.46:0/2334066219 wait complete. 2024-09-21T13:06:08.942 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:06:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 -- 172.21.15.46:0/284554593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd0102b90 msgr2=0x7efdd0102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 --2- 172.21.15.46:0/284554593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd0102b90 0x7efdd0102f70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009880 tx=0x7efdc002a530 comp rx=0 tx=0).stop 2024-09-21T13:06:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 -- 172.21.15.46:0/284554593 shutdown_connections 2024-09-21T13:06:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 --2- 172.21.15.46:0/284554593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd01034b0 0x7efdd010b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 --2- 172.21.15.46:0/284554593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd0102b90 0x7efdd0102f70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 -- 172.21.15.46:0/284554593 >> 172.21.15.46:0/284554593 conn(0x7efdd00fc510 msgr2=0x7efdd00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:08 smithi046 ceph-mon[108126]: pgmap v590: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:09.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 -- 172.21.15.46:0/284554593 shutdown_connections 2024-09-21T13:06:09.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.018+0000 7efdd5166640 1 -- 172.21.15.46:0/284554593 wait complete. 2024-09-21T13:06:09.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdd5166640 1 Processor -- start 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdd5166640 1 -- start start 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdd5166640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd0102b90 0x7efdd01007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdd5166640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 0x7efdd0100d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdd5166640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efdd010ee00 con 0x7efdd01034b0 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdd5166640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efdd010ec80 con 0x7efdd0102b90 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdc7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 0x7efdd0100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdc7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 0x7efdd0100d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51472/0 (socket says 172.21.15.46:51472) 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdc7fff640 1 -- 172.21.15.46:0/2416764464 learned_addr learned my addr 172.21.15.46:0/2416764464 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdced9d640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd0102b90 0x7efdd01007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdc7fff640 1 -- 172.21.15.46:0/2416764464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd0102b90 msgr2=0x7efdd01007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdc7fff640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd0102b90 0x7efdd01007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.019+0000 7efdc7fff640 1 -- 172.21.15.46:0/2416764464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd0101270 con 0x7efdd01034b0 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.020+0000 7efdc7fff640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 0x7efdd0100d30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efdb800d6f0 tx=0x7efdb800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.020+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb8017070 con 0x7efdd01034b0 2024-09-21T13:06:09.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.020+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efdb800de00 con 0x7efdd01034b0 2024-09-21T13:06:09.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.020+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd0101560 con 0x7efdd01034b0 2024-09-21T13:06:09.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.020+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efdb8004bb0 con 0x7efdd01034b0 2024-09-21T13:06:09.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.020+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd01a3e70 con 0x7efdd01034b0 2024-09-21T13:06:09.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.021+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd006ace0 con 0x7efdd01034b0 2024-09-21T13:06:09.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.022+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efdb8004e60 con 0x7efdd01034b0 2024-09-21T13:06:09.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.022+0000 7efdccd99640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efdbc07af30 0x7efdbc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.022+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efdb809dc30 con 0x7efdd01034b0 2024-09-21T13:06:09.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.023+0000 7efdced9d640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efdbc07af30 0x7efdbc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.024 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.023+0000 7efdced9d640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efdbc07af30 0x7efdbc07d3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdc00096c0 tx=0x7efdc0004f30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.028 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.027+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efdb8069180 con 0x7efdd01034b0 2024-09-21T13:06:09.232 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.231+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efdd0062630 con 0x7efdbc07af30 2024-09-21T13:06:09.233 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.232+0000 7efdccd99640 1 -- 172.21.15.46:0/2416764464 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7efdd0062630 con 0x7efdbc07af30 2024-09-21T13:06:09.235 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efdbc07af30 msgr2=0x7efdbc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efdbc07af30 0x7efdbc07d3f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdc00096c0 tx=0x7efdc0004f30 comp rx=0 tx=0).stop 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 msgr2=0x7efdd0100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 0x7efdd0100d30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7efdb800d6f0 tx=0x7efdb800dbb0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 shutdown_connections 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efdbc07af30 0x7efdbc07d3f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efdd01034b0 0x7efdd0100d30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 --2- 172.21.15.46:0/2416764464 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efdd0102b90 0x7efdd01007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 >> 172.21.15.46:0/2416764464 conn(0x7efdd00fc510 msgr2=0x7efdd0107ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 shutdown_connections 2024-09-21T13:06:09.236 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.234+0000 7efdd5166640 1 -- 172.21.15.46:0/2416764464 wait complete. 2024-09-21T13:06:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:08 smithi176 ceph-mon[80162]: pgmap v590: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 -- 172.21.15.46:0/3530005846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4106800 msgr2=0x7efeb4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 --2- 172.21.15.46:0/3530005846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4106800 0x7efeb4106be0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efea4009880 tx=0x7efea402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 -- 172.21.15.46:0/3530005846 shutdown_connections 2024-09-21T13:06:09.320 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 --2- 172.21.15.46:0/3530005846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb4100800 0x7efeb4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 --2- 172.21.15.46:0/3530005846 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4106800 0x7efeb4106be0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 -- 172.21.15.46:0/3530005846 >> 172.21.15.46:0/3530005846 conn(0x7efeb40fc520 msgr2=0x7efeb40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 -- 172.21.15.46:0/3530005846 shutdown_connections 2024-09-21T13:06:09.321 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.319+0000 7efeb9a21640 1 -- 172.21.15.46:0/3530005846 wait complete. 2024-09-21T13:06:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb9a21640 1 Processor -- start 2024-09-21T13:06:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb9a21640 1 -- start start 2024-09-21T13:06:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb9a21640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 0x7efeb40fcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb9a21640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb4106800 0x7efeb40fd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.322 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb9a21640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efeb410dcd0 con 0x7efeb4100800 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb9a21640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efeb410db50 con 0x7efeb4106800 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 0x7efeb40fcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 0x7efeb40fcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51486/0 (socket says 172.21.15.46:51486) 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb2ffd640 1 -- 172.21.15.46:0/752402855 learned_addr learned my addr 172.21.15.46:0/752402855 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.320+0000 7efeb27fc640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb4106800 0x7efeb40fd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb2ffd640 1 -- 172.21.15.46:0/752402855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb4106800 msgr2=0x7efeb40fd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb2ffd640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb4106800 0x7efeb40fd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb2ffd640 1 -- 172.21.15.46:0/752402855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb40fd6f0 con 0x7efeb4100800 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb2ffd640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 0x7efeb40fcc70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efea4031460 tx=0x7efea4004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efea403f070 con 0x7efeb4100800 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efea40035f0 con 0x7efeb4100800 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb40fd980 con 0x7efeb4100800 2024-09-21T13:06:09.323 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efea4035030 con 0x7efeb4100800 2024-09-21T13:06:09.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.321+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb41a3d60 con 0x7efeb4100800 2024-09-21T13:06:09.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.322+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb4101f40 con 0x7efeb4100800 2024-09-21T13:06:09.324 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.324+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efea4042070 con 0x7efeb4100800 2024-09-21T13:06:09.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.324+0000 7efeb8a1f640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efe9c07af80 0x7efe9c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.324+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efea40be8e0 con 0x7efeb4100800 2024-09-21T13:06:09.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.324+0000 7efeb27fc640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efe9c07af80 0x7efe9c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.325+0000 7efeb27fc640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efe9c07af80 0x7efe9c07d440 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efeb40fe700 tx=0x7efea8005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.329+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efea4089eb0 con 0x7efeb4100800 2024-09-21T13:06:09.525 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.524+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7efeb4062630 con 0x7efe9c07af80 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.534+0000 7efeb8a1f640 1 -- 172.21.15.46:0/752402855 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7efeb4062630 con 0x7efe9c07af80 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (16m) 10m ago 27m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (19m) 10m ago 27m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (19m) 9m ago 26m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (14m) 10m ago 27m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:06:09.535 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (14m) 9m ago 26m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (15m) 10m ago 26m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (10m) 10m ago 21m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (10m) 10m ago 21m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (10m) 9m ago 21m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (9m) 9m ago 21m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (18m) 10m ago 28m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (17m) 9m ago 26m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (14m) 10m ago 28m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (14m) 9m ago 26m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (17m) 10m ago 27m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (17m) 9m ago 26m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (14m) 10m ago 25m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:06:09.536 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (13m) 10m ago 24m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:06:09.537 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (12m) 10m ago 24m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:06:09.537 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (12m) 9m ago 23m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:06:09.537 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (11m) 9m ago 23m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:06:09.537 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (11m) 9m ago 22m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:06:09.537 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (16m) 10m ago 26m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:06:09.537 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efe9c07af80 msgr2=0x7efe9c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efe9c07af80 0x7efe9c07d440 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efeb40fe700 tx=0x7efea8005f90 comp rx=0 tx=0).stop 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 msgr2=0x7efeb40fcc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 0x7efeb40fcc70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efea4031460 tx=0x7efea4004530 comp rx=0 tx=0).stop 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 shutdown_connections 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efe9c07af80 0x7efe9c07d440 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efeb4106800 0x7efeb40fd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 --2- 172.21.15.46:0/752402855 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efeb4100800 0x7efeb40fcc70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.536+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 >> 172.21.15.46:0/752402855 conn(0x7efeb40fc520 msgr2=0x7efeb406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.537+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 shutdown_connections 2024-09-21T13:06:09.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.537+0000 7efeb9a21640 1 -- 172.21.15.46:0/752402855 wait complete. 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 -- 172.21.15.46:0/688259840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac01069a0 msgr2=0x7f2ac0106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/688259840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac01069a0 0x7f2ac0106d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0009880 tx=0x7f2ab002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 -- 172.21.15.46:0/688259840 shutdown_connections 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/688259840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac0100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/688259840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac01069a0 0x7f2ac0106d80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 -- 172.21.15.46:0/688259840 >> 172.21.15.46:0/688259840 conn(0x7f2ac00fbc90 msgr2=0x7f2ac00fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 -- 172.21.15.46:0/688259840 shutdown_connections 2024-09-21T13:06:09.622 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.620+0000 7f2ac5b51640 1 -- 172.21.15.46:0/688259840 wait complete. 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.621+0000 7f2ac5b51640 1 Processor -- start 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.621+0000 7f2ac5b51640 1 -- start start 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2ac5b51640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2ac5b51640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ac01069a0 0x7f2ac019dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2ac5b51640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac010ef20 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2ac5b51640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2ac010eda0 con 0x7f2ac01069a0 2024-09-21T13:06:09.624 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51502/0 (socket says 172.21.15.46:51502) 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 -- 172.21.15.46:0/2913392540 learned_addr learned my addr 172.21.15.46:0/2913392540 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abeffd640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ac01069a0 0x7f2ac019dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 -- 172.21.15.46:0/2913392540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ac01069a0 msgr2=0x7f2ac019dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ac01069a0 0x7f2ac019dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 -- 172.21.15.46:0/2913392540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac0197890 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.622+0000 7f2abf7fe640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac019d6d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0031460 tx=0x7f2ab00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.623+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ab003f070 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.623+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ab00035f0 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.623+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ab0035030 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.623+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac0197b20 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.625 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.623+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac0198050 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.624+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ac01030e0 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.625+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2ab0042070 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.625+0000 7f2abcff9640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2aa807af80 0x7f2aa807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.625+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2ab00be9c0 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.626 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.625+0000 7f2abeffd640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2aa807af80 0x7f2aa807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.627 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.626+0000 7f2abeffd640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2aa807af80 0x7f2aa807d440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4005d00 tx=0x7f2ab4005c50 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.630 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.630+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ab0089f90 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.892+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f2ac0198dc0 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.893+0000 7f2abcff9640 1 -- 172.21.15.46:0/2913392540 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f2ab008ee40 con 0x7f2ac00ffdc0 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:06:09.894 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:06:09.895 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:06:09.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2aa807af80 msgr2=0x7f2aa807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2aa807af80 0x7f2aa807d440 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ab4005d00 tx=0x7f2ab4005c50 comp rx=0 tx=0).stop 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 msgr2=0x7f2ac019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac019d6d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ab0031460 tx=0x7f2ab00045e0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 shutdown_connections 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2aa807af80 0x7f2aa807d440 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2ac01069a0 0x7f2ac019dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 --2- 172.21.15.46:0/2913392540 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2ac00ffdc0 0x7f2ac019d6d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 >> 172.21.15.46:0/2913392540 conn(0x7f2ac00fbc90 msgr2=0x7f2ac00fc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 shutdown_connections 2024-09-21T13:06:09.897 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.895+0000 7f2ac5b51640 1 -- 172.21.15.46:0/2913392540 wait complete. 2024-09-21T13:06:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.979+0000 7f798d35a640 1 -- 172.21.15.46:0/4171251617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 msgr2=0x7f7988100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.979+0000 7f798d35a640 1 --2- 172.21.15.46:0/4171251617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f7988100c50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f797c009880 tx=0x7f797c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 -- 172.21.15.46:0/4171251617 shutdown_connections 2024-09-21T13:06:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 --2- 172.21.15.46:0/4171251617 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f7988100c50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 --2- 172.21.15.46:0/4171251617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881067f0 0x7f7988106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 -- 172.21.15.46:0/4171251617 >> 172.21.15.46:0/4171251617 conn(0x7f79880fc550 msgr2=0x7f79880fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:09.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 -- 172.21.15.46:0/4171251617 shutdown_connections 2024-09-21T13:06:09.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 -- 172.21.15.46:0/4171251617 wait complete. 2024-09-21T13:06:09.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.980+0000 7f798d35a640 1 Processor -- start 2024-09-21T13:06:09.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f798d35a640 1 -- start start 2024-09-21T13:06:09.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f798d35a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f79881987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f798d35a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881067f0 0x7f7988198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f798d35a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f798810dca0 con 0x7f79881007f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f798d35a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f798810db20 con 0x7f79881067f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f79881987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f79881987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51532/0 (socket says 172.21.15.46:51532) 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 -- 172.21.15.46:0/1617103236 learned_addr learned my addr 172.21.15.46:0/1617103236 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f79867fc640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881067f0 0x7f7988198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 -- 172.21.15.46:0/1617103236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881067f0 msgr2=0x7f7988198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881067f0 0x7f7988198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 -- 172.21.15.46:0/1617103236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79881992f0 con 0x7f79881007f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.981+0000 7f7986ffd640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f79881987b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f797800d8d0 tx=0x7f797800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.982+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7978017070 con 0x7f79881007f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.982+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7978010460 con 0x7f79881007f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.982+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79881995e0 con 0x7f79881007f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.982+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f797800f5f0 con 0x7f79881007f0 2024-09-21T13:06:09.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.982+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79881a1be0 con 0x7f79881007f0 2024-09-21T13:06:09.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.983+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7988101f30 con 0x7f79881007f0 2024-09-21T13:06:09.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.984+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7978009a30 con 0x7f79881007f0 2024-09-21T13:06:09.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.984+0000 7f796ffff640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f797007af80 0x7f797007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:09.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.985+0000 7f79867fc640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f797007af80 0x7f797007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:09.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.985+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f797809dea0 con 0x7f79881007f0 2024-09-21T13:06:09.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.985+0000 7f79867fc640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f797007af80 0x7f797007d440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f798806a7f0 tx=0x7f797c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:09.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:09.989+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79881995e0 con 0x7f79881007f0 2024-09-21T13:06:10.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:09 smithi046 ceph-mon[108126]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:10.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:09 smithi046 ceph-mon[108126]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:10.215 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.214+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f79881a1e90 con 0x7f79881007f0 2024-09-21T13:06:10.216 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.215+0000 7f796ffff640 1 -- 172.21.15.46:0/1617103236 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f7978069470 con 0x7f79881007f0 2024-09-21T13:06:10.216 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:06:10.216 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:06:10.216 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:06:10.216 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:06:10.216 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:06:10.217 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:06:10.218 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:10.219 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:10.220 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:10.220 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:06:10.220 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f797007af80 msgr2=0x7f797007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f797007af80 0x7f797007d440 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f798806a7f0 tx=0x7f797c031400 comp rx=0 tx=0).stop 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 msgr2=0x7f79881987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f79881987b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f797800d8d0 tx=0x7f797800dd90 comp rx=0 tx=0).stop 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 shutdown_connections 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f797007af80 0x7f797007d440 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79881067f0 0x7f7988198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 --2- 172.21.15.46:0/1617103236 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f79881007f0 0x7f79881987b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 >> 172.21.15.46:0/1617103236 conn(0x7f79880fc550 msgr2=0x7f79880fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 shutdown_connections 2024-09-21T13:06:10.221 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.218+0000 7f798d35a640 1 -- 172.21.15.46:0/1617103236 wait complete. 2024-09-21T13:06:10.305 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.303+0000 7fe150eba640 1 -- 172.21.15.46:0/1026911929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c102ac0 msgr2=0x7fe14c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.306 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.303+0000 7fe150eba640 1 --2- 172.21.15.46:0/1026911929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c102ac0 0x7fe14c102ea0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe13c009880 tx=0x7fe13c02a530 comp rx=0 tx=0).stop 2024-09-21T13:06:10.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.303+0000 7fe150eba640 1 -- 172.21.15.46:0/1026911929 shutdown_connections 2024-09-21T13:06:10.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.303+0000 7fe150eba640 1 --2- 172.21.15.46:0/1026911929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c1033e0 0x7fe14c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.303+0000 7fe150eba640 1 --2- 172.21.15.46:0/1026911929 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c102ac0 0x7fe14c102ea0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.303+0000 7fe150eba640 1 -- 172.21.15.46:0/1026911929 >> 172.21.15.46:0/1026911929 conn(0x7fe14c0fc520 msgr2=0x7fe14c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:10.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.304+0000 7fe150eba640 1 -- 172.21.15.46:0/1026911929 shutdown_connections 2024-09-21T13:06:10.307 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.304+0000 7fe150eba640 1 -- 172.21.15.46:0/1026911929 wait complete. 2024-09-21T13:06:10.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.304+0000 7fe150eba640 1 Processor -- start 2024-09-21T13:06:10.309 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.304+0000 7fe150eba640 1 -- start start 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe150eba640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c102ac0 0x7fe14c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe150eba640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 0x7fe14c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe150eba640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10edf0 con 0x7fe14c1033e0 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe150eba640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe14c10ec70 con 0x7fe14c102ac0 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 0x7fe14c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 0x7fe14c19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51554/0 (socket says 172.21.15.46:51554) 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 -- 172.21.15.46:0/2472310502 learned_addr learned my addr 172.21.15.46:0/2472310502 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe14a59c640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c102ac0 0x7fe14c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 -- 172.21.15.46:0/2472310502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c102ac0 msgr2=0x7fe14c19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c102ac0 0x7fe14c19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 -- 172.21.15.46:0/2472310502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14c1977c0 con 0x7fe14c1033e0 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe14a59c640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c102ac0 0x7fe14c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:06:10.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe149d9b640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 0x7fe14c19db80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe14000e970 tx=0x7fe14000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe14000cac0 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14c197ab0 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe1400054e0 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.305+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe140004dd0 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.306+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe14c198040 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.307+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14c06aa90 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.307+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe140005020 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.308+0000 7fe13b7fe640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe13407aed0 0x7fe13407d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.308+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe14009e7b0 con 0x7fe14c1033e0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.308+0000 7fe14a59c640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe13407aed0 0x7fe13407d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:10.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.308+0000 7fe14a59c640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe13407aed0 0x7fe13407d390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000c00 tx=0x7fe13c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:10.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.312+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe140069d00 con 0x7fe14c1033e0 2024-09-21T13:06:10.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:09 smithi176 ceph-mon[80162]: from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:10.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:09 smithi176 ceph-mon[80162]: from='client.34902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:10.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.518+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe14c198350 con 0x7fe13407aed0 2024-09-21T13:06:10.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.519+0000 7fe13b7fe640 1 -- 172.21.15.46:0/2472310502 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fe14c198350 con 0x7fe13407aed0 2024-09-21T13:06:10.520 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:06:10.520 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:06:10.520 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:06:10.520 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:06:10.520 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:06:10.521 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:06:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe13407aed0 msgr2=0x7fe13407d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.522 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe13407aed0 0x7fe13407d390 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fe13c000c00 tx=0x7fe13c031400 comp rx=0 tx=0).stop 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 msgr2=0x7fe14c19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 0x7fe14c19db80 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fe14000e970 tx=0x7fe14000ee30 comp rx=0 tx=0).stop 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 shutdown_connections 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe13407aed0 0x7fe13407d390 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe14c1033e0 0x7fe14c19db80 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 --2- 172.21.15.46:0/2472310502 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe14c102ac0 0x7fe14c19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 >> 172.21.15.46:0/2472310502 conn(0x7fe14c0fc520 msgr2=0x7fe14c10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.521+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 shutdown_connections 2024-09-21T13:06:10.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.522+0000 7fe150eba640 1 -- 172.21.15.46:0/2472310502 wait complete. 2024-09-21T13:06:10.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 -- 172.21.15.46:0/3265799626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 msgr2=0x7f62e0109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/3265799626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e0109fc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f62dc009880 tx=0x7f62dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 -- 172.21.15.46:0/3265799626 shutdown_connections 2024-09-21T13:06:10.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/3265799626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 0x7f62e0103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.607 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/3265799626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e0109fc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 -- 172.21.15.46:0/3265799626 >> 172.21.15.46:0/3265799626 conn(0x7f62e00ff810 msgr2=0x7f62e0101c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:10.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 -- 172.21.15.46:0/3265799626 shutdown_connections 2024-09-21T13:06:10.608 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.606+0000 7f62e6c5b640 1 -- 172.21.15.46:0/3265799626 wait complete. 2024-09-21T13:06:10.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e6c5b640 1 Processor -- start 2024-09-21T13:06:10.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e6c5b640 1 -- start start 2024-09-21T13:06:10.609 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e6c5b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 0x7f62e019f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e6c5b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e019fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e6c5b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0111050 con 0x7f62e0109be0 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e6c5b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f62e0110ed0 con 0x7f62e0103b30 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e019fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62d7fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e019fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:51560/0 (socket says 172.21.15.46:51560) 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62d7fff640 1 -- 172.21.15.46:0/2875291119 learned_addr learned my addr 172.21.15.46:0/2875291119 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e49f7640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 0x7f62e019f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62d7fff640 1 -- 172.21.15.46:0/2875291119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 msgr2=0x7f62e019f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62d7fff640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 0x7f62e019f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62d7fff640 1 -- 172.21.15.46:0/2875291119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e01999c0 con 0x7f62e0109be0 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.607+0000 7f62e49f7640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 0x7f62e019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:06:10.610 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.608+0000 7f62d7fff640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e019fd40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b420 tx=0x7f62d000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:10.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.608+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62d0011630 con 0x7f62e0109be0 2024-09-21T13:06:10.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.608+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f62d0016070 con 0x7f62e0109be0 2024-09-21T13:06:10.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.608+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e0199cb0 con 0x7f62e0109be0 2024-09-21T13:06:10.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.608+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f62d0010d40 con 0x7f62e0109be0 2024-09-21T13:06:10.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.608+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e019a2c0 con 0x7f62e0109be0 2024-09-21T13:06:10.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.609+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e01051e0 con 0x7f62e0109be0 2024-09-21T13:06:10.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.610+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f62d001b460 con 0x7f62e0109be0 2024-09-21T13:06:10.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.610+0000 7f62d5ffb640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f62c807af80 0x7f62c807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:10.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.610+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f62d009d7a0 con 0x7f62e0109be0 2024-09-21T13:06:10.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.610+0000 7f62e49f7640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f62c807af80 0x7f62c807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:10.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.611+0000 7f62e49f7640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f62c807af80 0x7f62c807d440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000c00 tx=0x7f62dc004f50 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:10.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.615+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62d0021250 con 0x7f62e0109be0 2024-09-21T13:06:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.880+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f62e019aef0 con 0x7f62e0109be0 2024-09-21T13:06:10.881 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.880+0000 7f62d5ffb640 1 -- 172.21.15.46:0/2875291119 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f62d0068d70 con 0x7f62e0109be0 2024-09-21T13:06:10.881 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:06:10.882 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:06:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:06:10.882 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:06:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:06:10.882 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:06:10.882 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f62c807af80 msgr2=0x7f62c807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f62c807af80 0x7f62c807d440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f62dc000c00 tx=0x7f62dc004f50 comp rx=0 tx=0).stop 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 msgr2=0x7f62e019fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e019fd40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f62d000b420 tx=0x7f62d000b8e0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 shutdown_connections 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f62c807af80 0x7f62c807d440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f62e0109be0 0x7f62e019fd40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 --2- 172.21.15.46:0/2875291119 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f62e0103b30 0x7f62e019f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.882+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 >> 172.21.15.46:0/2875291119 conn(0x7f62e00ff810 msgr2=0x7f62e0101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.883+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 shutdown_connections 2024-09-21T13:06:10.884 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:10.883+0000 7f62e6c5b640 1 -- 172.21.15.46:0/2875291119 wait complete. 2024-09-21T13:06:11.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:10 smithi046 ceph-mon[108126]: from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:11.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:10 smithi046 ceph-mon[108126]: pgmap v591: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:10 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2913392540' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:06:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:10 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1617103236' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:06:11.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:10 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2875291119' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:06:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:10 smithi176 ceph-mon[80162]: from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:10 smithi176 ceph-mon[80162]: pgmap v591: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:10 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2913392540' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:06:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:10 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1617103236' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:06:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:10 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2875291119' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:06:12.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:11 smithi046 ceph-mon[108126]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:12.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:11 smithi176 ceph-mon[80162]: from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:13.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:12 smithi046 ceph-mon[108126]: pgmap v592: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:13.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:12 smithi176 ceph-mon[80162]: pgmap v592: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:15.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:14 smithi046 ceph-mon[108126]: pgmap v593: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:15.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:14 smithi176 ceph-mon[80162]: pgmap v593: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:17.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:16 smithi046 ceph-mon[108126]: pgmap v594: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:16 smithi176 ceph-mon[80162]: pgmap v594: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:19.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:18 smithi046 ceph-mon[108126]: pgmap v595: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:18 smithi176 ceph-mon[80162]: pgmap v595: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:20 smithi176 ceph-mon[80162]: pgmap v596: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:20 smithi046 ceph-mon[108126]: pgmap v596: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:22 smithi176 ceph-mon[80162]: pgmap v597: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:23.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:22 smithi046 ceph-mon[108126]: pgmap v597: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:25.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:24 smithi176 ceph-mon[80162]: pgmap v598: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:24 smithi046 ceph-mon[108126]: pgmap v598: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:26 smithi176 ceph-mon[80162]: pgmap v599: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:26 smithi046 ceph-mon[108126]: pgmap v599: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:28 smithi176 ceph-mon[80162]: pgmap v600: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:28 smithi046 ceph-mon[108126]: pgmap v600: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:30.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:30.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:30 smithi176 ceph-mon[80162]: pgmap v601: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:30 smithi046 ceph-mon[108126]: pgmap v601: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:32 smithi176 ceph-mon[80162]: pgmap v602: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:32 smithi046 ceph-mon[108126]: pgmap v602: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:34 smithi176 ceph-mon[80162]: pgmap v603: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:34 smithi046 ceph-mon[108126]: pgmap v603: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:37.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:36 smithi176 ceph-mon[80162]: pgmap v604: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:37.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:36 smithi046 ceph-mon[108126]: pgmap v604: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:38 smithi176 ceph-mon[80162]: pgmap v605: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:38 smithi046 ceph-mon[108126]: pgmap v605: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/413803525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 msgr2=0x7f8c58101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:40.982 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/413803525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c58101d60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c009880 tx=0x7f8c4c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/413803525 shutdown_connections 2024-09-21T13:06:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/413803525 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c58101d60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/413803525 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 0x7f8c58107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/413803525 >> 172.21.15.46:0/413803525 conn(0x7f8c580fd5e0 msgr2=0x7f8c580ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/413803525 shutdown_connections 2024-09-21T13:06:40.983 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.980+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/413803525 wait complete. 2024-09-21T13:06:40.984 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.981+0000 7f8c5dfaf640 1 Processor -- start 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.981+0000 7f8c5dfaf640 1 -- start start 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.981+0000 7f8c5dfaf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.981+0000 7f8c5dfaf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 0x7f8c58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.981+0000 7f8c5dfaf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5810edd0 con 0x7f8c58101900 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.981+0000 7f8c5dfaf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5810ec50 con 0x7f8c58107900 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c580744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41384/0 (socket says 172.21.15.46:41384) 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 -- 172.21.15.46:0/2217529385 learned_addr learned my addr 172.21.15.46:0/2217529385 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c56ffd640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 0x7f8c58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 -- 172.21.15.46:0/2217529385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 msgr2=0x7f8c58074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 0x7f8c58074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:40.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 -- 172.21.15.46:0/2217529385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c58074f70 con 0x7f8c58101900 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c56ffd640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 0x7f8c58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c577fe640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c580744f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d6f0 tx=0x7f8c4800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c48017070 con 0x7f8c58101900 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c58075260 con 0x7f8c58101900 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.982+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c4800de00 con 0x7f8c58101900 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.983+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c48004bb0 con 0x7f8c58101900 2024-09-21T13:06:40.986 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.983+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c581a3e80 con 0x7f8c58101900 2024-09-21T13:06:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.984+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c58103040 con 0x7f8c58101900 2024-09-21T13:06:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.984+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8c48004e60 con 0x7f8c58101900 2024-09-21T13:06:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.985+0000 7f8c54ff9640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8c4007af30 0x7f8c4007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.985+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8c4809dce0 con 0x7f8c58101900 2024-09-21T13:06:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.985+0000 7f8c56ffd640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8c4007af30 0x7f8c4007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:40.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.985+0000 7f8c56ffd640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8c4007af30 0x7f8c4007d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c58075f80 tx=0x7f8c4c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:40.991 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:40.989+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c48069230 con 0x7f8c58101900 2024-09-21T13:06:41.202 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.200+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8c58062630 con 0x7f8c4007af30 2024-09-21T13:06:41.203 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:40 smithi046 ceph-mon[108126]: pgmap v606: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:41.203 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.201+0000 7f8c54ff9640 1 -- 172.21.15.46:0/2217529385 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f8c58062630 con 0x7f8c4007af30 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8c4007af30 msgr2=0x7f8c4007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8c4007af30 0x7f8c4007d3f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c58075f80 tx=0x7f8c4c031400 comp rx=0 tx=0).stop 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 msgr2=0x7f8c580744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c580744f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800d6f0 tx=0x7f8c4800dbb0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 shutdown_connections 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8c4007af30 0x7f8c4007d3f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.206 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c58107900 0x7f8c58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 --2- 172.21.15.46:0/2217529385 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8c58101900 0x7f8c580744f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 >> 172.21.15.46:0/2217529385 conn(0x7f8c580fd5e0 msgr2=0x7f8c580fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 shutdown_connections 2024-09-21T13:06:41.207 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.204+0000 7f8c5dfaf640 1 -- 172.21.15.46:0/2217529385 wait complete. 2024-09-21T13:06:41.215 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 -- 172.21.15.46:0/2085144713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4103430 msgr2=0x7febb410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 --2- 172.21.15.46:0/2085144713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4103430 0x7febb410b920 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feba80098b0 tx=0x7feba802a560 comp rx=0 tx=0).stop 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 -- 172.21.15.46:0/2085144713 shutdown_connections 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 --2- 172.21.15.46:0/2085144713 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4103430 0x7febb410b920 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 --2- 172.21.15.46:0/2085144713 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb4102b10 0x7febb4102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 -- 172.21.15.46:0/2085144713 >> 172.21.15.46:0/2085144713 conn(0x7febb40fc550 msgr2=0x7febb40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:41.292 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 -- 172.21.15.46:0/2085144713 shutdown_connections 2024-09-21T13:06:41.293 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 -- 172.21.15.46:0/2085144713 wait complete. 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.290+0000 7febb8f85640 1 Processor -- start 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb8f85640 1 -- start start 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb8f85640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 0x7febb4100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb8f85640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb4103430 0x7febb4100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb8f85640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7febb410edc0 con 0x7febb4102b10 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb8f85640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7febb410ec40 con 0x7febb4103430 2024-09-21T13:06:41.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 0x7febb4100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 0x7febb4100770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41404/0 (socket says 172.21.15.46:41404) 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 -- 172.21.15.46:0/1861365599 learned_addr learned my addr 172.21.15.46:0/1861365599 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 -- 172.21.15.46:0/1861365599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb4103430 msgr2=0x7febb4100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb4103430 0x7febb4100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 -- 172.21.15.46:0/1861365599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb41011f0 con 0x7febb4102b10 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.291+0000 7febb259c640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 0x7febb4100770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feba400ea30 tx=0x7feba400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.292+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feba400cbe0 con 0x7febb4102b10 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.292+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb41014e0 con 0x7febb4102b10 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.292+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feba400cd80 con 0x7febb4102b10 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.292+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feba401a920 con 0x7febb4102b10 2024-09-21T13:06:41.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.292+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb41a3e70 con 0x7febb4102b10 2024-09-21T13:06:41.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.293+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb406a520 con 0x7febb4102b10 2024-09-21T13:06:41.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.293+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feba401abd0 con 0x7febb4102b10 2024-09-21T13:06:41.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.294+0000 7feba37fe640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feb9c07af30 0x7feb9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.294+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7feba409e760 con 0x7febb4102b10 2024-09-21T13:06:41.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.294+0000 7febb1d9b640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feb9c07af30 0x7feb9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.297 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.295+0000 7febb1d9b640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feb9c07af30 0x7feb9c07d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feba80096c0 tx=0x7feba8000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:41.300 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.298+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feba4016030 con 0x7febb4102b10 2024-09-21T13:06:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:40 smithi176 ceph-mon[80162]: pgmap v606: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:41.508 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.506+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7febb4062630 con 0x7feb9c07af30 2024-09-21T13:06:41.509 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.507+0000 7feba37fe640 1 -- 172.21.15.46:0/1861365599 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7febb4062630 con 0x7feb9c07af30 2024-09-21T13:06:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feb9c07af30 msgr2=0x7feb9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feb9c07af30 0x7feb9c07d3f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feba80096c0 tx=0x7feba8000bc0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 msgr2=0x7febb4100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 0x7febb4100770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feba400ea30 tx=0x7feba400eef0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 shutdown_connections 2024-09-21T13:06:41.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feb9c07af30 0x7feb9c07d3f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7febb4103430 0x7febb4100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 --2- 172.21.15.46:0/1861365599 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7febb4102b10 0x7febb4100770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 >> 172.21.15.46:0/1861365599 conn(0x7febb40fc550 msgr2=0x7febb4103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 shutdown_connections 2024-09-21T13:06:41.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.510+0000 7febb8f85640 1 -- 172.21.15.46:0/1861365599 wait complete. 2024-09-21T13:06:41.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 -- 172.21.15.46:0/2225549069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100ad0 msgr2=0x7fb88c106610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 --2- 172.21.15.46:0/2225549069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100ad0 0x7fb88c106610 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb880009880 tx=0x7fb88002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 -- 172.21.15.46:0/2225549069 shutdown_connections 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 --2- 172.21.15.46:0/2225549069 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100ad0 0x7fb88c106610 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 --2- 172.21.15.46:0/2225549069 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c100120 0x7fb88c100500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 -- 172.21.15.46:0/2225549069 >> 172.21.15.46:0/2225549069 conn(0x7fb88c0fbc90 msgr2=0x7fb88c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 -- 172.21.15.46:0/2225549069 shutdown_connections 2024-09-21T13:06:41.597 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.594+0000 7fb891e79640 1 -- 172.21.15.46:0/2225549069 wait complete. 2024-09-21T13:06:41.598 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb891e79640 1 Processor -- start 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb891e79640 1 -- start start 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb891e79640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 0x7fb88c19d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb891e79640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c100ad0 0x7fb88c19dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb891e79640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c10ee40 con 0x7fb88c100120 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb891e79640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c10ecc0 con 0x7fb88c100ad0 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.595+0000 7fb88b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 0x7fb88c19d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 0x7fb88c19d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41424/0 (socket says 172.21.15.46:41424) 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88b7fe640 1 -- 172.21.15.46:0/162747635 learned_addr learned my addr 172.21.15.46:0/162747635 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88affd640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c100ad0 0x7fb88c19dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88b7fe640 1 -- 172.21.15.46:0/162747635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c100ad0 msgr2=0x7fb88c19dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88b7fe640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c100ad0 0x7fb88c19dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88b7fe640 1 -- 172.21.15.46:0/162747635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c197850 con 0x7fb88c100120 2024-09-21T13:06:41.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb88b7fe640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 0x7fb88c19d6d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00d8d0 tx=0x7fb87c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:41.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb87c017030 con 0x7fb88c100120 2024-09-21T13:06:41.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c197b40 con 0x7fb88c100120 2024-09-21T13:06:41.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb87c004020 con 0x7fb88c100120 2024-09-21T13:06:41.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb87c0047a0 con 0x7fb88c100120 2024-09-21T13:06:41.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.596+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c1980a0 con 0x7fb88c100120 2024-09-21T13:06:41.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.597+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c1031e0 con 0x7fb88c100120 2024-09-21T13:06:41.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.598+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb87c0041d0 con 0x7fb88c100120 2024-09-21T13:06:41.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.598+0000 7fb888ff9640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87407af40 0x7fb87407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.598+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb87c018070 con 0x7fb88c100120 2024-09-21T13:06:41.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.598+0000 7fb88affd640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87407af40 0x7fb87407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.601 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.599+0000 7fb88affd640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87407af40 0x7fb87407d400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb880000c00 tx=0x7fb8800095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:41.605 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.603+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb87c069420 con 0x7fb88c100120 2024-09-21T13:06:41.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.799+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb88c1983e0 con 0x7fb87407af40 2024-09-21T13:06:41.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.810+0000 7fb888ff9640 1 -- 172.21.15.46:0/162747635 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb88c1983e0 con 0x7fb87407af40 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (16m) 10m ago 27m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (20m) 10m ago 27m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (19m) 10m ago 27m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (15m) 10m ago 27m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (14m) 10m ago 27m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (16m) 10m ago 27m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (11m) 10m ago 22m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (11m) 10m ago 22m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:06:41.814 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (10m) 10m ago 22m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (10m) 10m ago 22m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (19m) 10m ago 29m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (18m) 10m ago 26m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (15m) 10m ago 29m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (15m) 10m ago 26m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (17m) 10m ago 27m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (17m) 10m ago 26m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (14m) 10m ago 25m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (13m) 10m ago 25m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (13m) 10m ago 24m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (12m) 10m ago 24m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (12m) 10m ago 23m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (11m) 10m ago 23m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:06:41.815 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (17m) 10m ago 27m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87407af40 msgr2=0x7fb87407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87407af40 0x7fb87407d400 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb880000c00 tx=0x7fb8800095c0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 msgr2=0x7fb88c19d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 0x7fb88c19d6d0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00d8d0 tx=0x7fb87c00dd90 comp rx=0 tx=0).stop 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 shutdown_connections 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb87407af40 0x7fb87407d400 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb88c100ad0 0x7fb88c19dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 --2- 172.21.15.46:0/162747635 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb88c100120 0x7fb88c19d6d0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 >> 172.21.15.46:0/162747635 conn(0x7fb88c0fbc90 msgr2=0x7fb88c0fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 shutdown_connections 2024-09-21T13:06:41.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.812+0000 7fb891e79640 1 -- 172.21.15.46:0/162747635 wait complete. 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 -- 172.21.15.46:0/3813823706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 msgr2=0x7f9ef4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/3813823706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef4101d60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f9ee8009880 tx=0x7f9ee802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 -- 172.21.15.46:0/3813823706 shutdown_connections 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/3813823706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef4101d60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/3813823706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ef4107900 0x7f9ef4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 -- 172.21.15.46:0/3813823706 >> 172.21.15.46:0/3813823706 conn(0x7f9ef40fd600 msgr2=0x7f9ef40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 -- 172.21.15.46:0/3813823706 shutdown_connections 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.896+0000 7f9ef97e8640 1 -- 172.21.15.46:0/3813823706 wait complete. 2024-09-21T13:06:41.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.897+0000 7f9ef97e8640 1 Processor -- start 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.897+0000 7f9ef97e8640 1 -- start start 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.897+0000 7f9ef97e8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.897+0000 7f9ef97e8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ef4107900 0x7f9ef419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.897+0000 7f9ef97e8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef410edb0 con 0x7f9ef4101900 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.897+0000 7f9ef97e8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef410ec30 con 0x7f9ef4107900 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef419f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41436/0 (socket says 172.21.15.46:41436) 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 -- 172.21.15.46:0/4081012893 learned_addr learned my addr 172.21.15.46:0/4081012893 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef27fc640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ef4107900 0x7f9ef419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 -- 172.21.15.46:0/4081012893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ef4107900 msgr2=0x7f9ef419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ef4107900 0x7f9ef419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 -- 172.21.15.46:0/4081012893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef4199a10 con 0x7f9ef4101900 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef2ffd640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef419f850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400e970 tx=0x7f9ee400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ee400cac0 con 0x7f9ef4101900 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ee400cc60 con 0x7f9ef4101900 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ee4018720 con 0x7f9ef4101900 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef4199d00 con 0x7f9ef4101900 2024-09-21T13:06:41.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.898+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef419a260 con 0x7f9ef4101900 2024-09-21T13:06:41.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.900+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef4103040 con 0x7f9ef4101900 2024-09-21T13:06:41.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.900+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9ee4010430 con 0x7f9ef4101900 2024-09-21T13:06:41.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.901+0000 7f9edbfff640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9edc07af30 0x7f9edc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:41.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.901+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9ee409e6d0 con 0x7f9ef4101900 2024-09-21T13:06:41.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.901+0000 7f9ef27fc640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9edc07af30 0x7f9edc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:41.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.901+0000 7f9ef27fc640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9edc07af30 0x7f9edc07d3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9ef419b200 tx=0x7f9ee8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:41.911 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:41.909+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ee4069c20 con 0x7f9ef4101900 2024-09-21T13:06:42.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:41 smithi046 ceph-mon[108126]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:42.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:41 smithi046 ceph-mon[108126]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.172+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9ef419a510 con 0x7f9ef4101900 2024-09-21T13:06:42.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.172+0000 7f9edbfff640 1 -- 172.21.15.46:0/4081012893 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f9ee406ead0 con 0x7f9ef4101900 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:42.175 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:06:42.176 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:06:42.176 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:06:42.176 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:06:42.176 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:06:42.176 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:06:42.176 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:06:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9edc07af30 msgr2=0x7f9edc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9edc07af30 0x7f9edc07d3f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9ef419b200 tx=0x7f9ee8031400 comp rx=0 tx=0).stop 2024-09-21T13:06:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 msgr2=0x7f9ef419f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef419f850 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400e970 tx=0x7f9ee400ee30 comp rx=0 tx=0).stop 2024-09-21T13:06:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 shutdown_connections 2024-09-21T13:06:42.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9edc07af30 0x7f9edc07d3f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9ef4107900 0x7f9ef419fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 --2- 172.21.15.46:0/4081012893 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9ef4101900 0x7f9ef419f850 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 >> 172.21.15.46:0/4081012893 conn(0x7f9ef40fd600 msgr2=0x7f9ef4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 shutdown_connections 2024-09-21T13:06:42.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.175+0000 7f9ef97e8640 1 -- 172.21.15.46:0/4081012893 wait complete. 2024-09-21T13:06:42.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 -- 172.21.15.46:0/297098165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848101900 msgr2=0x7f0848101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 --2- 172.21.15.46:0/297098165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848101900 0x7f0848101d60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f0838009880 tx=0x7f083802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 -- 172.21.15.46:0/297098165 shutdown_connections 2024-09-21T13:06:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 --2- 172.21.15.46:0/297098165 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848101900 0x7f0848101d60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 --2- 172.21.15.46:0/297098165 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0848107900 0x7f0848107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 -- 172.21.15.46:0/297098165 >> 172.21.15.46:0/297098165 conn(0x7f08480fd600 msgr2=0x7f08480ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 -- 172.21.15.46:0/297098165 shutdown_connections 2024-09-21T13:06:42.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.259+0000 7f084f4a2640 1 -- 172.21.15.46:0/297098165 wait complete. 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084f4a2640 1 Processor -- start 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084f4a2640 1 -- start start 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084f4a2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0848101900 0x7f08480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084f4a2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 0x7f0848074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084f4a2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f084810edd0 con 0x7f0848107900 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084f4a2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f084810ec50 con 0x7f0848101900 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084ca3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 0x7f0848074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084ca3d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 0x7f0848074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41454/0 (socket says 172.21.15.46:41454) 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084ca3d640 1 -- 172.21.15.46:0/1858666331 learned_addr learned my addr 172.21.15.46:0/1858666331 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.260+0000 7f084d23e640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0848101900 0x7f08480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f084ca3d640 1 -- 172.21.15.46:0/1858666331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0848101900 msgr2=0x7f08480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f084ca3d640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0848101900 0x7f08480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f084ca3d640 1 -- 172.21.15.46:0/1858666331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0848074f70 con 0x7f0848107900 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f084ca3d640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 0x7f0848074a30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0838031460 tx=0x7f08380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f083803f070 con 0x7f0848107900 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0848075200 con 0x7f0848107900 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08380035f0 con 0x7f0848107900 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08481a3dc0 con 0x7f0848107900 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.261+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0838035030 con 0x7f0848107900 2024-09-21T13:06:42.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.262+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0848103040 con 0x7f0848107900 2024-09-21T13:06:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.263+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0838042070 con 0x7f0848107900 2024-09-21T13:06:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.263+0000 7f083e7fc640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083407af30 0x7f083407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.263+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f08380bea20 con 0x7f0848107900 2024-09-21T13:06:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.263+0000 7f084d23e640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083407af30 0x7f083407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.264+0000 7f084d23e640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083407af30 0x7f083407d3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0844005fd0 tx=0x7f084400b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:42.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.268+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0838089f70 con 0x7f0848107900 2024-09-21T13:06:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:41 smithi176 ceph-mon[80162]: from='client.34926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:41 smithi176 ceph-mon[80162]: from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.495+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0848109e70 con 0x7f0848107900 2024-09-21T13:06:42.497 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.495+0000 7f083e7fc640 1 -- 172.21.15.46:0/1858666331 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f083808ee20 con 0x7f0848107900 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:06:42.498 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:06:42.499 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:42.500 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:42.501 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:42.501 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:06:42.501 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:06:42.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083407af30 msgr2=0x7f083407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.501 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083407af30 0x7f083407d3f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0844005fd0 tx=0x7f084400b390 comp rx=0 tx=0).stop 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 msgr2=0x7f0848074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 0x7f0848074a30 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f0838031460 tx=0x7f08380045e0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 shutdown_connections 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f083407af30 0x7f083407d3f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0848107900 0x7f0848074a30 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.497+0000 7f084f4a2640 1 --2- 172.21.15.46:0/1858666331 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0848101900 0x7f08480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.498+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 >> 172.21.15.46:0/1858666331 conn(0x7f08480fd600 msgr2=0x7f08480fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.498+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 shutdown_connections 2024-09-21T13:06:42.502 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.498+0000 7f084f4a2640 1 -- 172.21.15.46:0/1858666331 wait complete. 2024-09-21T13:06:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3208267738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 msgr2=0x7f2c9c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3208267738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c106bd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c009880 tx=0x7f2c8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3208267738 shutdown_connections 2024-09-21T13:06:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3208267738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c9c1007f0 0x7f2c9c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.586 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3208267738 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c106bd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3208267738 >> 172.21.15.46:0/3208267738 conn(0x7f2c9c0fc550 msgr2=0x7f2c9c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3208267738 shutdown_connections 2024-09-21T13:06:42.587 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3208267738 wait complete. 2024-09-21T13:06:42.588 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 Processor -- start 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.584+0000 7f2ca27cf640 1 -- start start 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2ca27cf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c9c1007f0 0x7f2c9c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2ca27cf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2ca27cf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10cbb0 con 0x7f2c9c1067f0 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2ca27cf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c10ca30 con 0x7f2c9c1007f0 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c19fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41476/0 (socket says 172.21.15.46:41476) 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9b7fe640 1 -- 172.21.15.46:0/3323793391 learned_addr learned my addr 172.21.15.46:0/3323793391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9bfff640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c9c1007f0 0x7f2c9c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9b7fe640 1 -- 172.21.15.46:0/3323793391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c9c1007f0 msgr2=0x7f2c9c19f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9b7fe640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c9c1007f0 0x7f2c9c19f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.585+0000 7f2c9b7fe640 1 -- 172.21.15.46:0/3323793391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c1a04e0 con 0x7f2c9c1067f0 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.586+0000 7f2c9b7fe640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c19fe30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c8a0 tx=0x7f2c9000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.586+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c900079b0 con 0x7f2c9c1067f0 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.586+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c199bd0 con 0x7f2c9c1067f0 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.586+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c90007b50 con 0x7f2c9c1067f0 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.586+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c90018700 con 0x7f2c9c1067f0 2024-09-21T13:06:42.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.586+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c19a130 con 0x7f2c9c1067f0 2024-09-21T13:06:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.587+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c101f30 con 0x7f2c9c1067f0 2024-09-21T13:06:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.588+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2c90007d00 con 0x7f2c9c1067f0 2024-09-21T13:06:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.588+0000 7f2c997fa640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2c8407af30 0x7f2c8407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.588+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2c9009e320 con 0x7f2c9c1067f0 2024-09-21T13:06:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.588+0000 7f2c9bfff640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2c8407af30 0x7f2c8407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.591 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.589+0000 7f2c9bfff640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2c8407af30 0x7f2c8407d3f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c000c00 tx=0x7f2c8c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:42.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.593+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c90014030 con 0x7f2c9c1067f0 2024-09-21T13:06:42.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.798+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2c9c19afe0 con 0x7f2c8407af30 2024-09-21T13:06:42.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.799+0000 7f2c997fa640 1 -- 172.21.15.46:0/3323793391 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2c9c19afe0 con 0x7f2c8407af30 2024-09-21T13:06:42.801 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:06:42.802 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:06:42.803 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.801+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2c8407af30 msgr2=0x7f2c8407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.801+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2c8407af30 0x7f2c8407d3f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c000c00 tx=0x7f2c8c031400 comp rx=0 tx=0).stop 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.801+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 msgr2=0x7f2c9c19fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.801+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c19fe30 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f2c9000c8a0 tx=0x7f2c9000cd60 comp rx=0 tx=0).stop 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 shutdown_connections 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2c8407af30 0x7f2c8407d3f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.804 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2c9c1067f0 0x7f2c9c19fe30 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 --2- 172.21.15.46:0/3323793391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c9c1007f0 0x7f2c9c19f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 >> 172.21.15.46:0/3323793391 conn(0x7f2c9c0fc550 msgr2=0x7f2c9c0fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 shutdown_connections 2024-09-21T13:06:42.805 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.802+0000 7f2ca27cf640 1 -- 172.21.15.46:0/3323793391 wait complete. 2024-09-21T13:06:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 -- 172.21.15.46:0/1109297259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420106800 msgr2=0x7f5420106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 --2- 172.21.15.46:0/1109297259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420106800 0x7f5420106be0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f5410009880 tx=0x7f541002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 -- 172.21.15.46:0/1109297259 shutdown_connections 2024-09-21T13:06:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 --2- 172.21.15.46:0/1109297259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5420100800 0x7f5420100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 --2- 172.21.15.46:0/1109297259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420106800 0x7f5420106be0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 -- 172.21.15.46:0/1109297259 >> 172.21.15.46:0/1109297259 conn(0x7f54200fc520 msgr2=0x7f54200fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 -- 172.21.15.46:0/1109297259 shutdown_connections 2024-09-21T13:06:42.890 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.887+0000 7f54257e9640 1 -- 172.21.15.46:0/1109297259 wait complete. 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f54257e9640 1 Processor -- start 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f54257e9640 1 -- start start 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f54257e9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 0x7f54201987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f54257e9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5420106800 0x7f5420198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f54257e9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f542010dcd0 con 0x7f5420100800 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f54257e9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f542010db50 con 0x7f5420106800 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f541effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 0x7f54201987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f541effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 0x7f54201987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41492/0 (socket says 172.21.15.46:41492) 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.888+0000 7f541effd640 1 -- 172.21.15.46:0/993602871 learned_addr learned my addr 172.21.15.46:0/993602871 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f541e7fc640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5420106800 0x7f5420198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f541effd640 1 -- 172.21.15.46:0/993602871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5420106800 msgr2=0x7f5420198d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:42.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f541effd640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5420106800 0x7f5420198d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f541effd640 1 -- 172.21.15.46:0/993602871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5420199360 con 0x7f5420100800 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f541effd640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 0x7f54201987d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5410031460 tx=0x7f5410004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f541003f070 con 0x7f5420100800 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5410004a90 con 0x7f5420100800 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54201995f0 con 0x7f5420100800 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5410035030 con 0x7f5420100800 2024-09-21T13:06:42.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.889+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54201a1ba0 con 0x7f5420100800 2024-09-21T13:06:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.890+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5420101f40 con 0x7f5420100800 2024-09-21T13:06:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.891+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5410042070 con 0x7f5420100800 2024-09-21T13:06:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.892+0000 7f5407fff640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f540807af90 0x7f540807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:06:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.892+0000 7f541e7fc640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f540807af90 0x7f540807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:06:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.892+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f54100bea70 con 0x7f5420100800 2024-09-21T13:06:42.894 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.892+0000 7f541e7fc640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f540807af90 0x7f540807d450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f542006ad40 tx=0x7f5414005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:06:42.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:42.896+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f541008a040 con 0x7f5420100800 2024-09-21T13:06:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:42 smithi046 ceph-mon[108126]: pgmap v607: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:43.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:42 smithi046 ceph-mon[108126]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:43.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:42 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4081012893' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:06:43.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:42 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1858666331' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:06:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.161+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5420108d70 con 0x7f5420100800 2024-09-21T13:06:43.164 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.162+0000 7f5407fff640 1 -- 172.21.15.46:0/993602871 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f541008eef0 con 0x7f5420100800 2024-09-21T13:06:43.164 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:06:43.165 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:06:43.165 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:06:43.165 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:06:43.165 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:06:43.165 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:06:43.165 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:06:43.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f540807af90 msgr2=0x7f540807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f540807af90 0x7f540807d450 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f542006ad40 tx=0x7f5414005f90 comp rx=0 tx=0).stop 2024-09-21T13:06:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 msgr2=0x7f54201987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:06:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 0x7f54201987d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5410031460 tx=0x7f5410004530 comp rx=0 tx=0).stop 2024-09-21T13:06:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 shutdown_connections 2024-09-21T13:06:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f540807af90 0x7f540807d450 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:43.167 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5420106800 0x7f5420198d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 --2- 172.21.15.46:0/993602871 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5420100800 0x7f54201987d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:06:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.164+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 >> 172.21.15.46:0/993602871 conn(0x7f54200fc520 msgr2=0x7f54200fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:06:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.165+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 shutdown_connections 2024-09-21T13:06:43.168 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:06:43.165+0000 7f54257e9640 1 -- 172.21.15.46:0/993602871 wait complete. 2024-09-21T13:06:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:42 smithi176 ceph-mon[80162]: pgmap v607: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:42 smithi176 ceph-mon[80162]: from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:42 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4081012893' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:06:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:42 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1858666331' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:06:44.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:43 smithi176 ceph-mon[80162]: from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:44.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:43 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/993602871' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:06:44.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:43 smithi046 ceph-mon[108126]: from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:06:44.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:43 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/993602871' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:06:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:44 smithi176 ceph-mon[80162]: pgmap v608: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:44 smithi046 ceph-mon[108126]: pgmap v608: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:06:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:46 smithi176 ceph-mon[80162]: pgmap v609: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:46 smithi046 ceph-mon[108126]: pgmap v609: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:48 smithi176 ceph-mon[80162]: pgmap v610: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:48 smithi046 ceph-mon[108126]: pgmap v610: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:50 smithi176 ceph-mon[80162]: pgmap v611: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:50 smithi046 ceph-mon[108126]: pgmap v611: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:52 smithi176 ceph-mon[80162]: pgmap v612: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:52 smithi046 ceph-mon[108126]: pgmap v612: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:54 smithi176 ceph-mon[80162]: pgmap v613: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:54 smithi046 ceph-mon[108126]: pgmap v613: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:56 smithi176 ceph-mon[80162]: pgmap v614: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:56 smithi046 ceph-mon[108126]: pgmap v614: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:58 smithi176 ceph-mon[80162]: pgmap v615: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:06:59.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:58 smithi046 ceph-mon[108126]: pgmap v615: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:06:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:06:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:00 smithi176 ceph-mon[80162]: pgmap v616: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:01.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:00 smithi046 ceph-mon[108126]: pgmap v616: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:02 smithi176 ceph-mon[80162]: pgmap v617: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:02 smithi046 ceph-mon[108126]: pgmap v617: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:05.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:04 smithi176 ceph-mon[80162]: pgmap v618: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:04 smithi046 ceph-mon[108126]: pgmap v618: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:07 smithi176 ceph-mon[80162]: pgmap v619: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:07 smithi046 ceph-mon[108126]: pgmap v619: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:09 smithi176 ceph-mon[80162]: pgmap v620: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:09 smithi046 ceph-mon[108126]: pgmap v620: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:11 smithi176 ceph-mon[80162]: pgmap v621: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:11 smithi046 ceph-mon[108126]: pgmap v621: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:13.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 -- 172.21.15.46:0/1758596178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7404102ac0 msgr2=0x7f7404102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 --2- 172.21.15.46:0/1758596178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7404102ac0 0x7f7404102ea0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009880 tx=0x7f73f402a530 comp rx=0 tx=0).stop 2024-09-21T13:07:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 -- 172.21.15.46:0/1758596178 shutdown_connections 2024-09-21T13:07:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 --2- 172.21.15.46:0/1758596178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74041033e0 0x7f740410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 --2- 172.21.15.46:0/1758596178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7404102ac0 0x7f7404102ea0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 -- 172.21.15.46:0/1758596178 >> 172.21.15.46:0/1758596178 conn(0x7f74040fc520 msgr2=0x7f74040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:13.266 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:13 smithi046 ceph-mon[108126]: pgmap v622: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 -- 172.21.15.46:0/1758596178 shutdown_connections 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.264+0000 7f740a856640 1 -- 172.21.15.46:0/1758596178 wait complete. 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.265+0000 7f740a856640 1 Processor -- start 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.265+0000 7f740a856640 1 -- start start 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.265+0000 7f740a856640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7404102ac0 0x7f740419d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.265+0000 7f740a856640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 0x7f740419dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f740a856640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f740410edd0 con 0x7f74041033e0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f740a856640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f740410ec50 con 0x7f7404102ac0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 0x7f740419dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 0x7f740419dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53632/0 (socket says 172.21.15.46:53632) 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 -- 172.21.15.46:0/4006720909 learned_addr learned my addr 172.21.15.46:0/4006720909 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f7403fff640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7404102ac0 0x7f740419d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 -- 172.21.15.46:0/4006720909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7404102ac0 msgr2=0x7f740419d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7404102ac0 0x7f740419d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 -- 172.21.15.46:0/4006720909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740419e310 con 0x7f74041033e0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f7403fff640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7404102ac0 0x7f740419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74037fe640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 0x7f740419dc60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c8f0 tx=0x7f73ec00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73ec0079b0 con 0x7f74041033e0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.266+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73ec007b50 con 0x7f74041033e0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.267+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7404197a00 con 0x7f74041033e0 2024-09-21T13:07:13.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.267+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73ec018610 con 0x7f74041033e0 2024-09-21T13:07:13.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.267+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7404197f60 con 0x7f74041033e0 2024-09-21T13:07:13.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.268+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740406aa90 con 0x7f74041033e0 2024-09-21T13:07:13.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.268+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f73ec007d00 con 0x7f74041033e0 2024-09-21T13:07:13.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.269+0000 7f74017fa640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f73f007af30 0x7f73f007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.269+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f73ec09e330 con 0x7f74041033e0 2024-09-21T13:07:13.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.269+0000 7f7403fff640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f73f007af30 0x7f73f007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.271 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.270+0000 7f7403fff640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f73f007af30 0x7f73f007d3f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000c00 tx=0x7f73f4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:13.274 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.273+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73ec014030 con 0x7f74041033e0 2024-09-21T13:07:13.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:13 smithi176 ceph-mon[80162]: pgmap v622: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:13.479 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.478+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7404198e80 con 0x7f73f007af30 2024-09-21T13:07:13.480 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.479+0000 7f74017fa640 1 -- 172.21.15.46:0/4006720909 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7404198e80 con 0x7f73f007af30 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f73f007af30 msgr2=0x7f73f007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f73f007af30 0x7f73f007d3f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000c00 tx=0x7f73f4031400 comp rx=0 tx=0).stop 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 msgr2=0x7f740419dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 0x7f740419dc60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00c8f0 tx=0x7f73ec00cdb0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 shutdown_connections 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f73f007af30 0x7f73f007d3f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.482 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f74041033e0 0x7f740419dc60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 --2- 172.21.15.46:0/4006720909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7404102ac0 0x7f740419d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 >> 172.21.15.46:0/4006720909 conn(0x7f74040fc520 msgr2=0x7f7404108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 shutdown_connections 2024-09-21T13:07:13.483 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.481+0000 7f740a856640 1 -- 172.21.15.46:0/4006720909 wait complete. 2024-09-21T13:07:13.491 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:07:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 -- 172.21.15.46:0/961071879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 msgr2=0x7f4884101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 --2- 172.21.15.46:0/961071879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f4884101d60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4878009880 tx=0x7f487802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 -- 172.21.15.46:0/961071879 shutdown_connections 2024-09-21T13:07:13.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 --2- 172.21.15.46:0/961071879 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f4884101d60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 --2- 172.21.15.46:0/961071879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4884107900 0x7f4884107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 -- 172.21.15.46:0/961071879 >> 172.21.15.46:0/961071879 conn(0x7f48840fd600 msgr2=0x7f48840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:13.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 -- 172.21.15.46:0/961071879 shutdown_connections 2024-09-21T13:07:13.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.567+0000 7f488c254640 1 -- 172.21.15.46:0/961071879 wait complete. 2024-09-21T13:07:13.570 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f488c254640 1 Processor -- start 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f488c254640 1 -- start start 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f488c254640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f48840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f488c254640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4884107900 0x7f4884074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f488c254640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f488410edb0 con 0x7f4884101900 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f488c254640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f488410ec30 con 0x7f4884107900 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f4889ff0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f48840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f4889ff0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f48840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53646/0 (socket says 172.21.15.46:53646) 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f4889ff0640 1 -- 172.21.15.46:0/194368838 learned_addr learned my addr 172.21.15.46:0/194368838 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.568+0000 7f48897ef640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4884107900 0x7f4884074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.571 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4889ff0640 1 -- 172.21.15.46:0/194368838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4884107900 msgr2=0x7f4884074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4889ff0640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4884107900 0x7f4884074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4889ff0640 1 -- 172.21.15.46:0/194368838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4884074f70 con 0x7f4884101900 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4889ff0640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f48840744f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f488000db80 tx=0x7f488000b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4880017070 con 0x7f4884101900 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4880003e30 con 0x7f4884101900 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4884075260 con 0x7f4884101900 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4880010460 con 0x7f4884101900 2024-09-21T13:07:13.572 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.569+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48841a3e50 con 0x7f4884101900 2024-09-21T13:07:13.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.571+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4884103040 con 0x7f4884101900 2024-09-21T13:07:13.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.571+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f488000dc70 con 0x7f4884101900 2024-09-21T13:07:13.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.572+0000 7f4876ffd640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f487007af30 0x7f487007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.572+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f488009e500 con 0x7f4884101900 2024-09-21T13:07:13.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.572+0000 7f48897ef640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f487007af30 0x7f487007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.573 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.572+0000 7f48897ef640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f487007af30 0x7f487007d3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4884075f80 tx=0x7f4878031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:13.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.577+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4880069a50 con 0x7f4884101900 2024-09-21T13:07:13.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.784+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4884062630 con 0x7f487007af30 2024-09-21T13:07:13.786 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.785+0000 7f4876ffd640 1 -- 172.21.15.46:0/194368838 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4884062630 con 0x7f487007af30 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f487007af30 msgr2=0x7f487007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f487007af30 0x7f487007d3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4884075f80 tx=0x7f4878031400 comp rx=0 tx=0).stop 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 msgr2=0x7f48840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f48840744f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f488000db80 tx=0x7f488000b630 comp rx=0 tx=0).stop 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 shutdown_connections 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f487007af30 0x7f487007d3f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4884107900 0x7f4884074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 --2- 172.21.15.46:0/194368838 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4884101900 0x7f48840744f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 >> 172.21.15.46:0/194368838 conn(0x7f48840fd600 msgr2=0x7f48840fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:13.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 shutdown_connections 2024-09-21T13:07:13.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.788+0000 7f488c254640 1 -- 172.21.15.46:0/194368838 wait complete. 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.872+0000 7f53968b1640 1 -- 172.21.15.46:0/2507900707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390100800 msgr2=0x7f5390100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.872+0000 7f53968b1640 1 --2- 172.21.15.46:0/2507900707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390100800 0x7f5390100c60 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f5378009880 tx=0x7f537802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.872+0000 7f53968b1640 1 -- 172.21.15.46:0/2507900707 shutdown_connections 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.872+0000 7f53968b1640 1 --2- 172.21.15.46:0/2507900707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390100800 0x7f5390100c60 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.872+0000 7f53968b1640 1 --2- 172.21.15.46:0/2507900707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5390106800 0x7f5390106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.872+0000 7f53968b1640 1 -- 172.21.15.46:0/2507900707 >> 172.21.15.46:0/2507900707 conn(0x7f53900fc520 msgr2=0x7f53900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.873+0000 7f53968b1640 1 -- 172.21.15.46:0/2507900707 shutdown_connections 2024-09-21T13:07:13.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.873+0000 7f53968b1640 1 -- 172.21.15.46:0/2507900707 wait complete. 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.873+0000 7f53968b1640 1 Processor -- start 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.873+0000 7f53968b1640 1 -- start start 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f53968b1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5390100800 0x7f53901987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f53968b1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 0x7f5390198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f53968b1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f539010dcd0 con 0x7f5390106800 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f53968b1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f539010db50 con 0x7f5390100800 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 0x7f5390198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 0x7f5390198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53666/0 (socket says 172.21.15.46:53666) 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 -- 172.21.15.46:0/518288932 learned_addr learned my addr 172.21.15.46:0/518288932 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f538ffff640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5390100800 0x7f53901987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.876 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 -- 172.21.15.46:0/518288932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5390100800 msgr2=0x7f53901987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5390100800 0x7f53901987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 -- 172.21.15.46:0/518288932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5390199370 con 0x7f5390106800 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.874+0000 7f5387fff640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 0x7f5390198d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5378031460 tx=0x7f53780048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.875+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f537803f070 con 0x7f5390106800 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.875+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5378004cf0 con 0x7f5390106800 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.875+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5390199600 con 0x7f5390106800 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.875+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5378035030 con 0x7f5390106800 2024-09-21T13:07:13.877 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.875+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53901a1bb0 con 0x7f5390106800 2024-09-21T13:07:13.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.876+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5390101f40 con 0x7f5390106800 2024-09-21T13:07:13.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.877+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5378042070 con 0x7f5390106800 2024-09-21T13:07:13.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.877+0000 7f538dffb640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f537c07af80 0x7f537c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:13.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.877+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f53780bea90 con 0x7f5390106800 2024-09-21T13:07:13.878 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.877+0000 7f538ffff640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f537c07af80 0x7f537c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:13.879 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.878+0000 7f538ffff640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f537c07af80 0x7f537c07d440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5380005fd0 tx=0x7f5380005e20 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:13.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:13.882+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f537808a060 con 0x7f5390106800 2024-09-21T13:07:14.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.079+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5390062630 con 0x7f537c07af80 2024-09-21T13:07:14.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.088+0000 7f538dffb640 1 -- 172.21.15.46:0/518288932 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5390062630 con 0x7f537c07af80 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (17m) 11m ago 28m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (20m) 11m ago 28m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (20m) 11m ago 27m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (15m) 11m ago 28m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (15m) 11m ago 27m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (17m) 11m ago 28m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (11m) 11m ago 22m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (11m) 11m ago 22m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (11m) 11m ago 22m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (11m) 11m ago 22m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (19m) 11m ago 29m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:07:14.090 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (18m) 11m ago 27m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (16m) 11m ago 29m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (15m) 11m ago 27m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (18m) 11m ago 28m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (18m) 11m ago 27m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (15m) 11m ago 26m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (14m) 11m ago 25m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (13m) 11m ago 25m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (13m) 11m ago 24m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (12m) 11m ago 24m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (12m) 11m ago 23m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:07:14.091 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (17m) 11m ago 27m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:07:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f537c07af80 msgr2=0x7f537c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f537c07af80 0x7f537c07d440 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5380005fd0 tx=0x7f5380005e20 comp rx=0 tx=0).stop 2024-09-21T13:07:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 msgr2=0x7f5390198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 0x7f5390198d20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5378031460 tx=0x7f53780048f0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 shutdown_connections 2024-09-21T13:07:14.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f537c07af80 0x7f537c07d440 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5390106800 0x7f5390198d20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 --2- 172.21.15.46:0/518288932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5390100800 0x7f53901987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.090+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 >> 172.21.15.46:0/518288932 conn(0x7f53900fc520 msgr2=0x7f53900fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:14.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.091+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 shutdown_connections 2024-09-21T13:07:14.093 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.091+0000 7f53968b1640 1 -- 172.21.15.46:0/518288932 wait complete. 2024-09-21T13:07:14.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:14 smithi046 ceph-mon[108126]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 -- 172.21.15.46:0/1078902752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034106800 msgr2=0x7f1034106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 --2- 172.21.15.46:0/1078902752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034106800 0x7f1034106be0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1024009880 tx=0x7f102402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 -- 172.21.15.46:0/1078902752 shutdown_connections 2024-09-21T13:07:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 --2- 172.21.15.46:0/1078902752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1034100800 0x7f1034100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 --2- 172.21.15.46:0/1078902752 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034106800 0x7f1034106be0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 -- 172.21.15.46:0/1078902752 >> 172.21.15.46:0/1078902752 conn(0x7f10340fc520 msgr2=0x7f10340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 -- 172.21.15.46:0/1078902752 shutdown_connections 2024-09-21T13:07:14.176 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.174+0000 7f1039f78640 1 -- 172.21.15.46:0/1078902752 wait complete. 2024-09-21T13:07:14.177 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f1039f78640 1 Processor -- start 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f1039f78640 1 -- start start 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f1039f78640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 0x7f1034198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f1039f78640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1034106800 0x7f1034198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f1039f78640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f103410dcb0 con 0x7f1034100800 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f1039f78640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f103410db30 con 0x7f1034106800 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f10337fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 0x7f1034198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.175+0000 7f10337fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 0x7f1034198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53692/0 (socket says 172.21.15.46:53692) 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f10337fe640 1 -- 172.21.15.46:0/2642284259 learned_addr learned my addr 172.21.15.46:0/2642284259 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f1032ffd640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1034106800 0x7f1034198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f10337fe640 1 -- 172.21.15.46:0/2642284259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1034106800 msgr2=0x7f1034198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.178 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f10337fe640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1034106800 0x7f1034198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f10337fe640 1 -- 172.21.15.46:0/2642284259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1034199350 con 0x7f1034100800 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f10337fe640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 0x7f1034198810 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1024031460 tx=0x7f10240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f102403f070 con 0x7f1034100800 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10240035f0 con 0x7f1034100800 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10341995e0 con 0x7f1034100800 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1024035030 con 0x7f1034100800 2024-09-21T13:07:14.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.176+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10341a1b90 con 0x7f1034100800 2024-09-21T13:07:14.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.177+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1034101f40 con 0x7f1034100800 2024-09-21T13:07:14.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.178+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1024042070 con 0x7f1034100800 2024-09-21T13:07:14.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.179+0000 7f1030ff9640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f101c07af30 0x7f101c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.179+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f10240bea20 con 0x7f1034100800 2024-09-21T13:07:14.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.179+0000 7f1032ffd640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f101c07af30 0x7f101c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.179+0000 7f1032ffd640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f101c07af30 0x7f101c07d3f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f103406ad00 tx=0x7f102800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:14.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.183+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1024089f70 con 0x7f1034100800 2024-09-21T13:07:14.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:14 smithi176 ceph-mon[80162]: from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.450+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1034103a10 con 0x7f1034100800 2024-09-21T13:07:14.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.450+0000 7f1030ff9640 1 -- 172.21.15.46:0/2642284259 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f102408ee20 con 0x7f1034100800 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:07:14.452 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:14.453 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:07:14.453 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:07:14.453 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:07:14.453 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f101c07af30 msgr2=0x7f101c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f101c07af30 0x7f101c07d3f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f103406ad00 tx=0x7f102800b390 comp rx=0 tx=0).stop 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 msgr2=0x7f1034198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 0x7f1034198810 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1024031460 tx=0x7f10240045e0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 shutdown_connections 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f101c07af30 0x7f101c07d3f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1034106800 0x7f1034198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 --2- 172.21.15.46:0/2642284259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1034100800 0x7f1034198810 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 >> 172.21.15.46:0/2642284259 conn(0x7f10340fc520 msgr2=0x7f10340fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:14.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 shutdown_connections 2024-09-21T13:07:14.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.453+0000 7f1039f78640 1 -- 172.21.15.46:0/2642284259 wait complete. 2024-09-21T13:07:14.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.537+0000 7f2f4a252640 1 -- 172.21.15.46:0/2814810513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f441033e0 msgr2=0x7f2f4410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.537+0000 7f2f4a252640 1 --2- 172.21.15.46:0/2814810513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f441033e0 0x7f2f4410b8d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2f38009880 tx=0x7f2f3802a530 comp rx=0 tx=0).stop 2024-09-21T13:07:14.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 -- 172.21.15.46:0/2814810513 shutdown_connections 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 --2- 172.21.15.46:0/2814810513 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f441033e0 0x7f2f4410b8d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 --2- 172.21.15.46:0/2814810513 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f44102ac0 0x7f2f44102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 -- 172.21.15.46:0/2814810513 >> 172.21.15.46:0/2814810513 conn(0x7f2f440fc520 msgr2=0x7f2f440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 -- 172.21.15.46:0/2814810513 shutdown_connections 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 -- 172.21.15.46:0/2814810513 wait complete. 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 Processor -- start 2024-09-21T13:07:14.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.538+0000 7f2f4a252640 1 -- start start 2024-09-21T13:07:14.541 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f4a252640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 0x7f2f4419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f4a252640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f441033e0 0x7f2f4419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f4a252640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4410edf0 con 0x7f2f44102ac0 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f4a252640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f4410ec70 con 0x7f2f441033e0 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 0x7f2f4419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 0x7f2f4419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53706/0 (socket says 172.21.15.46:53706) 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 -- 172.21.15.46:0/1684070339 learned_addr learned my addr 172.21.15.46:0/1684070339 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f42ffd640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f441033e0 0x7f2f4419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 -- 172.21.15.46:0/1684070339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f441033e0 msgr2=0x7f2f4419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f441033e0 0x7f2f4419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 -- 172.21.15.46:0/1684070339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f44197800 con 0x7f2f44102ac0 2024-09-21T13:07:14.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f437fe640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 0x7f2f4419d680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c8f0 tx=0x7f2f3400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f340079b0 con 0x7f2f44102ac0 2024-09-21T13:07:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2f340054e0 con 0x7f2f44102ac0 2024-09-21T13:07:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2f34004dd0 con 0x7f2f44102ac0 2024-09-21T13:07:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.539+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f44197af0 con 0x7f2f44102ac0 2024-09-21T13:07:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.540+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f44198080 con 0x7f2f44102ac0 2024-09-21T13:07:14.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.540+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f4406aa90 con 0x7f2f44102ac0 2024-09-21T13:07:14.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.541+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2f34005020 con 0x7f2f44102ac0 2024-09-21T13:07:14.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.542+0000 7f2f40ff9640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.542+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2f3409dfb0 con 0x7f2f44102ac0 2024-09-21T13:07:14.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.542+0000 7f2f42ffd640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.542+0000 7f2f42ffd640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f38031460 tx=0x7f2f38009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:14.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.546+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f34014030 con 0x7f2f44102ac0 2024-09-21T13:07:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.772+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f2f44105f60 con 0x7f2f44102ac0 2024-09-21T13:07:14.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.772+0000 7f2f40ff9640 1 -- 172.21.15.46:0/1684070339 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f2f34069520 con 0x7f2f44102ac0 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:07:14.774 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:07:14.775 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:07:14.777 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:07:14.777 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:07:14.778 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:14.779 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2f2c07af30 msgr2=0x7f2f2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2f38031460 tx=0x7f2f38009560 comp rx=0 tx=0).stop 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 msgr2=0x7f2f4419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 0x7f2f4419d680 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2f3400c8f0 tx=0x7f2f3400cdb0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 shutdown_connections 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2f2c07af30 0x7f2f2c07d3f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f441033e0 0x7f2f4419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 --2- 172.21.15.46:0/1684070339 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f44102ac0 0x7f2f4419d680 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 >> 172.21.15.46:0/1684070339 conn(0x7f2f440fc520 msgr2=0x7f2f44108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:14.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 shutdown_connections 2024-09-21T13:07:14.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.775+0000 7f2f4a252640 1 -- 172.21.15.46:0/1684070339 wait complete. 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.861+0000 7f1b9c296640 1 -- 172.21.15.46:0/83403831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 msgr2=0x7f1b94100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.861+0000 7f1b9c296640 1 --2- 172.21.15.46:0/83403831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b94100c50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b84009880 tx=0x7f1b8402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- 172.21.15.46:0/83403831 shutdown_connections 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 --2- 172.21.15.46:0/83403831 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b94100c50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 --2- 172.21.15.46:0/83403831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b941067f0 0x7f1b94106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- 172.21.15.46:0/83403831 >> 172.21.15.46:0/83403831 conn(0x7f1b940fc550 msgr2=0x7f1b940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:14.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- 172.21.15.46:0/83403831 shutdown_connections 2024-09-21T13:07:14.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- 172.21.15.46:0/83403831 wait complete. 2024-09-21T13:07:14.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 Processor -- start 2024-09-21T13:07:14.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- start start 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b9419d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b941067f0 0x7f1b9419db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410dca0 con 0x7f1b941007f0 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.862+0000 7f1b9c296640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1b9410db20 con 0x7f1b941067f0 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b9419d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b9419d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53730/0 (socket says 172.21.15.46:53730) 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 -- 172.21.15.46:0/3662506215 learned_addr learned my addr 172.21.15.46:0/3662506215 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:14.865 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b99831640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b941067f0 0x7f1b9419db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 -- 172.21.15.46:0/3662506215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b941067f0 msgr2=0x7f1b9419db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b941067f0 0x7f1b9419db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 -- 172.21.15.46:0/3662506215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b94197780 con 0x7f1b941007f0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9a032640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b9419d600 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000d8d0 tx=0x7f1b9000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b90017070 con 0x7f1b941007f0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b94197a70 con 0x7f1b941007f0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b90010460 con 0x7f1b941007f0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b9000f5f0 con 0x7f1b941007f0 2024-09-21T13:07:14.866 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.863+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b94197fd0 con 0x7f1b941007f0 2024-09-21T13:07:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.864+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b94101f30 con 0x7f1b941007f0 2024-09-21T13:07:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.865+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1b90009a30 con 0x7f1b941007f0 2024-09-21T13:07:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.866+0000 7f1b8b7fe640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1b8007af90 0x7f1b8007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.866+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1b9009de90 con 0x7f1b941007f0 2024-09-21T13:07:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.866+0000 7f1b99831640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1b8007af90 0x7f1b8007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:14.867 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.866+0000 7f1b99831640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1b8007af90 0x7f1b8007d450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1b94198ad0 tx=0x7f1b84031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:14.871 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:14.870+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1b900693c0 con 0x7f1b941007f0 2024-09-21T13:07:15.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.078+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b94198280 con 0x7f1b8007af90 2024-09-21T13:07:15.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:15 smithi046 ceph-mon[108126]: pgmap v623: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:15.079 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:15 smithi046 ceph-mon[108126]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:15.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:15 smithi046 ceph-mon[108126]: from='client.34962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:15.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:15.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:15 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2642284259' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:07:15.080 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:15 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1684070339' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:07:15.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.079+0000 7f1b8b7fe640 1 -- 172.21.15.46:0/3662506215 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1b94198280 con 0x7f1b8007af90 2024-09-21T13:07:15.080 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:07:15.080 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:07:15.081 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1b8007af90 msgr2=0x7f1b8007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1b8007af90 0x7f1b8007d450 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1b94198ad0 tx=0x7f1b84031400 comp rx=0 tx=0).stop 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 msgr2=0x7f1b9419d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b9419d600 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b9000d8d0 tx=0x7f1b9000dd90 comp rx=0 tx=0).stop 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 shutdown_connections 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1b8007af90 0x7f1b8007d450 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b941067f0 0x7f1b9419db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 --2- 172.21.15.46:0/3662506215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1b941007f0 0x7f1b9419d600 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 >> 172.21.15.46:0/3662506215 conn(0x7f1b940fc550 msgr2=0x7f1b94069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 shutdown_connections 2024-09-21T13:07:15.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.082+0000 7f1b9c296640 1 -- 172.21.15.46:0/3662506215 wait complete. 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3173482322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 msgr2=0x7f8ba8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3173482322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8100c60 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009880 tx=0x7f8b9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3173482322 shutdown_connections 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3173482322 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8100c60 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3173482322 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba8106800 0x7f8ba8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3173482322 >> 172.21.15.46:0/3173482322 conn(0x7f8ba80fc520 msgr2=0x7f8ba80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3173482322 shutdown_connections 2024-09-21T13:07:15.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3173482322 wait complete. 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.170+0000 7f8bacbdb640 1 Processor -- start 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8bacbdb640 1 -- start start 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8bacbdb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8bacbdb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba8106800 0x7f8ba8198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8bacbdb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba810dcb0 con 0x7f8ba8100800 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8bacbdb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba810db30 con 0x7f8ba8106800 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53762/0 (socket says 172.21.15.46:53762) 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 -- 172.21.15.46:0/3997369553 learned_addr learned my addr 172.21.15.46:0/3997369553 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:15.173 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 -- 172.21.15.46:0/3997369553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba8106800 msgr2=0x7f8ba8198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba8106800 0x7f8ba8198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 -- 172.21.15.46:0/3997369553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba8199340 con 0x7f8ba8100800 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8ba659c640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8198800 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800d8d0 tx=0x7f8b9800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.171+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8b98017070 con 0x7f8ba8100800 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.172+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba8199630 con 0x7f8ba8100800 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.172+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8b98010460 con 0x7f8ba8100800 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.172+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8b9800f5f0 con 0x7f8ba8100800 2024-09-21T13:07:15.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.172+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba81a1c30 con 0x7f8ba8100800 2024-09-21T13:07:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.173+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba8101f40 con 0x7f8ba8100800 2024-09-21T13:07:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.173+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8b98009a30 con 0x7f8ba8100800 2024-09-21T13:07:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.174+0000 7f8b977fe640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8b9007af30 0x7f8b9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.174+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8b9809df90 con 0x7f8ba8100800 2024-09-21T13:07:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.174+0000 7f8ba5d9b640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8b9007af30 0x7f8b9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:15.175 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.174+0000 7f8ba5d9b640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8b9007af30 0x7f8b9007d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0096c0 tx=0x7f8b9c000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:15.179 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.178+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ba8199630 con 0x7f8ba8100800 2024-09-21T13:07:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:15 smithi176 ceph-mon[80162]: pgmap v623: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:15 smithi176 ceph-mon[80162]: from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:15 smithi176 ceph-mon[80162]: from='client.34962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:15 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2642284259' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:07:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:15 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1684070339' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.437+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8ba8108d90 con 0x7f8ba8100800 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.438+0000 7f8b977fe640 1 -- 172.21.15.46:0/3997369553 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f8b980694e0 con 0x7f8ba8100800 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:07:15.439 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:07:15.440 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8b9007af30 msgr2=0x7f8b9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8b9007af30 0x7f8b9007d3f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c0096c0 tx=0x7f8b9c000bc0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 msgr2=0x7f8ba8198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8198800 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8b9800d8d0 tx=0x7f8b9800dd90 comp rx=0 tx=0).stop 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 shutdown_connections 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8b9007af30 0x7f8b9007d3f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8ba8106800 0x7f8ba8198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 --2- 172.21.15.46:0/3997369553 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8ba8100800 0x7f8ba8198800 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 >> 172.21.15.46:0/3997369553 conn(0x7f8ba80fc520 msgr2=0x7f8ba80fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 shutdown_connections 2024-09-21T13:07:15.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:15.440+0000 7f8bacbdb640 1 -- 172.21.15.46:0/3997369553 wait complete. 2024-09-21T13:07:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:16 smithi176 ceph-mon[80162]: from='client.34974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:16 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3997369553' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:07:16.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:16 smithi046 ceph-mon[108126]: from='client.34974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:16.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:16 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3997369553' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:07:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:17 smithi176 ceph-mon[80162]: pgmap v624: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:17.386 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:17 smithi046 ceph-mon[108126]: pgmap v624: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:19 smithi176 ceph-mon[80162]: pgmap v625: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:19.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:19 smithi046 ceph-mon[108126]: pgmap v625: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:21 smithi176 ceph-mon[80162]: pgmap v626: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:21 smithi046 ceph-mon[108126]: pgmap v626: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:23 smithi176 ceph-mon[80162]: pgmap v627: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:23.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:23 smithi046 ceph-mon[108126]: pgmap v627: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:25.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:25 smithi176 ceph-mon[80162]: pgmap v628: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:25 smithi046 ceph-mon[108126]: pgmap v628: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:27 smithi176 ceph-mon[80162]: pgmap v629: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:27 smithi046 ceph-mon[108126]: pgmap v629: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:29 smithi176 ceph-mon[80162]: pgmap v630: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:29 smithi046 ceph-mon[108126]: pgmap v630: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:30.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:31 smithi176 ceph-mon[80162]: pgmap v631: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:31 smithi046 ceph-mon[108126]: pgmap v631: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:33 smithi176 ceph-mon[80162]: pgmap v632: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:33 smithi046 ceph-mon[108126]: pgmap v632: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:35 smithi176 ceph-mon[80162]: pgmap v633: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:35 smithi046 ceph-mon[108126]: pgmap v633: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:37 smithi176 ceph-mon[80162]: pgmap v634: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:37 smithi046 ceph-mon[108126]: pgmap v634: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:39 smithi176 ceph-mon[80162]: pgmap v635: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:39 smithi046 ceph-mon[108126]: pgmap v635: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:41 smithi176 ceph-mon[80162]: pgmap v636: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:41.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:41 smithi046 ceph-mon[108126]: pgmap v636: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:43 smithi176 ceph-mon[80162]: pgmap v637: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:43.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:43 smithi046 ceph-mon[108126]: pgmap v637: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:45 smithi046 ceph-mon[108126]: pgmap v638: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:45.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 -- 172.21.15.46:0/213890785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100640 msgr2=0x7f2a80100a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:45.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 --2- 172.21.15.46:0/213890785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100640 0x7f2a80100a20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009880 tx=0x7f2a7c02a490 comp rx=0 tx=0).stop 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 -- 172.21.15.46:0/213890785 shutdown_connections 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 --2- 172.21.15.46:0/213890785 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80100ff0 0x7f2a8010dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 --2- 172.21.15.46:0/213890785 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100640 0x7f2a80100a20 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 -- 172.21.15.46:0/213890785 >> 172.21.15.46:0/213890785 conn(0x7f2a800fc550 msgr2=0x7f2a800fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 -- 172.21.15.46:0/213890785 shutdown_connections 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.538+0000 7f2a875c7640 1 -- 172.21.15.46:0/213890785 wait complete. 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a875c7640 1 Processor -- start 2024-09-21T13:07:45.540 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a875c7640 1 -- start start 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a875c7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80100640 0x7f2a8019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a875c7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 0x7f2a8019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a875c7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80110f60 con 0x7f2a80100ff0 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a875c7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2a80110de0 con 0x7f2a80100640 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a84b62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 0x7f2a8019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a84b62640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 0x7f2a8019fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36492/0 (socket says 172.21.15.46:36492) 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a84b62640 1 -- 172.21.15.46:0/3053064626 learned_addr learned my addr 172.21.15.46:0/3053064626 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a85363640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80100640 0x7f2a8019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:45.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a84b62640 1 -- 172.21.15.46:0/3053064626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80100640 msgr2=0x7f2a8019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a84b62640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80100640 0x7f2a8019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.539+0000 7f2a84b62640 1 -- 172.21.15.46:0/3053064626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a80199950 con 0x7f2a80100ff0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.540+0000 7f2a84b62640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 0x7f2a8019fcd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000d8d0 tx=0x7f2a7000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.540+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a70017030 con 0x7f2a80100ff0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.540+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a70004020 con 0x7f2a80100ff0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.540+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a80199c40 con 0x7f2a80100ff0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.540+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a700047a0 con 0x7f2a80100ff0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.540+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8019a1d0 con 0x7f2a80100ff0 2024-09-21T13:07:45.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.541+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a8006a580 con 0x7f2a80100ff0 2024-09-21T13:07:45.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.542+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2a700041d0 con 0x7f2a80100ff0 2024-09-21T13:07:45.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.542+0000 7f2a767fc640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a6c07af80 0x7f2a6c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:45.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.543+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2a70018070 con 0x7f2a80100ff0 2024-09-21T13:07:45.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.543+0000 7f2a85363640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a6c07af80 0x7f2a6c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:45.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.543+0000 7f2a85363640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a6c07af80 0x7f2a6c07d440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:45.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.547+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2a70069370 con 0x7f2a80100ff0 2024-09-21T13:07:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:45 smithi176 ceph-mon[80162]: pgmap v638: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:07:45.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.756+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2a8019ae80 con 0x7f2a6c07af80 2024-09-21T13:07:45.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.757+0000 7f2a767fc640 1 -- 172.21.15.46:0/3053064626 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2a8019ae80 con 0x7f2a6c07af80 2024-09-21T13:07:45.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a6c07af80 msgr2=0x7f2a6c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:45.760 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a6c07af80 0x7f2a6c07d440 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c000c00 tx=0x7f2a7c031400 comp rx=0 tx=0).stop 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 msgr2=0x7f2a8019fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 0x7f2a8019fcd0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000d8d0 tx=0x7f2a7000dd90 comp rx=0 tx=0).stop 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 shutdown_connections 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2a6c07af80 0x7f2a6c07d440 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2a80100ff0 0x7f2a8019fcd0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 --2- 172.21.15.46:0/3053064626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80100640 0x7f2a8019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 >> 172.21.15.46:0/3053064626 conn(0x7f2a800fc550 msgr2=0x7f2a800fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 shutdown_connections 2024-09-21T13:07:45.761 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.759+0000 7f2a875c7640 1 -- 172.21.15.46:0/3053064626 wait complete. 2024-09-21T13:07:45.769 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:07:45.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 -- 172.21.15.46:0/3312076393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0106800 msgr2=0x7fead0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:45.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 --2- 172.21.15.46:0/3312076393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0106800 0x7fead0106be0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7feacc009880 tx=0x7feacc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 -- 172.21.15.46:0/3312076393 shutdown_connections 2024-09-21T13:07:45.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 --2- 172.21.15.46:0/3312076393 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead0100800 0x7fead0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 --2- 172.21.15.46:0/3312076393 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0106800 0x7fead0106be0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 -- 172.21.15.46:0/3312076393 >> 172.21.15.46:0/3312076393 conn(0x7fead00fc520 msgr2=0x7fead00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:45.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 -- 172.21.15.46:0/3312076393 shutdown_connections 2024-09-21T13:07:45.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.846+0000 7fead7844640 1 -- 172.21.15.46:0/3312076393 wait complete. 2024-09-21T13:07:45.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead7844640 1 Processor -- start 2024-09-21T13:07:45.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead7844640 1 -- start start 2024-09-21T13:07:45.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead7844640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 0x7fead019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:45.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead7844640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead0106800 0x7fead019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead7844640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fead010dcb0 con 0x7fead0100800 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead7844640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fead010db30 con 0x7fead0106800 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead55e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 0x7fead019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead55e0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 0x7fead019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36496/0 (socket says 172.21.15.46:36496) 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.847+0000 7fead55e0640 1 -- 172.21.15.46:0/1574639509 learned_addr learned my addr 172.21.15.46:0/1574639509 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead4ddf640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead0106800 0x7fead019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead55e0640 1 -- 172.21.15.46:0/1574639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead0106800 msgr2=0x7fead019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead55e0640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead0106800 0x7fead019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead55e0640 1 -- 172.21.15.46:0/1574639509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead01977b0 con 0x7fead0100800 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead55e0640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 0x7fead019d630 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feacc031460 tx=0x7feacc004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feacc03f070 con 0x7fead0100800 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead0197a40 con 0x7fead0100800 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feacc004a90 con 0x7fead0100800 2024-09-21T13:07:45.850 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feacc035030 con 0x7fead0100800 2024-09-21T13:07:45.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.848+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead0197f70 con 0x7fead0100800 2024-09-21T13:07:45.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.849+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead0101f40 con 0x7fead0100800 2024-09-21T13:07:45.851 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.850+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feacc042070 con 0x7fead0100800 2024-09-21T13:07:45.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.851+0000 7feac67fc640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feabc07af40 0x7feabc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:45.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.851+0000 7fead4ddf640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feabc07af40 0x7feabc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:45.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.851+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7feacc0bebb0 con 0x7fead0100800 2024-09-21T13:07:45.852 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.851+0000 7fead4ddf640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feabc07af40 0x7feabc07d400 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fead006b200 tx=0x7feac0005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:45.856 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:45.855+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feacc0c5080 con 0x7fead0100800 2024-09-21T13:07:46.062 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.061+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fead01982e0 con 0x7feabc07af40 2024-09-21T13:07:46.063 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.062+0000 7feac67fc640 1 -- 172.21.15.46:0/1574639509 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fead01982e0 con 0x7feabc07af40 2024-09-21T13:07:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.064+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feabc07af40 msgr2=0x7feabc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.066 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.064+0000 7fead7844640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feabc07af40 0x7feabc07d400 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fead006b200 tx=0x7feac0005f90 comp rx=0 tx=0).stop 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.064+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 msgr2=0x7fead019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.064+0000 7fead7844640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 0x7fead019d630 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7feacc031460 tx=0x7feacc004530 comp rx=0 tx=0).stop 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 shutdown_connections 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feabc07af40 0x7feabc07d400 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fead0106800 0x7fead019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 --2- 172.21.15.46:0/1574639509 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fead0100800 0x7fead019d630 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 >> 172.21.15.46:0/1574639509 conn(0x7fead00fc520 msgr2=0x7fead0109e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:46.067 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 shutdown_connections 2024-09-21T13:07:46.068 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.065+0000 7fead7844640 1 -- 172.21.15.46:0/1574639509 wait complete. 2024-09-21T13:07:46.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.149+0000 7fe84113f640 1 -- 172.21.15.46:0/4208207073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100c00 msgr2=0x7fe83c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.149+0000 7fe84113f640 1 --2- 172.21.15.46:0/4208207073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100c00 0x7fe83c104c50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe830009880 tx=0x7fe83002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.149+0000 7fe84113f640 1 -- 172.21.15.46:0/4208207073 shutdown_connections 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.149+0000 7fe84113f640 1 --2- 172.21.15.46:0/4208207073 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100c00 0x7fe83c104c50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.149+0000 7fe84113f640 1 --2- 172.21.15.46:0/4208207073 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100250 0x7fe83c100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.149+0000 7fe84113f640 1 -- 172.21.15.46:0/4208207073 >> 172.21.15.46:0/4208207073 conn(0x7fe83c0fbc90 msgr2=0x7fe83c0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.150+0000 7fe84113f640 1 -- 172.21.15.46:0/4208207073 shutdown_connections 2024-09-21T13:07:46.151 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.150+0000 7fe84113f640 1 -- 172.21.15.46:0/4208207073 wait complete. 2024-09-21T13:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.150+0000 7fe84113f640 1 Processor -- start 2024-09-21T13:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe84113f640 1 -- start start 2024-09-21T13:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe84113f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 0x7fe83c19c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe84113f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100c00 0x7fe83c19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.153 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe84113f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe83c10d4b0 con 0x7fe83c100250 2024-09-21T13:07:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe84113f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe83c10d330 con 0x7fe83c100c00 2024-09-21T13:07:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 0x7fe83c19c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 0x7fe83c19c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36516/0 (socket says 172.21.15.46:36516) 2024-09-21T13:07:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83ad9d640 1 -- 172.21.15.46:0/2893420443 learned_addr learned my addr 172.21.15.46:0/2893420443 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83a59c640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100c00 0x7fe83c19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83ad9d640 1 -- 172.21.15.46:0/2893420443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100c00 msgr2=0x7fe83c19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83ad9d640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100c00 0x7fe83c19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83ad9d640 1 -- 172.21.15.46:0/2893420443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe83c196860 con 0x7fe83c100250 2024-09-21T13:07:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.151+0000 7fe83a59c640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100c00 0x7fe83c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:07:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.152+0000 7fe83ad9d640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 0x7fe83c19c6a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00d8d0 tx=0x7fe82c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.152+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe82c017070 con 0x7fe83c100250 2024-09-21T13:07:46.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.152+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe83c196b50 con 0x7fe83c100250 2024-09-21T13:07:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.152+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe82c010460 con 0x7fe83c100250 2024-09-21T13:07:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.152+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe82c00f5f0 con 0x7fe83c100250 2024-09-21T13:07:46.157 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.152+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe83c1970b0 con 0x7fe83c100250 2024-09-21T13:07:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.153+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83c101730 con 0x7fe83c100250 2024-09-21T13:07:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.154+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe82c009a30 con 0x7fe83c100250 2024-09-21T13:07:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.154+0000 7fe823fff640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe82407af30 0x7fe82407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.154+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe82c09df90 con 0x7fe83c100250 2024-09-21T13:07:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.154+0000 7fe83a59c640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe82407af30 0x7fe82407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.158 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.155+0000 7fe83a59c640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe82407af30 0x7fe82407d3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe83c198050 tx=0x7fe830031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:46.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.159+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe82c0694e0 con 0x7fe83c100250 2024-09-21T13:07:46.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.353+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fe83c197e60 con 0x7fe82407af30 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.363+0000 7fe823fff640 1 -- 172.21.15.46:0/2893420443 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fe83c197e60 con 0x7fe82407af30 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (17m) 12m ago 28m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (21m) 12m ago 29m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (20m) 11m ago 28m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (16m) 12m ago 28m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (16m) 11m ago 28m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (17m) 12m ago 28m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:07:46.364 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (12m) 12m ago 23m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (12m) 12m ago 23m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (11m) 11m ago 23m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (11m) 11m ago 23m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (20m) 12m ago 30m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (19m) 11m ago 27m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (16m) 12m ago 30m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (16m) 11m ago 27m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (18m) 12m ago 28m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (18m) 11m ago 28m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (15m) 12m ago 26m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (15m) 12m ago 26m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (14m) 12m ago 25m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (13m) 11m ago 25m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:07:46.365 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (13m) 11m ago 24m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:07:46.366 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (12m) 11m ago 24m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:07:46.366 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (18m) 12m ago 28m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:07:46.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe82407af30 msgr2=0x7fe82407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe82407af30 0x7fe82407d3f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe83c198050 tx=0x7fe830031400 comp rx=0 tx=0).stop 2024-09-21T13:07:46.366 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 msgr2=0x7fe83c19c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 0x7fe83c19c6a0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00d8d0 tx=0x7fe82c00dd90 comp rx=0 tx=0).stop 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 shutdown_connections 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe82407af30 0x7fe82407d3f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe83c100c00 0x7fe83c19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 --2- 172.21.15.46:0/2893420443 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe83c100250 0x7fe83c19c6a0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 >> 172.21.15.46:0/2893420443 conn(0x7fe83c0fbc90 msgr2=0x7fe83c103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 shutdown_connections 2024-09-21T13:07:46.367 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.365+0000 7fe84113f640 1 -- 172.21.15.46:0/2893420443 wait complete. 2024-09-21T13:07:46.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 -- 172.21.15.46:0/4232015182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 msgr2=0x7f06c8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 --2- 172.21.15.46:0/4232015182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c8100c60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f06bc009880 tx=0x7f06bc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 -- 172.21.15.46:0/4232015182 shutdown_connections 2024-09-21T13:07:46.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 --2- 172.21.15.46:0/4232015182 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c8100c60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 --2- 172.21.15.46:0/4232015182 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 0x7f06c8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 -- 172.21.15.46:0/4232015182 >> 172.21.15.46:0/4232015182 conn(0x7f06c80fc520 msgr2=0x7f06c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:46.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 -- 172.21.15.46:0/4232015182 shutdown_connections 2024-09-21T13:07:46.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 -- 172.21.15.46:0/4232015182 wait complete. 2024-09-21T13:07:46.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.450+0000 7f06ce027640 1 Processor -- start 2024-09-21T13:07:46.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06ce027640 1 -- start start 2024-09-21T13:07:46.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06ce027640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c80fcc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06ce027640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 0x7f06c80fd150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06ce027640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810dcb0 con 0x7f06c8100800 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06ce027640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f06c810db30 con 0x7f06c8106800 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c80fcc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c80fcc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36544/0 (socket says 172.21.15.46:36544) 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 -- 172.21.15.46:0/2280881726 learned_addr learned my addr 172.21.15.46:0/2280881726 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 -- 172.21.15.46:0/2280881726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 msgr2=0x7f06c80fd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c6ffd640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 0x7f06c80fd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 0x7f06c80fd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 -- 172.21.15.46:0/2280881726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06c80fd690 con 0x7f06c8100800 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c6ffd640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 0x7f06c80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.451+0000 7f06c77fe640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c80fcc10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f06b800c8a0 tx=0x7f06b800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:46.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.452+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06b80079b0 con 0x7f06c8100800 2024-09-21T13:07:46.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.452+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06b8007b50 con 0x7f06c8100800 2024-09-21T13:07:46.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.452+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06c80fd980 con 0x7f06c8100800 2024-09-21T13:07:46.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.452+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06b8018700 con 0x7f06c8100800 2024-09-21T13:07:46.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.452+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06c81a3e00 con 0x7f06c8100800 2024-09-21T13:07:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.453+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06c8101f40 con 0x7f06c8100800 2024-09-21T13:07:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.454+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f06b8007d00 con 0x7f06c8100800 2024-09-21T13:07:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.454+0000 7f06c4ff9640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f06b007af30 0x7f06b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.454+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f06b809e3c0 con 0x7f06c8100800 2024-09-21T13:07:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.454+0000 7f06c6ffd640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f06b007af30 0x7f06b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.455+0000 7f06c6ffd640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f06b007af30 0x7f06b007d3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f06bc006010 tx=0x7f06bc0095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:46.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.459+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06b8014030 con 0x7f06c8100800 2024-09-21T13:07:46.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.720+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f06c8109e00 con 0x7f06c8100800 2024-09-21T13:07:46.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.720+0000 7f06c4ff9640 1 -- 172.21.15.46:0/2280881726 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f06b8069910 con 0x7f06c8100800 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:07:46.722 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:07:46.723 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:07:46.723 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:07:46.723 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:07:46.723 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:07:46.723 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f06b007af30 msgr2=0x7f06b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f06b007af30 0x7f06b007d3f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f06bc006010 tx=0x7f06bc0095f0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 msgr2=0x7f06c80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c80fcc10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f06b800c8a0 tx=0x7f06b800cd60 comp rx=0 tx=0).stop 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 shutdown_connections 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f06b007af30 0x7f06b007d3f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f06c8106800 0x7f06c80fd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 --2- 172.21.15.46:0/2280881726 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f06c8100800 0x7f06c80fcc10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 >> 172.21.15.46:0/2280881726 conn(0x7f06c80fc520 msgr2=0x7f06c806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 shutdown_connections 2024-09-21T13:07:46.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.723+0000 7f06ce027640 1 -- 172.21.15.46:0/2280881726 wait complete. 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 -- 172.21.15.46:0/910770579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 msgr2=0x7f410c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 --2- 172.21.15.46:0/910770579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c107ce0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f40fc009880 tx=0x7f40fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 -- 172.21.15.46:0/910770579 shutdown_connections 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 --2- 172.21.15.46:0/910770579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f410c101900 0x7f410c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 --2- 172.21.15.46:0/910770579 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c107ce0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 -- 172.21.15.46:0/910770579 >> 172.21.15.46:0/910770579 conn(0x7f410c0fd600 msgr2=0x7f410c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 -- 172.21.15.46:0/910770579 shutdown_connections 2024-09-21T13:07:46.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 -- 172.21.15.46:0/910770579 wait complete. 2024-09-21T13:07:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.808+0000 7f4110a2a640 1 Processor -- start 2024-09-21T13:07:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4110a2a640 1 -- start start 2024-09-21T13:07:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4110a2a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f410c101900 0x7f410c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4110a2a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4110a2a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f410c10ee30 con 0x7f410c107900 2024-09-21T13:07:46.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4110a2a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f410c10ecb0 con 0x7f410c101900 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4101d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4101d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36560/0 (socket says 172.21.15.46:36560) 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4101d9b640 1 -- 172.21.15.46:0/2175455392 learned_addr learned my addr 172.21.15.46:0/2175455392 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f410a59c640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f410c101900 0x7f410c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4101d9b640 1 -- 172.21.15.46:0/2175455392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f410c101900 msgr2=0x7f410c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4101d9b640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f410c101900 0x7f410c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.809+0000 7f4101d9b640 1 -- 172.21.15.46:0/2175455392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410c074f70 con 0x7f410c107900 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.810+0000 7f4101d9b640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c074a30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f40f400b420 tx=0x7f40f400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.810+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40f4011630 con 0x7f410c107900 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.810+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f40f4016070 con 0x7f410c107900 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.810+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410c075260 con 0x7f410c107900 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.810+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f40f4010d40 con 0x7f410c107900 2024-09-21T13:07:46.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.810+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410c1a3ee0 con 0x7f410c107900 2024-09-21T13:07:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.811+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f410c103040 con 0x7f410c107900 2024-09-21T13:07:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.812+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f40f401b460 con 0x7f410c107900 2024-09-21T13:07:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.812+0000 7f4103fff640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f807af80 0x7f40f807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.812+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f40f409d750 con 0x7f410c107900 2024-09-21T13:07:46.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.812+0000 7f410a59c640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f807af80 0x7f40f807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:46.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.813+0000 7f410a59c640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f807af80 0x7f40f807d440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0096c0 tx=0x7f40fc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:46.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:46.817+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f40f4021250 con 0x7f410c107900 2024-09-21T13:07:47.046 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.045+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f410c109e70 con 0x7f410c107900 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.046+0000 7f4103fff640 1 -- 172.21.15.46:0/2175455392 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f40f4068d20 con 0x7f410c107900 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:47.047 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:07:47.048 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:07:47.049 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:47.050 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f807af80 msgr2=0x7f40f807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f807af80 0x7f40f807d440 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0096c0 tx=0x7f40fc031400 comp rx=0 tx=0).stop 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 msgr2=0x7f410c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c074a30 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f40f400b420 tx=0x7f40f400b8e0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 shutdown_connections 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f40f807af80 0x7f40f807d440 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f410c107900 0x7f410c074a30 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 --2- 172.21.15.46:0/2175455392 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f410c101900 0x7f410c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.051 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 >> 172.21.15.46:0/2175455392 conn(0x7f410c0fd600 msgr2=0x7f410c0fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 shutdown_connections 2024-09-21T13:07:47.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.048+0000 7f4110a2a640 1 -- 172.21.15.46:0/2175455392 wait complete. 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 -- 172.21.15.46:0/2801247205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 msgr2=0x7f4934100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 --2- 172.21.15.46:0/2801247205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f4934100a30 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4930009880 tx=0x7f493002a490 comp rx=0 tx=0).stop 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 -- 172.21.15.46:0/2801247205 shutdown_connections 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 --2- 172.21.15.46:0/2801247205 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 0x7f493410dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 --2- 172.21.15.46:0/2801247205 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f4934100a30 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 -- 172.21.15.46:0/2801247205 >> 172.21.15.46:0/2801247205 conn(0x7f49340fc520 msgr2=0x7f49340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 -- 172.21.15.46:0/2801247205 shutdown_connections 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.134+0000 7f493bb74640 1 -- 172.21.15.46:0/2801247205 wait complete. 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f493bb74640 1 Processor -- start 2024-09-21T13:07:47.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f493bb74640 1 -- start start 2024-09-21T13:07:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f493bb74640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f493419f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f493bb74640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 0x7f493419fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f493bb74640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4934110fb0 con 0x7f4934100650 2024-09-21T13:07:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f493bb74640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4934110e30 con 0x7f4934101000 2024-09-21T13:07:47.138 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f4939910640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f493419f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f4939910640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f493419f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36576/0 (socket says 172.21.15.46:36576) 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.135+0000 7f4939910640 1 -- 172.21.15.46:0/1176566489 learned_addr learned my addr 172.21.15.46:0/1176566489 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f493910f640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 0x7f493419fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f4939910640 1 -- 172.21.15.46:0/1176566489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 msgr2=0x7f493419fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f4939910640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 0x7f493419fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f4939910640 1 -- 172.21.15.46:0/1176566489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49341999a0 con 0x7f4934100650 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f493910f640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 0x7f493419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f4939910640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f493419f7e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4930031460 tx=0x7f49300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f493003f070 con 0x7f4934100650 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f49300035f0 con 0x7f4934100650 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4930035030 con 0x7f4934100650 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4934199c30 con 0x7f4934100650 2024-09-21T13:07:47.139 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.136+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493419a1c0 con 0x7f4934100650 2024-09-21T13:07:47.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.137+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f493406aa90 con 0x7f4934100650 2024-09-21T13:07:47.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.138+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4930042070 con 0x7f4934100650 2024-09-21T13:07:47.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.138+0000 7f492affd640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af80 0x7f492007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:47.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.139+0000 7f493910f640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af80 0x7f492007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:47.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.139+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f49300be9c0 con 0x7f4934100650 2024-09-21T13:07:47.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.139+0000 7f493910f640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af80 0x7f492007d440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4934102520 tx=0x7f4924005e50 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:47.144 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.143+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4930089f90 con 0x7f4934100650 2024-09-21T13:07:47.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.349+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f493419aed0 con 0x7f492007af80 2024-09-21T13:07:47.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:47 smithi046 ceph-mon[108126]: pgmap v639: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:47.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:47 smithi046 ceph-mon[108126]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:47.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:47 smithi046 ceph-mon[108126]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:47.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:47 smithi046 ceph-mon[108126]: from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:47.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:47 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2280881726' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:07:47.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:47 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2175455392' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:07:47.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.350+0000 7f492affd640 1 -- 172.21.15.46:0/1176566489 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f493419aed0 con 0x7f492007af80 2024-09-21T13:07:47.351 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:07:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:07:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:07:47.351 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:07:47.352 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.352+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af80 msgr2=0x7f492007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.352+0000 7f493bb74640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af80 0x7f492007d440 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4934102520 tx=0x7f4924005e50 comp rx=0 tx=0).stop 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.352+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 msgr2=0x7f493419f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.352+0000 7f493bb74640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f493419f7e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4930031460 tx=0x7f49300045e0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 shutdown_connections 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f492007af80 0x7f492007d440 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4934101000 0x7f493419fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 --2- 172.21.15.46:0/1176566489 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4934100650 0x7f493419f7e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 >> 172.21.15.46:0/1176566489 conn(0x7f49340fc520 msgr2=0x7f49340fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:47.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 shutdown_connections 2024-09-21T13:07:47.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.353+0000 7f493bb74640 1 -- 172.21.15.46:0/1176566489 wait complete. 2024-09-21T13:07:47.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/688282583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18100800 msgr2=0x7f2d18100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/688282583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18100800 0x7f2d18100c60 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c009880 tx=0x7f2d0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/688282583 shutdown_connections 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/688282583 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18100800 0x7f2d18100c60 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/688282583 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d18106800 0x7f2d18106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/688282583 >> 172.21.15.46:0/688282583 conn(0x7f2d180fc520 msgr2=0x7f2d180fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/688282583 shutdown_connections 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.437+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/688282583 wait complete. 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.438+0000 7f2d1e7e1640 1 Processor -- start 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.438+0000 7f2d1e7e1640 1 -- start start 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.438+0000 7f2d1e7e1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d18100800 0x7f2d1819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.438+0000 7f2d1e7e1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 0x7f2d1819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.438+0000 7f2d1e7e1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1810dcd0 con 0x7f2d18106800 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.438+0000 7f2d1e7e1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2d1810db50 con 0x7f2d18100800 2024-09-21T13:07:47.441 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 0x7f2d1819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 0x7f2d1819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44326/0 (socket says 172.21.15.46:44326) 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 -- 172.21.15.46:0/763028360 learned_addr learned my addr 172.21.15.46:0/763028360 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d17fff640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d18100800 0x7f2d1819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 -- 172.21.15.46:0/763028360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d18100800 msgr2=0x7f2d1819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d18100800 0x7f2d1819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 -- 172.21.15.46:0/763028360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d181977e0 con 0x7f2d18106800 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d177fe640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 0x7f2d1819dba0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c031460 tx=0x7f2d0c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c03f070 con 0x7f2d18106800 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2d0c0035f0 con 0x7f2d18106800 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d18197a70 con 0x7f2d18106800 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2d0c035030 con 0x7f2d18106800 2024-09-21T13:07:47.442 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.439+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d18197fa0 con 0x7f2d18106800 2024-09-21T13:07:47.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.441+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d18101f40 con 0x7f2d18106800 2024-09-21T13:07:47.443 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.441+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2d0c042070 con 0x7f2d18106800 2024-09-21T13:07:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.442+0000 7f2d157fa640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2d0007af30 0x7f2d0007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:07:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.442+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2d0c0bead0 con 0x7f2d18106800 2024-09-21T13:07:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.442+0000 7f2d17fff640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2d0007af30 0x7f2d0007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:07:47.444 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.442+0000 7f2d17fff640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2d0007af30 0x7f2d0007d3f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d08005fd0 tx=0x7f2d08005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:07:47.447 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.446+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2d0c08a020 con 0x7f2d18106800 2024-09-21T13:07:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:47 smithi176 ceph-mon[80162]: pgmap v639: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:47 smithi176 ceph-mon[80162]: from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:47 smithi176 ceph-mon[80162]: from='client.34986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:47 smithi176 ceph-mon[80162]: from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:47 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2280881726' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:07:47.596 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:47 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2175455392' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:07:47.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.706+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f2d18109d80 con 0x7f2d18106800 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.707+0000 7f2d157fa640 1 -- 172.21.15.46:0/763028360 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f2d0c0be1c0 con 0x7f2d18106800 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:07:47.708 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2d0007af30 msgr2=0x7f2d0007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2d0007af30 0x7f2d0007d3f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f2d08005fd0 tx=0x7f2d08005850 comp rx=0 tx=0).stop 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 msgr2=0x7f2d1819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 0x7f2d1819dba0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2d0c031460 tx=0x7f2d0c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 shutdown_connections 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2d0007af30 0x7f2d0007d3f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2d18106800 0x7f2d1819dba0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 --2- 172.21.15.46:0/763028360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d18100800 0x7f2d1819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 >> 172.21.15.46:0/763028360 conn(0x7f2d180fc520 msgr2=0x7f2d1806a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:07:47.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 shutdown_connections 2024-09-21T13:07:47.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:07:47.709+0000 7f2d1e7e1640 1 -- 172.21.15.46:0/763028360 wait complete. 2024-09-21T13:07:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:48 smithi046 ceph-mon[108126]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:48.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:48 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/763028360' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:07:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:48 smithi176 ceph-mon[80162]: from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:07:48.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:48 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/763028360' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:07:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:49 smithi046 ceph-mon[108126]: pgmap v640: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:49.467 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:49 smithi176 ceph-mon[80162]: pgmap v640: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:51 smithi046 ceph-mon[108126]: pgmap v641: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:51 smithi176 ceph-mon[80162]: pgmap v641: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:53 smithi176 ceph-mon[80162]: pgmap v642: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:53 smithi046 ceph-mon[108126]: pgmap v642: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:55 smithi046 ceph-mon[108126]: pgmap v643: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:55 smithi176 ceph-mon[80162]: pgmap v643: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:57 smithi046 ceph-mon[108126]: pgmap v644: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:57 smithi176 ceph-mon[80162]: pgmap v644: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:59.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:07:59 smithi046 ceph-mon[108126]: pgmap v645: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:07:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:07:59 smithi176 ceph-mon[80162]: pgmap v645: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:01.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:01 smithi046 ceph-mon[108126]: pgmap v646: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:01 smithi176 ceph-mon[80162]: pgmap v646: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:03 smithi176 ceph-mon[80162]: pgmap v647: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:03 smithi046 ceph-mon[108126]: pgmap v647: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:05 smithi046 ceph-mon[108126]: pgmap v648: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:05 smithi176 ceph-mon[80162]: pgmap v648: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:07 smithi046 ceph-mon[108126]: pgmap v649: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:07 smithi176 ceph-mon[80162]: pgmap v649: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:09.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:09 smithi046 ceph-mon[108126]: pgmap v650: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:09 smithi176 ceph-mon[80162]: pgmap v650: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:11 smithi046 ceph-mon[108126]: pgmap v651: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:11 smithi176 ceph-mon[80162]: pgmap v651: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:13.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:13 smithi046 ceph-mon[108126]: pgmap v652: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:13 smithi176 ceph-mon[80162]: pgmap v652: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:15 smithi046 ceph-mon[108126]: pgmap v653: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:15 smithi176 ceph-mon[80162]: pgmap v653: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:17 smithi046 ceph-mon[108126]: pgmap v654: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:17.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:17 smithi176 ceph-mon[80162]: pgmap v654: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 -- 172.21.15.46:0/2849721742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 msgr2=0x7efc80101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 --2- 172.21.15.46:0/2849721742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc80101d60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7efc74009880 tx=0x7efc7402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 -- 172.21.15.46:0/2849721742 shutdown_connections 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 --2- 172.21.15.46:0/2849721742 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc80101d60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 --2- 172.21.15.46:0/2849721742 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc80107900 0x7efc80107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 -- 172.21.15.46:0/2849721742 >> 172.21.15.46:0/2849721742 conn(0x7efc800fd600 msgr2=0x7efc800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 -- 172.21.15.46:0/2849721742 shutdown_connections 2024-09-21T13:08:17.809 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.806+0000 7efc85b76640 1 -- 172.21.15.46:0/2849721742 wait complete. 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.807+0000 7efc85b76640 1 Processor -- start 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.807+0000 7efc85b76640 1 -- start start 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc85b76640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc8019d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc85b76640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc80107900 0x7efc8019db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc85b76640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7efc8010edd0 con 0x7efc80101900 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc85b76640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7efc8010ec50 con 0x7efc80107900 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc8019d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc8019d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36222/0 (socket says 172.21.15.46:36222) 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 -- 172.21.15.46:0/3690327839 learned_addr learned my addr 172.21.15.46:0/3690327839 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7effd640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc80107900 0x7efc8019db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 -- 172.21.15.46:0/3690327839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc80107900 msgr2=0x7efc8019db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:17.811 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc80107900 0x7efc8019db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 -- 172.21.15.46:0/3690327839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc801977a0 con 0x7efc80101900 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.808+0000 7efc7f7fe640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc8019d620 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efc7000d6f0 tx=0x7efc7000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.809+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc70017070 con 0x7efc80101900 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.809+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efc7000de00 con 0x7efc80101900 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.809+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc80197a90 con 0x7efc80101900 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.809+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efc70004bb0 con 0x7efc80101900 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.809+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc80197ff0 con 0x7efc80101900 2024-09-21T13:08:17.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.810+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc80103040 con 0x7efc80101900 2024-09-21T13:08:17.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.810+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7efc70009a30 con 0x7efc80101900 2024-09-21T13:08:17.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.811+0000 7efc7cff9640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efc6807af80 0x7efc6807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:17.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.811+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7efc7009dc80 con 0x7efc80101900 2024-09-21T13:08:17.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.811+0000 7efc7effd640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efc6807af80 0x7efc6807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:17.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.812+0000 7efc7effd640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efc6807af80 0x7efc6807d440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc80198af0 tx=0x7efc74031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:17.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:17.816+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7efc700a3020 con 0x7efc80101900 2024-09-21T13:08:18.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.020+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7efc801982a0 con 0x7efc6807af80 2024-09-21T13:08:18.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.021+0000 7efc7cff9640 1 -- 172.21.15.46:0/3690327839 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7efc801982a0 con 0x7efc6807af80 2024-09-21T13:08:18.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efc6807af80 msgr2=0x7efc6807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efc6807af80 0x7efc6807d440 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7efc80198af0 tx=0x7efc74031400 comp rx=0 tx=0).stop 2024-09-21T13:08:18.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 msgr2=0x7efc8019d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc8019d620 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7efc7000d6f0 tx=0x7efc7000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 shutdown_connections 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7efc6807af80 0x7efc6807d440 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efc80107900 0x7efc8019db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 --2- 172.21.15.46:0/3690327839 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7efc80101900 0x7efc8019d620 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 >> 172.21.15.46:0/3690327839 conn(0x7efc800fd600 msgr2=0x7efc800fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 shutdown_connections 2024-09-21T13:08:18.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.023+0000 7efc85b76640 1 -- 172.21.15.46:0/3690327839 wait complete. 2024-09-21T13:08:18.034 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:08:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/637011522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 msgr2=0x7f2e4410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/637011522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4410b8c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009880 tx=0x7f2e3802a530 comp rx=0 tx=0).stop 2024-09-21T13:08:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/637011522 shutdown_connections 2024-09-21T13:08:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/637011522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4410b8c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/637011522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 0x7f2e44102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/637011522 >> 172.21.15.46:0/637011522 conn(0x7f2e440fc550 msgr2=0x7f2e440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/637011522 shutdown_connections 2024-09-21T13:08:18.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.109+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/637011522 wait complete. 2024-09-21T13:08:18.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4bdaf640 1 Processor -- start 2024-09-21T13:08:18.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4bdaf640 1 -- start start 2024-09-21T13:08:18.115 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4bdaf640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 0x7f2e4419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4bdaf640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4bdaf640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410ede0 con 0x7f2e441033d0 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4bdaf640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2e4410ec60 con 0x7f2e44102ab0 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4934a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4934a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36250/0 (socket says 172.21.15.46:36250) 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.110+0000 7f2e4934a640 1 -- 172.21.15.46:0/3745821343 learned_addr learned my addr 172.21.15.46:0/3745821343 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:18.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e49b4b640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 0x7f2e4419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e4934a640 1 -- 172.21.15.46:0/3745821343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 msgr2=0x7f2e4419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e4934a640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 0x7f2e4419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e4934a640 1 -- 172.21.15.46:0/3745821343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e44197810 con 0x7f2e441033d0 2024-09-21T13:08:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e49b4b640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 0x7f2e4419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:08:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e4934a640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4419dbd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2e38031460 tx=0x7f2e380045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:18.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e3803f070 con 0x7f2e441033d0 2024-09-21T13:08:18.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e380035f0 con 0x7f2e441033d0 2024-09-21T13:08:18.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e44197aa0 con 0x7f2e441033d0 2024-09-21T13:08:18.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e38035030 con 0x7f2e441033d0 2024-09-21T13:08:18.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.111+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e44197fd0 con 0x7f2e441033d0 2024-09-21T13:08:18.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.113+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e4406a580 con 0x7f2e441033d0 2024-09-21T13:08:18.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.113+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2e38042070 con 0x7f2e441033d0 2024-09-21T13:08:18.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.114+0000 7f2e36ffd640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e3007af80 0x7f2e3007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.114+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2e380be870 con 0x7f2e441033d0 2024-09-21T13:08:18.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.114+0000 7f2e49b4b640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e3007af80 0x7f2e3007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.115+0000 7f2e49b4b640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e3007af80 0x7f2e3007d440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009c20 tx=0x7f2e40005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:18.121 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.119+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e38089e40 con 0x7f2e441033d0 2024-09-21T13:08:18.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.324+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2e44198280 con 0x7f2e3007af80 2024-09-21T13:08:18.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.325+0000 7f2e36ffd640 1 -- 172.21.15.46:0/3745821343 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f2e44198280 con 0x7f2e3007af80 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.327+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e3007af80 msgr2=0x7f2e3007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.327+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e3007af80 0x7f2e3007d440 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2e40009c20 tx=0x7f2e40005f90 comp rx=0 tx=0).stop 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.327+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 msgr2=0x7f2e4419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4419dbd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f2e38031460 tx=0x7f2e380045c0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 shutdown_connections 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2e3007af80 0x7f2e3007d440 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2e441033d0 0x7f2e4419dbd0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 --2- 172.21.15.46:0/3745821343 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e44102ab0 0x7f2e4419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 >> 172.21.15.46:0/3745821343 conn(0x7f2e440fc550 msgr2=0x7f2e44108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 shutdown_connections 2024-09-21T13:08:18.363 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.328+0000 7f2e4bdaf640 1 -- 172.21.15.46:0/3745821343 wait complete. 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.416+0000 7f85104ca640 1 -- 172.21.15.46:0/3557811284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85081033d0 msgr2=0x7f850810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.416+0000 7f85104ca640 1 --2- 172.21.15.46:0/3557811284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85081033d0 0x7f850810b8c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009880 tx=0x7f84f802a530 comp rx=0 tx=0).stop 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 -- 172.21.15.46:0/3557811284 shutdown_connections 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 --2- 172.21.15.46:0/3557811284 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f85081033d0 0x7f850810b8c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 --2- 172.21.15.46:0/3557811284 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8508102ab0 0x7f8508102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 -- 172.21.15.46:0/3557811284 >> 172.21.15.46:0/3557811284 conn(0x7f85080fc550 msgr2=0x7f85080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 -- 172.21.15.46:0/3557811284 shutdown_connections 2024-09-21T13:08:18.419 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 -- 172.21.15.46:0/3557811284 wait complete. 2024-09-21T13:08:18.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 Processor -- start 2024-09-21T13:08:18.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.417+0000 7f85104ca640 1 -- start start 2024-09-21T13:08:18.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f85104ca640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 0x7f8508100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f85104ca640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85081033d0 0x7f8508100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f85104ca640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f850810ede0 con 0x7f8508102ab0 2024-09-21T13:08:18.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f85104ca640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f850810ec60 con 0x7f85081033d0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 0x7f8508100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 0x7f8508100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36272/0 (socket says 172.21.15.46:36272) 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 -- 172.21.15.46:0/597460569 learned_addr learned my addr 172.21.15.46:0/597460569 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 -- 172.21.15.46:0/597460569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85081033d0 msgr2=0x7f8508100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85081033d0 0x7f8508100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 -- 172.21.15.46:0/597460569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8508101190 con 0x7f8508102ab0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f850e266640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 0x7f8508100710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f850400d6f0 tx=0x7f850400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8504017070 con 0x7f8508102ab0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f850400de00 con 0x7f8508102ab0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8508101480 con 0x7f8508102ab0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8504004bb0 con 0x7f8508102ab0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.418+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85081a3e90 con 0x7f8508102ab0 2024-09-21T13:08:18.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.419+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f850806a580 con 0x7f8508102ab0 2024-09-21T13:08:18.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.420+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8504004e60 con 0x7f8508102ab0 2024-09-21T13:08:18.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.421+0000 7f84ff7fe640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84f407af30 0x7f84f407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.421+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f850409e0a0 con 0x7f8508102ab0 2024-09-21T13:08:18.423 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.421+0000 7f850da65640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84f407af30 0x7f84f407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.424 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.421+0000 7f850da65640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84f407af30 0x7f84f407d3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f84f80096c0 tx=0x7f84f8000bc0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:18.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.425+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8504069710 con 0x7f8508102ab0 2024-09-21T13:08:18.621 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.619+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8508062630 con 0x7f84f407af30 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.629+0000 7f84ff7fe640 1 -- 172.21.15.46:0/597460569 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f8508062630 con 0x7f84f407af30 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (18m) 12m ago 29m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (21m) 12m ago 29m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (21m) 12m ago 28m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (16m) 12m ago 29m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (16m) 12m ago 28m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:08:18.631 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (18m) 12m ago 29m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (12m) 12m ago 24m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (12m) 12m ago 23m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (12m) 12m ago 24m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (12m) 12m ago 23m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (20m) 12m ago 30m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (19m) 12m ago 28m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (17m) 12m ago 30m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (16m) 12m ago 28m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (19m) 12m ago 29m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (19m) 12m ago 28m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (16m) 12m ago 27m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (15m) 12m ago 26m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (14m) 12m ago 26m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:08:18.632 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (14m) 12m ago 25m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:08:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (13m) 12m ago 25m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:08:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (13m) 12m ago 25m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:08:18.633 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (18m) 12m ago 28m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:08:18.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84f407af30 msgr2=0x7f84f407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84f407af30 0x7f84f407d3f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f84f80096c0 tx=0x7f84f8000bc0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.633 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 msgr2=0x7f8508100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 0x7f8508100710 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f850400d6f0 tx=0x7f850400dbb0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 shutdown_connections 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f84f407af30 0x7f84f407d3f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85081033d0 0x7f8508100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 --2- 172.21.15.46:0/597460569 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8508102ab0 0x7f8508100710 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 >> 172.21.15.46:0/597460569 conn(0x7f85080fc550 msgr2=0x7f8508108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 shutdown_connections 2024-09-21T13:08:18.634 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.631+0000 7f85104ca640 1 -- 172.21.15.46:0/597460569 wait complete. 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 -- 172.21.15.46:0/3113807395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 msgr2=0x7fe13c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 --2- 172.21.15.46:0/3113807395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c107ce0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fe12c009880 tx=0x7fe12c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 -- 172.21.15.46:0/3113807395 shutdown_connections 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 --2- 172.21.15.46:0/3113807395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe13c101900 0x7fe13c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 --2- 172.21.15.46:0/3113807395 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c107ce0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 -- 172.21.15.46:0/3113807395 >> 172.21.15.46:0/3113807395 conn(0x7fe13c0fd600 msgr2=0x7fe13c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 -- 172.21.15.46:0/3113807395 shutdown_connections 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.714+0000 7fe1423a6640 1 -- 172.21.15.46:0/3113807395 wait complete. 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.715+0000 7fe1423a6640 1 Processor -- start 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.715+0000 7fe1423a6640 1 -- start start 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe1423a6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe13c101900 0x7fe13c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.718 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe1423a6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe1423a6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c10edd0 con 0x7fe13c107900 2024-09-21T13:08:18.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe1423a6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c10ec50 con 0x7fe13c101900 2024-09-21T13:08:18.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36276/0 (socket says 172.21.15.46:36276) 2024-09-21T13:08:18.721 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 -- 172.21.15.46:0/1375664181 learned_addr learned my addr 172.21.15.46:0/1375664181 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:18.722 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13bfff640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe13c101900 0x7fe13c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 -- 172.21.15.46:0/1375664181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe13c101900 msgr2=0x7fe13c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe13c101900 0x7fe13c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 -- 172.21.15.46:0/1375664181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c1977a0 con 0x7fe13c107900 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe13b7fe640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c19db60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe13000d6f0 tx=0x7fe13000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.716+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe130017070 con 0x7fe13c107900 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.717+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe13000de00 con 0x7fe13c107900 2024-09-21T13:08:18.723 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.717+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c197a90 con 0x7fe13c107900 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.717+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe130004bb0 con 0x7fe13c107900 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.717+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c198020 con 0x7fe13c107900 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.718+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c103040 con 0x7fe13c107900 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.718+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe130009a30 con 0x7fe13c107900 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.719+0000 7fe1397fa640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe12407af80 0x7fe12407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.719+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe13009db70 con 0x7fe13c107900 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.719+0000 7fe13bfff640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe12407af80 0x7fe12407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:18.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.720+0000 7fe13bfff640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe12407af80 0x7fe12407d440 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0096c0 tx=0x7fe12c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:18.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.723+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe130069140 con 0x7fe13c107900 2024-09-21T13:08:18.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.986+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe13c109e70 con 0x7fe13c107900 2024-09-21T13:08:18.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.987+0000 7fe1397fa640 1 -- 172.21.15.46:0/1375664181 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe13006dff0 con 0x7fe13c107900 2024-09-21T13:08:18.990 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:08:18.990 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:08:18.990 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:08:18.990 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:18.990 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:08:18.991 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:08:18.992 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:18.992 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:08:18.992 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:08:18.992 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:08:18.992 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:08:18.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe12407af80 msgr2=0x7fe12407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe12407af80 0x7fe12407d440 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe12c0096c0 tx=0x7fe12c031400 comp rx=0 tx=0).stop 2024-09-21T13:08:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 msgr2=0x7fe13c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c19db60 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe13000d6f0 tx=0x7fe13000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 shutdown_connections 2024-09-21T13:08:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe12407af80 0x7fe12407d440 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.994 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe13c107900 0x7fe13c19db60 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 --2- 172.21.15.46:0/1375664181 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe13c101900 0x7fe13c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 >> 172.21.15.46:0/1375664181 conn(0x7fe13c0fd600 msgr2=0x7fe13c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 shutdown_connections 2024-09-21T13:08:18.995 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:18.989+0000 7fe1423a6640 1 -- 172.21.15.46:0/1375664181 wait complete. 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 -- 172.21.15.46:0/854849749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 msgr2=0x7ff748100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 --2- 172.21.15.46:0/854849749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff748100c60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ff734009880 tx=0x7ff73402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 -- 172.21.15.46:0/854849749 shutdown_connections 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 --2- 172.21.15.46:0/854849749 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff748100c60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 --2- 172.21.15.46:0/854849749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff748106800 0x7ff748106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 -- 172.21.15.46:0/854849749 >> 172.21.15.46:0/854849749 conn(0x7ff7480fc520 msgr2=0x7ff7480fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:19.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 -- 172.21.15.46:0/854849749 shutdown_connections 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.073+0000 7ff74ee40640 1 -- 172.21.15.46:0/854849749 wait complete. 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74ee40640 1 Processor -- start 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74ee40640 1 -- start start 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74ee40640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff7480fcc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74ee40640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff748106800 0x7ff7480fd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74ee40640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7ff74810dcd0 con 0x7ff748100800 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74ee40640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7ff74810db50 con 0x7ff748106800 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74cbdc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff7480fcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74cbdc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff7480fcc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36282/0 (socket says 172.21.15.46:36282) 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.074+0000 7ff74cbdc640 1 -- 172.21.15.46:0/1095812888 learned_addr learned my addr 172.21.15.46:0/1095812888 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff747fff640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff748106800 0x7ff7480fd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff74cbdc640 1 -- 172.21.15.46:0/1095812888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff748106800 msgr2=0x7ff7480fd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff74cbdc640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff748106800 0x7ff7480fd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff74cbdc640 1 -- 172.21.15.46:0/1095812888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480fd6d0 con 0x7ff748100800 2024-09-21T13:08:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff74cbdc640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff7480fcc50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c8f0 tx=0x7ff73c00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff73c0079b0 con 0x7ff748100800 2024-09-21T13:08:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff73c0054e0 con 0x7ff748100800 2024-09-21T13:08:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7480fd9c0 con 0x7ff748100800 2024-09-21T13:08:19.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff73c004dd0 con 0x7ff748100800 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.075+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481a3e70 con 0x7ff748100800 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.076+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff748101f40 con 0x7ff748100800 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.077+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7ff73c005020 con 0x7ff748100800 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.077+0000 7ff745ffb640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff73807aed0 0x7ff73807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.077+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7ff73c09e170 con 0x7ff748100800 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.078+0000 7ff747fff640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff73807aed0 0x7ff73807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.078+0000 7ff747fff640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff73807aed0 0x7ff73807d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff7480fe6e0 tx=0x7ff734031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:19.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.082+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff73c014030 con 0x7ff748100800 2024-09-21T13:08:19.310 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.308+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7ff748109d80 con 0x7ff748100800 2024-09-21T13:08:19.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:19 smithi046 ceph-mon[108126]: pgmap v655: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:19.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:19 smithi046 ceph-mon[108126]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:19.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:19 smithi046 ceph-mon[108126]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:19.311 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:19 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1375664181' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:08:19.311 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.309+0000 7ff745ffb640 1 -- 172.21.15.46:0/1095812888 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7ff73c069620 con 0x7ff748100800 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:08:19.312 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:08:19.313 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:19.314 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:19.315 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:19.315 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.311+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff73807aed0 msgr2=0x7ff73807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.311+0000 7ff74ee40640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff73807aed0 0x7ff73807d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff7480fe6e0 tx=0x7ff734031420 comp rx=0 tx=0).stop 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.311+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 msgr2=0x7ff7480fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.311+0000 7ff74ee40640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff7480fcc50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00c8f0 tx=0x7ff73c00cdb0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 shutdown_connections 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7ff73807aed0 0x7ff73807d390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff748106800 0x7ff7480fd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 --2- 172.21.15.46:0/1095812888 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7ff748100800 0x7ff7480fcc50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 >> 172.21.15.46:0/1095812888 conn(0x7ff7480fc520 msgr2=0x7ff74806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:19.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 shutdown_connections 2024-09-21T13:08:19.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.312+0000 7ff74ee40640 1 -- 172.21.15.46:0/1095812888 wait complete. 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 -- 172.21.15.46:0/358962383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e14102ac0 msgr2=0x7f0e14102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/358962383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e14102ac0 0x7f0e14102ea0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0e04009880 tx=0x7f0e0402a530 comp rx=0 tx=0).stop 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 -- 172.21.15.46:0/358962383 shutdown_connections 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/358962383 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e141033e0 0x7f0e1410b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/358962383 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e14102ac0 0x7f0e14102ea0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 -- 172.21.15.46:0/358962383 >> 172.21.15.46:0/358962383 conn(0x7f0e140fc520 msgr2=0x7f0e140fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 -- 172.21.15.46:0/358962383 shutdown_connections 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.397+0000 7f0e1a73b640 1 -- 172.21.15.46:0/358962383 wait complete. 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.398+0000 7f0e1a73b640 1 Processor -- start 2024-09-21T13:08:19.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.398+0000 7f0e1a73b640 1 -- start start 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.398+0000 7f0e1a73b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e14102ac0 0x7f0e14100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.398+0000 7f0e1a73b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 0x7f0e14100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.398+0000 7f0e1a73b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1410edf0 con 0x7f0e141033e0 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.398+0000 7f0e1a73b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1410ec70 con 0x7f0e14102ac0 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 0x7f0e14100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 0x7f0e14100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36304/0 (socket says 172.21.15.46:36304) 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 -- 172.21.15.46:0/3331608872 learned_addr learned my addr 172.21.15.46:0/3331608872 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e13fff640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e14102ac0 0x7f0e14100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 -- 172.21.15.46:0/3331608872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e14102ac0 msgr2=0x7f0e14100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e14102ac0 0x7f0e14100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.402 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 -- 172.21.15.46:0/3331608872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e141011a0 con 0x7f0e141033e0 2024-09-21T13:08:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e137fe640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 0x7f0e14100c60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800d6d0 tx=0x7f0e0800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e08017070 con 0x7f0e141033e0 2024-09-21T13:08:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e14101490 con 0x7f0e141033e0 2024-09-21T13:08:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e080054e0 con 0x7f0e141033e0 2024-09-21T13:08:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e08004ae0 con 0x7f0e141033e0 2024-09-21T13:08:19.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.399+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e141a3e40 con 0x7f0e141033e0 2024-09-21T13:08:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.401+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1406aa90 con 0x7f0e141033e0 2024-09-21T13:08:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.401+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0e08004de0 con 0x7f0e141033e0 2024-09-21T13:08:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.402+0000 7f0e117fa640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dfc07af30 0x7f0dfc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.402+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0e0809dbf0 con 0x7f0e141033e0 2024-09-21T13:08:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.402+0000 7f0e13fff640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dfc07af30 0x7f0dfc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.402+0000 7f0e13fff640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dfc07af30 0x7f0dfc07d3f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0e040096c0 tx=0x7f0e04031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:19.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.406+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e08069140 con 0x7f0e141033e0 2024-09-21T13:08:19.467 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:19 smithi176 ceph-mon[80162]: pgmap v655: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:19.468 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:19 smithi176 ceph-mon[80162]: from='client.35010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:19.468 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:19 smithi176 ceph-mon[80162]: from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:19.468 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:19 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1375664181' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:08:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.613+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0e1410b640 con 0x7f0dfc07af30 2024-09-21T13:08:19.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.615+0000 7f0e117fa640 1 -- 172.21.15.46:0/3331608872 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0e1410b640 con 0x7f0dfc07af30 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:08:19.617 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:08:19.618 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:08:19.618 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:08:19.618 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:08:19.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dfc07af30 msgr2=0x7f0dfc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dfc07af30 0x7f0dfc07d3f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0e040096c0 tx=0x7f0e04031400 comp rx=0 tx=0).stop 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 msgr2=0x7f0e14100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 0x7f0e14100c60 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0e0800d6d0 tx=0x7f0e0800db90 comp rx=0 tx=0).stop 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 shutdown_connections 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0dfc07af30 0x7f0dfc07d3f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e141033e0 0x7f0e14100c60 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 --2- 172.21.15.46:0/3331608872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e14102ac0 0x7f0e14100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 >> 172.21.15.46:0/3331608872 conn(0x7f0e140fc520 msgr2=0x7f0e1410af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 shutdown_connections 2024-09-21T13:08:19.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.617+0000 7f0e1a73b640 1 -- 172.21.15.46:0/3331608872 wait complete. 2024-09-21T13:08:19.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 -- 172.21.15.46:0/1116082816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501007f0 msgr2=0x7f8f50100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 --2- 172.21.15.46:0/1116082816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501007f0 0x7f8f50100c50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009880 tx=0x7f8f4002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 -- 172.21.15.46:0/1116082816 shutdown_connections 2024-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 --2- 172.21.15.46:0/1116082816 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501007f0 0x7f8f50100c50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 --2- 172.21.15.46:0/1116082816 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501067f0 0x7f8f50106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 -- 172.21.15.46:0/1116082816 >> 172.21.15.46:0/1116082816 conn(0x7f8f500fc550 msgr2=0x7f8f500fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 -- 172.21.15.46:0/1116082816 shutdown_connections 2024-09-21T13:08:19.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 -- 172.21.15.46:0/1116082816 wait complete. 2024-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 Processor -- start 2024-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.702+0000 7f8f5819f640 1 -- start start 2024-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5819f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501007f0 0x7f8f5019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5819f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 0x7f8f5019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5819f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5010dcc0 con 0x7f8f501067f0 2024-09-21T13:08:19.709 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5819f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5010db40 con 0x7f8f501007f0 2024-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 0x7f8f5019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 0x7f8f5019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:36328/0 (socket says 172.21.15.46:36328) 2024-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 -- 172.21.15.46:0/577263669 learned_addr learned my addr 172.21.15.46:0/577263669 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f55f3b640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501007f0 0x7f8f5019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 -- 172.21.15.46:0/577263669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501007f0 msgr2=0x7f8f5019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.710 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501007f0 0x7f8f5019d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 -- 172.21.15.46:0/577263669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f501977e0 con 0x7f8f501067f0 2024-09-21T13:08:19.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f55f3b640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501007f0 0x7f8f5019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:08:19.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f5573a640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 0x7f8f5019dba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8f40031460 tx=0x7f8f400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:19.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f4003f070 con 0x7f8f501067f0 2024-09-21T13:08:19.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.703+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f40004cf0 con 0x7f8f501067f0 2024-09-21T13:08:19.711 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.704+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f50197a70 con 0x7f8f501067f0 2024-09-21T13:08:19.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.704+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f40035030 con 0x7f8f501067f0 2024-09-21T13:08:19.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.704+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f50197fa0 con 0x7f8f501067f0 2024-09-21T13:08:19.712 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.704+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f50101f30 con 0x7f8f501067f0 2024-09-21T13:08:19.713 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.705+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8f40042070 con 0x7f8f501067f0 2024-09-21T13:08:19.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.706+0000 7f8f46ffd640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8f3c07af80 0x7f8f3c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:19.714 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.706+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8f400bea90 con 0x7f8f501067f0 2024-09-21T13:08:19.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.706+0000 7f8f55f3b640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8f3c07af80 0x7f8f3c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:19.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.706+0000 7f8f55f3b640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8f3c07af80 0x7f8f3c07d440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0058c0 tx=0x7f8f4c005d30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:19.715 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.710+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8f4008a060 con 0x7f8f501067f0 2024-09-21T13:08:19.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.971+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f8f50198d10 con 0x7f8f501067f0 2024-09-21T13:08:19.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.971+0000 7f8f46ffd640 1 -- 172.21.15.46:0/577263669 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f8f4008ef10 con 0x7f8f501067f0 2024-09-21T13:08:19.973 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:08:19.973 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:08:19.973 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:08:19.974 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:08:19.974 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:08:19.974 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:08:19.974 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8f3c07af80 msgr2=0x7f8f3c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8f3c07af80 0x7f8f3c07d440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0058c0 tx=0x7f8f4c005d30 comp rx=0 tx=0).stop 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 msgr2=0x7f8f5019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 0x7f8f5019dba0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8f40031460 tx=0x7f8f400048f0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 shutdown_connections 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8f3c07af80 0x7f8f3c07d440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8f501067f0 0x7f8f5019dba0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 --2- 172.21.15.46:0/577263669 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8f501007f0 0x7f8f5019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 >> 172.21.15.46:0/577263669 conn(0x7f8f500fc550 msgr2=0x7f8f50069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.973+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 shutdown_connections 2024-09-21T13:08:19.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:19.974+0000 7f8f5819f640 1 -- 172.21.15.46:0/577263669 wait complete. 2024-09-21T13:08:20.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:20 smithi046 ceph-mon[108126]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:20.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1095812888' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:08:20.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/577263669' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:08:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:20 smithi176 ceph-mon[80162]: from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1095812888' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:08:20.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/577263669' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:08:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:21 smithi046 ceph-mon[108126]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:21 smithi046 ceph-mon[108126]: pgmap v656: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:21 smithi176 ceph-mon[80162]: from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:21 smithi176 ceph-mon[80162]: pgmap v656: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:23.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:23 smithi046 ceph-mon[108126]: pgmap v657: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:23 smithi176 ceph-mon[80162]: pgmap v657: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:25 smithi046 ceph-mon[108126]: pgmap v658: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:25 smithi176 ceph-mon[80162]: pgmap v658: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:27 smithi046 ceph-mon[108126]: pgmap v659: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:27 smithi176 ceph-mon[80162]: pgmap v659: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:29 smithi046 ceph-mon[108126]: pgmap v660: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:29 smithi176 ceph-mon[80162]: pgmap v660: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:31 smithi046 ceph-mon[108126]: pgmap v661: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:31 smithi176 ceph-mon[80162]: pgmap v661: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:33 smithi046 ceph-mon[108126]: pgmap v662: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:33.487 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:33 smithi176 ceph-mon[80162]: pgmap v662: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:35 smithi046 ceph-mon[108126]: pgmap v663: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:35 smithi176 ceph-mon[80162]: pgmap v663: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:37 smithi046 ceph-mon[108126]: pgmap v664: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:37 smithi176 ceph-mon[80162]: pgmap v664: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:39 smithi046 ceph-mon[108126]: pgmap v665: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:39 smithi176 ceph-mon[80162]: pgmap v665: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:41 smithi176 ceph-mon[80162]: pgmap v666: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:41 smithi046 ceph-mon[108126]: pgmap v666: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:43 smithi176 ceph-mon[80162]: pgmap v667: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:43 smithi046 ceph-mon[108126]: pgmap v667: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:45 smithi046 ceph-mon[108126]: pgmap v668: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:45 smithi176 ceph-mon[80162]: pgmap v668: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:08:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:47 smithi176 ceph-mon[80162]: pgmap v669: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:47 smithi046 ceph-mon[108126]: pgmap v669: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:49 smithi176 ceph-mon[80162]: pgmap v670: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:49 smithi046 ceph-mon[108126]: pgmap v670: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:50.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 -- 172.21.15.46:0/1419490808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 msgr2=0x7fc02410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1419490808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc02410b8d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc014009880 tx=0x7fc01402a530 comp rx=0 tx=0).stop 2024-09-21T13:08:50.074 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 -- 172.21.15.46:0/1419490808 shutdown_connections 2024-09-21T13:08:50.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1419490808 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc02410b8d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1419490808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc024102ac0 0x7fc024102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 -- 172.21.15.46:0/1419490808 >> 172.21.15.46:0/1419490808 conn(0x7fc0240fc520 msgr2=0x7fc0240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 -- 172.21.15.46:0/1419490808 shutdown_connections 2024-09-21T13:08:50.075 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.073+0000 7fc02bc18640 1 -- 172.21.15.46:0/1419490808 wait complete. 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc02bc18640 1 Processor -- start 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc02bc18640 1 -- start start 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc02bc18640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc024102ac0 0x7fc024100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc02bc18640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc024100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc02bc18640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc02410edf0 con 0x7fc0241033e0 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc02bc18640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc02410ec70 con 0x7fc024102ac0 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0291b3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc024100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0291b3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc024100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57758/0 (socket says 172.21.15.46:57758) 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0291b3640 1 -- 172.21.15.46:0/1713898360 learned_addr learned my addr 172.21.15.46:0/1713898360 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0299b4640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc024102ac0 0x7fc024100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0291b3640 1 -- 172.21.15.46:0/1713898360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc024102ac0 msgr2=0x7fc024100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0291b3640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc024102ac0 0x7fc024100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.077 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.074+0000 7fc0291b3640 1 -- 172.21.15.46:0/1713898360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0241011a0 con 0x7fc0241033e0 2024-09-21T13:08:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.075+0000 7fc0291b3640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc024100c60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc014031460 tx=0x7fc0140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.075+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc01403f070 con 0x7fc0241033e0 2024-09-21T13:08:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.075+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0140035f0 con 0x7fc0241033e0 2024-09-21T13:08:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.075+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc014035030 con 0x7fc0241033e0 2024-09-21T13:08:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.075+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc024101430 con 0x7fc0241033e0 2024-09-21T13:08:50.078 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.075+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0241a3de0 con 0x7fc0241033e0 2024-09-21T13:08:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.076+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02406aa90 con 0x7fc0241033e0 2024-09-21T13:08:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.077+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc014042070 con 0x7fc0241033e0 2024-09-21T13:08:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.077+0000 7fc01affd640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc01007af40 0x7fc01007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.078+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc0140be9d0 con 0x7fc0241033e0 2024-09-21T13:08:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.078+0000 7fc0299b4640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc01007af40 0x7fc01007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.079 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.078+0000 7fc0299b4640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc01007af40 0x7fc01007d400 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc020009bd0 tx=0x7fc020005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.082+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc014089f20 con 0x7fc0241033e0 2024-09-21T13:08:50.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.291+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc024062630 con 0x7fc01007af40 2024-09-21T13:08:50.294 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.292+0000 7fc01affd640 1 -- 172.21.15.46:0/1713898360 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc024062630 con 0x7fc01007af40 2024-09-21T13:08:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc01007af40 msgr2=0x7fc01007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc01007af40 0x7fc01007d400 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc020009bd0 tx=0x7fc020005f90 comp rx=0 tx=0).stop 2024-09-21T13:08:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 msgr2=0x7fc024100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc024100c60 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc014031460 tx=0x7fc0140045e0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 shutdown_connections 2024-09-21T13:08:50.295 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc01007af40 0x7fc01007d400 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc0241033e0 0x7fc024100c60 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 --2- 172.21.15.46:0/1713898360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc024102ac0 0x7fc024100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 >> 172.21.15.46:0/1713898360 conn(0x7fc0240fc520 msgr2=0x7fc024108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 shutdown_connections 2024-09-21T13:08:50.296 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.294+0000 7fc02bc18640 1 -- 172.21.15.46:0/1713898360 wait complete. 2024-09-21T13:08:50.304 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.379+0000 7fa9c93e5640 1 -- 172.21.15.46:0/2641970057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 msgr2=0x7fa9c4100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.379+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/2641970057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c4100220 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009880 tx=0x7fa9b802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.379+0000 7fa9c93e5640 1 -- 172.21.15.46:0/2641970057 shutdown_connections 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.379+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/2641970057 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c4100220 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.379+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/2641970057 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c41069a0 0x7fa9c4106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.379+0000 7fa9c93e5640 1 -- 172.21.15.46:0/2641970057 >> 172.21.15.46:0/2641970057 conn(0x7fa9c40fbc90 msgr2=0x7fa9c40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.380+0000 7fa9c93e5640 1 -- 172.21.15.46:0/2641970057 shutdown_connections 2024-09-21T13:08:50.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.380+0000 7fa9c93e5640 1 -- 172.21.15.46:0/2641970057 wait complete. 2024-09-21T13:08:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.380+0000 7fa9c93e5640 1 Processor -- start 2024-09-21T13:08:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.380+0000 7fa9c93e5640 1 -- start start 2024-09-21T13:08:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c93e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c93e5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c41069a0 0x7fa9c419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c93e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c410ef40 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c93e5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c410edc0 con 0x7fa9c41069a0 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57774/0 (socket says 172.21.15.46:57774) 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 -- 172.21.15.46:0/127625270 learned_addr learned my addr 172.21.15.46:0/127625270 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c27fc640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c41069a0 0x7fa9c419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 -- 172.21.15.46:0/127625270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c41069a0 msgr2=0x7fa9c419dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c41069a0 0x7fa9c419dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 -- 172.21.15.46:0/127625270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c41978f0 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.381+0000 7fa9c2ffd640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c419d730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400e970 tx=0x7fa9b400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.384 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.382+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9b400cac0 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.382+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9b40054e0 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.382+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c4197be0 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.382+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9b4010430 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.385 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.382+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c4198140 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.383+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c41030e0 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.384+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa9b4004f00 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.384+0000 7fa9abfff640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9ac07af80 0x7fa9ac07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.384+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa9b409e650 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.384+0000 7fa9c27fc640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9ac07af80 0x7fa9ac07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.386 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.385+0000 7fa9c27fc640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9ac07af80 0x7fa9ac07d440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa9c41990e0 tx=0x7fa9b8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.390+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9b4069c20 con 0x7fa9c40ffdc0 2024-09-21T13:08:50.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.594+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa9c4198e20 con 0x7fa9ac07af80 2024-09-21T13:08:50.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.596+0000 7fa9abfff640 1 -- 172.21.15.46:0/127625270 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fa9c4198e20 con 0x7fa9ac07af80 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9ac07af80 msgr2=0x7fa9ac07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9ac07af80 0x7fa9ac07d440 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa9c41990e0 tx=0x7fa9b8031400 comp rx=0 tx=0).stop 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 msgr2=0x7fa9c419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c419d730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400e970 tx=0x7fa9b400ed70 comp rx=0 tx=0).stop 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 shutdown_connections 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9ac07af80 0x7fa9ac07d440 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9c41069a0 0x7fa9c419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 --2- 172.21.15.46:0/127625270 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9c40ffdc0 0x7fa9c419d730 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 >> 172.21.15.46:0/127625270 conn(0x7fa9c40fbc90 msgr2=0x7fa9c40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.599 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 shutdown_connections 2024-09-21T13:08:50.600 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.598+0000 7fa9c93e5640 1 -- 172.21.15.46:0/127625270 wait complete. 2024-09-21T13:08:50.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 -- 172.21.15.46:0/879670822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434106800 msgr2=0x7fd434106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 --2- 172.21.15.46:0/879670822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434106800 0x7fd434106be0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd428009880 tx=0x7fd42802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.684 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 -- 172.21.15.46:0/879670822 shutdown_connections 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 --2- 172.21.15.46:0/879670822 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434100800 0x7fd434100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 --2- 172.21.15.46:0/879670822 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434106800 0x7fd434106be0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 -- 172.21.15.46:0/879670822 >> 172.21.15.46:0/879670822 conn(0x7fd4340fc520 msgr2=0x7fd4340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 -- 172.21.15.46:0/879670822 shutdown_connections 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 -- 172.21.15.46:0/879670822 wait complete. 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 Processor -- start 2024-09-21T13:08:50.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.683+0000 7fd43b04f640 1 -- start start 2024-09-21T13:08:50.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd43b04f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434100800 0x7fd43419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd43b04f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 0x7fd43419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd43b04f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd43410dcb0 con 0x7fd434106800 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd43b04f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd43410db30 con 0x7fd434100800 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 0x7fd43419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 0x7fd43419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57790/0 (socket says 172.21.15.46:57790) 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 -- 172.21.15.46:0/2897487581 learned_addr learned my addr 172.21.15.46:0/2897487581 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd438deb640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434100800 0x7fd43419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 -- 172.21.15.46:0/2897487581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434100800 msgr2=0x7fd43419d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434100800 0x7fd43419d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 -- 172.21.15.46:0/2897487581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4341977e0 con 0x7fd434106800 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd433fff640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 0x7fd43419dba0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd42000e9e0 tx=0x7fd42000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd42000cb50 con 0x7fd434106800 2024-09-21T13:08:50.687 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd434197ad0 con 0x7fd434106800 2024-09-21T13:08:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.684+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd42000ccf0 con 0x7fd434106800 2024-09-21T13:08:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.685+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd4200049d0 con 0x7fd434106800 2024-09-21T13:08:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.685+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd434198060 con 0x7fd434106800 2024-09-21T13:08:50.688 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.686+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd434101f40 con 0x7fd434106800 2024-09-21T13:08:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.686+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd420004c50 con 0x7fd434106800 2024-09-21T13:08:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.687+0000 7fd431ffb640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd42407af80 0x7fd42407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.687+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd42009e150 con 0x7fd434106800 2024-09-21T13:08:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.687+0000 7fd438deb640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd42407af80 0x7fd42407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.687+0000 7fd438deb640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd42407af80 0x7fd42407d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4280096c0 tx=0x7fd428031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.691+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd420069720 con 0x7fd434106800 2024-09-21T13:08:50.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.888+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd434198370 con 0x7fd42407af80 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.898+0000 7fd431ffb640 1 -- 172.21.15.46:0/2897487581 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd434198370 con 0x7fd42407af80 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (19m) 13m ago 29m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (22m) 13m ago 30m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (22m) 12m ago 29m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (17m) 13m ago 30m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (17m) 12m ago 29m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:08:50.899 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (18m) 13m ago 29m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (13m) 13m ago 24m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (13m) 13m ago 24m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (12m) 12m ago 24m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (12m) 12m ago 24m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (21m) 13m ago 31m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (20m) 12m ago 29m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (17m) 13m ago 31m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (17m) 12m ago 28m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (20m) 13m ago 29m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:08:50.900 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (19m) 12m ago 29m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (16m) 13m ago 27m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (16m) 13m ago 27m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (15m) 13m ago 26m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (14m) 12m ago 26m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (14m) 12m ago 26m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (13m) 12m ago 25m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:08:50.901 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (19m) 13m ago 29m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd42407af80 msgr2=0x7fd42407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd42407af80 0x7fd42407d440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd4280096c0 tx=0x7fd428031400 comp rx=0 tx=0).stop 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 msgr2=0x7fd43419dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 0x7fd43419dba0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fd42000e9e0 tx=0x7fd42000eea0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 shutdown_connections 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd42407af80 0x7fd42407d440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd434106800 0x7fd43419dba0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 --2- 172.21.15.46:0/2897487581 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd434100800 0x7fd43419d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.902 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 >> 172.21.15.46:0/2897487581 conn(0x7fd4340fc520 msgr2=0x7fd43406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 shutdown_connections 2024-09-21T13:08:50.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.900+0000 7fd43b04f640 1 -- 172.21.15.46:0/2897487581 wait complete. 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2477641596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 msgr2=0x7f42ac106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2477641596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac106c90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f429c009880 tx=0x7f429c02a530 comp rx=0 tx=0).stop 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2477641596 shutdown_connections 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2477641596 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42ac100fd0 0x7f42ac101430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2477641596 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac106c90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2477641596 >> 172.21.15.46:0/2477641596 conn(0x7f42ac0fbc90 msgr2=0x7f42ac0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2477641596 shutdown_connections 2024-09-21T13:08:50.985 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.983+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2477641596 wait complete. 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.984+0000 7f42b0e2c640 1 Processor -- start 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.984+0000 7f42b0e2c640 1 -- start start 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.984+0000 7f42b0e2c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42ac100fd0 0x7f42ac19d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.984+0000 7f42b0e2c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac19dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.984+0000 7f42b0e2c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac10dd70 con 0x7f42ac1068b0 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.984+0000 7f42b0e2c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f42ac10dbf0 con 0x7f42ac100fd0 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac19dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.987 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac19dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57804/0 (socket says 172.21.15.46:57804) 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 -- 172.21.15.46:0/2862302320 learned_addr learned my addr 172.21.15.46:0/2862302320 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42aa59c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42ac100fd0 0x7f42ac19d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 -- 172.21.15.46:0/2862302320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42ac100fd0 msgr2=0x7f42ac19d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42ac100fd0 0x7f42ac19d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 -- 172.21.15.46:0/2862302320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42ac1978f0 con 0x7f42ac1068b0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a3fff640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac19dc70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f429400c8f0 tx=0x7f429400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42940079b0 con 0x7f42ac1068b0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42940054e0 con 0x7f42ac1068b0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.985+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42ac197be0 con 0x7f42ac1068b0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.986+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4294004dd0 con 0x7f42ac1068b0 2024-09-21T13:08:50.988 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.986+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42ac198170 con 0x7f42ac1068b0 2024-09-21T13:08:50.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.987+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42ac101430 con 0x7f42ac1068b0 2024-09-21T13:08:50.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.988+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4294005020 con 0x7f42ac1068b0 2024-09-21T13:08:50.989 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.988+0000 7f42a37fe640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f429807aed0 0x7f429807d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:50.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.988+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f429409dfd0 con 0x7f42ac1068b0 2024-09-21T13:08:50.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.988+0000 7f42aa59c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f429807aed0 0x7f429807d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:50.990 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.989+0000 7f42aa59c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f429807aed0 0x7f429807d390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f429c000c00 tx=0x7f429c031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:50.993 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:50.993+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4294014030 con 0x7f42ac1068b0 2024-09-21T13:08:51.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.262+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f42ac198e20 con 0x7f42ac1068b0 2024-09-21T13:08:51.263 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:51 smithi046 ceph-mon[108126]: pgmap v671: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:51.264 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:51 smithi046 ceph-mon[108126]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:51.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.262+0000 7f42a37fe640 1 -- 172.21.15.46:0/2862302320 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f4294069520 con 0x7f42ac1068b0 2024-09-21T13:08:51.264 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:08:51.264 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:08:51.264 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:08:51.264 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:51.264 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:08:51.265 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:08:51.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.264+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f429807aed0 msgr2=0x7f429807d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.264+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f429807aed0 0x7f429807d390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f429c000c00 tx=0x7f429c031400 comp rx=0 tx=0).stop 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 msgr2=0x7f42ac19dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac19dc70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f429400c8f0 tx=0x7f429400cdb0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 shutdown_connections 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f429807aed0 0x7f429807d390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f42ac1068b0 0x7f42ac19dc70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.267 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 --2- 172.21.15.46:0/2862302320 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f42ac100fd0 0x7f42ac19d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 >> 172.21.15.46:0/2862302320 conn(0x7f42ac0fbc90 msgr2=0x7f42ac100000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 shutdown_connections 2024-09-21T13:08:51.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.265+0000 7f42b0e2c640 1 -- 172.21.15.46:0/2862302320 wait complete. 2024-09-21T13:08:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 -- 172.21.15.46:0/3419963081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 msgr2=0x7faf60100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 --2- 172.21.15.46:0/3419963081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf60100a30 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7faf50009880 tx=0x7faf5002a490 comp rx=0 tx=0).stop 2024-09-21T13:08:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 -- 172.21.15.46:0/3419963081 shutdown_connections 2024-09-21T13:08:51.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 --2- 172.21.15.46:0/3419963081 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf60101000 0x7faf6010dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 --2- 172.21.15.46:0/3419963081 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf60100a30 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 -- 172.21.15.46:0/3419963081 >> 172.21.15.46:0/3419963081 conn(0x7faf600fc520 msgr2=0x7faf600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 -- 172.21.15.46:0/3419963081 shutdown_connections 2024-09-21T13:08:51.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.349+0000 7faf6523b640 1 -- 172.21.15.46:0/3419963081 wait complete. 2024-09-21T13:08:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf6523b640 1 Processor -- start 2024-09-21T13:08:51.352 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf6523b640 1 -- start start 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf6523b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf6019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf6523b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf60101000 0x7faf6019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf6523b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7faf60110ff0 con 0x7faf60100650 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf6523b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7faf60110e70 con 0x7faf60101000 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf5ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf6019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf5ed9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf6019f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57822/0 (socket says 172.21.15.46:57822) 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf5ed9d640 1 -- 172.21.15.46:0/2840635259 learned_addr learned my addr 172.21.15.46:0/2840635259 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.350+0000 7faf5e59c640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf60101000 0x7faf6019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf5ed9d640 1 -- 172.21.15.46:0/2840635259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf60101000 msgr2=0x7faf6019fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf5ed9d640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf60101000 0x7faf6019fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.353 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf5ed9d640 1 -- 172.21.15.46:0/2840635259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf60199a80 con 0x7faf60100650 2024-09-21T13:08:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf5ed9d640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf6019f8c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faf50031460 tx=0x7faf500048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf5003f070 con 0x7faf60100650 2024-09-21T13:08:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf500044d0 con 0x7faf60100650 2024-09-21T13:08:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf60199d10 con 0x7faf60100650 2024-09-21T13:08:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf50035030 con 0x7faf60100650 2024-09-21T13:08:51.354 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.351+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf6019a2a0 con 0x7faf60100650 2024-09-21T13:08:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.352+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf6006aa90 con 0x7faf60100650 2024-09-21T13:08:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.353+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7faf50042070 con 0x7faf60100650 2024-09-21T13:08:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.353+0000 7faf47fff640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf4807af90 0x7faf4807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.353+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7faf500beae0 con 0x7faf60100650 2024-09-21T13:08:51.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.353+0000 7faf5e59c640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf4807af90 0x7faf4807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.354+0000 7faf5e59c640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf4807af90 0x7faf4807d450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7faf60102520 tx=0x7faf54009110 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:51.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.358+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faf50004cf0 con 0x7faf60100650 2024-09-21T13:08:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:51 smithi176 ceph-mon[80162]: pgmap v671: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:51 smithi176 ceph-mon[80162]: from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.583+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7faf6019afb0 con 0x7faf60100650 2024-09-21T13:08:51.584 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.583+0000 7faf47fff640 1 -- 172.21.15.46:0/2840635259 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7faf5008a0b0 con 0x7faf60100650 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:08:51.585 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:08:51.586 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:08:51.587 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:51.588 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf4807af90 msgr2=0x7faf4807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf4807af90 0x7faf4807d450 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7faf60102520 tx=0x7faf54009110 comp rx=0 tx=0).stop 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 msgr2=0x7faf6019f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf6019f8c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faf50031460 tx=0x7faf500048f0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 shutdown_connections 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7faf4807af90 0x7faf4807d450 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf60101000 0x7faf6019fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 --2- 172.21.15.46:0/2840635259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7faf60100650 0x7faf6019f8c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.589 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.585+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 >> 172.21.15.46:0/2840635259 conn(0x7faf600fc520 msgr2=0x7faf600fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.586+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 shutdown_connections 2024-09-21T13:08:51.590 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.586+0000 7faf6523b640 1 -- 172.21.15.46:0/2840635259 wait complete. 2024-09-21T13:08:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 -- 172.21.15.46:0/2947388801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 msgr2=0x7f4e0c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2947388801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c102ea0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009880 tx=0x7f4dfc02a530 comp rx=0 tx=0).stop 2024-09-21T13:08:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 -- 172.21.15.46:0/2947388801 shutdown_connections 2024-09-21T13:08:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2947388801 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c1033e0 0x7f4e0c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2947388801 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c102ea0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.673 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 -- 172.21.15.46:0/2947388801 >> 172.21.15.46:0/2947388801 conn(0x7f4e0c0fc520 msgr2=0x7f4e0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 -- 172.21.15.46:0/2947388801 shutdown_connections 2024-09-21T13:08:51.674 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.671+0000 7f4e111f9640 1 -- 172.21.15.46:0/2947388801 wait complete. 2024-09-21T13:08:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.672+0000 7f4e111f9640 1 Processor -- start 2024-09-21T13:08:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.672+0000 7f4e111f9640 1 -- start start 2024-09-21T13:08:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.672+0000 7f4e111f9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.678 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.672+0000 7f4e111f9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c1033e0 0x7f4e0c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.672+0000 7f4e111f9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c10edd0 con 0x7f4e0c102ac0 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.672+0000 7f4e111f9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c10ec50 con 0x7f4e0c1033e0 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57844/0 (socket says 172.21.15.46:57844) 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 -- 172.21.15.46:0/2271145314 learned_addr learned my addr 172.21.15.46:0/2271145314 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0a59c640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c1033e0 0x7f4e0c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 -- 172.21.15.46:0/2271145314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c1033e0 msgr2=0x7f4e0c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c1033e0 0x7f4e0c100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 -- 172.21.15.46:0/2271145314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c1011a0 con 0x7f4e0c102ac0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e0ad9d640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c100720 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc031460 tx=0x7f4dfc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4dfc03f070 con 0x7f4e0c102ac0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4dfc004cf0 con 0x7f4e0c102ac0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e0c101430 con 0x7f4e0c102ac0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.673+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4dfc035030 con 0x7f4e0c102ac0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.674+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e0c1a3ea0 con 0x7f4e0c102ac0 2024-09-21T13:08:51.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.674+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e0c06aa90 con 0x7f4e0c102ac0 2024-09-21T13:08:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.675+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4dfc042070 con 0x7f4e0c102ac0 2024-09-21T13:08:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.676+0000 7f4df3fff640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4df407af30 0x7f4df407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.676+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4dfc0beb70 con 0x7f4e0c102ac0 2024-09-21T13:08:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.676+0000 7f4e0a59c640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4df407af30 0x7f4df407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.681 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.676+0000 7f4e0a59c640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4df407af30 0x7f4df407d3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c1021b0 tx=0x7f4e0000a560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:51.682 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.680+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4dfc08a0c0 con 0x7f4e0c102ac0 2024-09-21T13:08:51.885 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.884+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4e0c062630 con 0x7f4df407af30 2024-09-21T13:08:51.886 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.885+0000 7f4df3fff640 1 -- 172.21.15.46:0/2271145314 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f4e0c062630 con 0x7f4df407af30 2024-09-21T13:08:51.886 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:08:51.886 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:08:51.886 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:08:51.886 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:08:51.887 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4df407af30 msgr2=0x7f4df407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4df407af30 0x7f4df407d3f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c1021b0 tx=0x7f4e0000a560 comp rx=0 tx=0).stop 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 msgr2=0x7f4e0c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c100720 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc031460 tx=0x7f4dfc0048f0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 shutdown_connections 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4df407af30 0x7f4df407d3f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4e0c1033e0 0x7f4e0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 --2- 172.21.15.46:0/2271145314 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4e0c102ac0 0x7f4e0c100720 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 >> 172.21.15.46:0/2271145314 conn(0x7f4e0c0fc520 msgr2=0x7f4e0c108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 shutdown_connections 2024-09-21T13:08:51.889 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.887+0000 7f4e111f9640 1 -- 172.21.15.46:0/2271145314 wait complete. 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.971+0000 7fe720b34640 1 -- 172.21.15.46:0/2702549396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 msgr2=0x7fe71c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.971+0000 7fe720b34640 1 --2- 172.21.15.46:0/2702549396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c101d60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe710009880 tx=0x7fe71002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.971+0000 7fe720b34640 1 -- 172.21.15.46:0/2702549396 shutdown_connections 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.971+0000 7fe720b34640 1 --2- 172.21.15.46:0/2702549396 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c101d60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.971+0000 7fe720b34640 1 --2- 172.21.15.46:0/2702549396 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe71c107900 0x7fe71c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.971+0000 7fe720b34640 1 -- 172.21.15.46:0/2702549396 >> 172.21.15.46:0/2702549396 conn(0x7fe71c0fd600 msgr2=0x7fe71c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.972+0000 7fe720b34640 1 -- 172.21.15.46:0/2702549396 shutdown_connections 2024-09-21T13:08:51.973 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.972+0000 7fe720b34640 1 -- 172.21.15.46:0/2702549396 wait complete. 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.972+0000 7fe720b34640 1 Processor -- start 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.972+0000 7fe720b34640 1 -- start start 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe720b34640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe720b34640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe71c107900 0x7fe71c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe720b34640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c10edd0 con 0x7fe71c101900 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe720b34640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe71c10ec50 con 0x7fe71c107900 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.975 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:57860/0 (socket says 172.21.15.46:57860) 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 -- 172.21.15.46:0/1671800162 learned_addr learned my addr 172.21.15.46:0/1671800162 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe719d9b640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe71c107900 0x7fe71c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 -- 172.21.15.46:0/1671800162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe71c107900 msgr2=0x7fe71c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe71c107900 0x7fe71c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 -- 172.21.15.46:0/1671800162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71c074f70 con 0x7fe71c101900 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe71a59c640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c0744f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d6f0 tx=0x7fe70c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe70c017070 con 0x7fe71c101900 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe70c00de00 con 0x7fe71c101900 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71c075260 con 0x7fe71c101900 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.973+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe70c004bb0 con 0x7fe71c101900 2024-09-21T13:08:51.976 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.974+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe71c1a3e80 con 0x7fe71c101900 2024-09-21T13:08:51.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.975+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe71c103040 con 0x7fe71c101900 2024-09-21T13:08:51.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.975+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe70c004e60 con 0x7fe71c101900 2024-09-21T13:08:51.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.976+0000 7fe70b7fe640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe70407af30 0x7fe70407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:08:51.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.976+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe70c09dcd0 con 0x7fe71c101900 2024-09-21T13:08:51.977 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.976+0000 7fe719d9b640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe70407af30 0x7fe70407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:08:51.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.976+0000 7fe719d9b640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe70407af30 0x7fe70407d3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe71c075f80 tx=0x7fe710031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:08:51.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:51.980+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe70c069180 con 0x7fe71c101900 2024-09-21T13:08:52.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.244+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe71c109e70 con 0x7fe71c101900 2024-09-21T13:08:52.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.244+0000 7fe70b7fe640 1 -- 172.21.15.46:0/1671800162 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fe70c06e030 con 0x7fe71c101900 2024-09-21T13:08:52.246 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:08:52.246 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:08:52.246 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:08:52.246 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:08:52.247 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:08:52.247 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:08:52.247 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:08:52.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.246+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe70407af30 msgr2=0x7fe70407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:52.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.246+0000 7fe720b34640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe70407af30 0x7fe70407d3f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe71c075f80 tx=0x7fe710031400 comp rx=0 tx=0).stop 2024-09-21T13:08:52.248 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.246+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 msgr2=0x7fe71c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:08:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.246+0000 7fe720b34640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c0744f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d6f0 tx=0x7fe70c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:08:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 shutdown_connections 2024-09-21T13:08:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe70407af30 0x7fe70407d3f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe71c107900 0x7fe71c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 --2- 172.21.15.46:0/1671800162 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe71c101900 0x7fe71c0744f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:08:52.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 >> 172.21.15.46:0/1671800162 conn(0x7fe71c0fd600 msgr2=0x7fe71c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:08:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 shutdown_connections 2024-09-21T13:08:52.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:08:52.247+0000 7fe720b34640 1 -- 172.21.15.46:0/1671800162 wait complete. 2024-09-21T13:08:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:52 smithi176 ceph-mon[80162]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:52 smithi176 ceph-mon[80162]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:52 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2862302320' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:08:52.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:52 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2840635259' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:08:52.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:52 smithi046 ceph-mon[108126]: from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:52.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:52 smithi046 ceph-mon[108126]: from='client.35046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:52.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:52 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2862302320' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:08:52.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:52 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2840635259' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:08:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:53 smithi176 ceph-mon[80162]: pgmap v672: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:53 smithi176 ceph-mon[80162]: from='client.35058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:53.567 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:53 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1671800162' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:08:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:53 smithi046 ceph-mon[108126]: pgmap v672: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:53 smithi046 ceph-mon[108126]: from='client.35058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:08:53.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:53 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1671800162' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:08:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:55 smithi176 ceph-mon[80162]: pgmap v673: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:55.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:55 smithi046 ceph-mon[108126]: pgmap v673: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:57 smithi046 ceph-mon[108126]: pgmap v674: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:57 smithi176 ceph-mon[80162]: pgmap v674: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:08:59 smithi176 ceph-mon[80162]: pgmap v675: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:08:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:08:59 smithi046 ceph-mon[108126]: pgmap v675: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:01 smithi176 ceph-mon[80162]: pgmap v676: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:01 smithi046 ceph-mon[108126]: pgmap v676: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:03 smithi046 ceph-mon[108126]: pgmap v677: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:03 smithi176 ceph-mon[80162]: pgmap v677: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:05 smithi176 ceph-mon[80162]: pgmap v678: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:05 smithi046 ceph-mon[108126]: pgmap v678: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:07 smithi176 ceph-mon[80162]: pgmap v679: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:07 smithi046 ceph-mon[108126]: pgmap v679: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:09 smithi176 ceph-mon[80162]: pgmap v680: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:09 smithi046 ceph-mon[108126]: pgmap v680: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:11 smithi176 ceph-mon[80162]: pgmap v681: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:11 smithi046 ceph-mon[108126]: pgmap v681: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:13 smithi176 ceph-mon[80162]: pgmap v682: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:13.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:13 smithi046 ceph-mon[108126]: pgmap v682: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:15 smithi046 ceph-mon[108126]: pgmap v683: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:15 smithi176 ceph-mon[80162]: pgmap v683: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:17 smithi176 ceph-mon[80162]: pgmap v684: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:17.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:17 smithi046 ceph-mon[108126]: pgmap v684: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:19 smithi176 ceph-mon[80162]: pgmap v685: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:19 smithi046 ceph-mon[108126]: pgmap v685: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:21 smithi046 ceph-mon[108126]: pgmap v686: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:21 smithi176 ceph-mon[80162]: pgmap v686: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:22.346 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 -- 172.21.15.46:0/860475841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 msgr2=0x7f76d4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 --2- 172.21.15.46:0/860475841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d4101d60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f76bc009880 tx=0x7f76bc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 -- 172.21.15.46:0/860475841 shutdown_connections 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 --2- 172.21.15.46:0/860475841 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d4101d60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 --2- 172.21.15.46:0/860475841 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d4107900 0x7f76d4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 -- 172.21.15.46:0/860475841 >> 172.21.15.46:0/860475841 conn(0x7f76d40fd600 msgr2=0x7f76d40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 -- 172.21.15.46:0/860475841 shutdown_connections 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 -- 172.21.15.46:0/860475841 wait complete. 2024-09-21T13:09:22.347 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.345+0000 7f76d94a9640 1 Processor -- start 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d94a9640 1 -- start start 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d94a9640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d94a9640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d4107900 0x7f76d419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d94a9640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410edd0 con 0x7f76d4101900 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d94a9640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f76d410ec50 con 0x7f76d4107900 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d419d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48872/0 (socket says 172.21.15.46:48872) 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d2ffd640 1 -- 172.21.15.46:0/3224173268 learned_addr learned my addr 172.21.15.46:0/3224173268 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.346+0000 7f76d27fc640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d4107900 0x7f76d419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76d2ffd640 1 -- 172.21.15.46:0/3224173268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d4107900 msgr2=0x7f76d419db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76d2ffd640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d4107900 0x7f76d419db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.349 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76d2ffd640 1 -- 172.21.15.46:0/3224173268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d41977a0 con 0x7f76d4101900 2024-09-21T13:09:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76d2ffd640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d419d620 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00d6f0 tx=0x7f76cc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76cc017070 con 0x7f76d4101900 2024-09-21T13:09:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76cc00de00 con 0x7f76d4101900 2024-09-21T13:09:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d4197a90 con 0x7f76d4101900 2024-09-21T13:09:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76cc004bb0 con 0x7f76d4101900 2024-09-21T13:09:22.350 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.347+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d4197ff0 con 0x7f76d4101900 2024-09-21T13:09:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.348+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d4103040 con 0x7f76d4101900 2024-09-21T13:09:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.349+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f76cc009a30 con 0x7f76d4101900 2024-09-21T13:09:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.349+0000 7f76cbfff640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f76c007af80 0x7f76c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.350+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f76cc09dc10 con 0x7f76d4101900 2024-09-21T13:09:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.350+0000 7f76d27fc640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f76c007af80 0x7f76c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.351 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.350+0000 7f76d27fc640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f76c007af80 0x7f76c007d440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f76d4198af0 tx=0x7f76bc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:22.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.354+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76cc069140 con 0x7f76d4101900 2024-09-21T13:09:22.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.563+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f76d4198360 con 0x7f76c007af80 2024-09-21T13:09:22.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.565+0000 7f76cbfff640 1 -- 172.21.15.46:0/3224173268 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f76d4198360 con 0x7f76c007af80 2024-09-21T13:09:22.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f76c007af80 msgr2=0x7f76c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f76c007af80 0x7f76c007d440 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f76d4198af0 tx=0x7f76bc031400 comp rx=0 tx=0).stop 2024-09-21T13:09:22.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 msgr2=0x7f76d419d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.568 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d419d620 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00d6f0 tx=0x7f76cc00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 shutdown_connections 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f76c007af80 0x7f76c007d440 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f76d4107900 0x7f76d419db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 --2- 172.21.15.46:0/3224173268 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f76d4101900 0x7f76d419d620 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 >> 172.21.15.46:0/3224173268 conn(0x7f76d40fd600 msgr2=0x7f76d40fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 shutdown_connections 2024-09-21T13:09:22.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.567+0000 7f76d94a9640 1 -- 172.21.15.46:0/3224173268 wait complete. 2024-09-21T13:09:22.577 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:09:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 -- 172.21.15.46:0/1190706059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 msgr2=0x7f2814102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1190706059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f2814102e90 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2804009880 tx=0x7f280402a530 comp rx=0 tx=0).stop 2024-09-21T13:09:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 -- 172.21.15.46:0/1190706059 shutdown_connections 2024-09-21T13:09:22.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1190706059 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28141033d0 0x7f281410b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1190706059 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f2814102e90 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 -- 172.21.15.46:0/1190706059 >> 172.21.15.46:0/1190706059 conn(0x7f28140fc550 msgr2=0x7f28140fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 -- 172.21.15.46:0/1190706059 shutdown_connections 2024-09-21T13:09:22.655 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.653+0000 7f281b1e2640 1 -- 172.21.15.46:0/1190706059 wait complete. 2024-09-21T13:09:22.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f281b1e2640 1 Processor -- start 2024-09-21T13:09:22.656 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f281b1e2640 1 -- start start 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f281b1e2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f281419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f281b1e2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28141033d0 0x7f281419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f281b1e2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f281410ede0 con 0x7f2814102ab0 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f281b1e2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f281410ec60 con 0x7f28141033d0 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2818f7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f281419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2818f7e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f281419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48896/0 (socket says 172.21.15.46:48896) 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2818f7e640 1 -- 172.21.15.46:0/1705574522 learned_addr learned my addr 172.21.15.46:0/1705574522 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2813fff640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28141033d0 0x7f281419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2818f7e640 1 -- 172.21.15.46:0/1705574522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28141033d0 msgr2=0x7f281419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2818f7e640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28141033d0 0x7f281419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.654+0000 7f2818f7e640 1 -- 172.21.15.46:0/1705574522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28141977b0 con 0x7f2814102ab0 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.655+0000 7f2818f7e640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f281419d630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2804031460 tx=0x7f28040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:22.657 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.655+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f280403f070 con 0x7f2814102ab0 2024-09-21T13:09:22.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.655+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2804004cf0 con 0x7f2814102ab0 2024-09-21T13:09:22.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.655+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2814197a40 con 0x7f2814102ab0 2024-09-21T13:09:22.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.655+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2804035030 con 0x7f2814102ab0 2024-09-21T13:09:22.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.655+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2814197f70 con 0x7f2814102ab0 2024-09-21T13:09:22.658 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.656+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f281406a580 con 0x7f2814102ab0 2024-09-21T13:09:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.657+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2804042070 con 0x7f2814102ab0 2024-09-21T13:09:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.657+0000 7f2811ffb640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f280007af80 0x7f280007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.657+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f28040beb80 con 0x7f2814102ab0 2024-09-21T13:09:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.658+0000 7f2813fff640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f280007af80 0x7f280007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.659 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.658+0000 7f2813fff640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f280007af80 0x7f280007d440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f28141088f0 tx=0x7f27fc005ec0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:22.663 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.662+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f280408a0b0 con 0x7f2814102ab0 2024-09-21T13:09:22.869 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.868+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f28141982e0 con 0x7f280007af80 2024-09-21T13:09:22.870 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.869+0000 7f2811ffb640 1 -- 172.21.15.46:0/1705574522 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f28141982e0 con 0x7f280007af80 2024-09-21T13:09:22.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.871+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f280007af80 msgr2=0x7f280007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.871+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f280007af80 0x7f280007d440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f28141088f0 tx=0x7f27fc005ec0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.871+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 msgr2=0x7f281419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.873 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.871+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f281419d630 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f2804031460 tx=0x7f28040048f0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.871+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 shutdown_connections 2024-09-21T13:09:22.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.871+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f280007af80 0x7f280007d440 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.872+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28141033d0 0x7f281419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.872+0000 7f281b1e2640 1 --2- 172.21.15.46:0/1705574522 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2814102ab0 0x7f281419d630 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.872+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 >> 172.21.15.46:0/1705574522 conn(0x7f28140fc550 msgr2=0x7f281410aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:22.874 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.872+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 shutdown_connections 2024-09-21T13:09:22.875 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.872+0000 7f281b1e2640 1 -- 172.21.15.46:0/1705574522 wait complete. 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 -- 172.21.15.46:0/691924913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 msgr2=0x7fbef4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/691924913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4100c60 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009880 tx=0x7fbee802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 -- 172.21.15.46:0/691924913 shutdown_connections 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/691924913 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4100c60 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/691924913 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef4106800 0x7fbef4106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 -- 172.21.15.46:0/691924913 >> 172.21.15.46:0/691924913 conn(0x7fbef40fc520 msgr2=0x7fbef40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 -- 172.21.15.46:0/691924913 shutdown_connections 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.956+0000 7fbefa2ef640 1 -- 172.21.15.46:0/691924913 wait complete. 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbefa2ef640 1 Processor -- start 2024-09-21T13:09:22.958 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbefa2ef640 1 -- start start 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbefa2ef640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbefa2ef640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef4106800 0x7fbef4196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbefa2ef640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410dcd0 con 0x7fbef4100800 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbefa2ef640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbef410db50 con 0x7fbef4106800 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbef3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48912/0 (socket says 172.21.15.46:48912) 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.957+0000 7fbef3fff640 1 -- 172.21.15.46:0/2718890648 learned_addr learned my addr 172.21.15.46:0/2718890648 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:22.960 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef37fe640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef4106800 0x7fbef4196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef3fff640 1 -- 172.21.15.46:0/2718890648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef4106800 msgr2=0x7fbef4196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef3fff640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef4106800 0x7fbef4196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef3fff640 1 -- 172.21.15.46:0/2718890648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef4197090 con 0x7fbef4100800 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef3fff640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4196610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbee400e970 tx=0x7fbee400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbee400cac0 con 0x7fbef4100800 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef4197380 con 0x7fbef4100800 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbee40054e0 con 0x7fbef4100800 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbee4010430 con 0x7fbef4100800 2024-09-21T13:09:22.961 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.958+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef41a3e50 con 0x7fbef4100800 2024-09-21T13:09:22.962 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.959+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbef4101f40 con 0x7fbef4100800 2024-09-21T13:09:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.960+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbee4004e80 con 0x7fbef4100800 2024-09-21T13:09:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.960+0000 7fbef17fa640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbedc07af30 0x7fbedc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.961+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbee409e7a0 con 0x7fbef4100800 2024-09-21T13:09:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.961+0000 7fbef37fe640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbedc07af30 0x7fbedc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:22.963 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.961+0000 7fbef37fe640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbedc07af30 0x7fbedc07d3f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbef4198770 tx=0x7fbee8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:22.966 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:22.965+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbee4069cf0 con 0x7fbef4100800 2024-09-21T13:09:23.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.160+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fbef4062630 con 0x7fbedc07af30 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.170+0000 7fbef17fa640 1 -- 172.21.15.46:0/2718890648 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fbef4062630 con 0x7fbedc07af30 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (19m) 13m ago 30m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (22m) 13m ago 30m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (22m) 13m ago 29m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (17m) 13m ago 30m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (17m) 13m ago 29m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:09:23.171 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (19m) 13m ago 30m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (14m) 13m ago 25m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (13m) 13m ago 25m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (13m) 13m ago 25m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (13m) 13m ago 24m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (21m) 13m ago 31m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (20m) 13m ago 29m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (18m) 13m ago 31m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (17m) 13m ago 29m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (20m) 13m ago 30m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (20m) 13m ago 29m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (17m) 13m ago 28m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:09:23.172 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (16m) 13m ago 27m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:09:23.173 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (16m) 13m ago 27m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:09:23.173 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (15m) 13m ago 27m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:09:23.173 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (14m) 13m ago 26m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:09:23.173 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (14m) 13m ago 26m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:09:23.173 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (19m) 13m ago 30m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbedc07af30 msgr2=0x7fbedc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbedc07af30 0x7fbedc07d3f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbef4198770 tx=0x7fbee8031400 comp rx=0 tx=0).stop 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 msgr2=0x7fbef4196610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4196610 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbee400e970 tx=0x7fbee400ed70 comp rx=0 tx=0).stop 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 shutdown_connections 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbedc07af30 0x7fbedc07d3f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbef4106800 0x7fbef4196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 --2- 172.21.15.46:0/2718890648 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbef4100800 0x7fbef4196610 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 >> 172.21.15.46:0/2718890648 conn(0x7fbef40fc520 msgr2=0x7fbef40fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 shutdown_connections 2024-09-21T13:09:23.174 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.172+0000 7fbefa2ef640 1 -- 172.21.15.46:0/2718890648 wait complete. 2024-09-21T13:09:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/854857027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f41033e0 msgr2=0x7fa0f410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/854857027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f41033e0 0x7fa0f410b8d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009880 tx=0x7fa0dc02a530 comp rx=0 tx=0).stop 2024-09-21T13:09:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/854857027 shutdown_connections 2024-09-21T13:09:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/854857027 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f41033e0 0x7fa0f410b8d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.259 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/854857027 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f4102ac0 0x7fa0f4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/854857027 >> 172.21.15.46:0/854857027 conn(0x7fa0f40fc520 msgr2=0x7fa0f40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/854857027 shutdown_connections 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.256+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/854857027 wait complete. 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0fa9c2640 1 Processor -- start 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0fa9c2640 1 -- start start 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0fa9c2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 0x7fa0f419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0fa9c2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f41033e0 0x7fa0f419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0fa9c2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f410ee50 con 0x7fa0f4102ac0 2024-09-21T13:09:23.260 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0fa9c2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa0f410ecd0 con 0x7fa0f41033e0 2024-09-21T13:09:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0f3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 0x7fa0f419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0f3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 0x7fa0f419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48930/0 (socket says 172.21.15.46:48930) 2024-09-21T13:09:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0f3fff640 1 -- 172.21.15.46:0/707591106 learned_addr learned my addr 172.21.15.46:0/707591106 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.257+0000 7fa0f37fe640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f41033e0 0x7fa0f419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f3fff640 1 -- 172.21.15.46:0/707591106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f41033e0 msgr2=0x7fa0f419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f3fff640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f41033e0 0x7fa0f419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f3fff640 1 -- 172.21.15.46:0/707591106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0f4197840 con 0x7fa0f4102ac0 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f3fff640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 0x7fa0f419d6c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400b420 tx=0x7fa0e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0e4011630 con 0x7fa0f4102ac0 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0f4197b30 con 0x7fa0f4102ac0 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0e4016070 con 0x7fa0f4102ac0 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0e4010d40 con 0x7fa0f4102ac0 2024-09-21T13:09:23.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.258+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0f4198090 con 0x7fa0f4102ac0 2024-09-21T13:09:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.259+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0f406aa90 con 0x7fa0f4102ac0 2024-09-21T13:09:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.260+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa0e401b460 con 0x7fa0f4102ac0 2024-09-21T13:09:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.260+0000 7fa0f17fa640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa0e007af30 0x7fa0e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.260+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa0e409d890 con 0x7fa0f4102ac0 2024-09-21T13:09:23.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.260+0000 7fa0f37fe640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa0e007af30 0x7fa0e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.261+0000 7fa0f37fe640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa0e007af30 0x7fa0e007d3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4198b90 tx=0x7fa0dc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:23.266 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.265+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0e4021250 con 0x7fa0f4102ac0 2024-09-21T13:09:23.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.525+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa0f4105f60 con 0x7fa0f4102ac0 2024-09-21T13:09:23.527 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:23 smithi046 ceph-mon[108126]: pgmap v687: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:23.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.526+0000 7fa0f17fa640 1 -- 172.21.15.46:0/707591106 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa0e4068d40 con 0x7fa0f4102ac0 2024-09-21T13:09:23.527 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:09:23.528 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa0e007af30 msgr2=0x7fa0e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa0e007af30 0x7fa0e007d3f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4198b90 tx=0x7fa0dc031400 comp rx=0 tx=0).stop 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 msgr2=0x7fa0f419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 0x7fa0f419d6c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fa0e400b420 tx=0x7fa0e400b8e0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 shutdown_connections 2024-09-21T13:09:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa0e007af30 0x7fa0e007d3f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa0f41033e0 0x7fa0f419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 --2- 172.21.15.46:0/707591106 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa0f4102ac0 0x7fa0f419d6c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 >> 172.21.15.46:0/707591106 conn(0x7fa0f40fc520 msgr2=0x7fa0f4108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 shutdown_connections 2024-09-21T13:09:23.530 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.528+0000 7fa0fa9c2640 1 -- 172.21.15.46:0/707591106 wait complete. 2024-09-21T13:09:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:23 smithi176 ceph-mon[80162]: pgmap v687: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 -- 172.21.15.46:0/2667898276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c100800 msgr2=0x7fb70c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 --2- 172.21.15.46:0/2667898276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c100800 0x7fb70c100c60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009880 tx=0x7fb6fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.616 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 -- 172.21.15.46:0/2667898276 shutdown_connections 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 --2- 172.21.15.46:0/2667898276 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c100800 0x7fb70c100c60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 --2- 172.21.15.46:0/2667898276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c106800 0x7fb70c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 -- 172.21.15.46:0/2667898276 >> 172.21.15.46:0/2667898276 conn(0x7fb70c0fc520 msgr2=0x7fb70c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 -- 172.21.15.46:0/2667898276 shutdown_connections 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.613+0000 7fb713edd640 1 -- 172.21.15.46:0/2667898276 wait complete. 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb713edd640 1 Processor -- start 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb713edd640 1 -- start start 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb713edd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c100800 0x7fb70c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb713edd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 0x7fb70c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb713edd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c10dcd0 con 0x7fb70c106800 2024-09-21T13:09:23.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb713edd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb70c10db50 con 0x7fb70c100800 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb711478640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 0x7fb70c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb711478640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 0x7fb70c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48940/0 (socket says 172.21.15.46:48940) 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb711478640 1 -- 172.21.15.46:0/330149233 learned_addr learned my addr 172.21.15.46:0/330149233 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.614+0000 7fb711c79640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c100800 0x7fb70c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb711478640 1 -- 172.21.15.46:0/330149233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c100800 msgr2=0x7fb70c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb711478640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c100800 0x7fb70c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb711478640 1 -- 172.21.15.46:0/330149233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb70c197800 con 0x7fb70c106800 2024-09-21T13:09:23.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb711c79640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c100800 0x7fb70c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:09:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb711478640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 0x7fb70c19dbc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc031460 tx=0x7fb6fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6fc03f070 con 0x7fb70c106800 2024-09-21T13:09:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb6fc004cf0 con 0x7fb70c106800 2024-09-21T13:09:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb70c197a90 con 0x7fb70c106800 2024-09-21T13:09:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb6fc035030 con 0x7fb70c106800 2024-09-21T13:09:23.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.615+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb70c197fc0 con 0x7fb70c106800 2024-09-21T13:09:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.616+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb70c101f40 con 0x7fb70c106800 2024-09-21T13:09:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.617+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb6fc042070 con 0x7fb70c106800 2024-09-21T13:09:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.617+0000 7fb702ffd640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6f807af80 0x7fb6f807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.617+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb6fc0bea90 con 0x7fb70c106800 2024-09-21T13:09:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.617+0000 7fb711c79640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6f807af80 0x7fb6f807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.618+0000 7fb711c79640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6f807af80 0x7fb6f807d440 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb708005fd0 tx=0x7fb708005ea0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:23.623 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.622+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb6fc08a060 con 0x7fb70c106800 2024-09-21T13:09:23.847 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.846+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb70c109d80 con 0x7fb70c106800 2024-09-21T13:09:23.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.847+0000 7fb702ffd640 1 -- 172.21.15.46:0/330149233 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7fb6fc08ef10 con 0x7fb70c106800 2024-09-21T13:09:23.848 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:09:23.848 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:09:23.848 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:09:23.849 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:09:23.850 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:23.851 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:23.852 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:23.852 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:23.852 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:23.852 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6f807af80 msgr2=0x7fb6f807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6f807af80 0x7fb6f807d440 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb708005fd0 tx=0x7fb708005ea0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 msgr2=0x7fb70c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 0x7fb70c19dbc0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc031460 tx=0x7fb6fc0048f0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 shutdown_connections 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb6f807af80 0x7fb6f807d440 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb70c106800 0x7fb70c19dbc0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 --2- 172.21.15.46:0/330149233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb70c100800 0x7fb70c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 >> 172.21.15.46:0/330149233 conn(0x7fb70c0fc520 msgr2=0x7fb70c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 shutdown_connections 2024-09-21T13:09:23.853 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.850+0000 7fb713edd640 1 -- 172.21.15.46:0/330149233 wait complete. 2024-09-21T13:09:23.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 -- 172.21.15.46:0/98977447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 msgr2=0x7f548010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 --2- 172.21.15.46:0/98977447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548010b8d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f5470009880 tx=0x7f547002a530 comp rx=0 tx=0).stop 2024-09-21T13:09:23.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 -- 172.21.15.46:0/98977447 shutdown_connections 2024-09-21T13:09:23.939 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 --2- 172.21.15.46:0/98977447 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548010b8d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 --2- 172.21.15.46:0/98977447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5480102ac0 0x7f5480102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 -- 172.21.15.46:0/98977447 >> 172.21.15.46:0/98977447 conn(0x7f54800fc520 msgr2=0x7f54800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 -- 172.21.15.46:0/98977447 shutdown_connections 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.935+0000 7f5487e1a640 1 -- 172.21.15.46:0/98977447 wait complete. 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f5487e1a640 1 Processor -- start 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f5487e1a640 1 -- start start 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f5487e1a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5480102ac0 0x7f548019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f5487e1a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.940 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f5487e1a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f548010edf0 con 0x7f54801033e0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f5487e1a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f548010ec70 con 0x7f5480102ac0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f54853b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f54853b5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48956/0 (socket says 172.21.15.46:48956) 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.936+0000 7f54853b5640 1 -- 172.21.15.46:0/4096556215 learned_addr learned my addr 172.21.15.46:0/4096556215 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f5485bb6640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5480102ac0 0x7f548019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f54853b5640 1 -- 172.21.15.46:0/4096556215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5480102ac0 msgr2=0x7f548019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f54853b5640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5480102ac0 0x7f548019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f54853b5640 1 -- 172.21.15.46:0/4096556215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5480197820 con 0x7f54801033e0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f54853b5640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548019dbe0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5470031460 tx=0x7f54700045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f547003f070 con 0x7f54801033e0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f54700035f0 con 0x7f54801033e0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5480197ab0 con 0x7f54801033e0 2024-09-21T13:09:23.941 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5470035030 con 0x7f54801033e0 2024-09-21T13:09:23.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.937+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5480197fe0 con 0x7f54801033e0 2024-09-21T13:09:23.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.938+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548006aa90 con 0x7f54801033e0 2024-09-21T13:09:23.942 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.939+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5470042070 con 0x7f54801033e0 2024-09-21T13:09:23.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.940+0000 7f5476ffd640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f546c07af80 0x7f546c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:23.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.940+0000 7f5485bb6640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f546c07af80 0x7f546c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:23.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.940+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f54700be870 con 0x7f54801033e0 2024-09-21T13:09:23.943 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.940+0000 7f5485bb6640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f546c07af80 0x7f546c07d440 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f547c009b60 tx=0x7f547c005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:23.945 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:23.944+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5470089e40 con 0x7f54801033e0 2024-09-21T13:09:24.161 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.160+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5480198350 con 0x7f546c07af80 2024-09-21T13:09:24.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.161+0000 7f5476ffd640 1 -- 172.21.15.46:0/4096556215 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f5480198350 con 0x7f546c07af80 2024-09-21T13:09:24.162 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:09:24.162 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:09:24.163 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:09:24.164 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:09:24.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.163+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f546c07af80 msgr2=0x7f546c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:24.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.163+0000 7f5487e1a640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f546c07af80 0x7f546c07d440 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f547c009b60 tx=0x7f547c005f90 comp rx=0 tx=0).stop 2024-09-21T13:09:24.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.163+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 msgr2=0x7f548019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:24.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.163+0000 7f5487e1a640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548019dbe0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5470031460 tx=0x7f54700045c0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 shutdown_connections 2024-09-21T13:09:24.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f546c07af80 0x7f546c07d440 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f54801033e0 0x7f548019dbe0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 --2- 172.21.15.46:0/4096556215 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5480102ac0 0x7f548019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 >> 172.21.15.46:0/4096556215 conn(0x7f54800fc520 msgr2=0x7f5480108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 shutdown_connections 2024-09-21T13:09:24.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.164+0000 7f5487e1a640 1 -- 172.21.15.46:0/4096556215 wait complete. 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.247+0000 7f01f810b640 1 -- 172.21.15.46:0/3442559707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 msgr2=0x7f01f0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.247+0000 7f01f810b640 1 --2- 172.21.15.46:0/3442559707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f0102e90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f01ec009880 tx=0x7f01ec02a530 comp rx=0 tx=0).stop 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 -- 172.21.15.46:0/3442559707 shutdown_connections 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 --2- 172.21.15.46:0/3442559707 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f01033d0 0x7f01f010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 --2- 172.21.15.46:0/3442559707 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f0102e90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 -- 172.21.15.46:0/3442559707 >> 172.21.15.46:0/3442559707 conn(0x7f01f00fc550 msgr2=0x7f01f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 -- 172.21.15.46:0/3442559707 shutdown_connections 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 -- 172.21.15.46:0/3442559707 wait complete. 2024-09-21T13:09:24.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 Processor -- start 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.248+0000 7f01f810b640 1 -- start start 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f810b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f019d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f810b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f01033d0 0x7f01f019db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f810b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f01f010ede0 con 0x7f01f0102ab0 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f810b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f01f010ec60 con 0x7f01f01033d0 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f019d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f019d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:48964/0 (socket says 172.21.15.46:48964) 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 -- 172.21.15.46:0/2779137904 learned_addr learned my addr 172.21.15.46:0/2779137904 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f56a6640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f01033d0 0x7f01f019db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 -- 172.21.15.46:0/2779137904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f01033d0 msgr2=0x7f01f019db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f01033d0 0x7f01f019db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 -- 172.21.15.46:0/2779137904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f01977b0 con 0x7f01f0102ab0 2024-09-21T13:09:24.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01f5ea7640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f019d630 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f01ec031460 tx=0x7f01ec0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:24.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.249+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01ec03f070 con 0x7f01f0102ab0 2024-09-21T13:09:24.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.250+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f0197a40 con 0x7f01f0102ab0 2024-09-21T13:09:24.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.250+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f01ec004b10 con 0x7f01f0102ab0 2024-09-21T13:09:24.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.250+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f01ec035030 con 0x7f01f0102ab0 2024-09-21T13:09:24.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.250+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f0197f70 con 0x7f01f0102ab0 2024-09-21T13:09:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.251+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f006a580 con 0x7f01f0102ab0 2024-09-21T13:09:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.251+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f01ec042070 con 0x7f01f0102ab0 2024-09-21T13:09:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.252+0000 7f01e6ffd640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f01dc07af40 0x7f01dc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.252+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f01ec0beb50 con 0x7f01f0102ab0 2024-09-21T13:09:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.252+0000 7f01f56a6640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f01dc07af40 0x7f01dc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:24.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.252+0000 7f01f56a6640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f01dc07af40 0x7f01dc07d400 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f01f01088f0 tx=0x7f01e000b2e0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:24.257 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.256+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01ec08a0a0 con 0x7f01f0102ab0 2024-09-21T13:09:24.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:24 smithi046 ceph-mon[108126]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:24 smithi046 ceph-mon[108126]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:24 smithi046 ceph-mon[108126]: from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:24 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/707591106' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:09:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:24 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/330149233' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:09:24.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.543+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f01f0198220 con 0x7f01f0102ab0 2024-09-21T13:09:24.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.543+0000 7f01e6ffd640 1 -- 172.21.15.46:0/2779137904 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7f01ec08ef50 con 0x7f01f0102ab0 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:09:24.545 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.545+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f01dc07af40 msgr2=0x7f01dc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.545+0000 7f01f810b640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f01dc07af40 0x7f01dc07d400 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f01f01088f0 tx=0x7f01e000b2e0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.545+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 msgr2=0x7f01f019d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.545+0000 7f01f810b640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f019d630 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f01ec031460 tx=0x7f01ec0045e0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 shutdown_connections 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f01dc07af40 0x7f01dc07d400 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f01f01033d0 0x7f01f019db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 --2- 172.21.15.46:0/2779137904 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f01f0102ab0 0x7f01f019d630 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 >> 172.21.15.46:0/2779137904 conn(0x7f01f00fc550 msgr2=0x7f01f010aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:24.547 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 shutdown_connections 2024-09-21T13:09:24.548 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:24.546+0000 7f01f810b640 1 -- 172.21.15.46:0/2779137904 wait complete. 2024-09-21T13:09:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:24 smithi176 ceph-mon[80162]: from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:24 smithi176 ceph-mon[80162]: from='client.35070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:24 smithi176 ceph-mon[80162]: from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:24 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/707591106' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:09:24.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:24 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/330149233' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:09:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:25 smithi176 ceph-mon[80162]: pgmap v688: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:25 smithi176 ceph-mon[80162]: from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:25 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2779137904' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:09:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:25 smithi046 ceph-mon[108126]: pgmap v688: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:25 smithi046 ceph-mon[108126]: from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:25.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:25 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2779137904' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:09:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:27 smithi046 ceph-mon[108126]: pgmap v689: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:27 smithi176 ceph-mon[80162]: pgmap v689: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:29 smithi176 ceph-mon[80162]: pgmap v690: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:29.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:29 smithi046 ceph-mon[108126]: pgmap v690: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:31 smithi176 ceph-mon[80162]: pgmap v691: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:31 smithi046 ceph-mon[108126]: pgmap v691: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:33 smithi046 ceph-mon[108126]: pgmap v692: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:33 smithi176 ceph-mon[80162]: pgmap v692: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:35 smithi176 ceph-mon[80162]: pgmap v693: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:35 smithi046 ceph-mon[108126]: pgmap v693: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:37 smithi176 ceph-mon[80162]: pgmap v694: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:37 smithi046 ceph-mon[108126]: pgmap v694: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:39 smithi046 ceph-mon[108126]: pgmap v695: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:39 smithi176 ceph-mon[80162]: pgmap v695: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:41 smithi176 ceph-mon[80162]: pgmap v696: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:41 smithi046 ceph-mon[108126]: pgmap v696: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:43 smithi176 ceph-mon[80162]: pgmap v697: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:43 smithi046 ceph-mon[108126]: pgmap v697: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:45 smithi046 ceph-mon[108126]: pgmap v698: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:45 smithi176 ceph-mon[80162]: pgmap v698: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:47 smithi176 ceph-mon[80162]: pgmap v699: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:47.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:47 smithi046 ceph-mon[108126]: pgmap v699: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:49 smithi176 ceph-mon[80162]: pgmap v700: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:49 smithi046 ceph-mon[108126]: pgmap v700: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:51 smithi046 ceph-mon[108126]: pgmap v701: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:51 smithi176 ceph-mon[80162]: pgmap v701: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:53 smithi176 ceph-mon[80162]: pgmap v702: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:53 smithi046 ceph-mon[108126]: pgmap v702: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:54.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.643+0000 7f995d618640 1 -- 172.21.15.46:0/98501909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958107900 msgr2=0x7f9958107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:54.645 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.643+0000 7f995d618640 1 --2- 172.21.15.46:0/98501909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958107900 0x7f9958107ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f9948009c20 tx=0x7f994802a970 comp rx=0 tx=0).stop 2024-09-21T13:09:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 -- 172.21.15.46:0/98501909 shutdown_connections 2024-09-21T13:09:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 --2- 172.21.15.46:0/98501909 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9958101900 0x7f9958101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 --2- 172.21.15.46:0/98501909 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958107900 0x7f9958107ce0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 -- 172.21.15.46:0/98501909 >> 172.21.15.46:0/98501909 conn(0x7f99580fd600 msgr2=0x7f99580ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 -- 172.21.15.46:0/98501909 shutdown_connections 2024-09-21T13:09:54.646 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 -- 172.21.15.46:0/98501909 wait complete. 2024-09-21T13:09:54.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.644+0000 7f995d618640 1 Processor -- start 2024-09-21T13:09:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f995d618640 1 -- start start 2024-09-21T13:09:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f995d618640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 0x7f995819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f995d618640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9958107900 0x7f995819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f995d618640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f995810edd0 con 0x7f9958101900 2024-09-21T13:09:54.650 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f995d618640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f995810ec50 con 0x7f9958107900 2024-09-21T13:09:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f9956ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 0x7f995819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f9956ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 0x7f995819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42502/0 (socket says 172.21.15.46:42502) 2024-09-21T13:09:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f9956ffd640 1 -- 172.21.15.46:0/2380048265 learned_addr learned my addr 172.21.15.46:0/2380048265 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f99567fc640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9958107900 0x7f995819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f9956ffd640 1 -- 172.21.15.46:0/2380048265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9958107900 msgr2=0x7f995819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:54.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f9956ffd640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9958107900 0x7f995819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.645+0000 7f9956ffd640 1 -- 172.21.15.46:0/2380048265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99581977c0 con 0x7f9958101900 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.646+0000 7f9956ffd640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 0x7f995819d640 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f994802ae90 tx=0x7f994802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.646+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9948047070 con 0x7f9958101900 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.646+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f994802f7e0 con 0x7f9958101900 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.646+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9958197a50 con 0x7f9958101900 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.646+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9948034070 con 0x7f9958101900 2024-09-21T13:09:54.652 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.646+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9958197f80 con 0x7f9958101900 2024-09-21T13:09:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.647+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9958103040 con 0x7f9958101900 2024-09-21T13:09:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.648+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f994804a070 con 0x7f9958101900 2024-09-21T13:09:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.648+0000 7f994ffff640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994407af30 0x7f994407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.648+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f99480beda0 con 0x7f9958101900 2024-09-21T13:09:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.648+0000 7f99567fc640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994407af30 0x7f994407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:54.653 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.649+0000 7f99567fc640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994407af30 0x7f994407d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99580ffbf0 tx=0x7f994000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:54.654 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.653+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f994803f070 con 0x7f9958101900 2024-09-21T13:09:54.860 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.859+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9958198230 con 0x7f994407af30 2024-09-21T13:09:54.861 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.860+0000 7f994ffff640 1 -- 172.21.15.46:0/2380048265 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f9958198230 con 0x7f994407af30 2024-09-21T13:09:54.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994407af30 msgr2=0x7f994407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:54.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994407af30 0x7f994407d3f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f99580ffbf0 tx=0x7f994000b390 comp rx=0 tx=0).stop 2024-09-21T13:09:54.863 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 msgr2=0x7f995819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 0x7f995819d640 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f994802ae90 tx=0x7f994802f5f0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 shutdown_connections 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f994407af30 0x7f994407d3f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9958107900 0x7f995819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 --2- 172.21.15.46:0/2380048265 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9958101900 0x7f995819d640 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 >> 172.21.15.46:0/2380048265 conn(0x7f99580fd600 msgr2=0x7f99580fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 shutdown_connections 2024-09-21T13:09:54.864 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.862+0000 7f995d618640 1 -- 172.21.15.46:0/2380048265 wait complete. 2024-09-21T13:09:54.874 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:09:54.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/4611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54103440 msgr2=0x7f1c5410b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:54.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/4611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54103440 0x7f1c5410b930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098b0 tx=0x7f1c4402a560 comp rx=0 tx=0).stop 2024-09-21T13:09:54.952 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/4611965 shutdown_connections 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/4611965 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54103440 0x7f1c5410b930 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/4611965 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c54102b20 0x7f1c54102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/4611965 >> 172.21.15.46:0/4611965 conn(0x7f1c540fc520 msgr2=0x7f1c540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/4611965 shutdown_connections 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.949+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/4611965 wait complete. 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c5bd3e640 1 Processor -- start 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c5bd3e640 1 -- start start 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c5bd3e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 0x7f1c5419d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c5bd3e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c54103440 0x7f1c5419dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:54.953 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c5bd3e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5410edf0 con 0x7f1c54102b20 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c5bd3e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f1c5410ec70 con 0x7f1c54103440 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c59ada640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 0x7f1c5419d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c59ada640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 0x7f1c5419d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42510/0 (socket says 172.21.15.46:42510) 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c59ada640 1 -- 172.21.15.46:0/1024152197 learned_addr learned my addr 172.21.15.46:0/1024152197 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.950+0000 7f1c592d9640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c54103440 0x7f1c5419dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c59ada640 1 -- 172.21.15.46:0/1024152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c54103440 msgr2=0x7f1c5419dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c59ada640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c54103440 0x7f1c5419dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c59ada640 1 -- 172.21.15.46:0/1024152197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c541978a0 con 0x7f1c54102b20 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c59ada640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 0x7f1c5419d6e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d6f0 tx=0x7f1c5000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c50017070 con 0x7f1c54102b20 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1c5000de00 con 0x7f1c54102b20 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c54197b90 con 0x7f1c54102b20 2024-09-21T13:09:54.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1c50004bb0 con 0x7f1c54102b20 2024-09-21T13:09:54.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.951+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c541980f0 con 0x7f1c54102b20 2024-09-21T13:09:54.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.952+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c5406aa30 con 0x7f1c54102b20 2024-09-21T13:09:54.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.953+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1c50009a30 con 0x7f1c54102b20 2024-09-21T13:09:54.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.953+0000 7f1c4affd640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c4007af80 0x7f1c4007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:54.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.953+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f1c5009db70 con 0x7f1c54102b20 2024-09-21T13:09:54.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.953+0000 7f1c592d9640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c4007af80 0x7f1c4007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:54.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.954+0000 7f1c592d9640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c4007af80 0x7f1c4007d440 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c44000c00 tx=0x7f1c44031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:54.959 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:54.958+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c50069140 con 0x7f1c54102b20 2024-09-21T13:09:55.162 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.161+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1c54198dd0 con 0x7f1c4007af80 2024-09-21T13:09:55.163 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.162+0000 7f1c4affd640 1 -- 172.21.15.46:0/1024152197 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f1c54198dd0 con 0x7f1c4007af80 2024-09-21T13:09:55.165 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c4007af80 msgr2=0x7f1c4007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c4007af80 0x7f1c4007d440 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1c44000c00 tx=0x7f1c44031400 comp rx=0 tx=0).stop 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 msgr2=0x7f1c5419d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 0x7f1c5419d6e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f1c5000d6f0 tx=0x7f1c5000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 shutdown_connections 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f1c4007af80 0x7f1c4007d440 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c54103440 0x7f1c5419dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 --2- 172.21.15.46:0/1024152197 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f1c54102b20 0x7f1c5419d6e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.164+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 >> 172.21.15.46:0/1024152197 conn(0x7f1c540fc520 msgr2=0x7f1c54103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.165+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 shutdown_connections 2024-09-21T13:09:55.166 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.165+0000 7f1c5bd3e640 1 -- 172.21.15.46:0/1024152197 wait complete. 2024-09-21T13:09:55.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.248+0000 7f852f7cc640 1 -- 172.21.15.46:0/3870194989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 msgr2=0x7f8528100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.248+0000 7f852f7cc640 1 --2- 172.21.15.46:0/3870194989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f8528100a30 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f8524009880 tx=0x7f852402a490 comp rx=0 tx=0).stop 2024-09-21T13:09:55.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 -- 172.21.15.46:0/3870194989 shutdown_connections 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 --2- 172.21.15.46:0/3870194989 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8528101000 0x7f852810dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 --2- 172.21.15.46:0/3870194989 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f8528100a30 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 -- 172.21.15.46:0/3870194989 >> 172.21.15.46:0/3870194989 conn(0x7f85280fc520 msgr2=0x7f85280fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 -- 172.21.15.46:0/3870194989 shutdown_connections 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 -- 172.21.15.46:0/3870194989 wait complete. 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 Processor -- start 2024-09-21T13:09:55.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.249+0000 7f852f7cc640 1 -- start start 2024-09-21T13:09:55.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852f7cc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f852819f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852f7cc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8528101000 0x7f852819fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852f7cc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8528110fb0 con 0x7f8528100650 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852f7cc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8528110e30 con 0x7f8528101000 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f852819f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f852819f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42528/0 (socket says 172.21.15.46:42528) 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 -- 172.21.15.46:0/760492921 learned_addr learned my addr 172.21.15.46:0/760492921 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852cd67640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8528101000 0x7f852819fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 -- 172.21.15.46:0/760492921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8528101000 msgr2=0x7f852819fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8528101000 0x7f852819fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 -- 172.21.15.46:0/760492921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8528199a40 con 0x7f8528100650 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.250+0000 7f852d568640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f852819f880 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8524031460 tx=0x7f85240045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.251+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f852403f070 con 0x7f8528100650 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.251+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f85240035f0 con 0x7f8528100650 2024-09-21T13:09:55.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.251+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8528199cd0 con 0x7f8528100650 2024-09-21T13:09:55.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.251+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8524035030 con 0x7f8528100650 2024-09-21T13:09:55.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.251+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f852819a260 con 0x7f8528100650 2024-09-21T13:09:55.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.253+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8524042070 con 0x7f8528100650 2024-09-21T13:09:55.254 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.253+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f852806aa90 con 0x7f8528100650 2024-09-21T13:09:55.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.253+0000 7f851e7fc640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f851407af80 0x7f851407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.253+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f85240be520 con 0x7f8528100650 2024-09-21T13:09:55.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.253+0000 7f852cd67640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f851407af80 0x7f851407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.255 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.254+0000 7f852cd67640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f851407af80 0x7f851407d440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8528102520 tx=0x7f851800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:55.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.259+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8524089af0 con 0x7f8528100650 2024-09-21T13:09:55.459 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.458+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f852819af70 con 0x7f851407af80 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.468+0000 7f851e7fc640 1 -- 172.21.15.46:0/760492921 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f852819af70 con 0x7f851407af80 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (20m) 14m ago 30m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (23m) 14m ago 31m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (23m) 13m ago 30m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (18m) 14m ago 31m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (18m) 13m ago 30m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:09:55.470 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (19m) 14m ago 30m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (14m) 14m ago 25m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (14m) 14m ago 25m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (14m) 13m ago 25m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (13m) 13m ago 25m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (22m) 14m ago 32m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (21m) 13m ago 30m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (18m) 14m ago 32m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (18m) 13m ago 30m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (21m) 14m ago 31m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (21m) 13m ago 30m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (17m) 14m ago 28m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (17m) 14m ago 28m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:09:55.471 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (16m) 14m ago 27m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:09:55.472 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (15m) 13m ago 27m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:09:55.472 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (15m) 13m ago 27m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:09:55.472 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (14m) 13m ago 26m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:09:55.472 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (20m) 14m ago 30m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:09:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f851407af80 msgr2=0x7f851407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f851407af80 0x7f851407d440 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8528102520 tx=0x7f851800b390 comp rx=0 tx=0).stop 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 msgr2=0x7f852819f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f852819f880 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8524031460 tx=0x7f85240045e0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 shutdown_connections 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f851407af80 0x7f851407d440 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8528101000 0x7f852819fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 --2- 172.21.15.46:0/760492921 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8528100650 0x7f852819f880 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 >> 172.21.15.46:0/760492921 conn(0x7f85280fc520 msgr2=0x7f85280fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 shutdown_connections 2024-09-21T13:09:55.473 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.470+0000 7f852f7cc640 1 -- 172.21.15.46:0/760492921 wait complete. 2024-09-21T13:09:55.554 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 -- 172.21.15.46:0/4292157548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 msgr2=0x7f135010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 --2- 172.21.15.46:0/4292157548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135010b8d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1344009880 tx=0x7f134402a530 comp rx=0 tx=0).stop 2024-09-21T13:09:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 -- 172.21.15.46:0/4292157548 shutdown_connections 2024-09-21T13:09:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 --2- 172.21.15.46:0/4292157548 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135010b8d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 --2- 172.21.15.46:0/4292157548 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 0x7f1350102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.555 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 -- 172.21.15.46:0/4292157548 >> 172.21.15.46:0/4292157548 conn(0x7f13500fc520 msgr2=0x7f13500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:55.555 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:55 smithi046 ceph-mon[108126]: pgmap v703: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 -- 172.21.15.46:0/4292157548 shutdown_connections 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.553+0000 7f1355b35640 1 -- 172.21.15.46:0/4292157548 wait complete. 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.554+0000 7f1355b35640 1 Processor -- start 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.554+0000 7f1355b35640 1 -- start start 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.554+0000 7f1355b35640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 0x7f135019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.554+0000 7f1355b35640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.554+0000 7f1355b35640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f135010ee50 con 0x7f13501033e0 2024-09-21T13:09:55.557 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.554+0000 7f1355b35640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f135010ecd0 con 0x7f1350102ac0 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42546/0 (socket says 172.21.15.46:42546) 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 -- 172.21.15.46:0/4020305368 learned_addr learned my addr 172.21.15.46:0/4020305368 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134f7fe640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 0x7f135019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 -- 172.21.15.46:0/4020305368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 msgr2=0x7f135019d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 0x7f135019d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 -- 172.21.15.46:0/4020305368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1350197860 con 0x7f13501033e0 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134f7fe640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 0x7f135019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134effd640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135019dbe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1344031460 tx=0x7f13440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f134403f070 con 0x7f13501033e0 2024-09-21T13:09:55.558 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1350197af0 con 0x7f13501033e0 2024-09-21T13:09:55.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.555+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1344004ac0 con 0x7f13501033e0 2024-09-21T13:09:55.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.556+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1350198020 con 0x7f13501033e0 2024-09-21T13:09:55.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.556+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1344035030 con 0x7f13501033e0 2024-09-21T13:09:55.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.557+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135006aa90 con 0x7f13501033e0 2024-09-21T13:09:55.559 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.557+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f1344042070 con 0x7f13501033e0 2024-09-21T13:09:55.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.558+0000 7f134cff9640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f133807af40 0x7f133807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.558+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f13440beb80 con 0x7f13501033e0 2024-09-21T13:09:55.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.558+0000 7f134f7fe640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f133807af40 0x7f133807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.560 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.559+0000 7f134f7fe640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f133807af40 0x7f133807d400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13501989a0 tx=0x7f1340008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:55.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.562+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f134408a0d0 con 0x7f13501033e0 2024-09-21T13:09:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:55 smithi176 ceph-mon[80162]: pgmap v703: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:55.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.826+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1350105f90 con 0x7f13501033e0 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.827+0000 7f134cff9640 1 -- 172.21.15.46:0/4020305368 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f134408ef80 con 0x7f13501033e0 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:09:55.828 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:09:55.829 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:09:55.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f133807af40 msgr2=0x7f133807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f133807af40 0x7f133807d400 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13501989a0 tx=0x7f1340008040 comp rx=0 tx=0).stop 2024-09-21T13:09:55.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 msgr2=0x7f135019dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135019dbe0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f1344031460 tx=0x7f13440046c0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 shutdown_connections 2024-09-21T13:09:55.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f133807af40 0x7f133807d400 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f13501033e0 0x7f135019dbe0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 --2- 172.21.15.46:0/4020305368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1350102ac0 0x7f135019d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 >> 172.21.15.46:0/4020305368 conn(0x7f13500fc520 msgr2=0x7f1350108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:55.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 shutdown_connections 2024-09-21T13:09:55.831 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.829+0000 7f1355b35640 1 -- 172.21.15.46:0/4020305368 wait complete. 2024-09-21T13:09:55.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 -- 172.21.15.46:0/17284022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d41033d0 msgr2=0x7f70d410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 --2- 172.21.15.46:0/17284022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d41033d0 0x7f70d410b8c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f70c8009880 tx=0x7f70c802a530 comp rx=0 tx=0).stop 2024-09-21T13:09:55.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 -- 172.21.15.46:0/17284022 shutdown_connections 2024-09-21T13:09:55.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 --2- 172.21.15.46:0/17284022 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d41033d0 0x7f70d410b8c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 --2- 172.21.15.46:0/17284022 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d4102ab0 0x7f70d4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 -- 172.21.15.46:0/17284022 >> 172.21.15.46:0/17284022 conn(0x7f70d40fc550 msgr2=0x7f70d40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:55.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 -- 172.21.15.46:0/17284022 shutdown_connections 2024-09-21T13:09:55.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 -- 172.21.15.46:0/17284022 wait complete. 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.914+0000 7f70d9c68640 1 Processor -- start 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d9c68640 1 -- start start 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d9c68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 0x7f70d4100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d9c68640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d41033d0 0x7f70d4100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d9c68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f70d410ede0 con 0x7f70d4102ab0 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d9c68640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f70d410ec60 con 0x7f70d41033d0 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 0x7f70d4100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.917 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d37fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 0x7f70d4100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42558/0 (socket says 172.21.15.46:42558) 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d37fe640 1 -- 172.21.15.46:0/3223212750 learned_addr learned my addr 172.21.15.46:0/3223212750 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d2ffd640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d41033d0 0x7f70d4100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d37fe640 1 -- 172.21.15.46:0/3223212750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d41033d0 msgr2=0x7f70d4100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d37fe640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d41033d0 0x7f70d4100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d37fe640 1 -- 172.21.15.46:0/3223212750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70d4101190 con 0x7f70d4102ab0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.915+0000 7f70d2ffd640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d41033d0 0x7f70d4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.916+0000 7f70d37fe640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 0x7f70d4100710 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c8f0 tx=0x7f70c400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.916+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70c40079b0 con 0x7f70d4102ab0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.916+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f70c40054e0 con 0x7f70d4102ab0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.916+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70d4101480 con 0x7f70d4102ab0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.916+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f70c4004dd0 con 0x7f70d4102ab0 2024-09-21T13:09:55.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.916+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70d41a3e90 con 0x7f70d4102ab0 2024-09-21T13:09:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.917+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70d406a580 con 0x7f70d4102ab0 2024-09-21T13:09:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.918+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f70c4005020 con 0x7f70d4102ab0 2024-09-21T13:09:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.918+0000 7f70d0ff9640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70bc07aed0 0x7f70bc07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.918+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f70c409e090 con 0x7f70d4102ab0 2024-09-21T13:09:55.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.918+0000 7f70d2ffd640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70bc07aed0 0x7f70bc07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:55.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.919+0000 7f70d2ffd640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70bc07aed0 0x7f70bc07d390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f70d41021a0 tx=0x7f70c8009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:55.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:55.923+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f70c4014030 con 0x7f70d4102ab0 2024-09-21T13:09:56.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.148+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f70d4105f50 con 0x7f70d4102ab0 2024-09-21T13:09:56.150 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.149+0000 7f70d0ff9640 1 -- 172.21.15.46:0/3223212750 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f70c40695e0 con 0x7f70d4102ab0 2024-09-21T13:09:56.150 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:09:56.150 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:09:56.150 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:09:56.151 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:09:56.152 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:56.153 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70bc07aed0 msgr2=0x7f70bc07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70bc07aed0 0x7f70bc07d390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f70d41021a0 tx=0x7f70c8009560 comp rx=0 tx=0).stop 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 msgr2=0x7f70d4100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 0x7f70d4100710 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70c400c8f0 tx=0x7f70c400cdb0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 shutdown_connections 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f70bc07aed0 0x7f70bc07d390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f70d41033d0 0x7f70d4100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.154 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 --2- 172.21.15.46:0/3223212750 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f70d4102ab0 0x7f70d4100710 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 >> 172.21.15.46:0/3223212750 conn(0x7f70d40fc550 msgr2=0x7f70d4108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:56.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.151+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 shutdown_connections 2024-09-21T13:09:56.155 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.152+0000 7f70d9c68640 1 -- 172.21.15.46:0/3223212750 wait complete. 2024-09-21T13:09:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 -- 172.21.15.46:0/3077490129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 msgr2=0x7f9180100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 --2- 172.21.15.46:0/3077490129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f9180100c60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9170009880 tx=0x7f917002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 -- 172.21.15.46:0/3077490129 shutdown_connections 2024-09-21T13:09:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 --2- 172.21.15.46:0/3077490129 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f9180100c60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 --2- 172.21.15.46:0/3077490129 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9180106800 0x7f9180106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.243 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 -- 172.21.15.46:0/3077490129 >> 172.21.15.46:0/3077490129 conn(0x7f91800fc520 msgr2=0x7f91800fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:56.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 -- 172.21.15.46:0/3077490129 shutdown_connections 2024-09-21T13:09:56.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 -- 172.21.15.46:0/3077490129 wait complete. 2024-09-21T13:09:56.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.238+0000 7f9187298640 1 Processor -- start 2024-09-21T13:09:56.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9187298640 1 -- start start 2024-09-21T13:09:56.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9187298640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f918019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:56.244 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9187298640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9180106800 0x7f918019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9187298640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f918010dcd0 con 0x7f9180100800 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9187298640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f918010db50 con 0x7f9180106800 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9185034640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f918019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9185034640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f918019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42572/0 (socket says 172.21.15.46:42572) 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9185034640 1 -- 172.21.15.46:0/972075840 learned_addr learned my addr 172.21.15.46:0/972075840 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9184833640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9180106800 0x7f918019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9185034640 1 -- 172.21.15.46:0/972075840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9180106800 msgr2=0x7f918019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9185034640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9180106800 0x7f918019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.239+0000 7f9185034640 1 -- 172.21.15.46:0/972075840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91801977f0 con 0x7f9180100800 2024-09-21T13:09:56.245 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.240+0000 7f9185034640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f918019d670 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f917c00e970 tx=0x7f917c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.240+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f917c00cac0 con 0x7f9180100800 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.240+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f917c0054e0 con 0x7f9180100800 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.240+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9180197ae0 con 0x7f9180100800 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.240+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f917c010430 con 0x7f9180100800 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.240+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9180198040 con 0x7f9180100800 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.241+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9180101f40 con 0x7f9180100800 2024-09-21T13:09:56.246 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.242+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f917c004f00 con 0x7f9180100800 2024-09-21T13:09:56.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.242+0000 7f91767fc640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f916c07af80 0x7f916c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:56.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.242+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f917c09e700 con 0x7f9180100800 2024-09-21T13:09:56.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.242+0000 7f9184833640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f916c07af80 0x7f916c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:56.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.243+0000 7f9184833640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f916c07af80 0x7f916c07d440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9180198b40 tx=0x7f9170031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:56.247 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.247+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f917c069cd0 con 0x7f9180100800 2024-09-21T13:09:56.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:56 smithi046 ceph-mon[108126]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:56.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:56 smithi046 ceph-mon[108126]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:56 smithi046 ceph-mon[108126]: from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:56 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4020305368' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:09:56.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:56 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3223212750' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:09:56.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.452+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f91801983b0 con 0x7f916c07af80 2024-09-21T13:09:56.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.453+0000 7f91767fc640 1 -- 172.21.15.46:0/972075840 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f91801983b0 con 0x7f916c07af80 2024-09-21T13:09:56.454 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:09:56.454 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:09:56.454 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:09:56.454 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:09:56.455 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:09:56.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.455+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f916c07af80 msgr2=0x7f916c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.455+0000 7f9187298640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f916c07af80 0x7f916c07d440 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9180198b40 tx=0x7f9170031400 comp rx=0 tx=0).stop 2024-09-21T13:09:56.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.455+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 msgr2=0x7f918019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.455+0000 7f9187298640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f918019d670 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f917c00e970 tx=0x7f917c00ed70 comp rx=0 tx=0).stop 2024-09-21T13:09:56.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 shutdown_connections 2024-09-21T13:09:56.457 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f916c07af80 0x7f916c07d440 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9180106800 0x7f918019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 --2- 172.21.15.46:0/972075840 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9180100800 0x7f918019d670 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 >> 172.21.15.46:0/972075840 conn(0x7f91800fc520 msgr2=0x7f918006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 shutdown_connections 2024-09-21T13:09:56.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.456+0000 7f9187298640 1 -- 172.21.15.46:0/972075840 wait complete. 2024-09-21T13:09:56.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/1496845159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 msgr2=0x7fdaf0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/1496845159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf0101d60 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009880 tx=0x7fdae002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/1496845159 shutdown_connections 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/1496845159 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf0101d60 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/1496845159 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaf0107900 0x7fdaf0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/1496845159 >> 172.21.15.46:0/1496845159 conn(0x7fdaf00fd600 msgr2=0x7fdaf00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/1496845159 shutdown_connections 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.539+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/1496845159 wait complete. 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf6cd3640 1 Processor -- start 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf6cd3640 1 -- start start 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf6cd3640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf6cd3640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaf0107900 0x7fdaf0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf6cd3640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf010edd0 con 0x7fdaf0101900 2024-09-21T13:09:56.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf6cd3640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf010ec50 con 0x7fdaf0107900 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf4a6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf4a6f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:42584/0 (socket says 172.21.15.46:42584) 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.540+0000 7fdaf4a6f640 1 -- 172.21.15.46:0/709984293 learned_addr learned my addr 172.21.15.46:0/709984293 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdae7fff640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaf0107900 0x7fdaf0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdaf4a6f640 1 -- 172.21.15.46:0/709984293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaf0107900 msgr2=0x7fdaf0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdaf4a6f640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaf0107900 0x7fdaf0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdaf4a6f640 1 -- 172.21.15.46:0/709984293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf0074f70 con 0x7fdaf0101900 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdaf4a6f640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf00744f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00e970 tx=0x7fdaec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdaec00cac0 con 0x7fdaf0101900 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdaec0054e0 con 0x7fdaf0101900 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf0075260 con 0x7fdaf0101900 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdaec010430 con 0x7fdaf0101900 2024-09-21T13:09:56.544 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.541+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf01a3e80 con 0x7fdaf0101900 2024-09-21T13:09:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.542+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaf0103040 con 0x7fdaf0101900 2024-09-21T13:09:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.543+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdaec004f00 con 0x7fdaf0101900 2024-09-21T13:09:56.545 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.544+0000 7fdae5ffb640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdad807af80 0x7fdad807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:09:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.544+0000 7fdae7fff640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdad807af80 0x7fdad807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:09:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.544+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdaec09e620 con 0x7fdaf0101900 2024-09-21T13:09:56.546 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.544+0000 7fdae7fff640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdad807af80 0x7fdad807d440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0075f80 tx=0x7fdae0031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:09:56.549 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.548+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdaec069bf0 con 0x7fdaf0101900 2024-09-21T13:09:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:56 smithi176 ceph-mon[80162]: from='client.35094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:56 smithi176 ceph-mon[80162]: from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:56 smithi176 ceph-mon[80162]: from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:56 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4020305368' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:09:56.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:56 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3223212750' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:09:56.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.811+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdaf0101d60 con 0x7fdaf0101900 2024-09-21T13:09:56.812 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.811+0000 7fdae5ffb640 1 -- 172.21.15.46:0/709984293 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fdaec06eaa0 con 0x7fdaf0101900 2024-09-21T13:09:56.812 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:09:56.813 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:09:56.813 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:09:56.813 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:09:56.813 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:09:56.813 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:09:56.813 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:09:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.813+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdad807af80 msgr2=0x7fdad807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.813+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdad807af80 0x7fdad807d440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0075f80 tx=0x7fdae0031400 comp rx=0 tx=0).stop 2024-09-21T13:09:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.813+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 msgr2=0x7fdaf00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:09:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.813+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf00744f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdaec00e970 tx=0x7fdaec00ed70 comp rx=0 tx=0).stop 2024-09-21T13:09:56.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 shutdown_connections 2024-09-21T13:09:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdad807af80 0x7fdad807d440 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdaf0107900 0x7fdaf0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 --2- 172.21.15.46:0/709984293 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdaf0101900 0x7fdaf00744f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:09:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 >> 172.21.15.46:0/709984293 conn(0x7fdaf00fd600 msgr2=0x7fdaf00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:09:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 shutdown_connections 2024-09-21T13:09:56.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:09:56.814+0000 7fdaf6cd3640 1 -- 172.21.15.46:0/709984293 wait complete. 2024-09-21T13:09:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:57 smithi046 ceph-mon[108126]: pgmap v704: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:57 smithi046 ceph-mon[108126]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:57.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:57 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/709984293' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:09:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:57 smithi176 ceph-mon[80162]: pgmap v704: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:57 smithi176 ceph-mon[80162]: from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:09:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:57 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/709984293' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:09:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:59 smithi176 ceph-mon[80162]: pgmap v705: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:09:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:09:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:59 smithi046 ceph-mon[108126]: pgmap v705: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:09:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:09:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:00.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:00 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T13:09:59.999+0000 7f6620747640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:10:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:00 smithi046 ceph-mon[108126]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:10:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:00 smithi176 ceph-mon[80162]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:10:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:01 smithi176 ceph-mon[80162]: pgmap v706: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:01 smithi046 ceph-mon[108126]: pgmap v706: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:03 smithi046 ceph-mon[108126]: pgmap v707: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:03 smithi176 ceph-mon[80162]: pgmap v707: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:05 smithi046 ceph-mon[108126]: pgmap v708: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:05 smithi176 ceph-mon[80162]: pgmap v708: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:07 smithi046 ceph-mon[108126]: pgmap v709: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:07.800 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:07 smithi176 ceph-mon[80162]: pgmap v709: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:09 smithi046 ceph-mon[108126]: pgmap v710: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:09 smithi176 ceph-mon[80162]: pgmap v710: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:11 smithi046 ceph-mon[108126]: pgmap v711: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:11 smithi176 ceph-mon[80162]: pgmap v711: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:13 smithi046 ceph-mon[108126]: pgmap v712: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:13 smithi176 ceph-mon[80162]: pgmap v712: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:14.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:15.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:15 smithi046 ceph-mon[108126]: pgmap v713: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:15.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:15 smithi176 ceph-mon[80162]: pgmap v713: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:17 smithi046 ceph-mon[108126]: pgmap v714: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:17 smithi176 ceph-mon[80162]: pgmap v714: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:19.618 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:19 smithi176 ceph-mon[80162]: pgmap v715: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:19 smithi046 ceph-mon[108126]: pgmap v715: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:21 smithi046 ceph-mon[108126]: pgmap v716: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:21 smithi176 ceph-mon[80162]: pgmap v716: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:23 smithi046 ceph-mon[108126]: pgmap v717: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:23.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:23 smithi176 ceph-mon[80162]: pgmap v717: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:25 smithi176 ceph-mon[80162]: pgmap v718: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:25 smithi046 ceph-mon[108126]: pgmap v718: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 -- 172.21.15.46:0/3395831878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c101900 msgr2=0x7f3a2c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:26.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3395831878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c101900 0x7f3a2c101d60 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009880 tx=0x7f3a1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:10:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 -- 172.21.15.46:0/3395831878 shutdown_connections 2024-09-21T13:10:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3395831878 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c101900 0x7f3a2c101d60 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3395831878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a2c107900 0x7f3a2c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 -- 172.21.15.46:0/3395831878 >> 172.21.15.46:0/3395831878 conn(0x7f3a2c0fd600 msgr2=0x7f3a2c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 -- 172.21.15.46:0/3395831878 shutdown_connections 2024-09-21T13:10:26.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.914+0000 7f3a33e68640 1 -- 172.21.15.46:0/3395831878 wait complete. 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.915+0000 7f3a33e68640 1 Processor -- start 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.915+0000 7f3a33e68640 1 -- start start 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.915+0000 7f3a33e68640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a2c101900 0x7f3a2c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.915+0000 7f3a33e68640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 0x7f3a2c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.915+0000 7f3a33e68640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c10edb0 con 0x7f3a2c107900 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.915+0000 7f3a33e68640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2c10ec30 con 0x7f3a2c101900 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 0x7f3a2c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 0x7f3a2c074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56328/0 (socket says 172.21.15.46:56328) 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 -- 172.21.15.46:0/3785418461 learned_addr learned my addr 172.21.15.46:0/3785418461 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31c04640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a2c101900 0x7f3a2c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 -- 172.21.15.46:0/3785418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a2c101900 msgr2=0x7f3a2c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a2c101900 0x7f3a2c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:26.918 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 -- 172.21.15.46:0/3785418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2c074f70 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a31403640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 0x7f3a2c074a30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c031460 tx=0x7f3a1c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a1c03f070 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3a1c0035f0 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a2c075200 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3a1c035030 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.916+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a2c1a3d90 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.918+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2c103040 con 0x7f3a2c107900 2024-09-21T13:10:26.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.918+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3a1c042070 con 0x7f3a2c107900 2024-09-21T13:10:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.919+0000 7f3a22ffd640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3a1807af30 0x7f3a1807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.919+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3a1c0bea20 con 0x7f3a2c107900 2024-09-21T13:10:26.920 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.919+0000 7f3a31c04640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3a1807af30 0x7f3a1807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:26.921 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.920+0000 7f3a31c04640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3a1807af30 0x7f3a1807d3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3a28005d00 tx=0x7f3a2800b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:26.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:26.924+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3a1c089f70 con 0x7f3a2c107900 2024-09-21T13:10:27.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.131+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3a2c062630 con 0x7f3a1807af30 2024-09-21T13:10:27.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.133+0000 7f3a22ffd640 1 -- 172.21.15.46:0/3785418461 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f3a2c062630 con 0x7f3a1807af30 2024-09-21T13:10:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3a1807af30 msgr2=0x7f3a1807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3a1807af30 0x7f3a1807d3f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3a28005d00 tx=0x7f3a2800b410 comp rx=0 tx=0).stop 2024-09-21T13:10:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 msgr2=0x7f3a2c074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 0x7f3a2c074a30 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c031460 tx=0x7f3a1c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 shutdown_connections 2024-09-21T13:10:27.136 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3a1807af30 0x7f3a1807d3f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3a2c107900 0x7f3a2c074a30 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 --2- 172.21.15.46:0/3785418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3a2c101900 0x7f3a2c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 >> 172.21.15.46:0/3785418461 conn(0x7f3a2c0fd600 msgr2=0x7f3a2c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:27.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 shutdown_connections 2024-09-21T13:10:27.137 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.135+0000 7f3a33e68640 1 -- 172.21.15.46:0/3785418461 wait complete. 2024-09-21T13:10:27.145 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 -- 172.21.15.46:0/1824990577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c102ab0 msgr2=0x7f0a6c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 --2- 172.21.15.46:0/1824990577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c102ab0 0x7f0a6c102e90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009880 tx=0x7f0a6802a530 comp rx=0 tx=0).stop 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 -- 172.21.15.46:0/1824990577 shutdown_connections 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 --2- 172.21.15.46:0/1824990577 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 --2- 172.21.15.46:0/1824990577 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c102ab0 0x7f0a6c102e90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 -- 172.21.15.46:0/1824990577 >> 172.21.15.46:0/1824990577 conn(0x7f0a6c0fc550 msgr2=0x7f0a6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.221+0000 7f0a736b0640 1 -- 172.21.15.46:0/1824990577 shutdown_connections 2024-09-21T13:10:27.223 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 -- 172.21.15.46:0/1824990577 wait complete. 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 Processor -- start 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 -- start start 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6c102ab0 0x7f0a6c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c10ede0 con 0x7f0a6c1033d0 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.222+0000 7f0a736b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0a6c10ec60 con 0x7f0a6c102ab0 2024-09-21T13:10:27.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:56340/0 (socket says 172.21.15.46:56340) 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 -- 172.21.15.46:0/3490361128 learned_addr learned my addr 172.21.15.46:0/3490361128 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a7144c640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6c102ab0 0x7f0a6c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 -- 172.21.15.46:0/3490361128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6c102ab0 msgr2=0x7f0a6c100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6c102ab0 0x7f0a6c100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 -- 172.21.15.46:0/3490361128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a6c101190 con 0x7f0a6c1033d0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a70c4b640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c100c50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00d6d0 tx=0x7f0a5c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a5c017070 con 0x7f0a6c1033d0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a6c101480 con 0x7f0a6c1033d0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a5c0054e0 con 0x7f0a6c1033d0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a5c004ae0 con 0x7f0a6c1033d0 2024-09-21T13:10:27.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.223+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a6c1a3e30 con 0x7f0a6c1033d0 2024-09-21T13:10:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.225+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a6c06a580 con 0x7f0a6c1033d0 2024-09-21T13:10:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.225+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0a5c004de0 con 0x7f0a6c1033d0 2024-09-21T13:10:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.226+0000 7f0a627fc640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5807af30 0x7f0a5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.227 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.226+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0a5c09dd00 con 0x7f0a6c1033d0 2024-09-21T13:10:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.226+0000 7f0a7144c640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5807af30 0x7f0a5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.226+0000 7f0a7144c640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5807af30 0x7f0a5807d3f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0a680096c0 tx=0x7f0a68031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:27.231 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.230+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a5c0a1030 con 0x7f0a6c1033d0 2024-09-21T13:10:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.434+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0a6c10b5d0 con 0x7f0a5807af30 2024-09-21T13:10:27.436 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.436+0000 7f0a627fc640 1 -- 172.21.15.46:0/3490361128 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f0a6c10b5d0 con 0x7f0a5807af30 2024-09-21T13:10:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5807af30 msgr2=0x7f0a5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5807af30 0x7f0a5807d3f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0a680096c0 tx=0x7f0a68031400 comp rx=0 tx=0).stop 2024-09-21T13:10:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 msgr2=0x7f0a6c100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c100c50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c00d6d0 tx=0x7f0a5c00db90 comp rx=0 tx=0).stop 2024-09-21T13:10:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 shutdown_connections 2024-09-21T13:10:27.439 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0a5807af30 0x7f0a5807d3f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0a6c1033d0 0x7f0a6c100c50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 --2- 172.21.15.46:0/3490361128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a6c102ab0 0x7f0a6c100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 >> 172.21.15.46:0/3490361128 conn(0x7f0a6c0fc550 msgr2=0x7f0a6c10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:27.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 shutdown_connections 2024-09-21T13:10:27.440 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.438+0000 7f0a736b0640 1 -- 172.21.15.46:0/3490361128 wait complete. 2024-09-21T13:10:27.523 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 -- 172.21.15.46:0/1294133102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc101900 msgr2=0x7fc9fc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.524 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 --2- 172.21.15.46:0/1294133102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc101900 0x7fc9fc101d60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0009880 tx=0x7fc9f002a4b0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.524 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:27 smithi046 ceph-mon[108126]: pgmap v719: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 -- 172.21.15.46:0/1294133102 shutdown_connections 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 --2- 172.21.15.46:0/1294133102 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc101900 0x7fc9fc101d60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 --2- 172.21.15.46:0/1294133102 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9fc107900 0x7fc9fc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 -- 172.21.15.46:0/1294133102 >> 172.21.15.46:0/1294133102 conn(0x7fc9fc0fd600 msgr2=0x7fc9fc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 -- 172.21.15.46:0/1294133102 shutdown_connections 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.522+0000 7fca009b0640 1 -- 172.21.15.46:0/1294133102 wait complete. 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.523+0000 7fca009b0640 1 Processor -- start 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.523+0000 7fca009b0640 1 -- start start 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.523+0000 7fca009b0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9fc101900 0x7fc9fc19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fca009b0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 0x7fc9fc19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fca009b0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc10edd0 con 0x7fc9fc107900 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fca009b0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc9fc10ec50 con 0x7fc9fc101900 2024-09-21T13:10:27.526 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 0x7fc9fc19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 0x7fc9fc19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40998/0 (socket says 172.21.15.46:40998) 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 -- 172.21.15.46:0/452540407 learned_addr learned my addr 172.21.15.46:0/452540407 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9fa59c640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9fc101900 0x7fc9fc19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 -- 172.21.15.46:0/452540407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9fc101900 msgr2=0x7fc9fc19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9fc101900 0x7fc9fc19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 -- 172.21.15.46:0/452540407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9fc197800 con 0x7fc9fc107900 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9f9d9b640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 0x7fc9fc19dbc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0031460 tx=0x7fc9f00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.524+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9f003f070 con 0x7fc9fc107900 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.525+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9f00035f0 con 0x7fc9fc107900 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.525+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9fc197a90 con 0x7fc9fc107900 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.525+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9f0035030 con 0x7fc9fc107900 2024-09-21T13:10:27.527 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.525+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9fc197fc0 con 0x7fc9fc107900 2024-09-21T13:10:27.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.526+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9fc103040 con 0x7fc9fc107900 2024-09-21T13:10:27.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.527+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc9f0042070 con 0x7fc9fc107900 2024-09-21T13:10:27.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.527+0000 7fc9eb7fe640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9e407af80 0x7fc9e407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.527+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc9f00bea60 con 0x7fc9fc107900 2024-09-21T13:10:27.528 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.527+0000 7fc9fa59c640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9e407af80 0x7fc9e407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.529 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.528+0000 7fc9fa59c640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9e407af80 0x7fc9e407d440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec005fd0 tx=0x7fc9ec005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:27.532 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.532+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9f0089f90 con 0x7fc9fc107900 2024-09-21T13:10:27.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.728+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc9fc198270 con 0x7fc9e407af80 2024-09-21T13:10:27.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.737+0000 7fc9eb7fe640 1 -- 172.21.15.46:0/452540407 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc9fc198270 con 0x7fc9e407af80 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (20m) 14m ago 31m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (23m) 14m ago 31m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (23m) 14m ago 30m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (18m) 14m ago 31m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (18m) 14m ago 30m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (20m) 14m ago 31m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (15m) 14m ago 26m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (14m) 14m ago 26m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (14m) 14m ago 26m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (14m) 14m ago 26m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (23m) 14m ago 32m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:10:27.739 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (21m) 14m ago 30m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (19m) 14m ago 32m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (19m) 14m ago 30m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (21m) 14m ago 31m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (21m) 14m ago 30m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (18m) 14m ago 29m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (17m) 14m ago 28m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (17m) 14m ago 28m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (16m) 14m ago 28m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (15m) 14m ago 27m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (15m) 14m ago 27m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:10:27.740 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (21m) 14m ago 31m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:10:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9e407af80 msgr2=0x7fc9e407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9e407af80 0x7fc9e407d440 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc9ec005fd0 tx=0x7fc9ec005850 comp rx=0 tx=0).stop 2024-09-21T13:10:27.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 msgr2=0x7fc9fc19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 0x7fc9fc19dbc0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc9f0031460 tx=0x7fc9f00045e0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 shutdown_connections 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9e407af80 0x7fc9e407d440 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc9fc107900 0x7fc9fc19dbc0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 --2- 172.21.15.46:0/452540407 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc9fc101900 0x7fc9fc19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 >> 172.21.15.46:0/452540407 conn(0x7fc9fc0fd600 msgr2=0x7fc9fc0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 shutdown_connections 2024-09-21T13:10:27.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.740+0000 7fca009b0640 1 -- 172.21.15.46:0/452540407 wait complete. 2024-09-21T13:10:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:27 smithi176 ceph-mon[80162]: pgmap v719: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 -- 172.21.15.46:0/524240847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01008b0 msgr2=0x7fa9d0100c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/524240847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01008b0 0x7fa9d0100c90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0009880 tx=0x7fa9c002a530 comp rx=0 tx=0).stop 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 -- 172.21.15.46:0/524240847 shutdown_connections 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/524240847 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9d01011d0 0x7fa9d01056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/524240847 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01008b0 0x7fa9d0100c90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 -- 172.21.15.46:0/524240847 >> 172.21.15.46:0/524240847 conn(0x7fa9d00fc520 msgr2=0x7fa9d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 -- 172.21.15.46:0/524240847 shutdown_connections 2024-09-21T13:10:27.825 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.823+0000 7fa9d62fb640 1 -- 172.21.15.46:0/524240847 wait complete. 2024-09-21T13:10:27.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.824+0000 7fa9d62fb640 1 Processor -- start 2024-09-21T13:10:27.826 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.824+0000 7fa9d62fb640 1 -- start start 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.824+0000 7fa9d62fb640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9d01008b0 0x7fa9d019dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.824+0000 7fa9d62fb640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 0x7fa9d019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.824+0000 7fa9d62fb640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d01153f0 con 0x7fa9d01011d0 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.824+0000 7fa9d62fb640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d0115270 con 0x7fa9d01008b0 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 0x7fa9d019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 0x7fa9d019e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41016/0 (socket says 172.21.15.46:41016) 2024-09-21T13:10:27.827 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 -- 172.21.15.46:0/1227502060 learned_addr learned my addr 172.21.15.46:0/1227502060 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cffff640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9d01008b0 0x7fa9d019dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 -- 172.21.15.46:0/1227502060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9d01008b0 msgr2=0x7fa9d019dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9d01008b0 0x7fa9d019dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 -- 172.21.15.46:0/1227502060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d01a2880 con 0x7fa9d01011d0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cf7fe640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 0x7fa9d019e4f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400d6d0 tx=0x7fa9c400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9c4017070 con 0x7fa9d01011d0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9c40054e0 con 0x7fa9d01011d0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d01a2b70 con 0x7fa9d01011d0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa9c4004ae0 con 0x7fa9d01011d0 2024-09-21T13:10:27.828 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.825+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d01a3100 con 0x7fa9d01011d0 2024-09-21T13:10:27.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.826+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d006aa90 con 0x7fa9d01011d0 2024-09-21T13:10:27.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.828+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa9c4004de0 con 0x7fa9d01011d0 2024-09-21T13:10:27.829 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.828+0000 7fa9cd7fa640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9b807af30 0x7fa9b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:27.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.828+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa9c409dc90 con 0x7fa9d01011d0 2024-09-21T13:10:27.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.828+0000 7fa9cffff640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9b807af30 0x7fa9b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:27.830 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.829+0000 7fa9cffff640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9b807af30 0x7fa9b807d3f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00096c0 tx=0x7fa9c0031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:27.834 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:27.833+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9c4069140 con 0x7fa9d01011d0 2024-09-21T13:10:28.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.097+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa9d019f340 con 0x7fa9d01011d0 2024-09-21T13:10:28.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.098+0000 7fa9cd7fa640 1 -- 172.21.15.46:0/1227502060 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa9d019f340 con 0x7fa9d01011d0 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:10:28.099 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:10:28.100 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:10:28.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9b807af30 msgr2=0x7fa9b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9b807af30 0x7fa9b807d3f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00096c0 tx=0x7fa9c0031400 comp rx=0 tx=0).stop 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 msgr2=0x7fa9d019e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 0x7fa9d019e4f0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fa9c400d6d0 tx=0x7fa9c400db90 comp rx=0 tx=0).stop 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 shutdown_connections 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa9b807af30 0x7fa9b807d3f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa9d01011d0 0x7fa9d019e4f0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.100+0000 7fa9d62fb640 1 --2- 172.21.15.46:0/1227502060 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa9d01008b0 0x7fa9d019dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.101+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 >> 172.21.15.46:0/1227502060 conn(0x7fa9d00fc520 msgr2=0x7fa9d0112b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.101+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 shutdown_connections 2024-09-21T13:10:28.102 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.101+0000 7fa9d62fb640 1 -- 172.21.15.46:0/1227502060 wait complete. 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 -- 172.21.15.46:0/673693661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034100800 msgr2=0x7fb034100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 --2- 172.21.15.46:0/673693661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034100800 0x7fb034100c60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009880 tx=0x7fb01c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 -- 172.21.15.46:0/673693661 shutdown_connections 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 --2- 172.21.15.46:0/673693661 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034100800 0x7fb034100c60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 --2- 172.21.15.46:0/673693661 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb034106800 0x7fb034106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 -- 172.21.15.46:0/673693661 >> 172.21.15.46:0/673693661 conn(0x7fb0340fc520 msgr2=0x7fb0340fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 -- 172.21.15.46:0/673693661 shutdown_connections 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.185+0000 7fb038f3f640 1 -- 172.21.15.46:0/673693661 wait complete. 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb038f3f640 1 Processor -- start 2024-09-21T13:10:28.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb038f3f640 1 -- start start 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb038f3f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb034100800 0x7fb03419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb038f3f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 0x7fb03419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb038f3f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb03410dcb0 con 0x7fb034106800 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb038f3f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb03410db30 con 0x7fb034100800 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 0x7fb03419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb02bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 0x7fb03419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41036/0 (socket says 172.21.15.46:41036) 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb02bfff640 1 -- 172.21.15.46:0/2153131274 learned_addr learned my addr 172.21.15.46:0/2153131274 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.186+0000 7fb03259c640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb034100800 0x7fb03419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02bfff640 1 -- 172.21.15.46:0/2153131274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb034100800 msgr2=0x7fb03419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02bfff640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb034100800 0x7fb03419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.189 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02bfff640 1 -- 172.21.15.46:0/2153131274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0341977f0 con 0x7fb034106800 2024-09-21T13:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02bfff640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 0x7fb03419dbb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb01c031460 tx=0x7fb01c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb01c03f070 con 0x7fb034106800 2024-09-21T13:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb034197a80 con 0x7fb034106800 2024-09-21T13:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb01c004cf0 con 0x7fb034106800 2024-09-21T13:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb01c035030 con 0x7fb034106800 2024-09-21T13:10:28.190 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.187+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb034197fb0 con 0x7fb034106800 2024-09-21T13:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.188+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb034101f40 con 0x7fb034106800 2024-09-21T13:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.189+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb01c042070 con 0x7fb034106800 2024-09-21T13:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.189+0000 7fb02b7fe640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb02007af30 0x7fb02007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.189+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb01c0bea80 con 0x7fb034106800 2024-09-21T13:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.189+0000 7fb03259c640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb02007af30 0x7fb02007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.190+0000 7fb03259c640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb02007af30 0x7fb02007d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb02400abe0 tx=0x7fb02400a2d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:28.195 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.194+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb01c089fd0 con 0x7fb034106800 2024-09-21T13:10:28.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.420+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fb034198d20 con 0x7fb034106800 2024-09-21T13:10:28.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.420+0000 7fb02b7fe640 1 -- 172.21.15.46:0/2153131274 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7fb01c08ee80 con 0x7fb034106800 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:10:28.422 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:10:28.423 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:10:28.424 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:10:28.425 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:10:28.425 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:10:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:10:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb02007af30 msgr2=0x7fb02007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb02007af30 0x7fb02007d3f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb02400abe0 tx=0x7fb02400a2d0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 msgr2=0x7fb03419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 0x7fb03419dbb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb01c031460 tx=0x7fb01c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 shutdown_connections 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb02007af30 0x7fb02007d3f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb034106800 0x7fb03419dbb0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 --2- 172.21.15.46:0/2153131274 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb034100800 0x7fb03419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.422+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 >> 172.21.15.46:0/2153131274 conn(0x7fb0340fc520 msgr2=0x7fb03406a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.423+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 shutdown_connections 2024-09-21T13:10:28.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.423+0000 7fb038f3f640 1 -- 172.21.15.46:0/2153131274 wait complete. 2024-09-21T13:10:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.508+0000 7fce0c921640 1 -- 172.21.15.46:0/3699646044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081067f0 msgr2=0x7fce08106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.508+0000 7fce0c921640 1 --2- 172.21.15.46:0/3699646044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081067f0 0x7fce08106bd0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fce00009880 tx=0x7fce0002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 -- 172.21.15.46:0/3699646044 shutdown_connections 2024-09-21T13:10:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 --2- 172.21.15.46:0/3699646044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce081007f0 0x7fce08100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 --2- 172.21.15.46:0/3699646044 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081067f0 0x7fce08106bd0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.510 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 -- 172.21.15.46:0/3699646044 >> 172.21.15.46:0/3699646044 conn(0x7fce080fc550 msgr2=0x7fce080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 -- 172.21.15.46:0/3699646044 shutdown_connections 2024-09-21T13:10:28.511 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 -- 172.21.15.46:0/3699646044 wait complete. 2024-09-21T13:10:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.509+0000 7fce0c921640 1 Processor -- start 2024-09-21T13:10:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0c921640 1 -- start start 2024-09-21T13:10:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0c921640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 0x7fce080fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.512 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0c921640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce081067f0 0x7fce080fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0c921640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce0810dcc0 con 0x7fce081007f0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0c921640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce0810db40 con 0x7fce081067f0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 0x7fce080fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 0x7fce080fcd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41056/0 (socket says 172.21.15.46:41056) 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 -- 172.21.15.46:0/2280152588 learned_addr learned my addr 172.21.15.46:0/2280152588 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce05d9b640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce081067f0 0x7fce080fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 -- 172.21.15.46:0/2280152588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce081067f0 msgr2=0x7fce080fd290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce081067f0 0x7fce080fd290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 -- 172.21.15.46:0/2280152588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce080fd7d0 con 0x7fce081007f0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.510+0000 7fce0659c640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 0x7fce080fcd50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fce00031460 tx=0x7fce000045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.511+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce0003f070 con 0x7fce081007f0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.511+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce00004b10 con 0x7fce081007f0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.511+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce080fda60 con 0x7fce081007f0 2024-09-21T13:10:28.513 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.511+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce00035030 con 0x7fce081007f0 2024-09-21T13:10:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.511+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce081a3db0 con 0x7fce081007f0 2024-09-21T13:10:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.512+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce08101f30 con 0x7fce081007f0 2024-09-21T13:10:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.512+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fce00042070 con 0x7fce081007f0 2024-09-21T13:10:28.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.513+0000 7fcdff7fe640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcdf407af90 0x7fcdf407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.514+0000 7fce05d9b640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcdf407af90 0x7fcdf407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.514+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce000beae0 con 0x7fce081007f0 2024-09-21T13:10:28.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.514+0000 7fce05d9b640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcdf407af90 0x7fcdf407d450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce080fe7e0 tx=0x7fcdf000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:28.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.518+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce0008a050 con 0x7fce081007f0 2024-09-21T13:10:28.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:28 smithi046 ceph-mon[108126]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:28.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:28 smithi046 ceph-mon[108126]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:28.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:28 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1227502060' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:10:28.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.723+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce08062630 con 0x7fcdf407af90 2024-09-21T13:10:28.725 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.725+0000 7fcdff7fe640 1 -- 172.21.15.46:0/2280152588 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fce08062630 con 0x7fcdf407af90 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:10:28.726 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:10:28.727 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcdf407af90 msgr2=0x7fcdf407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcdf407af90 0x7fcdf407d450 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fce080fe7e0 tx=0x7fcdf000b390 comp rx=0 tx=0).stop 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 msgr2=0x7fce080fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 0x7fce080fcd50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fce00031460 tx=0x7fce000045e0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 shutdown_connections 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcdf407af90 0x7fcdf407d450 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce081067f0 0x7fce080fd290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 --2- 172.21.15.46:0/2280152588 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce081007f0 0x7fce080fcd50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 >> 172.21.15.46:0/2280152588 conn(0x7fce080fc550 msgr2=0x7fce08069ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:28.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 shutdown_connections 2024-09-21T13:10:28.729 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.727+0000 7fce0c921640 1 -- 172.21.15.46:0/2280152588 wait complete. 2024-09-21T13:10:28.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 -- 172.21.15.46:0/2328426716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac107900 msgr2=0x7fcdac107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 --2- 172.21.15.46:0/2328426716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac107900 0x7fcdac107ce0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009880 tx=0x7fcd9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.813 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 -- 172.21.15.46:0/2328426716 shutdown_connections 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 --2- 172.21.15.46:0/2328426716 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac101900 0x7fcdac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 --2- 172.21.15.46:0/2328426716 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac107900 0x7fcdac107ce0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 -- 172.21.15.46:0/2328426716 >> 172.21.15.46:0/2328426716 conn(0x7fcdac0fd600 msgr2=0x7fcdac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 -- 172.21.15.46:0/2328426716 shutdown_connections 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.811+0000 7fcdb254d640 1 -- 172.21.15.46:0/2328426716 wait complete. 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdb254d640 1 Processor -- start 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdb254d640 1 -- start start 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdb254d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 0x7fcdac19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdb254d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac107900 0x7fcdac19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdb254d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac10edd0 con 0x7fcdac101900 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdb254d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcdac10ec50 con 0x7fcdac107900 2024-09-21T13:10:28.814 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 0x7fcdac19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdabfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 0x7fcdac19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:41060/0 (socket says 172.21.15.46:41060) 2024-09-21T13:10:28.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.812+0000 7fcdabfff640 1 -- 172.21.15.46:0/1420487161 learned_addr learned my addr 172.21.15.46:0/1420487161 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:28.815 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcda3fff640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac107900 0x7fcdac19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcdabfff640 1 -- 172.21.15.46:0/1420487161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac107900 msgr2=0x7fcdac19db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcdabfff640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac107900 0x7fcdac19db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcdabfff640 1 -- 172.21.15.46:0/1420487161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdac1977a0 con 0x7fcdac101900 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcda3fff640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac107900 0x7fcdac19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcdabfff640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 0x7fcdac19d620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c031460 tx=0x7fcd9c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c03f070 con 0x7fcdac101900 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcd9c0035f0 con 0x7fcdac101900 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdac197a30 con 0x7fcdac101900 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c035030 con 0x7fcdac101900 2024-09-21T13:10:28.816 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.813+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdac197f60 con 0x7fcdac101900 2024-09-21T13:10:28.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.814+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac103040 con 0x7fcdac101900 2024-09-21T13:10:28.817 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.815+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcd9c042070 con 0x7fcdac101900 2024-09-21T13:10:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:28 smithi176 ceph-mon[80162]: from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:28 smithi176 ceph-mon[80162]: from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:28.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:28 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1227502060' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:10:28.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.815+0000 7fcda9ffb640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd9807af80 0x7fcd9807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:28.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.816+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcd9c0be9c0 con 0x7fcdac101900 2024-09-21T13:10:28.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.816+0000 7fcda3fff640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd9807af80 0x7fcd9807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:28.818 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.816+0000 7fcda3fff640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd9807af80 0x7fcd9807d440 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcd940058c0 tx=0x7fcd94005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:28.821 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:28.820+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd9c089f90 con 0x7fcdac101900 2024-09-21T13:10:29.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.079+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcdac109e70 con 0x7fcdac101900 2024-09-21T13:10:29.080 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.079+0000 7fcda9ffb640 1 -- 172.21.15.46:0/1420487161 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcd9c08ee40 con 0x7fcdac101900 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:10:29.081 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd9807af80 msgr2=0x7fcd9807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd9807af80 0x7fcd9807d440 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcd940058c0 tx=0x7fcd94005850 comp rx=0 tx=0).stop 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 msgr2=0x7fcdac19d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 0x7fcdac19d620 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c031460 tx=0x7fcd9c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 shutdown_connections 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcd9807af80 0x7fcd9807d440 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:29.083 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcdac107900 0x7fcdac19db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:29.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 --2- 172.21.15.46:0/1420487161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcdac101900 0x7fcdac19d620 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:29.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 >> 172.21.15.46:0/1420487161 conn(0x7fcdac0fd600 msgr2=0x7fcdac0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:29.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 shutdown_connections 2024-09-21T13:10:29.084 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:29.082+0000 7fcdb254d640 1 -- 172.21.15.46:0/1420487161 wait complete. 2024-09-21T13:10:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:29 smithi046 ceph-mon[108126]: pgmap v720: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:29 smithi046 ceph-mon[108126]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2153131274' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:10:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1420487161' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:10:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:29 smithi176 ceph-mon[80162]: pgmap v720: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:29 smithi176 ceph-mon[80162]: from='client.35130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2153131274' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:10:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1420487161' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:10:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:30 smithi176 ceph-mon[80162]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:30.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:30 smithi046 ceph-mon[108126]: from='client.35142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:10:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:31 smithi046 ceph-mon[108126]: pgmap v721: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:31 smithi176 ceph-mon[80162]: pgmap v721: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:33 smithi046 ceph-mon[108126]: pgmap v722: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:33.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:33 smithi176 ceph-mon[80162]: pgmap v722: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:35 smithi176 ceph-mon[80162]: pgmap v723: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:35 smithi046 ceph-mon[108126]: pgmap v723: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:37 smithi046 ceph-mon[108126]: pgmap v724: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:37 smithi176 ceph-mon[80162]: pgmap v724: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:39.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:39 smithi046 ceph-mon[108126]: pgmap v725: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:39 smithi176 ceph-mon[80162]: pgmap v725: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:41 smithi046 ceph-mon[108126]: pgmap v726: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:41 smithi176 ceph-mon[80162]: pgmap v726: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:43 smithi046 ceph-mon[108126]: pgmap v727: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:43 smithi176 ceph-mon[80162]: pgmap v727: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:44.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:44.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:45.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:45 smithi046 ceph-mon[108126]: pgmap v728: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:45.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:45 smithi176 ceph-mon[80162]: pgmap v728: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:47 smithi046 ceph-mon[108126]: pgmap v729: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:47.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:47 smithi176 ceph-mon[80162]: pgmap v729: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:49 smithi046 ceph-mon[108126]: pgmap v730: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:49 smithi176 ceph-mon[80162]: pgmap v730: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:51.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:51 smithi046 ceph-mon[108126]: pgmap v731: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:51 smithi176 ceph-mon[80162]: pgmap v731: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:53 smithi046 ceph-mon[108126]: pgmap v732: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:53 smithi176 ceph-mon[80162]: pgmap v732: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:55.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:55 smithi046 ceph-mon[108126]: pgmap v733: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:55.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:55 smithi176 ceph-mon[80162]: pgmap v733: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:57.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:57 smithi176 ceph-mon[80162]: pgmap v734: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:57.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:57 smithi046 ceph-mon[108126]: pgmap v734: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:59.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 -- 172.21.15.46:0/394224104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384107900 msgr2=0x7f3384107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 --2- 172.21.15.46:0/394224104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384107900 0x7f3384107ce0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3374009880 tx=0x7f337402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 -- 172.21.15.46:0/394224104 shutdown_connections 2024-09-21T13:10:59.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 --2- 172.21.15.46:0/394224104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3384101900 0x7f3384101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 --2- 172.21.15.46:0/394224104 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384107900 0x7f3384107ce0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 -- 172.21.15.46:0/394224104 >> 172.21.15.46:0/394224104 conn(0x7f33840fd600 msgr2=0x7f33840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:59.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 -- 172.21.15.46:0/394224104 shutdown_connections 2024-09-21T13:10:59.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 -- 172.21.15.46:0/394224104 wait complete. 2024-09-21T13:10:59.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.181+0000 7f33898e7640 1 Processor -- start 2024-09-21T13:10:59.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f33898e7640 1 -- start start 2024-09-21T13:10:59.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f33898e7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 0x7f338419f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f33898e7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3384107900 0x7f338419fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f33898e7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f338410edb0 con 0x7f3384101900 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f33898e7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f338410ec30 con 0x7f3384107900 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f3382ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 0x7f338419f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f3382ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 0x7f338419f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44124/0 (socket says 172.21.15.46:44124) 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f3382ffd640 1 -- 172.21.15.46:0/3406631391 learned_addr learned my addr 172.21.15.46:0/3406631391 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f33827fc640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3384107900 0x7f338419fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f3382ffd640 1 -- 172.21.15.46:0/3406631391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3384107900 msgr2=0x7f338419fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f3382ffd640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3384107900 0x7f338419fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.182+0000 7f3382ffd640 1 -- 172.21.15.46:0/3406631391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3384199a30 con 0x7f3384101900 2024-09-21T13:10:59.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.183+0000 7f3382ffd640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 0x7f338419f870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3374031460 tx=0x7f33740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:59.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.183+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f337403f070 con 0x7f3384101900 2024-09-21T13:10:59.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.183+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33740035f0 con 0x7f3384101900 2024-09-21T13:10:59.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.183+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3384199cc0 con 0x7f3384101900 2024-09-21T13:10:59.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.183+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3374035030 con 0x7f3384101900 2024-09-21T13:10:59.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.183+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338419a1f0 con 0x7f3384101900 2024-09-21T13:10:59.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.184+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3384103040 con 0x7f3384101900 2024-09-21T13:10:59.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.185+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3374042070 con 0x7f3384101900 2024-09-21T13:10:59.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.185+0000 7f33888e5640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f337007af80 0x7f337007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.186+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f33740be9c0 con 0x7f3384101900 2024-09-21T13:10:59.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.186+0000 7f33827fc640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f337007af80 0x7f337007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.187 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.186+0000 7f33827fc640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f337007af80 0x7f337007d440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f336c005fd0 tx=0x7f336c005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:59.191 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.190+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3374089f90 con 0x7f3384101900 2024-09-21T13:10:59.400 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.399+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f338419afd0 con 0x7f337007af80 2024-09-21T13:10:59.401 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.400+0000 7f33888e5640 1 -- 172.21.15.46:0/3406631391 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f338419afd0 con 0x7f337007af80 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f337007af80 msgr2=0x7f337007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f337007af80 0x7f337007d440 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f336c005fd0 tx=0x7f336c005850 comp rx=0 tx=0).stop 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 msgr2=0x7f338419f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 0x7f338419f870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3374031460 tx=0x7f33740045e0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 shutdown_connections 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f337007af80 0x7f337007d440 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3384107900 0x7f338419fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 --2- 172.21.15.46:0/3406631391 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3384101900 0x7f338419f870 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.402+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 >> 172.21.15.46:0/3406631391 conn(0x7f33840fd600 msgr2=0x7f3384074900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.403+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 shutdown_connections 2024-09-21T13:10:59.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.403+0000 7f33898e7640 1 -- 172.21.15.46:0/3406631391 wait complete. 2024-09-21T13:10:59.413 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:10:59.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2968993007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb8102ab0 msgr2=0x7f7fb8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2968993007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb8102ab0 0x7f7fb8102e90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8009880 tx=0x7f7fa802a530 comp rx=0 tx=0).stop 2024-09-21T13:10:59.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2968993007 shutdown_connections 2024-09-21T13:10:59.490 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2968993007 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb81033d0 0x7f7fb810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2968993007 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb8102ab0 0x7f7fb8102e90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.491 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2968993007 >> 172.21.15.46:0/2968993007 conn(0x7f7fb80fc550 msgr2=0x7f7fb80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:59.491 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:59 smithi046 ceph-mon[108126]: pgmap v735: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:59.491 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:10:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:59.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2968993007 shutdown_connections 2024-09-21T13:10:59.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.489+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2968993007 wait complete. 2024-09-21T13:10:59.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fbe3e5640 1 Processor -- start 2024-09-21T13:10:59.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fbe3e5640 1 -- start start 2024-09-21T13:10:59.493 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fbe3e5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb8102ab0 0x7f7fb819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fbe3e5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 0x7f7fb819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fbe3e5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb810ede0 con 0x7f7fb81033d0 2024-09-21T13:10:59.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fbe3e5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f7fb810ec60 con 0x7f7fb8102ab0 2024-09-21T13:10:59.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 0x7f7fb819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.494 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fb77fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 0x7f7fb819fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44136/0 (socket says 172.21.15.46:44136) 2024-09-21T13:10:59.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fb7fff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb8102ab0 0x7f7fb819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.490+0000 7f7fb77fe640 1 -- 172.21.15.46:0/2395311015 learned_addr learned my addr 172.21.15.46:0/2395311015 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:59.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb7fff640 1 -- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 msgr2=0x7f7fb819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb7fff640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 0x7f7fb819fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb7fff640 1 -- 172.21.15.46:0/2395311015 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb8199a20 con 0x7f7fb8102ab0 2024-09-21T13:10:59.495 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb77fe640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 0x7f7fb819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:10:59.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb7fff640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb8102ab0 0x7f7fb819f810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802aa50 tx=0x7f7fa80045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:59.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fa803f070 con 0x7f7fb8102ab0 2024-09-21T13:10:59.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb8199cb0 con 0x7f7fb8102ab0 2024-09-21T13:10:59.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fb819a1e0 con 0x7f7fb8102ab0 2024-09-21T13:10:59.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fa80035f0 con 0x7f7fb8102ab0 2024-09-21T13:10:59.496 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.491+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fa8035030 con 0x7f7fb8102ab0 2024-09-21T13:10:59.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.492+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fb806a580 con 0x7f7fb8102ab0 2024-09-21T13:10:59.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.493+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f7fa8042070 con 0x7f7fb8102ab0 2024-09-21T13:10:59.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.494+0000 7f7fb57fa640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fa007af90 0x7f7fa007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.494+0000 7f7fb77fe640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fa007af90 0x7f7fa007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.494+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f7fa80be930 con 0x7f7fb8102ab0 2024-09-21T13:10:59.498 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.494+0000 7f7fb77fe640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fa007af90 0x7f7fa007d450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80feeb0 tx=0x7f7fac00b360 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:59.499 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.498+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fa8089f00 con 0x7f7fb8102ab0 2024-09-21T13:10:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.702+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7fb819af00 con 0x7f7fa007af90 2024-09-21T13:10:59.704 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.704+0000 7f7fb57fa640 1 -- 172.21.15.46:0/2395311015 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7f7fb819af00 con 0x7f7fa007af90 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fa007af90 msgr2=0x7f7fa007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fa007af90 0x7f7fa007d450 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7fb80feeb0 tx=0x7f7fac00b360 comp rx=0 tx=0).stop 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb8102ab0 msgr2=0x7f7fb819f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb8102ab0 0x7f7fb819f810 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fa802aa50 tx=0x7f7fa80045e0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 shutdown_connections 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f7fa007af90 0x7f7fa007d450 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.707 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f7fb81033d0 0x7f7fb819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 --2- 172.21.15.46:0/2395311015 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb8102ab0 0x7f7fb819f810 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 >> 172.21.15.46:0/2395311015 conn(0x7f7fb80fc550 msgr2=0x7f7fb8100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:59.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 shutdown_connections 2024-09-21T13:10:59.708 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.706+0000 7f7fbe3e5640 1 -- 172.21.15.46:0/2395311015 wait complete. 2024-09-21T13:10:59.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 -- 172.21.15.46:0/2885208179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 msgr2=0x7f2f04100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 --2- 172.21.15.46:0/2885208179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04100c60 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8009880 tx=0x7f2ef802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 -- 172.21.15.46:0/2885208179 shutdown_connections 2024-09-21T13:10:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 --2- 172.21.15.46:0/2885208179 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04100c60 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 --2- 172.21.15.46:0/2885208179 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f04106800 0x7f2f04106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 -- 172.21.15.46:0/2885208179 >> 172.21.15.46:0/2885208179 conn(0x7f2f040fc520 msgr2=0x7f2f040fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:10:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 -- 172.21.15.46:0/2885208179 shutdown_connections 2024-09-21T13:10:59.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.790+0000 7f2f0a504640 1 -- 172.21.15.46:0/2885208179 wait complete. 2024-09-21T13:10:59.793 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.791+0000 7f2f0a504640 1 Processor -- start 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.791+0000 7f2f0a504640 1 -- start start 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.791+0000 7f2f0a504640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.791+0000 7f2f0a504640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f04106800 0x7f2f04198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.791+0000 7f2f0a504640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0410dd30 con 0x7f2f04100800 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.791+0000 7f2f0a504640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0410dbb0 con 0x7f2f04106800 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44152/0 (socket says 172.21.15.46:44152) 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 -- 172.21.15.46:0/1477945511 learned_addr learned my addr 172.21.15.46:0/1477945511 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f037fe640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f04106800 0x7f2f04198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 -- 172.21.15.46:0/1477945511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f04106800 msgr2=0x7f2f04198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f04106800 0x7f2f04198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 -- 172.21.15.46:0/1477945511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f041993c0 con 0x7f2f04100800 2024-09-21T13:10:59.794 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f03fff640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04198880 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400b420 tx=0x7f2ef400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef4011630 con 0x7f2f04100800 2024-09-21T13:10:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2ef4016070 con 0x7f2f04100800 2024-09-21T13:10:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f041996b0 con 0x7f2f04100800 2024-09-21T13:10:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2ef4010d40 con 0x7f2f04100800 2024-09-21T13:10:59.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.792+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f041a1cb0 con 0x7f2f04100800 2024-09-21T13:10:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.794+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f04101f40 con 0x7f2f04100800 2024-09-21T13:10:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.794+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2ef401b460 con 0x7f2f04100800 2024-09-21T13:10:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.795+0000 7f2f017fa640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2eec07af30 0x7f2eec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:10:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.795+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2ef409d770 con 0x7f2f04100800 2024-09-21T13:10:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.795+0000 7f2f037fe640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2eec07af30 0x7f2eec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:10:59.796 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.795+0000 7f2f037fe640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2eec07af30 0x7f2eec07d3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f0406ad00 tx=0x7f2ef8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:10:59.800 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.799+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2f041996b0 con 0x7f2f04100800 2024-09-21T13:10:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:59 smithi176 ceph-mon[80162]: pgmap v735: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:10:59.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:10:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:10:59.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:10:59.994+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2f04062630 con 0x7f2eec07af30 2024-09-21T13:11:00.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.004+0000 7f2f017fa640 1 -- 172.21.15.46:0/1477945511 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f2f04062630 con 0x7f2eec07af30 2024-09-21T13:11:00.005 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (21m) 15m ago 31m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (24m) 15m ago 32m 9332k - 19.1.1-373-g4e45e6b4 164465d2334a 8a6e7c299f18 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (24m) 14m ago 31m 9156k - 19.1.1-373-g4e45e6b4 164465d2334a bfac07c8287a 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (19m) 15m ago 32m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (19m) 14m ago 31m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (20m) 15m ago 31m 77.6M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (15m) 15m ago 26m 15.4M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (15m) 15m ago 26m 11.7M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (15m) 14m ago 26m 13.9M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (14m) 14m ago 26m 11.8M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:11:00.006 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (23m) 15m ago 33m 532M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (22m) 14m ago 31m 459M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (19m) 15m ago 33m 50.2M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (19m) 14m ago 31m 41.4M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (22m) 15m ago 32m 12.2M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (22m) 14m ago 31m 11.7M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (18m) 15m ago 30m 86.6M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (18m) 15m ago 29m 94.3M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (17m) 15m ago 29m 78.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (17m) 14m ago 28m 93.6M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (16m) 14m ago 28m 92.7M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (15m) 14m ago 27m 86.4M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:11:00.007 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (21m) 15m ago 31m 58.9M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2eec07af30 msgr2=0x7f2eec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2eec07af30 0x7f2eec07d3f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2f0406ad00 tx=0x7f2ef8031400 comp rx=0 tx=0).stop 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 msgr2=0x7f2f04198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04198880 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2ef400b420 tx=0x7f2ef400b8e0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 shutdown_connections 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2eec07af30 0x7f2eec07d3f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2f04106800 0x7f2f04198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.008 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 --2- 172.21.15.46:0/1477945511 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2f04100800 0x7f2f04198880 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.006+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 >> 172.21.15.46:0/1477945511 conn(0x7f2f040fc520 msgr2=0x7f2f040fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.007+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 shutdown_connections 2024-09-21T13:11:00.009 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.007+0000 7f2f0a504640 1 -- 172.21.15.46:0/1477945511 wait complete. 2024-09-21T13:11:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.089+0000 7f3f4260a640 1 -- 172.21.15.46:0/1314008517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c100800 msgr2=0x7f3f3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.089+0000 7f3f4260a640 1 --2- 172.21.15.46:0/1314008517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c100800 0x7f3f3c100c60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3f30009880 tx=0x7f3f3002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 -- 172.21.15.46:0/1314008517 shutdown_connections 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 --2- 172.21.15.46:0/1314008517 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c100800 0x7f3f3c100c60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 --2- 172.21.15.46:0/1314008517 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c106800 0x7f3f3c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 -- 172.21.15.46:0/1314008517 >> 172.21.15.46:0/1314008517 conn(0x7f3f3c0fc520 msgr2=0x7f3f3c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 -- 172.21.15.46:0/1314008517 shutdown_connections 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 -- 172.21.15.46:0/1314008517 wait complete. 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 Processor -- start 2024-09-21T13:11:00.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.090+0000 7f3f4260a640 1 -- start start 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f4260a640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c100800 0x7f3f3c19d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f4260a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 0x7f3f3c19dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f4260a640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c10dcd0 con 0x7f3f3c106800 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f4260a640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c10db50 con 0x7f3f3c100800 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 0x7f3f3c19dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3bfff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c100800 0x7f3f3c19d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3b7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 0x7f3f3c19dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44172/0 (socket says 172.21.15.46:44172) 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3b7fe640 1 -- 172.21.15.46:0/593410480 learned_addr learned my addr 172.21.15.46:0/593410480 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3b7fe640 1 -- 172.21.15.46:0/593410480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c100800 msgr2=0x7f3f3c19d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3b7fe640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c100800 0x7f3f3c19d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.094 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3b7fe640 1 -- 172.21.15.46:0/593410480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c1977f0 con 0x7f3f3c106800 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.091+0000 7f3f3bfff640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c100800 0x7f3f3c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.092+0000 7f3f3b7fe640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 0x7f3f3c19dbb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3f30031460 tx=0x7f3f30004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.092+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f3003f070 con 0x7f3f3c106800 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.092+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3f30004a90 con 0x7f3f3c106800 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.092+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3c197a80 con 0x7f3f3c106800 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.092+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3f30035030 con 0x7f3f3c106800 2024-09-21T13:11:00.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.092+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3c197fb0 con 0x7f3f3c106800 2024-09-21T13:11:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.093+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3c101f40 con 0x7f3f3c106800 2024-09-21T13:11:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.094+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f3f30042070 con 0x7f3f3c106800 2024-09-21T13:11:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.095+0000 7f3f397fa640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f2407af80 0x7f3f2407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.095+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f3f300be7e0 con 0x7f3f3c106800 2024-09-21T13:11:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.095+0000 7f3f3bfff640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f2407af80 0x7f3f2407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.095+0000 7f3f3bfff640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f2407af80 0x7f3f2407d440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009fc0 tx=0x7f3f2c005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:00.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.099+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3f30089db0 con 0x7f3f3c106800 2024-09-21T13:11:00.361 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.360+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f3f3c109d80 con 0x7f3f3c106800 2024-09-21T13:11:00.362 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.361+0000 7f3f397fa640 1 -- 172.21.15.46:0/593410480 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f3f3008ec60 con 0x7f3f3c106800 2024-09-21T13:11:00.362 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:11:00.362 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:11:00.362 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:11:00.363 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:11:00.364 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.363+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f2407af80 msgr2=0x7f3f2407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.363+0000 7f3f4260a640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f2407af80 0x7f3f2407d440 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c009fc0 tx=0x7f3f2c005f90 comp rx=0 tx=0).stop 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.363+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 msgr2=0x7f3f3c19dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.363+0000 7f3f4260a640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 0x7f3f3c19dbb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f3f30031460 tx=0x7f3f30004530 comp rx=0 tx=0).stop 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.363+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 shutdown_connections 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.363+0000 7f3f4260a640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f3f2407af80 0x7f3f2407d440 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.364+0000 7f3f4260a640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f3f3c106800 0x7f3f3c19dbb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.364+0000 7f3f4260a640 1 --2- 172.21.15.46:0/593410480 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3f3c100800 0x7f3f3c19d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.364+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 >> 172.21.15.46:0/593410480 conn(0x7f3f3c0fc520 msgr2=0x7f3f3c06a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.364+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 shutdown_connections 2024-09-21T13:11:00.365 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.364+0000 7f3f4260a640 1 -- 172.21.15.46:0/593410480 wait complete. 2024-09-21T13:11:00.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 -- 172.21.15.46:0/3015400177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 msgr2=0x7f453c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 --2- 172.21.15.46:0/3015400177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c101d60 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f4530009880 tx=0x7f453002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 -- 172.21.15.46:0/3015400177 shutdown_connections 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 --2- 172.21.15.46:0/3015400177 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c101d60 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 --2- 172.21.15.46:0/3015400177 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 0x7f453c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 -- 172.21.15.46:0/3015400177 >> 172.21.15.46:0/3015400177 conn(0x7f453c0fd600 msgr2=0x7f453c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 -- 172.21.15.46:0/3015400177 shutdown_connections 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.448+0000 7f45417b2640 1 -- 172.21.15.46:0/3015400177 wait complete. 2024-09-21T13:11:00.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f45417b2640 1 Processor -- start 2024-09-21T13:11:00.454 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f45417b2640 1 -- start start 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f45417b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f45417b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 0x7f453c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f45417b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f453c10ee30 con 0x7f453c101900 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f45417b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f453c10ecb0 con 0x7f453c107900 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f453affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f453affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44194/0 (socket says 172.21.15.46:44194) 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f453affd640 1 -- 172.21.15.46:0/2671904848 learned_addr learned my addr 172.21.15.46:0/2671904848 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.449+0000 7f453a7fc640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 0x7f453c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f453affd640 1 -- 172.21.15.46:0/2671904848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 msgr2=0x7f453c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f453affd640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 0x7f453c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f453affd640 1 -- 172.21.15.46:0/2671904848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c197840 con 0x7f453c101900 2024-09-21T13:11:00.455 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f453a7fc640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 0x7f453c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f453affd640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c19d6c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f452c00b420 tx=0x7f452c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f452c011630 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f452c016070 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453c197b30 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f452c010d40 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.450+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453c198090 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.451+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453c103040 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.452+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f452c01b460 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.452+0000 7f4523fff640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f452407af80 0x7f452407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.452+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f452c09d840 con 0x7f453c101900 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.452+0000 7f453a7fc640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f452407af80 0x7f452407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.453+0000 7f453a7fc640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f452407af80 0x7f452407d440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f453c198b90 tx=0x7f4530031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:00.458 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.457+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f452c021250 con 0x7f453c101900 2024-09-21T13:11:00.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:00 smithi046 ceph-mon[108126]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:00.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:00 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/593410480' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:00.685 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.684+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f453c109e90 con 0x7f453c101900 2024-09-21T13:11:00.686 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.685+0000 7f4523fff640 1 -- 172.21.15.46:0/2671904848 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 31 v31) ==== 76+0+2002 (secure 0 0 0) 0x7f452c068d70 con 0x7f453c101900 2024-09-21T13:11:00.686 INFO:teuthology.orchestra.run.smithi046.stdout:e31 2024-09-21T13:11:00.686 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T12:56:11:268861+0000 2024-09-21T13:11:00.686 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:11:00.686 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 22 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T12:55:13.816524+0000 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:11:00.687 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:up {} 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:failed 0,1 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:11:00.688 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 0 members: 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:Standby daemons: 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{-1:34328} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{-1:34360} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{-1:44303} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:00.689 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{-1:44335} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f452407af80 msgr2=0x7f452407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f452407af80 0x7f452407d440 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f453c198b90 tx=0x7f4530031400 comp rx=0 tx=0).stop 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 msgr2=0x7f453c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c19d6c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f452c00b420 tx=0x7f452c00b8e0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 shutdown_connections 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f452407af80 0x7f452407d440 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f453c107900 0x7f453c19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 --2- 172.21.15.46:0/2671904848 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f453c101900 0x7f453c19d6c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 >> 172.21.15.46:0/2671904848 conn(0x7f453c0fd600 msgr2=0x7f453c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 shutdown_connections 2024-09-21T13:11:00.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.688+0000 7f45417b2640 1 -- 172.21.15.46:0/2671904848 wait complete. 2024-09-21T13:11:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 -- 172.21.15.46:0/3097534792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 msgr2=0x7fc100100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 --2- 172.21.15.46:0/3097534792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc100100c50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fc0e8009880 tx=0x7fc0e802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.776 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 -- 172.21.15.46:0/3097534792 shutdown_connections 2024-09-21T13:11:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 --2- 172.21.15.46:0/3097534792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc100100c50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 --2- 172.21.15.46:0/3097534792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 0x7fc100106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 -- 172.21.15.46:0/3097534792 >> 172.21.15.46:0/3097534792 conn(0x7fc1000fc550 msgr2=0x7fc1000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 -- 172.21.15.46:0/3097534792 shutdown_connections 2024-09-21T13:11:00.777 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.775+0000 7fc1064c0640 1 -- 172.21.15.46:0/3097534792 wait complete. 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc1064c0640 1 Processor -- start 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc1064c0640 1 -- start start 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc1064c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc1001987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc1064c0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 0x7fc100198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc1064c0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fc10010dcc0 con 0x7fc1001007f0 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc1064c0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fc10010db40 con 0x7fc1001067f0 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc0fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc1001987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc0fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc1001987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44224/0 (socket says 172.21.15.46:44224) 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc0fffff640 1 -- 172.21.15.46:0/2641937412 learned_addr learned my addr 172.21.15.46:0/2641937412 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.776+0000 7fc0f7fff640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 0x7fc100198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fffff640 1 -- 172.21.15.46:0/2641937412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 msgr2=0x7fc100198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:00.779 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fffff640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 0x7fc100198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fffff640 1 -- 172.21.15.46:0/2641937412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc100199340 con 0x7fc1001007f0 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0f7fff640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 0x7fc100198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fffff640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc1001987b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000d6f0 tx=0x7fc0f000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc0f0017070 con 0x7fc1001007f0 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1001a1820 con 0x7fc1001007f0 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a1c20 con 0x7fc1001007f0 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc0f000de00 con 0x7fc1001007f0 2024-09-21T13:11:00.780 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.777+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc0f0004bb0 con 0x7fc1001007f0 2024-09-21T13:11:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.778+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0e0005290 con 0x7fc1001007f0 2024-09-21T13:11:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.779+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc0f0009a30 con 0x7fc1001007f0 2024-09-21T13:11:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.779+0000 7fc0fdffb640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0ec07af80 0x7fc0ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.779+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc0f009dbb0 con 0x7fc1001007f0 2024-09-21T13:11:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.779+0000 7fc0f7fff640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0ec07af80 0x7fc0ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:00.781 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.780+0000 7fc0f7fff640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0ec07af80 0x7fc0ec07d440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc10006a830 tx=0x7fc0e8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:00.785 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.784+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc0f00a4080 con 0x7fc1001007f0 2024-09-21T13:11:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:00 smithi176 ceph-mon[80162]: from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:00.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:00 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/593410480' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:00.996 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.995+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc0e0000bc0 con 0x7fc0ec07af80 2024-09-21T13:11:00.997 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.996+0000 7fc0fdffb640 1 -- 172.21.15.46:0/2641937412 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+431 (secure 0 0 0) 0x7fc0e0000bc0 con 0x7fc0ec07af80 2024-09-21T13:11:00.997 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:11:00.998 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:11:00.998 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:11:00.998 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:11:00.998 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:11:00.998 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:11:00.998 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:11:00.999 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:11:00.999 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:11:00.999 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:11:00.999 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:11:00.999 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "16/23 daemons upgraded", 2024-09-21T13:11:00.999 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T13:11:01.000 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:11:01.000 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:11:01.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0ec07af80 msgr2=0x7fc0ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:01.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0ec07af80 0x7fc0ec07d440 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc10006a830 tx=0x7fc0e8031400 comp rx=0 tx=0).stop 2024-09-21T13:11:01.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 msgr2=0x7fc1001987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc1001987b0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc0f000d6f0 tx=0x7fc0f000dbb0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 shutdown_connections 2024-09-21T13:11:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc0ec07af80 0x7fc0ec07d440 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1001067f0 0x7fc100198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 --2- 172.21.15.46:0/2641937412 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fc1001007f0 0x7fc1001987b0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 >> 172.21.15.46:0/2641937412 conn(0x7fc1000fc550 msgr2=0x7fc1000fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:01.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 shutdown_connections 2024-09-21T13:11:01.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:00.999+0000 7fc1064c0640 1 -- 172.21.15.46:0/2641937412 wait complete. 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 -- 172.21.15.46:0/3308978233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 msgr2=0x7fcbf8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 --2- 172.21.15.46:0/3308978233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8102ea0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009880 tx=0x7fcbe802a530 comp rx=0 tx=0).stop 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 -- 172.21.15.46:0/3308978233 shutdown_connections 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 --2- 172.21.15.46:0/3308978233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 0x7fcbf810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 --2- 172.21.15.46:0/3308978233 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8102ea0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 -- 172.21.15.46:0/3308978233 >> 172.21.15.46:0/3308978233 conn(0x7fcbf80fc520 msgr2=0x7fcbf80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 -- 172.21.15.46:0/3308978233 shutdown_connections 2024-09-21T13:11:01.087 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.085+0000 7fcbfd901640 1 -- 172.21.15.46:0/3308978233 wait complete. 2024-09-21T13:11:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbfd901640 1 Processor -- start 2024-09-21T13:11:01.088 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbfd901640 1 -- start start 2024-09-21T13:11:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbfd901640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbfd901640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 0x7fcbf8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbfd901640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf810edf0 con 0x7fcbf8102ac0 2024-09-21T13:11:01.089 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbfd901640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf810ec70 con 0x7fcbf81033e0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbf6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbf6ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:44248/0 (socket says 172.21.15.46:44248) 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.086+0000 7fcbf6ffd640 1 -- 172.21.15.46:0/1750312709 learned_addr learned my addr 172.21.15.46:0/1750312709 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbf67fc640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 0x7fcbf8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbf6ffd640 1 -- 172.21.15.46:0/1750312709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 msgr2=0x7fcbf8100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbf6ffd640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 0x7fcbf8100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbf6ffd640 1 -- 172.21.15.46:0/1750312709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf81011a0 con 0x7fcbf8102ac0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbf67fc640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 0x7fcbf8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbf6ffd640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8100720 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8031460 tx=0x7fcbe80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbe803f070 con 0x7fcbf8102ac0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcbe80035f0 con 0x7fcbf8102ac0 2024-09-21T13:11:01.090 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf8101430 con 0x7fcbf8102ac0 2024-09-21T13:11:01.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcbe8035030 con 0x7fcbf8102ac0 2024-09-21T13:11:01.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.087+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf81a3da0 con 0x7fcbf8102ac0 2024-09-21T13:11:01.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.088+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf806aa90 con 0x7fcbf8102ac0 2024-09-21T13:11:01.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.089+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fcbe8042070 con 0x7fcbf8102ac0 2024-09-21T13:11:01.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.089+0000 7fcbfc8ff640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcbe007af80 0x7fcbe007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:01.091 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.090+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fcbe80be9c0 con 0x7fcbf8102ac0 2024-09-21T13:11:01.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.090+0000 7fcbf67fc640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcbe007af80 0x7fcbe007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:01.092 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.090+0000 7fcbf67fc640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcbe007af80 0x7fcbe007d440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcbec005fd0 tx=0x7fcbec005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:01.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.094+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcbe8089f90 con 0x7fcbf8102ac0 2024-09-21T13:11:01.355 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.354+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fcbf8105f90 con 0x7fcbf8102ac0 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.354+0000 7fcbfc8ff640 1 -- 172.21.15.46:0/1750312709 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+423 (secure 0 0 0) 0x7fcbe808ee40 con 0x7fcbf8102ac0 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data; 1 filesystem is offline 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is degraded 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:11:01.356 INFO:teuthology.orchestra.run.smithi046.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-09-21T13:11:01.357 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs is offline because no MDS is active for it. 2024-09-21T13:11:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcbe007af80 msgr2=0x7fcbe007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcbe007af80 0x7fcbe007d440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcbec005fd0 tx=0x7fcbec005850 comp rx=0 tx=0).stop 2024-09-21T13:11:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 msgr2=0x7fcbf8100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:01.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8100720 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8031460 tx=0x7fcbe80045e0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 shutdown_connections 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fcbe007af80 0x7fcbe007d440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbf81033e0 0x7fcbf8100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 --2- 172.21.15.46:0/1750312709 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fcbf8102ac0 0x7fcbf8100720 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 >> 172.21.15.46:0/1750312709 conn(0x7fcbf80fc520 msgr2=0x7fcbf8108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 shutdown_connections 2024-09-21T13:11:01.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:01.357+0000 7fcbfd901640 1 -- 172.21.15.46:0/1750312709 wait complete. 2024-09-21T13:11:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:01 smithi046 ceph-mon[108126]: pgmap v736: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:01 smithi046 ceph-mon[108126]: from='client.44927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:01 smithi046 ceph-mon[108126]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:01 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2671904848' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:11:01.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:01 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1750312709' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:11:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:01 smithi176 ceph-mon[80162]: pgmap v736: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:01 smithi176 ceph-mon[80162]: from='client.44927 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:01 smithi176 ceph-mon[80162]: from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:01 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2671904848' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:11:01.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:01 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1750312709' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:11:02.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:02 smithi176 ceph-mon[80162]: from='client.35170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:02.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:02 smithi046 ceph-mon[108126]: from='client.35170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:03.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:03 smithi176 ceph-mon[80162]: pgmap v737: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:03.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:03 smithi046 ceph-mon[108126]: pgmap v737: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:05.743 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:05 smithi176 ceph-mon[80162]: pgmap v738: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:05.825 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:05 smithi046 ceph-mon[108126]: pgmap v738: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:07 smithi176 ceph-mon[80162]: pgmap v739: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:07.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:07 smithi046 ceph-mon[108126]: pgmap v739: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:09 smithi176 ceph-mon[80162]: pgmap v740: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:09.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:09 smithi046 ceph-mon[108126]: pgmap v740: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: pgmap v741: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: pgmap v742: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all mds 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:11.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.ffxnex"}]': finished 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hxdqyf"} : dispatch 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hxdqyf"}]': finished 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.kzzdid"} : dispatch 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.kzzdid"}]': finished 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.whwfab"} : dispatch 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.whwfab"}]': finished 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: Standby daemon mds.cephfs.smithi046.ffxnex assigned to filesystem cephfs as rank 0 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: Standby daemon mds.cephfs.smithi046.hxdqyf assigned to filesystem cephfs as rank 1 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T13:11:11.818 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:replay,1=cephfs.smithi046.hxdqyf=up:replay} 2 up:standby 2024-09-21T13:11:11.819 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:11 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: pgmap v741: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: pgmap v742: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:11.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all mds 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.ffxnex"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.ffxnex"}]': finished 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hxdqyf"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi046.hxdqyf"}]': finished 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.kzzdid"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.kzzdid"}]': finished 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.whwfab"} : dispatch 2024-09-21T13:11:11.884 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi176.whwfab"}]': finished 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: Standby daemon mds.cephfs.smithi046.ffxnex assigned to filesystem cephfs as rank 0 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: Standby daemon mds.cephfs.smithi046.hxdqyf assigned to filesystem cephfs as rank 1 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:replay,1=cephfs.smithi046.hxdqyf=up:replay} 2 up:standby 2024-09-21T13:11:11.885 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:11 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"} : dispatch 2024-09-21T13:11:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T13:11:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-21T13:11:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-21T13:11:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-21T13:11:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:resolve 2024-09-21T13:11:12.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:replay,1=cephfs.smithi046.hxdqyf=up:resolve} 2 up:standby 2024-09-21T13:11:12.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:12.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:12.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:12.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:12.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:12.657 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:12 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T13:11:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-21T13:11:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-09-21T13:11:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-21T13:11:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:resolve 2024-09-21T13:11:12.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:replay,1=cephfs.smithi046.hxdqyf=up:resolve} 2 up:standby 2024-09-21T13:11:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:12.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:12 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:13.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:13 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all rgw 2024-09-21T13:11:13.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:13 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T13:11:13.652 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:13 smithi046 ceph-mon[108126]: pgmap v743: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 3 op/s 2024-09-21T13:11:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:13 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all rgw 2024-09-21T13:11:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:13 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T13:11:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:13 smithi176 ceph-mon[80162]: pgmap v743: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 3 op/s 2024-09-21T13:11:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: Upgrade: Updating ceph-exporter.smithi046 (1/2) 2024-09-21T13:11:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T13:11:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:15.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-09-21T13:11:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:15.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:14 smithi176 ceph-mon[80162]: pgmap v744: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.5 MiB/s rd, 3 op/s 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: Upgrade: Updating ceph-exporter.smithi046 (1/2) 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi046", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: Deploying daemon ceph-exporter.smithi046 on smithi046 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:15.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:14 smithi046 ceph-mon[108126]: pgmap v744: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 6.5 MiB/s rd, 3 op/s 2024-09-21T13:11:17.571 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:17 smithi046 ceph-mon[108126]: pgmap v745: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 5 op/s 2024-09-21T13:11:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:17 smithi176 ceph-mon[80162]: pgmap v745: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 5 op/s 2024-09-21T13:11:19.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:18 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:19.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:18 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:19.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:18 smithi176 ceph-mon[80162]: pgmap v746: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2024-09-21T13:11:19.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:18 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:19.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:18 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:19.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:18 smithi046 ceph-mon[108126]: pgmap v746: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 7 op/s 2024-09-21T13:11:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:20 smithi046 ceph-mon[108126]: Upgrade: Updating ceph-exporter.smithi176 (2/2) 2024-09-21T13:11:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:20 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:20 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T13:11:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:20 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:20.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:20 smithi046 ceph-mon[108126]: Deploying daemon ceph-exporter.smithi176 on smithi176 2024-09-21T13:11:20.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:20 smithi176 ceph-mon[80162]: Upgrade: Updating ceph-exporter.smithi176 (2/2) 2024-09-21T13:11:20.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:20 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:20.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:20 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi176", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T13:11:20.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:20 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:20.492 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:20 smithi176 ceph-mon[80162]: Deploying daemon ceph-exporter.smithi176 on smithi176 2024-09-21T13:11:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:21 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:resolve 2024-09-21T13:11:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:21 smithi046 ceph-mon[108126]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:resolve,1=cephfs.smithi046.hxdqyf=up:resolve} 2 up:standby 2024-09-21T13:11:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:21 smithi046 ceph-mon[108126]: pgmap v747: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-21T13:11:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:21 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:resolve 2024-09-21T13:11:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:21 smithi176 ceph-mon[80162]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:resolve,1=cephfs.smithi046.hxdqyf=up:resolve} 2 up:standby 2024-09-21T13:11:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:21 smithi176 ceph-mon[80162]: pgmap v747: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-09-21T13:11:22.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: reconnect by client.14600 192.168.0.1:0/1427713140 after 0 2024-09-21T13:11:22.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: reconnect by client.14600 192.168.0.1:0/1427713140 after 0.000999989 2024-09-21T13:11:22.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: reconnect by client.24329 192.168.0.1:0/2508730095 after 0.000999989 2024-09-21T13:11:22.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: reconnect by client.24329 192.168.0.1:0/2508730095 after 0.00199998 2024-09-21T13:11:22.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:reconnect 2024-09-21T13:11:22.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:reconnect 2024-09-21T13:11:22.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:22 smithi176 ceph-mon[80162]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:reconnect,1=cephfs.smithi046.hxdqyf=up:reconnect} 2 up:standby 2024-09-21T13:11:22.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: reconnect by client.14600 192.168.0.1:0/1427713140 after 0 2024-09-21T13:11:22.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: reconnect by client.14600 192.168.0.1:0/1427713140 after 0.000999989 2024-09-21T13:11:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: reconnect by client.24329 192.168.0.1:0/2508730095 after 0.000999989 2024-09-21T13:11:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: reconnect by client.24329 192.168.0.1:0/2508730095 after 0.00199998 2024-09-21T13:11:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:reconnect 2024-09-21T13:11:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:reconnect 2024-09-21T13:11:22.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:22 smithi046 ceph-mon[108126]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:reconnect,1=cephfs.smithi046.hxdqyf=up:reconnect} 2 up:standby 2024-09-21T13:11:23.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:rejoin 2024-09-21T13:11:23.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:rejoin 2024-09-21T13:11:23.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:rejoin,1=cephfs.smithi046.hxdqyf=up:rejoin} 2 up:standby 2024-09-21T13:11:23.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: daemon mds.cephfs.smithi046.hxdqyf is now active in filesystem cephfs as rank 1 2024-09-21T13:11:23.476 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: daemon mds.cephfs.smithi046.ffxnex is now active in filesystem cephfs as rank 0 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: pgmap v748: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.477 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:23 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:rejoin 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:rejoin 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: fsmap cephfs:2/2 {0=cephfs.smithi046.ffxnex=up:rejoin,1=cephfs.smithi046.hxdqyf=up:rejoin} 2 up:standby 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: daemon mds.cephfs.smithi046.hxdqyf is now active in filesystem cephfs as rank 1 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: daemon mds.cephfs.smithi046.ffxnex is now active in filesystem cephfs as rank 0 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: pgmap v748: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 85 B/s wr, 7 op/s 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:23.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:23.663 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:23 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:24.310 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:24 smithi176 ceph-mon[80162]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T13:11:24.311 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:24 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:active 2024-09-21T13:11:24.311 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:24 smithi176 ceph-mon[80162]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:active 2024-09-21T13:11:24.311 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:24 smithi176 ceph-mon[80162]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi046.hxdqyf=up:active} 2 up:standby 2024-09-21T13:11:24.311 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:24 smithi176 ceph-mon[80162]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi046.hxdqyf=up:active} 2 up:standby-replay 2024-09-21T13:11:24.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:24 smithi046 ceph-mon[108126]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T13:11:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:24 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] up:active 2024-09-21T13:11:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:24 smithi046 ceph-mon[108126]: mds.? [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] up:active 2024-09-21T13:11:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:24 smithi046 ceph-mon[108126]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi046.hxdqyf=up:active} 2 up:standby 2024-09-21T13:11:24.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:24 smithi046 ceph-mon[108126]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi046.hxdqyf=up:active} 2 up:standby-replay 2024-09-21T13:11:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:25 smithi176 ceph-mon[80162]: pgmap v749: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T13:11:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:25 smithi046 ceph-mon[108126]: pgmap v749: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-21T13:11:27.043 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.043 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.043 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.043 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:26 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.043 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:26 smithi176 ceph-mon[80162]: pgmap v750: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 341 B/s wr, 8 op/s 2024-09-21T13:11:27.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.063 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.066 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.066 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:26 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:27.066 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:26 smithi046 ceph-mon[108126]: pgmap v750: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 341 B/s wr, 8 op/s 2024-09-21T13:11:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:29 smithi176 ceph-mon[80162]: pgmap v751: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 767 B/s wr, 18 op/s 2024-09-21T13:11:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:29.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:29 smithi046 ceph-mon[108126]: pgmap v751: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 27 MiB/s rd, 767 B/s wr, 18 op/s 2024-09-21T13:11:29.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:29.852 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:31.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 -- 172.21.15.46:0/680567692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 msgr2=0x7f8664106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:31.449 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 --2- 172.21.15.46:0/680567692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f8664106be0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8654009880 tx=0x7f865402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 -- 172.21.15.46:0/680567692 shutdown_connections 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 --2- 172.21.15.46:0/680567692 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8664100800 0x7f8664100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 --2- 172.21.15.46:0/680567692 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f8664106be0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 -- 172.21.15.46:0/680567692 >> 172.21.15.46:0/680567692 conn(0x7f86640fc520 msgr2=0x7f86640fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 -- 172.21.15.46:0/680567692 shutdown_connections 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.446+0000 7f866a4d6640 1 -- 172.21.15.46:0/680567692 wait complete. 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.447+0000 7f866a4d6640 1 Processor -- start 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.447+0000 7f866a4d6640 1 -- start start 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.447+0000 7f866a4d6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8664100800 0x7f866419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f866a4d6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f866419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f866a4d6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f866410dcb0 con 0x7f8664106800 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f866a4d6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f866410db30 con 0x7f8664100800 2024-09-21T13:11:31.450 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f866419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f866419db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43244/0 (socket says 172.21.15.46:43244) 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 -- 172.21.15.46:0/882966963 learned_addr learned my addr 172.21.15.46:0/882966963 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f8663fff640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8664100800 0x7f866419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 -- 172.21.15.46:0/882966963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8664100800 msgr2=0x7f866419d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8664100800 0x7f866419d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 -- 172.21.15.46:0/882966963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8664197790 con 0x7f8664106800 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86637fe640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f866419db50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f865800d8d0 tx=0x7f865800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8658017070 con 0x7f8664106800 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8658010460 con 0x7f8664106800 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8664197a80 con 0x7f8664106800 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f865800f5f0 con 0x7f8664106800 2024-09-21T13:11:31.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.448+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8664198010 con 0x7f8664106800 2024-09-21T13:11:31.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.449+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8664101f40 con 0x7f8664106800 2024-09-21T13:11:31.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.450+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8658009a30 con 0x7f8664106800 2024-09-21T13:11:31.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.451+0000 7f86617fa640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f864c07af40 0x7f864c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:31.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.451+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f865809dee0 con 0x7f8664106800 2024-09-21T13:11:31.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.451+0000 7f8663fff640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f864c07af40 0x7f864c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:31.453 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.451+0000 7f8663fff640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f864c07af40 0x7f864c07d400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86540096c0 tx=0x7f8654031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:31.456 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.455+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8658069430 con 0x7f8664106800 2024-09-21T13:11:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:31 smithi046 ceph-mon[108126]: pgmap v752: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 767 B/s wr, 16 op/s 2024-09-21T13:11:31.665 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.664+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f86641982c0 con 0x7f864c07af40 2024-09-21T13:11:31.666 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.665+0000 7f86617fa640 1 -- 172.21.15.46:0/882966963 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7f86641982c0 con 0x7f864c07af40 2024-09-21T13:11:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f864c07af40 msgr2=0x7f864c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:31.668 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f864c07af40 0x7f864c07d400 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86540096c0 tx=0x7f8654031400 comp rx=0 tx=0).stop 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 msgr2=0x7f866419db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f866419db50 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f865800d8d0 tx=0x7f865800dd90 comp rx=0 tx=0).stop 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 shutdown_connections 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f864c07af40 0x7f864c07d400 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8664106800 0x7f866419db50 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 --2- 172.21.15.46:0/882966963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8664100800 0x7f866419d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 >> 172.21.15.46:0/882966963 conn(0x7f86640fc520 msgr2=0x7f866406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 shutdown_connections 2024-09-21T13:11:31.669 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.667+0000 7f866a4d6640 1 -- 172.21.15.46:0/882966963 wait complete. 2024-09-21T13:11:31.677 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:11:31.754 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 -- 172.21.15.46:0/2907799792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 msgr2=0x7fb4d810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 --2- 172.21.15.46:0/2907799792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d810b8d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009880 tx=0x7fb4c802a530 comp rx=0 tx=0).stop 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 -- 172.21.15.46:0/2907799792 shutdown_connections 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 --2- 172.21.15.46:0/2907799792 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d810b8d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 --2- 172.21.15.46:0/2907799792 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4d8102ac0 0x7fb4d8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 -- 172.21.15.46:0/2907799792 >> 172.21.15.46:0/2907799792 conn(0x7fb4d80fc520 msgr2=0x7fb4d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 -- 172.21.15.46:0/2907799792 shutdown_connections 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.753+0000 7fb4e0710640 1 -- 172.21.15.46:0/2907799792 wait complete. 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4e0710640 1 Processor -- start 2024-09-21T13:11:31.755 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4e0710640 1 -- start start 2024-09-21T13:11:31.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4e0710640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4d8102ac0 0x7fb4d8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:31.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4e0710640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:31.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4e0710640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d810edd0 con 0x7fb4d81033e0 2024-09-21T13:11:31.756 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4e0710640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d810ec50 con 0x7fb4d8102ac0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4ddcab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4ddcab640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d8100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43272/0 (socket says 172.21.15.46:43272) 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4ddcab640 1 -- 172.21.15.46:0/957766198 learned_addr learned my addr 172.21.15.46:0/957766198 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4de4ac640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4d8102ac0 0x7fb4d8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4ddcab640 1 -- 172.21.15.46:0/957766198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4d8102ac0 msgr2=0x7fb4d8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4ddcab640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4d8102ac0 0x7fb4d8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.754+0000 7fb4ddcab640 1 -- 172.21.15.46:0/957766198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d81011a0 con 0x7fb4d81033e0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.755+0000 7fb4ddcab640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d8100c60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8031460 tx=0x7fb4c8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.755+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4c803f070 con 0x7fb4d81033e0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.755+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4c80035f0 con 0x7fb4d81033e0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.755+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d8101430 con 0x7fb4d81033e0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.755+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4c8035030 con 0x7fb4d81033e0 2024-09-21T13:11:31.757 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.755+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d81a3da0 con 0x7fb4d81033e0 2024-09-21T13:11:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.756+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d806aa90 con 0x7fb4d81033e0 2024-09-21T13:11:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.757+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb4c8042070 con 0x7fb4d81033e0 2024-09-21T13:11:31.758 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.757+0000 7fb4cf7fe640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb4c407af80 0x7fb4c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.757+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb4c80be8e0 con 0x7fb4d81033e0 2024-09-21T13:11:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.758+0000 7fb4de4ac640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb4c407af80 0x7fb4c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:31.759 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.758+0000 7fb4de4ac640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb4c407af80 0x7fb4c407d440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4005d00 tx=0x7fb4d400b410 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:31.763 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:31.762+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4c8089eb0 con 0x7fb4d81033e0 2024-09-21T13:11:31.773 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:31 smithi176 ceph-mon[80162]: pgmap v752: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 767 B/s wr, 16 op/s 2024-09-21T13:11:32.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.000+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb4d8062630 con 0x7fb4c407af80 2024-09-21T13:11:32.003 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.002+0000 7fb4cf7fe640 1 -- 172.21.15.46:0/957766198 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+441 (secure 0 0 0) 0x7fb4d8062630 con 0x7fb4c407af80 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.004+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb4c407af80 msgr2=0x7fb4c407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.004+0000 7fb4e0710640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb4c407af80 0x7fb4c407d440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4005d00 tx=0x7fb4d400b410 comp rx=0 tx=0).stop 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.004+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 msgr2=0x7fb4d8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.004+0000 7fb4e0710640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d8100c60 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8031460 tx=0x7fb4c8004530 comp rx=0 tx=0).stop 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 shutdown_connections 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb4c407af80 0x7fb4c407d440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb4d81033e0 0x7fb4d8100c60 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 --2- 172.21.15.46:0/957766198 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4d8102ac0 0x7fb4d8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 >> 172.21.15.46:0/957766198 conn(0x7fb4d80fc520 msgr2=0x7fb4d8108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 shutdown_connections 2024-09-21T13:11:32.006 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.005+0000 7fb4e0710640 1 -- 172.21.15.46:0/957766198 wait complete. 2024-09-21T13:11:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/1624223858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c681066a0 msgr2=0x7f5c68106a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/1624223858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c681066a0 0x7f5c68106a80 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5c58009880 tx=0x7f5c5802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/1624223858 shutdown_connections 2024-09-21T13:11:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/1624223858 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c68100610 0x7f5c68100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.095 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/1624223858 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c681066a0 0x7f5c68106a80 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/1624223858 >> 172.21.15.46:0/1624223858 conn(0x7f5c680fc310 msgr2=0x7f5c680fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/1624223858 shutdown_connections 2024-09-21T13:11:32.096 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/1624223858 wait complete. 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.094+0000 7f5c6c9ff640 1 Processor -- start 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c6c9ff640 1 -- start start 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c6c9ff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 0x7f5c6819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c6c9ff640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c681066a0 0x7f5c6819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c6c9ff640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6810dad0 con 0x7f5c68100610 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c6c9ff640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5c6810d950 con 0x7f5c681066a0 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c66d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 0x7f5c6819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c66d9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 0x7f5c6819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43282/0 (socket says 172.21.15.46:43282) 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c66d9d640 1 -- 172.21.15.46:0/3689550235 learned_addr learned my addr 172.21.15.46:0/3689550235 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:32.098 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c6659c640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c681066a0 0x7f5c6819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.095+0000 7f5c66d9d640 1 -- 172.21.15.46:0/3689550235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c681066a0 msgr2=0x7f5c6819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c66d9d640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c681066a0 0x7f5c6819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c66d9d640 1 -- 172.21.15.46:0/3689550235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c681997a0 con 0x7f5c68100610 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c66d9d640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 0x7f5c6819f620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5c58031460 tx=0x7f5c58004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c5803f070 con 0x7f5c68100610 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5c580035f0 con 0x7f5c68100610 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c68199a30 con 0x7f5c68100610 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5c58035030 con 0x7f5c68100610 2024-09-21T13:11:32.099 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.096+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c68199f60 con 0x7f5c68100610 2024-09-21T13:11:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.097+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c68101d50 con 0x7f5c68100610 2024-09-21T13:11:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.098+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5c58042070 con 0x7f5c68100610 2024-09-21T13:11:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.099+0000 7f5c5ffff640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5c5407af80 0x7f5c5407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.099+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5c580bef90 con 0x7f5c68100610 2024-09-21T13:11:32.100 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.099+0000 7f5c6659c640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5c5407af80 0x7f5c5407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.101 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.099+0000 7f5c6659c640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5c5407af80 0x7f5c5407d440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c680fe820 tx=0x7f5c50005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:32.103 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.102+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c5808a600 con 0x7f5c68100610 2024-09-21T13:11:32.303 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.302+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5c6819a2d0 con 0x7f5c5407af80 2024-09-21T13:11:32.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.313+0000 7f5c5ffff640 1 -- 172.21.15.46:0/3689550235 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f5c6819a2d0 con 0x7f5c5407af80 2024-09-21T13:11:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:11:32.314 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (21m) 0s ago 32m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (15s) 0s ago 32m 7792k - 19.3.0-5104-g44178494 b415816db8b4 2267b049721a 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (10s) 6s ago 31m 7335k - 19.3.0-5104-g44178494 b415816db8b4 dc836293174a 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (19m) 0s ago 32m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (19m) 6s ago 31m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (21m) 0s ago 32m 78.4M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (16m) 0s ago 27m 86.6M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (15m) 0s ago 27m 22.6M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (15m) 6s ago 27m 20.8M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (15m) 6s ago 27m 20.7M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (24m) 0s ago 33m 535M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (23m) 6s ago 31m 465M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (20m) 0s ago 34m 70.6M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (20m) 6s ago 31m 50.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:11:32.315 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (22m) 0s ago 32m 11.9M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (22m) 6s ago 31m 11.8M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (19m) 0s ago 30m 94.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (18m) 0s ago 30m 107M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (18m) 0s ago 29m 91.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (17m) 6s ago 29m 107M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (17m) 6s ago 28m 100M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (16m) 6s ago 28m 98.5M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:11:32.316 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (22m) 0s ago 32m 69.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5c5407af80 msgr2=0x7f5c5407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5c5407af80 0x7f5c5407d440 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5c680fe820 tx=0x7f5c50005f90 comp rx=0 tx=0).stop 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 msgr2=0x7f5c6819f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 0x7f5c6819f620 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5c58031460 tx=0x7f5c58004530 comp rx=0 tx=0).stop 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 shutdown_connections 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5c5407af80 0x7f5c5407d440 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5c681066a0 0x7f5c6819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 --2- 172.21.15.46:0/3689550235 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5c68100610 0x7f5c6819f620 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 >> 172.21.15.46:0/3689550235 conn(0x7f5c680fc310 msgr2=0x7f5c68069d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 shutdown_connections 2024-09-21T13:11:32.317 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.315+0000 7f5c6c9ff640 1 -- 172.21.15.46:0/3689550235 wait complete. 2024-09-21T13:11:32.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 -- 172.21.15.46:0/646213559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 msgr2=0x7fbfc8100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 --2- 172.21.15.46:0/646213559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc8100c50 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009880 tx=0x7fbfb402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.403 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 -- 172.21.15.46:0/646213559 shutdown_connections 2024-09-21T13:11:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 --2- 172.21.15.46:0/646213559 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc8100c50 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 --2- 172.21.15.46:0/646213559 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfc81067f0 0x7fbfc8106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 -- 172.21.15.46:0/646213559 >> 172.21.15.46:0/646213559 conn(0x7fbfc80fc550 msgr2=0x7fbfc80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 -- 172.21.15.46:0/646213559 shutdown_connections 2024-09-21T13:11:32.404 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.402+0000 7fbfceef5640 1 -- 172.21.15.46:0/646213559 wait complete. 2024-09-21T13:11:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfceef5640 1 Processor -- start 2024-09-21T13:11:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfceef5640 1 -- start start 2024-09-21T13:11:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfceef5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfceef5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfc81067f0 0x7fbfc80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfceef5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc810dca0 con 0x7fbfc81007f0 2024-09-21T13:11:32.405 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfceef5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fbfc810db20 con 0x7fbfc81067f0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfccc91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfccc91640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc80fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43308/0 (socket says 172.21.15.46:43308) 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfccc91640 1 -- 172.21.15.46:0/1453776652 learned_addr learned my addr 172.21.15.46:0/1453776652 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.403+0000 7fbfc7fff640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfc81067f0 0x7fbfc80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfccc91640 1 -- 172.21.15.46:0/1453776652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfc81067f0 msgr2=0x7fbfc80fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfccc91640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfc81067f0 0x7fbfc80fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfccc91640 1 -- 172.21.15.46:0/1453776652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfc80fd700 con 0x7fbfc81007f0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfccc91640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc80fcc80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c8a0 tx=0x7fbfbc00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfbc0079b0 con 0x7fbfc81007f0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfc80fd9f0 con 0x7fbfc81007f0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbfbc007b50 con 0x7fbfc81007f0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbfbc018700 con 0x7fbfc81007f0 2024-09-21T13:11:32.406 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.404+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfc81a3da0 con 0x7fbfc81007f0 2024-09-21T13:11:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.405+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfc8101f30 con 0x7fbfc81007f0 2024-09-21T13:11:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.406+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fbfbc0188a0 con 0x7fbfc81007f0 2024-09-21T13:11:32.407 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.406+0000 7fbfc5ffb640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbfb807af80 0x7fbfb807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.406+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fbfbc09e260 con 0x7fbfc81007f0 2024-09-21T13:11:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.407+0000 7fbfc7fff640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbfb807af80 0x7fbfb807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.408 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.407+0000 7fbfc7fff640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbfb807af80 0x7fbfb807d440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80fe710 tx=0x7fbfb4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:32.412 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.411+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbfbc014030 con 0x7fbfc81007f0 2024-09-21T13:11:32.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.675+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbfc802d7c0 con 0x7fbfc81007f0 2024-09-21T13:11:32.676 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.675+0000 7fbfc5ffb640 1 -- 172.21.15.46:0/1453776652 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fbfbc069830 con 0x7fbfc81007f0 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:11:32.677 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:11:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:11:32.678 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:11:32.678 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:11:32.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbfb807af80 msgr2=0x7fbfb807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbfb807af80 0x7fbfb807d440 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fbfc80fe710 tx=0x7fbfb4031400 comp rx=0 tx=0).stop 2024-09-21T13:11:32.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 msgr2=0x7fbfc80fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc80fcc80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc00c8a0 tx=0x7fbfbc00cd60 comp rx=0 tx=0).stop 2024-09-21T13:11:32.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 shutdown_connections 2024-09-21T13:11:32.679 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fbfb807af80 0x7fbfb807d440 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbfc81067f0 0x7fbfc80fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 --2- 172.21.15.46:0/1453776652 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fbfc81007f0 0x7fbfc80fcc80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 >> 172.21.15.46:0/1453776652 conn(0x7fbfc80fc550 msgr2=0x7fbfc8069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 shutdown_connections 2024-09-21T13:11:32.680 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.678+0000 7fbfceef5640 1 -- 172.21.15.46:0/1453776652 wait complete. 2024-09-21T13:11:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.764+0000 7f5f446a7640 1 -- 172.21.15.46:0/3941225593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 msgr2=0x7f5f3c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.766 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.764+0000 7f5f446a7640 1 --2- 172.21.15.46:0/3941225593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c102e90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009880 tx=0x7f5f3802a530 comp rx=0 tx=0).stop 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 -- 172.21.15.46:0/3941225593 shutdown_connections 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 --2- 172.21.15.46:0/3941225593 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f3c1033d0 0x7f5f3c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 --2- 172.21.15.46:0/3941225593 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c102e90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 -- 172.21.15.46:0/3941225593 >> 172.21.15.46:0/3941225593 conn(0x7f5f3c0fc4d0 msgr2=0x7f5f3c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 -- 172.21.15.46:0/3941225593 shutdown_connections 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 -- 172.21.15.46:0/3941225593 wait complete. 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 Processor -- start 2024-09-21T13:11:32.767 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.765+0000 7f5f446a7640 1 -- start start 2024-09-21T13:11:32.769 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f446a7640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f446a7640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f3c1033d0 0x7f5f3c100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f446a7640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c10edc0 con 0x7f5f3c102ab0 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f446a7640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c10ec40 con 0x7f5f3c1033d0 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43326/0 (socket says 172.21.15.46:43326) 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 -- 172.21.15.46:0/42207954 learned_addr learned my addr 172.21.15.46:0/42207954 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f41c42640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f3c1033d0 0x7f5f3c100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 -- 172.21.15.46:0/42207954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f3c1033d0 msgr2=0x7f5f3c100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:32.770 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f3c1033d0 0x7f5f3c100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 -- 172.21.15.46:0/42207954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c101190 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f42443640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c100710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5f38031460 tx=0x7f5f38004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f3803f070 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.766+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5f38004a90 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.767+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3c101420 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.767+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3c1a3d70 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.767+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5f38035030 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.768+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3c06ada0 con 0x7f5f3c102ab0 2024-09-21T13:11:32.771 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.769+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5f38042070 con 0x7f5f3c102ab0 2024-09-21T13:11:32.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.769+0000 7f5f337fe640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5f2807af90 0x7f5f2807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:32.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.769+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5f380bf080 con 0x7f5f3c102ab0 2024-09-21T13:11:32.772 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.769+0000 7f5f41c42640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5f2807af90 0x7f5f2807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:32.773 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.770+0000 7f5f41c42640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5f2807af90 0x7f5f2807d450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c1021a0 tx=0x7f5f2c005f90 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:32.774 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:32.773+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5f3808a6f0 con 0x7f5f3c102ab0 2024-09-21T13:11:33.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.018+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f5f3c105f80 con 0x7f5f3c102ab0 2024-09-21T13:11:33.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:33.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:33.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.020 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='client.35188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:33.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: pgmap v753: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-21T13:11:33.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.021 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:32 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1453776652' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:33.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.019+0000 7f5f337fe640 1 -- 172.21.15.46:0/42207954 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) ==== 76+0+2052 (secure 0 0 0) 0x7f5f3808f5a0 con 0x7f5f3c102ab0 2024-09-21T13:11:33.021 INFO:teuthology.orchestra.run.smithi046.stdout:e38 2024-09-21T13:11:33.021 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T13:11:23:223419+0000 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 38 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T13:11:23.223404+0000 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:11:33.022 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=34328,1=34360} 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T13:11:33.023 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 34328 members: 34360,34328 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:34328} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:33.024 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{0:44303} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{1:34360} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:44335} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 38 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5f2807af90 msgr2=0x7f5f2807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.025 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5f2807af90 0x7f5f2807d450 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c1021a0 tx=0x7f5f2c005f90 comp rx=0 tx=0).stop 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 msgr2=0x7f5f3c100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c100710 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5f38031460 tx=0x7f5f38004530 comp rx=0 tx=0).stop 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 shutdown_connections 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5f2807af90 0x7f5f2807d450 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5f3c1033d0 0x7f5f3c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 --2- 172.21.15.46:0/42207954 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5f3c102ab0 0x7f5f3c100710 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 >> 172.21.15.46:0/42207954 conn(0x7f5f3c0fc4d0 msgr2=0x7f5f3c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 shutdown_connections 2024-09-21T13:11:33.026 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.021+0000 7f5f446a7640 1 -- 172.21.15.46:0/42207954 wait complete. 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='client.35184 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='client.35188 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: pgmap v753: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 4.8 KiB/s wr, 20 op/s 2024-09-21T13:11:33.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:33.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:32 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1453776652' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 -- 172.21.15.46:0/2715676744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 msgr2=0x7f9e60100a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 --2- 172.21.15.46:0/2715676744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e60100a40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c009880 tx=0x7f9e5c02a490 comp rx=0 tx=0).stop 2024-09-21T13:11:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 -- 172.21.15.46:0/2715676744 shutdown_connections 2024-09-21T13:11:33.108 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 --2- 172.21.15.46:0/2715676744 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 0x7f9e6010dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 --2- 172.21.15.46:0/2715676744 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e60100a40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 -- 172.21.15.46:0/2715676744 >> 172.21.15.46:0/2715676744 conn(0x7f9e600fc510 msgr2=0x7f9e600fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 -- 172.21.15.46:0/2715676744 shutdown_connections 2024-09-21T13:11:33.109 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.107+0000 7f9e67954640 1 -- 172.21.15.46:0/2715676744 wait complete. 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e67954640 1 Processor -- start 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e67954640 1 -- start start 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e67954640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e6019f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e67954640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 0x7f9e6019fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e67954640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60110fc0 con 0x7f9e60100660 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e67954640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60110e40 con 0x7f9e60101010 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e656f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e6019f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e656f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e6019f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43340/0 (socket says 172.21.15.46:43340) 2024-09-21T13:11:33.111 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e656f0640 1 -- 172.21.15.46:0/1027390644 learned_addr learned my addr 172.21.15.46:0/1027390644 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e64eef640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 0x7f9e6019fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e656f0640 1 -- 172.21.15.46:0/1027390644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 msgr2=0x7f9e6019fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e656f0640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 0x7f9e6019fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e656f0640 1 -- 172.21.15.46:0/1027390644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e60199ad0 con 0x7f9e60100660 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.108+0000 7f9e64eef640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 0x7f9e6019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.109+0000 7f9e656f0640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e6019f910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c031460 tx=0x7f9e5c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.109+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e5c03f070 con 0x7f9e60100660 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.109+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9e5c004cf0 con 0x7f9e60100660 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.109+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e60199d60 con 0x7f9e60100660 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.109+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9e5c035030 con 0x7f9e60100660 2024-09-21T13:11:33.112 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.109+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6019a2f0 con 0x7f9e60100660 2024-09-21T13:11:33.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.110+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6006ada0 con 0x7f9e60100660 2024-09-21T13:11:33.113 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.111+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f9e5c042070 con 0x7f9e60100660 2024-09-21T13:11:33.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.111+0000 7f9e567fc640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4c07af80 0x7f9e4c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:33.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.111+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f9e5c0bea90 con 0x7f9e60100660 2024-09-21T13:11:33.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.111+0000 7f9e64eef640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4c07af80 0x7f9e4c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:33.114 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.112+0000 7f9e64eef640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4c07af80 0x7f9e4c07d440 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9e600fedb0 tx=0x7f9e50005d30 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:33.118 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.117+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e5c08a060 con 0x7f9e60100660 2024-09-21T13:11:33.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.324+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9e6019afc0 con 0x7f9e4c07af80 2024-09-21T13:11:33.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.325+0000 7f9e567fc640 1 -- 172.21.15.46:0/1027390644 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+466 (secure 0 0 0) 0x7f9e6019afc0 con 0x7f9e4c07af80 2024-09-21T13:11:33.326 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:11:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5", 2024-09-21T13:11:33.326 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": true, 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [ 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph-exporter", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "mon", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "osd", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "mds", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "crash", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr" 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: ], 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": "18/23 daemons upgraded", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:11:33.327 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4c07af80 msgr2=0x7f9e4c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4c07af80 0x7f9e4c07d440 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9e600fedb0 tx=0x7f9e50005d30 comp rx=0 tx=0).stop 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 msgr2=0x7f9e6019f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e6019f910 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c031460 tx=0x7f9e5c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 shutdown_connections 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f9e4c07af80 0x7f9e4c07d440 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.329 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e60101010 0x7f9e6019fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 --2- 172.21.15.46:0/1027390644 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f9e60100660 0x7f9e6019f910 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 >> 172.21.15.46:0/1027390644 conn(0x7f9e600fc510 msgr2=0x7f9e600fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 shutdown_connections 2024-09-21T13:11:33.330 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.328+0000 7f9e67954640 1 -- 172.21.15.46:0/1027390644 wait complete. 2024-09-21T13:11:33.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 -- 172.21.15.46:0/1860199660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 msgr2=0x7f5fe0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/1860199660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0102e90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009880 tx=0x7f5fd002a530 comp rx=0 tx=0).stop 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 -- 172.21.15.46:0/1860199660 shutdown_connections 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/1860199660 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fe01033d0 0x7f5fe010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/1860199660 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0102e90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 -- 172.21.15.46:0/1860199660 >> 172.21.15.46:0/1860199660 conn(0x7f5fe00fc550 msgr2=0x7f5fe00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 -- 172.21.15.46:0/1860199660 shutdown_connections 2024-09-21T13:11:33.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.416+0000 7f5fe65c0640 1 -- 172.21.15.46:0/1860199660 wait complete. 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.417+0000 7f5fe65c0640 1 Processor -- start 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.417+0000 7f5fe65c0640 1 -- start start 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.417+0000 7f5fe65c0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.417+0000 7f5fe65c0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fe01033d0 0x7f5fe0100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fe65c0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe010edc0 con 0x7f5fe0102ab0 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fe65c0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe010ec40 con 0x7f5fe01033d0 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:43344/0 (socket says 172.21.15.46:43344) 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 -- 172.21.15.46:0/4096881971 learned_addr learned my addr 172.21.15.46:0/4096881971 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdf7fe640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fe01033d0 0x7f5fe0100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 -- 172.21.15.46:0/4096881971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fe01033d0 msgr2=0x7f5fe0100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.420 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fe01033d0 0x7f5fe0100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 -- 172.21.15.46:0/4096881971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe0101190 con 0x7f5fe0102ab0 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdffff640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0100710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0031460 tx=0x7f5fd00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fd003f070 con 0x7f5fe0102ab0 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fd0004cf0 con 0x7f5fe0102ab0 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe0101420 con 0x7f5fe0102ab0 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.418+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fd0035030 con 0x7f5fe0102ab0 2024-09-21T13:11:33.421 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.419+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe01a3d20 con 0x7f5fe0102ab0 2024-09-21T13:11:33.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.420+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe006a580 con 0x7f5fe0102ab0 2024-09-21T13:11:33.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.420+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f5fd0042070 con 0x7f5fe0102ab0 2024-09-21T13:11:33.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.421+0000 7f5fdd7fa640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc807af80 0x7f5fc807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:11:33.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.421+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f5fd00be9f0 con 0x7f5fe0102ab0 2024-09-21T13:11:33.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.421+0000 7f5fdf7fe640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc807af80 0x7f5fc807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:11:33.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.421+0000 7f5fdf7fe640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc807af80 0x7f5fc807d440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5fe01021a0 tx=0x7f5fd400a250 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:11:33.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.425+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5fd0089fc0 con 0x7f5fe0102ab0 2024-09-21T13:11:33.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.690+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f5fe0105f80 con 0x7f5fe0102ab0 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.691+0000 7f5fdd7fa640 1 -- 172.21.15.46:0/4096881971 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+3573 (secure 0 0 0) 0x7f5fd00bee20 con 0x7f5fe0102ab0 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN failed to probe daemons or devices; 1 filesystem with deprecated feature inline_data 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout: host smithi176 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi176/config 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:/usr/bin/podman: timeout after 895 seconds 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 -e NODE_NAME=smithi176 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/297e1ece-7816-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpoa4n4ike:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 inventory --format=json-pretty --filter-for-batch 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout:Traceback (most recent call last): 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout: return _run_code(code, main_globals, None, 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-09-21T13:11:33.692 INFO:teuthology.orchestra.run.smithi046.stdout: exec(code, run_globals) 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 5628, in 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 5616, in main 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 414, in _infer_config 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 329, in _infer_fsid 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 442, in _infer_image 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 316, in _validate_fsid 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/__main__.py", line 3353, in command_ceph_volume 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: File "/tmp/tmptpwpfqo2.cephadm.build/app/cephadmlib/call_wrappers.py", line 310, in call_throws 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 -e NODE_NAME=smithi176 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/297e1ece-7816-11ef-baf6-efdc52797490:/var/run/ceph:z -v /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490:/var/log/ceph:z -v /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/selinux:/sys/fs/selinux:ro -v /:/rootfs:rslave -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpoa4n4ike:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 inventory --format=json-pretty --filter-for-batch 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:11:33.693 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc807af80 msgr2=0x7f5fc807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc807af80 0x7f5fc807d440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5fe01021a0 tx=0x7f5fd400a250 comp rx=0 tx=0).stop 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 msgr2=0x7f5fe0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0100710 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0031460 tx=0x7f5fd00048f0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 shutdown_connections 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f5fc807af80 0x7f5fc807d440 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5fe01033d0 0x7f5fe0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 --2- 172.21.15.46:0/4096881971 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f5fe0102ab0 0x7f5fe0100710 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:11:33.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 >> 172.21.15.46:0/4096881971 conn(0x7f5fe00fc550 msgr2=0x7f5fe0108ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:11:33.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 shutdown_connections 2024-09-21T13:11:33.695 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:11:33.693+0000 7f5fe65c0640 1 -- 172.21.15.46:0/4096881971 wait complete. 2024-09-21T13:11:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:33 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/42207954' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:11:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:33 smithi176 ceph-mon[80162]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:34.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:33 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/4096881971' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:11:34.119 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:33 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/42207954' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:11:34.119 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:33 smithi046 ceph-mon[108126]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:11:34.119 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:33 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/4096881971' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:11:35.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:34 smithi176 ceph-mon[80162]: pgmap v754: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-09-21T13:11:35.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:34 smithi046 ceph-mon[108126]: pgmap v754: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 4.7 KiB/s wr, 19 op/s 2024-09-21T13:11:37.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: pgmap v755: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T13:11:37.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:36 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T13:11:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: pgmap v755: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 5.0 KiB/s wr, 20 op/s 2024-09-21T13:11:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T13:11:37.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:36 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi046.hxdqyf=up:active} 2 up:standby-replay 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"} : dispatch 2024-09-21T13:11:38.067 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"}]': finished 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi176"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi176"}]': finished 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all iscsi 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all nfs 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Upgrade: Setting container_image for all nvmeof 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.068 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Upgrade: Finalizing container_image settings 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T13:11:38.069 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.070 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: Upgrade: Complete! 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:38.071 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:38.072 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:38.072 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-09-21T13:11:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T13:11:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: fsmap cephfs:2 {0=cephfs.smithi046.ffxnex=up:active,1=cephfs.smithi046.hxdqyf=up:active} 2 up:standby-replay 2024-09-21T13:11:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"} : dispatch 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi046"}]': finished 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi176"} : dispatch 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi176"}]': finished 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all iscsi 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all nfs 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.163 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Upgrade: Setting container_image for all nvmeof 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Upgrade: Finalizing container_image settings 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T13:11:38.164 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T13:11:38.165 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T13:11:38.166 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: Upgrade: Complete! 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:11:38.167 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:39.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:38 smithi046 ceph-mon[108126]: pgmap v756: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-21T13:11:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:38 smithi176 ceph-mon[80162]: pgmap v756: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-21T13:11:40.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:40.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:41 smithi046 ceph-mon[108126]: pgmap v757: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-21T13:11:41.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:41 smithi176 ceph-mon[80162]: pgmap v757: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 8.1 MiB/s rd, 4.3 KiB/s wr, 6 op/s 2024-09-21T13:11:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:43 smithi046 ceph-mon[108126]: pgmap v758: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-21T13:11:43.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:43 smithi176 ceph-mon[80162]: pgmap v758: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 7.4 MiB/s rd, 4.3 KiB/s wr, 7 op/s 2024-09-21T13:11:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:45 smithi046 ceph-mon[108126]: pgmap v759: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 3 op/s 2024-09-21T13:11:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:45 smithi176 ceph-mon[80162]: pgmap v759: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.8 MiB/s rd, 3 op/s 2024-09-21T13:11:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:11:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:47 smithi176 ceph-mon[80162]: pgmap v760: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 3 op/s 2024-09-21T13:11:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:47 smithi046 ceph-mon[108126]: pgmap v760: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.2 KiB/s rd, 3 op/s 2024-09-21T13:11:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:49 smithi176 ceph-mon[80162]: pgmap v761: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 4 op/s 2024-09-21T13:11:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:49 smithi046 ceph-mon[108126]: pgmap v761: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 4 op/s 2024-09-21T13:11:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:51 smithi046 ceph-mon[108126]: pgmap v762: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:11:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:51 smithi176 ceph-mon[80162]: pgmap v762: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:11:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:53 smithi176 ceph-mon[80162]: pgmap v763: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:11:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:53 smithi046 ceph-mon[108126]: pgmap v763: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:11:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:55 smithi176 ceph-mon[80162]: pgmap v764: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:11:55.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:55 smithi046 ceph-mon[108126]: pgmap v764: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:11:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:57 smithi046 ceph-mon[108126]: pgmap v765: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:11:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:57 smithi176 ceph-mon[80162]: pgmap v765: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:11:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:59 smithi176 ceph-mon[80162]: pgmap v766: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:11:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:11:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:11:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:59 smithi046 ceph-mon[108126]: pgmap v766: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:11:59.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:11:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:01 smithi176 ceph-mon[80162]: pgmap v767: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:01 smithi046 ceph-mon[108126]: pgmap v767: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:03 smithi046 ceph-mon[108126]: pgmap v768: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:03 smithi176 ceph-mon[80162]: pgmap v768: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 -- 172.21.15.46:0/591910492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf41033e0 msgr2=0x7feaf410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 --2- 172.21.15.46:0/591910492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf41033e0 0x7feaf410b8d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7feadc009c20 tx=0x7feadc02aa00 comp rx=0 tx=0).stop 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 -- 172.21.15.46:0/591910492 shutdown_connections 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 --2- 172.21.15.46:0/591910492 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf41033e0 0x7feaf410b8d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 --2- 172.21.15.46:0/591910492 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf4102ac0 0x7feaf4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 -- 172.21.15.46:0/591910492 >> 172.21.15.46:0/591910492 conn(0x7feaf40fc520 msgr2=0x7feaf40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 -- 172.21.15.46:0/591910492 shutdown_connections 2024-09-21T13:12:03.789 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.785+0000 7feaf972b640 1 -- 172.21.15.46:0/591910492 wait complete. 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.786+0000 7feaf972b640 1 Processor -- start 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.786+0000 7feaf972b640 1 -- start start 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.786+0000 7feaf972b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 0x7feaf419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.786+0000 7feaf972b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf41033e0 0x7feaf419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf972b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7feaf410edf0 con 0x7feaf4102ac0 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf972b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7feaf410ec70 con 0x7feaf41033e0 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 0x7feaf419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 0x7feaf419d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40586/0 (socket says 172.21.15.46:40586) 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 -- 172.21.15.46:0/944476479 learned_addr learned my addr 172.21.15.46:0/944476479 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf27fc640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf41033e0 0x7feaf419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 -- 172.21.15.46:0/944476479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf41033e0 msgr2=0x7feaf419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:03.790 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf41033e0 0x7feaf419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 -- 172.21.15.46:0/944476479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf4197820 con 0x7feaf4102ac0 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf2ffd640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 0x7feaf419d6a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7feae400d6f0 tx=0x7feae400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feae4017070 con 0x7feaf4102ac0 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf4197b10 con 0x7feaf4102ac0 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7feae400de00 con 0x7feaf4102ac0 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.787+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7feae4004bb0 con 0x7feaf4102ac0 2024-09-21T13:12:03.791 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.788+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf41980a0 con 0x7feaf4102ac0 2024-09-21T13:12:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.789+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf406aa90 con 0x7feaf4102ac0 2024-09-21T13:12:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.789+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7feae4009a30 con 0x7feaf4102ac0 2024-09-21T13:12:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.790+0000 7feaebfff640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feae007af40 0x7feae007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.790+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7feae409dc60 con 0x7feaf4102ac0 2024-09-21T13:12:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.790+0000 7feaf27fc640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feae007af40 0x7feae007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:03.792 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.790+0000 7feaf27fc640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feae007af40 0x7feae007d400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feaf41088d0 tx=0x7feadc03a040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:03.795 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:03.794+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feae40691b0 con 0x7feaf4102ac0 2024-09-21T13:12:04.001 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.000+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feaf4198350 con 0x7feae007af40 2024-09-21T13:12:04.002 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.001+0000 7feaebfff640 1 -- 172.21.15.46:0/944476479 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7feaf4198350 con 0x7feae007af40 2024-09-21T13:12:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feae007af40 msgr2=0x7feae007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feae007af40 0x7feae007d400 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7feaf41088d0 tx=0x7feadc03a040 comp rx=0 tx=0).stop 2024-09-21T13:12:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 msgr2=0x7feaf419d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 0x7feaf419d6a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7feae400d6f0 tx=0x7feae400dbb0 comp rx=0 tx=0).stop 2024-09-21T13:12:04.004 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 shutdown_connections 2024-09-21T13:12:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7feae007af40 0x7feae007d400 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feaf41033e0 0x7feaf419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 --2- 172.21.15.46:0/944476479 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7feaf4102ac0 0x7feaf419d6a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 >> 172.21.15.46:0/944476479 conn(0x7feaf40fc520 msgr2=0x7feaf4108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 shutdown_connections 2024-09-21T13:12:04.005 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:04.003+0000 7feaf972b640 1 -- 172.21.15.46:0/944476479 wait complete. 2024-09-21T13:12:04.732 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch ps' 2024-09-21T13:12:05.001 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:12:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:05 smithi046 ceph-mon[108126]: pgmap v769: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:05 smithi046 ceph-mon[108126]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:12:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 -- 172.21.15.46:0/2296427394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 msgr2=0x7f4c9010b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 --2- 172.21.15.46:0/2296427394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9010b930 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4c840098b0 tx=0x7f4c8402a560 comp rx=0 tx=0).stop 2024-09-21T13:12:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 -- 172.21.15.46:0/2296427394 shutdown_connections 2024-09-21T13:12:05.425 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 --2- 172.21.15.46:0/2296427394 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9010b930 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 --2- 172.21.15.46:0/2296427394 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c90102b20 0x7f4c90102f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 -- 172.21.15.46:0/2296427394 >> 172.21.15.46:0/2296427394 conn(0x7f4c900fc520 msgr2=0x7f4c900fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 -- 172.21.15.46:0/2296427394 shutdown_connections 2024-09-21T13:12:05.426 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.424+0000 7f4c96685640 1 -- 172.21.15.46:0/2296427394 wait complete. 2024-09-21T13:12:05.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c96685640 1 Processor -- start 2024-09-21T13:12:05.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c96685640 1 -- start start 2024-09-21T13:12:05.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c96685640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c90102b20 0x7f4c9019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:05.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c96685640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9019dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:05.427 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c96685640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9010edf0 con 0x7f4c90103440 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c96685640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9010ec70 con 0x7f4c90102b20 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9019dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c8f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9019dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40600/0 (socket says 172.21.15.46:40600) 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.425+0000 7f4c8f7fe640 1 -- 172.21.15.46:0/1347542782 learned_addr learned my addr 172.21.15.46:0/1347542782 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8ffff640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c90102b20 0x7f4c9019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8f7fe640 1 -- 172.21.15.46:0/1347542782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c90102b20 msgr2=0x7f4c9019d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8f7fe640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c90102b20 0x7f4c9019d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8f7fe640 1 -- 172.21.15.46:0/1347542782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c901978a0 con 0x7f4c90103440 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8f7fe640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9019dc20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4c84031460 tx=0x7f4c840045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c8403f070 con 0x7f4c90103440 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4c840035f0 con 0x7f4c90103440 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c90197b30 con 0x7f4c90103440 2024-09-21T13:12:05.428 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4c84035030 con 0x7f4c90103440 2024-09-21T13:12:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.426+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c90198060 con 0x7f4c90103440 2024-09-21T13:12:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.427+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c9006aa30 con 0x7f4c90103440 2024-09-21T13:12:05.429 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.428+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4c84042070 con 0x7f4c90103440 2024-09-21T13:12:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.428+0000 7f4c8d7fa640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4c7807af80 0x7f4c7807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.429+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f4c840be890 con 0x7f4c90103440 2024-09-21T13:12:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.429+0000 7f4c8ffff640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4c7807af80 0x7f4c7807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:05.430 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.429+0000 7f4c8ffff640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4c7807af80 0x7f4c7807d440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4c901989e0 tx=0x7f4c8000b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:05.434 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.433+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4c84089e60 con 0x7f4c90103440 2024-09-21T13:12:05.629 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.628+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4c90198dd0 con 0x7f4c7807af80 2024-09-21T13:12:05.639 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.638+0000 7f4c8d7fa640 1 -- 172.21.15.46:0/1347542782 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f4c90198dd0 con 0x7f4c7807af80 2024-09-21T13:12:05.639 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:12:05.639 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (22m) 33s ago 33m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:12:05.639 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (48s) 33s ago 33m 7792k - 19.3.0-5104-g44178494 b415816db8b4 2267b049721a 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (43s) 39s ago 32m 7335k - 19.3.0-5104-g44178494 b415816db8b4 dc836293174a 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (20m) 33s ago 33m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (20m) 39s ago 32m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (21m) 33s ago 32m 78.4M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (16m) 33s ago 27m 86.6M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (16m) 33s ago 27m 22.6M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (16m) 39s ago 27m 20.8M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (15m) 39s ago 27m 20.7M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (24m) 33s ago 34m 535M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (23m) 39s ago 32m 465M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (20m) 33s ago 34m 70.6M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:12:05.640 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (20m) 39s ago 32m 50.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (23m) 33s ago 33m 11.9M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (23m) 39s ago 32m 11.8M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (19m) 33s ago 31m 94.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (19m) 33s ago 30m 107M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (18m) 33s ago 30m 91.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (18m) 39s ago 29m 107M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (17m) 39s ago 29m 100M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (17m) 39s ago 28m 98.5M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:12:05.641 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (22m) 33s ago 32m 69.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4c7807af80 msgr2=0x7f4c7807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4c7807af80 0x7f4c7807d440 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4c901989e0 tx=0x7f4c8000b390 comp rx=0 tx=0).stop 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 msgr2=0x7f4c9019dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9019dc20 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4c84031460 tx=0x7f4c840045c0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 shutdown_connections 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f4c7807af80 0x7f4c7807d440 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f4c90103440 0x7f4c9019dc20 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 --2- 172.21.15.46:0/1347542782 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c90102b20 0x7f4c9019d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:05.642 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 >> 172.21.15.46:0/1347542782 conn(0x7f4c900fc520 msgr2=0x7f4c90103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 shutdown_connections 2024-09-21T13:12:05.643 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:05.640+0000 7f4c96685640 1 -- 172.21.15.46:0/1347542782 wait complete. 2024-09-21T13:12:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:05 smithi176 ceph-mon[80162]: pgmap v769: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:05.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:05 smithi176 ceph-mon[80162]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:12:06.454 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch upgrade status' 2024-09-21T13:12:06.724 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 -- 172.21.15.46:0/87680587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241007f0 msgr2=0x7f0e24100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 --2- 172.21.15.46:0/87680587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241007f0 0x7f0e24100c50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009880 tx=0x7f0e1802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 -- 172.21.15.46:0/87680587 shutdown_connections 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 --2- 172.21.15.46:0/87680587 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241007f0 0x7f0e24100c50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 --2- 172.21.15.46:0/87680587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e241067f0 0x7f0e24106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 -- 172.21.15.46:0/87680587 >> 172.21.15.46:0/87680587 conn(0x7f0e240fc550 msgr2=0x7f0e240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 -- 172.21.15.46:0/87680587 shutdown_connections 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.176+0000 7f0e2adee640 1 -- 172.21.15.46:0/87680587 wait complete. 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e2adee640 1 Processor -- start 2024-09-21T13:12:07.182 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e2adee640 1 -- start start 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e2adee640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e241007f0 0x7f0e24196760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e2adee640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 0x7f0e24196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e2adee640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2410dd20 con 0x7f0e241067f0 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e2adee640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2410dba0 con 0x7f0e241007f0 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e23fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 0x7f0e24196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e23fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 0x7f0e24196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:40610/0 (socket says 172.21.15.46:40610) 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e23fff640 1 -- 172.21.15.46:0/1314067013 learned_addr learned my addr 172.21.15.46:0/1314067013 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e28b8a640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e241007f0 0x7f0e24196760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e23fff640 1 -- 172.21.15.46:0/1314067013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e241007f0 msgr2=0x7f0e24196760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e23fff640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e241007f0 0x7f0e24196760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.177+0000 7f0e23fff640 1 -- 172.21.15.46:0/1314067013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e241971e0 con 0x7f0e241067f0 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.178+0000 7f0e23fff640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 0x7f0e24196ca0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0e18031460 tx=0x7f0e180048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:07.183 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.178+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e1803f070 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.178+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e18004cf0 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.178+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e24197470 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.178+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e18035030 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.178+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e241a3fa0 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.179+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e24101f30 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.180+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f0e18042070 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.180+0000 7f0e21ffb640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0e0c07af80 0x7f0e0c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.181+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f0e180bea90 con 0x7f0e241067f0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.181+0000 7f0e28b8a640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0e0c07af80 0x7f0e0c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:07.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.181+0000 7f0e28b8a640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0e0c07af80 0x7f0e0c07d440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009890 tx=0x7f0e14008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:07.186 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.185+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e1808a060 con 0x7f0e241067f0 2024-09-21T13:12:07.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.389+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0e24062630 con 0x7f0e0c07af80 2024-09-21T13:12:07.391 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:07 smithi046 ceph-mon[108126]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:12:07.391 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:07 smithi046 ceph-mon[108126]: pgmap v770: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:07.391 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.390+0000 7f0e21ffb640 1 -- 172.21.15.46:0/1314067013 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f0e24062630 con 0x7f0e0c07af80 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "target_image": null, 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "in_progress": false, 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "which": "", 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "services_complete": [], 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "progress": null, 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "message": "", 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout: "is_paused": false 2024-09-21T13:12:07.392 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0e0c07af80 msgr2=0x7f0e0c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0e0c07af80 0x7f0e0c07d440 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0e14009890 tx=0x7f0e14008040 comp rx=0 tx=0).stop 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 msgr2=0x7f0e24196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 0x7f0e24196ca0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0e18031460 tx=0x7f0e180048f0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 shutdown_connections 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f0e0c07af80 0x7f0e0c07d440 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f0e241067f0 0x7f0e24196ca0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 --2- 172.21.15.46:0/1314067013 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0e241007f0 0x7f0e24196760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:07.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 >> 172.21.15.46:0/1314067013 conn(0x7f0e240fc550 msgr2=0x7f0e240fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:07.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 shutdown_connections 2024-09-21T13:12:07.395 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:07.393+0000 7f0e2adee640 1 -- 172.21.15.46:0/1314067013 wait complete. 2024-09-21T13:12:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:07 smithi176 ceph-mon[80162]: from='client.35212 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:12:07.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:07 smithi176 ceph-mon[80162]: pgmap v770: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:07.979 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph health detail' 2024-09-21T13:12:08.239 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:12:08.582 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:08 smithi046 ceph-mon[108126]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:12:08.730 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 -- 172.21.15.46:0/3632569901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 msgr2=0x7fb9ac107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/3632569901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac107cf0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb9a8009880 tx=0x7fb9a802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 -- 172.21.15.46:0/3632569901 shutdown_connections 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/3632569901 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9ac101910 0x7fb9ac101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/3632569901 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac107cf0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 -- 172.21.15.46:0/3632569901 >> 172.21.15.46:0/3632569901 conn(0x7fb9ac0fd630 msgr2=0x7fb9ac0ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 -- 172.21.15.46:0/3632569901 shutdown_connections 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 -- 172.21.15.46:0/3632569901 wait complete. 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 Processor -- start 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.706+0000 7fb9b3db8640 1 -- start start 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b3db8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9ac101910 0x7fb9ac19d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b3db8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac19db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b3db8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac10edc0 con 0x7fb9ac107910 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b3db8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ac10ec40 con 0x7fb9ac101910 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac19db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:08.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac19db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60074/0 (socket says 172.21.15.46:60074) 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 -- 172.21.15.46:0/277941098 learned_addr learned my addr 172.21.15.46:0/277941098 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1b54640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9ac101910 0x7fb9ac19d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 -- 172.21.15.46:0/277941098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9ac101910 msgr2=0x7fb9ac19d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9ac101910 0x7fb9ac19d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 -- 172.21.15.46:0/277941098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ac197790 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9b1353640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac19db50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00d8d0 tx=0x7fb99c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.707+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb99c017070 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.708+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb99c010460 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.708+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ac197a80 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.708+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb99c00f5f0 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.708+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ac198010 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.709+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ac103050 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.709+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb99c009a30 con 0x7fb9ac107910 2024-09-21T13:12:08.739 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.710+0000 7fb9a2ffd640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb99807af30 0x7fb99807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:08.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.710+0000 7fb9b1b54640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb99807af30 0x7fb99807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:08.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.710+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb99c09df90 con 0x7fb9ac107910 2024-09-21T13:12:08.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.710+0000 7fb9b1b54640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb99807af30 0x7fb99807d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80096c0 tx=0x7fb9a8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:08.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.714+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb99c0694e0 con 0x7fb9ac107910 2024-09-21T13:12:08.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:08 smithi176 ceph-mon[80162]: from='client.35216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:12:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.977+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fb9ac104b20 con 0x7fb9ac107910 2024-09-21T13:12:08.978 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.977+0000 7fb9a2ffd640 1 -- 172.21.15.46:0/277941098 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fb99c06e390 con 0x7fb9ac107910 2024-09-21T13:12:08.978 INFO:teuthology.orchestra.run.smithi046.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T13:12:08.978 INFO:teuthology.orchestra.run.smithi046.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T13:12:08.978 INFO:teuthology.orchestra.run.smithi046.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T13:12:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb99807af30 msgr2=0x7fb99807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb99807af30 0x7fb99807d3f0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80096c0 tx=0x7fb9a8031400 comp rx=0 tx=0).stop 2024-09-21T13:12:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 msgr2=0x7fb9ac19db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac19db50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb99c00d8d0 tx=0x7fb99c00dd90 comp rx=0 tx=0).stop 2024-09-21T13:12:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 shutdown_connections 2024-09-21T13:12:08.980 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb99807af30 0x7fb99807d3f0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb9ac107910 0x7fb9ac19db50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 --2- 172.21.15.46:0/277941098 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9ac101910 0x7fb9ac19d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 >> 172.21.15.46:0/277941098 conn(0x7fb9ac0fd630 msgr2=0x7fb9ac0fefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 shutdown_connections 2024-09-21T13:12:08.981 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:08.979+0000 7fb9b3db8640 1 -- 172.21.15.46:0/277941098 wait complete. 2024-09-21T13:12:09.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:09 smithi046 ceph-mon[108126]: pgmap v771: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:09.584 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:09 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/277941098' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:12:09.614 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions' 2024-09-21T13:12:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:09 smithi176 ceph-mon[80162]: pgmap v771: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:09.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:09 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/277941098' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T13:12:09.875 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:12:10.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.318+0000 7fac43ec4640 1 -- 172.21.15.46:0/3909887472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c101900 msgr2=0x7fac3c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:10.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.318+0000 7fac43ec4640 1 --2- 172.21.15.46:0/3909887472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c101900 0x7fac3c101d60 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009880 tx=0x7fac2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.318+0000 7fac43ec4640 1 -- 172.21.15.46:0/3909887472 shutdown_connections 2024-09-21T13:12:10.337 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.318+0000 7fac43ec4640 1 --2- 172.21.15.46:0/3909887472 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c101900 0x7fac3c101d60 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.318+0000 7fac43ec4640 1 --2- 172.21.15.46:0/3909887472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac3c107900 0x7fac3c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.318+0000 7fac43ec4640 1 -- 172.21.15.46:0/3909887472 >> 172.21.15.46:0/3909887472 conn(0x7fac3c0fd620 msgr2=0x7fac3c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 -- 172.21.15.46:0/3909887472 shutdown_connections 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 -- 172.21.15.46:0/3909887472 wait complete. 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 Processor -- start 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 -- start start 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac3c101900 0x7fac3c19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 0x7fac3c19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c10edb0 con 0x7fac3c107900 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.319+0000 7fac43ec4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fac3c10ec30 con 0x7fac3c101900 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 0x7fac3c19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:10.338 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 0x7fac3c19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60096/0 (socket says 172.21.15.46:60096) 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 -- 172.21.15.46:0/969778765 learned_addr learned my addr 172.21.15.46:0/969778765 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac41c60640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac3c101900 0x7fac3c19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 -- 172.21.15.46:0/969778765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac3c101900 msgr2=0x7fac3c19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac3c101900 0x7fac3c19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 -- 172.21.15.46:0/969778765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3c1977a0 con 0x7fac3c107900 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac4145f640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 0x7fac3c19db60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fac2c031460 tx=0x7fac2c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac2c03f070 con 0x7fac3c107900 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fac2c0035f0 con 0x7fac3c107900 2024-09-21T13:12:10.339 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3c197a30 con 0x7fac3c107900 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fac2c035030 con 0x7fac3c107900 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.320+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3c197f60 con 0x7fac3c107900 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.321+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac3c103040 con 0x7fac3c107900 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.322+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fac2c042070 con 0x7fac3c107900 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.322+0000 7fac32ffd640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fac2807af30 0x7fac2807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.323+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fac2c0bea80 con 0x7fac3c107900 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.323+0000 7fac41c60640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fac2807af30 0x7fac2807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.323+0000 7fac41c60640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fac2807af30 0x7fac2807d3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fac3800bbe0 tx=0x7fac3800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:12:10.340 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.327+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac2c089f70 con 0x7fac3c107900 2024-09-21T13:12:10.592 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.591+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fac3c198cd0 con 0x7fac3c107900 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.592+0000 7fac32ffd640 1 -- 172.21.15.46:0/969778765 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fac2c08ee20 con 0x7fac3c107900 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:12:10.593 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:12:10.594 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fac2807af30 msgr2=0x7fac2807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fac2807af30 0x7fac2807d3f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fac3800bbe0 tx=0x7fac3800b390 comp rx=0 tx=0).stop 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 msgr2=0x7fac3c19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 0x7fac3c19db60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fac2c031460 tx=0x7fac2c0045e0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 shutdown_connections 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fac2807af30 0x7fac2807d3f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fac3c107900 0x7fac3c19db60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.595 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 --2- 172.21.15.46:0/969778765 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fac3c101900 0x7fac3c19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:12:10.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 >> 172.21.15.46:0/969778765 conn(0x7fac3c0fd620 msgr2=0x7fac3c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:12:10.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 shutdown_connections 2024-09-21T13:12:10.596 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:12:10.594+0000 7fac43ec4640 1 -- 172.21.15.46:0/969778765 wait complete. 2024-09-21T13:12:11.195 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-21T13:12:11.457 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:12:11.577 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:11 smithi046 ceph-mon[108126]: pgmap v772: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:11.578 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:11 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/969778765' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:12:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:11 smithi176 ceph-mon[80162]: pgmap v772: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:11.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:11 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/969778765' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:12:11.944 INFO:teuthology.orchestra.run.smithi046.stdout:wait for servicemap items w/ changing names to refresh 2024-09-21T13:12:12.591 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'sleep 60' 2024-09-21T13:12:12.859 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:12:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:13 smithi046 ceph-mon[108126]: pgmap v773: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:13.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:13 smithi176 ceph-mon[80162]: pgmap v773: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:14.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:14.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:15 smithi046 ceph-mon[108126]: pgmap v774: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:15.817 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:15 smithi176 ceph-mon[80162]: pgmap v774: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:17.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:17 smithi046 ceph-mon[108126]: pgmap v775: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:17.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:17 smithi176 ceph-mon[80162]: pgmap v775: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:19 smithi046 ceph-mon[108126]: pgmap v776: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:19.717 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:19 smithi176 ceph-mon[80162]: pgmap v776: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:21.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:21 smithi046 ceph-mon[108126]: pgmap v777: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:21.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:21 smithi176 ceph-mon[80162]: pgmap v777: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:23.607 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:23 smithi176 ceph-mon[80162]: pgmap v778: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:23 smithi046 ceph-mon[108126]: pgmap v778: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:25 smithi046 ceph-mon[108126]: pgmap v779: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:25.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:25 smithi176 ceph-mon[80162]: pgmap v779: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:27 smithi046 ceph-mon[108126]: pgmap v780: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:27.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:27 smithi176 ceph-mon[80162]: pgmap v780: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:29 smithi046 ceph-mon[108126]: pgmap v781: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:29.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:29 smithi176 ceph-mon[80162]: pgmap v781: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:29.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:31 smithi046 ceph-mon[108126]: pgmap v782: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:31.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:31 smithi176 ceph-mon[80162]: pgmap v782: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:33 smithi046 ceph-mon[108126]: pgmap v783: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:33.793 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:33 smithi176 ceph-mon[80162]: pgmap v783: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:35 smithi046 ceph-mon[108126]: pgmap v784: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:35.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:35 smithi176 ceph-mon[80162]: pgmap v784: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:37 smithi046 ceph-mon[108126]: pgmap v785: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:37 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:12:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:37 smithi176 ceph-mon[80162]: pgmap v785: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:37.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:37 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:12:38.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:38 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:12:38.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:38 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:12:38.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:38 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:12:38.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:38 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:12:38.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:38 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:12:38.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:38 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:12:39.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:39 smithi176 ceph-mon[80162]: pgmap v786: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:39.912 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:39 smithi046 ceph-mon[108126]: pgmap v786: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:41.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:41 smithi046 ceph-mon[108126]: pgmap v787: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:42.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:41 smithi176 ceph-mon[80162]: pgmap v787: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:43.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:43 smithi046 ceph-mon[108126]: pgmap v788: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:43.980 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:43 smithi176 ceph-mon[80162]: pgmap v788: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:44.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:45.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:12:45.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:45 smithi046 ceph-mon[108126]: pgmap v789: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:46.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:45 smithi176 ceph-mon[80162]: pgmap v789: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:46 smithi176 ceph-mon[80162]: pgmap v790: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:46 smithi046 ceph-mon[108126]: pgmap v790: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:48 smithi176 ceph-mon[80162]: pgmap v791: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:49.350 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:48 smithi046 ceph-mon[108126]: pgmap v791: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:50 smithi176 ceph-mon[80162]: pgmap v792: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:50 smithi046 ceph-mon[108126]: pgmap v792: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:52 smithi176 ceph-mon[80162]: pgmap v793: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:52 smithi046 ceph-mon[108126]: pgmap v793: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:12:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:54 smithi176 ceph-mon[80162]: pgmap v794: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:54 smithi046 ceph-mon[108126]: pgmap v794: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:12:57.214 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:56 smithi046 ceph-mon[108126]: pgmap v795: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:56 smithi176 ceph-mon[80162]: pgmap v795: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:12:59.258 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:58 smithi176 ceph-mon[80162]: pgmap v796: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:12:59.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:58 smithi046 ceph-mon[108126]: pgmap v796: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:12:59 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:12:59 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:00 smithi176 ceph-mon[80162]: pgmap v797: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:01.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:00 smithi046 ceph-mon[108126]: pgmap v797: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:02 smithi176 ceph-mon[80162]: pgmap v798: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:03.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:02 smithi046 ceph-mon[108126]: pgmap v798: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:05.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:04 smithi176 ceph-mon[80162]: pgmap v799: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:04 smithi046 ceph-mon[108126]: pgmap v799: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:07.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:06 smithi176 ceph-mon[80162]: pgmap v800: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:06 smithi046 ceph-mon[108126]: pgmap v800: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:08 smithi176 ceph-mon[80162]: pgmap v801: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:08 smithi046 ceph-mon[108126]: pgmap v801: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:10 smithi176 ceph-mon[80162]: pgmap v802: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:10 smithi046 ceph-mon[108126]: pgmap v802: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:13.225 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:12 smithi046 ceph-mon[108126]: pgmap v803: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:13.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:12 smithi176 ceph-mon[80162]: pgmap v803: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:13.923 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph orch ps' 2024-09-21T13:13:14.189 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 -- 172.21.15.46:0/581362819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074f40 msgr2=0x7f8d7010dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/581362819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074f40 0x7f8d7010dc00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009880 tx=0x7f8d6402a530 comp rx=0 tx=0).stop 2024-09-21T13:13:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 -- 172.21.15.46:0/581362819 shutdown_connections 2024-09-21T13:13:14.699 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/581362819 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074f40 0x7f8d7010dc00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/581362819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074620 0x7f8d70074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 -- 172.21.15.46:0/581362819 >> 172.21.15.46:0/581362819 conn(0x7f8d700fd600 msgr2=0x7f8d700ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 -- 172.21.15.46:0/581362819 shutdown_connections 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.673+0000 7f8d75b4b640 1 -- 172.21.15.46:0/581362819 wait complete. 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.674+0000 7f8d75b4b640 1 Processor -- start 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.674+0000 7f8d75b4b640 1 -- start start 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.674+0000 7f8d75b4b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 0x7f8d7019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.674+0000 7f8d75b4b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074f40 0x7f8d7019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.674+0000 7f8d75b4b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70110ff0 con 0x7f8d70074620 2024-09-21T13:13:14.700 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.674+0000 7f8d75b4b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70110e70 con 0x7f8d70074f40 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 0x7f8d7019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 0x7f8d7019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49770/0 (socket says 172.21.15.46:49770) 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 -- 172.21.15.46:0/3021729531 learned_addr learned my addr 172.21.15.46:0/3021729531 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6effd640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074f40 0x7f8d7019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 -- 172.21.15.46:0/3021729531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074f40 msgr2=0x7f8d7019fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074f40 0x7f8d7019fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 -- 172.21.15.46:0/3021729531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d70199a20 con 0x7f8d70074620 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6effd640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074f40 0x7f8d7019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6f7fe640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 0x7f8d7019f860 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000e970 tx=0x7f8d6000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d6000cac0 con 0x7f8d70074620 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8d600054e0 con 0x7f8d70074620 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d70199d10 con 0x7f8d70074620 2024-09-21T13:13:14.701 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8d60010430 con 0x7f8d70074620 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.675+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7019a270 con 0x7f8d70074620 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.676+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d70075cd0 con 0x7f8d70074620 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.677+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f8d60004f00 con 0x7f8d70074620 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.677+0000 7f8d6cff9640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8d5807af80 0x7f8d5807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.678+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f8d6009e7a0 con 0x7f8d70074620 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.678+0000 7f8d6effd640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8d5807af80 0x7f8d5807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.678+0000 7f8d6effd640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8d5807af80 0x7f8d5807d440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8d7019b210 tx=0x7f8d64031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:14.702 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.682+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8d60069cd0 con 0x7f8d70074620 2024-09-21T13:13:14.882 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.881+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 --> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8d7019af50 con 0x7f8d5807af80 2024-09-21T13:13:14.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.891+0000 7f8d6cff9640 1 -- 172.21.15.46:0/3021729531 <== mgr.14742 v2:172.21.15.46:6800/3073108359 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8d7019af50 con 0x7f8d5807af80 2024-09-21T13:13:14.892 INFO:teuthology.orchestra.run.smithi046.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T13:13:14.892 INFO:teuthology.orchestra.run.smithi046.stdout:alertmanager.smithi046 smithi046 *:9093,9094 running (23m) 102s ago 34m 18.9M - 0.27.0 11f11916f8cd f91d02c25934 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi046 smithi046 running (117s) 102s ago 34m 7792k - 19.3.0-5104-g44178494 b415816db8b4 2267b049721a 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:ceph-exporter.smithi176 smithi176 running (112s) 109s ago 33m 7335k - 19.3.0-5104-g44178494 b415816db8b4 dc836293174a 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi046 smithi046 running (21m) 102s ago 34m 6899k - 19.3.0-5104-g44178494 b415816db8b4 59d7e289919a 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:crash.smithi176 smithi176 running (21m) 109s ago 33m 6895k - 19.3.0-5104-g44178494 b415816db8b4 4556f39dd203 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:grafana.smithi046 smithi046 *:3000 running (23m) 102s ago 34m 78.4M - 10.4.8 5aad1d7cf004 e73a5ef69870 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.ffxnex smithi046 running (17m) 102s ago 28m 86.6M - 19.3.0-5104-g44178494 b415816db8b4 20fb859d07ab 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi046.hxdqyf smithi046 running (17m) 102s ago 28m 22.6M - 19.3.0-5104-g44178494 b415816db8b4 d5a213595645 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.kzzdid smithi176 running (17m) 109s ago 28m 20.8M - 19.3.0-5104-g44178494 b415816db8b4 ed27754f6cc6 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mds.cephfs.smithi176.whwfab smithi176 running (17m) 109s ago 28m 20.7M - 19.3.0-5104-g44178494 b415816db8b4 5a18db194fb2 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi046.vedsjs smithi046 *:8443,9283,8765 running (25m) 102s ago 35m 535M - 19.3.0-5104-g44178494 b415816db8b4 e266f3c613a4 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mgr.smithi176.rmyfjh smithi176 *:8443,9283,8765 running (24m) 109s ago 33m 465M - 19.3.0-5104-g44178494 b415816db8b4 e316ff5f16ec 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi046 smithi046 running (22m) 102s ago 35m 70.6M 2048M 19.3.0-5104-g44178494 b415816db8b4 805012a2e2d1 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:mon.smithi176 smithi176 running (21m) 109s ago 33m 50.8M 2048M 19.3.0-5104-g44178494 b415816db8b4 0eb7759cb8cb 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi046 smithi046 *:9100 running (24m) 102s ago 34m 11.9M - 1.7.0 72c9c2088986 f2ce0cd0e201 2024-09-21T13:13:14.893 INFO:teuthology.orchestra.run.smithi046.stdout:node-exporter.smithi176 smithi176 *:9100 running (24m) 109s ago 33m 11.8M - 1.7.0 72c9c2088986 b3d5eb2ccc60 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.0 smithi046 running (21m) 102s ago 32m 94.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 b6ae673b9b35 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.1 smithi046 running (20m) 102s ago 31m 107M 1217M 19.3.0-5104-g44178494 b415816db8b4 7f56a266a998 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.2 smithi046 running (19m) 102s ago 31m 91.9M 1217M 19.3.0-5104-g44178494 b415816db8b4 4fc21225a6a8 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.3 smithi176 running (19m) 109s ago 30m 107M 2240M 19.3.0-5104-g44178494 b415816db8b4 92277842fa2d 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.4 smithi176 running (18m) 109s ago 30m 100M 2240M 19.3.0-5104-g44178494 b415816db8b4 614ac268f031 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:osd.5 smithi176 running (18m) 109s ago 29m 98.5M 2240M 19.3.0-5104-g44178494 b415816db8b4 c461494c3227 2024-09-21T13:13:14.894 INFO:teuthology.orchestra.run.smithi046.stdout:prometheus.smithi046 smithi046 *:9095 running (23m) 102s ago 33m 69.7M - 2.51.0 1d3b7f56885b ecf0cad3ceac 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8d5807af80 msgr2=0x7f8d5807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8d5807af80 0x7f8d5807d440 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8d7019b210 tx=0x7f8d64031400 comp rx=0 tx=0).stop 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 msgr2=0x7f8d7019f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 0x7f8d7019f860 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000e970 tx=0x7f8d6000ed70 comp rx=0 tx=0).stop 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 shutdown_connections 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f8d5807af80 0x7f8d5807d440 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8d70074f40 0x7f8d7019fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 --2- 172.21.15.46:0/3021729531 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f8d70074620 0x7f8d7019f860 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.893+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 >> 172.21.15.46:0/3021729531 conn(0x7f8d700fd600 msgr2=0x7f8d7010b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:14.895 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.894+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 shutdown_connections 2024-09-21T13:13:14.896 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:14.894+0000 7f8d75b4b640 1 -- 172.21.15.46:0/3021729531 wait complete. 2024-09-21T13:13:15.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:14 smithi046 ceph-mon[108126]: pgmap v804: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:15.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:14 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:14 smithi176 ceph-mon[80162]: pgmap v804: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:14 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:15.595 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions' 2024-09-21T13:13:15.866 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:16.146 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:15 smithi046 ceph-mon[108126]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:13:16.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:15 smithi176 ceph-mon[80162]: from='client.35228 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.342+0000 7f47067d1640 1 -- 172.21.15.46:0/409472976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 msgr2=0x7f4700100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.342+0000 7f47067d1640 1 --2- 172.21.15.46:0/409472976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f4700100c50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f46e8009880 tx=0x7f46e802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.342+0000 7f47067d1640 1 -- 172.21.15.46:0/409472976 shutdown_connections 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.342+0000 7f47067d1640 1 --2- 172.21.15.46:0/409472976 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f4700100c50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.342+0000 7f47067d1640 1 --2- 172.21.15.46:0/409472976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47001067f0 0x7f4700106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.342+0000 7f47067d1640 1 -- 172.21.15.46:0/409472976 >> 172.21.15.46:0/409472976 conn(0x7f47000fc550 msgr2=0x7f47000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.343+0000 7f47067d1640 1 -- 172.21.15.46:0/409472976 shutdown_connections 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.343+0000 7f47067d1640 1 -- 172.21.15.46:0/409472976 wait complete. 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.343+0000 7f47067d1640 1 Processor -- start 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.343+0000 7f47067d1640 1 -- start start 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f47067d1640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f47001987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:16.357 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f47067d1640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47001067f0 0x7f4700198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f47067d1640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f470010dca0 con 0x7f47001007f0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f47067d1640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f470010db20 con 0x7f47001067f0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f47001987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f47001987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49778/0 (socket says 172.21.15.46:49778) 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 -- 172.21.15.46:0/3338528091 learned_addr learned my addr 172.21.15.46:0/3338528091 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46f7fff640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47001067f0 0x7f4700198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 -- 172.21.15.46:0/3338528091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47001067f0 msgr2=0x7f4700198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47001067f0 0x7f4700198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 -- 172.21.15.46:0/3338528091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47001992f0 con 0x7f47001007f0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.344+0000 7f46fffff640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f47001987b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f46f000d8d0 tx=0x7f46f000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.345+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46f0017070 con 0x7f47001007f0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.345+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f46f0010460 con 0x7f47001007f0 2024-09-21T13:13:16.358 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.345+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47001995e0 con 0x7f47001007f0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.345+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f46f000f5f0 con 0x7f47001007f0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.345+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47001a1be0 con 0x7f47001007f0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.346+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4700101f30 con 0x7f47001007f0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.347+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f46f0009a30 con 0x7f47001007f0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.347+0000 7f46fdffb640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46ec07af40 0x7f46ec07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.347+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f46f009df90 con 0x7f47001007f0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.347+0000 7f46f7fff640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46ec07af40 0x7f46ec07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.348+0000 7f46f7fff640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46ec07af40 0x7f46ec07d400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f470006a7f0 tx=0x7f46e80095c0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:16.359 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.352+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47001995e0 con 0x7f47001007f0 2024-09-21T13:13:16.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.613+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f47001a1e90 con 0x7f47001007f0 2024-09-21T13:13:16.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.614+0000 7f46fdffb640 1 -- 172.21.15.46:0/3338528091 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f46f00694e0 con 0x7f47001007f0 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout:{ 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "mon": { 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "mgr": { 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 2 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "osd": { 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 6 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "mds": { 2024-09-21T13:13:16.615 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 4 2024-09-21T13:13:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: }, 2024-09-21T13:13:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: "overall": { 2024-09-21T13:13:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)": 14 2024-09-21T13:13:16.616 INFO:teuthology.orchestra.run.smithi046.stdout: } 2024-09-21T13:13:16.616 INFO:teuthology.orchestra.run.smithi046.stdout:} 2024-09-21T13:13:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46ec07af40 msgr2=0x7f46ec07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:16.617 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46ec07af40 0x7f46ec07d400 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f470006a7f0 tx=0x7f46e80095c0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 msgr2=0x7f47001987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f47001987b0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f46f000d8d0 tx=0x7f46f000dd90 comp rx=0 tx=0).stop 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 shutdown_connections 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f46ec07af40 0x7f46ec07d400 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47001067f0 0x7f4700198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 --2- 172.21.15.46:0/3338528091 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f47001007f0 0x7f47001987b0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 >> 172.21.15.46:0/3338528091 conn(0x7f47000fc550 msgr2=0x7f47000fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 shutdown_connections 2024-09-21T13:13:16.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:16.616+0000 7f47067d1640 1 -- 172.21.15.46:0/3338528091 wait complete. 2024-09-21T13:13:17.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:16 smithi046 ceph-mon[108126]: pgmap v805: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:17.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:16 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3338528091' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:13:17.255 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-21T13:13:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:16 smithi176 ceph-mon[80162]: pgmap v805: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:16 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3338528091' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:13:17.517 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 -- 172.21.15.46:0/1635488948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 msgr2=0x7fa800101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1635488948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa800101d60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0009880 tx=0x7fa7f002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 -- 172.21.15.46:0/1635488948 shutdown_connections 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1635488948 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa800101d60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1635488948 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 0x7fa800107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 -- 172.21.15.46:0/1635488948 >> 172.21.15.46:0/1635488948 conn(0x7fa8000fd600 msgr2=0x7fa8000ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 -- 172.21.15.46:0/1635488948 shutdown_connections 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.012+0000 7fa807f7f640 1 -- 172.21.15.46:0/1635488948 wait complete. 2024-09-21T13:13:18.039 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa807f7f640 1 Processor -- start 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa807f7f640 1 -- start start 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa807f7f640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa80019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa807f7f640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 0x7fa80019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa807f7f640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa80010edd0 con 0x7fa800101900 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa807f7f640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa80010ec50 con 0x7fa800107900 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa805d1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa80019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa805d1b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa80019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34764/0 (socket says 172.21.15.46:34764) 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa805d1b640 1 -- 172.21.15.46:0/1401418461 learned_addr learned my addr 172.21.15.46:0/1401418461 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa80551a640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 0x7fa80019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa805d1b640 1 -- 172.21.15.46:0/1401418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 msgr2=0x7fa80019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa805d1b640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 0x7fa80019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa805d1b640 1 -- 172.21.15.46:0/1401418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa800197800 con 0x7fa800101900 2024-09-21T13:13:18.040 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.013+0000 7fa80551a640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 0x7fa80019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.014+0000 7fa805d1b640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa80019d680 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c8f0 tx=0x7fa7fc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.014+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc0079b0 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.014+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7fc0054e0 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.014+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa800197af0 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.014+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7fc004dd0 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.014+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa800198050 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.015+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa800103040 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.016+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa7fc005020 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.016+0000 7fa7f6ffd640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7ec07aed0 0x7fa7ec07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.016+0000 7fa80551a640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7ec07aed0 0x7fa7ec07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.016+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa7fc09e080 con 0x7fa800101900 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.017+0000 7fa80551a640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7ec07aed0 0x7fa7ec07d390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa800198b50 tx=0x7fa7f0009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:18.041 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.021+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7fc014030 con 0x7fa800101900 2024-09-21T13:13:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.286+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa800109e70 con 0x7fa800101900 2024-09-21T13:13:18.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.286+0000 7fa7f6ffd640 1 -- 172.21.15.46:0/1401418461 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa7fc0695d0 con 0x7fa800101900 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.288+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7ec07aed0 msgr2=0x7fa7ec07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.288+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7ec07aed0 0x7fa7ec07d390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa800198b50 tx=0x7fa7f0009560 comp rx=0 tx=0).stop 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.288+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 msgr2=0x7fa80019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.288+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa80019d680 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc00c8f0 tx=0x7fa7fc00cdb0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.288+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 shutdown_connections 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.288+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7ec07aed0 0x7fa7ec07d390 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.289+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa800107900 0x7fa80019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.289+0000 7fa807f7f640 1 --2- 172.21.15.46:0/1401418461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa800101900 0x7fa80019d680 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.289+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 >> 172.21.15.46:0/1401418461 conn(0x7fa8000fd600 msgr2=0x7fa8000fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.289+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 shutdown_connections 2024-09-21T13:13:18.290 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:18.289+0000 7fa807f7f640 1 -- 172.21.15.46:0/1401418461 wait complete. 2024-09-21T13:13:18.298 INFO:teuthology.orchestra.run.smithi046.stdout:true 2024-09-21T13:13:18.982 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -e sha1=441784946648ff53dd310293f9dd752afeeea72a -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-21T13:13:19.243 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:18 smithi176 ceph-mon[80162]: pgmap v806: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T13:13:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:18 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1401418461' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:13:19.365 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:18 smithi046 ceph-mon[108126]: pgmap v806: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T13:13:19.365 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:18 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1401418461' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:13:19.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 -- 172.21.15.46:0/3106804928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c107900 msgr2=0x7f066c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:19.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 --2- 172.21.15.46:0/3106804928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c107900 0x7f066c107ce0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f065c009880 tx=0x7f065c02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:19.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 -- 172.21.15.46:0/3106804928 shutdown_connections 2024-09-21T13:13:19.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 --2- 172.21.15.46:0/3106804928 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f066c101900 0x7f066c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:19.737 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 --2- 172.21.15.46:0/3106804928 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c107900 0x7f066c107ce0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:19.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 -- 172.21.15.46:0/3106804928 >> 172.21.15.46:0/3106804928 conn(0x7f066c0fd600 msgr2=0x7f066c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:19.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 -- 172.21.15.46:0/3106804928 shutdown_connections 2024-09-21T13:13:19.738 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.736+0000 7f0670abc640 1 -- 172.21.15.46:0/3106804928 wait complete. 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0670abc640 1 Processor -- start 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0670abc640 1 -- start start 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0670abc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 0x7f066c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0670abc640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f066c107900 0x7f066c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0670abc640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f066c10edb0 con 0x7f066c101900 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0670abc640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f066c10ec30 con 0x7f066c107900 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f066a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 0x7f066c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f066a59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 0x7f066c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34784/0 (socket says 172.21.15.46:34784) 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f066a59c640 1 -- 172.21.15.46:0/3602542850 learned_addr learned my addr 172.21.15.46:0/3602542850 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.737+0000 7f0661d9b640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f066c107900 0x7f066c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:19.740 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f066a59c640 1 -- 172.21.15.46:0/3602542850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f066c107900 msgr2=0x7f066c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f066a59c640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f066c107900 0x7f066c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f066a59c640 1 -- 172.21.15.46:0/3602542850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c1977c0 con 0x7f066c101900 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f066a59c640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 0x7f066c19d640 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f065c031460 tx=0x7f065c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f065c03f070 con 0x7f066c101900 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f065c004cf0 con 0x7f066c101900 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066c197a50 con 0x7f066c101900 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f065c035030 con 0x7f066c101900 2024-09-21T13:13:19.741 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.738+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066c197f80 con 0x7f066c101900 2024-09-21T13:13:19.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.739+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066c103040 con 0x7f066c101900 2024-09-21T13:13:19.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.740+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f065c042070 con 0x7f066c101900 2024-09-21T13:13:19.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.740+0000 7f0663fff640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f065807af30 0x7f065807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:19.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.741+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f065c0beb60 con 0x7f066c101900 2024-09-21T13:13:19.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.741+0000 7f0661d9b640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f065807af30 0x7f065807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:19.742 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.741+0000 7f0661d9b640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f065807af30 0x7f065807d3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f066c100e00 tx=0x7f065400a2d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:19.746 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:19.745+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f065c08a010 con 0x7f066c101900 2024-09-21T13:13:20.011 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.010+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f066c104b10 con 0x7f066c101900 2024-09-21T13:13:20.012 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.011+0000 7f0663fff640 1 -- 172.21.15.46:0/3602542850 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f065c08eec0 con 0x7f066c101900 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f065807af30 msgr2=0x7f065807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f065807af30 0x7f065807d3f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f066c100e00 tx=0x7f065400a2d0 comp rx=0 tx=0).stop 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 msgr2=0x7f066c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 0x7f066c19d640 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f065c031460 tx=0x7f065c0048f0 comp rx=0 tx=0).stop 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 shutdown_connections 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f065807af30 0x7f065807d3f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f066c107900 0x7f066c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:20.014 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 --2- 172.21.15.46:0/3602542850 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f066c101900 0x7f066c19d640 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 >> 172.21.15.46:0/3602542850 conn(0x7f066c0fd600 msgr2=0x7f066c0ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 shutdown_connections 2024-09-21T13:13:20.015 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:20.013+0000 7f0670abc640 1 -- 172.21.15.46:0/3602542850 wait complete. 2024-09-21T13:13:20.022 INFO:teuthology.orchestra.run.smithi046.stdout: "ceph version 19.3.0-5104-g44178494 (441784946648ff53dd310293f9dd752afeeea72a) squid (dev)" 2024-09-21T13:13:20.647 DEBUG:teuthology.parallel:result is None 2024-09-21T13:13:20.647 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T13:13:20.660 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T13:13:20.661 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T13:13:20.921 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:21.294 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:20 smithi046 ceph-mon[108126]: pgmap v807: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T13:13:21.295 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:20 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3602542850' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:13:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:20 smithi176 ceph-mon[80162]: pgmap v807: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T13:13:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:20 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3602542850' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T13:13:21.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.376+0000 7fce398b6640 1 -- 172.21.15.46:0/237427637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34102b50 msgr2=0x7fce34102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:21.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.376+0000 7fce398b6640 1 --2- 172.21.15.46:0/237427637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34102b50 0x7fce34102f30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fce24009c20 tx=0x7fce2402aa00 comp rx=0 tx=0).stop 2024-09-21T13:13:21.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 -- 172.21.15.46:0/237427637 shutdown_connections 2024-09-21T13:13:21.379 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 --2- 172.21.15.46:0/237427637 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce34103470 0x7fce3410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 --2- 172.21.15.46:0/237427637 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34102b50 0x7fce34102f30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 -- 172.21.15.46:0/237427637 >> 172.21.15.46:0/237427637 conn(0x7fce340fc550 msgr2=0x7fce340fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 -- 172.21.15.46:0/237427637 shutdown_connections 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 -- 172.21.15.46:0/237427637 wait complete. 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 Processor -- start 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.377+0000 7fce398b6640 1 -- start start 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce398b6640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce34102b50 0x7fce3419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce398b6640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 0x7fce3419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce398b6640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fce3410ede0 con 0x7fce34103470 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce398b6640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fce3410ec60 con 0x7fce34102b50 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 0x7fce3419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 0x7fce3419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34796/0 (socket says 172.21.15.46:34796) 2024-09-21T13:13:21.380 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 -- 172.21.15.46:0/3382106117 learned_addr learned my addr 172.21.15.46:0/3382106117 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce32ffd640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce34102b50 0x7fce3419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 -- 172.21.15.46:0/3382106117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce34102b50 msgr2=0x7fce3419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce34102b50 0x7fce3419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 -- 172.21.15.46:0/3382106117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce34199990 con 0x7fce34103470 2024-09-21T13:13:21.381 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.378+0000 7fce327fc640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 0x7fce3419fd10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00d6f0 tx=0x7fce1c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.379+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce1c017070 con 0x7fce34103470 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.379+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce34199c80 con 0x7fce34103470 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.379+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce1c00de00 con 0x7fce34103470 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.379+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce1c004bb0 con 0x7fce34103470 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.379+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce3419a210 con 0x7fce34103470 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.380+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce3406a4e0 con 0x7fce34103470 2024-09-21T13:13:21.382 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.381+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fce1c004e60 con 0x7fce34103470 2024-09-21T13:13:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.381+0000 7fce388b4640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fce2007af30 0x7fce2007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.381+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fce1c09dc50 con 0x7fce34103470 2024-09-21T13:13:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.381+0000 7fce32ffd640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fce2007af30 0x7fce2007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:21.383 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.382+0000 7fce32ffd640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fce2007af30 0x7fce2007d3f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce24009430 tx=0x7fce2403a040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:21.387 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.386+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce1c0691a0 con 0x7fce34103470 2024-09-21T13:13:21.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.614+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fce3419aec0 con 0x7fce34103470 2024-09-21T13:13:21.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.614+0000 7fce388b4640 1 -- 172.21.15.46:0/3382106117 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) ==== 76+0+2052 (secure 0 0 0) 0x7fce1c06e050 con 0x7fce34103470 2024-09-21T13:13:21.615 INFO:teuthology.orchestra.run.smithi046.stdout:e39 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:btime 2024-09-21T13:11:36:892326+0000 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:legacy client fscid: 1 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:Filesystem 'cephfs' (1) 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:fs_name cephfs 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:epoch 39 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:created 2024-09-21T12:44:11.798472+0000 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:modified 2024-09-21T13:11:35.987881+0000 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:tableserver 0 2024-09-21T13:13:21.616 INFO:teuthology.orchestra.run.smithi046.stdout:root 0 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:session_timeout 60 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:session_autoclose 300 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:max_file_size 1099511627776 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:max_xattr_size 65536 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:required_client_features {} 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure 0 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:last_failure_osd_epoch 77 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:max_mds 2 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:in 0,1 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:up {0=34328,1=34360} 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:failed 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:damaged 2024-09-21T13:13:21.617 INFO:teuthology.orchestra.run.smithi046.stdout:stopped 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:data_pools [3] 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:metadata_pool 2 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:inline_data enabled 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:balancer 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:bal_rank_mask -1 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:standby_count_wanted 1 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:qdb_cluster leader: 34328 members: 34328,34360 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.ffxnex{0:34328} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.46:6826/3249327567,v1:172.21.15.46:6827/3249327567] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.kzzdid{0:44303} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.176:6824/1139967954,v1:172.21.15.176:6825/1139967954] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi046.hxdqyf{1:34360} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.46:6828/3766079152,v1:172.21.15.46:6829/3766079152] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout:[mds.cephfs.smithi176.whwfab{1:44335} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.176:6826/1090771457,v1:172.21.15.176:6827/1090771457] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:21.618 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 39 2024-09-21T13:13:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.616+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fce2007af30 msgr2=0x7fce2007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:21.619 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fce2007af30 0x7fce2007d3f0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fce24009430 tx=0x7fce2403a040 comp rx=0 tx=0).stop 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 msgr2=0x7fce3419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 0x7fce3419fd10 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fce1c00d6f0 tx=0x7fce1c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 shutdown_connections 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fce2007af30 0x7fce2007d3f0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fce34103470 0x7fce3419fd10 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 --2- 172.21.15.46:0/3382106117 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce34102b50 0x7fce3419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 >> 172.21.15.46:0/3382106117 conn(0x7fce340fc550 msgr2=0x7fce34100bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 shutdown_connections 2024-09-21T13:13:21.620 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:21.617+0000 7fce398b6640 1 -- 172.21.15.46:0/3382106117 wait complete. 2024-09-21T13:13:22.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:21 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3382106117' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:13:22.279 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-21T13:13:22.292 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T13:13:22.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:21 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3382106117' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T13:13:22.553 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:23.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 -- 172.21.15.46:0/561106682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 msgr2=0x7f00e4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:23.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/561106682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e4101d60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009880 tx=0x7f00d402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.052 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 -- 172.21.15.46:0/561106682 shutdown_connections 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/561106682 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e4101d60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/561106682 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 0x7f00e4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 -- 172.21.15.46:0/561106682 >> 172.21.15.46:0/561106682 conn(0x7f00e40fd600 msgr2=0x7f00e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 -- 172.21.15.46:0/561106682 shutdown_connections 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.034+0000 7f00ec7c8640 1 -- 172.21.15.46:0/561106682 wait complete. 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ec7c8640 1 Processor -- start 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ec7c8640 1 -- start start 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ec7c8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ec7c8640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 0x7f00e419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ec7c8640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f00e410ee30 con 0x7f00e4101900 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ec7c8640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f00e410ecb0 con 0x7f00e4107900 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:23.053 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e419d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34816/0 (socket says 172.21.15.46:34816) 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 -- 172.21.15.46:0/3577804643 learned_addr learned my addr 172.21.15.46:0/3577804643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00e9d63640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 0x7f00e419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 -- 172.21.15.46:0/3577804643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 msgr2=0x7f00e419dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 0x7f00e419dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 -- 172.21.15.46:0/3577804643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e4197840 con 0x7f00e4101900 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00e9d63640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 0x7f00e419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.035+0000 7f00ea564640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e419d6c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b420 tx=0x7f00e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.036+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00e0011630 con 0x7f00e4101900 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.036+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e4197b30 con 0x7f00e4101900 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.036+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f00e0016070 con 0x7f00e4101900 2024-09-21T13:13:23.054 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.036+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f00e0010d40 con 0x7f00e4101900 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.036+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e4198090 con 0x7f00e4101900 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.037+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e4103040 con 0x7f00e4101900 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.037+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f00e001b460 con 0x7f00e4101900 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.038+0000 7f00db7fe640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00d007af30 0x7f00d007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.038+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f00e009d7f0 con 0x7f00e4101900 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.038+0000 7f00e9d63640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00d007af30 0x7f00d007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.038+0000 7f00e9d63640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00d007af30 0x7f00d007d3f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f00e4198b90 tx=0x7f00d4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:23.055 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.042+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f00e0068d40 con 0x7f00e4101900 2024-09-21T13:13:23.269 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.268+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00e4109e90 con 0x7f00e4101900 2024-09-21T13:13:23.270 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:22 smithi046 ceph-mon[108126]: pgmap v808: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-21T13:13:23.270 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.269+0000 7f00db7fe640 1 -- 172.21.15.46:0/3577804643 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5364 (secure 0 0 0) 0x7f00e006dbf0 con 0x7f00e4101900 2024-09-21T13:13:23.270 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:23.270 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":39,"btime":"2024-09-21T13:11:36:892326+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:35.987881+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:active","state_seq":244,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:active","state_seq":239,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44303":{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44335":{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34328,"qdb_cluster":[34328,34360]},"id":1}]} 2024-09-21T13:13:23.271 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 39 2024-09-21T13:13:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00d007af30 msgr2=0x7f00d007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:23.272 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00d007af30 0x7f00d007d3f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f00e4198b90 tx=0x7f00d4031400 comp rx=0 tx=0).stop 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 msgr2=0x7f00e419d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e419d6c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b420 tx=0x7f00e000b8e0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 shutdown_connections 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f00d007af30 0x7f00d007d3f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f00e4107900 0x7f00e419dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 --2- 172.21.15.46:0/3577804643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f00e4101900 0x7f00e419d6c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 >> 172.21.15.46:0/3577804643 conn(0x7f00e40fd600 msgr2=0x7f00e40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 shutdown_connections 2024-09-21T13:13:23.273 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:23.271+0000 7f00ec7c8640 1 -- 172.21.15.46:0/3577804643 wait complete. 2024-09-21T13:13:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:22 smithi176 ceph-mon[80162]: pgmap v808: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-21T13:13:23.911 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 20, 'max_mds': 2, 'flags': 50} 2024-09-21T13:13:23.911 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 21 2024-09-21T13:13:24.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:23 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3577804643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T13:13:24.172 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:24.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:23 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3577804643' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T13:13:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 -- 172.21.15.46:0/182960315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec102ac0 msgr2=0x7f89ec102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 --2- 172.21.15.46:0/182960315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec102ac0 0x7f89ec102ea0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f89dc009880 tx=0x7f89dc02a530 comp rx=0 tx=0).stop 2024-09-21T13:13:24.611 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 -- 172.21.15.46:0/182960315 shutdown_connections 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 --2- 172.21.15.46:0/182960315 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec1033e0 0x7f89ec10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 --2- 172.21.15.46:0/182960315 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec102ac0 0x7f89ec102ea0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 -- 172.21.15.46:0/182960315 >> 172.21.15.46:0/182960315 conn(0x7f89ec0fc520 msgr2=0x7f89ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 -- 172.21.15.46:0/182960315 shutdown_connections 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.608+0000 7f89f25bd640 1 -- 172.21.15.46:0/182960315 wait complete. 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89f25bd640 1 Processor -- start 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89f25bd640 1 -- start start 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89f25bd640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec102ac0 0x7f89ec100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89f25bd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 0x7f89ec100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89f25bd640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec10ee50 con 0x7f89ec1033e0 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89f25bd640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f89ec10ecd0 con 0x7f89ec102ac0 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89eb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 0x7f89ec100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:24.612 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89eb7fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 0x7f89ec100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34836/0 (socket says 172.21.15.46:34836) 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.609+0000 7f89eb7fe640 1 -- 172.21.15.46:0/2166541390 learned_addr learned my addr 172.21.15.46:0/2166541390 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89ebfff640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec102ac0 0x7f89ec100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89eb7fe640 1 -- 172.21.15.46:0/2166541390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec102ac0 msgr2=0x7f89ec100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89eb7fe640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec102ac0 0x7f89ec100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89eb7fe640 1 -- 172.21.15.46:0/2166541390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ec1011a0 con 0x7f89ec1033e0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89ebfff640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec102ac0 0x7f89ec100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89eb7fe640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 0x7f89ec100c60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f89e000b370 tx=0x7f89e000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89e0015020 con 0x7f89ec1033e0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f89e0011af0 con 0x7f89ec1033e0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ec101490 con 0x7f89ec1033e0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f89e0010d60 con 0x7f89ec1033e0 2024-09-21T13:13:24.613 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.610+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ec1a3f80 con 0x7f89ec1033e0 2024-09-21T13:13:24.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.611+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ec06aa90 con 0x7f89ec1033e0 2024-09-21T13:13:24.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.612+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f89e0018020 con 0x7f89ec1033e0 2024-09-21T13:13:24.614 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.613+0000 7f89e97fa640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89d407af80 0x7f89d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:24.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.613+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f89e009d9a0 con 0x7f89ec1033e0 2024-09-21T13:13:24.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.613+0000 7f89ebfff640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89d407af80 0x7f89d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:24.615 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.613+0000 7f89ebfff640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89d407af80 0x7f89d407d440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000c00 tx=0x7f89dc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:24.618 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.617+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f89e001f020 con 0x7f89ec1033e0 2024-09-21T13:13:24.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.844+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f89ec105f90 con 0x7f89ec1033e0 2024-09-21T13:13:24.845 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.844+0000 7f89e97fa640 1 -- 172.21.15.46:0/2166541390 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v39) ==== 107+0+3645 (secure 0 0 0) 0x7f89e0068f70 con 0x7f89ec1033e0 2024-09-21T13:13:24.846 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:24.846 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":21,"btime":"2024-09-21T12:55:13:707091+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:12.709244+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14570,"mds_1":24297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14570":{"gid":14570,"name":"cephfs.smithi046.hxdqyf","rank":0,"incarnation":15,"state":"up:active","state_seq":6,"addr":"172.21.15.46:6829/692972635","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":692972635},{"type":"v1","addr":"172.21.15.46:6829","nonce":692972635}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24297":{"gid":24297,"name":"cephfs.smithi176.kzzdid","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6825/1059739183","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1059739183},{"type":"v1","addr":"172.21.15.176:6825","nonce":1059739183}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14570,"qdb_cluster":[14570,24297]},"id":1}]} 2024-09-21T13:13:24.846 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 21 2024-09-21T13:13:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89d407af80 msgr2=0x7f89d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89d407af80 0x7f89d407d440 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f89dc000c00 tx=0x7f89dc031400 comp rx=0 tx=0).stop 2024-09-21T13:13:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 msgr2=0x7f89ec100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 0x7f89ec100c60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f89e000b370 tx=0x7f89e000b830 comp rx=0 tx=0).stop 2024-09-21T13:13:24.848 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 shutdown_connections 2024-09-21T13:13:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f89d407af80 0x7f89d407d440 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f89ec1033e0 0x7f89ec100c60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 --2- 172.21.15.46:0/2166541390 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89ec102ac0 0x7f89ec100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 >> 172.21.15.46:0/2166541390 conn(0x7f89ec0fc520 msgr2=0x7f89ec108eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 shutdown_connections 2024-09-21T13:13:24.849 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:24.847+0000 7f89f25bd640 1 -- 172.21.15.46:0/2166541390 wait complete. 2024-09-21T13:13:25.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:24 smithi176 ceph-mon[80162]: pgmap v809: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T13:13:25.317 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:24 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2166541390' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T13:13:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:24 smithi046 ceph-mon[108126]: pgmap v809: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-21T13:13:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:24 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2166541390' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T13:13:25.556 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-09-21T13:13:25.556 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 22 2024-09-21T13:13:25.819 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 -- 172.21.15.46:0/1704595493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0107900 msgr2=0x7f45a0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 --2- 172.21.15.46:0/1704595493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0107900 0x7f45a0107ce0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4590009880 tx=0x7f459002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.261 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 -- 172.21.15.46:0/1704595493 shutdown_connections 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 --2- 172.21.15.46:0/1704595493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a0101900 0x7f45a0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 --2- 172.21.15.46:0/1704595493 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0107900 0x7f45a0107ce0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 -- 172.21.15.46:0/1704595493 >> 172.21.15.46:0/1704595493 conn(0x7f45a00fd600 msgr2=0x7f45a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 -- 172.21.15.46:0/1704595493 shutdown_connections 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.258+0000 7f45a680c640 1 -- 172.21.15.46:0/1704595493 wait complete. 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f45a680c640 1 Processor -- start 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f45a680c640 1 -- start start 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f45a680c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 0x7f45a019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f45a680c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a0107900 0x7f45a019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f45a680c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010ee30 con 0x7f45a0101900 2024-09-21T13:13:26.262 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f45a680c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010ecb0 con 0x7f45a0107900 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.259+0000 7f459ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 0x7f45a019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 0x7f45a019d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:34854/0 (socket says 172.21.15.46:34854) 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459ffff640 1 -- 172.21.15.46:0/261975821 learned_addr learned my addr 172.21.15.46:0/261975821 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459f7fe640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a0107900 0x7f45a019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459ffff640 1 -- 172.21.15.46:0/261975821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a0107900 msgr2=0x7f45a019dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459ffff640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a0107900 0x7f45a019dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459ffff640 1 -- 172.21.15.46:0/261975821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a0197810 con 0x7f45a0101900 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459ffff640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 0x7f45a019d690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4590031460 tx=0x7f45900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f459003f070 con 0x7f45a0101900 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4590004cf0 con 0x7f45a0101900 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a0197aa0 con 0x7f45a0101900 2024-09-21T13:13:26.263 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4590035030 con 0x7f45a0101900 2024-09-21T13:13:26.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.260+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a0197fd0 con 0x7f45a0101900 2024-09-21T13:13:26.264 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.261+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a0103040 con 0x7f45a0101900 2024-09-21T13:13:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.262+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f4590042070 con 0x7f45a0101900 2024-09-21T13:13:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.263+0000 7f459d7fa640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f458807af30 0x7f458807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.263+0000 7f459f7fe640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f458807af30 0x7f458807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.263+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f45900be870 con 0x7f45a0101900 2024-09-21T13:13:26.265 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.263+0000 7f459f7fe640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f458807af30 0x7f458807d3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45a00ffc50 tx=0x7f4594008040 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:26.268 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.267+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4590089dc0 con 0x7f45a0101900 2024-09-21T13:13:26.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.515+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f45a0198d40 con 0x7f45a0101900 2024-09-21T13:13:26.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.515+0000 7f459d7fa640 1 -- 172.21.15.46:0/261975821 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v39) ==== 107+0+3612 (secure 0 0 0) 0x7f459008ec70 con 0x7f45a0101900 2024-09-21T13:13:26.517 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:26.517 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":22,"btime":"2024-09-21T12:55:13:816528+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34316,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3641180421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3641180421},{"type":"v1","addr":"172.21.15.46:6827","nonce":3641180421}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:26.517 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 22 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f458807af30 msgr2=0x7f458807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f458807af30 0x7f458807d3f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45a00ffc50 tx=0x7f4594008040 comp rx=0 tx=0).stop 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 msgr2=0x7f45a019d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 0x7f45a019d690 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4590031460 tx=0x7f45900048f0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 shutdown_connections 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f458807af30 0x7f458807d3f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45a0107900 0x7f45a019dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.519 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 --2- 172.21.15.46:0/261975821 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45a0101900 0x7f45a019d690 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:26.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 >> 172.21.15.46:0/261975821 conn(0x7f45a00fd600 msgr2=0x7f45a00fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:26.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 shutdown_connections 2024-09-21T13:13:26.520 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:26.518+0000 7f45a680c640 1 -- 172.21.15.46:0/261975821 wait complete. 2024-09-21T13:13:27.157 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:27.157 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-09-21T13:13:27.158 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 23 2024-09-21T13:13:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:26 smithi176 ceph-mon[80162]: pgmap v810: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T13:13:27.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:26 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/261975821' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T13:13:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:26 smithi046 ceph-mon[108126]: pgmap v810: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-21T13:13:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:26 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/261975821' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T13:13:27.418 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:27.898 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 -- 172.21.15.46:0/44457281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 msgr2=0x7f15d0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 --2- 172.21.15.46:0/44457281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d0100c60 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f15b8009880 tx=0x7f15b802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 -- 172.21.15.46:0/44457281 shutdown_connections 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 --2- 172.21.15.46:0/44457281 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d0100c60 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 --2- 172.21.15.46:0/44457281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 0x7f15d0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 -- 172.21.15.46:0/44457281 >> 172.21.15.46:0/44457281 conn(0x7f15d00fc520 msgr2=0x7f15d00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 -- 172.21.15.46:0/44457281 shutdown_connections 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.890+0000 7f15d71f0640 1 -- 172.21.15.46:0/44457281 wait complete. 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d71f0640 1 Processor -- start 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d71f0640 1 -- start start 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d71f0640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d71f0640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 0x7f15d019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:27.899 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d71f0640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f15d010dcd0 con 0x7f15d0100800 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d71f0640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f15d010db50 con 0x7f15d0106800 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d4f8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d4f8c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60514/0 (socket says 172.21.15.46:60514) 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15d4f8c640 1 -- 172.21.15.46:0/3388443382 learned_addr learned my addr 172.21.15.46:0/3388443382 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.891+0000 7f15cffff640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 0x7f15d019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15d4f8c640 1 -- 172.21.15.46:0/3388443382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 msgr2=0x7f15d019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15d4f8c640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 0x7f15d019dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15d4f8c640 1 -- 172.21.15.46:0/3388443382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d01977f0 con 0x7f15d0100800 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15cffff640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 0x7f15d019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15d4f8c640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d019d670 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c8f0 tx=0x7f15c000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15c00079b0 con 0x7f15d0100800 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f15c00054e0 con 0x7f15d0100800 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d0197ae0 con 0x7f15d0100800 2024-09-21T13:13:27.900 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f15c0004dd0 con 0x7f15d0100800 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.892+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d0198070 con 0x7f15d0100800 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.893+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d0101f40 con 0x7f15d0100800 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.894+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f15c0005020 con 0x7f15d0100800 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.894+0000 7f15cdffb640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15bc07af30 0x7f15bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.894+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f15c009df50 con 0x7f15d0100800 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.894+0000 7f15cffff640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15bc07af30 0x7f15bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.895+0000 7f15cffff640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15bc07af30 0x7f15bc07d3f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f15b8031460 tx=0x7f15b80095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:27.901 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:27.899+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15c0014030 con 0x7f15d0100800 2024-09-21T13:13:28.129 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.128+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7f15d0109d80 con 0x7f15d0100800 2024-09-21T13:13:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.129+0000 7f15cdffb640 1 -- 172.21.15.46:0/3388443382 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v39) ==== 107+0+5309 (secure 0 0 0) 0x7f15c0069520 con 0x7f15d0100800 2024-09-21T13:13:28.130 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:28.130 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":23,"btime":"2024-09-21T12:55:14:818320+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34316,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3641180421","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3641180421},{"type":"v1","addr":"172.21.15.46:6827","nonce":3641180421}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":34324,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1628549881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1628549881},{"type":"v1","addr":"172.21.15.46:6829","nonce":1628549881}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44273,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/2758440754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2758440754},{"type":"v1","addr":"172.21.15.176:6825","nonce":2758440754}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:28.130 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 23 2024-09-21T13:13:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15bc07af30 msgr2=0x7f15bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15bc07af30 0x7f15bc07d3f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f15b8031460 tx=0x7f15b80095f0 comp rx=0 tx=0).stop 2024-09-21T13:13:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 msgr2=0x7f15d019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d019d670 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f15c000c8f0 tx=0x7f15c000cdb0 comp rx=0 tx=0).stop 2024-09-21T13:13:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 shutdown_connections 2024-09-21T13:13:28.132 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f15bc07af30 0x7f15bc07d3f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f15d0106800 0x7f15d019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 --2- 172.21.15.46:0/3388443382 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f15d0100800 0x7f15d019d670 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 >> 172.21.15.46:0/3388443382 conn(0x7f15d00fc520 msgr2=0x7f15d006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 shutdown_connections 2024-09-21T13:13:28.133 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:28.131+0000 7f15d71f0640 1 -- 172.21.15.46:0/3388443382 wait complete. 2024-09-21T13:13:28.914 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:28.915 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-09-21T13:13:28.915 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 24 2024-09-21T13:13:29.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:28 smithi046 ceph-mon[108126]: pgmap v811: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T13:13:29.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:28 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3388443382' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T13:13:29.186 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:28 smithi176 ceph-mon[80162]: pgmap v811: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-21T13:13:29.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:28 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3388443382' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T13:13:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 -- 172.21.15.46:0/452190341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 msgr2=0x7f6cf0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/452190341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf0106be0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009880 tx=0x7f6ce002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.689 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 -- 172.21.15.46:0/452190341 shutdown_connections 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/452190341 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 0x7f6cf0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/452190341 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf0106be0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 -- 172.21.15.46:0/452190341 >> 172.21.15.46:0/452190341 conn(0x7f6cf00fc520 msgr2=0x7f6cf00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 -- 172.21.15.46:0/452190341 shutdown_connections 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 -- 172.21.15.46:0/452190341 wait complete. 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.681+0000 7f6cf61b2640 1 Processor -- start 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cf61b2640 1 -- start start 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cf61b2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 0x7f6cf019f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cf61b2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf019fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cf61b2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010dcd0 con 0x7f6cf0106800 2024-09-21T13:13:29.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cf61b2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf010db50 con 0x7f6cf0100800 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf019fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf019fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60526/0 (socket says 172.21.15.46:60526) 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 -- 172.21.15.46:0/33392706 learned_addr learned my addr 172.21.15.46:0/33392706 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cef7fe640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 0x7f6cf019f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 -- 172.21.15.46:0/33392706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 msgr2=0x7f6cf019f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 0x7f6cf019f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 -- 172.21.15.46:0/33392706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf01999a0 con 0x7f6cf0106800 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6cef7fe640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 0x7f6cf019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.682+0000 7f6ceeffd640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf019fd20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d6f0 tx=0x7f6ce400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.683+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ce4017070 con 0x7f6cf0106800 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.683+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ce400de00 con 0x7f6cf0106800 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.683+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf0199c90 con 0x7f6cf0106800 2024-09-21T13:13:29.691 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.683+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ce4004bb0 con 0x7f6cf0106800 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.683+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf019a220 con 0x7f6cf0106800 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.684+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf0101f40 con 0x7f6cf0106800 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.684+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6ce4009a30 con 0x7f6cf0106800 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.685+0000 7f6cecff9640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6cd807af30 0x7f6cd807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.685+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6ce409dd10 con 0x7f6cf0106800 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.685+0000 7f6cef7fe640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6cd807af30 0x7f6cd807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.685+0000 7f6cef7fe640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6cd807af30 0x7f6cd807d3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0006010 tx=0x7f6ce0004140 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:29.692 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.689+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ce4069260 con 0x7f6cf0106800 2024-09-21T13:13:29.915 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.914+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f6cf019afb0 con 0x7f6cf0106800 2024-09-21T13:13:29.916 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.915+0000 7f6cecff9640 1 -- 172.21.15.46:0/33392706 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v39) ==== 107+0+4462 (secure 0 0 0) 0x7f6cf019afb0 con 0x7f6cf0106800 2024-09-21T13:13:29.916 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:29.917 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":24,"btime":"2024-09-21T12:55:17:288658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1628549881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1628549881},{"type":"v1","addr":"172.21.15.46:6829","nonce":1628549881}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44273,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/2758440754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2758440754},{"type":"v1","addr":"172.21.15.176:6825","nonce":2758440754}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:29.917 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 24 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6cd807af30 msgr2=0x7f6cd807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6cd807af30 0x7f6cd807d3f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0006010 tx=0x7f6ce0004140 comp rx=0 tx=0).stop 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 msgr2=0x7f6cf019fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf019fd20 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400d6f0 tx=0x7f6ce400dbb0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 shutdown_connections 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6cd807af30 0x7f6cd807d3f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6cf0106800 0x7f6cf019fd20 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 --2- 172.21.15.46:0/33392706 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6cf0100800 0x7f6cf019f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 >> 172.21.15.46:0/33392706 conn(0x7f6cf00fc520 msgr2=0x7f6cf00fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 shutdown_connections 2024-09-21T13:13:29.919 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:29.917+0000 7f6cf61b2640 1 -- 172.21.15.46:0/33392706 wait complete. 2024-09-21T13:13:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:29 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:30.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:29 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/33392706' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T13:13:30.243 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:29 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:30.243 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:29 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/33392706' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T13:13:30.581 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:30.581 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-21T13:13:30.581 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 25 2024-09-21T13:13:30.842 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:31.221 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:30 smithi046 ceph-mon[108126]: pgmap v812: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.303+0000 7f91e931b640 1 -- 172.21.15.46:0/3693538889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 msgr2=0x7f91e4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:31.313 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.303+0000 7f91e931b640 1 --2- 172.21.15.46:0/3693538889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e4101d60 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009880 tx=0x7f91cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.303+0000 7f91e931b640 1 -- 172.21.15.46:0/3693538889 shutdown_connections 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 --2- 172.21.15.46:0/3693538889 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e4101d60 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 --2- 172.21.15.46:0/3693538889 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 0x7f91e4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 -- 172.21.15.46:0/3693538889 >> 172.21.15.46:0/3693538889 conn(0x7f91e40fd600 msgr2=0x7f91e40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 -- 172.21.15.46:0/3693538889 shutdown_connections 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 -- 172.21.15.46:0/3693538889 wait complete. 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 Processor -- start 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 -- start start 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 0x7f91e419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f91e410edb0 con 0x7f91e4101900 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.304+0000 7f91e931b640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f91e410ec30 con 0x7f91e4107900 2024-09-21T13:13:31.314 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60550/0 (socket says 172.21.15.46:60550) 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 -- 172.21.15.46:0/516059174 learned_addr learned my addr 172.21.15.46:0/516059174 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91dbfff640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 0x7f91e419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 -- 172.21.15.46:0/516059174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 msgr2=0x7f91e419db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 0x7f91e419db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 -- 172.21.15.46:0/516059174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e41977d0 con 0x7f91e4101900 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91dbfff640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 0x7f91e419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e2ffd640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e419d650 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f91d400d8d0 tx=0x7f91d400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91d4017070 con 0x7f91e4101900 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f91d4010460 con 0x7f91e4101900 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e4197ac0 con 0x7f91e4101900 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f91d400f5f0 con 0x7f91e4101900 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.305+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e4198020 con 0x7f91e4101900 2024-09-21T13:13:31.315 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.306+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e4103040 con 0x7f91e4101900 2024-09-21T13:13:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.307+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f91d4009a30 con 0x7f91e4101900 2024-09-21T13:13:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.307+0000 7f91e0ff9640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f91d007af80 0x7f91d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.308+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f91d409dea0 con 0x7f91e4101900 2024-09-21T13:13:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.308+0000 7f91dbfff640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f91d007af80 0x7f91d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.308+0000 7f91dbfff640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f91d007af80 0x7f91d007d440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91e4198b20 tx=0x7f91cc031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:31.316 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.312+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f91d4069470 con 0x7f91e4101900 2024-09-21T13:13:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:30 smithi176 ceph-mon[80162]: pgmap v812: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:31.538 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.537+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7f91e4109e90 con 0x7f91e4101900 2024-09-21T13:13:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.538+0000 7f91e0ff9640 1 -- 172.21.15.46:0/516059174 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v39) ==== 107+0+5309 (secure 0 0 0) 0x7f91d406e320 con 0x7f91e4101900 2024-09-21T13:13:31.539 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:31.539 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":25,"btime":"2024-09-21T12:55:23:352032+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34324,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/1628549881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":1628549881},{"type":"v1","addr":"172.21.15.46:6829","nonce":1628549881}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23},{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44273,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/2758440754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2758440754},{"type":"v1","addr":"172.21.15.176:6825","nonce":2758440754}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:31.539 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 25 2024-09-21T13:13:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f91d007af80 msgr2=0x7f91d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f91d007af80 0x7f91d007d440 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f91e4198b20 tx=0x7f91cc031400 comp rx=0 tx=0).stop 2024-09-21T13:13:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 msgr2=0x7f91e419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:31.542 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e419d650 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f91d400d8d0 tx=0x7f91d400dd90 comp rx=0 tx=0).stop 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 shutdown_connections 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f91d007af80 0x7f91d007d440 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4107900 0x7f91e419db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 --2- 172.21.15.46:0/516059174 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f91e4101900 0x7f91e419d650 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.540+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 >> 172.21.15.46:0/516059174 conn(0x7f91e40fd600 msgr2=0x7f91e40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.541+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 shutdown_connections 2024-09-21T13:13:31.543 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:31.541+0000 7f91e931b640 1 -- 172.21.15.46:0/516059174 wait complete. 2024-09-21T13:13:32.142 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:31 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/516059174' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T13:13:32.172 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:32.172 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-21T13:13:32.172 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 26 2024-09-21T13:13:32.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:32 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/516059174' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T13:13:32.432 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.885+0000 7fa25b41c640 1 -- 172.21.15.46:0/2030998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 msgr2=0x7fa254102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.885+0000 7fa25b41c640 1 --2- 172.21.15.46:0/2030998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa254102f30 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa244009880 tx=0x7fa24402a530 comp rx=0 tx=0).stop 2024-09-21T13:13:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 -- 172.21.15.46:0/2030998242 shutdown_connections 2024-09-21T13:13:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 --2- 172.21.15.46:0/2030998242 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 0x7fa25410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:32.903 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 --2- 172.21.15.46:0/2030998242 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa254102f30 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 -- 172.21.15.46:0/2030998242 >> 172.21.15.46:0/2030998242 conn(0x7fa2540fc550 msgr2=0x7fa2540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 -- 172.21.15.46:0/2030998242 shutdown_connections 2024-09-21T13:13:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 -- 172.21.15.46:0/2030998242 wait complete. 2024-09-21T13:13:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 Processor -- start 2024-09-21T13:13:32.904 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 -- start start 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa2541007b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.886+0000 7fa25b41c640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 0x7fa254100cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa25b41c640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa25410edc0 con 0x7fa254102b50 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa25b41c640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa25410ec40 con 0x7fa254103470 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa2541007b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa2541007b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60572/0 (socket says 172.21.15.46:60572) 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 -- 172.21.15.46:0/3773429631 learned_addr learned my addr 172.21.15.46:0/3773429631 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2589b7640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 0x7fa254100cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 -- 172.21.15.46:0/3773429631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 msgr2=0x7fa254100cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 0x7fa254100cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 -- 172.21.15.46:0/3773429631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa254101230 con 0x7fa254102b50 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2589b7640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 0x7fa254100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2591b8640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa2541007b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa244004f90 tx=0x7fa2440048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa24403f070 con 0x7fa254102b50 2024-09-21T13:13:32.905 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa244004cf0 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa244035030 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2541014c0 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.887+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2541a3d20 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.888+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa25406a4e0 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.889+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa244042070 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.889+0000 7fa2527fc640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa23c07af30 0x7fa23c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.890+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa2440beb60 con 0x7fa254102b50 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.890+0000 7fa2589b7640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa23c07af30 0x7fa23c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.890+0000 7fa2589b7640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa23c07af30 0x7fa23c07d3f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa254102240 tx=0x7fa248007850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:32.906 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:32.894+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa24408a0b0 con 0x7fa254102b50 2024-09-21T13:13:33.121 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:33 smithi046 ceph-mon[108126]: pgmap v813: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:33.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.122+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7fa254105fb0 con 0x7fa254102b50 2024-09-21T13:13:33.123 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.122+0000 7fa2527fc640 1 -- 172.21.15.46:0/3773429631 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v39) ==== 107+0+4462 (secure 0 0 0) 0x7fa24408ef60 con 0x7fa254102b50 2024-09-21T13:13:33.124 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:33.124 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":26,"btime":"2024-09-21T12:55:35:169433+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44273,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/2758440754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2758440754},{"type":"v1","addr":"172.21.15.176:6825","nonce":2758440754}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:33.124 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 26 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa23c07af30 msgr2=0x7fa23c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa23c07af30 0x7fa23c07d3f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa254102240 tx=0x7fa248007850 comp rx=0 tx=0).stop 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 msgr2=0x7fa2541007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa2541007b0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fa244004f90 tx=0x7fa2440048f0 comp rx=0 tx=0).stop 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 shutdown_connections 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa23c07af30 0x7fa23c07d3f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa254103470 0x7fa254100cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 --2- 172.21.15.46:0/3773429631 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa254102b50 0x7fa2541007b0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 >> 172.21.15.46:0/3773429631 conn(0x7fa2540fc550 msgr2=0x7fa254108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 shutdown_connections 2024-09-21T13:13:33.126 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:33.125+0000 7fa25b41c640 1 -- 172.21.15.46:0/3773429631 wait complete. 2024-09-21T13:13:33.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:33 smithi176 ceph-mon[80162]: pgmap v813: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:33.727 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:33.727 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-21T13:13:33.728 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 27 2024-09-21T13:13:33.987 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:34.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:34 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3773429631' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T13:13:34.369 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:34 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3773429631' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T13:13:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/3647272259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc107900 msgr2=0x7fb3dc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/3647272259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc107900 0x7fb3dc107ce0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009880 tx=0x7fb3cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/3647272259 shutdown_connections 2024-09-21T13:13:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/3647272259 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc101900 0x7fb3dc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/3647272259 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc107900 0x7fb3dc107ce0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.469 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/3647272259 >> 172.21.15.46:0/3647272259 conn(0x7fb3dc0fd600 msgr2=0x7fb3dc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/3647272259 shutdown_connections 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.451+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/3647272259 wait complete. 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.452+0000 7fb3e0eb2640 1 Processor -- start 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.452+0000 7fb3e0eb2640 1 -- start start 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.452+0000 7fb3e0eb2640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 0x7fb3dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.452+0000 7fb3e0eb2640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc107900 0x7fb3dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.452+0000 7fb3e0eb2640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc10edd0 con 0x7fb3dc101900 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.452+0000 7fb3e0eb2640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fb3dc10ec50 con 0x7fb3dc107900 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 0x7fb3dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 0x7fb3dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60582/0 (socket says 172.21.15.46:60582) 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 -- 172.21.15.46:0/2695808920 learned_addr learned my addr 172.21.15.46:0/2695808920 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3d9d9b640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc107900 0x7fb3dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:34.470 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 -- 172.21.15.46:0/2695808920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc107900 msgr2=0x7fb3dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc107900 0x7fb3dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 -- 172.21.15.46:0/2695808920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3dc074f70 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3d9d9b640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc107900 0x7fb3dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3da59c640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 0x7fb3dc0744f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc031460 tx=0x7fb3cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3cc03f070 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3dc075200 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3cc0035f0 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3cc035030 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.453+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3dc1a3d80 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.455+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3dc103040 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.455+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fb3cc042070 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.456+0000 7fb3cb7fe640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb3c407af30 0x7fb3c407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.456+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fb3cc0bead0 con 0x7fb3dc101900 2024-09-21T13:13:34.471 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.456+0000 7fb3d9d9b640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb3c407af30 0x7fb3c407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:34.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.456+0000 7fb3d9d9b640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb3c407af30 0x7fb3c407d3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00058c0 tx=0x7fb3d0005850 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:34.472 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.460+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3cc08a020 con 0x7fb3dc101900 2024-09-21T13:13:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.689+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7fb3dc109e70 con 0x7fb3dc101900 2024-09-21T13:13:34.690 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.689+0000 7fb3cb7fe640 1 -- 172.21.15.46:0/2695808920 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v39) ==== 107+0+5309 (secure 0 0 0) 0x7fb3cc08c020 con 0x7fb3dc101900 2024-09-21T13:13:34.691 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:34.691 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":27,"btime":"2024-09-21T12:55:40:185771+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44273,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/2758440754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":2758440754},{"type":"v1","addr":"172.21.15.176:6825","nonce":2758440754}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:34.691 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 27 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb3c407af30 msgr2=0x7fb3c407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb3c407af30 0x7fb3c407d3f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb3d00058c0 tx=0x7fb3d0005850 comp rx=0 tx=0).stop 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 msgr2=0x7fb3dc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 0x7fb3dc0744f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc031460 tx=0x7fb3cc0045e0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 shutdown_connections 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fb3c407af30 0x7fb3c407d3f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb3dc107900 0x7fb3dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.693 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 --2- 172.21.15.46:0/2695808920 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fb3dc101900 0x7fb3dc0744f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:34.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 >> 172.21.15.46:0/2695808920 conn(0x7fb3dc0fd600 msgr2=0x7fb3dc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:34.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 shutdown_connections 2024-09-21T13:13:34.694 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:34.692+0000 7fb3e0eb2640 1 -- 172.21.15.46:0/2695808920 wait complete. 2024-09-21T13:13:35.256 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:35 smithi046 ceph-mon[108126]: pgmap v814: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:35.257 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:35 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2695808920' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T13:13:35.286 DEBUG:tasks.fs:max_mds not reduced in epoch 27 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:35.286 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-21T13:13:35.287 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 28 2024-09-21T13:13:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:35 smithi176 ceph-mon[80162]: pgmap v814: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:35.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:35 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2695808920' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T13:13:35.548 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 -- 172.21.15.46:0/1856804194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc101900 msgr2=0x7f2cfc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 --2- 172.21.15.46:0/1856804194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc101900 0x7f2cfc101d60 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f2cec009880 tx=0x7f2cec02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 -- 172.21.15.46:0/1856804194 shutdown_connections 2024-09-21T13:13:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 --2- 172.21.15.46:0/1856804194 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc101900 0x7f2cfc101d60 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 --2- 172.21.15.46:0/1856804194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cfc107900 0x7f2cfc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.018 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 -- 172.21.15.46:0/1856804194 >> 172.21.15.46:0/1856804194 conn(0x7f2cfc0fd600 msgr2=0x7f2cfc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 -- 172.21.15.46:0/1856804194 shutdown_connections 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 -- 172.21.15.46:0/1856804194 wait complete. 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.991+0000 7f2d0192e640 1 Processor -- start 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2d0192e640 1 -- start start 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2d0192e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cfc101900 0x7f2cfc1955a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2d0192e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 0x7f2cfc195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:36.019 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2d0192e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc10edb0 con 0x7f2cfc107900 2024-09-21T13:13:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2d0192e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc10ec30 con 0x7f2cfc101900 2024-09-21T13:13:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 0x7f2cfc195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 0x7f2cfc195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:60602/0 (socket says 172.21.15.46:60602) 2024-09-21T13:13:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 -- 172.21.15.46:0/3556460760 learned_addr learned my addr 172.21.15.46:0/3556460760 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:36.020 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfaffd640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cfc101900 0x7f2cfc1955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 -- 172.21.15.46:0/3556460760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cfc101900 msgr2=0x7f2cfc1955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cfc101900 0x7f2cfc1955a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 -- 172.21.15.46:0/3556460760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc196020 con 0x7f2cfc107900 2024-09-21T13:13:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.992+0000 7f2cfa7fc640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 0x7f2cfc195ae0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2cec031460 tx=0x7f2cec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:36.021 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.993+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cec03f070 con 0x7f2cfc107900 2024-09-21T13:13:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.993+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cec004cf0 con 0x7f2cfc107900 2024-09-21T13:13:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.993+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc1962b0 con 0x7f2cfc107900 2024-09-21T13:13:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.993+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cec035030 con 0x7f2cfc107900 2024-09-21T13:13:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.993+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc1a80e0 con 0x7f2cfc107900 2024-09-21T13:13:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.994+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc103040 con 0x7f2cfc107900 2024-09-21T13:13:36.022 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.994+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f2cec042070 con 0x7f2cfc107900 2024-09-21T13:13:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.995+0000 7f2d0092c640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2ce807af30 0x7f2ce807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.995+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f2cec0beb10 con 0x7f2cfc107900 2024-09-21T13:13:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.995+0000 7f2cfaffd640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2ce807af30 0x7f2ce807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.996+0000 7f2cfaffd640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2ce807af30 0x7f2ce807d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400abe0 tx=0x7f2ce400a2d0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:36.023 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:35.999+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cec08a000 con 0x7f2cfc107900 2024-09-21T13:13:36.225 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.224+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7f2cfc1a8310 con 0x7f2cfc107900 2024-09-21T13:13:36.226 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.224+0000 7f2d0092c640 1 -- 172.21.15.46:0/3556460760 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v39) ==== 107+0+4459 (secure 0 0 0) 0x7f2cec08eeb0 con 0x7f2cfc107900 2024-09-21T13:13:36.226 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:36.226 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":28,"btime":"2024-09-21T12:55:51:431853+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:36.227 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 28 2024-09-21T13:13:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2ce807af30 msgr2=0x7f2ce807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2ce807af30 0x7f2ce807d3f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400abe0 tx=0x7f2ce400a2d0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 msgr2=0x7f2cfc195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 0x7f2cfc195ae0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f2cec031460 tx=0x7f2cec0048f0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 shutdown_connections 2024-09-21T13:13:36.228 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f2ce807af30 0x7f2ce807d3f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2cfc107900 0x7f2cfc195ae0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 --2- 172.21.15.46:0/3556460760 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2cfc101900 0x7f2cfc1955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.226+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 >> 172.21.15.46:0/3556460760 conn(0x7f2cfc0fd600 msgr2=0x7f2cfc0fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.227+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 shutdown_connections 2024-09-21T13:13:36.229 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:36.227+0000 7f2d0192e640 1 -- 172.21.15.46:0/3556460760 wait complete. 2024-09-21T13:13:36.835 DEBUG:tasks.fs:max_mds not reduced in epoch 28 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:36.835 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-21T13:13:36.835 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 29 2024-09-21T13:13:37.097 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:37 smithi176 ceph-mon[80162]: pgmap v815: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:37.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:37 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3556460760' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T13:13:37.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:37 smithi046 ceph-mon[108126]: pgmap v815: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:37.344 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:37 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3556460760' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T13:13:37.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 -- 172.21.15.46:0/1596024836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 msgr2=0x7f2844101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:37.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 --2- 172.21.15.46:0/1596024836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f2844101d60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2838009880 tx=0x7f283802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 -- 172.21.15.46:0/1596024836 shutdown_connections 2024-09-21T13:13:37.575 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 --2- 172.21.15.46:0/1596024836 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f2844101d60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 --2- 172.21.15.46:0/1596024836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2844107900 0x7f2844107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 -- 172.21.15.46:0/1596024836 >> 172.21.15.46:0/1596024836 conn(0x7f28440fd600 msgr2=0x7f28440ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:37.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.566+0000 7f284bfac640 1 -- 172.21.15.46:0/1596024836 shutdown_connections 2024-09-21T13:13:37.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.567+0000 7f284bfac640 1 -- 172.21.15.46:0/1596024836 wait complete. 2024-09-21T13:13:37.576 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.567+0000 7f284bfac640 1 Processor -- start 2024-09-21T13:13:37.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.567+0000 7f284bfac640 1 -- start start 2024-09-21T13:13:37.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f284bfac640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f284419d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:37.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f284bfac640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2844107900 0x7f284419dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:37.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f284bfac640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f284410edd0 con 0x7f2844101900 2024-09-21T13:13:37.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f284bfac640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f284410ec50 con 0x7f2844107900 2024-09-21T13:13:37.577 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f284419d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:37.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f284419d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49868/0 (socket says 172.21.15.46:49868) 2024-09-21T13:13:37.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 -- 172.21.15.46:0/221137643 learned_addr learned my addr 172.21.15.46:0/221137643 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:37.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 -- 172.21.15.46:0/221137643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2844107900 msgr2=0x7f284419dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:37.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849547640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2844107900 0x7f284419dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:37.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2844107900 0x7f284419dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.578 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 -- 172.21.15.46:0/221137643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28441977e0 con 0x7f2844101900 2024-09-21T13:13:37.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2849d48640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f284419d660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f283c00d6f0 tx=0x7f283c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:37.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f283c017070 con 0x7f2844101900 2024-09-21T13:13:37.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f283c00de00 con 0x7f2844101900 2024-09-21T13:13:37.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2844197ad0 con 0x7f2844101900 2024-09-21T13:13:37.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f283c004bb0 con 0x7f2844101900 2024-09-21T13:13:37.579 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.568+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2844198060 con 0x7f2844101900 2024-09-21T13:13:37.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.570+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2844103040 con 0x7f2844101900 2024-09-21T13:13:37.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.570+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f283c009a30 con 0x7f2844101900 2024-09-21T13:13:37.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.571+0000 7f2842ffd640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f282c07af80 0x7f282c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:37.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.571+0000 7f2849547640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f282c07af80 0x7f282c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:37.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.571+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f283c09dc20 con 0x7f2844101900 2024-09-21T13:13:37.580 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.571+0000 7f2849547640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f282c07af80 0x7f282c07d440 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2838031460 tx=0x7f2838009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:37.581 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.576+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f283c0691f0 con 0x7f2844101900 2024-09-21T13:13:37.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.801+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f2844109e70 con 0x7f2844101900 2024-09-21T13:13:37.803 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.802+0000 7f2842ffd640 1 -- 172.21.15.46:0/221137643 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v39) ==== 107+0+5309 (secure 0 0 0) 0x7f283c06e0a0 con 0x7f2844101900 2024-09-21T13:13:37.804 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:37.804 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":29,"btime":"2024-09-21T12:55:55:441541+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44265,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/3440958805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":3440958805},{"type":"v1","addr":"172.21.15.176:6827","nonce":3440958805}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":22},{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:37.804 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 29 2024-09-21T13:13:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.804+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f282c07af80 msgr2=0x7f282c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:37.806 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.804+0000 7f284bfac640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f282c07af80 0x7f282c07d440 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f2838031460 tx=0x7f2838009560 comp rx=0 tx=0).stop 2024-09-21T13:13:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.804+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 msgr2=0x7f284419d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.804+0000 7f284bfac640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f284419d660 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f283c00d6f0 tx=0x7f283c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 shutdown_connections 2024-09-21T13:13:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f282c07af80 0x7f282c07d440 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2844107900 0x7f284419dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.807 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 --2- 172.21.15.46:0/221137643 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f2844101900 0x7f284419d660 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 >> 172.21.15.46:0/221137643 conn(0x7f28440fd600 msgr2=0x7f28440fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 shutdown_connections 2024-09-21T13:13:37.808 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:37.805+0000 7f284bfac640 1 -- 172.21.15.46:0/221137643 wait complete. 2024-09-21T13:13:38.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:38 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:13:38.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:38 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/221137643' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T13:13:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:38 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:13:38.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:38 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/221137643' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T13:13:38.495 DEBUG:tasks.fs:max_mds not reduced in epoch 29 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:38.495 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-21T13:13:38.495 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 30 2024-09-21T13:13:38.771 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:39.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:39 smithi046 ceph-mon[108126]: pgmap v816: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:39.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:13:39.144 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:13:39.145 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 -- 172.21.15.46:0/2262649245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 msgr2=0x7fdadc107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 --2- 172.21.15.46:0/2262649245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc107ce0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009880 tx=0x7fdad802a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 -- 172.21.15.46:0/2262649245 shutdown_connections 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 --2- 172.21.15.46:0/2262649245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc101900 0x7fdadc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 --2- 172.21.15.46:0/2262649245 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc107ce0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 -- 172.21.15.46:0/2262649245 >> 172.21.15.46:0/2262649245 conn(0x7fdadc0fd600 msgr2=0x7fdadc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 -- 172.21.15.46:0/2262649245 shutdown_connections 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 -- 172.21.15.46:0/2262649245 wait complete. 2024-09-21T13:13:39.249 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 Processor -- start 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.223+0000 7fdae4468640 1 -- start start 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae4468640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc101900 0x7fdadc19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae4468640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae4468640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc10edd0 con 0x7fdadc107900 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae4468640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc10ec50 con 0x7fdadc101900 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc19db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49886/0 (socket says 172.21.15.46:49886) 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 -- 172.21.15.46:0/3110616844 learned_addr learned my addr 172.21.15.46:0/3110616844 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae2204640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc101900 0x7fdadc19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 -- 172.21.15.46:0/3110616844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc101900 msgr2=0x7fdadc19d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc101900 0x7fdadc19d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 -- 172.21.15.46:0/3110616844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc1977c0 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdae1a03640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc19db80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00d6f0 tx=0x7fdacc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.224+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdacc017070 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.225+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc197ab0 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.225+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdacc00de00 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.225+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdacc004bb0 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.225+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc198040 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.226+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc103040 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.226+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdacc004e60 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.227+0000 7fdad37fe640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdac807af40 0x7fdac807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.227+0000 7fdae2204640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdac807af40 0x7fdac807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.227+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdacc09dc10 con 0x7fdadc107900 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.228+0000 7fdae2204640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdac807af40 0x7fdac807d400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdad80096c0 tx=0x7fdad8031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:39.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.232+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdacc069160 con 0x7fdadc107900 2024-09-21T13:13:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:39 smithi176 ceph-mon[80162]: pgmap v816: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:13:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:13:39.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:13:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.459+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7fdadc109e70 con 0x7fdadc107900 2024-09-21T13:13:39.460 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.459+0000 7fdad37fe640 1 -- 172.21.15.46:0/3110616844 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v39) ==== 107+0+4459 (secure 0 0 0) 0x7fdacc06e010 con 0x7fdadc107900 2024-09-21T13:13:39.461 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:39.461 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":30,"btime":"2024-09-21T12:56:05:251037+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:39.461 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 30 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdac807af40 msgr2=0x7fdac807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdac807af40 0x7fdac807d400 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fdad80096c0 tx=0x7fdad8031400 comp rx=0 tx=0).stop 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 msgr2=0x7fdadc19db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc19db80 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00d6f0 tx=0x7fdacc00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 shutdown_connections 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdac807af40 0x7fdac807d400 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdadc107900 0x7fdadc19db80 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.463 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 --2- 172.21.15.46:0/3110616844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdadc101900 0x7fdadc19d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:39.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 >> 172.21.15.46:0/3110616844 conn(0x7fdadc0fd600 msgr2=0x7fdadc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:39.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 shutdown_connections 2024-09-21T13:13:39.464 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:39.462+0000 7fdae4468640 1 -- 172.21.15.46:0/3110616844 wait complete. 2024-09-21T13:13:40.120 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:40 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3110616844' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T13:13:40.152 DEBUG:tasks.fs:max_mds not reduced in epoch 30 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:40.152 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-21T13:13:40.152 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 31 2024-09-21T13:13:40.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:40 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3110616844' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T13:13:40.419 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 -- 172.21.15.46:0/80613594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc101900 msgr2=0x7fa7cc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/80613594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc101900 0x7fa7cc101d60 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009880 tx=0x7fa7b402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 -- 172.21.15.46:0/80613594 shutdown_connections 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/80613594 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc101900 0x7fa7cc101d60 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/80613594 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7cc107900 0x7fa7cc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 -- 172.21.15.46:0/80613594 >> 172.21.15.46:0/80613594 conn(0x7fa7cc0fd600 msgr2=0x7fa7cc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:40.923 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 -- 172.21.15.46:0/80613594 shutdown_connections 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.905+0000 7fa7d25f4640 1 -- 172.21.15.46:0/80613594 wait complete. 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7d25f4640 1 Processor -- start 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7d25f4640 1 -- start start 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7d25f4640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7cc101900 0x7fa7cc19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7d25f4640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 0x7fa7cc19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7d25f4640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc10edb0 con 0x7fa7cc107900 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7d25f4640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc10ec30 con 0x7fa7cc101900 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 0x7fa7cc19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7c3fff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 0x7fa7cc19db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49908/0 (socket says 172.21.15.46:49908) 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.906+0000 7fa7c3fff640 1 -- 172.21.15.46:0/2382439907 learned_addr learned my addr 172.21.15.46:0/2382439907 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:40.924 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7cbfff640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7cc101900 0x7fa7cc19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c3fff640 1 -- 172.21.15.46:0/2382439907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7cc101900 msgr2=0x7fa7cc19d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c3fff640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7cc101900 0x7fa7cc19d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c3fff640 1 -- 172.21.15.46:0/2382439907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc1977d0 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c3fff640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 0x7fa7cc19db90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4031460 tx=0x7fa7b40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7b403f070 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc197a60 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7b40035f0 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa7b4035030 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.907+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc197f90 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.908+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7cc103040 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.909+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fa7b4042070 con 0x7fa7cc107900 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.910+0000 7fa7c9ffb640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7b807af30 0x7fa7b807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:40.925 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.910+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fa7b40bf180 con 0x7fa7cc107900 2024-09-21T13:13:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.910+0000 7fa7cbfff640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7b807af30 0x7fa7b807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.910+0000 7fa7cbfff640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7b807af30 0x7fa7b807d3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005fd0 tx=0x7fa7bc00b590 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:40.926 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:40.913+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7b408a6b0 con 0x7fa7cc107900 2024-09-21T13:13:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.138+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7fa7cc109e90 con 0x7fa7cc107900 2024-09-21T13:13:41.140 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:41 smithi046 ceph-mon[108126]: pgmap v817: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:41.140 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.139+0000 7fa7c9ffb640 1 -- 172.21.15.46:0/2382439907 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v39) ==== 107+0+5309 (secure 0 0 0) 0x7fa7b408f560 con 0x7fa7cc107900 2024-09-21T13:13:41.141 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:41.141 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":31,"btime":"2024-09-21T12:56:11:268861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":22,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T12:55:13.816524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:41.141 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 31 2024-09-21T13:13:41.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7b807af30 msgr2=0x7fa7b807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:41.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7b807af30 0x7fa7b807d3f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc005fd0 tx=0x7fa7bc00b590 comp rx=0 tx=0).stop 2024-09-21T13:13:41.142 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 msgr2=0x7fa7cc19db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 0x7fa7cc19db90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4031460 tx=0x7fa7b40045e0 comp rx=0 tx=0).stop 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 shutdown_connections 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fa7b807af30 0x7fa7b807d3f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fa7cc107900 0x7fa7cc19db90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 --2- 172.21.15.46:0/2382439907 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa7cc101900 0x7fa7cc19d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 >> 172.21.15.46:0/2382439907 conn(0x7fa7cc0fd600 msgr2=0x7fa7cc0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 shutdown_connections 2024-09-21T13:13:41.143 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:41.141+0000 7fa7d25f4640 1 -- 172.21.15.46:0/2382439907 wait complete. 2024-09-21T13:13:41.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:41 smithi176 ceph-mon[80162]: pgmap v817: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:41.743 DEBUG:tasks.fs:max_mds not reduced in epoch 31 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-09-21T13:13:41.743 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-21T13:13:41.743 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 32 2024-09-21T13:13:42.008 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:42.135 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:42 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2382439907' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T13:13:42.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:42 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2382439907' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T13:13:42.413 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 -- 172.21.15.46:0/4167655851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 msgr2=0x7f45bc10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/4167655851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc10b980 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f45b0009880 tx=0x7f45b002a530 comp rx=0 tx=0).stop 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 -- 172.21.15.46:0/4167655851 shutdown_connections 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/4167655851 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc10b980 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/4167655851 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45bc102b70 0x7f45bc102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 -- 172.21.15.46:0/4167655851 >> 172.21.15.46:0/4167655851 conn(0x7f45bc0fc550 msgr2=0x7f45bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 -- 172.21.15.46:0/4167655851 shutdown_connections 2024-09-21T13:13:42.414 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.412+0000 7f45c0ca5640 1 -- 172.21.15.46:0/4167655851 wait complete. 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.413+0000 7f45c0ca5640 1 Processor -- start 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.413+0000 7f45c0ca5640 1 -- start start 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.413+0000 7f45c0ca5640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45bc102b70 0x7f45bc1007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.413+0000 7f45c0ca5640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.413+0000 7f45c0ca5640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc10ede0 con 0x7f45bc103490 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.413+0000 7f45c0ca5640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f45bc10ec60 con 0x7f45bc102b70 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49936/0 (socket says 172.21.15.46:49936) 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 -- 172.21.15.46:0/3645691409 learned_addr learned my addr 172.21.15.46:0/3645691409 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:42.416 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45ba59c640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45bc102b70 0x7f45bc1007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 -- 172.21.15.46:0/3645691409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45bc102b70 msgr2=0x7f45bc1007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45bc102b70 0x7f45bc1007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 -- 172.21.15.46:0/3645691409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45bc101250 con 0x7f45bc103490 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45b9d9b640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc100d10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45b0004f90 tx=0x7f45b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45b003f070 con 0x7f45bc103490 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45bc1014e0 con 0x7f45bc103490 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f45b0004c70 con 0x7f45bc103490 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f45b0035030 con 0x7f45bc103490 2024-09-21T13:13:42.417 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.414+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45bc1a3d90 con 0x7f45bc103490 2024-09-21T13:13:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.416+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45bc06a4c0 con 0x7f45bc103490 2024-09-21T13:13:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.416+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f45b0042070 con 0x7f45bc103490 2024-09-21T13:13:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.417+0000 7f45ab7fe640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45a407af30 0x7f45a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.417+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f45b00bea30 con 0x7f45bc103490 2024-09-21T13:13:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.417+0000 7f45ba59c640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45a407af30 0x7f45a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:42.418 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.417+0000 7f45ba59c640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45a407af30 0x7f45a407d3f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f45ac005fd0 tx=0x7f45ac00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:42.422 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.421+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45b0089f80 con 0x7f45bc103490 2024-09-21T13:13:42.647 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.646+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7f45bc106000 con 0x7f45bc103490 2024-09-21T13:13:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.647+0000 7f45ab7fe640 1 -- 172.21.15.46:0/3645691409 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v39) ==== 107+0+5331 (secure 0 0 0) 0x7f45b008ee30 con 0x7f45bc103490 2024-09-21T13:13:42.648 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:42.648 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":32,"btime":"2024-09-21T13:11:10:887015+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:10.886999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:42.648 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 32 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45a407af30 msgr2=0x7f45a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45a407af30 0x7f45a407d3f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f45ac005fd0 tx=0x7f45ac00b390 comp rx=0 tx=0).stop 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 msgr2=0x7f45bc100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc100d10 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45b0004f90 tx=0x7f45b00048f0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 shutdown_connections 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f45a407af30 0x7f45a407d3f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f45bc103490 0x7f45bc100d10 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 --2- 172.21.15.46:0/3645691409 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45bc102b70 0x7f45bc1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 >> 172.21.15.46:0/3645691409 conn(0x7f45bc0fc550 msgr2=0x7f45bc103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 shutdown_connections 2024-09-21T13:13:42.651 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:42.649+0000 7f45c0ca5640 1 -- 172.21.15.46:0/3645691409 wait complete. 2024-09-21T13:13:43.300 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:43 smithi046 ceph-mon[108126]: pgmap v818: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:43.300 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:43 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/3645691409' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T13:13:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:43 smithi176 ceph-mon[80162]: pgmap v818: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:43.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:43 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/3645691409' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T13:13:43.334 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-21T13:13:43.335 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 33 2024-09-21T13:13:43.601 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 -- 172.21.15.46:0/331435334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84107900 msgr2=0x7f6d84107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 --2- 172.21.15.46:0/331435334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84107900 0x7f6d84107ce0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6d74009880 tx=0x7f6d7402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 -- 172.21.15.46:0/331435334 shutdown_connections 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 --2- 172.21.15.46:0/331435334 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d84101900 0x7f6d84101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 --2- 172.21.15.46:0/331435334 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84107900 0x7f6d84107ce0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 -- 172.21.15.46:0/331435334 >> 172.21.15.46:0/331435334 conn(0x7f6d840fd600 msgr2=0x7f6d840ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 -- 172.21.15.46:0/331435334 shutdown_connections 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.153+0000 7f6d8940e640 1 -- 172.21.15.46:0/331435334 wait complete. 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d8940e640 1 Processor -- start 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d8940e640 1 -- start start 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d8940e640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 0x7f6d840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:44.287 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d8940e640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d84107900 0x7f6d84074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d8940e640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8410edd0 con 0x7f6d84101900 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d8940e640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8410ec50 con 0x7f6d84107900 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 0x7f6d840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 0x7f6d840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49958/0 (socket says 172.21.15.46:49958) 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d82ffd640 1 -- 172.21.15.46:0/1622239084 learned_addr learned my addr 172.21.15.46:0/1622239084 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.154+0000 7f6d827fc640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d84107900 0x7f6d84074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d82ffd640 1 -- 172.21.15.46:0/1622239084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d84107900 msgr2=0x7f6d84074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d82ffd640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d84107900 0x7f6d84074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d82ffd640 1 -- 172.21.15.46:0/1622239084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d84074f70 con 0x7f6d84101900 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d82ffd640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 0x7f6d840744f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6d74031460 tx=0x7f6d740045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d7403f070 con 0x7f6d84101900 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d84075200 con 0x7f6d84101900 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6d740035f0 con 0x7f6d84101900 2024-09-21T13:13:44.288 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6d74035030 con 0x7f6d84101900 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.155+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d841a3d80 con 0x7f6d84101900 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.156+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d84103040 con 0x7f6d84101900 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.157+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f6d74042070 con 0x7f6d84101900 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.157+0000 7f6d6bfff640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6c07af30 0x7f6d6c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.158+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f6d740beac0 con 0x7f6d84101900 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.158+0000 7f6d827fc640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6c07af30 0x7f6d6c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.158+0000 7f6d827fc640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6c07af30 0x7f6d6c07d3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d84075f80 tx=0x7f6d7800b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:44.289 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.162+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6d74089f70 con 0x7f6d84101900 2024-09-21T13:13:44.389 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.388+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f6d84109e70 con 0x7f6d84101900 2024-09-21T13:13:44.390 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.389+0000 7f6d6bfff640 1 -- 172.21.15.46:0/1622239084 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v39) ==== 107+0+5333 (secure 0 0 0) 0x7f6d7408ee20 con 0x7f6d84101900 2024-09-21T13:13:44.390 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:44.390 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":33,"btime":"2024-09-21T13:11:11:888208+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:10.900874+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:resolve","state_seq":234,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:44.390 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 33 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6c07af30 msgr2=0x7f6d6c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6c07af30 0x7f6d6c07d3f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6d84075f80 tx=0x7f6d7800b390 comp rx=0 tx=0).stop 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 msgr2=0x7f6d840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 0x7f6d840744f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6d74031460 tx=0x7f6d740045e0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 shutdown_connections 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f6d6c07af30 0x7f6d6c07d3f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6d84107900 0x7f6d84074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 --2- 172.21.15.46:0/1622239084 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f6d84101900 0x7f6d840744f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:44.393 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.391+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 >> 172.21.15.46:0/1622239084 conn(0x7f6d840fd600 msgr2=0x7f6d840fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:44.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.392+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 shutdown_connections 2024-09-21T13:13:44.394 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:44.392+0000 7f6d8940e640 1 -- 172.21.15.46:0/1622239084 wait complete. 2024-09-21T13:13:45.163 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 34 2024-09-21T13:13:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:45 smithi176 ceph-mon[80162]: pgmap v819: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:45.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:45 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1622239084' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T13:13:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:45 smithi046 ceph-mon[108126]: pgmap v819: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:13:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:45 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1622239084' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T13:13:45.427 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 -- 172.21.15.46:0/1443694387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 msgr2=0x7fca0c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 --2- 172.21.15.46:0/1443694387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c106be0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009880 tx=0x7fc9f402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 -- 172.21.15.46:0/1443694387 shutdown_connections 2024-09-21T13:13:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 --2- 172.21.15.46:0/1443694387 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0c100800 0x7fca0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 --2- 172.21.15.46:0/1443694387 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c106be0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:45.947 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 -- 172.21.15.46:0/1443694387 >> 172.21.15.46:0/1443694387 conn(0x7fca0c0fc520 msgr2=0x7fca0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:45.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 -- 172.21.15.46:0/1443694387 shutdown_connections 2024-09-21T13:13:45.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.945+0000 7fca12b9d640 1 -- 172.21.15.46:0/1443694387 wait complete. 2024-09-21T13:13:45.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.946+0000 7fca12b9d640 1 Processor -- start 2024-09-21T13:13:45.948 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.946+0000 7fca12b9d640 1 -- start start 2024-09-21T13:13:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.946+0000 7fca12b9d640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0c100800 0x7fca0c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.946+0000 7fca12b9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.946+0000 7fca12b9d640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c10dcd0 con 0x7fca0c106800 2024-09-21T13:13:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.946+0000 7fca12b9d640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fca0c10db50 con 0x7fca0c100800 2024-09-21T13:13:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:45.949 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c19cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:49968/0 (socket says 172.21.15.46:49968) 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 -- 172.21.15.46:0/228097461 learned_addr learned my addr 172.21.15.46:0/228097461 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca10939640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0c100800 0x7fca0c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 -- 172.21.15.46:0/228097461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0c100800 msgr2=0x7fca0c19c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0c100800 0x7fca0c19c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 -- 172.21.15.46:0/228097461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca0c1966a0 con 0x7fca0c106800 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca0bfff640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c19cb10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00cc60 tx=0x7fc9fc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9fc00ad30 con 0x7fca0c106800 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc9fc005020 con 0x7fca0c106800 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca0c196990 con 0x7fca0c106800 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.947+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc9fc00f640 con 0x7fca0c106800 2024-09-21T13:13:45.950 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.948+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca0c196ef0 con 0x7fca0c106800 2024-09-21T13:13:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.949+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca0c101f40 con 0x7fca0c106800 2024-09-21T13:13:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.949+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fc9fc0051d0 con 0x7fca0c106800 2024-09-21T13:13:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.950+0000 7fca09ffb640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9f807af80 0x7fc9f807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.950+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fc9fc09e1d0 con 0x7fca0c106800 2024-09-21T13:13:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.950+0000 7fca10939640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9f807af80 0x7fc9f807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:45.951 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.950+0000 7fca10939640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9f807af80 0x7fc9f807d440 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4000c00 tx=0x7fc9f4031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:45.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:45.954+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc9fc014030 con 0x7fca0c106800 2024-09-21T13:13:46.180 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.179+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7fca0c108d70 con 0x7fca0c106800 2024-09-21T13:13:46.181 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.180+0000 7fca09ffb640 1 -- 172.21.15.46:0/228097461 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v39) ==== 107+0+5336 (secure 0 0 0) 0x7fc9fc0697a0 con 0x7fca0c106800 2024-09-21T13:13:46.181 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:46.181 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":34,"btime":"2024-09-21T13:11:20:199331+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:19.776028+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:resolve","state_seq":241,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:resolve","state_seq":234,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:46.182 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 34 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9f807af80 msgr2=0x7fc9f807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9f807af80 0x7fc9f807d440 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4000c00 tx=0x7fc9f4031400 comp rx=0 tx=0).stop 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 msgr2=0x7fca0c19cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c19cb10 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00cc60 tx=0x7fc9fc00a620 comp rx=0 tx=0).stop 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 shutdown_connections 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fc9f807af80 0x7fc9f807d440 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fca0c106800 0x7fca0c19cb10 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 --2- 172.21.15.46:0/228097461 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca0c100800 0x7fca0c19c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:46.184 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 >> 172.21.15.46:0/228097461 conn(0x7fca0c0fc520 msgr2=0x7fca0c0fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:46.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 shutdown_connections 2024-09-21T13:13:46.185 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:46.183+0000 7fca12b9d640 1 -- 172.21.15.46:0/228097461 wait complete. 2024-09-21T13:13:46.837 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 35 2024-09-21T13:13:47.101 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:47.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:47 smithi046 ceph-mon[108126]: pgmap v820: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:47.162 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:47 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/228097461' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-21T13:13:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:47 smithi176 ceph-mon[80162]: pgmap v820: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:47.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:47 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/228097461' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 -- 172.21.15.46:0/919698161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 msgr2=0x7f290c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 --2- 172.21.15.46:0/919698161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c101d60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009880 tx=0x7f28fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 -- 172.21.15.46:0/919698161 shutdown_connections 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 --2- 172.21.15.46:0/919698161 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c101d60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 --2- 172.21.15.46:0/919698161 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f290c107900 0x7f290c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 -- 172.21.15.46:0/919698161 >> 172.21.15.46:0/919698161 conn(0x7f290c0fd5e0 msgr2=0x7f290c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 -- 172.21.15.46:0/919698161 shutdown_connections 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 -- 172.21.15.46:0/919698161 wait complete. 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 Processor -- start 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.560+0000 7f2912cce640 1 -- start start 2024-09-21T13:13:47.563 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2912cce640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2912cce640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f290c107900 0x7f290c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2912cce640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f290c10edd0 con 0x7f290c101900 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2912cce640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f290c10ec50 con 0x7f290c107900 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53962/0 (socket says 172.21.15.46:53962) 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 -- 172.21.15.46:0/1490605550 learned_addr learned my addr 172.21.15.46:0/1490605550 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f290bfff640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f290c107900 0x7f290c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 -- 172.21.15.46:0/1490605550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f290c107900 msgr2=0x7f290c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f290c107900 0x7f290c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 -- 172.21.15.46:0/1490605550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f290c074f70 con 0x7f290c101900 2024-09-21T13:13:47.564 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2910a6a640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c0744f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f290400cc60 tx=0x7f290400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f290400ad30 con 0x7f290c101900 2024-09-21T13:13:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f290c075260 con 0x7f290c101900 2024-09-21T13:13:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2904005020 con 0x7f290c101900 2024-09-21T13:13:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.561+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f290400f640 con 0x7f290c101900 2024-09-21T13:13:47.565 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.562+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f290c1a3e80 con 0x7f290c101900 2024-09-21T13:13:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.563+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f290c103040 con 0x7f290c101900 2024-09-21T13:13:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.563+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f29040051d0 con 0x7f290c101900 2024-09-21T13:13:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.564+0000 7f2909ffb640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f28f807af30 0x7f28f807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.564+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f290409e400 con 0x7f290c101900 2024-09-21T13:13:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.564+0000 7f290bfff640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f28f807af30 0x7f28f807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:47.566 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.564+0000 7f290bfff640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f28f807af30 0x7f28f807d3f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f290c075f80 tx=0x7f28fc031420 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:47.569 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.568+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2904014030 con 0x7f290c101900 2024-09-21T13:13:47.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.797+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) -- 0x7f290c101d60 con 0x7f290c101900 2024-09-21T13:13:47.798 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.797+0000 7f2909ffb640 1 -- 172.21.15.46:0/1490605550 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v39) ==== 107+0+5340 (secure 0 0 0) 0x7f29040698b0 con 0x7f290c101900 2024-09-21T13:13:47.799 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:47.799 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":35,"btime":"2024-09-21T13:11:21:204414+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:20.251596+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":242,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:reconnect","state_seq":237,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:47.799 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 35 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f28f807af30 msgr2=0x7f28f807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f28f807af30 0x7f28f807d3f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f290c075f80 tx=0x7f28fc031420 comp rx=0 tx=0).stop 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 msgr2=0x7f290c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c0744f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f290400cc60 tx=0x7f290400a620 comp rx=0 tx=0).stop 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 shutdown_connections 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f28f807af30 0x7f28f807d3f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f290c107900 0x7f290c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 --2- 172.21.15.46:0/1490605550 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f290c101900 0x7f290c0744f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 >> 172.21.15.46:0/1490605550 conn(0x7f290c0fd5e0 msgr2=0x7f290c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:47.801 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 shutdown_connections 2024-09-21T13:13:47.802 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:47.800+0000 7f2912cce640 1 -- 172.21.15.46:0/1490605550 wait complete. 2024-09-21T13:13:48.113 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:48 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/1490605550' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-21T13:13:48.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:48 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/1490605550' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 35, "format": "json"} : dispatch 2024-09-21T13:13:48.450 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 36 2024-09-21T13:13:48.707 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:49.108 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:49 smithi046 ceph-mon[108126]: pgmap v821: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:49 smithi176 ceph-mon[80162]: pgmap v821: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 -- 172.21.15.46:0/3442595903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 msgr2=0x7f57bc101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 --2- 172.21.15.46:0/3442595903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc101d60 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009880 tx=0x7f57b002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 -- 172.21.15.46:0/3442595903 shutdown_connections 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 --2- 172.21.15.46:0/3442595903 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc101d60 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 --2- 172.21.15.46:0/3442595903 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 0x7f57bc107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 -- 172.21.15.46:0/3442595903 >> 172.21.15.46:0/3442595903 conn(0x7f57bc0fd600 msgr2=0x7f57bc0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 -- 172.21.15.46:0/3442595903 shutdown_connections 2024-09-21T13:13:49.325 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.250+0000 7f57c1227640 1 -- 172.21.15.46:0/3442595903 wait complete. 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.251+0000 7f57c1227640 1 Processor -- start 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.251+0000 7f57c1227640 1 -- start start 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.251+0000 7f57c1227640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.251+0000 7f57c1227640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 0x7f57bc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.251+0000 7f57c1227640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc10ee30 con 0x7f57bc101900 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.251+0000 7f57c1227640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f57bc10ecb0 con 0x7f57bc107900 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:53990/0 (socket says 172.21.15.46:53990) 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 -- 172.21.15.46:0/2811100674 learned_addr learned my addr 172.21.15.46:0/2811100674 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57ba59c640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 0x7f57bc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 -- 172.21.15.46:0/2811100674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 msgr2=0x7f57bc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 0x7f57bc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 -- 172.21.15.46:0/2811100674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57bc074f70 con 0x7f57bc101900 2024-09-21T13:13:49.326 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57ba59c640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 0x7f57bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57bad9d640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc0744f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b420 tx=0x7f57ac00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57ac011630 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57bc075260 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57ac016070 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f57ac010d40 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.252+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57bc1a3ec0 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.253+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57bc103040 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.254+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f57ac01b460 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.255+0000 7f57a3fff640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f57a407af30 0x7f57a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.255+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f57ac09d920 con 0x7f57bc101900 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.255+0000 7f57ba59c640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f57a407af30 0x7f57a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.255+0000 7f57ba59c640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f57a407af30 0x7f57a407d3f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f57b0006010 tx=0x7f57b00095f0 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:49.327 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.259+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57ac021250 con 0x7f57bc101900 2024-09-21T13:13:49.485 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.484+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) -- 0x7f57bc101d60 con 0x7f57bc101900 2024-09-21T13:13:49.486 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.484+0000 7f57a3fff640 1 -- 172.21.15.46:0/2811100674 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v39) ==== 107+0+5334 (secure 0 0 0) 0x7f57ac068dd0 con 0x7f57bc101900 2024-09-21T13:13:49.486 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:49.486 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":36,"btime":"2024-09-21T13:11:22:208736+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":36,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:21.211546+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":243,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:rejoin","state_seq":238,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T13:13:49.486 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 36 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f57a407af30 msgr2=0x7f57a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f57a407af30 0x7f57a407d3f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f57b0006010 tx=0x7f57b00095f0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 msgr2=0x7f57bc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc0744f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b420 tx=0x7f57ac00b8e0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 shutdown_connections 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f57a407af30 0x7f57a407d3f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.488 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f57bc107900 0x7f57bc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 --2- 172.21.15.46:0/2811100674 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f57bc101900 0x7f57bc0744f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 >> 172.21.15.46:0/2811100674 conn(0x7f57bc0fd600 msgr2=0x7f57bc0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 shutdown_connections 2024-09-21T13:13:49.489 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:49.487+0000 7f57c1227640 1 -- 172.21.15.46:0/2811100674 wait complete. 2024-09-21T13:13:50.103 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 37 2024-09-21T13:13:50.128 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:50 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2811100674' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-21T13:13:50.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:50 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2811100674' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 36, "format": "json"} : dispatch 2024-09-21T13:13:50.365 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 -- 172.21.15.46:0/570389680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 msgr2=0x7f821c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 --2- 172.21.15.46:0/570389680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c101d60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f8204009880 tx=0x7f820402a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 -- 172.21.15.46:0/570389680 shutdown_connections 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 --2- 172.21.15.46:0/570389680 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c101d60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 --2- 172.21.15.46:0/570389680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f821c107900 0x7f821c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 -- 172.21.15.46:0/570389680 >> 172.21.15.46:0/570389680 conn(0x7f821c0fd600 msgr2=0x7f821c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:50.891 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 -- 172.21.15.46:0/570389680 shutdown_connections 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.881+0000 7f8221461640 1 -- 172.21.15.46:0/570389680 wait complete. 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.882+0000 7f8221461640 1 Processor -- start 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.882+0000 7f8221461640 1 -- start start 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.882+0000 7f8221461640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.882+0000 7f8221461640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f821c107900 0x7f821c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.882+0000 7f8221461640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10edb0 con 0x7f821c101900 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.882+0000 7f8221461640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7f821c10ec30 con 0x7f821c107900 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54014/0 (socket says 172.21.15.46:54014) 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 -- 172.21.15.46:0/381213958 learned_addr learned my addr 172.21.15.46:0/381213958 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f8213fff640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f821c107900 0x7f821c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 -- 172.21.15.46:0/381213958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f821c107900 msgr2=0x7f821c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f821c107900 0x7f821c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 -- 172.21.15.46:0/381213958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821c1977d0 con 0x7f821c101900 2024-09-21T13:13:50.892 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f821affd640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c19d650 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f820c00d8d0 tx=0x7f820c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f820c017070 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f820c010460 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821c197ac0 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f820c00f5f0 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.883+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821c198020 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.885+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f821c103040 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.885+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7f820c00f860 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.885+0000 7f8218ff9640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f820807af80 0x7f820807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.886+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7f820c09de60 con 0x7f821c101900 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.886+0000 7f8213fff640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f820807af80 0x7f820807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.886+0000 7f8213fff640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f820807af80 0x7f820807d440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f821c198b20 tx=0x7f8204031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:50.893 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:50.890+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f820c069430 con 0x7f821c101900 2024-09-21T13:13:51.116 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.115+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) -- 0x7f821c109e90 con 0x7f821c101900 2024-09-21T13:13:51.117 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.116+0000 7f8218ff9640 1 -- 172.21.15.46:0/381213958 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v39) ==== 107+0+5349 (secure 0 0 0) 0x7f820c06e2e0 con 0x7f821c101900 2024-09-21T13:13:51.117 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:51.117 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":37,"btime":"2024-09-21T13:11:23:214421+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":29},{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":37,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:23.214415+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:active","state_seq":244,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:active","state_seq":239,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34328,"qdb_cluster":[34328,34360]},"id":1}]} 2024-09-21T13:13:51.117 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 37 2024-09-21T13:13:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f820807af80 msgr2=0x7f820807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:51.119 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f820807af80 0x7f820807d440 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f821c198b20 tx=0x7f8204031400 comp rx=0 tx=0).stop 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 msgr2=0x7f821c19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c19d650 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f820c00d8d0 tx=0x7f820c00dd90 comp rx=0 tx=0).stop 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 shutdown_connections 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7f820807af80 0x7f820807d440 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f821c107900 0x7f821c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 --2- 172.21.15.46:0/381213958 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7f821c101900 0x7f821c19d650 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 >> 172.21.15.46:0/381213958 conn(0x7f821c0fd600 msgr2=0x7f821c0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 shutdown_connections 2024-09-21T13:13:51.120 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:51.118+0000 7f8221461640 1 -- 172.21.15.46:0/381213958 wait complete. 2024-09-21T13:13:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:51 smithi176 ceph-mon[80162]: pgmap v822: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:51 smithi046 ceph-mon[108126]: pgmap v822: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:51.711 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 38 2024-09-21T13:13:52.015 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:52.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:52 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/381213958' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-21T13:13:52.406 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:52 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/381213958' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 37, "format": "json"} : dispatch 2024-09-21T13:13:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 -- 172.21.15.46:0/524883178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1681033e0 msgr2=0x7fd16810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 --2- 172.21.15.46:0/524883178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1681033e0 0x7fd16810b8d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd154009880 tx=0x7fd15402a530 comp rx=0 tx=0).stop 2024-09-21T13:13:52.514 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 -- 172.21.15.46:0/524883178 shutdown_connections 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 --2- 172.21.15.46:0/524883178 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd1681033e0 0x7fd16810b8d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 --2- 172.21.15.46:0/524883178 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd168102ac0 0x7fd168102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 -- 172.21.15.46:0/524883178 >> 172.21.15.46:0/524883178 conn(0x7fd1680fc520 msgr2=0x7fd1680fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 -- 172.21.15.46:0/524883178 shutdown_connections 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.489+0000 7fd16ed86640 1 -- 172.21.15.46:0/524883178 wait complete. 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16ed86640 1 Processor -- start 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16ed86640 1 -- start start 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16ed86640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 0x7fd16819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16ed86640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1681033e0 0x7fd16819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16ed86640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fd16810edf0 con 0x7fd168102ac0 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16ed86640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fd16810ec70 con 0x7fd1681033e0 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16cb22640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 0x7fd16819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:52.515 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16cb22640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 0x7fd16819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54028/0 (socket says 172.21.15.46:54028) 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16cb22640 1 -- 172.21.15.46:0/2157305784 learned_addr learned my addr 172.21.15.46:0/2157305784 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd167fff640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1681033e0 0x7fd16819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.490+0000 7fd16cb22640 1 -- 172.21.15.46:0/2157305784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1681033e0 msgr2=0x7fd16819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd16cb22640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1681033e0 0x7fd16819dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd16cb22640 1 -- 172.21.15.46:0/2157305784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd168197820 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd16cb22640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 0x7fd16819d6a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00d6f0 tx=0x7fd15c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd15c017070 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd15c00de00 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd168197b10 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd15c004bb0 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.491+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd168198070 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.492+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd16806aa90 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.493+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fd15c009a30 con 0x7fd168102ac0 2024-09-21T13:13:52.516 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.493+0000 7fd165ffb640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd15807af80 0x7fd15807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.493+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fd15c09dc20 con 0x7fd168102ac0 2024-09-21T13:13:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.493+0000 7fd167fff640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd15807af80 0x7fd15807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.494+0000 7fd167fff640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd15807af80 0x7fd15807d440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd168198b70 tx=0x7fd154031400 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:52.517 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.498+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd15c0691f0 con 0x7fd168102ac0 2024-09-21T13:13:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.723+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) -- 0x7fd168105f60 con 0x7fd168102ac0 2024-09-21T13:13:52.724 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.723+0000 7fd165ffb640 1 -- 172.21.15.46:0/2157305784 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v39) ==== 107+0+5364 (secure 0 0 0) 0x7fd15c06e0a0 con 0x7fd168102ac0 2024-09-21T13:13:52.725 INFO:teuthology.orchestra.run.smithi046.stdout: 2024-09-21T13:13:52.725 INFO:teuthology.orchestra.run.smithi046.stdout:{"epoch":38,"btime":"2024-09-21T13:11:23:223419+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T12:44:11.798472+0000","modified":"2024-09-21T13:11:23.223404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":77,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34328,"mds_1":34360},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34328":{"gid":34328,"name":"cephfs.smithi046.ffxnex","rank":0,"incarnation":32,"state":"up:active","state_seq":244,"addr":"172.21.15.46:6827/3249327567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6826","nonce":3249327567},{"type":"v1","addr":"172.21.15.46:6827","nonce":3249327567}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34360":{"gid":34360,"name":"cephfs.smithi046.hxdqyf","rank":1,"incarnation":32,"state":"up:active","state_seq":239,"addr":"172.21.15.46:6829/3766079152","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.46:6828","nonce":3766079152},{"type":"v1","addr":"172.21.15.46:6829","nonce":3766079152}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44303":{"gid":44303,"name":"cephfs.smithi176.kzzdid","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6825/1139967954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":1139967954},{"type":"v1","addr":"172.21.15.176:6825","nonce":1139967954}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44335":{"gid":44335,"name":"cephfs.smithi176.whwfab","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.176:6827/1090771457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":1090771457},{"type":"v1","addr":"172.21.15.176:6827","nonce":1090771457}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34328,"qdb_cluster":[34360,34328]},"id":1}]} 2024-09-21T13:13:52.725 INFO:teuthology.orchestra.run.smithi046.stderr:dumped fsmap epoch 38 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd15807af80 msgr2=0x7fd15807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd15807af80 0x7fd15807d440 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd168198b70 tx=0x7fd154031400 comp rx=0 tx=0).stop 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 msgr2=0x7fd16819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 0x7fd16819d6a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd15c00d6f0 tx=0x7fd15c00dbb0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 shutdown_connections 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fd15807af80 0x7fd15807d440 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd1681033e0 0x7fd16819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.727 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 --2- 172.21.15.46:0/2157305784 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fd168102ac0 0x7fd16819d6a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 >> 172.21.15.46:0/2157305784 conn(0x7fd1680fc520 msgr2=0x7fd168108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 shutdown_connections 2024-09-21T13:13:52.728 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:52.726+0000 7fd16ed86640 1 -- 172.21.15.46:0/2157305784 wait complete. 2024-09-21T13:13:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:53 smithi176 ceph-mon[80162]: pgmap v823: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:53 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2157305784' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 38, "format": "json"} : dispatch 2024-09-21T13:13:53.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:53 smithi046 ceph-mon[108126]: pgmap v823: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:13:53.351 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:53 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2157305784' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 38, "format": "json"} : dispatch 2024-09-21T13:13:53.382 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T13:13:53.392 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T13:13:53.392 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T13:13:53.392 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T13:13:53.413 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T13:13:53.413 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T13:13:53.473 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T13:13:53.772 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:54.250 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 -- 172.21.15.46:0/194796526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 msgr2=0x7fe220107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 --2- 172.21.15.46:0/194796526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe220107ce0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe210009880 tx=0x7fe21002a4a0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 -- 172.21.15.46:0/194796526 shutdown_connections 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 --2- 172.21.15.46:0/194796526 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe220101900 0x7fe220101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 --2- 172.21.15.46:0/194796526 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe220107ce0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 -- 172.21.15.46:0/194796526 >> 172.21.15.46:0/194796526 conn(0x7fe2200fd600 msgr2=0x7fe2200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 -- 172.21.15.46:0/194796526 shutdown_connections 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.236+0000 7fe2271af640 1 -- 172.21.15.46:0/194796526 wait complete. 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe2271af640 1 Processor -- start 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe2271af640 1 -- start start 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe2271af640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe220101900 0x7fe22019d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:54.251 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe2271af640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe22019dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe2271af640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fe22010edb0 con 0x7fe220107900 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe2271af640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fe22010ec30 con 0x7fe220101900 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe21ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe22019dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe21ffff640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe22019dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54046/0 (socket says 172.21.15.46:54046) 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe21ffff640 1 -- 172.21.15.46:0/27222703 learned_addr learned my addr 172.21.15.46:0/27222703 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe224f4b640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe220101900 0x7fe22019d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe21ffff640 1 -- 172.21.15.46:0/27222703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe220101900 msgr2=0x7fe22019d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe21ffff640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe220101900 0x7fe22019d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.237+0000 7fe21ffff640 1 -- 172.21.15.46:0/27222703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2201977e0 con 0x7fe220107900 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.238+0000 7fe21ffff640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe22019dba0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe20800cc60 tx=0x7fe20800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.238+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe20800ce10 con 0x7fe220107900 2024-09-21T13:13:54.252 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.238+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe20800f910 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.238+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe220197ad0 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.238+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe208018ae0 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.238+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe220198060 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.239+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe220103040 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.240+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fe208018ca0 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.240+0000 7fe21dffb640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe20c07af30 0x7fe20c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.240+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fe20809e7b0 con 0x7fe220107900 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.240+0000 7fe224f4b640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe20c07af30 0x7fe20c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.241+0000 7fe224f4b640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe20c07af30 0x7fe20c07d3f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe210031460 tx=0x7fe210009560 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:54.253 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.245+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe208014030 con 0x7fe220107900 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.446+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe220198d40 con 0x7fe220107900 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.447+0000 7fe21dffb640 1 -- 172.21.15.46:0/27222703 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2082 (secure 0 0 0) 0x7fe220198d40 con 0x7fe220107900 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6829/692972635 2024-09-22T12:55:13.816150+0000 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6828/692972635 2024-09-22T12:55:13.816150+0000 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6825/1059739183 2024-09-22T12:55:13.816163+0000 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6824/1059739183 2024-09-22T12:55:13.816163+0000 2024-09-21T13:13:54.448 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/2766147226 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3333048124 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2026840811 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4011409884 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/617091851 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6826/1184759627 2024-09-22T12:44:26.406214+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6827/1184759627 2024-09-22T12:44:26.406214+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/2227350145 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2476197265 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3638928701 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/1821916109 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/1544581399 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3100933281 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:54.449 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1961061203 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2799026186 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2799026186 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3815949737 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3815949737 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2844834476 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2190573753 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/37892782 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3239992248 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2026840811 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2703068580 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2569846456 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2190573753 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:54.450 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3184981437 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:54.451 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6828/4102729688 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.451 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6829/4102729688 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.451 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4175095776 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:54.451 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/595099626 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:54.451 INFO:teuthology.orchestra.run.smithi046.stderr:listed 35 entries 2024-09-21T13:13:54.451 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe20c07af30 msgr2=0x7fe20c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe20c07af30 0x7fe20c07d3f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe210031460 tx=0x7fe210009560 comp rx=0 tx=0).stop 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 msgr2=0x7fe22019dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe22019dba0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe20800cc60 tx=0x7fe20800a620 comp rx=0 tx=0).stop 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 shutdown_connections 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fe20c07af30 0x7fe20c07d3f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fe220107900 0x7fe22019dba0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 --2- 172.21.15.46:0/27222703 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe220101900 0x7fe22019d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 >> 172.21.15.46:0/27222703 conn(0x7fe2200fd600 msgr2=0x7fe2200fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 shutdown_connections 2024-09-21T13:13:54.452 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:54.449+0000 7fe2271af640 1 -- 172.21.15.46:0/27222703 wait complete. 2024-09-21T13:13:55.113 DEBUG:teuthology.orchestra.run.smithi046:> set -ex 2024-09-21T13:13:55.113 DEBUG:teuthology.orchestra.run.smithi046:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T13:13:55.132 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 297e1ece-7816-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T13:13:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:55 smithi176 ceph-mon[80162]: pgmap v824: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:55 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/27222703' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:13:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:55 smithi046 ceph-mon[108126]: pgmap v824: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:13:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:55 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/27222703' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:13:55.431 INFO:teuthology.orchestra.run.smithi046.stderr:Inferring config /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/mon.smithi046/config 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.944+0000 7fdd5db39640 1 -- 172.21.15.46:0/1259334804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 msgr2=0x7fdd58100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.944+0000 7fdd5db39640 1 --2- 172.21.15.46:0/1259334804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd58100aa0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009880 tx=0x7fdd4802a490 comp rx=0 tx=0).stop 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 -- 172.21.15.46:0/1259334804 shutdown_connections 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 --2- 172.21.15.46:0/1259334804 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58101070 0x7fdd5810dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 --2- 172.21.15.46:0/1259334804 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd58100aa0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 -- 172.21.15.46:0/1259334804 >> 172.21.15.46:0/1259334804 conn(0x7fdd580fc550 msgr2=0x7fdd580fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 -- 172.21.15.46:0/1259334804 shutdown_connections 2024-09-21T13:13:55.954 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 -- 172.21.15.46:0/1259334804 wait complete. 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.945+0000 7fdd5db39640 1 Processor -- start 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd5db39640 1 -- start start 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd5db39640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd5819f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd5db39640 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58101070 0x7fdd5819fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd5db39640 1 -- --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58110fa0 con 0x7fdd581006c0 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd5db39640 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 -- 0x7fdd58110e20 con 0x7fdd58101070 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd5819f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd577fe640 1 --2- >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd5819f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.46:3300/0 says I am v2:172.21.15.46:54058/0 (socket says 172.21.15.46:54058) 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd577fe640 1 -- 172.21.15.46:0/2278529664 learned_addr learned my addr 172.21.15.46:0/2278529664 (peer_addr_for_me v2:172.21.15.46:0/0) 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd56ffd640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58101070 0x7fdd5819fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd577fe640 1 -- 172.21.15.46:0/2278529664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58101070 msgr2=0x7fdd5819fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd577fe640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58101070 0x7fdd5819fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:55.955 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.946+0000 7fdd577fe640 1 -- 172.21.15.46:0/2278529664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd58199a30 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.947+0000 7fdd577fe640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd5819f870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdd48031460 tx=0x7fdd480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.947+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd4803f070 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.947+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdd48004b10 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.947+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd58199cc0 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.947+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd48035030 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.947+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd5819a250 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.948+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd5806a500 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.948+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 4 ==== mgrmap(e 33) ==== 103320+0+0 (secure 0 0 0) 0x7fdd48042070 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.949+0000 7fdd54ff9640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdd4007af90 0x7fdd4007d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.949+0000 7fdd56ffd640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdd4007af90 0x7fdd4007d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.949+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 6328+0+0 (secure 0 0 0) 0x7fdd480beac0 con 0x7fdd581006c0 2024-09-21T13:13:55.956 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.950+0000 7fdd56ffd640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdd4007af90 0x7fdd4007d450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdd580fef90 tx=0x7fdd4c00b390 comp rx=0 tx=0).ready entity=mgr.14742 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T13:13:55.957 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:55.954+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdd4808a090 con 0x7fdd581006c0 2024-09-21T13:13:56.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.155+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 --> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdd5810b410 con 0x7fdd581006c0 2024-09-21T13:13:56.156 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.155+0000 7fdd54ff9640 1 -- 172.21.15.46:0/2278529664 <== mon.0 v2:172.21.15.46:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 35 entries v82) ==== 81+0+2082 (secure 0 0 0) 0x7fdd4808ef40 con 0x7fdd581006c0 2024-09-21T13:13:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6829/692972635 2024-09-22T12:55:13.816150+0000 2024-09-21T13:13:56.156 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6828/692972635 2024-09-22T12:55:13.816150+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6825/1059739183 2024-09-22T12:55:13.816163+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6824/1059739183 2024-09-22T12:55:13.816163+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/2766147226 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3333048124 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2026840811 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4011409884 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/617091851 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6826/1184759627 2024-09-22T12:44:26.406214+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6827/1184759627 2024-09-22T12:44:26.406214+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/2227350145 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2476197265 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3638928701 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:56.157 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/1821916109 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/1544581399 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3100933281 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/1961061203 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2799026186 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2799026186 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/3815949737 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/3815949737 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2844834476 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2190573753 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/37892782 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3239992248 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6801/2026840811 2024-09-22T12:46:12.521160+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2703068580 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:56.158 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/2569846456 2024-09-22T12:37:59.843813+0000 2024-09-21T13:13:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:6800/2190573753 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/3184981437 2024-09-22T12:38:32.104639+0000 2024-09-21T13:13:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6828/4102729688 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:6829/4102729688 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.46:0/4175095776 2024-09-22T12:39:28.313737+0000 2024-09-21T13:13:56.159 INFO:teuthology.orchestra.run.smithi046.stdout:172.21.15.176:0/595099626 2024-09-22T12:47:43.295783+0000 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:listed 35 entries 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.157+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdd4007af90 msgr2=0x7fdd4007d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.157+0000 7fdd5db39640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdd4007af90 0x7fdd4007d450 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fdd580fef90 tx=0x7fdd4c00b390 comp rx=0 tx=0).stop 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.157+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 msgr2=0x7fdd5819f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.157+0000 7fdd5db39640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd5819f870 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdd48031460 tx=0x7fdd480045e0 comp rx=0 tx=0).stop 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 shutdown_connections 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:6800/3073108359,v1:172.21.15.46:6801/3073108359] conn(0x7fdd4007af90 0x7fdd4007d450 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdd58101070 0x7fdd5819fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 --2- 172.21.15.46:0/2278529664 >> [v2:172.21.15.46:3300/0,v1:172.21.15.46:6789/0] conn(0x7fdd581006c0 0x7fdd5819f870 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 >> 172.21.15.46:0/2278529664 conn(0x7fdd580fc550 msgr2=0x7fdd580fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 shutdown_connections 2024-09-21T13:13:56.160 INFO:teuthology.orchestra.run.smithi046.stderr:2024-09-21T13:13:56.158+0000 7fdd5db39640 1 -- 172.21.15.46:0/2278529664 wait complete. 2024-09-21T13:13:56.789 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi046.front.sepia.ceph.com... 2024-09-21T13:13:56.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T13:13:56.789 DEBUG:teuthology.orchestra.run.smithi046:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T13:13:56.818 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T13:13:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:57 smithi176 ceph-mon[80162]: pgmap v825: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:57 smithi176 ceph-mon[80162]: from='client.? 172.21.15.46:0/2278529664' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:13:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:57 smithi046 ceph-mon[108126]: pgmap v825: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:13:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:57 smithi046 ceph-mon[108126]: from='client.? 172.21.15.46:0/2278529664' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T13:13:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:13:59 smithi176 ceph-mon[80162]: pgmap v826: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:13:59.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:13:59 smithi046 ceph-mon[108126]: pgmap v826: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:00.372 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:01.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:01 smithi046 ceph-mon[108126]: pgmap v827: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:01 smithi176 ceph-mon[80162]: pgmap v827: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:03 smithi046 ceph-mon[108126]: pgmap v828: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:03 smithi176 ceph-mon[80162]: pgmap v828: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:05 smithi046 ceph-mon[108126]: pgmap v829: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:05.464 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:05 smithi176 ceph-mon[80162]: pgmap v829: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:07 smithi046 ceph-mon[108126]: pgmap v830: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:07 smithi176 ceph-mon[80162]: pgmap v830: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:09 smithi046 ceph-mon[108126]: pgmap v831: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:09 smithi176 ceph-mon[80162]: pgmap v831: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:11.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:11 smithi046 ceph-mon[108126]: pgmap v832: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:11 smithi176 ceph-mon[80162]: pgmap v832: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:13.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:13 smithi046 ceph-mon[108126]: pgmap v833: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:13 smithi176 ceph-mon[80162]: pgmap v833: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:15 smithi046 ceph-mon[108126]: pgmap v834: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:15 smithi176 ceph-mon[80162]: pgmap v834: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:17.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:17 smithi046 ceph-mon[108126]: pgmap v835: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:17 smithi176 ceph-mon[80162]: pgmap v835: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:19.369 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:19 smithi176 ceph-mon[80162]: pgmap v836: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:19.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:19 smithi046 ceph-mon[108126]: pgmap v836: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:21 smithi046 ceph-mon[108126]: pgmap v837: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:21 smithi176 ceph-mon[80162]: pgmap v837: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:23.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:23 smithi046 ceph-mon[108126]: pgmap v838: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:23 smithi176 ceph-mon[80162]: pgmap v838: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:25 smithi046 ceph-mon[108126]: pgmap v839: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:25 smithi176 ceph-mon[80162]: pgmap v839: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:27 smithi046 ceph-mon[108126]: pgmap v840: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:27 smithi176 ceph-mon[80162]: pgmap v840: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:29 smithi046 ceph-mon[108126]: pgmap v841: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:29 smithi176 ceph-mon[80162]: pgmap v841: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:31.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:31 smithi176 ceph-mon[80162]: pgmap v842: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:31 smithi046 ceph-mon[108126]: pgmap v842: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:33 smithi046 ceph-mon[108126]: pgmap v843: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:33 smithi176 ceph-mon[80162]: pgmap v843: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:35.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:35 smithi046 ceph-mon[108126]: pgmap v844: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:35 smithi176 ceph-mon[80162]: pgmap v844: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:37 smithi046 ceph-mon[108126]: pgmap v845: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:37 smithi176 ceph-mon[80162]: pgmap v845: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:39 smithi046 ceph-mon[108126]: pgmap v846: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:14:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:14:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:14:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:39 smithi176 ceph-mon[80162]: pgmap v846: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:14:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:14:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:14:40.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:14:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:14:41.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:41 smithi046 ceph-mon[108126]: pgmap v847: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:41 smithi176 ceph-mon[80162]: pgmap v847: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:43.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:43 smithi046 ceph-mon[108126]: pgmap v848: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:43 smithi176 ceph-mon[80162]: pgmap v848: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:45 smithi046 ceph-mon[108126]: pgmap v849: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:45.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:45 smithi176 ceph-mon[80162]: pgmap v849: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:14:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:47 smithi046 ceph-mon[108126]: pgmap v850: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:47 smithi176 ceph-mon[80162]: pgmap v850: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:49 smithi046 ceph-mon[108126]: pgmap v851: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:49 smithi176 ceph-mon[80162]: pgmap v851: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:51 smithi046 ceph-mon[108126]: pgmap v852: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:51 smithi176 ceph-mon[80162]: pgmap v852: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:53 smithi046 ceph-mon[108126]: pgmap v853: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:53 smithi176 ceph-mon[80162]: pgmap v853: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:14:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:55 smithi176 ceph-mon[80162]: pgmap v854: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:55.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:55 smithi046 ceph-mon[108126]: pgmap v854: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:14:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:57 smithi046 ceph-mon[108126]: pgmap v855: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:57 smithi176 ceph-mon[80162]: pgmap v855: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:14:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:14:59 smithi176 ceph-mon[80162]: pgmap v856: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:14:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:14:59 smithi046 ceph-mon[108126]: pgmap v856: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:01.481 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:01 smithi176 ceph-mon[80162]: pgmap v857: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:01 smithi046 ceph-mon[108126]: pgmap v857: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:03 smithi046 ceph-mon[108126]: pgmap v858: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:03 smithi176 ceph-mon[80162]: pgmap v858: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:05 smithi176 ceph-mon[80162]: pgmap v859: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:05 smithi046 ceph-mon[108126]: pgmap v859: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:07 smithi046 ceph-mon[108126]: pgmap v860: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:07 smithi176 ceph-mon[80162]: pgmap v860: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:09 smithi046 ceph-mon[108126]: pgmap v861: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:09 smithi176 ceph-mon[80162]: pgmap v861: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:11 smithi176 ceph-mon[80162]: pgmap v862: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:11 smithi046 ceph-mon[108126]: pgmap v862: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:13 smithi176 ceph-mon[80162]: pgmap v863: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:13 smithi046 ceph-mon[108126]: pgmap v863: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:15 smithi046 ceph-mon[108126]: pgmap v864: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:15 smithi176 ceph-mon[80162]: pgmap v864: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:17 smithi046 ceph-mon[108126]: pgmap v865: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:17 smithi176 ceph-mon[80162]: pgmap v865: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:19 smithi176 ceph-mon[80162]: pgmap v866: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:19 smithi046 ceph-mon[108126]: pgmap v866: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:21 smithi046 ceph-mon[108126]: pgmap v867: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:21 smithi176 ceph-mon[80162]: pgmap v867: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:23 smithi176 ceph-mon[80162]: pgmap v868: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:23 smithi046 ceph-mon[108126]: pgmap v868: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:25 smithi176 ceph-mon[80162]: pgmap v869: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:25 smithi046 ceph-mon[108126]: pgmap v869: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:27 smithi046 ceph-mon[108126]: pgmap v870: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:27 smithi176 ceph-mon[80162]: pgmap v870: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:29 smithi176 ceph-mon[80162]: pgmap v871: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:29.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:29 smithi046 ceph-mon[108126]: pgmap v871: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:31 smithi176 ceph-mon[80162]: pgmap v872: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:31 smithi046 ceph-mon[108126]: pgmap v872: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:33 smithi046 ceph-mon[108126]: pgmap v873: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:33 smithi176 ceph-mon[80162]: pgmap v873: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:35 smithi176 ceph-mon[80162]: pgmap v874: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:35 smithi046 ceph-mon[108126]: pgmap v874: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:37.512 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:37 smithi046 ceph-mon[108126]: pgmap v875: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:37 smithi176 ceph-mon[80162]: pgmap v875: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:39 smithi046 ceph-mon[108126]: pgmap v876: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:39 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:15:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:39 smithi176 ceph-mon[80162]: pgmap v876: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:39 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:15:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:15:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:15:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:15:40.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:15:40.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:15:40.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:15:41.883 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:41 smithi046 ceph-mon[108126]: pgmap v877: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:42.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:41 smithi176 ceph-mon[80162]: pgmap v877: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:43.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:43 smithi046 ceph-mon[108126]: pgmap v878: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:44.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:43 smithi176 ceph-mon[80162]: pgmap v878: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:44.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:45.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:15:45.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:45 smithi046 ceph-mon[108126]: pgmap v879: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:46.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:45 smithi176 ceph-mon[80162]: pgmap v879: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:46.911 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:46 smithi046 ceph-mon[108126]: pgmap v880: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:47.066 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:46 smithi176 ceph-mon[80162]: pgmap v880: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:49.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:49 smithi176 ceph-mon[80162]: pgmap v881: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:49.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:49 smithi046 ceph-mon[108126]: pgmap v881: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:51.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:51 smithi176 ceph-mon[80162]: pgmap v882: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:51 smithi046 ceph-mon[108126]: pgmap v882: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:53.161 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:53 smithi046 ceph-mon[108126]: pgmap v883: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:53.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:53 smithi176 ceph-mon[80162]: pgmap v883: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:15:55.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:55 smithi176 ceph-mon[80162]: pgmap v884: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:55 smithi046 ceph-mon[108126]: pgmap v884: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:15:57.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:57 smithi176 ceph-mon[80162]: pgmap v885: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:57 smithi046 ceph-mon[108126]: pgmap v885: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:15:59.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:15:59 smithi176 ceph-mon[80162]: pgmap v886: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:15:59.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:15:59 smithi046 ceph-mon[108126]: pgmap v886: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:00.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:01.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:01 smithi176 ceph-mon[80162]: pgmap v887: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:01.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:01 smithi046 ceph-mon[108126]: pgmap v887: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:03.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:03 smithi176 ceph-mon[80162]: pgmap v888: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:03 smithi046 ceph-mon[108126]: pgmap v888: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:05.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:05 smithi176 ceph-mon[80162]: pgmap v889: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:05 smithi046 ceph-mon[108126]: pgmap v889: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:07.318 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:07 smithi176 ceph-mon[80162]: pgmap v890: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:07.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:07 smithi046 ceph-mon[108126]: pgmap v890: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:09.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:09 smithi176 ceph-mon[80162]: pgmap v891: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:09 smithi046 ceph-mon[108126]: pgmap v891: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:11.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:11 smithi176 ceph-mon[80162]: pgmap v892: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:11 smithi046 ceph-mon[108126]: pgmap v892: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:13.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:13 smithi176 ceph-mon[80162]: pgmap v893: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:13.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:13 smithi046 ceph-mon[108126]: pgmap v893: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:15 smithi176 ceph-mon[80162]: pgmap v894: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:15.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:15 smithi046 ceph-mon[108126]: pgmap v894: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:17.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:17 smithi176 ceph-mon[80162]: pgmap v895: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:17 smithi046 ceph-mon[108126]: pgmap v895: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:19 smithi176 ceph-mon[80162]: pgmap v896: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:19.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:19 smithi046 ceph-mon[108126]: pgmap v896: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:21.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:21 smithi176 ceph-mon[80162]: pgmap v897: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:21 smithi046 ceph-mon[108126]: pgmap v897: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:23.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:23 smithi176 ceph-mon[80162]: pgmap v898: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:23.371 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:23 smithi046 ceph-mon[108126]: pgmap v898: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:25.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:25 smithi176 ceph-mon[80162]: pgmap v899: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:25.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:25 smithi046 ceph-mon[108126]: pgmap v899: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:27 smithi046 ceph-mon[108126]: pgmap v900: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:27 smithi176 ceph-mon[80162]: pgmap v900: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:29.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:29 smithi046 ceph-mon[108126]: pgmap v901: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:29 smithi176 ceph-mon[80162]: pgmap v901: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:31.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:31 smithi046 ceph-mon[108126]: pgmap v902: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:31 smithi176 ceph-mon[80162]: pgmap v902: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:33 smithi046 ceph-mon[108126]: pgmap v903: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:33 smithi176 ceph-mon[80162]: pgmap v903: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:35.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:35 smithi046 ceph-mon[108126]: pgmap v904: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:35 smithi176 ceph-mon[80162]: pgmap v904: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:37.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:37 smithi046 ceph-mon[108126]: pgmap v905: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:37 smithi176 ceph-mon[80162]: pgmap v905: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:39 smithi046 ceph-mon[108126]: pgmap v906: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:39 smithi176 ceph-mon[80162]: pgmap v906: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:40.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:16:40.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:16:40.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:16:40.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:16:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:16:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:16:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:16:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:16:41.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:41 smithi046 ceph-mon[108126]: pgmap v907: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:41 smithi176 ceph-mon[80162]: pgmap v907: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:43.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:43 smithi046 ceph-mon[108126]: pgmap v908: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:43 smithi176 ceph-mon[80162]: pgmap v908: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:45 smithi046 ceph-mon[108126]: pgmap v909: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:45 smithi176 ceph-mon[80162]: pgmap v909: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:16:47.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:47 smithi046 ceph-mon[108126]: pgmap v910: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:47 smithi176 ceph-mon[80162]: pgmap v910: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:49.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:49 smithi046 ceph-mon[108126]: pgmap v911: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:49.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:49 smithi176 ceph-mon[80162]: pgmap v911: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:51 smithi046 ceph-mon[108126]: pgmap v912: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:51 smithi176 ceph-mon[80162]: pgmap v912: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:53.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:53 smithi046 ceph-mon[108126]: pgmap v913: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:53.513 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:53 smithi176 ceph-mon[80162]: pgmap v913: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:16:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:55 smithi046 ceph-mon[108126]: pgmap v914: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:55 smithi176 ceph-mon[80162]: pgmap v914: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:16:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:57 smithi046 ceph-mon[108126]: pgmap v915: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:57 smithi176 ceph-mon[80162]: pgmap v915: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:16:59.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:16:59 smithi046 ceph-mon[108126]: pgmap v916: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:16:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:16:59 smithi176 ceph-mon[80162]: pgmap v916: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:01.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:01 smithi046 ceph-mon[108126]: pgmap v917: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:01 smithi176 ceph-mon[80162]: pgmap v917: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:03 smithi046 ceph-mon[108126]: pgmap v918: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:03 smithi176 ceph-mon[80162]: pgmap v918: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:05.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:05 smithi046 ceph-mon[108126]: pgmap v919: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:05 smithi176 ceph-mon[80162]: pgmap v919: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:07.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:07 smithi046 ceph-mon[108126]: pgmap v920: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:07 smithi176 ceph-mon[80162]: pgmap v920: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:09 smithi046 ceph-mon[108126]: pgmap v921: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:09 smithi176 ceph-mon[80162]: pgmap v921: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:11.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:11 smithi046 ceph-mon[108126]: pgmap v922: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:11 smithi176 ceph-mon[80162]: pgmap v922: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:13.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:13 smithi046 ceph-mon[108126]: pgmap v923: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:13 smithi176 ceph-mon[80162]: pgmap v923: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:15 smithi046 ceph-mon[108126]: pgmap v924: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:15 smithi176 ceph-mon[80162]: pgmap v924: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:17.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:17 smithi046 ceph-mon[108126]: pgmap v925: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:17 smithi176 ceph-mon[80162]: pgmap v925: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:19.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:19 smithi176 ceph-mon[80162]: pgmap v926: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:19.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:19 smithi046 ceph-mon[108126]: pgmap v926: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:21 smithi046 ceph-mon[108126]: pgmap v927: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:21 smithi176 ceph-mon[80162]: pgmap v927: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:23 smithi176 ceph-mon[80162]: pgmap v928: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:23 smithi046 ceph-mon[108126]: pgmap v928: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:25 smithi176 ceph-mon[80162]: pgmap v929: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:25.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:25 smithi046 ceph-mon[108126]: pgmap v929: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:27.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:27 smithi046 ceph-mon[108126]: pgmap v930: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:27 smithi176 ceph-mon[80162]: pgmap v930: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:29 smithi176 ceph-mon[80162]: pgmap v931: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:29.608 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:29 smithi046 ceph-mon[108126]: pgmap v931: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:31 smithi176 ceph-mon[80162]: pgmap v932: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:31.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:31 smithi046 ceph-mon[108126]: pgmap v932: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:33.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:33 smithi046 ceph-mon[108126]: pgmap v933: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:33 smithi176 ceph-mon[80162]: pgmap v933: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:35 smithi176 ceph-mon[80162]: pgmap v934: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:35.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:35 smithi046 ceph-mon[108126]: pgmap v934: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:37 smithi176 ceph-mon[80162]: pgmap v935: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:37 smithi046 ceph-mon[108126]: pgmap v935: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:39.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:39 smithi046 ceph-mon[108126]: pgmap v936: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:39 smithi176 ceph-mon[80162]: pgmap v936: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:40.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:40 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:17:40.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:40 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:17:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:41 smithi176 ceph-mon[80162]: pgmap v937: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:17:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:17:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:17:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:41 smithi046 ceph-mon[108126]: pgmap v937: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:17:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:17:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:17:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:43 smithi176 ceph-mon[80162]: pgmap v938: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:43 smithi046 ceph-mon[108126]: pgmap v938: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:45 smithi176 ceph-mon[80162]: pgmap v939: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:45 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:45.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:45 smithi046 ceph-mon[108126]: pgmap v939: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:45.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:45 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:17:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:47 smithi176 ceph-mon[80162]: pgmap v940: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:47 smithi046 ceph-mon[108126]: pgmap v940: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:49.526 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:49 smithi176 ceph-mon[80162]: pgmap v941: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:49 smithi046 ceph-mon[108126]: pgmap v941: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:51 smithi046 ceph-mon[108126]: pgmap v942: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:51.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:51 smithi176 ceph-mon[80162]: pgmap v942: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:53.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:53 smithi176 ceph-mon[80162]: pgmap v943: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:53 smithi046 ceph-mon[108126]: pgmap v943: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:17:55.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:55 smithi046 ceph-mon[108126]: pgmap v944: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:55.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:55 smithi176 ceph-mon[80162]: pgmap v944: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:17:57.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:57 smithi046 ceph-mon[108126]: pgmap v945: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:57.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:57 smithi176 ceph-mon[80162]: pgmap v945: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:17:59.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:17:59 smithi176 ceph-mon[80162]: pgmap v946: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:17:59.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:17:59 smithi046 ceph-mon[108126]: pgmap v946: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:00.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:00 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:00.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:00 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:01.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:01 smithi176 ceph-mon[80162]: pgmap v947: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:01.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:01 smithi046 ceph-mon[108126]: pgmap v947: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:03.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:03 smithi046 ceph-mon[108126]: pgmap v948: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:03.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:03 smithi176 ceph-mon[80162]: pgmap v948: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:05.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:05 smithi176 ceph-mon[80162]: pgmap v949: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:05.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:05 smithi046 ceph-mon[108126]: pgmap v949: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:07.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:07 smithi176 ceph-mon[80162]: pgmap v950: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:07.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:07 smithi046 ceph-mon[108126]: pgmap v950: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:09.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:09 smithi046 ceph-mon[108126]: pgmap v951: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:09.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:09 smithi176 ceph-mon[80162]: pgmap v951: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:11.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:11 smithi176 ceph-mon[80162]: pgmap v952: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:11.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:11 smithi046 ceph-mon[108126]: pgmap v952: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:13.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:13 smithi176 ceph-mon[80162]: pgmap v953: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:13.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:13 smithi046 ceph-mon[108126]: pgmap v953: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:15.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:15 smithi046 ceph-mon[108126]: pgmap v954: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:15.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:15 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:15 smithi176 ceph-mon[80162]: pgmap v954: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:15.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:15 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:17.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:17 smithi176 ceph-mon[80162]: pgmap v955: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:17.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:17 smithi046 ceph-mon[108126]: pgmap v955: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:19.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:19 smithi176 ceph-mon[80162]: pgmap v956: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:19.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:19 smithi046 ceph-mon[108126]: pgmap v956: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:21.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:21 smithi046 ceph-mon[108126]: pgmap v957: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:21.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:21 smithi176 ceph-mon[80162]: pgmap v957: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:23.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:23 smithi176 ceph-mon[80162]: pgmap v958: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:23.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:23 smithi046 ceph-mon[108126]: pgmap v958: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:25.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:25 smithi176 ceph-mon[80162]: pgmap v959: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:25.656 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:25 smithi046 ceph-mon[108126]: pgmap v959: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:27.412 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:27 smithi046 ceph-mon[108126]: pgmap v960: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:27.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:27 smithi176 ceph-mon[80162]: pgmap v960: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:29.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:29 smithi176 ceph-mon[80162]: pgmap v961: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:29.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:29 smithi046 ceph-mon[108126]: pgmap v961: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:30.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:30 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:30.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:30 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:31.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:31 smithi176 ceph-mon[80162]: pgmap v962: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:31.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:31 smithi046 ceph-mon[108126]: pgmap v962: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:33.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:33 smithi046 ceph-mon[108126]: pgmap v963: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:33.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:33 smithi176 ceph-mon[80162]: pgmap v963: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:35.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:35 smithi176 ceph-mon[80162]: pgmap v964: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:35.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:35 smithi046 ceph-mon[108126]: pgmap v964: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:37.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:37 smithi176 ceph-mon[80162]: pgmap v965: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:37.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:37 smithi046 ceph-mon[108126]: pgmap v965: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:39.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:39 smithi046 ceph-mon[108126]: pgmap v966: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:39.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:39 smithi176 ceph-mon[80162]: pgmap v966: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:41 smithi176 ceph-mon[80162]: pgmap v967: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:18:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:18:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:18:41.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:41 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:18:41.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:41 smithi046 ceph-mon[108126]: pgmap v967: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T13:18:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T13:18:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T13:18:41.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:41 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' 2024-09-21T13:18:43.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:43 smithi176 ceph-mon[80162]: pgmap v968: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:43.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:43 smithi046 ceph-mon[108126]: pgmap v968: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:44.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:44 smithi176 ceph-mon[80162]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:44.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:44 smithi046 ceph-mon[108126]: from='mgr.14742 172.21.15.46:0/1377916471' entity='mgr.smithi046.vedsjs' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T13:18:45.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:45 smithi046 ceph-mon[108126]: pgmap v969: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:45.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:45 smithi176 ceph-mon[80162]: pgmap v969: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:47.566 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:47 smithi176 ceph-mon[80162]: pgmap v970: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:47.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:47 smithi046 ceph-mon[108126]: pgmap v970: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:49.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:49 smithi046 ceph-mon[108126]: pgmap v971: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:49.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:49 smithi176 ceph-mon[80162]: pgmap v971: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-21T13:18:51.411 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:51 smithi046 ceph-mon[108126]: pgmap v972: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:51.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:51 smithi176 ceph-mon[80162]: pgmap v972: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-21T13:18:53.661 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:53 smithi046 ceph-mon[108126]: pgmap v973: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:53.816 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:53 smithi176 ceph-mon[80162]: pgmap v973: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-21T13:18:55.662 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:55 smithi046 ceph-mon[108126]: pgmap v974: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:55.728 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:55 smithi176 ceph-mon[80162]: pgmap v974: 65 pgs: 65 active+clean; 276 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-21T13:18:55.884 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-21T13:18:55.884 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T13:18:55.885 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T13:18:55.896 INFO:tasks.cephadm:Teardown begin 2024-09-21T13:18:55.896 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T13:18:55.897 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:18:55.932 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:18:55.962 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T13:18:55.962 DEBUG:teuthology.orchestra.run.smithi046:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T13:18:55.991 DEBUG:teuthology.orchestra.run.smithi176:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T13:18:56.018 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T13:18:56.018 INFO:tasks.cephadm.mon.smithi046:Stopping mon.smithi046... 2024-09-21T13:18:56.018 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046 2024-09-21T13:18:56.230 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:56 smithi046 systemd[1]: Stopping Ceph mon.smithi046 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:18:56.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:56 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T13:18:56.365+0000 7f662374d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi046 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:18:56.492 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:56 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046[108122]: 2024-09-21T13:18:56.365+0000 7f662374d640 -1 mon.smithi046@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T13:18:56.493 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:56 smithi046 podman[155055]: 2024-09-21 13:18:56.397001186 +0000 UTC m=+0.162998685 container died 805012a2e2d14590453420b628edf132c753e19a95f48451e12a46d7e2acbae2 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T13:18:57.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:56 smithi046 podman[155055]: 2024-09-21 13:18:56.867282822 +0000 UTC m=+0.633280313 container cleanup 805012a2e2d14590453420b628edf132c753e19a95f48451e12a46d7e2acbae2 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T13:18:57.118 INFO:journalctl@ceph.mon.smithi046.smithi046.stdout:Sep 21 13:18:56 smithi046 bash[155055]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi046 2024-09-21T13:18:57.306 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi046.service' 2024-09-21T13:18:57.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:18:57.351 INFO:tasks.cephadm.mon.smithi046:Stopped mon.smithi046 2024-09-21T13:18:57.352 INFO:tasks.cephadm.mon.smithi176:Stopping mon.smithi176... 2024-09-21T13:18:57.352 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176 2024-09-21T13:18:57.678 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:57 smithi176 systemd[1]: Stopping Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:18:58.028 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:57 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176[80158]: 2024-09-21T13:18:57.676+0000 7f637b9bd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi176 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:18:58.028 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:57 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176[80158]: 2024-09-21T13:18:57.676+0000 7f637b9bd640 -1 mon.smithi176@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T13:18:58.028 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:57 smithi176 podman[114403]: 2024-09-21 13:18:57.769551606 +0000 UTC m=+0.217015141 container died 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T13:18:58.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:58 smithi176 podman[114403]: 2024-09-21 13:18:58.210479426 +0000 UTC m=+0.657943003 container cleanup 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True) 2024-09-21T13:18:58.316 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:58 smithi176 bash[114403]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176 2024-09-21T13:18:58.640 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176.service' 2024-09-21T13:18:58.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:58 smithi176 podman[114416]: 2024-09-21 13:18:58.403729627 +0000 UTC m=+0.633002564 container remove 0eb7759cb8cb97a7dd2fcedd4e518b85b981aaafd08a1f13446532652ee055a8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-mon-smithi176, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T13:18:58.662 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:58 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176.service: Deactivated successfully. 2024-09-21T13:18:58.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:58 smithi176 systemd[1]: Stopped Ceph mon.smithi176 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T13:18:58.663 INFO:journalctl@ceph.mon.smithi176.smithi176.stdout:Sep 21 13:18:58 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@mon.smithi176.service: Consumed 12.109s CPU time. 2024-09-21T13:18:58.685 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:18:58.685 INFO:tasks.cephadm.mon.smithi176:Stopped mon.smithi176 2024-09-21T13:18:58.686 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T13:18:58.686 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.0 2024-09-21T13:18:59.014 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:18:58 smithi046 systemd[1]: Stopping Ceph osd.0 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:18:59.411 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:18:59 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[116797]: 2024-09-21T13:18:59.012+0000 7f28f4098640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:18:59.411 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:18:59 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[116797]: 2024-09-21T13:18:59.012+0000 7f28f4098640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-21T13:18:59.411 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:18:59 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0[116797]: 2024-09-21T13:18:59.012+0000 7f28f4098640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:19:04.591 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:04 smithi046 podman[155192]: 2024-09-21 13:19:04.329789193 +0000 UTC m=+5.449892138 container died b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T13:19:04.911 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:04 smithi046 podman[155192]: 2024-09-21 13:19:04.663945912 +0000 UTC m=+5.784048860 container cleanup b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T13:19:04.912 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:04 smithi046 bash[155192]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0 2024-09-21T13:19:05.411 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155215]: 2024-09-21 13:19:05.024087974 +0000 UTC m=+0.694681342 container remove b6ae673b9b35391935b2958fc90e3f02080df21a4f95cfb06b3786d9fc6612da (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T13:19:05.764 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155307]: 2024-09-21 13:19:05.358824995 +0000 UTC m=+0.016434320 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:19:05.764 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155307]: 2024-09-21 13:19:05.491878101 +0000 UTC m=+0.149487455 container create bbee970b94ce7db191a3b2a116d896dc6d603f262e216763b58f62cad17e916a (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T13:19:05.765 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155307]: 2024-09-21 13:19:05.763958974 +0000 UTC m=+0.421568297 container init bbee970b94ce7db191a3b2a116d896dc6d603f262e216763b58f62cad17e916a (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T13:19:06.114 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155307]: 2024-09-21 13:19:05.768299716 +0000 UTC m=+0.425909032 container start bbee970b94ce7db191a3b2a116d896dc6d603f262e216763b58f62cad17e916a (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T13:19:06.115 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155307]: 2024-09-21 13:19:05.869357456 +0000 UTC m=+0.526966897 container attach bbee970b94ce7db191a3b2a116d896dc6d603f262e216763b58f62cad17e916a (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-21T13:19:06.115 INFO:journalctl@ceph.osd.0.smithi046.stdout:Sep 21 13:19:05 smithi046 podman[155307]: 2024-09-21 13:19:05.965788576 +0000 UTC m=+0.623397887 container died bbee970b94ce7db191a3b2a116d896dc6d603f262e216763b58f62cad17e916a (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T13:19:06.726 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T13:19:06.769 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:19:06.769 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T13:19:06.769 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T13:19:06.769 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.1 2024-09-21T13:19:07.128 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:06 smithi046 systemd[1]: Stopping Ceph osd.1 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:19:07.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:07 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[122593]: 2024-09-21T13:19:07.126+0000 7fc74ed1d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:19:07.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:07 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[122593]: 2024-09-21T13:19:07.126+0000 7fc74ed1d640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-21T13:19:07.412 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:07 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1[122593]: 2024-09-21T13:19:07.126+0000 7fc74ed1d640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:19:12.738 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:12 smithi046 podman[155410]: 2024-09-21 13:19:12.452564976 +0000 UTC m=+5.446367883 container died 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T13:19:13.137 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:12 smithi046 podman[155410]: 2024-09-21 13:19:12.835371944 +0000 UTC m=+5.829174847 container cleanup 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:19:13.137 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:12 smithi046 bash[155410]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1 2024-09-21T13:19:13.411 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155428]: 2024-09-21 13:19:13.137078152 +0000 UTC m=+0.682698649 container remove 7f56a266a9987430833ad31164f12c808afa5138ab4300684378ca099912ca17 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T13:19:13.782 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155513]: 2024-09-21 13:19:13.376070965 +0000 UTC m=+0.016503032 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:19:13.782 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155513]: 2024-09-21 13:19:13.496338031 +0000 UTC m=+0.136770097 container create 60b17fee885407d229d2924fa7b28e4e6b54a609a4f860d904994f3479cc84b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T13:19:13.782 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155513]: 2024-09-21 13:19:13.698617134 +0000 UTC m=+0.339049208 container init 60b17fee885407d229d2924fa7b28e4e6b54a609a4f860d904994f3479cc84b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T13:19:13.782 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155513]: 2024-09-21 13:19:13.7021046 +0000 UTC m=+0.342536676 container start 60b17fee885407d229d2924fa7b28e4e6b54a609a4f860d904994f3479cc84b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-21T13:19:13.782 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155513]: 2024-09-21 13:19:13.781894667 +0000 UTC m=+0.422326750 container attach 60b17fee885407d229d2924fa7b28e4e6b54a609a4f860d904994f3479cc84b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-21T13:19:14.162 INFO:journalctl@ceph.osd.1.smithi046.stdout:Sep 21 13:19:13 smithi046 podman[155513]: 2024-09-21 13:19:13.896361195 +0000 UTC m=+0.536793262 container died 60b17fee885407d229d2924fa7b28e4e6b54a609a4f860d904994f3479cc84b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:19:14.502 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T13:19:14.545 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:19:14.545 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T13:19:14.545 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T13:19:14.545 DEBUG:teuthology.orchestra.run.smithi046:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.2 2024-09-21T13:19:14.864 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:14 smithi046 systemd[1]: Stopping Ceph osd.2 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:19:15.115 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:14 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[128049]: 2024-09-21T13:19:14.863+0000 7ff188c6b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:19:15.115 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:14 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[128049]: 2024-09-21T13:19:14.863+0000 7ff188c6b640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-21T13:19:15.115 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:14 smithi046 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2[128049]: 2024-09-21T13:19:14.863+0000 7ff188c6b640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:19:20.615 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:20 smithi046 podman[155615]: 2024-09-21 13:19:20.301551818 +0000 UTC m=+5.529730889 container died 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T13:19:20.911 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:20 smithi046 podman[155615]: 2024-09-21 13:19:20.7053813 +0000 UTC m=+5.933560366 container cleanup 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T13:19:20.911 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:20 smithi046 bash[155615]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2 2024-09-21T13:19:21.287 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:20 smithi046 podman[155630]: 2024-09-21 13:19:20.964987517 +0000 UTC m=+0.664907160 container remove 4fc21225a6a84e76c0ba1e2f5a5e44efe4d58e34cd996f4d0917d8e5a1f65af5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T13:19:21.552 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:21 smithi046 podman[155716]: 2024-09-21 13:19:21.189595261 +0000 UTC m=+0.016683153 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:19:21.552 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:21 smithi046 podman[155716]: 2024-09-21 13:19:21.290820869 +0000 UTC m=+0.117908761 container create 8952a032a91cab1a0ae7ec6038daa5fdbf02464a3b33d78ce46eca19a36ecb64 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T13:19:21.552 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:21 smithi046 podman[155716]: 2024-09-21 13:19:21.552012668 +0000 UTC m=+0.379100569 container init 8952a032a91cab1a0ae7ec6038daa5fdbf02464a3b33d78ce46eca19a36ecb64 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T13:19:21.882 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:21 smithi046 podman[155716]: 2024-09-21 13:19:21.555969346 +0000 UTC m=+0.383057242 container start 8952a032a91cab1a0ae7ec6038daa5fdbf02464a3b33d78ce46eca19a36ecb64 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:19:21.882 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:21 smithi046 podman[155716]: 2024-09-21 13:19:21.651755059 +0000 UTC m=+0.478842969 container attach 8952a032a91cab1a0ae7ec6038daa5fdbf02464a3b33d78ce46eca19a36ecb64 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:19:21.882 INFO:journalctl@ceph.osd.2.smithi046.stdout:Sep 21 13:19:21 smithi046 podman[155716]: 2024-09-21 13:19:21.77161246 +0000 UTC m=+0.598700361 container died 8952a032a91cab1a0ae7ec6038daa5fdbf02464a3b33d78ce46eca19a36ecb64 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:19:22.400 DEBUG:teuthology.orchestra.run.smithi046:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T13:19:22.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:19:22.446 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T13:19:22.446 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T13:19:22.446 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.3 2024-09-21T13:19:22.773 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:22 smithi176 systemd[1]: Stopping Ceph osd.3 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:19:23.066 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:22 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T13:19:22.772+0000 7fc2726ab640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:19:23.066 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:22 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T13:19:22.772+0000 7fc2726ab640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-21T13:19:23.066 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:22 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T13:19:22.772+0000 7fc2726ab640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:19:25.204 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:24 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:24.905+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:25.566 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:25 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T13:19:25.203+0000 7fc26ecc0640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:01.250763+0000 front 2024-09-21T13:19:01.250732+0000 (oldest deadline 2024-09-21T13:19:24.750548+0000) 2024-09-21T13:19:26.214 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:25 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:25.945+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:26.566 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:26 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T13:19:26.214+0000 7fc26ecc0640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:01.250763+0000 front 2024-09-21T13:19:01.250732+0000 (oldest deadline 2024-09-21T13:19:24.750548+0000) 2024-09-21T13:19:27.211 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:27 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:27.092+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:27.211 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:26 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:26.953+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:27.566 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:27 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3[88097]: 2024-09-21T13:19:27.210+0000 7fc26ecc0640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:01.250763+0000 front 2024-09-21T13:19:01.250732+0000 (oldest deadline 2024-09-21T13:19:24.750548+0000) 2024-09-21T13:19:28.248 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:27 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:27.978+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:28.249 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:28 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:28.059+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:28.540 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:28 smithi176 podman[114537]: 2024-09-21 13:19:28.24775399 +0000 UTC m=+5.582620385 container died 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T13:19:28.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:28 smithi176 podman[114537]: 2024-09-21 13:19:28.630474909 +0000 UTC m=+5.965341302 container cleanup 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-21T13:19:28.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:28 smithi176 bash[114537]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3 2024-09-21T13:19:29.174 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:28 smithi176 podman[114553]: 2024-09-21 13:19:28.848273927 +0000 UTC m=+0.601020393 container remove 92277842fa2d6ee42e1d93b07eb2fd086bf6ed8205b3abe64e0c155391224881 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-21T13:19:29.174 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:28 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:28.974+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:29.175 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:29 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:29.025+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:29.435 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:29 smithi176 podman[114641]: 2024-09-21 13:19:29.07687301 +0000 UTC m=+0.016017832 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:19:29.435 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:29 smithi176 podman[114641]: 2024-09-21 13:19:29.215718526 +0000 UTC m=+0.154863345 container create 3c6b5c2a4cf04457aa1774fc6dd663da17d143dd764d74801c780e6ffdd297e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T13:19:29.435 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:29 smithi176 podman[114641]: 2024-09-21 13:19:29.434860039 +0000 UTC m=+0.374004879 container init 3c6b5c2a4cf04457aa1774fc6dd663da17d143dd764d74801c780e6ffdd297e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T13:19:29.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:29 smithi176 podman[114641]: 2024-09-21 13:19:29.438273632 +0000 UTC m=+0.377418454 container start 3c6b5c2a4cf04457aa1774fc6dd663da17d143dd764d74801c780e6ffdd297e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T13:19:29.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:29 smithi176 podman[114641]: 2024-09-21 13:19:29.518168583 +0000 UTC m=+0.457313422 container attach 3c6b5c2a4cf04457aa1774fc6dd663da17d143dd764d74801c780e6ffdd297e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T13:19:29.816 INFO:journalctl@ceph.osd.3.smithi176.stdout:Sep 21 13:19:29 smithi176 podman[114641]: 2024-09-21 13:19:29.627647458 +0000 UTC m=+0.566792293 container died 3c6b5c2a4cf04457aa1774fc6dd663da17d143dd764d74801c780e6ffdd297e0 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T13:19:30.230 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:29 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:29.978+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:30.230 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:30.053+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:30.250 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T13:19:30.291 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:19:30.291 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T13:19:30.291 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T13:19:30.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.4 2024-09-21T13:19:30.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:30 smithi176 systemd[1]: Stopping Ceph osd.4 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:19:30.934 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:30.641+0000 7ff07b869640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:19:30.934 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:30.641+0000 7ff07b869640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-21T13:19:30.934 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:30.642+0000 7ff07b869640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:19:30.934 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:30 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:30.931+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:31.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:31 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:31.049+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:32.296 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:31 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:31.887+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:32.297 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:32 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:32.077+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:33.316 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:32 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:32.839+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:33.316 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:32 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:32.839+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:06.556526+0000 front 2024-09-21T13:19:06.556481+0000 (oldest deadline 2024-09-21T13:19:32.456423+0000) 2024-09-21T13:19:33.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:33 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:33.088+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:33.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:33 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:33.088+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:34.316 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:33 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:33.883+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:34.316 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:33 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:33.883+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:06.556526+0000 front 2024-09-21T13:19:06.556481+0000 (oldest deadline 2024-09-21T13:19:32.456423+0000) 2024-09-21T13:19:34.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:34 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:34.106+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:34.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:34 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:34.106+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:35.316 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:34 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:34.858+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.855432+0000 front 2024-09-21T13:19:00.855390+0000 (oldest deadline 2024-09-21T13:19:24.355347+0000) 2024-09-21T13:19:35.316 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:34 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4[93132]: 2024-09-21T13:19:34.858+0000 7ff073e76640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:06.556526+0000 front 2024-09-21T13:19:06.556481+0000 (oldest deadline 2024-09-21T13:19:32.456423+0000) 2024-09-21T13:19:35.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:35 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:35.069+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:35.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:35 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:35.069+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:36.251 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:35 smithi176 podman[114744]: 2024-09-21 13:19:35.970604648 +0000 UTC m=+5.454873016 container died 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:19:36.251 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:36 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:36.052+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:36.251 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:36 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:36.052+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:36.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:36 smithi176 podman[114744]: 2024-09-21 13:19:36.349800236 +0000 UTC m=+5.834068593 container cleanup 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T13:19:36.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:36 smithi176 bash[114744]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4 2024-09-21T13:19:36.973 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:36 smithi176 podman[114762]: 2024-09-21 13:19:36.609269827 +0000 UTC m=+0.637119678 container remove 614ac268f0312ded62ce368a015fffef31077b63bfa1554507b2fcbf9148f10f (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T13:19:37.246 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:37 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:37.011+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:37.246 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:37 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:37.011+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:37.246 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:36 smithi176 podman[114853]: 2024-09-21 13:19:36.875324788 +0000 UTC m=+0.016218536 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:19:37.247 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:37 smithi176 podman[114853]: 2024-09-21 13:19:37.001787573 +0000 UTC m=+0.142681315 container create 8a11eeac3e3ccebbd242233cea149ebccc998f0c48447e20ef38e1ecb2148af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849) 2024-09-21T13:19:37.247 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:37 smithi176 podman[114853]: 2024-09-21 13:19:37.246018275 +0000 UTC m=+0.386912010 container init 8a11eeac3e3ccebbd242233cea149ebccc998f0c48447e20ef38e1ecb2148af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS) 2024-09-21T13:19:37.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:37 smithi176 podman[114853]: 2024-09-21 13:19:37.249804592 +0000 UTC m=+0.390698336 container start 8a11eeac3e3ccebbd242233cea149ebccc998f0c48447e20ef38e1ecb2148af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T13:19:37.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:37 smithi176 podman[114853]: 2024-09-21 13:19:37.337732813 +0000 UTC m=+0.478626549 container attach 8a11eeac3e3ccebbd242233cea149ebccc998f0c48447e20ef38e1ecb2148af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T13:19:37.566 INFO:journalctl@ceph.osd.4.smithi176.stdout:Sep 21 13:19:37 smithi176 podman[114853]: 2024-09-21 13:19:37.443223322 +0000 UTC m=+0.584117067 container died 8a11eeac3e3ccebbd242233cea149ebccc998f0c48447e20ef38e1ecb2148af3 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:19:38.041 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.014+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:38.041 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.014+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:38.070 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T13:19:38.109 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:19:38.110 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T13:19:38.110 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T13:19:38.110 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5 2024-09-21T13:19:38.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 systemd[1]: Stopping Ceph osd.5 for 297e1ece-7816-11ef-baf6-efdc52797490... 2024-09-21T13:19:38.816 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.427+0000 7faa2619c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T13:19:38.816 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.427+0000 7faa2619c640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-21T13:19:38.816 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.427+0000 7faa2619c640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T13:19:39.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.982+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:39.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:38 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:38.982+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:40.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:39 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:39.948+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:40.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:39 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:39.948+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:41.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:40 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:40.904+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:41.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:40 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:40.904+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:42.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:41 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:41.861+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:42.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:41 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:41.861+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:43.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:42 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:42.899+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6806 osd.0 since back 2024-09-21T13:19:00.821511+0000 front 2024-09-21T13:19:00.821492+0000 (oldest deadline 2024-09-21T13:19:26.121380+0000) 2024-09-21T13:19:43.316 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:42 smithi176 ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5[97999]: 2024-09-21T13:19:42.899+0000 7faa1e7a9640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.46:6814 osd.1 since back 2024-09-21T13:19:09.022208+0000 front 2024-09-21T13:19:09.022247+0000 (oldest deadline 2024-09-21T13:19:32.522114+0000) 2024-09-21T13:19:44.153 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:43 smithi176 podman[114958]: 2024-09-21 13:19:43.831417908 +0000 UTC m=+5.506359075 container died c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T13:19:44.153 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:44 smithi176 podman[114958]: 2024-09-21 13:19:44.152430935 +0000 UTC m=+5.827372101 container cleanup c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T13:19:44.566 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:44 smithi176 bash[114958]: ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5 2024-09-21T13:19:44.566 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:44 smithi176 podman[114973]: 2024-09-21 13:19:44.361940775 +0000 UTC m=+0.528811462 container remove c461494c32274261a054c1a447e5438af03b84d0c273ef840b80fe30f49d0bb8 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T13:19:45.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:44 smithi176 podman[115058]: 2024-09-21 13:19:44.671592127 +0000 UTC m=+0.016142720 image pull b415816db8b41f544cdfdc71d193ff8b1ee008bf7b0ec4f64da8eb8f71b62e85 quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5 2024-09-21T13:19:45.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:44 smithi176 podman[115058]: 2024-09-21 13:19:44.787613332 +0000 UTC m=+0.132163921 container create ebc3cb6877d254e4357f66d54bfc041d377338d3296a786c5b27c39f6045a400 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0842-4417849, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-09-21T13:19:45.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 podman[115058]: 2024-09-21 13:19:45.015032551 +0000 UTC m=+0.359583147 container init ebc3cb6877d254e4357f66d54bfc041d377338d3296a786c5b27c39f6045a400 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-main-2024-09-21-0842-4417849, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T13:19:45.066 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 podman[115058]: 2024-09-21 13:19:45.018318692 +0000 UTC m=+0.362869286 container start ebc3cb6877d254e4357f66d54bfc041d377338d3296a786c5b27c39f6045a400 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T13:19:45.502 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 podman[115058]: 2024-09-21 13:19:45.094556949 +0000 UTC m=+0.439107548 container attach ebc3cb6877d254e4357f66d54bfc041d377338d3296a786c5b27c39f6045a400 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T13:19:45.502 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 podman[115058]: 2024-09-21 13:19:45.204993614 +0000 UTC m=+0.549544209 container died ebc3cb6877d254e4357f66d54bfc041d377338d3296a786c5b27c39f6045a400 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0842-4417849, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:19:45.737 DEBUG:teuthology.orchestra.run.smithi176:> sudo pkill -f 'journalctl -f -n 0 -u ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T13:19:45.760 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 podman[115081]: 2024-09-21 13:19:45.718261341 +0000 UTC m=+0.507417267 container remove ebc3cb6877d254e4357f66d54bfc041d377338d3296a786c5b27c39f6045a400 (image=quay.ceph.io/ceph-ci/ceph@sha256:f8fbbbcab363df772d74f326e361db3b4f83aa3233da1ebe9de08a83e748d9f5, name=ceph-297e1ece-7816-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0842-4417849, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T13:19:45.760 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T13:19:45.760 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 systemd[1]: Stopped Ceph osd.5 for 297e1ece-7816-11ef-baf6-efdc52797490. 2024-09-21T13:19:45.760 INFO:journalctl@ceph.osd.5.smithi176.stdout:Sep 21 13:19:45 smithi176 systemd[1]: ceph-297e1ece-7816-11ef-baf6-efdc52797490@osd.5.service: Consumed 12.509s CPU time. 2024-09-21T13:19:45.775 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T13:19:45.776 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T13:19:45.776 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 297e1ece-7816-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T13:19:45.989 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T13:19:50.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi046.stderr:ceph-fuse[75125]: fuse finished with error 0 and tester_r 0 2024-09-21T13:20:08.886 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 297e1ece-7816-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T13:20:09.091 INFO:teuthology.orchestra.run.smithi176.stdout:Deleting cluster with fsid: 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T13:20:24.070 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:20:24.105 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T13:20:24.132 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T13:20:24.133 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946/remote/smithi046/crash 2024-09-21T13:20:24.134 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash -- . 2024-09-21T13:20:24.173 INFO:teuthology.orchestra.run.smithi046.stderr:tar: /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T13:20:24.173 INFO:teuthology.orchestra.run.smithi046.stderr:tar: Error is not recoverable: exiting now 2024-09-21T13:20:24.175 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946/remote/smithi176/crash 2024-09-21T13:20:24.176 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash -- . 2024-09-21T13:20:24.199 INFO:teuthology.orchestra.run.smithi176.stderr:tar: /var/lib/ceph/297e1ece-7816-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T13:20:24.199 INFO:teuthology.orchestra.run.smithi176.stderr:tar: Error is not recoverable: exiting now 2024-09-21T13:20:24.201 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T13:20:24.201 DEBUG:teuthology.orchestra.run.smithi046:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T13:20:24.251 INFO:teuthology.orchestra.run.smithi046.stdout:2024-09-21T13:00:00.000190+0000 mon.smithi046 (mon.0) 581 : cluster [ERR] fs cephfs is offline because no MDS is active for it. 2024-09-21T13:20:24.252 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-21T13:20:24.252 INFO:tasks.cephadm:Compressing logs... 2024-09-21T13:20:24.252 DEBUG:teuthology.orchestra.run.smithi046:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T13:20:24.295 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T13:20:24.320 INFO:teuthology.orchestra.run.smithi176.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T13:20:24.320 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-21T13:20:24.320 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi176.whwfab.log 2024-09-21T13:20:24.320 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T13:20:24.320 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi176.whwfab.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T13:20:24.325 INFO:teuthology.orchestra.run.smithi176.stderr:gzip/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-volume.log: -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T13:20:24.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T13:20:24.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mon.smithi176.log 2024-09-21T13:20:24.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.cephadm.log: 84.9% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T13:20:24.325 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T13:20:24.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mon.smithi176.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:: No such file or directory 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mon.smithi046.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi046.hxdqyf.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mon.smithi046.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi046.hxdqyf.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi046.ffxnex.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi046.ffxnex.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mgr.smithi046.vedsjs.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T13:20:24.326 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mgr.smithi046.vedsjs.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi046.log 2024-09-21T13:20:24.327 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.5.log: 91.6% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T13:20:24.329 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.audit.log: 91.5% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T13:20:24.330 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T13:20:24.333 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mgr.smithi176.rmyfjh.log 2024-09-21T13:20:24.334 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi046.log: 94.3% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi046.log.gz 2024-09-21T13:20:24.335 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T13:20:24.336 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.cephadm.log: 86.3% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T13:20:24.337 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log 2024-09-21T13:20:24.338 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log: 89.4% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T13:20:24.346 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T13:20:24.347 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi176.kzzdid.log 2024-09-21T13:20:24.347 INFO:teuthology.orchestra.run.smithi176.stderr: 91.3% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T13:20:24.352 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log: 91.3% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T13:20:24.356 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mgr.smithi176.rmyfjh.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi176.log 2024-09-21T13:20:24.356 INFO:teuthology.orchestra.run.smithi046.stderr: 89.3% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T13:20:24.362 INFO:teuthology.orchestra.run.smithi046.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T13:20:24.367 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi176.kzzdid.log: gzip -5 --verbose -- /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T13:20:24.374 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi176.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T13:20:24.374 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.3.log: 94.3% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi176.log.gz 2024-09-21T13:20:24.395 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/cephadm.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T13:20:24.403 INFO:teuthology.orchestra.run.smithi176.stderr: 89.7% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mgr.smithi176.rmyfjh.log.gz 2024-09-21T13:20:24.416 INFO:teuthology.orchestra.run.smithi176.stderr: 94.6% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi176.whwfab.log.gz 2024-09-21T13:20:24.469 INFO:teuthology.orchestra.run.smithi046.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T13:20:24.853 INFO:teuthology.orchestra.run.smithi046.stderr: 89.7% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mgr.smithi046.vedsjs.log.gz 2024-09-21T13:20:24.868 INFO:teuthology.orchestra.run.smithi176.stderr: 92.5% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mon.smithi176.log.gz 2024-09-21T13:20:26.163 INFO:teuthology.orchestra.run.smithi046.stderr: 90.2% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mon.smithi046.log.gz 2024-09-21T13:20:28.478 INFO:teuthology.orchestra.run.smithi176.stderr: 93.8% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T13:20:29.118 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T13:20:29.744 INFO:teuthology.orchestra.run.smithi176.stderr: 93.8% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T13:20:30.422 INFO:teuthology.orchestra.run.smithi176.stderr: 93.8% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T13:20:30.514 INFO:teuthology.orchestra.run.smithi046.stderr: 93.7% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T13:20:31.756 INFO:teuthology.orchestra.run.smithi046.stderr: 93.8% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T13:20:31.965 INFO:teuthology.orchestra.run.smithi176.stderr: 94.9% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi176.kzzdid.log.gz 2024-09-21T13:20:39.508 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-21T13:20:39.508 INFO:teuthology.orchestra.run.smithi176.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-21T13:20:39.509 INFO:teuthology.orchestra.run.smithi176.stderr: 2024-09-21T13:20:39.510 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m15.200s 2024-09-21T13:20:39.510 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m37.923s 2024-09-21T13:20:39.510 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m1.142s 2024-09-21T13:20:40.128 INFO:teuthology.orchestra.run.smithi046.stderr: 94.9% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi046.ffxnex.log.gz 2024-09-21T13:20:40.915 INFO:teuthology.orchestra.run.smithi046.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T13:22:08.616 INFO:teuthology.orchestra.run.smithi046.stderr: 92.8% -- replaced with /var/log/ceph/297e1ece-7816-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi046.hxdqyf.log.gz 2024-09-21T13:22:08.618 INFO:teuthology.orchestra.run.smithi046.stderr: 2024-09-21T13:22:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:real 1m44.309s 2024-09-21T13:22:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:user 2m32.603s 2024-09-21T13:22:08.618 INFO:teuthology.orchestra.run.smithi046.stderr:sys 0m4.407s 2024-09-21T13:22:08.618 INFO:tasks.cephadm:Archiving logs... 2024-09-21T13:22:08.619 DEBUG:teuthology.misc:Transferring archived files from smithi046:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946/remote/smithi046/log 2024-09-21T13:22:08.620 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T13:22:27.974 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946/remote/smithi176/log 2024-09-21T13:22:27.975 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T13:22:32.661 INFO:tasks.cephadm:Removing cluster... 2024-09-21T13:22:32.662 DEBUG:teuthology.orchestra.run.smithi046:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 297e1ece-7816-11ef-baf6-efdc52797490 --force 2024-09-21T13:22:32.875 INFO:teuthology.orchestra.run.smithi046.stdout:Deleting cluster with fsid: 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T13:22:33.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 297e1ece-7816-11ef-baf6-efdc52797490 --force 2024-09-21T13:22:33.497 INFO:teuthology.orchestra.run.smithi176.stdout:Deleting cluster with fsid: 297e1ece-7816-11ef-baf6-efdc52797490 2024-09-21T13:22:33.783 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T13:22:33.784 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T13:22:33.801 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T13:22:33.816 INFO:tasks.cephadm:Teardown complete 2024-09-21T13:22:33.816 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T13:22:33.826 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T13:22:33.827 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T13:22:33.827 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T13:22:33.843 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T13:22:33.935 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T13:22:33.944 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T13:22:33.945 DEBUG:teuthology.orchestra.run.smithi046:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:22:33.947 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T13:22:33.961 INFO:teuthology.orchestra.run.smithi046.stderr:bash: line 1: ntpq: command not found 2024-09-21T13:22:33.962 INFO:teuthology.orchestra.run.smithi176.stderr:bash: line 1: ntpq: command not found 2024-09-21T13:22:33.966 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T13:22:33.966 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2024-09-21T13:22:33.966 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv01.front.sepia.ceph.com 3 6 377 25 +416us[ +417us] +/- 45ms 2024-09-21T13:22:33.967 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 90 -1217us[-1211us] +/- 71ms 2024-09-21T13:22:33.967 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +929us[ +931us] +/- 84ms 2024-09-21T13:22:33.967 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:22:33.968 INFO:teuthology.orchestra.run.smithi046.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T13:22:33.968 INFO:teuthology.orchestra.run.smithi046.stdout:=============================================================================== 2024-09-21T13:22:33.968 INFO:teuthology.orchestra.run.smithi046.stdout:^* hv01.front.sepia.ceph.com 3 7 377 28 +388us[ +378us] +/- 45ms 2024-09-21T13:22:33.968 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1342us[-1342us] +/- 72ms 2024-09-21T13:22:33.968 INFO:teuthology.orchestra.run.smithi046.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +869us[ +869us] +/- 84ms 2024-09-21T13:22:33.968 INFO:teuthology.orchestra.run.smithi046.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T13:22:33.968 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T13:22:33.977 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T13:22:33.978 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T13:22:34.004 DEBUG:teuthology.orchestra.run.smithi046:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T13:22:34.094 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T13:22:34.167 DEBUG:teuthology.orchestra.run.smithi046:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T13:22:34.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:22:34.197 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T13:22:34.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:22:34.226 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T13:22:34.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T13:22:34.262 INFO:teuthology.task.internal:Duration was 3102.794357 seconds 2024-09-21T13:22:34.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T13:22:34.281 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T13:22:34.281 DEBUG:teuthology.orchestra.run.smithi046:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T13:22:34.283 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T13:22:34.322 INFO:teuthology.orchestra.run.smithi046.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T13:22:34.322 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T13:22:34.706 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T13:22:34.706 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi046.front.sepia.ceph.com 2024-09-21T13:22:34.707 DEBUG:teuthology.orchestra.run.smithi046:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T13:22:34.768 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2024-09-21T13:22:34.768 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T13:22:34.796 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T13:22:34.797 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T13:22:34.811 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T13:22:34.863 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T13:22:34.863 DEBUG:teuthology.orchestra.run.smithi046:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T13:22:34.879 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T13:22:35.813 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T13:22:35.825 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T13:22:35.825 DEBUG:teuthology.orchestra.run.smithi046:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T13:22:35.850 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T13:22:35.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T13:22:35.891 DEBUG:teuthology.orchestra.run.smithi046:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:22:35.894 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:22:35.915 INFO:teuthology.orchestra.run.smithi046.stdout:kernel.core_pattern = core 2024-09-21T13:22:35.947 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2024-09-21T13:22:35.971 DEBUG:teuthology.orchestra.run.smithi046:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:22:35.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:22:35.997 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T13:22:36.027 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:22:36.027 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T13:22:36.038 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T13:22:36.039 DEBUG:teuthology.misc:Transferring archived files from smithi046:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946/remote/smithi046 2024-09-21T13:22:36.039 DEBUG:teuthology.orchestra.run.smithi046:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T13:22:36.090 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_11:23:40-orch:cephadm-wip-guits-main-2024-09-21-0842-distro-default-smithi/7913946/remote/smithi176 2024-09-21T13:22:36.090 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T13:22:36.131 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T13:22:36.131 DEBUG:teuthology.orchestra.run.smithi046:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T13:22:36.135 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T13:22:36.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T13:22:36.193 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T13:22:36.194 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T13:22:36.205 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T13:22:36.205 DEBUG:teuthology.orchestra.run.smithi046:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T13:22:36.208 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T13:22:36.220 INFO:teuthology.orchestra.run.smithi046.stdout: 262169 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 21 13:22 /home/ubuntu/cephtest 2024-09-21T13:22:36.221 INFO:teuthology.orchestra.run.smithi046.stdout: 655444 4 d--------- 2 ubuntu ubuntu 4096 Sep 21 12:44 /home/ubuntu/cephtest/mnt.0 2024-09-21T13:22:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-21T13:22:36.222 INFO:teuthology.orchestra.run.smithi046.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-21T13:22:36.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T13:22:36.224 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_441784946648ff53dd310293f9dd752afeeea72a/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi046 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-21T13:22:36.225 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T13:22:36.236 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T13:22:36.247 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T13:22:36.250 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3102.7943568229675 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-21T13:22:36.250 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T13:22:36.353 INFO:teuthology.run:FAIL